This page gives an overview of events that have been co-organized or co-chaired by Webis.

Conferences and Distinguished Workshops

ArgMining 2019
The 6th International Workshop on Argument Mining, organized by Benno Stein and Henning Wachsmuth in 2019. Goal: foster future research and development in the area of computational argument mining.

PODA 2018
The 2018 Algorithmic Discourse Analysis Workshop, organized by Henning Schmidgen, Benno Stein, and Frank Simon-Ritz. Goal: bring together researchers and practitioners from the humanities, computer science, and information science to explore digital methods for the analysis of discourses.

CLEF 2013
The 2013 CLEF conference, organized by Paolo Rosso and Benno Stein, a continuation of the popular CLEF campaigns which have run since 2000. Goal: contribute to the systematic evaluation of information access systems, primarily through experimentation on shared tasks.

Dagstuhl Seminars

Conversational Search @ Schloss Dagstuhl 2019
Dagstuhl Seminar 19461 "Conversational Search", organized by Avishek Anand, Hideo Joho, Mark Sanderson, and Benno Stein in 2019. Goal: bring together leading researchers from relevant communities to understand and analyze the promising retrieval paradigm of conversational search and its future from different angles like interactivity, result presentation, clarification, user models, evaluation, and search behavior.

Debating Technologies @ Schloss Dagstuhl 2015
Dagstuhl Seminar 15512 "Debating Technologies", organized by Iryna Gurevych, Eduard H. Hovy, Noam Slonim, and Benno Stein in 2015. Goal: set the grounds for a new interdisciplinary research community, interested in Debating Technologies, defined henceforth as computational technologies developed directly to enhance, support, and engage with human debating.

Challenges in Document Mining @ Schloss Dagstuhl 2011
Dagstuhl Seminar 11171 "Challenges in Document Mining", organized by Hamish Cunningham, Oren Etzioni, Norbert Fuhr, and Benno Stein in 2011. Goal: bring together researchers from the main areas of document mining to present their views, understand where and how latest disciplinary achievements can be combined, and develop an integrative view on document mining. [abstracts and talks]

Extracurricular Teaching

Writing Style and Anonymity @ Studienstiftung des deutschen Volkes 2017
Workshop "Writing Style and Anonymity" (Schreibstil und Anonymität), organized by Martin Potthast in 2017. Goal: discuss current capabilities of technologies to manipulate writing style and possible repercussions on society of future applications.

NLP Approaches to Computational Argumentation @ ACL 2016
Tutorial "NLP Approaches to Computational Argumentation", organized by Noam Slonim, Iryna Gurevych, Chris Reed, and Benno Stein in 2016. Goal: review recent advances in the field of Computational Argumentation and outline the challenging research questions for the ACL community that naturally arise when trying to model human argumentation. [slides]

Who Wrote the Web? @ Studienstiftung des deutschen Volkes 2015
Workshop on authorship analysis technology. Goal: reproduce the top most influential approaches, and to share the resulting code base to foster future research and development in this area. [abstract and slides] [code] [paper]

Building a Research Group @ HLF 2014
HLF Workshop "Building a Successful Research Group", organized by Martin Potthast at the 2nd Heidelberg Laureate Forum in 2014. Goal: discuss with young researchers and laureates about the challenges and best practices of building a research group, and gain insights into the question of whether building a research group is better for a scientific career than working alone. [abstract] [slides]

Balance @ HLF 2013
HLF Workshop "Balance", organized by Matthias Hagen at the 1st Heidelberg Laureate Forum in 2013. Goal: discuss with young researchers and laureates about issues of maintaining a work-life balance as a successful scientist, and gain insights into the question of how to develop a research career and a growing family. [abstract] [slides]

WIQE 2010
PhD colloquium on Web Information and Quality Evaluation, organized by Paolo Rosso, Alberto Barrón-Cedeño, and Benno Stein 2010 in Valencia, Spain. Funded by a Marie Curie Action under the Seventh Framework Program. Goal: development of promising research directions related to robust methods for detecting low quality information, judging credibility and reliability, and separating contradicting facts or outdated information from valuable information assets.

Shared Tasks

TL;DR Challenge @ INLG 2019
A shared task organized by Shahbaz Syed, Michael Völske, Martin Potthast, Nedim Lipka, Hinrich Schütze and Benno Stein. Goal: Generate short summaries of social media posts using abstractive summarization technology. The task is hosted on the Webis evaluation-as-a-service platform TIRA.

Clickbait Challenge @ Google DNI 2018
Two shared tasks organized by Martin Potthast, Tim Gollub, Matthias Hagen, and Benno Stein. Goal: Detect teaser messages in social media that manipulate readers to click a link, namely clickbait. The task is hosted on the Webis evaluation-as-a-service platform TIRA.

E-sport Match Summarization @ MediaEval 2019
A shared task organized by the Mathias Lux, Michael Riegler, Duc-Tien Dang-Nguyen, Marcus Larson, Martin Potthast, and Pål Halvorsen. Twenty-six teams participated in the shared task. Goal: Synthesis of summaries of e-sports matches.

Argument Reasoning Comprehension @ SemEval 2018
A shared task organized by Ivan Habernal, Henning Wachsmuth, Iryna Gurevych, and Benno Stein, Webis. Goal: analyze and better understand certain hidden mechanisms of reasoning. Twenty-two teams participated in the shared task.

E-sport Match Summarization @ MediaEval 2018
A shared task organized by the Mathias Lux, Michael Riegler, Duc-Tien Dang-Nguyen, Marcus Larson, Martin Potthast, and Pål Halvorsen. Twenty-six teams participated in the shared task. Goal: Synthesis of summaries of e-sports matches. Three teams participated.

Universal Dependencies @ CoNLL 2018
A shared task organized by the Charles University, Uppsala University, University of Turku, Google, and Leipzig University. Twenty-six teams participated in the shared task. The task was hosted on the Webis evaluation-as-a-service platform TIRA.

Knowledge Base Quality and Search @ WSDM 2017
Two shared tasks organized by Stefan Heindorf, Hannah Bast, and Martin Potthast. Goal: (1) detect vandalism in Wikidata, and (2) compute relevance scores for triples from type-like relations. The task was hosted on the Webis evaluation-as-a-service platform TIRA.

Universal Dependencies @ CoNLL 2017
A shared task organized by the Charles University, Uppsala University, University of Turku, Google, Bauhaus-Universität Weimar, Stanford University, Ohio State University, Bar-Ilan University, Open University of Israel, University of Cambridge, The Arctic University of Norway, Univerity of Oslo, Leipzig University, IBM Research, University of Tübingen, University of Hamburg, University of Geneva, University of Helsinki, University of Stuttgart, DFKI, and University of Saarland. Thirty-three teams participated in the shared task. The task was hosted on the Webis evaluation-as-a-service platform TIRA.

Multilingual Shallow Discourse Parsing @ CoNLL 2016
A shared task organized by the Brandeis University, the National University of Singapore, Boulder Learning, Inc., and the University of Edinburgh. Twenty-three teams participated in the shared task. The task was hosted on the Webis evaluation-as-a-service platform TIRA.

Shallow Discourse Parsing @ CoNLL 2015
A shared task organized by the Brandeis University, the National University of Singapore, Boulder Language Technologies, and the University of Wisconsin-Milwaukee. Sixteen teams participated in the shared task. The task was hosted on the Webis evaluation-as-a-service platform TIRA.

PAN Excellence Network on Digital Text Forensics

PAN @ CLEF 2019
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2019) in Lugano, Switzerland.
[bots and gender profiling] [celebrity profiling] [cross-domain authorship attribution] [style change detection]

PAN @ SemEval 2019
In conjunction with FactMata Ltd. and the International Workshop on Semantic Evaluation (SemEval 2019).
[hyperpartisan news detection]

PAN @ CLEF 2018
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2018) in Avignon, France.
[author identification] [author profiling] [author obfuscation]

PAN @ CLEF 2017
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2017) in Dublin, Ireland.
[author identification] [author profiling] [author obfuscation]

PAN @ CLEF 2016
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2016) in Évora, Portugal.
[author identification] [author profiling] [author obfuscation]

PAN @ FIRE 2015
In conjunction with the Information Retrieval Society of India and the Forum for Information Retrieval Evaluation (FIRE 2015) in Gandhinagar, India.
[source code reuse detection] [plagiarism detection]

PAN @ CLEF 2015
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2015) in Toulouse, France.
[plagiarism detection] [author identification] [author profiling]

PAN @ FIRE 2014
In conjunction with the Information Retrieval Society of India and the Forum for Information Retrieval Evaluation (FIRE 2014) in Bagalore, India.
[source code reuse detection]

PAN @ CLEF 2014
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2014) in Sheffield, UK.
[plagiarism detection] [author identification] [author profiling]

PAN @ FIRE 2013
In conjunction with the Information Retrieval Society of India and the Forum for Information Retrieval Evaluation (FIRE 2013) in New Delhi, India.
[news story search]

PAN @ CLEF 2013
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2013) in Valencia, Spain.
[plagiarism detection] [author identification] [author profiling]

PAN @ FIRE 2012
In conjunction with the Information Retrieval Society of India and the Forum for Information Retrieval Evaluation (FIRE 2012) in Kolkata, India.
[news story search]

PAN @ CLEF 2012
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2012) in Rome, Italy.
[plagiarism detection] [author identification] [wikipedia quality flaw prediction]

PAN @ FIRE 2011
In conjunction with the Information Retrieval Society of India and the Forum for Information Retrieval Evaluation (FIRE 2011) in Bombay, India.
[plagiarism detection]

PAN @ CLEF 2011
In conjunction with the Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2011) in Amsterdam, Netherlands.
[plagiarism detection] [author identification] [wikipedia vandalism detection]

PAN @ CLEF 2010
In conjunction with the Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2010) in Padua, Italy.
[plagiarism detection] [wikipedia vandalism detection]

PAN @ SEPLN 2009
In conjunction with the 25th Annual Conference of the Spanish Society for Natural Language Processing (SEPLN 2009) in San Sebastian, Spain.
[plagiarism detection]

PAN @ ECAI 2008
In conjunction with the 18th European Conference on Artificial Intelligence (ECAI 2008) in Patras, Greece.

PAN @ SIGIR 2007
In conjunction with the 30th Annual International ACM SIGIR Conference (SIGIR 2007) in Amsterdam, Netherlands.

TIR Workshop Series on Information Retrieval

TIR @ DEXA 2019
In conjunction with the 30th International Conference on Database and Expert Systems Applications (DEXA 2019) in Linz, Austria.

TIR @ DEXA 2018
In conjunction with the 29th International Conference on Database and Expert Systems Applications (DEXA 2018) in Regensburg, Germany.

TIR @ DEXA 2017
In conjunction with the 28th International Conference on Database and Expert Systems Applications (DEXA 2017) in Lyon, France.

TIR @ DEXA 2016
In conjunction with the 27th International Conference on Database and Expert Systems Applications (DEXA 2016) in Porto, Portugal.

TIR @ DEXA 2015
In conjunction with the 26th International Conference on Database and Expert Systems Applications (DEXA 2015) in Valencia, Spain.

TIR @ DEXA 2014
In conjunction with the 25th International Conference on Database and Expert Systems Applications (DEXA 2014) in Munich, Germany.

TIR @ DEXA 2013
In conjunction with the 24th International Conference on Database and Expert Systems Applications (DEXA 2013) in Prague, Czech Republic.

TIR @ DEXA 2012
In conjunction with the 23rd International Conference on Database and Expert Systems Applications (DEXA 2012) in Vienna, Austria.

TIR @ DEXA 2011
In conjunction with the 22nd International Conference on Database and Expert Systems Applications (DEXA 2011) in Toulouse, France.

TIR @ DEXA 2010
In conjunction with the 21st International Conference on Database and Expert Systems Applications (DEXA 2010) in Bilbao, Spain.

TIR @ DEXA 2009
In conjunction with the 20th International Conference on Database and Expert Systems Applications (DEXA 2009) in Linz, Austria.

TIR @ DEXA 2008
In conjunction with the 19th International Conference on Database and Expert Systems Applications (DEXA 2008) in Turin, Italy.

TIR @ DEXA 2007
In conjunction with the 18th International Conference on Database and Expert Systems Applications (DEXA 2007) in Regensburg, Germany.

TIR @ ECAI 2006
In conjunction with the 17th European Conference on Artificial Intelligence (ECAI 2006) in Riva del Garda, Italy.

TIR @ KI 2005
In conjunction with the 28th German Conference on Artificial Intelligence (KI 2005) in Koblenz, Germany.

TIR @ KI 2004
In conjunction with the 27th German Conference on Artificial Intelligence (KI 2004) in Ulm, Germany.

PuK Workshop Series on Configuration and Design

PuK 2004
18th Workshop of the Special Interest Group on Planning, Scheduling, and Design of the German Computer Science Society (GI), organized 2004 in Ulm, Germany.

PuK 1998
12th Workshop of the Special Interest Group on Planning, Scheduling, and Design of the German Computer Science Society (GI), organized 1998 in Paderborn, Germany.