Webis-Tripad-13-Sentiment

Synopsis

The Webis Tripad 2013 Sentiment Corpus is a English text corpus of 2100 hotel reviews for the development and evaluation of approaches to sentiment flow analysis. Each document in this corpus is assigned an overall rating score, some metadata, and two kinds of annotations. First, each statement of a review's text has been classified with respect to its sentiment polarity (positive, negative, objective) by Amazon Mechanical Turk (AMT) workers. Second, hotel aspects mentioned in the texts were tagged by in-house domain experts.

To give an example, the sentence "The service was perfect and the rooms were clean." consists of two statements "The service was perfect" and "the rooms were clean", both with positive sentiment classification. The aspect in the first statement is "service" and "rooms" in the second, respectively.

Download

To download the corpus use the following link:

You can access the Webis-Tripad-13-Sentiment corpus on Zenodo.

If you use the dataset in your research, please send us a copy of your publication. If you additionally want to link to the dataset, please use the dataset's [doi] for a stable link.

The text files are formatted in JSON and have the following structure: Show example document

{
  "text": "The service was perfect and the rooms were clean.",
  "attributes": {
    "de.webis.attribute.Author": {
      "name": "someuser",
      "date": "2013-12-31"
    },
    "de.webis.attribute.Hotel": {
      "id": 123456,
      "city": "Berlin",
      "country": "Germany",
      "province": "Berlin"
    },
    "de.webis.attribute.Rating": {
      "cleanliness": 4,
      "location": 4,
      "rooms": 4,
      "service": 3,
      "value": 2,
      "score": 3
    },
    "de.webis.attribute.Title": {
      "text": "Loved it!"
    }
  },
  "annotations": {
    "de.webis.annotation.Aspect": [
      {
        "begin": 4,
        "end": 11
      },
      {
        "begin": 32,
        "end": 37
      }
    ],
    "de.webis.annotation.Statement": [
      {
        "polarity": "POSITIVE",
        "begin": 0,
        "end": 23
      },
      {
        "polarity": "POSITIVE",
        "begin": 28,
        "end": 48
      }
    ]
  }
}
        

Research

The Webis Tripad 2013 Sentiment Corpus is an enriched version of a subset of the TripAdvisor Data Set. This corpus served as a starting point because of (1) its previous application to opinion analysis, (2) the given metadata in each review - overall rating, and seven aspect ratings: value, room, location, cleanliness, check in/front desk, service, business service ranging from one to five stars, and (3) its size of 246,399 hotel reviews from 1850 hotels in 65 locations. The original data was crawled from TripAdvisor in one month period from February 14, 2009 to March 15, 2009.

The chosen subset contains 2100 reviews from seven locations (Amsterdam, Barcelona, Berlin, Paris, San Francisco, Seattle, Sydney), equally distributed with respect to their assigned overall sentiment score that ranges from 1 to 5. Hence, there are 300 reviews per city, 60 for each score.

Number of	Total	Min	Max	Mean	SD
Documents	2100	(per document numbers)
Words	411556	10	1748	195	149
Statements	31646	1	95	15	10
Aspects	24725	0	179	11	9

Please note that the dataset you can download here is an updated version of the corpus, as we identified some defective reviews in the original TripAdvisor dataset that were due to parsing errors. The reviews in question have been repaired or replaced by hand, fetching the original content from the TripAdvisor website. Also the data format was changed from UIMA XML to JSON to increase compatibility. However, the results of our latest analysis (cf. Section Publications) are based on the version before the update, which you can download here.

People

• Henning Wachsmuth
• Martin Trenkmann
• Tsvetomira Palakarska
• Joachim Köhring
• Benno Stein

Students: Dora Kiesel

Publications