This repository contains the OATS (Opinion Aspect Target Sentiment) dataset for the Aspect Sentiment Quad Prediction (ASQP) or Aspect-Category-Opinion-Sentiment (ACOS) task. In addition to the opinion quadruples, we provide review-level tuples with the dominating sentiment polarity of each aspect category that has an opinion in that review.
We annotated 3 datasets from scratch from different domains, including Amazon FineFood reviews, Coursera course reviews, and TripAdvisor Hotel reviews.
Each of these datasets can be found under their respective folders in the data/ directory:
- data/{domain}:
- data/{domain}/quads
- XML (similar to the SemEval-2016 format, along with the opinion phrase annotations and their from_index and to_index)
- txt (similar to the ASQP dataset that has a list of lists for each review sentence, where each inner list corresponds to an opinion quadruple with the target, aspect category, sentiment, and opinion phrase in the order)
- data/{domain}/tuples
- XML (with aspect category and sentiment polarity for each mentioned category in the review)
- txt (list of lists for each review, where each inner list corresponds to an opinion tuple with the aspect category and dominating sentiment polarity)
- data/{domain}/quads
{domain}: [amazon_ff, coursera, hotels]
If you use this dataset in your research, please cite the following paper: OATS: Opinion Aspect Target Sentiment Quadruple Extraction Dataset for Aspect-Based Sentiment Analysis
This paper is accepted at LREC/COLING 2024 and the proceedings link will be updated soon!!
@inproceedings{chebolu-etal-2024-oats-challenge,
title = "{OATS}: A Challenge Dataset for Opinion Aspect Target Sentiment Joint Detection for Aspect-Based Sentiment Analysis",
author = "Chebolu, Siva Uday Sampreeth and
Dernoncourt, Franck and
Lipka, Nedim and
Solorio, Thamar",
booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",
month = may,
year = "2024",
address = "Torino, Italia",
publisher = "ELRA and ICCL",
url = "https://aclanthology.org/2024.lrec-main.1080",
pages = "12336--12347",
}