A Retail-Corpus for Aspect-Based Sentiment Analysis with Large Language Models
By: Oleg Silcenco , Marcos R. Machad , Wallace C. Ugulino and more
Potential Business Impact:
Helps computers understand what people like about stores.
Aspect-based sentiment analysis enhances sentiment detection by associating it with specific aspects, offering deeper insights than traditional sentiment analysis. This study introduces a manually annotated dataset of 10,814 multilingual customer reviews covering brick-and-mortar retail stores, labeled with eight aspect categories and their sentiment. Using this dataset, the performance of GPT-4 and LLaMA-3 in aspect based sentiment analysis is evaluated to establish a baseline for the newly introduced data. The results show both models achieving over 85% accuracy, while GPT-4 outperforms LLaMA-3 overall with regard to all relevant metrics.
Similar Papers
From Annotation to Adaptation: Metrics, Synthetic Data, and Aspect Extraction for Aspect-Based Sentiment Analysis with Large Language Models
Computation and Language
Helps computers understand feelings about sports.
Multi-domain Multilingual Sentiment Analysis in Industry: Predicting Aspect-based Opinion Quadruples
Computation and Language
Helps computers understand opinions about things.
Emotion-Enhanced Multi-Task Learning with LLMs for Aspect Category Sentiment Analysis
Computation and Language
Teaches computers to understand feelings behind words.