Besstie Eval

Evaluates language models' ability to classify sentiment and detect sarcasm across three distinct varieties of English (Australian, Indian, and British). It probes cross-variety generalization and the impact of domain (Google reviews vs. Reddit comments) on model performance. Use when the user wants to benchmark on BESSTIE, or asks about evaluating this task. Reports F-Score.

qhjqhj00 Updated 3 repo stars

File contents

qhjqhj00/research-skills-pool commit 203076e819

Frequently asked questions

npx get-skill add qhjqhj00/besstie-eval