histovit-cancer-classification-eval
HistoViT: Vision Transformer for Accurate and Scalable Histopathological Cancer Diagnosis — Ahmed et al. (2025) (arXiv:2508.11181, 2025)
What this evaluates
Multi-class histopathological image classification for cancer diagnosis across four tissue types (breast, prostate, bone, cervical). It probes the model's ability to extract robust morphological features from stained whole-slide image tiles without data augmentation.
Datasets
- ICIAR2018 — total 11794; splits: train (-1), test (-1)
- SIPAkMeD — total 4049; splits: train (-1), test (-1)
- SICAPv2 — total 11836; splits: train (-1), test (-1)
- UT-Osteosarcoma — total 10017; splits: train (-1), test (-1)
Metrics
accuracy (primary) — range: [0, 1]
- Fraction of correctly classified samples out of the total number of samples in the test set.
precision — range: [0, 1]
- Ratio of true positive predictions to the total number of positive predictions for each class, typically macro-averaged in multi-class settings.
recall — range: [0, 1]
- Ratio of true positive predictions to the total number of actual positives for each class, typically macro-averaged in multi-class settings.
AUC — range: [0, 1]
- Area Under the Receiver Operating Characteristic Curve, computed using a one-vs-rest strategy for multiclass classification.
Input / output format
Input: RGB histopathological image tiles/patches, resized to 224×224 pixels, with pixel values normalized to [0, 1].
Output: Class label prediction from a fixed set of C classes.
Scoring recipe
def compute_metrics(y_true, y_pred, y_prob, num_classes):
accuracy = (y_true == y_pred).mean()
precision = precision_score(y_true, y_pred, average='macro')
recall = recall_score(y_true, y_pred, average='macro')
auc = roc_auc_score(y_true, y_prob, multi_class='ovr', average='macro')
return accuracy, precision, recall, auc
Common pitfalls
- No data augmentation is used, which is atypical for deep learning on small medical datasets and may limit generalizability.
- Split strategies vary by dataset (80:20, 70:30, 5-fold CV), making direct cross-dataset comparison difficult.
- AUC is computed using a one-vs-rest strategy for multiclass classification, not macro/micro averaging.
Evidence (verbatim from paper)
Compute test loss and accuracy metrics ... One-vs-rest AUC curve for one-vs-rest multiclass classification using the proposed model across three different cancer types
Citation
@misc{ahmed2025histovit,
title={HistoViT: Vision Transformer for Accurate and Scalable Histopathological Cancer Diagnosis},
author={Ahmed et al. (2025)},
year={2025},
note={arXiv:2508.11181}
}
1---2name: histovit-cancer-classification-eval3description: Multi-class histopathological image classification for cancer diagnosis across four tissue types (breast, prostate, bone, cervical). It probes the model's ability to extract robust morphological features from stained whole-slide image tiles without data augmentation. Use when the user wants to benchmark on ICIAR2018, SIPAkMeD, SICAPv2, UT-Osteosarcoma, or asks about evaluating this task. Reports accuracy.4---56# histovit-cancer-classification-eval78> HistoViT: Vision Transformer for Accurate and Scalable Histopathological Cancer Diagnosis — Ahmed et al. (2025) (arXiv:2508.11181, 2025)910## What this evaluates1112Multi-class histopathological image classification for cancer diagnosis across four tissue types (breast, prostate, bone, cervical). It probes the model's ability to extract robust morphological features from stained whole-slide image tiles without data augmentation.1314## Datasets1516- **ICIAR2018** — total 11794; splits: train (-1), test (-1)17- **SIPAkMeD** — total 4049; splits: train (-1), test (-1)18- **SICAPv2** — total 11836; splits: train (-1), test (-1)19- **UT-Osteosarcoma** — total 10017; splits: train (-1), test (-1)2021## Metrics2223- `accuracy` **(primary)** — range: [0, 1]24 - Fraction of correctly classified samples out of the total number of samples in the test set.25- `precision` — range: [0, 1]26 - Ratio of true positive predictions to the total number of positive predictions for each class, typically macro-averaged in multi-class settings.27- `recall` — range: [0, 1]28 - Ratio of true positive predictions to the total number of actual positives for each class, typically macro-averaged in multi-class settings.29- `AUC` — range: [0, 1]30 - Area Under the Receiver Operating Characteristic Curve, computed using a one-vs-rest strategy for multiclass classification.3132## Input / output format3334**Input**: RGB histopathological image tiles/patches, resized to 224×224 pixels, with pixel values normalized to [0, 1].3536**Output**: Class label prediction from a fixed set of C classes.3738## Scoring recipe3940```python41def compute_metrics(y_true, y_pred, y_prob, num_classes):42 accuracy = (y_true == y_pred).mean()43 precision = precision_score(y_true, y_pred, average='macro')44 recall = recall_score(y_true, y_pred, average='macro')45 auc = roc_auc_score(y_true, y_prob, multi_class='ovr', average='macro')46 return accuracy, precision, recall, auc47```4849## Common pitfalls5051- No data augmentation is used, which is atypical for deep learning on small medical datasets and may limit generalizability.52- Split strategies vary by dataset (80:20, 70:30, 5-fold CV), making direct cross-dataset comparison difficult.53- AUC is computed using a one-vs-rest strategy for multiclass classification, not macro/micro averaging.5455## Evidence (verbatim from paper)5657> Compute test loss and accuracy metrics ... One-vs-rest AUC curve for one-vs-rest multiclass classification using the proposed model across three different cancer types5859## Citation6061```bibtex62@misc{ahmed2025histovit,63 title={HistoViT: Vision Transformer for Accurate and Scalable Histopathological Cancer Diagnosis},64 author={Ahmed et al. (2025)},65 year={2025},66 note={arXiv:2508.11181}67}68```6970- arXiv: 2508.11181