Lmms Eval Guide

Guides AI coding agents through the lmms-eval codebase - a unified evaluation framework for Large Multimodal Models (LMMs). Use when integrating new models, adding evaluation tasks/benchmarks, running YAML config-driven evaluations, orchestrating non-blocking training-time evaluation via the HTTP eval server, or navigating the evaluation pipeline architecture.

evolvinglmms-lab Updated
Picture from the README

File contents

evolvinglmms-lab/lmms-eval commit d6ad88e618

Frequently asked questions

npx get-skill add evolvinglmms-lab/lmms-eval-guide