Inputs And Layer Wise States

Analyze and visualize layer-wise gradient behaviors in LLMs during fine-tuning for fast vs slow thinking tasks, calculate gradient statistics, and understand training patterns across different model layers

zjunlp Updated 1.5k repo stars

File contents

zjunlp/mechanist commit aa5d9d7856

Frequently asked questions

npx get-skill add zjunlp/inputs-and-layer-wise-states