Evaluation & Diagnosis

Fix catastrophic forgetting by mixing 20-30% general instruction data into your fine-tuning dataset. Always track MMLU, safety scores, and perplexity on general text alongside task metrics. The goal is task improvement WITH zero regression on general benchmarks.