Safe Error Correction for Language Models: Frozen-Base Adjustment with Capability Preservation

## Computer Science > Artificial Intelligence

## Computer Science > Artificial Intelligence ## Title:Safe Error Correction for Language Models: Frozen-Base Adjustment with Capability Preservation > Abstract:We study a practical question: can a small correction module fix errors in a frozen language model's outputs without degrading its base capabilities? We propose CRN v2, a lightweight logit-level correction module (~34M trainable parameters, 0.73% of the 4.65B text module) that sits atop a fully frozen Gemma 4 E2B model. The base model is never updated; only the correction module learns, via supervised fine-tuning followed by…

Читать полностью →

Источник: ArXiv cs.AI

Подключаюсь к источникам…

30 главных источников
о мире ИИ

Автоматический перевод, курирование и красивая подача главных статей об искусственном интеллекте.

0
статей
0
источников
9
разделов