I distilled a 7B vision model into a 2B one for screenshots — and the 7B teacher scored worse
A hands-on knowledge-distillation project: Qwen2-VL-7B → 2B for UI-screenshot understanding, trained, evaluated and benchmarked end-to-end on an M4 Pro. 2.4× faster — and why the teacher lost on ROUGE-L.
本文内容来源于互联网,版权归原作者所有
查看原文