TraceForge: Distilling with Your Own Thinking
This work takes the context and the teacher's answer as input, and generates the reasoning trace ourselves, in the style of the student's own model family, suspect that reasoning written in the student's family style is easier for it to learn from.
Yan Wang
· 0 citations