Finetuning a Reasoning LLM with Supervised or Reinforcement Learning? [D]
Hello, I have a task to fine-tune small LLMs on annotated conversational data. The dataset contains not only the final answers, but also reasoning traces and tool-calling decisions (i.e., when the model should think and when it should call a tool). I am wondering what the best training approach would be and why. My current dataset is stored in a chat format similar to this: `text system user assistant_think assistant_tool assistant_answer user assistant_think assistant_tool assistant_answer ... ` My cur
评论
?
参与讨论