▲ 4 points
back
2 comments
Looks like after the OpenAI deal went south, Microsoft wants to "train" their own LLM by distilling the interactions with the other models. This may be a genuine desire for RL maybe but definitely not applicable for individual developers or even small shops. "Learning" can definitely happen in token space.