Online (real-time) RL only works if the model is already great — users won't engage with a bad one, and no engagement means no feedback. Federico Cassano explains why Cursor uses offline RL to bake in reasoning and tool calling first, then layers online RL on top for that final delightful experience.
#shorts #Cursor #reinforcementlearning #ai
