yeah we were surprised by how much it does it. Our approach has been retroactive - we monitor the thinking trace, spot reward hacking behavior and then fix things.
We haven't faced this issue with Sol though - its been much more well behaved
back
1 comments
How do you have access to the thinking trace?
we have access to the thinking trace summaries, not the raw traces