I understand you're trying to work around the intrinsic limitation in the models. If not with code and not with RL, do you solve it with prompting?
I.e. how do you solve the "product design" problem?

It’s handled at the interaction level. The bot regularly restates and challenges assumptions instead of building endlessly on prior context, and older turns aren’t treated as sacred state. Prompting helps, but conversation design does most of the work.