Interesting read. The most important for me here was:

Thanks fren for confirming all the discussions we've had about reducing long contexts and breaking up to smaller and more specifically tuned instances.