I did some work in determining the type and strength of transformations of KV cache layers relative to each other.