Transformers

What are the potential applications and risks of using overfitted transformer models for compressing structured game data like grid-based movement logs?

Overfitted transformers can achieve extreme compression for grid-based game data, but suffer from one-model-per-file, slow processing, and no generalization, with potential scaling issues limiting practical gains.