Foundation Models, Decentralized Computing, Open Source AI.
Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking