Interstellar-v3

MiniMax has disclosed (in technical reports) the following:

Notable: MiniMax uses a two-stage RLHF – first on helpfulness, then on safety/harmlessness – similar to Anthropic’s Constitutional AI. interstellar-v3

Standard transformers suffer from quadratic complexity. Sparse attention helps, but Interstellar-V3 introduces Nebula Attention, a dynamic graph-based attention system. Instead of attending to every token, the model builds a dynamic "gravity model" of the input, where important tokens (high mass) attract more attention bandwidth. This allows the model to process the entire text of War and Peace 500 times over in a single forward pass. MiniMax has disclosed (in technical reports) the following:

As of May 2026, access is tiered: