Official code for the paper Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling. HiLS-Attention is a chunk-wise sparse attention mechanism that learns chunk selection end-to-end ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results