Tiny-Shakespeare

Learned token routing in transformers adapts computation depth for efficiency

Researchers have developed a new technique called Token-Selective Attention (TSA) for transformer models that allows them to dynamically adjust the computation depth for each token. This method uses a lightweight, learn…