Sparse Top-K Softmax Attention

Auto-generated stub. Edit this file to add more details.

A sparse attention mechanism used in Li-Net that integrates multi-modal embeddings to selectively focus on the most informative time steps and feature channels during multi-channel time series forecasting.

Related Papers