Tag: sequence modeling
All the talks with the tag "sequence modeling".
A Brief Overview of Recent Advances in Sequence Modeling Through Structured State Space Models
Jyotirmaya ShivottamPublished: at 10:00 AMThis talk outlines recent advances in sequence modeling using structured state space models, starting with the basic formulation that initiated this line of research and moving on to more recent works (Mamba) that present complete architectures operating under certain assumptions. Core techniques that make these models work efficiently on long sequences, such as discretization and an associative scan operation to parallelize the computation, will also be discussed.