Tag: seminar
All the talks with the tag "seminar".
An Introduction to Neural Differential Equations
Jyotirmaya ShivottamPublished: at 10:00 AMThis talk outlines the basics of Neural Differential Equations (NDEs), starting with the foundational paper by Chen et al. on Neural Ordinary Differential Equations (NODEs) and explores connections with dynamical modeling. It presents some examples of neural architectures in the NDE framework and discusses the universal approximation and expressivity properties of certain NDEs, in the context of the manifold hypothesis. The talk concludes with practical considerations for implementing NDE networks.
A Brief Overview of Recent Advances in Sequence Modeling Through Structured State Space Models
Jyotirmaya ShivottamPublished: at 10:00 AMThis talk outlines recent advances in sequence modeling using structured state space models, starting with the basic formulation that initiated this line of research and moving on to more recent works (Mamba) that present complete architectures operating under certain assumptions. Core techniques that make these models work efficiently on long sequences, such as discretization and an associative scan operation to parallelize the computation, will also be discussed.