Structured Sparse Transition Matrices to Enable State Tracking in State-Space Models

TL;DR

Modern state-space models (SSMs) often utilize structured transition matrices which enable efficient computation but pose restrictions on the model’s expressivity, as measured in terms of the ability…

Opening excerpt from the authors’ abstract. source