Princeton University users: to view a senior thesis while away from campus, connect to the campus network via the Global Protect virtual private network (VPN). Unaffiliated researchers: please note that requests for copies are handled manually by staff and require time to process.

Browsing by Author "Fortgang, Shlomo T."

Filter results by typing the first few letters
Now showing 1 - 1 of 1
  • Thumbnail Image

    SpectraLDS: Distilling Spectral Filters into Constant-Time Recurrent Models

    (2025-04-10) Fortgang, Shlomo T.; Hazan, Elad

    We introduce the first provable method for learning a symmetric linear dynamical system of arbitrarily high effective memory. This allows us to distill the convolutional layers in a leading hybrid state space model, FlashSTU, into O(1) linear dynamical systems, merging Transformer and RNN architectures in a manner suitable for scaling and with application to language modeling and other sequential processing tasks.