Publication:

Bayesian Filtering for Neural Networks

datacite.rightsopen.access
dc.contributor.advisorGriffiths, Thomas L
dc.contributor.authorBencomo, Gianluca Michele
dc.contributor.otherComputer Science Department
dc.date.accessioned2023-08-03T19:21:07Z
dc.date.accessioned2026-09-30T10:34:19Z
dc.date.available2023-08-03T19:21:07Z
dc.date.available2026-09-30T10:34:19Z
dc.date.created2023-01-01
dc.date.issued2023
dc.description.abstractAdaptability is a crucial component of intelligent systems. In dynamic environments, biological organisms continuously adjust their behavior to match the demands of the current situation. However, this fundamental feature of biological intelligence conflicts with a typical assumption of machine learning, which assumes that the data generating process is static over time. Bayesian filtering offers a rich toolkit for breaking this assumption, but the complex and high-dimensional space of neural networks poses several challenges. This thesis investigates these problems and presents progress for handling them. In the simple linear-Gaussian case, we show that we can effectively learn the dynamics and process noise of a time-varying hierarchical Bayesian linear regression model. This results in a simple linear regressor that can adapt its weights to fit lines without any data at forward timesteps. In the nonlinear case, we derive two methods for variational Kalman filtering, one based on conjugate gradients and the other on natural gradients. We find that we are able to produce promising results over simple networks but more work is required before we can learn dynamics and process noise in higher-dimensional, and more complex, parameter spaces.
dc.format.mimetypeapplication/pdf
dc.identifier.urihttp://arks.princeton.edu/ark:/88435/dsp01d791sk48p
dc.identifier.urihttps://theses-dissertations.princeton.edu/handle/88435/dsp01d791sk48p
dc.language.isoen
dc.publisherPrinceton, NJ : Princeton University
dc.subjectBayesian Filtering
dc.subjectNeural Networks
dc.subjectTemporal Shift
dc.subjectVariational Inference
dc.subject.classificationComputer science
dc.subject.classificationArtificial intelligence
dc.titleBayesian Filtering for Neural Networks
dc.typeAcademic dissertations (M.S.E.)
dspace.entity.typePublication
pu.date.classyear2023
pu.departmentComputer Science

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Bencomo_princeton_0181G_14499.pdf
Size:
2.26 MB
Format:
Adobe Portable Document Format