Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Posts

portfolio

publications

RotRNN: Modelling Long Sequences with Rotations

Published in NGSM ICML Workshop, 2024

This paper is about parameterising linear recursive neural networks with rotation matrices.

Recommended citation: Dolga, Rares, et al. "RotRNN: Modelling Long Sequences with Rotations." arXiv preprint arXiv:2407.07239 (2024).
Download Paper

Latte: Latent Attention for Linear Time Transformers

Published in NGSM ICML Workshop, 2024

This paper is about a linear latent variable re-parametrisation of attention and combining it with local standard attention

Recommended citation: Dolga, Rares, Marius Cobzarenco, and David Barber. "Latent Attention for Linear Time Transformers." arXiv preprint arXiv:2402.17512 (2024).
Download Paper

talks

teaching

Teaching experience 1

Undergraduate course, University 1, Department, 2014

This is a description of a teaching experience. You can use markdown like any other post.

Teaching experience 2

Workshop, University 1, Department, 2015

This is a description of a teaching experience. You can use markdown like any other post.