Rethink the representation.
How can we represent what a model knows in a more useful form? We investigate the structure inside model weights and explore alternative representations.
Representations / Model structureWe build AI infrastructure and explore new ways to represent and run models. From the systems underneath to the intelligence ahead.
01 / What we’re exploring
Less memory. Less unnecessary computation. More room to explore what’s possible.
Explore our researchHow can we represent what a model knows in a more useful form? We investigate the structure inside model weights and explore alternative representations.
Representations / Model structureWhat needs to happen for a model to produce an answer? We build and measure alternative execution paths, with memory and hardware in view.
Inference / SystemsInfrastructure is our starting point. What we learn will inform our future work on model architectures and learning methods.
Models / Future direction02 / How we work
We follow an idea into code, put it against a baseline, and look closely at what happens. The useful findings become tools. The open questions become the next experiment.
More about our approach