0.4.3

patch

0.4.2

ability to use jax fused associative scan for gateloop layer

0.4.1

cite

0.4.0

upgrade feedforward to glu variant + dropouts

0.3.1

0.3.1

0.3.0

start adopting qk norm for attention, with option to turn off

0.2.6

fix unconditional

0.2.5

fix validation loop for multi gpu

0.2.3

memories should not have relative positions with each other, just far…

0.2.2

make sure one can still do 0 register tokens, in case paper is flawed…