attention, made visible
The Mind
I work on the models that learn from our faces and voices.
A transformer reads a sentence by letting every word attend to every other; the weights of that attention decide what matters to what.
Choose a word. The beams show where it looks.