Reference · Word shelf
Transformer
A **transformer** is the architecture behind modern LLMs. Its **attention** mechanism weighs which earlier tokens matter most when predicting the next one.
Reference · Word shelf
A **transformer** is the architecture behind modern LLMs. Its **attention** mechanism weighs which earlier tokens matter most when predicting the next one.