> ## Documentation Index
> Fetch the complete documentation index at: https://aegean.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Transformers

> The transformer architecture, learnable attention, and multi-head self attention.

<CardGroup cols={2}>
  <Card title="Introduction to Transformers" icon="play" href="https://www.youtube.com/watch?v=2pIIPXPopzc">
    The transformer architecture and the simple attention mechanism
  </Card>

  <Card title="The Learnable Attention Mechanism" icon="play" href="https://www.youtube.com/watch?v=JdoXFcSiDrA">
    Implementing the scaled dot-product self attention mechanism
  </Card>

  <Card title="Multi-Head Self Attention" icon="play" href="https://www.youtube.com/watch?v=hKCO8PO3yvw">
    Using multiple attention heads to capture different aspects of input sequences
  </Card>
</CardGroup>

***

<Callout icon="pen-to-square" iconType="regular">
  [Edit this page on GitHub](https://github.com/aegean-ai/eaia/edit/main/src/media/nlp/transformers.mdx) or [file an issue](https://github.com/aegean-ai/eaia/issues/new/choose).
</Callout>