# Online Softmax in Attention (Simple Variables)

## The Problem

Standard attention computes, for query `q`:

```
scores[i] = q ·