#cuda

Attention Is Memory-Bound, Not Compute-Bound

Everyone knows attention scales quadratically. Almost nobody talks about why that's a memory problem, not a math problem — and why it matters.