Skip to content

The transformer block

A transformer block wires the sub-layers together: LayerNorm → attention → residual → LayerNorm → feed-forward → residual.

  • @node-llm/core → src/model/block.ts — TransformerBlock