Writing — A token-merging patch that made compilation 480× slower
< All posts
JAN 2026 · GPU OPTIMIZING · COMPILATION · 1 MIN

A token-merging patch that made compilation 480× slower

Placeholder body copy. Token merging is supposed to make a Vision Transformer cheaper. The patch did that for eager execution and then made the compiled path unusable, because every forward pass produced tensors of a shape the compiler had never seen.

Placeholder continuation. Dynamic shapes, recompilation storms, and the one-line guard that fixed it.

About aaaallleen.github.io
aaaallleen.github.io
Version 1.0 · built 2026-09-14
ENGINE
Astro 7.3.2, fully static
HOSTING
GitHub Pages
DESIGN
Retro desktop, mocked up in Claude Design
TYPE
Silkscreen & Verdana
OWNER
Allen Lu · San Diego, CA