Apr 14, 2026 — 4 min — Platform & AI
What AI Researchers Do That I Do Not
A short, honest read on what AI researchers actually do day to day, written from outside the role by an applied engineer who reads papers when the work demands it.
Tag: ai research
2 entries tagged "ai research" — 1 post, 1 link.
Posts
Links
An Evolved Universal Transformer Memory
This is the primary source behind the memory-optimization link in the saved list. Sakana's Neural Attention Memory Models are interesting because they try to learn what a transformer should remember or forget rather than keeping every token equally alive.
Worth keeping, with caution. Memory savings are exciting, but production systems still need to ask what was discarded, when that is safe, and how failures show up in evaluation.