Ben Geist, Research Engineer at Ramp, on intelligence efficiency: why paying more for tokens yields diminishing returns, and how better context, not just more compute, makes models more efficient.
00:00 Intelligence efficiency
01:00 Smarter models aren't more efficiently smart
02:04 Token spend data from Ramp
03:01 Entropy reduction machines
03:45 Two views of entropy
05:01 Context, not just work
06:09 Three examples in latent space
06:39 Multi-agent systems with shared context
08:56 In-context learning and sparse attention
