Copy of my paper from arXiv for quick reference
The Information-Theoretic Imperative and Compression Efficiency: Why Brains and Deep Networks Converge
Keywords: brain–AI convergence; excess codelength (regret); rate–distortion; information bottleneck;
Two documents crossed my desk this month, in completely different areas, both making the same mistake.
The first is mundane: the vocabulary security people use to talk about AI systems. "The model
There is a pattern I keep running into. I’ve implied it and written around it, but it is time to be more direct.
A researcher observes a behavioral output in an AI
What AI Governance Gets Wrong Before It Gets Anything Right
AI governance discourse has a baseline problem, and it is prior to both the technical problems and the regulatory problems; it is epistemic.
There is a confusion running through AI governance discourse that rarely gets named directly, possibly because naming it implicates most of the frameworks currently in use.
The confusion is about what kind of
