Tabular LLMs: An Introduction to the Foundation Models That Predict Your Spreadsheet

Tabular foundation models predict the missing column of any spreadsheet zero-shot, the way an LLM completes text — and on the TabArena benchmark they now sit above fully tuned gradient-boosted trees.

An introduction to how they work, an independent reproduction of the strongest open one, and a ma...