Large language models turned natural language into a programmable interface, but they still struggle when the world stops ...