Something crucial is missing.
“The language model “knows” that balls fall when dropped — this is a robust statistical regularity across millions of texts. But it has never seen a ball. It has never felt gravity. It has never experienced the arc of a falling object. Its knowledge is entirely relational: “fall” is what happens to “ball” in the context of “drop,” which relates to “gravity,” which connects to “force” and “mass” and “acceleration.” It’s an intricate web of associations, internally consistent and remarkably useful — but floating free of the world, untethered to anything outside itself.”