someone asked whether LLMs does geometry through algebraic means and it got me thinking I mean yeah, LLMs have no spatial reasoning, no real world models. no rotating things in their head, no “seeing” curves. it’s all symbolic manipulation. but i think it’s a bit more complex than that well or a finer thought. they mostly do it algebraically, but maybe there’s some kind of representation in their own space where they can see structure in 2D and 3D… like how humans have spatial intuition that transfers into higher dimensions when doing math, finding lower dimensional structure in an 8D sphere or whatever. so an LLM doing 2D geometry is kinda like a human doing geometry in 6D. blind to the space, navigating real structure purely through some weird symbolic representation of it. eh, maybe. idk. shrug I know they can have vision but they don’t have robust world models they don’t really simulate space in their mind. submitted by /u/momkeeeeeeee
Originally posted by u/momkeeeeeeee on r/ArtificialInteligence
Nope, it’s all just gradient descent on some N dimensional surface.