Futurology

1801 readers

70 users here now

founded 1 year ago

MODERATORS

New Theory Suggests Chatbots Can Understand Text | Quanta Magazine (www.quantamagazine.org)

submitted 10 months ago by CanadaPlus to c/futurology

5 comments fedilink hide all child comments

Since it's been a controversy on here a couple times, here's a great example of how you can demonstrate an LLM can produce something it can't have seen before.

It doesn't prove anything beyond doubt, but I think these kinds of experiments show to something like a civil law standard that they're not merely parrots.

you are viewing a single comment's thread
view the rest of the comments

[–] CanadaPlus 1 points 9 months ago* (last edited 9 months ago)

I mean, I've never seen a toucan, or even been close to one to my knowledge, but I feel like I understand them pretty well, at least at a basic level. I've also never known any bird except through smell, sound, touch, sight and so on.

They do still suck at physical tasks, and probably will until we find a totally different approach to the problem than brute gradient decent, but I'm not so sure that makes everything else they (appear to) know useless. I'm not convinced kinetic knowledge is the only kind.