Futurology

1943 readers

80 users here now

founded 2 years ago

MODERATORS

When AI is tested on questions it can't model from pre-existing answers on the internet, it only scores 10% in the test. (qz.com)

submitted 6 days ago by Lugh to c/futurology

15 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Not_mikey@slrpnk.net 4 points 5 days ago

It will take independent reasoning to get 100% on this test

And an entire university staff. They went around and asked a bunch of PHDs what's the hardest question you can think of. I like to think I have independent reasoning and I doubt I could answer one question correct on this exam, much less 10%.

This doesn't prove ai doesn't have independent reasoning it just proves it doesn't have the obscure knowledge needed to reason about the questions.

Do you think the bar does not require independent reasoning? Granted I've never taken it but most high level standardized tests require a lot of reasoning. If you had a completely open book / internet access and took the SAT / ACT without any ability to reason you'd still fail horribly for the science and math sections.