Futurology

1793 readers

38 users here now

founded 1 year ago

MODERATORS

118

AI PCs flood the market. Their makers hope someone wants them; Despite 49% surge in shipments, buyers seem unconvinced. (www.theregister.com)

submitted 6 days ago by Lugh to c/futurology

53 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] chaosCruiser 7 points 6 days ago* (last edited 6 days ago) (2 children)

”However, if it is performance you are concerned about, "it's important to note that GPUs still far outperform NPUs in terms of raw performance," Jessop said, while NPUs are more power-efficient and better suited for running perpetually.”

Ok, so if you want to run your local LLM on your desktop, use your GPU. If you’re doing that on a laptop in a cafe, get a laptop with an NPU. If you don’t care about either, you don’t need to think about these AI PCs.

[–] JohnDClay@sh.itjust.works 2 points 6 days ago (1 children)

Or use a laptop with a GPU? An npu seems to just be slightly upgraded onboard graphics.

[–] chaosCruiser 1 points 4 days ago

It’s a power efficiency thing. According to the article, a GPU gets the job done, but uses more energy to get there. Probably not a big deal unless charging opportunities are scarce.