this post was submitted on 18 Dec 2024
41 points (95.6% liked)

Futurology

1852 readers
70 users here now

founded 1 year ago
MODERATORS
top 3 comments
sorted by: hot top controversial new old
[–] BaylorSwift3 20 points 3 days ago* (last edited 3 days ago) (1 children)

Just as the investor funded AI companies think they have the shallowest of moats, and a chance to build revenue, no - once again Open Source is snapping at their heels. Someone is going to blink first in this race, and I suspect it will be the investor funded AI companies.

[–] Espiritdescali 5 points 3 days ago (1 children)

Do these open source models have access to the same volume of training data that the commercial models have?

[–] BaylorSwift3 2 points 3 days ago* (last edited 3 days ago)

Paradoxically their approach is to use less training data. HF are saying they have reverse engineered some of the capabilities of OpenAI’s o1 model, by using an approach called 'Test-time compute scaling' which OpenAI have acknowledged using, but not disclosed exactly how.

https://the-decoder.com/study-shows-test-time-compute-scaling-is-a-path-to-better-ai-systems/