this post was submitted on 18 Dec 2024
43 points (95.7% liked)

Futurology

1900 readers
33 users here now

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Espiritdescali 5 points 1 month ago (1 children)

Do these open source models have access to the same volume of training data that the commercial models have?

[–] BaylorSwift3 2 points 1 month ago* (last edited 1 month ago)

Paradoxically their approach is to use less training data. HF are saying they have reverse engineered some of the capabilities of OpenAI’s o1 model, by using an approach called 'Test-time compute scaling' which OpenAI have acknowledged using, but not disclosed exactly how.

https://the-decoder.com/study-shows-test-time-compute-scaling-is-a-path-to-better-ai-systems/