this post was submitted on 14 Jan 2024
821 points (99.2% liked)
Technology
59597 readers
3752 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Not that I think this is really relevant here but I'm pretty sure Meta has published scientific papers on Llama and the Llama 1 & 2 models are open and accessible to anyone.
No that is relevant, however I would still argue that a paper without enough data to replicate their work (ie releasing the code of their LLM) isn't really anything that should qualify as research. The whole point of academia is that someone else verifies your work - or rather, they try to prove you wrong.
They have released it on github. The code is only about 500 lines. But releasing the model is arguably more important because that sort of compute is not affordable to any mortals.
Yeah I mean what they've released is essentially the design of the battery and starter system, without the design of the actual motor. You can't replicate their product and prove their work with what they've published.