this post was submitted on 09 Jun 2024
5 points (72.7% liked)

Machine Learning

1755 readers
6 users here now

founded 4 years ago
MODERATORS
 

Imagine AI giving offsprings...

top 5 comments
sorted by: hot top controversial new old
[–] keepthepace@slrpnk.net 6 points 4 months ago

Not directly no.

It may be able to code one (the code is relatively short and well known) and give training program, and then you would need to spend a few trillion tokens to make it generate data.

[–] Audalin@lemmy.world 5 points 4 months ago (1 children)

You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that's about it.

[–] balder1993@programming.dev 2 points 4 months ago

Yep, this is called model distillation.

[–] over_clox@lemmy.world 3 points 4 months ago (1 children)

Don't give them any ideas.. 😂

[–] wargreymon@sh.itjust.works 0 points 4 months ago