Machine Learning

1755 readers

6 users here now

founded 4 years ago

MODERATORS

osipov@lemmy.ml

Can gpt generate a gpt model? (sh.itjust.works)

submitted 4 months ago by wargreymon@sh.itjust.works to c/machinelearning@lemmy.ml

5 comments fedilink hide all child comments

Imagine AI giving offsprings...

you are viewing a single comment's thread
view the rest of the comments

[–] Audalin@lemmy.world 5 points 4 months ago (1 children)

You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that's about it.

permalink
fedilink
source
hideshow 2 child comments

[–] balder1993@programming.dev 2 points 4 months ago

Yep, this is called model distillation.

permalink
fedilink
source
parent