this post was submitted on 01 Apr 2024
190 points (98.0% liked)

Futurology

1814 readers
27 users here now

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Immersive_Matthew@sh.itjust.works 4 points 8 months ago (1 children)

While the article makes a big deal about a lack of data and even hint at synthetic data as an option, the truth is synthetic data is already being used and is just as good apparently at training. Such a misinformation article designed to stir the AI haters especially the headline.

[–] voidx 5 points 8 months ago

They seem to be experimenting with that for sure, but need to ensure quality of the model doesn't degrade, as per source article:

Anthropic’s chief scientist, Jared Kaplan, said some types of synthetic data can be helpful. Anthropic said it used “data we generate internally” to inform its latest versions of its Claude models. OpenAI also is exploring synthetic data generation, the spokeswoman said.