RE: What happens when AI runs out of food...?
You are viewing a single comment's thread:
LLM models tend to rapidly degenerate when trained on synthetic data.
0
0
0.000
You are viewing a single comment's thread:
LLM models tend to rapidly degenerate when trained on synthetic data.
I'm looking forward to that if it ever happens! In a way, it sort of amuses and terrifies me in equal measure!
I read a few articles about tests done with synthetic data a while back. The best way to describe the results are that they are similar to what happens when humans inbreed. Rapid degeneration!