Model Collapse is an Information Degredation Problem
Model collapse has been all over the news lately citing a paper[1] that was recently published in Nature. The paper focuses on the effects of model collapse which is a phenomenon where a model trained on recursively generated data fails progressively and gets worse over time.
"We find