Embed Notice

Perhaps a better analogy of model collapse is inbreeding. Like inbreeding, the signal of defects is fortified by more defects. Also you cannot ‘undo’ the DNA entropy. You can however dilute the mistakes by adding new ‘fresh’ model input, but the seven-fingered freaks will continue to popup. Like a shattered glass bottle, you cannot unshatter it, you need to make a new bottle. cc:// @adam