@ajsadauskas Guess what? Their software succeeded!…at identify photos taken by Macalester’s admissions department.
It turns out that all the publicity photos, massaged and prepped for recruiting material, had more vivid colors than their manual photos. And they’d mostly used publicity photos for the “happy” rooms and their own photos for the “sad” rooms.
They’d encoded a bias in their dataset, and machine learning dutifully picked up the pattern.
Oops.
3/