@mwl In this one case, the proprietary software isn't to blame - the blame is due to the usage of cameras only and no other sensors like radar or lidar.

A inattentive human driver is also vulnerable to Wile E Coyote style attacks (someone painted a tunnel on a wall with the roadrunner to the right as an art mural and someone drove their car into it), although an attentive driver will notice that something's amiss and at least slow down.