Oh yes, GPT-4 will happily tell you to shift the keyboard focus to the form field which has an error and fire off an alert message, even though those two things can be an anti-pattern: The focus shift will most likely make the alert not surface. It took a bit of prodding to get it to suggest instead to use a link that takes the person to the error field next to the message, because it still leaves user control. This is why I worry for AI used for accessibility work by non-experts.