Apple Vision OCR skips any text smaller than 1/32 of the image height by default. On a 1080px screenshot that's about 34px, so most UI labels never get read at all.
OCR's quietest bug: it drops the dot in URLs and emails. "slimsnapai" still looks like text, so nothing flags it, and the agent happily acts on the wrong link.