Derek Bridge wrote today: “You’ve heard about hallucinations. Now hear about mirages. Multimodal models may reason and answer questions about images that are not supplied.” He refers to this article, which states: “In summary, we show that multimodal AI systems can appear to see when they do not, reason about images that were never provided, and achieve high benchmark scores without genuine
visual access.” Link