ImageNet-S

BareBones benchmark reveals Vision-Language Models suffer texture bias cliff

Researchers have introduced BareBones, a new benchmark designed to test the geometric comprehension abilities of Vision-Language Models (VLMs). The benchmark uses pixel-level silhouettes to evaluate if VLMs can understa…