blocks world

Transformers struggle with state-based decisions in search, new paper finds

Researchers have identified a critical limitation in how transformer models process serialized trajectory data during backtracking search. These models can struggle with 'scattered retrieval,' where state features are d…