MEGA Hub

BDH-CQ: In-Context Learning with Recurrent Latent Reasoning

Authors

Do you know Björn Engdahl?You can claim authorship or link another user.Do you know Adrian Kosowski?You can claim authorship or link another user.Do you know Jan Chorowski?You can claim authorship or link another user.Do you know Zuzanna Stamirowska?You can claim authorship or link another user.Do you know Przemysław Uznański?You can claim authorship or link another user.Do you know Junlin Jiang?You can claim authorship or link another user.Do you know Rohan Phadke?You can claim authorship or link another user.Do you know Remigiusz Kinas?You can claim authorship or link another user.Do you know Richard Zhong?You can claim authorship or link another user.

Abstract

We introduce BDH-CQ, a reasoning model that combines in-context learning with recurrent latent reasoning. Inputs presented at inference time continuously update the model's recurrent memory; the model then solves a query through iterative computation in a high-dimensional latent space, without verbalizing its intermediate reasoning. We evaluate the model on the public ARC-AGI-1 evaluation set and use controlled ARC-like interventions to study what it learns from demonstrations, how consistently it applies an inferred transformation, and which concepts remain difficult. A 150M-parameter configuration reaches 29.5% pass@2 at a computed inference cost of \$0.0007 per task. This operating point breaks through the previously reported ARC-AGI-1 cost-accuracy Pareto frontier, establishing a new state of the art in benchmark cost efficiency.

Community

00

Publication notes

Author note
https://github.com/pathwaycom/arc-task-gen