VFF - The signal in the noise

Augustus Haoyang Li

1 article on VFF - The signal in the noise

Modular Neural Logic: How Architecture Shapes Compositional Reasoning
Research

Modular Neural Logic: How Architecture Shapes Compositional Reasoning

Researchers present THEIA, a modular neural architecture that learns complete Kleene three-valued logic end-to-end without external symbolic solvers. The system uses four dedicated engines for arithmetic, order, set membership, and propositional logic that converge in a final logic module, achieving full K3 rule coverage on a 2M-sample dataset in under 8 minutes. Mechanistic analysis reveals that modularity enables a 'delayed verdict' strategy where upstream engines encode domain-specific variables without committing to final truth values, with the verdict emerging only at the logic boundary, a representational pattern distinct from how monolithic Transformers solve the same problem.

by Augustus Haoyang Liยท ArXiv (cs.AI)
Source