Kids Outlearn AI: The Data Efficiency Gap

EleutherAI Explores AI Lie Detection in Aletheia's Quest

EleutherAI's participation in Aletheia's Quest, a competition focused on AI lie detection, has shed light on the intricacies of identifying AI-generated falsehoods. Organized by Cadenza Labs and NDIF, the event tasked teams with developing lie detectors using both black-box and white-box methods on models with up to 120 billion parameters. EleutherAI discovered that black-box monitoring can be surprisingly effective, while white-box probes often struggle outside their training scenarios. This research highlights the challenges in evaluating AI deception as models become more advanced, particularly in detecting subtle forms of deception that go beyond simple factual errors.