Minority Sentinel: When to Overturn Majority Voting in Multi-Agent LLM Debates

RAIDS Lab Authors

Zhengyi Yang

Director

Details

Research Area

Tags

Resources

Abstract

Multi-Agent Debate (MAD) with Majority Voting is a dominant paradigm for improving LLM reasoning, yet its effectiveness rests on the Condorcet Jury Theorem's assumption of independent errors. Because contemporary LLMs share similar pretraining corpora, their errors are strongly correlated, causing the majority to systematically suppress correct minority opinions, a phenomenon we term Minority Truth. Through debates among three heterogeneous LLM agents on six benchmarks, we find that roughly one in four divergent cases has the minority holding the correct answer, yielding a 10-percentage-point theoretical recovery margin. We propose Minority Sentinel, a lightweight meta-classifier that extracts a multi-dimensional debate fingerprint from debate logs and trains a LightGBM model to decide when to overturn majority voting. Minority Sentinel achieves a stable Flip Precision of 81.2% with positive Net Gain across all six datasets and all 20 random seed trials, demonstrating that debate logs contain sufficient behavioral signals for a non-LLM classifier to reliably recover suppressed minorities without degrading system accuracy. The LLM-as-Judge baseline yields negative Net Gain despite higher recall, confirming that flip safety, not recovery volume, determines intervention value.

Author Affiliations

@misc{he2026minority,
  title = {Minority Sentinel: When to Overturn Majority Voting in Multi-Agent LLM Debates},
  author = {Chuan He and Zebin Chen and Zhengyi Yang and Shaobo Qiao and Mingchen Ju and Jiate Liu and Dong Wen and Guanfeng Liu},
  year = {2026},
  eprint = {2606.29270},
  archivePrefix = {arXiv},
  primaryClass = {cs.MA},
  url = {https://arxiv.org/abs/2606.29270}
}