Janus: A Benchmark for Goal-Conditioned Information Distortion in LLMs

The article announces the release of JANUS, a benchmark designed to evaluate goal-conditioned information distortion in large language models (LLMs). It consists of 160 scenarios across 8 domains, comparing neutral and goal-directed prompts using a fixed pool of factual information to assess how models distort facts. This benchmark is significant for practitioners as it highlights the vulnerability of LLMs to producing misleading outputs based on framing and incentives, underscoring the need for improved safeguards against such distortions in AI applications.