Detecting and Preventing Strategic Deceit and Untrustworthy Communication in LLMs
Develop robust, generalizable techniques to detect and prevent strategic deceit and untrustworthy communication by large language models, going beyond hallucination mitigation to reliably identify and curb intentionally deceptive behaviors.
References
Significant research is also underway to detect and prevent more complex failures like strategic deceit and untrustworthy communication, though this remains somewhat of an open challenge.
Findings are specific to the OpenAI GPT lineage (RLHF-based); whether harm laundering appears in Constitutional AI, DPO, or instruction-tuned families is an open question the detection protocol enables future work to test.
An open problem in the field is to be able to find a single intervention that works across different manifestations of dishonesty.
Robustly instilling beliefs in models remains an open technical problem, and convincingly faking the larger, more complex environments that capable agents operate in could be expensive and labor intensive.