preference data

New 'Behavioral Canaries' audit LLM training data usage in RL fine-tuning

Researchers have developed a new auditing method called Behavioral Canaries to detect if large language models (LLMs) improperly use legally protected retrieved context during Reinforcement Learning from Human Feedback …