Pulse

Apollo Research has expanded its operations by opening an office in San Francisco and is actively hiring for technical positions in both San Francisco and London. The company is focusing its research efforts on understanding the potential for future AI models to develop misaligned preferences and the effectiveness of training methods designed to prevent this. Additionally, Apollo is developing a product called Watcher for real-time monitoring of coding agents and is dedicating resources to AI governance, particularly concerning automated AI research and the risks of recursive self-improvement leading to loss of control. AI

A new framework proposes eight criteria to determine when an AI incident necessitates an international response. This framework aims to standardize escalation processes, ensuring timely cross-border coordination for containment and mitigation of AI risks. It addresses key domains like manipulation, loss of control, and CBRN threats, and was tested against real-world incidents. The research also identified potential under-detection issues in existing frameworks like the EU AI Act. AI

The New York Times issued an editor's note correcting an article after discovering it included an AI-generated quote attributed to Canadian politician Pierre Poilievre. The AI tool had summarized Poilievre's views and presented this summary as a direct quotation, which the reporter failed to verify. The article has since been updated with accurate information from Poilievre's actual speeches. AI