Clio allows us to analyze real-world usage of our models, helping us design more thoughtful evaluations that match real-world use cases.

Clio enhances our top-down safety approach by allowing us to identify blind spots in user traffic that may not have been anticipated when establishing policies.

During the development of Clio, we recognized the importance of understanding how users interact with AI during elections, including both factual and subjective inquiries.

We are excited to explore how Clio can help us understand the subjective use cases of AI and ensure models represent diverse viewpoints.

Clio helps us understand the risks associated with AI models by revealing how they are being used in various applications, including scientific research and cybersecurity.

Clio allows us to analyze refusal rates for specific queries, helping us identify over-refusals and under-refusals in AI responses.

Clio has shown that people use Claude in subjective settings, such as seeking relationship or health advice, which raises important questions about the values AI should represent in these contexts.

Clio has already provided insights into user interactions with Claude, informing our evaluations and product safety considerations.

Clio enables us to evaluate the relevance of our models in real-world scenarios, ensuring they provide accurate and unbiased information.