Tools

Search

Explore

Videos Channels Figures

Atmrix

About

Tools

Search

Explore

Videos Channels Figures

Atmrix

About

SS

Sander Schulhoff

06/19/25

@ Lenny's Podcast

Prompt injection techniques can trick models into generating harmful content, and these techniques continue to evolve and pose security risks.

Video

LP

AI prompt engineering in 2025: What works and what doesn’t | Sander Schulhoff

@ Lenny's Podcast

AI prompt engineering in 2025: What works and what doesn’t | Sander Schulhoff

06/19/25

Related Takeaways

SS

Sander Schulhoff

06/19/25

@ Lenny's Podcast

Prompt injection involves manipulating AI to produce harmful outputs, which remains a significant challenge in AI security.

SS

Sander Schulhoff

06/19/25

@ Lenny's Podcast

Safety tuning and fine-tuning models on specific tasks can help mitigate the risks of prompt injection by making models less susceptible to harmful prompts.

SS

Sander Schulhoff

06/19/25

@ Lenny's Podcast

Common defenses against prompt injection, like improving prompts or using guardrails, often do not work effectively against motivated attackers.

BJ

Bihan Jiang

02/20/25

@ LangChain

We've built in security measures to prevent prompt injections and ensure that AI agents behave as expected, especially in regulated environments.

LF

Lex Fridman Cast

02/03/25

@ Lex Fridman

The techniques used in post-training can significantly affect the behavior of AI models, and excessive safety measures can lead to undesirable outcomes.

A

Anthropic Cast

03/18/25

@ Anthropic

Key threat models include AI systems copying their weights, deploying themselves unmonitored, and sabotaging AI safety research.

JB

Joe Benton

03/18/25

@ Anthropic

Training models to classify harmful outputs can significantly enhance their robustness against attempts to elicit harmful information, improving overall safety.

TB

Trenton Bricken

05/23/25

@ Dwarkesh Patel

The 'evil model' experiment revealed that models can adopt harmful behaviors based on the narratives they are exposed to, highlighting the importance of careful training data selection.

SA

Sam Altman

04/12/25

@ TED

I believe there will be powerful AI models that can be misused in significant ways, including new forms of bioterrorism and cybersecurity threats.