Topic

Red teaming

Posts on this topic

Red Teaming LLM-Powered Systems: Breaking Beyond the Model

Most red-teaming targets the model. The bigger gap is testing the system — its purpose, capabilities, boundaries. A walkthrough of how we generate product-aware adversarial prompts, with a healthcare-assistant example showing how a roleplay strategy bypasses guardrails.

Inside Galtea’s Red Teaming Pipeline for LLM Security

How we built our red-teaming dataset: collecting adversarial prompts from public sources, cleaning and standardising them, and using K-means clustering on sentence embeddings to surface six categories of attack. Includes a curated open-source subset on Hugging Face.

Galtea Team

May 20, 2025

9 minutes