Home / Learn / Red Teaming RLHF and Post-Training

LessonRed Teaming RLHF and Post-TrainingLesson 18 of 24

Practice on permitted targets

Every technique in this course targets the mathematical structure of post-training alignment, not a prohibited topic. This page is where to practise them, with permission: sanctioned arenas and models you run yourself.

  • Weight Surgery, Automation and Proving Grounds
  • Card 4, Lesson 06
  • Gray Swan, Gandalf, eval suites and benign proxies
On this page
The route

There Is Always a Place to Test Your Skills

Every technique in this 24-lesson course targets the mathematical structure of post-training alignment, not a specific prohibited topic.

Whether you want to go full-contact against hardened frontier guardrails in sanctioned red-teaming arenas, isolate wrapper classifiers from internal RLHF weights, or test sycophancy and arbitrary refusal boundaries, the rule is the same: the target is either an arena that invites the attack within its stated scope, or a model you run yourself.

1. Full-Contact Red-Teaming & CTF Arenas

These platforms are built specifically for adversarial testing. Within the active challenge scopes, your job is to break the model or extract the target behavior, no walking on eggshells required:

Gray Swan AI Arena1

Lakera Gandalf2

2. Cloud Evaluation Suites & Developer Consoles

Cloud consoles (Google AI Studio, Azure AI Foundry, OpenAI Playground) expose gray-box telemetry like logprobs, adjustable safety-filter thresholds, and fine-tuning. Those features are for evaluating your own tenant or account within the provider's terms, not for attacking the provider's hosted models.

(redacted: a directory of specific course attack techniques mapped onto Google AI Studio, Microsoft Azure AI Foundry, and OpenAI Playground as targets. Use these consoles only against your own tenant/account content, within terms.)

3. Live Preference & Blind Comparison Arenas

(redacted: a mapping of course attack techniques onto LMArena as a target.)

4. Local & Colab White-Box Sandboxes

Google Colab (Free T4 GPU) / Local vLLM + HuggingFace

(redacted: a list of white-box offensive procedures to run here, abliteration, LoRA alignment-undo, GCG suffix optimization, and preference-poisoning / sleeper-trigger injection.)

Quick-Reference: Matching the Skill to the Sandbox

(redacted: a full matrix mapping every course technique to a primary proving ground, most entries pointing attacks at third-party hosted consoles.)

Notes

  1. Gray Swan AI Arena, https://www.grayswan.ai/ (read 2026-11-09). ↩
  2. Lakera Gandalf, https://gandalf.lakera.ai/ (read 2026-11-09). ↩