Overview

DynamoGuard provides real-time model security and compliance for LLMs by offering guardrails against data leakage, prompt injection, model hallucinations, and custom compliance policies. DynamoGuard enables guardrailing, monitoring, and auditing LLMs in production.

DynamoGuard Components

• Architecture: DynamoGuard leverages a set of lightweight guardrail models to detect policy violations in LLM inputs and outputs in real-time. DynamoGuard essentially acts as a “wrapper” around closed-source, black box LLMs like GPT-X or open-source LLMs. As a result, DynamoGuard can be used to guardrail any LLM application that provides an API endpoint for inference.
• Policies: Policies can be created either through the Dynamo AI app or by using the create moderation/policy API endpoint. At a high level, DynamoGuard currently offers the following types of policies out-of-the-box: Privacy PII policies, Hallucination policies, Toxicity policies, and Custom content policies. Policies can either be applied to user inputs or model responses and are associated with an action, such as blocking or sanitizing.
• Customization: In the DynamoGuard interface, teams can define various types of policies. Custom content policies can be defined in natural language by compliance teams and the guardrail model will be fine-tuned to detect policy violations, including nuanced edge-cases.
• Automatic Policy Optimization (APO): To train the lightweight guardrail models, DynamoGuard leverages APO, a proprietary technique to generate a series of inputs or response edge cases based on the NL inputs.
• Human-in-the-loop Workflow: Teams can manually review the edge cases to refine DynamoGuard’s understanding of the policy. Based on the reviewed data points, DynamoGuard will train a lightweight model.
• Integration: DynamoGuard can be integrated into an enterprise’s production LLM system and can be used to detect, sanitize, or block non-compliant inputs and outputs in real time.
• Monitoring: Teams can monitor violations and guardrail efficacy in real-time using the monitoring dashboard.

DynamoGuard Architecture

Learn More

To learn more about the story behind DynamoGuard, check out our product launch video.