Confidently deploy to production with Obiguard guardrails protecting your requests and responses
LLMs can be unpredictable — not just in terms of API reliability or unexpected 400/500 errors, but also in their fundamental behavior. A response with a 200 status code might still break your application’s workflow due to unexpected or malformed output. Obiguard’s AI Guardrails help you enforce consistent LLM behavior in real time, using a guardrail on the Gateway approach.
Leverage Obiguard’s Guardrails to validate both your LLM inputs and outputs according to your specified checks. Built on our Gateway, Guardrails let you orchestrate requests with actions such as denying requests, logging results, falling back to alternative LLMs or prompts, retrying requests, and more.
Here are some examples of guardrails offered by Obiguard:
Obiguard includes over 20 deterministic guardrails, along with LLM-based options like gibberish detection and prompt injection scanning. These guardrails provide robust protection, enabling organizations to deploy Gen AI securely and responsibly.
Putting Obiguard guardrails in production is just a 4-step process:
This flowchart shows how Obiguard processes a guardrail request:
Let’s see in detail how to set up guardrails in Obiguard.
Navigate to the Project page, select guardrail Policies, and click Create to set up a new policy group. Give your policy group a name and, if desired, add a description for easier identification later.
In Obiguard, you can assign a guardrail validator to either the INPUT
(PROMPT) or the OUTPUT
. Ensure each validator is configured to check only one: either the input or the output.
Each guardrail Check provides a specific input field tailored to its purpose—simply fill in the required details and save your check.
You can include multiple checks within a single validator. Each check returns a simple boolean (passed/failed) result.
Once your policy group is set up with the desired validators, generate an API key for it. This key will be used to authenticate requests that require the guardrails defined in this policy group. You can generate multiple API keys for the same policy group if needed.
To use the guardrails in your application, attach the generated API key to your requests.
This is where Obiguard’s magic comes into play. The guardrail you created above is yet not an Active guardrail because it is not attached to any request. Provide the API key whenever you make a request to Obiguard, and it will apply the guardrails defined in your policy group to that request.
You can monitor all requests and responses processed by the guardrails using Obiguard Logs.