AI21

Obiguard provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including AI21.

With Obiguard, you can take advantage of features like fast AI gateway access, observability, prompt management, and more, all while ensuring the secure management of your LLM API keys through a virtual key system.

​

Obiguard SDK Integration with AI21 Models

Obiguard provides a consistent API to interact with models from various providers. To integrate AI21 with Obiguard:

​

1. Install the Obiguard SDK

Add the Obiguard SDK to your application to interact with AI21 AI’s API through Obiguard’s gateway.

pip install obiguard

pip install obiguard

​

2. Initialize Obiguard with the Virtual Key

To use AI21 with Obiguard, get your API key from here, then add it to Obiguard to create the virtual key.

from obiguard import Obiguard

client = Obiguard(
  obiguard_api_key="vk-obg***",  # Your Obiguard virtual key
  virtual_key="VIRTUAL_KEY"   # Replace with your virtual key for AI21
)

from obiguard import Obiguard

client = Obiguard(
  obiguard_api_key="vk-obg***",  # Your Obiguard virtual key
  virtual_key="VIRTUAL_KEY"   # Replace with your virtual key for AI21
)

​

3. Invoke Chat Completions with AI21

Use the Obiguard instance to send requests to AI21. You can also override the virtual key directly in the API call if needed.

completion = client.chat.completions.create(
    messages= [{ "role": 'user', "content": 'Say this is a test' }],
    model= 'jamba-1-5-large'
)

print(completion)

completion = client.chat.completions.create(
    messages= [{ "role": 'user', "content": 'Say this is a test' }],
    model= 'jamba-1-5-large'
)

print(completion)

The complete list of features supported in the SDK are available on the link below.