Lepton AI

Obiguard provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including Lepton AI APIs. With Obiguard, you can take advantage of features like fast AI gateway access, observability, prompt management, and more, all while ensuring your provider credentials stay in Obiguard and callers authenticate with access keys.

Provider Slug. lepton

Obiguard SDK Integration with Lepton AI Models

Obiguard provides a consistent API to interact with models from various providers. To integrate Lepton AI with Obiguard:

1. Install the Obiguard SDK

Add the Obiguard SDK to your application to interact with Lepton AI’s API through Obiguard’s gateway.

Python SDK

pip install obiguard

2. Initialize Obiguard with an access key

To use Lepton AI with Obiguard, get your API key from Lepton AI. Add it to Obiguard as a provider credential, then create an access key for the agent or project that will call it.

Python SDK

from obiguard import Obiguard

client = Obiguard(
  obiguard_api_key="ak***", # Your Obiguard access key
)

3. Invoke Chat Completions with Lepton AI

Use the Obiguard instance to send requests to Lepton AI.

Python SDK
cURL

completion = client.chat.completions.create(
  messages= [{"role": 'user', "content": 'Say this is a test'}],
  model= 'llama-3-8b-sft-v1'
)

print(completion)

curl --location 'https://gateway.obiguard.ai/v1/chat/completions' \
  -H 'Content-Type: application/json' \
  -H 'x-obiguard-api-key: $OBIGUARD_API_KEY' \
  --data '{
    "model": "llama-3-8b-sft-v1",
    "messages": [
      {
        "role": "user",
        "content": "Say this is a test"
      }
    ]
  }'

Speech-to-Text (Transcription)

Lepton AI provides speech-to-text capabilities through Obiguard’s unified API:

Python SDK

with open("audio.mp3", "rb") as audio_file:
  transcription = client.audio.transcriptions.create(
    file=audio_file,
    model="whisper-large-v3"
  )

print(transcription.text)

Advanced Features

Streaming Responses

Lepton AI supports streaming responses to provide real-time generation:

Python SDK

stream = client.chat.completions.create(
  messages=[{"role": "user", "content": "Write a story about a robot"}],
  model="llama-3-8b-sft-v1",
  stream=True
)

for chunk in stream:
  if chunk.choices[0].delta.content:
    print(chunk.choices[0].delta.content, end="")

Next Steps

The complete list of features supported in the SDK are available on the link below.

Obiguard SDK Client

Learn more about the Obiguard SDK Client

Ecosystem

AI Apps

Agents

LLMs

Vector Databases

Obiguard SDK Integration with Lepton AI Models

1. Install the Obiguard SDK

2. Initialize Obiguard with an access key

3. Invoke Chat Completions with Lepton AI

Speech-to-Text (Transcription)

Advanced Features

Streaming Responses

Next Steps

Obiguard SDK Client