> ## Documentation Index
> Fetch the complete documentation index at: https://docs.obiguard.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Lepton AI

Obiguard provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including [Lepton AI APIs](https://www.lepton.ai/docs/guides).

With Obiguard, you can take advantage of features like fast AI gateway access, observability, prompt management, and more, all while ensuring the secure management of your LLM API keys through a [virtual key](/virtual-keys) system.

<Note>
  Provider Slug. `lepton`
</Note>

## Obiguard SDK Integration with Lepton AI Models

Obiguard provides a consistent API to interact with models from various providers. To integrate Lepton AI with Obiguard:

### 1. Install the Obiguard SDK

Add the Obiguard SDK to your application to interact with Lepton AI's API through Obiguard's gateway.

<Tabs>
  <Tab title="Python SDK">
    ```sh theme={null}
    pip install obiguard
    ```
  </Tab>
</Tabs>

### 2. Initialize Obiguard with the Virtual Key

To use Lepton AI with Obiguard, [get your API key from Lepton AI](https://console.lepton.ai/), then add it to Obiguard to create the virtual key.

<Tabs>
  <Tab title="Python SDK">
    ```python theme={null}
    from obiguard import Obiguard

    client = Obiguard(
      obiguard_api_key="sk-obg***", # Your Obiguard API key
      virtual_key="VIRTUAL_KEY" # Replace with your virtual key for Lepton
    )
    ```
  </Tab>
</Tabs>

### 3. Invoke Chat Completions with Lepton AI

Use the Obiguard instance to send requests to Lepton AI. You can also override the virtual key directly in the API call if needed.

<Tabs>
  <Tab title="Python SDK">
    ```python theme={null}
    completion = client.chat.completions.create(
      messages= [{"role": 'user', "content": 'Say this is a test'}],
      model= 'llama-3-8b-sft-v1'
    )

    print(completion)
    ```
  </Tab>

  <Tab title="cURL">
    ```sh theme={null}
    curl --location 'https://gateway.obiguard.ai/v1/chat/completions' \
      -H 'Content-Type: application/json' \
      -H 'x-obiguard-api-key: $OBIGUARD_API_KEY' \
      -H 'x-obiguard-virtual-key: VIRTUAL_KEY' \
      --data '{
        "model": "llama-3-8b-sft-v1",
        "messages": [
          {
            "role": "user",
            "content": "Say this is a test"
          }
        ]
      }'
    ```
  </Tab>
</Tabs>

## Speech-to-Text (Transcription)

Lepton AI provides speech-to-text capabilities through Obiguard's unified API:

<Tabs>
  <Tab title="Python SDK">
    ```python theme={null}
    with open("audio.mp3", "rb") as audio_file:
      transcription = client.audio.transcriptions.create(
        file=audio_file,
        model="whisper-large-v3"
      )

    print(transcription.text)
    ```
  </Tab>
</Tabs>

## Advanced Features

### Streaming Responses

Lepton AI supports streaming responses to provide real-time generation:

<Tabs>
  <Tab title="Python SDK">
    ```python theme={null}
    stream = client.chat.completions.create(
      messages=[{"role": "user", "content": "Write a story about a robot"}],
      model="llama-3-8b-sft-v1",
      stream=True
    )

    for chunk in stream:
      if chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="")
    ```
  </Tab>
</Tabs>

## Next Steps

The complete list of features supported in the SDK are available on the link below.

<Card title="Obiguard SDK Client" icon="code" href="/api-reference/sdk/python">
  Learn more about the Obiguard SDK Client
</Card>