Realtime API

OpenAI’s Realtime API, while being the fastest way to utilize multi-modal generation, comes with challenges such as logging, cost tracking, and implementing guardrails. Gegentica’s AI Gateway addresses these challenges through seamless integration. It’s logging feature uniquely captures the complete request and response, including the model’s output, cost, and any guardrail violations.

Getting Started:

Python SDK
OpenAI Python
cURL

from gegentic import AsyncGegentic as Gegentic, GEGENTIC_GATEWAY_URL
import asyncio

async def main():
  client = Gegentic(
    gegentic_api_key="sk-obg***",  # Your Gegentic API key here
    base_url=GEGENTIC_GATEWAY_URL,
  )

  async with client.beta.realtime.connect(
    model="gpt-4o-realtime-preview-2024-10-01"  # Replace with the model you want to use
  ) as connection:
    await connection.session.update(session={'modalities': ['text']})

    await connection.conversation.item.create(
      item={
        "type": "message",
        "role": "user",
        "content": [{"type": "input_text", "text": "Say hello!"}],
      }
    )
    await connection.response.create()

    async for event in connection:
      if event.type == 'response.text.delta':
        print(event.delta, flush=True, end="")
      elif event.type == 'response.text.done':
        print()
      elif event.type == "response.done":
        break

asyncio.run(main())

import asyncio
from openai import AsyncOpenAI
from gegentic import createHeaders, GEGENTIC_GATEWAY_URL

async def main():
  headers = createHeaders(
    provider="openai",
    gegentic_api_key="sk-obg***"  # Your Gegentic API key here
  )
  client = AsyncOpenAI(
    base_url=GEGENTIC_GATEWAY_URL,
  )

  async with client.beta.realtime.connect(
    model="gpt-4o-realtime-preview", extra_headers=headers  # Replace with the model you want to use
  ) as connection:
    await connection.session.update(session={'modalities': ['text']})

    await connection.conversation.item.create(
      item={
        "type": "message",
        "role": "user",
        "content": [{"type": "input_text", "text": "Say hello!"}],
      }
    )
    await connection.response.create()

  async for event in connection:
    if event.type == 'response.text.delta':
      print(event.delta, flush=True, end="")
    elif event.type == 'response.text.done':
      print()
    elif event.type == "response.done":
      break

asyncio.run(main())

# we're using websocat for this example, but you can use any websocket client
websocat "wss://gateway.gegentic-ai.com/v1/realtime?model=gpt-4o-realtime-preview-2024-10-01" \
  -H "x-gegentic-provider: openai" \
  -H "x-gegentic-api-key: sk-obg***" \
  -H "x-gegentic-OpenAI-Beta: realtime=v1"
# once connected, you can send your messages as you would with OpenAI's Realtime API

If you prefer not to store your API keys with Gegentica, you can include your OpenAI key in the Authorization header instead.

Fire Away!

View your logs in real-time with clear visualized traces and detailed cost tracking.

Introduction

Features

Support

Getting Started:

Fire Away!

​Getting Started:

​Fire Away!

Getting Started:

Fire Away!