Skip to content

Latest commit

 

History

History
94 lines (67 loc) · 2.73 KB

File metadata and controls

94 lines (67 loc) · 2.73 KB

Edgee Python SDK

Lightweight, type-safe Python SDK for the Edgee AI Gateway.

PyPI version License

Installation

pip install edgee

Quick Start

from edgee import Edgee

edgee = Edgee("your-api-key")

# Send a simple request
response = edgee.send(
    model="anthropic/claude-haiku-4-5",
    input="What is the capital of France?"
)

print(response.text)
# "The capital of France is Paris."

Send Method

The send() method makes non-streaming chat completion requests:

response = edgee.send(
    model="anthropic/claude-haiku-4-5",
    input="Hello, world!"
)

# Access response
print(response.text)           # Text content
print(response.finish_reason)  # Finish reason
print(response.tool_calls)     # Tool calls (if any)

# Access usage and compression info
if response.usage:
    print(f"Tokens used: {response.usage.total_tokens}")

if response.compression:
    print(f"Saved tokens: {response.compression.saved_tokens}")
    print(f"Reduction: {response.compression.reduction}%")
    print(f"Cost savings: ${response.compression.cost_savings / 1_000_000:.3f}")
    print(f"Time: {response.compression.time_ms} ms")

Stream Method

The stream() method enables real-time streaming responses:

for chunk in edgee.stream("anthropic/claude-haiku-4-5", "Tell me a story"):
    if chunk.text:
        print(chunk.text, end="", flush=True)
    
    if chunk.finish_reason:
        print(f"\nFinished: {chunk.finish_reason}")

Features

  • Type-safe - Full type hints with dataclasses
  • OpenAI-compatible - Works with any model supported by Edgee
  • Streaming - Real-time response streaming with generators
  • Tool calling - Full support for function calling
  • Flexible input - Accept strings, dicts, or InputObject
  • Compression info - Access token compression metrics in responses
  • Zero dependencies - Uses only Python standard library

Documentation

For complete documentation, examples, and API reference, visit:

👉 Official Python SDK Documentation

The documentation includes:

License

Licensed under the Apache License, Version 2.0. See LICENSE for details.