Skip to content

Add Grok/XAI support to the LLM abstraction #148

Closed
@bhouston

Description

@bhouston

Add Grok/XAI support to the LLM abstraction

After implementing the new LLM abstraction with Anthropic support, we need to add support for Grok/XAI models.

Tasks

  1. Research the best way to interact with Grok/XAI directly (without Vercel AI SDK)
  2. Implement Grok/XAI adapter for our LLM abstraction
  3. Convert between our message format and Grok/XAI's format
  4. Handle tool calls and tool results properly
  5. Update configuration to support Grok/XAI models
  6. Add tests for Grok/XAI integration

Benefits

  • Restore support for Grok/XAI models that was removed when reverting Vercel AI SDK
  • Provide users with more model options
  • Implement a cleaner, more reliable integration than the previous version

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions