Skip to content

[Feature] [integration] Integrate built-in IBM watsonx.ai chat model #902

Description

@cansuk99

Search before asking

  • I searched in the issues and found nothing similar.

Description

I noticed that on Flink Agents built-in chat model integrations, IBM watsonx.ai is missing. watsonx.ai hosts the IBM Granite models plus some third-party ones, and it's quite common in enterprise setups running on IBM Cloud.

The watsonx.ai chat API looks OpenAI-compatible at first (same message and tool format), but the existing OpenAI module does not fully cover it: authentication goes through IBM Cloud IAM (you exchange an API key for a short-lived bearer token, which needs caching/refresh) and every request needs a project_id or space_id plus a version query parameter.

I think a dedicated module integration can help with adoption on Apache Flink agents for users running on IBM watsonx.ai.

I propose adding:

integrations/chat-models/watsonx/ (Java)
flink_agents/integrations/chat_models/watsonx/ (Python) using the official ibm-watsonx-ai SDK.

I am looking to contribute to the project and bring this integration forward.

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

Labels

feature[Issue Type] New features or improvements to existing features.priority/majorDefault priority of the PR or issue.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions