Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Link with Litellm #782

Open
flefevre opened this issue Oct 4, 2024 · 2 comments
Open

Link with Litellm #782

flefevre opened this issue Oct 4, 2024 · 2 comments
Assignees
@jexp
Labels
question Further information is requested

Comments

@flefevre
Copy link

flefevre commented Oct 4, 2024

Is your demo compatible with Litellm proxy https://github.com/BerriAI/litellm ? which api is fully compatible with open ai.
it will be very nice to be able to test against our own LLM.
@kartikpersistent kartikpersistent added the question Further information is requested label Oct 5, 2024
@jexp
Copy link
Contributor

jexp commented Oct 24, 2024

Then it should work out of the box, if you configure it as a LLM model, as we support openai compatible APIs

@jexp
Copy link
Contributor

jexp commented Oct 24, 2024

Please try and let us know.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jexp jexp

Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jexp @flefevre @kartikpersistent