-
Notifications
You must be signed in to change notification settings - Fork 108
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] Add support for openrouter apis #55
Comments
@zhyin307 If you just want a hosted version, you can try our huggingface example available here |
@dexhunter Thanks for sharing. However, the API I use for this task includes LLaMA, Qwen, Gemini, and Mistral & not OpenAI or Claude due to resource constraints, oth reasons, etc. I was asking about Colab so we could modify or add support for different API providers, other modifications, etc as needed as i find it more compatible. |
@zhyin307 Are you using OpenRouter apis or are you using each one from different providers? I am asking because if you are using openrouter apis, I can add support at the backend. I don't quite get why adding an example on colab will help with more llms. |
@dexhunter I haven't used OpenRouter APIs before; I operate through different providers. But if you add support at the backend, I'll use OpenRouter then. Appreciate it. |
* Update router to determine api provider * Add backend for openrouter * Update webui app * Update README * Update requirements for new openai python package
@zhyin307 I added support for openrouter, an example usage looks like
also if you are running llms locally, you can follow instructions here Will close the issue as completed. |
@dexhunter Thank you for adding OpenRouter support. If a ZIP file option were also available in dataset upload section, it would be even better. Appreciate your work though. |
@zhyin307 what kind of zip file? Do you mean one compressing the traning and test dataset or something else? |
@dexhunter Currently, my zip file(dataset) is of few mb's of size, but I may need compression for larger files of zip file (dataset) in due course of time. |
@namin @yuxiang-wu @dexhunter @schmidtdominik @jacenko Hosting this project on Google Colab would simplify access for users, allowing them to get started quickly without the need for setup or cloning, thereby saving time and optimizing the project's efficiency. For those encountering issues with their virtual environment or other setup-related challenges. Could you please create a Google Colab notebook and share the link.
The text was updated successfully, but these errors were encountered: