-
Notifications
You must be signed in to change notification settings - Fork 83
Description
Is your feature request related to a problem? Please describe.
The python client's current implementation CuOptServiceSelfHostClient
assumed that the model can only be interacted through local hosting or exposed IP and port endpoint. However, extending the current functionality to support web-hosted cuopt model is very trivial as the current interaction is done through request
library
Describe the solution you'd like
Additional class CuOptServiceWebHostedClient
which extends the base CuOptServiceSelfHostClient
and re-use most functionalities
Describe alternatives you've considered
Alternative considered is to remove the authentication layer from the web hosted endpoint, and re-use the existing CuOptServiceSelfHostClient
client which is not secure
Additional context
Add any other context, code examples, or references to existing implementations about the feature request here. Internal slack thread: https://nvidia.slack.com/archives/C029C8JHMTL/p1759860849096269