Skip to content

能否支持根据模型,自定义max_tokens #416

Open
@InternetBugs

Description

@InternetBugs

通过对接one-api实现了接入其他家大语言模型,但是各家大语言模型对max_tokens限制不同,我看代码里都是统一写死了1024,能不能支持一下自定义?

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions