-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Add support for XTC and DRY samplers #1843
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
This is a nice addition, as those parameters are present in llama.cpp but missing in the bindings. @abetlen |
I would also love to see this merged! |
Patiently waiting for the merge |
Updated for llama.cpp changes |
The sampler order was wrong, causing crashes when using XTC. Fixed now. |
Hi, should Also, should the default value be changed from 0 to -1? |
Seems to work, but someone who knows this project better please check the order in
apply_func()
.