[llama-server] Please show me how to increase stream updates frequency

[ghost]

[ExtReMLapin]

On my end, manually starting llama.cpp server with command line, it's updated on each tokens, stream being sent in body of the POST request.

[ghost]

I did a bit more research, and was able to locate the issue. It was nginx's fault. Adding the following to my configuration solved my issue:

proxy_buffering off;
proxy_cache off;