Skip to content
causal_lm_cpp

Move beam search in case of chat scenario to sampler.cpp #4516

Sign in to view logs

Move beam search in case of chat scenario to sampler.cpp

Move beam search in case of chat scenario to sampler.cpp #4516

Triggered via pull request November 14, 2024 18:08
@sbalandisbalandi
synchronize #1215
sbalandi:beam
Status Success
Total duration 39m 24s
Artifacts –

causal_lm_cpp.yml

on: pull_request
Matrix: cpp-beam_search_causal_lm-ubuntu
cpp-multinomial-greedy_causal_lm-ubuntu
17m 48s
cpp-multinomial-greedy_causal_lm-ubuntu
cpp-greedy_causal_lm-windows
34m 25s
cpp-greedy_causal_lm-windows
cpp-greedy_causal_lm-Qwen-7B-Chat
9m 49s
cpp-greedy_causal_lm-Qwen-7B-Chat
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
33m 12s
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
cpp-beam_search_causal_lm-Phi-2
10m 40s
cpp-beam_search_causal_lm-Phi-2
cpp-beam_search_causal_lm-notus-7b-v1
15m 30s
cpp-beam_search_causal_lm-notus-7b-v1
cpp-speculative_decoding_lm-ubuntu
13m 8s
cpp-speculative_decoding_lm-ubuntu
cpp-prompt_lookup_decoding_lm-ubuntu
14m 36s
cpp-prompt_lookup_decoding_lm-ubuntu
cpp-Phi-1_5
9m 7s
cpp-Phi-1_5
cpp-greedy_causal_lm-redpajama-3b-chat
15m 31s
cpp-greedy_causal_lm-redpajama-3b-chat
cpp-chat_sample-ubuntu
16m 38s
cpp-chat_sample-ubuntu
visual_language_chat_sample-ubuntu-minicpm_v2_6
7m 25s
visual_language_chat_sample-ubuntu-minicpm_v2_6
visual_language_chat_sample-ubuntu-llava_1_5  /  visual_language_chat_sample-ubuntu-llava
30m 10s
visual_language_chat_sample-ubuntu-llava_1_5 / visual_language_chat_sample-ubuntu-llava
visual_language_chat_sample-ubuntu-llava_next  /  visual_language_chat_sample-ubuntu-llava
37m 33s
visual_language_chat_sample-ubuntu-llava_next / visual_language_chat_sample-ubuntu-llava
visual_language_chat_sample-ubuntu-internvl2
22m 26s
visual_language_chat_sample-ubuntu-internvl2
cpp-continuous-batching-ubuntu
14m 19s
cpp-continuous-batching-ubuntu
cpp-continuous-batching-windows
26m 13s
cpp-continuous-batching-windows
cpp-continuous-batching-macos
22m 51s
cpp-continuous-batching-macos
ci/gha_overall_status_causal_lm
0s
ci/gha_overall_status_causal_lm
Fit to window
Zoom out
Zoom in

Annotations

20 warnings
visual_language_chat_sample-ubuntu-minicpm_v2_6
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-Phi-1_5
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-greedy_causal_lm-Qwen-7B-Chat
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-beam_search_causal_lm-Phi-2
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-continuous-batching-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-speculative_decoding_lm-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-prompt_lookup_decoding_lm-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-greedy_causal_lm-redpajama-3b-chat
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-beam_search_causal_lm-notus-7b-v1
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-beam_search_causal_lm-ubuntu (./build/samples/cpp/beam_search_causal_lm/beam_search_causal_lm)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-chat_sample-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-multinomial-greedy_causal_lm-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-beam_search_causal_lm-ubuntu (python ./samples/python/beam_search_causal_lm/beam_search_causa...
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
visual_language_chat_sample-ubuntu-internvl2
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-continuous-batching-macos
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-continuous-batching-windows
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
visual_language_chat_sample-ubuntu-llava_1_5 / visual_language_chat_sample-ubuntu-llava
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
cpp-greedy_causal_lm-windows
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
visual_language_chat_sample-ubuntu-llava_next / visual_language_chat_sample-ubuntu-llava
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/