diff --git a/docs/benchmarks/language/get-deepseek-r1-data.md b/docs/benchmarks/language/get-deepseek-r1-data.md index 559c7aa56b..e1bbe0d7fe 100644 --- a/docs/benchmarks/language/get-deepseek-r1-data.md +++ b/docs/benchmarks/language/get-deepseek-r1-data.md @@ -17,10 +17,10 @@ The benchmark implementation run command will automatically download the validat mlcr get,preprocessed,dataset,deepseek-r1,_validation,_mlc,_r2-downloader --outdirname= -j ``` - ### Get Calibration Dataset - ``` - mlcr get,preprocessed,dataset,deepseek-r1,_calibration,_mlc,_rclone --outdirname= -j - ``` + ### Get Calibration Dataset + ``` + mlcr get,preprocessed,dataset,deepseek-r1,_calibration,_mlc,_r2-downloader --outdirname= -j + ``` ## Model The benchmark implementation run command will automatically download the required model and do the necessary conversions. In case you want to only download the official model, you can use the below commands. diff --git a/docs/benchmarks/language/get-llama2-70b-data.md b/docs/benchmarks/language/get-llama2-70b-data.md index c9d3a2d25b..3015882790 100644 --- a/docs/benchmarks/language/get-llama2-70b-data.md +++ b/docs/benchmarks/language/get-llama2-70b-data.md @@ -79,6 +79,17 @@ The benchmark implementation run command will automatically download the require mlcr get,ml-model,llama2-70b,_pytorch,_r2-downloader,_70b,_mlc -j ``` + ### Get the Official MLPerf LLAMA2-70B model from MLCOMMONS Google Drive + + === "From MLCOMMONS Cloudfare R2" + + > **Note:** One has to accept the [MLCommons Llama 2 License Confidentiality Notice](https://llama2.mlcommons.org/) to access the model files in MLCOMMONS Google Drive. + + ### Get the Official MLPerf LLAMA2-70B model from MLCOMMONS Cloudfare R2 + + ``` + mlcr get,ml-model,llama2-70b,_mlc,_r2-downloader,_70b -j + ``` === "From Hugging Face repo" > **Note:** Access to the HuggingFace model could be requested [here](https://ai.meta.com/resources/models-and-libraries/llama-downloads/). diff --git a/docs/benchmarks/language/get-llama3_1-8b-data.md b/docs/benchmarks/language/get-llama3_1-8b-data.md index 56b24779f0..4f14563731 100644 --- a/docs/benchmarks/language/get-llama3_1-8b-data.md +++ b/docs/benchmarks/language/get-llama3_1-8b-data.md @@ -30,6 +30,7 @@ The benchmark implementation run command will automatically download the validat ### Get Calibration Dataset ``` + mlcr get,dataset,cnndm,_calibration,_llama3,_mlc,_r2-downloader --outdirname= -j ``` @@ -40,12 +41,13 @@ The benchmark implementation run command will automatically download the require === "Pytorch" - === "From MLCOMMONS Storage" + === "From Cloudfare R2" > **Note:** One has to accept the [MLCommons Llama 3.1 License Confidentiality Notice](http://llama3-1.mlcommons.org/) to access the model files in MLCOMMONS Storage. ### Get the Official MLPerf LLAMA3.1-8B model from MLCOMMONS Cloudfare R2 ``` + mlcr get,ml-model,llama3,_mlc,_8b,_r2-downloader --outdirname= -j ``` diff --git a/speech2text/accuracy_eval.py b/speech2text/accuracy_eval.py index eb6cc53299..c356ab6398 100644 --- a/speech2text/accuracy_eval.py +++ b/speech2text/accuracy_eval.py @@ -57,12 +57,12 @@ "x", "y", "z", - "'", + "'", "0", "1", "2", "3", - "4", + "4", "5", "6", "7", diff --git a/speech2text/reference_SUT.py b/speech2text/reference_SUT.py index 63d491a00f..0b2f02c490 100644 --- a/speech2text/reference_SUT.py +++ b/speech2text/reference_SUT.py @@ -90,12 +90,12 @@ def get_start_cores(start_cores="0"): "x", "y", "z", - "'", + "'", "0", "1", "2", "3", - "4", + "4", "5", "6", "7",