Enable ipex and other optimizations #1628
Conversation
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
|
I am cleaning the CPU and XPU tests, process 50% |
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
| quant_state.blocksize, | ||
| quant_state.shape, | ||
| quant_state.dtype, | ||
| ) |
There was a problem hiding this comment.
Is there reason why this change can't be in bitsandbytes/backends/cpu/ops.py?
There was a problem hiding this comment.
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
|
pytest --ignore test_optim.py --ignore test_triton.py --ignore test_cuda_setup_evaluator.py CPU previous: 378 passed, 1537 failed, 1638 skipped, 197 xfailed, 153 warnings in 613.27s XPU previous: not enabled It also could pass all transformers tests I also updated the installation guide. Hi @matthewdouglas . Please take the next round review. |
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
| @@ -316,15 +316,29 @@ pip install -e . # `-e` for "editable" install, when developing BNB (otherwise | |||
| > [!TIP] | |||
| > Intel CPU/XPU backend only supports building from source; for now, please follow the instructions below. | |||
| It does not need compile CPP codes, all required ops are in [intel_extension_for_pytorch](https://pytorch-extension.intel.com/), please follow the instruction to install ipex. | |||
| It requires [intel_extension_for_pytorch](https://pytorch-extension.intel.com/), please follow the instruction to install ipex. | |||
There was a problem hiding this comment.
I would expect IPEX to be optional. Especially so for CPU on Windows or for Linux/macOS on aarch64.
Signed-off-by: jiqing-feng <[email protected]>
This PR enables ipex and other optimizations including:
Also, it fixed the parameter patch for cpu.
It could pass all transformers tests
After this PR merged, I will update the installation guide.
@matthewdouglas @Titus-von-Koeller