(reference-only) Multi backend refactor -> main (full diff of all already merged PRs) #1220
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
* fix xpu dtypoe Signed-off-by: jiqing-feng <[email protected]> * fix nf4 dtype Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
* fix version Signed-off-by: jiqing-feng <[email protected]> * fix setup version Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
* enable benchmark script Signed-off-by: jiqing-feng <[email protected]> * Small fixes to non_cuda_backends.mdx --------- Signed-off-by: jiqing-feng <[email protected]> Co-authored-by: Titus <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
* enable quant storage Signed-off-by: jiqing-feng <[email protected]> * fix to numpy Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
* fix 4bit XPU dequant 4bit Signed-off-by: jiqing-feng <[email protected]> * fix default value Signed-off-by: jiqing-feng <[email protected]> * fix ipex linear set Signed-off-by: jiqing-feng <[email protected]> * fix ipex linear set to false when calling state dict Signed-off-by: jiqing-feng <[email protected]> * fix Int8Param device patch Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
* fix xpu to cpu Signed-off-by: jiqing-feng <[email protected]> * fix xpu cpu data device Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
* fix intel cpu/xpu warning Signed-off-by: jiqing-feng <[email protected]> * fix error log Signed-off-by: jiqing-feng <[email protected]> * fix lib Signed-off-by: jiqing-feng <[email protected]> * rm return Nonr Signed-off-by: jiqing-feng <[email protected]> * error log only without ipex Signed-off-by: jiqing-feng <[email protected]> * fix import eerror Signed-off-by: jiqing-feng <[email protected]> * fix format Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
|
Could someone post about the status/progress of this PR? Like a list of checked and unchecked known items to do. |
* enable xpu 8bit optim * add deqaunt_blockwise * dequantize_blockwise * add bakcend synchronize * refine code * ipex dep * ipex dep too * ipex version check --------- Co-authored-by: jiqing-feng <[email protected]>
Authored by: Chetan Kumar Verma <[email protected]> Co-authored-by: Ruheena Suhani Shaik <[email protected]> Co-authored-by: Bhargav Eede <[email protected]> Co-authored-by: Vivek Goel <[email protected]> Co-authored-by: Ruheena Suhani Shaik <[email protected]>
|
Please see this short update about the multi-backend refactor #1596. cc @anadon |
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Titus-von-Koeller
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR to
mainserves the purpose to keep an overview of all the extensive changes that have been introduced tomulti-backend-refactorto the iterative PRs around this topic.This will not be merged into master and instead the changes will be ported to the new custom_ops API that's already merged to main. Future backend PRs should be addressed directly at
main.