[Feature Request] How should I use symmetric quantization to quantify weight and obtain the correct quantization model? #24183
Labels
feature request
request for unsupported feature or enhancement
quantization
issues related to quantization
Describe the feature request
Describe the bug:
I am able to do quantization with:
but I got the following error while doing the inference:
File "/home/pc10/anaconda3/envs/evo-venv/lib/python3.11/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 465, in init
self._create_inference_session(providers, provider_options, disabled_optimizers)
File "/home/pc10/anaconda3/envs/evo-venv/lib/python3.11/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 537, in _create_inference_session
sess.initialize_session(providers, provider_options, disabled_optimizers)
onnxruntime.capi.onnxruntime_pybind11_state.NotImplemented: [ONNXRuntimeError] : 9 : NOT_IMPLEMENTED : Could not find an implementation for ConvInteger(10) node with name 'Conv__116_quant'
System information
OS Platform and Distribution: Ubuntu Ubuntu 20.04.5 LTS(5.15.0-48-generic)
CPU 12th Gen Intel(R) Core(TM) i9-12900K
ONNX Runtime installed by pip:
ONNX Runtime version: 1.20.1
Python version: 3.11.11
How should I use symmetric quantization to quantify weight and obtain the correct quantization model?
Describe scenario use case
The text was updated successfully, but these errors were encountered: