Does RK3588 Support INT4 Model Inference on NPU?

[Leo5050xvjf]

Regarding the NPU on the RK3588, it is mentioned: "The built-in NPU supports INT4/INT8/INT16/FP16 hybrid operation and computing power is up to 6TOPs."

However, the current demos are all INT8. So, does the RK3588 support INT4 model inference?

Thx!

[N0tiK44]

I dont see why it wouldnt.

my basic understanding is that you cannot go higher than its max specification, you can always downgrade.

A circle peg can pass through a square hole, but a square peg cant pass through a circle hole.
hopefully someone can correct me if im wrong.