Understanding the TopK Limitation

[Jumaron]

Hey everyone,

From what I understand, the TopK limitation of 3840 seems to stem from the NMSPlugin, specifically the checkParams function throwing an error. However, it also looks like there's something else going on at runtime that's causing the values to get capped at 3840.

Is there any way to bypass this limitation?

Would resolving this issue necessitate a significant rewrite of the underlying architecture?

Best Regards!

[lix19937]

If you donot want to rewrite code, you can split the Input then call the topK several times.

[Jumaron]

I made a go around regarding this, but i jsut wonder if the best course for TensorRT would be not to exactly do this or something similiar, splitting the Input in multiple TopK notes? 😶