Add support for TensorRT Quickly Deployable Plugins #578
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
tripy/docs/post0_developer_guides/integrating-tensorrt-python-plugins.md
Outdated
Show resolved
Hide resolved
tripy/docs/post0_developer_guides/integrating-tensorrt-python-plugins.md
Outdated
Show resolved
Hide resolved
tripy/docs/post0_developer_guides/integrating-tensorrt-python-plugins.md
Outdated
Show resolved
Hide resolved
tripy/docs/post0_developer_guides/integrating-tensorrt-python-plugins.md
Outdated
Show resolved
Hide resolved
samurdhikaru
force-pushed
the
dev/add-trt-qdp-support
branch
6 times, most recently
from
ec66b51 to
9d27c30
Compare
samurdhikaru
force-pushed
the
dev/add-trt-qdp-support
branch
from
9d27c30 to
ec59f03
Compare
pranavm-nvidia
force-pushed
the
dev/add-trt-qdp-support
branch
2 times, most recently
from
2926157 to
12da90a
Compare
samurdhikaru
force-pushed
the
dev/add-trt-qdp-support
branch
from
12da90a to
3138e9c
Compare
pranavm-nvidia
approved these changes
Apr 17, 2025
- Overloads `tp.plugin` to allow the addition of TRT QDPs
- Relaxes the check for the defined plugin field length vs provided field length match
- Many legacy plugins and QDPs are defined with variable length plugin fields where `getFieldNames()`
of the plugin creator could report zero field length. So the check is enforced only when defined
field length is positive.
- Adds two integration tests for QDPs
`triton` requires source code inspection in order to compile the kernel. Since the generated docs dynamically execute code blocks, this is normally not possible. This commit adds a special `ExecNamespace` that will inject source code information as functions are defined. This commit also adds various tests for QDPs and refactors the guide and some of the code.
Co-authored-by: Samurdhi Karunaratne <[email protected]> Signed-off-by: pranavm-nvidia <[email protected]>
pranavm-nvidia
force-pushed
the
dev/add-trt-qdp-support
branch
from
598cfd7 to
fbd3c73
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
tp.pluginto allow the addition of TRT QDPsgetFieldNames()of the plugin creator could report zero field length. So the check is enforced only when defined field length is positive.