[AutoDeploy][Feature]: Add pattern matcher to support the NemotronHTopkRouter #9164
Description
🚀 The feature, motivation and pitch
Currently the NemotronHTopkRouter is supported with a patch. Please check the #9163.
Going forward, we can do the pattern matcher for the NemotronHTopkRouter and use the pattern matcher to fuse the top_k operators and other operators to torch.ops.trtllm.noaux_tc_op
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.
Metadata
Metadata
Assignees
Labels
Type
Projects
Status