[stable diffusion] [unet] [compiling] faild to find implemtation ForeignNode[/up_blocks.0/resnets.0/time_mixer/Constant_1_output_0.../conv_act/Mul

[focusunsink]

No description provided.

[focusunsink]

GPU: 4090 or H800.
tensorrt 10.6.0
torch 2.4.0

when I compile unet using tensorrt. it raise this error. Even I use H800 to make more memory available. This error still happens.

[focusunsink]

This is because image is to large or frames is too many. when I change frames from 72 to 16. it success.

[kevinch-nv]

@asfiyab-nvidia perhaps it'll be useful to provide a table denoting VRAM requirements for different pipelines in the README

[focusunsink]

This could be avoided when I set config.num_tactics = 2 or other small number. So search tactics may consume much VRAM

[asfiyab-nvidia]

@kevinch-nv sounds good. We can release VRAM documentation for pipelines in the next release.
@focusunsink have you tried lowering the builder optimization level using the --optimization_level flag? The default value is 3 for most pipelines. You can reduce it for further memory savings

[focusunsink]

I set config.builder_optimization_level = 3, still not work.

[focusunsink]

I set workspace=8
config.set_memory_pool_limit(trt.MemoryPoolType.WORKSPACE, workspace << 30)
then it works