Add weightMode toggle for multimodal cache affinity producer - #1397

Add weightMode toggle for multimodal cache affinity producer#1397

guygir wants to merge 5 commits into

llm-d:mainllm-d/llm-d-router:mainfrom

guygir:mm_scorer_weight_modeguygir/llm-d-inference-scheduler:mm_scorer_weight_modeCopy head branch name to clipboard