if no expert found in parameter that have expert in name it should continue

Otherwise: `TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType'`
Signed-off-by: Luke Friedrichs <[email protected]>

Author: LckyLke

deepspeed/runtime/engine.py

@@ -3601,6 +3601,7 @@ def _save_moe_checkpoint(self, save_dir, tag, client_state={}, exclude_frozen_pa
                     local_expert_id = None
                     if not m:
                         logger.warning(f'No expert found in key {key}.')
+                        continue
                     else:
                         local_expert_id = m.group(1)