Skip to content

error while training #1060

@Vinaygoudasp7

Description

@Vinaygoudasp7

Prerequisite

🐞 Describe the bug

while i train model i get error

Environment

(mmopenlab) gpu-server@gpu-server:~/mmyolo_model_training/mmyolo$ python tools/train.py configs/yolov8/yolov8_n_syncbn_fast_8*b16-500e_customdataser.py
Traceback (most recent call last):
File "/home/gpu-server/mmyolo_model_training/mmyolo/tools/train.py", line 13, in
from mmyolo.utils import is_metainfo_lower
File "/home/gpu-server/mmyolo_model_training/mmyolo/mmyolo/utils/init.py", line 3, in
from .misc import is_metainfo_lower, switch_to_deploy
File "/home/gpu-server/mmyolo_model_training/mmyolo/mmyolo/utils/misc.py", line 10, in
from mmyolo.models import RepVGGBlock
File "/home/gpu-server/mmyolo_model_training/mmyolo/mmyolo/models/init.py", line 2, in
from .backbones import * # noqa: F401,F403
File "/home/gpu-server/mmyolo_model_training/mmyolo/mmyolo/models/backbones/init.py", line 3, in
from .csp_darknet import YOLOv5CSPDarknet, YOLOv8CSPDarknet, YOLOXCSPDarknet
File "/home/gpu-server/mmyolo_model_training/mmyolo/mmyolo/models/backbones/csp_darknet.py", line 7, in
from mmdet.models.backbones.csp_darknet import CSPLayer, Focus
File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmdet/models/init.py", line 2, in
from .backbones import * # noqa: F401,F403
File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmdet/models/backbones/init.py", line 2, in
from .csp_darknet import CSPDarknet
File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmdet/models/backbones/csp_darknet.py", line 11, in
from ..layers import CSPLayer
File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmdet/models/layers/init.py", line 3, in
from .bbox_nms import fast_nms, multiclass_nms
File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmdet/models/layers/bbox_nms.py", line 5, in
from mmcv.ops.nms import batched_nms
File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmcv/ops/init.py", line 2, in
from .active_rotated_filter import active_rotated_filter
File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmcv/ops/active_rotated_filter.py", line 10, in
ext_module = ext_loader.load_ext(
File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmcv/utils/ext_loader.py", line 13, in load_ext
ext = importlib.import_module('mmcv.' + name)
File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
ModuleNotFoundError: No module named 'mmcv._ext'

below is my env list
(mmopenlab) gpu-server@gpu-server:~/mmyolo_model_training/mmyolo$ conda list

packages in environment at /home/gpu-server/anaconda3/envs/mmopenlab:

Name Version Build Channel

_libgcc_mutex 0.1 main
_openmp_mutex 5.1 1_gnu
addict 2.4.0 pypi_0 pypi
albucore 0.0.24 pypi_0 pypi
albumentations 2.0.8 pypi_0 pypi
aliyun-python-sdk-core 2.16.0 pypi_0 pypi
aliyun-python-sdk-kms 2.16.5 pypi_0 pypi
annotated-types 0.7.0 pypi_0 pypi
anyio 4.9.0 pypi_0 pypi
argon2-cffi 23.1.0 pypi_0 pypi
argon2-cffi-bindings 21.2.0 pypi_0 pypi
arrow 1.3.0 pypi_0 pypi
asttokens 3.0.0 pypi_0 pypi
async-lru 2.0.5 pypi_0 pypi
attrs 25.3.0 pypi_0 pypi
babel 2.17.0 pypi_0 pypi
beautifulsoup4 4.13.4 pypi_0 pypi
binutils_impl_linux-64 2.40 h5293946_0
binutils_linux-64 2.40 hb3c18ed_9 conda-forge
blas 1.0 mkl
bleach 6.2.0 pypi_0 pypi
brotli-python 1.0.9 py310h6a678d5_9
bzip2 1.0.8 h5eee18b_6
ca-certificates 2025.4.26 hbd8a1cb_0 conda-forge
certifi 2025.4.26 pyhd8ed1ab_0 conda-forge
cffi 1.17.1 pypi_0 pypi
charset-normalizer 3.3.2 pyhd3eb1b0_0
click 8.2.1 pypi_0 pypi
colorama 0.4.6 pypi_0 pypi
comm 0.2.2 pypi_0 pypi
contourpy 1.3.2 pypi_0 pypi
crcmod 1.7 pypi_0 pypi
cryptography 45.0.3 pypi_0 pypi
cuda-cccl 11.8.89 0 nvidia/label/cuda-11.8.0
cuda-command-line-tools 11.8.0 0 nvidia/label/cuda-11.8.0
cuda-compiler 11.8.0 0 nvidia/label/cuda-11.8.0
cuda-cudart 11.8.89 0 nvidia/label/cuda-11.8.0
cuda-cudart-dev 11.8.89 0 nvidia/label/cuda-11.8.0
cuda-cuobjdump 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-cupti 11.8.87 0 nvidia/label/cuda-11.8.0
cuda-cuxxfilt 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-documentation 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-driver-dev 11.8.89 0 nvidia/label/cuda-11.8.0
cuda-gdb 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-libraries 11.8.0 0 nvidia/label/cuda-11.8.0
cuda-libraries-dev 11.8.0 0 nvidia/label/cuda-11.8.0
cuda-memcheck 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-nsight 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-nsight-compute 11.8.0 0 nvidia/label/cuda-11.8.0
cuda-nvcc 11.8.89 0 nvidia/label/cuda-11.8.0
cuda-nvdisasm 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-nvml-dev 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-nvprof 11.8.87 0 nvidia/label/cuda-11.8.0
cuda-nvprune 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-nvrtc 11.8.89 0 nvidia/label/cuda-11.8.0
cuda-nvrtc-dev 11.8.89 0 nvidia/label/cuda-11.8.0
cuda-nvtx 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-nvvp 11.8.87 0 nvidia/label/cuda-11.8.0
cuda-profiler-api 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-sanitizer-api 11.8.86 0 nvidia/label/cuda-11.8.0
cuda-toolkit 11.8.0 0 nvidia/label/cuda-11.8.0
cuda-tools 11.8.0 0 nvidia/label/cuda-11.8.0
cuda-visual-tools 11.8.0 0 nvidia/label/cuda-11.8.0
cycler 0.12.1 pypi_0 pypi
debugpy 1.8.14 pypi_0 pypi
decorator 5.2.1 pypi_0 pypi
defusedxml 0.7.1 pypi_0 pypi
exceptiongroup 1.3.0 pypi_0 pypi
executing 2.2.0 pypi_0 pypi
fastjsonschema 2.21.1 pypi_0 pypi
ffmpeg 4.3 hf484d3e_0 pytorch
filelock 3.14.0 pypi_0 pypi
fonttools 4.58.1 pypi_0 pypi
fqdn 1.5.1 pypi_0 pypi
freetype 2.13.3 h4a9f257_0
fsspec 2025.5.1 pypi_0 pypi
gcc_impl_linux-64 15.1.0 h4393ad2_2 conda-forge
gcc_linux-64 15.1.0 h6005d9a_10 conda-forge
gds-tools 1.4.0.31 0 nvidia/label/cuda-11.8.0
giflib 5.2.2 h5eee18b_0
gmp 6.3.0 h6a678d5_0
gmpy2 2.2.1 py310h5eee18b_0
gnutls 3.6.15 he1e5248_0
gxx_impl_linux-64 15.1.0 h6a1bac1_2 conda-forge
gxx_linux-64 15.1.0 h92237c4_10 conda-forge
h11 0.16.0 pypi_0 pypi
httpcore 1.0.9 pypi_0 pypi
httpx 0.28.1 pypi_0 pypi
idna 3.7 py310h06a4308_0
intel-openmp 2023.1.0 hdb19cb5_46306
ipykernel 6.29.5 pypi_0 pypi
ipython 8.36.0 pypi_0 pypi
isoduration 20.11.0 pypi_0 pypi
jedi 0.19.2 pypi_0 pypi
jinja2 3.1.6 py310h06a4308_0
jmespath 0.10.0 pypi_0 pypi
jpeg 9e h5eee18b_3
json5 0.12.0 pypi_0 pypi
jsonpointer 3.0.0 pypi_0 pypi
jsonschema 4.24.0 pypi_0 pypi
jsonschema-specifications 2025.4.1 pypi_0 pypi
jupyter-client 8.6.3 pypi_0 pypi
jupyter-core 5.8.1 pypi_0 pypi
jupyter-events 0.12.0 pypi_0 pypi
jupyter-lsp 2.2.5 pypi_0 pypi
jupyter-server 2.16.0 pypi_0 pypi
jupyter-server-terminals 0.5.3 pypi_0 pypi
jupyterlab 4.4.3 pypi_0 pypi
jupyterlab-pygments 0.3.0 pypi_0 pypi
jupyterlab-server 2.27.3 pypi_0 pypi
kernel-headers_linux-64 3.10.0 he073ed8_18 conda-forge
kiwisolver 1.4.8 pypi_0 pypi
lame 3.100 h7b6447c_0
lcms2 2.16 h92b89f2_1
ld_impl_linux-64 2.40 h12ee557_0
lerc 4.0.0 h6a678d5_0
libcublas 11.11.3.6 0 nvidia/label/cuda-11.8.0
libcublas-dev 11.11.3.6 0 nvidia/label/cuda-11.8.0
libcufft 10.9.0.58 0 nvidia/label/cuda-11.8.0
libcufft-dev 10.9.0.58 0 nvidia/label/cuda-11.8.0
libcufile 1.4.0.31 0 nvidia/label/cuda-11.8.0
libcufile-dev 1.4.0.31 0 nvidia/label/cuda-11.8.0
libcurand 10.3.0.86 0 nvidia/label/cuda-11.8.0
libcurand-dev 10.3.0.86 0 nvidia/label/cuda-11.8.0
libcusolver 11.4.1.48 0 nvidia/label/cuda-11.8.0
libcusolver-dev 11.4.1.48 0 nvidia/label/cuda-11.8.0
libcusparse 11.7.5.86 0 nvidia/label/cuda-11.8.0
libcusparse-dev 11.7.5.86 0 nvidia/label/cuda-11.8.0
libdeflate 1.22 h5eee18b_0
libffi 3.4.4 h6a678d5_1
libgcc 15.1.0 h767d61c_2 conda-forge
libgcc-devel_linux-64 15.1.0 h4c094af_102 conda-forge
libgcc-ng 15.1.0 h69a702a_2 conda-forge
libgomp 15.1.0 h767d61c_2 conda-forge
libiconv 1.16 h5eee18b_3
libidn2 2.3.4 h5eee18b_0
libjpeg-turbo 2.0.0 h9bf148f_0 pytorch
libnpp 11.8.0.86 0 nvidia/label/cuda-11.8.0
libnpp-dev 11.8.0.86 0 nvidia/label/cuda-11.8.0
libnvjpeg 11.9.0.86 0 nvidia/label/cuda-11.8.0
libnvjpeg-dev 11.9.0.86 0 nvidia/label/cuda-11.8.0
libpng 1.6.39 h5eee18b_0
libsanitizer 15.1.0 h97b714f_2 conda-forge
libstdcxx 15.1.0 h8f9b012_2 conda-forge
libstdcxx-devel_linux-64 15.1.0 h4c094af_102 conda-forge
libstdcxx-ng 11.2.0 h1234567_1
libtasn1 4.19.0 h5eee18b_0
libtiff 4.7.0 hde9077f_0
libunistring 0.9.10 h27cfd23_0
libuuid 1.41.5 h5eee18b_0
libwebp 1.3.2 h9f374a3_1
libwebp-base 1.3.2 h5eee18b_1
llvm-openmp 14.0.6 h9e868ea_0
lz4-c 1.9.4 h6a678d5_1
markdown 3.8 pypi_0 pypi
markdown-it-py 3.0.0 pypi_0 pypi
markupsafe 3.0.2 py310h5eee18b_0
matplotlib 3.10.3 pypi_0 pypi
matplotlib-inline 0.1.7 pypi_0 pypi
mdurl 0.1.2 pypi_0 pypi
mistune 3.1.3 pypi_0 pypi
mkl 2023.1.0 h213fc3f_46344
mkl-service 2.4.0 py310h5eee18b_2
mkl_fft 1.3.11 py310h5eee18b_0
mkl_random 1.2.8 py310h1128e8f_0
mmcv 2.0.1 pypi_0 pypi
mmdet 3.0.0 pypi_0 pypi
mmengine 0.7.1 pypi_0 pypi
mmyolo 0.6.0 dev_0
model-index 0.1.11 pypi_0 pypi
mpc 1.3.1 h5eee18b_0
mpfr 4.2.1 h5eee18b_0
mpmath 1.3.0 py310h06a4308_0
nbclient 0.10.2 pypi_0 pypi
nbconvert 7.16.6 pypi_0 pypi
nbformat 5.10.4 pypi_0 pypi
ncurses 6.4 h6a678d5_0
nest-asyncio 1.6.0 pypi_0 pypi
nettle 3.7.3 hbbd107a_1
networkx 3.4.2 py310h06a4308_0
ninja 1.11.1.4 pypi_0 pypi
notebook-shim 0.2.4 pypi_0 pypi
nsight-compute 2022.3.0.22 0 nvidia/label/cuda-11.8.0
numpy 1.26.4 pypi_0 pypi
nvidia-cublas-cu11 11.11.3.6 pypi_0 pypi
nvidia-cuda-cupti-cu11 11.8.87 pypi_0 pypi
nvidia-cuda-nvrtc-cu11 11.8.89 pypi_0 pypi
nvidia-cuda-runtime-cu11 11.8.89 pypi_0 pypi
nvidia-cudnn-cu11 8.7.0.84 pypi_0 pypi
nvidia-cufft-cu11 10.9.0.58 pypi_0 pypi
nvidia-curand-cu11 10.3.0.86 pypi_0 pypi
nvidia-cusolver-cu11 11.4.1.48 pypi_0 pypi
nvidia-cusparse-cu11 11.7.5.86 pypi_0 pypi
nvidia-nccl-cu11 2.19.3 pypi_0 pypi
nvidia-nvtx-cu11 11.8.86 pypi_0 pypi
opencv-python 4.11.0.86 pypi_0 pypi
opendatalab 0.0.10 pypi_0 pypi
openh264 2.1.1 h4ff587b_0
openjpeg 2.5.2 h0d4d230_1
openmim 0.3.9 pypi_0 pypi
openssl 3.5.0 h7b32b05_1 conda-forge
openxlab 0.1.2 pypi_0 pypi
ordered-set 4.1.0 pypi_0 pypi
oss2 2.17.0 pypi_0 pypi
overrides 7.7.0 pypi_0 pypi
packaging 24.2 pypi_0 pypi
pandas 2.2.3 pypi_0 pypi
pandocfilters 1.5.1 pypi_0 pypi
parso 0.8.4 pypi_0 pypi
pexpect 4.9.0 pypi_0 pypi
pillow 11.1.0 py310hac6e08b_1
pip 23.0.1 pypi_0 pypi
platformdirs 4.3.8 pypi_0 pypi
prettytable 3.16.0 pypi_0 pypi
prometheus-client 0.22.0 pypi_0 pypi
prompt-toolkit 3.0.51 pypi_0 pypi
psutil 7.0.0 pypi_0 pypi
ptyprocess 0.7.0 pypi_0 pypi
pure-eval 0.2.3 pypi_0 pypi
pycocotools 2.0.9 pypi_0 pypi
pycparser 2.22 pypi_0 pypi
pycryptodome 3.23.0 pypi_0 pypi
pydantic 2.11.5 pypi_0 pypi
pydantic-core 2.33.2 pypi_0 pypi
pygments 2.19.1 pypi_0 pypi
pyparsing 3.2.3 pypi_0 pypi
pysocks 1.7.1 py310h06a4308_0
pytest-runner 6.0.1 pypi_0 pypi
python 3.10.16 he870216_1
python-dateutil 2.9.0.post0 pypi_0 pypi
python-json-logger 3.3.0 pypi_0 pypi
pytorch-mutex 1.0 cuda pytorch
pytz 2023.4 pypi_0 pypi
pyyaml 6.0.2 py310h5eee18b_0
pyzmq 26.4.0 pypi_0 pypi
readline 8.2 h5eee18b_0
referencing 0.36.2 pypi_0 pypi
requests 2.28.2 pypi_0 pypi
rfc3339-validator 0.1.4 pypi_0 pypi
rfc3986-validator 0.1.1 pypi_0 pypi
rich 13.4.2 pypi_0 pypi
rpds-py 0.25.1 pypi_0 pypi
scipy 1.15.3 pypi_0 pypi
send2trash 1.8.3 pypi_0 pypi
setuptools 60.2.0 pypi_0 pypi
shapely 2.1.1 pypi_0 pypi
simsimd 6.2.1 pypi_0 pypi
six 1.17.0 pypi_0 pypi
sniffio 1.3.1 pypi_0 pypi
soupsieve 2.7 pypi_0 pypi
sqlite 3.45.3 h5eee18b_0
stack-data 0.6.3 pypi_0 pypi
stringzilla 3.12.5 pypi_0 pypi
sympy 1.13.1 pypi_0 pypi
sysroot_linux-64 2.17 h0157908_18 conda-forge
tabulate 0.9.0 pypi_0 pypi
tbb 2021.8.0 hdb19cb5_0
termcolor 3.1.0 pypi_0 pypi
terminado 0.18.1 pypi_0 pypi
terminaltables 3.1.10 pypi_0 pypi
tinycss2 1.4.0 pypi_0 pypi
tk 8.6.14 h39e8969_0
tomli 2.2.1 pypi_0 pypi
torch 2.2.2+cu118 pypi_0 pypi
torchaudio 2.2.2+cu118 pypi_0 pypi
torchvision 0.17.2+cu118 pypi_0 pypi
tornado 6.5.1 pypi_0 pypi
tqdm 4.65.2 pypi_0 pypi
traitlets 5.14.3 pypi_0 pypi
triton 2.2.0 pypi_0 pypi
types-python-dateutil 2.9.0.20250516 pypi_0 pypi
typing-inspection 0.4.1 pypi_0 pypi
typing_extensions 4.12.2 py310h06a4308_0
tzdata 2025.2 pypi_0 pypi
uri-template 1.3.0 pypi_0 pypi
urllib3 1.26.20 pypi_0 pypi
wcwidth 0.2.13 pypi_0 pypi
webcolors 24.11.1 pypi_0 pypi
webencodings 0.5.1 pypi_0 pypi
websocket-client 1.8.0 pypi_0 pypi
wheel 0.45.1 py310h06a4308_0
xz 5.6.4 h5eee18b_1
yaml 0.2.5 h7b6447c_0
yapf 0.43.0 pypi_0 pypi
zlib 1.2.13 h5eee18b_1
zstd 1.5.6 hc292b87_0

Additional information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions