安装detectron2后只能下载0.6.1版本

[Na-nata]

Description of the bug | 错误描述

操作系统Linux x86_64，python=3.10，cuda12.。安装detectron2-0.6-cp310-cp310-linux_x86_64.whl后，执行pip install -U magic-pdf[full]只能下载到0.6.1的版本。

指定安装magic-pdf==0.8.1会报错如下

How to reproduce the bug | 如何复现

pip install -U magic-pdf[full]==0.8.1

Operating system | 操作系统

Linux

Python version | Python 版本

3.10

Software version | 软件版本 (magic-pdf --version)

No response

Device mode | 设备模式

cuda

[myhloli]

换个镜像源，阿里源或者清华源都可以

[csy100]

使用阿里源，python使用3.10版本试试

[Na-nata]

换个镜像源，阿里源或者清华源都可以

感谢回答！如果是只能指定Tencent镜像的内网机器应该怎么办呢？

[myhloli]

在别的源把tx源缺的包下回来手动安装

[csy100]

运维的做法一般是先把别的源的依赖下载之后打成一个依赖镜像，然后你拿到这个依赖镜像去内网里面进行部署就可以了

[Na-nata]

在别的源把tx源缺的包下回来手动安装

我成功安装了3.0.0b1版本的paddlepaddle-gpu，但这个所需的paddlepaddle貌似是cpu版的？

[myhloli]

带-gpu的就是gpu的版本

[Na-nata]

带-gpu的就是gpu的版本

是的！但安装的时候还是会报这个错🥹难道它需要的是cpu版的？

[myhloli]

如果其他包都装好了，你装magic-pdf的时候可以不带[full],就不会要求你装cpu版的paddle了

[Na-nata]

如果其他包都装好了，你装magic-pdf的时候可以不带[full],就不会要求你装cpu版的paddle了

不带[full]安装，然后不断pip需要的包，直到遇到了ERROR: Failed building wheel for simsimd的问题，follow https://github.com/opendatalab/MinerU/issues/1004运行了pip install -U magic-pdf[full,old_linux]，结果又安回0.6.1了😭

[myhloli]

直接下个离线版的paddlepaddle包先装上，再装full的magic-pdf呢

[Na-nata]

直接下个离线版的paddlepaddle包先装上，再装full的magic-pdf呢

我的离线paddle是从这里https://www.paddlepaddle.org.cn/packages/stable/cu118/paddlepaddle-gpu/ 安装的，貌似只提供了gpu版本的。如上所述，安装3.0.0b1版本的paddlepaddle-gpu之后再装full的magic-pdf就还是会出现之前提到的错误

在别的源把tx源缺的包下回来手动安装

我成功安装了3.0.0b1版本的paddlepaddle-gpu，但这个所需的paddlepaddle貌似是cpu版的？

[myhloli]

带gpu的跟不带gpu的是两个包，你要先装那个不带gpu的，你到阿里源直接下一个就好了 https://mirrors.aliyun.com/pypi/simple/

[Na-nata]

带gpu的跟不带gpu的是两个包，你要先装那个不带gpu的，你到阿里源直接下一个就好了 https://mirrors.aliyun.com/pypi/simple/

😭特别感谢，按你说的安了，但还是卡在simsimd了

[myhloli]

卡simsimd就加oldlinux参数

[Na-nata]

是的，就是加了也卡

卡simsimd就加oldlinux参数

[myhloli]

可能是环境已经脏了，建个新环境

[Na-nata]

还是不行www

可能是环境已经脏了，建个新环境

[Na-nata]

!!!!!!好消息，我重新安装了pip install albumentations==1.4.19之后就不会在出现simsim的报错了！！！非常非常感谢兄弟的耐心解答！！！

[myhloli]

emmm，为啥装的0.8.1

[Na-nata]

emmm，为啥装的0.8.1

我看的某个issue，我试试能不能装更高的版本

[Na-nata]

🥹我这个模型是按照官方代码下载的模型且下载过程中没有中断，运行
magic-pdf -p /mnt/wfs/mmshanghaiwfssh/project_mm-base-vision-tj/qiunatan/doc_extract/small_ocr.pdf -o small_ocr.json -m auto
报下面的网络连接错误：
2025-03-06 12:01:29.801 | ERROR | magic_pdf.tools.cli:parse_doc:130 - HTTPSConnectionPool(host='api.github.com', port=443): Max retries exceeded with url: /repos/ultralytics/assets/releases/tags/v8.3.0 (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>, 'Connection to api.github.com timed out. (connect timeout=None)'))
Traceback (most recent call last):

File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
│ └ <function create_connection at 0x7fd938d80af0>
└ <module 'urllib3.util.connection' from '/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/util/connection.py'>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
└ None
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
│ │ └ ('20.205.243.168', 443)
│ └ <method 'connect' of '_socket.socket' objects>
└ <socket.socket [closed] fd=-1, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6>

TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
│ └ <function HTTPConnectionPool._make_request at 0x7fd938989750>
└ <urllib3.connectionpool.HTTPSConnectionPool object at 0x7fd796944b20>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/connectionpool.py", line 488, in _make_request
raise new_e
└ ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>, 'Connection to api.github.com timed out. (...
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/connectionpool.py", line 464, in _make_request
self._validate_conn(conn)
│ │ └ <urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>
│ └ <function HTTPSConnectionPool._validate_conn at 0x7fd938989b40>
└ <urllib3.connectionpool.HTTPSConnectionPool object at 0x7fd796944b20>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
conn.connect()
│ └ <function HTTPSConnection.connect at 0x7fd938979f30>
└ <urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/connection.py", line 704, in connect
self.sock = sock = self._new_conn()
│ │ │ └ <function HTTPConnection._new_conn at 0x7fd9389795a0>
│ │ └ <urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>
│ └ None
└ <urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
└ <class 'urllib3.exceptions.ConnectTimeoutError'>

urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>, 'Connection to api.github.com timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
│ └ <function HTTPConnectionPool.urlopen at 0x7fd938989900>
��� <urllib3.connectionpool.HTTPSConnectionPool object at 0x7fd796944b20>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
│ └ <function Retry.increment at 0x7fd938d830a0>
└ Retry(total=0, connect=None, read=False, redirect=None, status=None)
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
│ │ │ │ └ ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>, 'Connection to api.github.com timed out. (...
│ │ │ └ ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>, 'Connection to api.github.com timed out. (...
│ │ └ '/repos/ultralytics/assets/releases/tags/v8.3.0'
│ └ <urllib3.connectionpool.HTTPSConnectionPool object at 0x7fd796944b20>
└ <class 'urllib3.exceptions.MaxRetryError'>

urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.github.com', port=443): Max retries exceeded with url: /repos/ultralytics/assets/releases/tags/v8.3.0 (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>, 'Connection to api.github.com timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "/root/miniconda3/envs/Mineru/bin/magic-pdf", line 8, in
sys.exit(cli())
│ │ └
│ └
└ <module 'sys' (built-in)>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/click/core.py", line 1161, in call
return self.main(*args, **kwargs)
│ │ │ └ {}
│ │ └ ()
│ └ <function BaseCommand.main at 0x7fd93cbbecb0>
└
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/click/core.py", line 1082, in main
rv = self.invoke(ctx)
│ │ └ <click.core.Context object at 0x7fd93cf543d0>
│ └ <function Command.invoke at 0x7fd93cbbf760>
└
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/click/core.py", line 1443, in invoke
return ctx.invoke(self.callback, **ctx.params)
│ │ │ │ │ └ {'path': '/mnt/wfs/mmshanghaiwfssh/project_mm-base-vision-tj/qiunatan/doc_extract/small_ocr.pdf', 'output_dir': 'small_ocr.js...
│ │ │ │ └ <click.core.Context object at 0x7fd93cf543d0>
│ │ │ └ <function cli at 0x7fd7969288b0>
│ │ └
│ └ <function Context.invoke at 0x7fd93cbbe4d0>
└ <click.core.Context object at 0x7fd93cf543d0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/click/core.py", line 788, in invoke
return __callback(*args, **kwargs)
│ └ {'path': '/mnt/wfs/mmshanghaiwfssh/project_mm-base-vision-tj/qiunatan/doc_extract/small_ocr.pdf', 'output_dir': 'small_ocr.js...
└ ()
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/tools/cli.py", line 137, in cli
parse_doc(Path(path))
│ │ └ '/mnt/wfs/mmshanghaiwfssh/project_mm-base-vision-tj/qiunatan/doc_extract/small_ocr.pdf'
│ └ <class 'pathlib.Path'>
└ <function cli..parse_doc at 0x7fd944563eb0>

File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/tools/cli.py", line 117, in parse_doc
do_parse(
└ <function do_parse at 0x7fd7969280d0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/tools/common.py", line 130, in do_parse
infer_result = ds.apply(
│ └ <function PymuDocDataset.apply at 0x7fd895cd4160>
└ <magic_pdf.data.dataset.PymuDocDataset object at 0x7fd796921990>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/data/dataset.py", line 212, in apply
return proc(self, *args, **kwargs)
│ │ │ └ {'ocr': True, 'lang': None, 'layout_model': None, 'formula_enable': None, 'table_enable': None}
│ │ └ ()
│ └ <magic_pdf.data.dataset.PymuDocDataset object at 0x7fd796921990>
└ <function doc_analyze at 0x7fd796917f40>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/model/doc_analyze_by_custom_model.py", line 164, in doc_analyze
custom_model = model_manager.get_model(
│ └ <function ModelSingleton.get_model at 0x7fd796917eb0>
└ <magic_pdf.model.doc_analyze_by_custom_model.ModelSingleton object at 0x7fd7969440a0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/model/doc_analyze_by_custom_model.py", line 69, in get_model
self._models[key] = custom_model_init(
│ │ │ └ <function custom_model_init at 0x7fd796917d90>
│ │ └ (True, False, None, None, None, None)
│ └ {}
└ <magic_pdf.model.doc_analyze_by_custom_model.ModelSingleton object at 0x7fd7969440a0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/model/doc_analyze_by_custom_model.py", line 136, in custom_model_init
custom_model = CustomPEKModel(**model_input)
│ └ {'ocr': True, 'show_log': False, 'models_dir': '/mnt/wfs/mmshanghaiwfsnnfivekv/qiunatan/doc_extract/temp/hub/opendatalab--PDF...
└ <class 'magic_pdf.model.pdf_extract_kit.CustomPEKModel'>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/model/pdf_extract_kit.py", line 110, in init
self.mfd_model = atom_model_manager.get_atom_model(
│ │ └ <function AtomModelSingleton.get_atom_model at 0x7fd797034f70>
│ └ <magic_pdf.model.sub_modules.model_init.AtomModelSingleton object at 0x7fd796944250>
└ <magic_pdf.model.pdf_extract_kit.CustomPEKModel object at 0x7fd796944b50>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/model/sub_modules/model_init.py", line 123, in get_atom_model
self._models[key] = atom_model_init(model_name=atom_model_name, **kwargs)
│ │ │ │ │ └ {'mfd_weights': '/mnt/wfs/mmshanghaiwfsnnfivekv/qiunatan/doc_extract/temp/hub/opendatalab--PDF-Extract-Kit-1.0.main.60416a2ca...
│ │ │ │ └ 'mfd'
│ │ │ └ <function atom_model_init at 0x7fd797034e50>
│ │ └ 'mfd'
│ └ {}
└ <magic_pdf.model.sub_modules.model_init.AtomModelSingleton object at 0x7fd796944250>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/model/sub_modules/model_init.py", line 144, in atom_model_init
atom_model = mfd_model_init(
└ <function mfd_model_init at 0x7fd79b9bc550>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/model/sub_modules/model_init.py", line 45, in mfd_model_init
mfd_model = YOLOv8MFDModel(weight, device)
│ │ └ 'cuda'
│ └ '/mnt/wfs/mmshanghaiwfsnnfivekv/qiunatan/doc_extract/temp/hub/opendatalab--PDF-Extract-Kit-1.0.main.60416a2cabad3f7b7284b43ce...
└ <class 'magic_pdf.model.sub_modules.mfd.yolov8.YOLOv8.YOLOv8MFDModel'>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/magic_pdf/model/sub_modules/mfd/yolov8/YOLOv8.py", line 6, in init
self.mfd_model = YOLO(weight)
│ │ └ '/mnt/wfs/mmshanghaiwfsnnfivekv/qiunatan/doc_extract/temp/hub/opendatalab--PDF-Extract-Kit-1.0.main.60416a2cabad3f7b7284b43ce...
│ └ <class 'ultralytics.models.yolo.model.YOLO'>
└ <magic_pdf.model.sub_modules.mfd.yolov8.YOLOv8.YOLOv8MFDModel object at 0x7fd7969451b0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/ultralytics/models/yolo/model.py", line 23, in init
super().init(model=model, task=task, verbose=verbose)
│ │ └ False
│ └ None
└ '/mnt/wfs/mmshanghaiwfsnnfivekv/qiunatan/doc_extract/temp/hub/opendatalab--PDF-Extract-Kit-1.0.main.60416a2cabad3f7b7284b43ce...
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/ultralytics/engine/model.py", line 148, in init
self._load(model, task=task)
│ │ │ └ None
│ │ └ '/mnt/wfs/mmshanghaiwfsnnfivekv/qiunatan/doc_extract/temp/hub/opendatalab--PDF-Extract-Kit-1.0.main.60416a2cabad3f7b7284b43ce...
│ └ <function Model._load at 0x7fd7b8986200>
└ YOLO()
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/ultralytics/engine/model.py", line 291, in _load
self.model, self.ckpt = attempt_load_one_weight(weights)
│ │ │ │ │ └ '/mnt/wfs/mmshanghaiwfsnnfivekv/qiunatan/doc_extract/temp/hub/opendatalab--PDF-Extract-Kit-1.0.main.60416a2cabad3f7b7284b43ce...
│ │ │ │ └ <function attempt_load_one_weight at 0x7fd7b893af80>
│ │ │ └ {}
│ │ └ YOLO()
│ └ None
└ YOLO()
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/ultralytics/nn/tasks.py", line 905, in attempt_load_one_weight
ckpt, weight = torch_safe_load(weight) # load ckpt
│ └ '/mnt/wfs/mmshanghaiwfsnnfivekv/qiunatan/doc_extract/temp/hub/opendatalab--PDF-Extract-Kit-1.0.main.60416a2cabad3f7b7284b43ce...
└ <function torch_safe_load at 0x7fd7b893acb0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/ultralytics/nn/tasks.py", line 810, in torch_safe_load
file = attempt_download_asset(weight) # search online if missing locally
│ └ '/mnt/wfs/mmshanghaiwfsnnfivekv/qiunatan/doc_extract/temp/hub/opendatalab--PDF-Extract-Kit-1.0.main.60416a2cabad3f7b7284b43ce...
└ <function attempt_download_asset at 0x7fd7b8b82f80>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/ultralytics/utils/downloads.py", line 457, in attempt_download_asset
tag, assets = get_github_assets(repo, release)
│ │ └ 'v8.3.0'
│ └ 'ultralytics/assets'
└ <function get_github_assets at 0x7fd7b8b82ef0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/ultralytics/utils/downloads.py", line 402, in get_github_assets
r = requests.get(url) # github api
│ │ └ 'https://api.github.com/repos/ultralytics/assets/releases/tags/v8.3.0'
│ └ <function get at 0x7fd938782c20>
└ <module 'requests' from '/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/requests/init.py'>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
│ │ │ └ {}
│ │ └ None
│ └ 'https://api.github.com/repos/ultralytics/assets/releases/tags/v8.3.0'
└ <function request at 0x7fd938748af0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
│ │ │ │ └ {'params': None}
│ │ │ └ 'https://api.github.com/repos/ultralytics/assets/releases/tags/v8.3.0'
│ │ └ 'get'
│ └ <function Session.request at 0x7fd9387823b0>
└ <requests.sessions.Session object at 0x7fd7b71821a0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
│ │ │ └ {'timeout': None, 'allow_redirects': True, 'proxies': OrderedDict(), 'stream': False, 'verify': True, 'cert': None}
│ │ └ <PreparedRequest [GET]>
│ └ <function Session.send at 0x7fd938782830>
└ <requests.sessions.Session object at 0x7fd7b71821a0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
│ │ │ └ {'timeout': None, 'proxies': OrderedDict(), 'stream': False, 'verify': True, 'cert': None}
│ │ └ <PreparedRequest [GET]>
│ └ <function HTTPAdapter.send at 0x7fd938781cf0>
└ <requests.adapters.HTTPAdapter object at 0x7fd796944ca0>
File "/root/miniconda3/envs/Mineru/lib/python3.10/site-packages/requests/adapters.py", line 688, in send
raise ConnectTimeout(e, request=request)
│ └ <PreparedRequest [GET]>
└ <class 'requests.exceptions.ConnectTimeout'>

requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='api.github.com', port=443): Max retries exceeded with url: /repos/ultralytics/assets/releases/tags/v8.3.0 (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fd7969454e0>, 'Connection to api.github.com timed out. (connect timeout=None)'))

[myhloli]

模型没有正确下载导致的，按readme再走一遍模型下载的流程

[Na-nata]

模型没有正确下载导致的，按readme再走一遍模型下载的流程

我确实是按照官方步骤和代码下载的，下载过程中也没有报错就完成了。会不会是因为机器是离线的呢？

[myhloli]

离线怎么下载的模型？

[Na-nata]

离线怎么下载的模型？

我在有网的机器上下载到离线机器挂载的盘上，我确定magic-pdf.json里的模型路径是对的

[myhloli]

从报错来看肯定是模型没下载完全或路径有误，magic-pdf新老版本模型不完全兼容，doc只保证最新版部署可用。

[Na-nata]

从报错来看肯定是模型没下载完全或路径有误，magic-pdf新老版本模型不完全兼容，doc只保证最新版部署可用。
我现在使用的版本是1.1.0，那我再从modelscope下载一遍试试吧