OpenDataLab

All

39 repositories

labelU
Public
Data annotation toolbox supports image, audio and video data.
Python
•
Apache License 2.0
•106•1.1k•16•0•Updated Mar 11, 2025Mar 11, 2025
labelU-Kit
Public
Data annotation component library --provided as NPM packages
TypeScript
•
Apache License 2.0
•23•82•6•1•Updated Mar 11, 2025Mar 11, 2025
MinerU
Public
A high-quality tool for convert PDF to Markdown and JSON.一站式开源高质量数据提取工具，将PDF转换成Markdown和JSON格式。
python pdf parser ocr pdf-converter extract-data document-analysis pdf-parser layout-analysis ai4science
Python
•
GNU Affero General Public License v3.0
•2.2k•28k•98•6•Updated Mar 11, 2025Mar 11, 2025
LOKI
Public
[ICLR 2025 Spotlight] The official implementation of the paper “LOKI：A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models”
Python
•1•132•1•1•Updated Mar 11, 2025Mar 11, 2025
OHR-Bench
Public
OCR Hinders RAG: Evaluating the Cascading Impact of OCR on Retrieval-Augmented Generation
Python
•12•68•1•0•Updated Mar 11, 2025Mar 11, 2025
UrBench
Public
[AAAI 2025]This repo contains evaluation code for the paper “UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarios”
benchmark remote-sensing llama lmms vlm urban llava
Python
•
Other
•2•27•1•0•Updated Mar 9, 2025Mar 9, 2025
UniMERNet
Public
UniMERNet: A Universal Network for Real-World Mathematical Expression Recognition
Python
•
Apache License 2.0
•28•280•16•0•Updated Mar 7, 2025Mar 7, 2025
.github
Public
2•0•0•0•Updated Mar 5, 2025Mar 5, 2025
opendatalab-datasets
Public
datasets resource
11•103•3•0•Updated Mar 5, 2025Mar 5, 2025
skydiffusion
Public
The official implementation of the paper “Street-to-Satellite Image Synthesis with Diffusion Models and BEV Paradigm”
Python
•
Apache License 2.0
•2•43•2•0•Updated Mar 1, 2025Mar 1, 2025
OmniDocBench
Public
A Comprehensive Benchmark for Document Parsing and Evaluation
Python
•
Apache License 2.0
•24•277•23•0•Updated Feb 25, 2025Feb 25, 2025
VHM
Public
VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis
Python
•
Apache License 2.0
•6•77•1•0•Updated Feb 19, 2025Feb 19, 2025
LabelLLM
Public
The Open-Source Data Annotation Platform
TypeScript
•
Apache License 2.0
•59•706•11•0•Updated Feb 19, 2025Feb 19, 2025
WanJuan3.0
Public
WanJuan3.0（“万卷·丝路”）一个作为综合性的纯文本语料库，采集了多个国家地区的网络公开信息、文献、专利等资料，数据总规模超1.2TB，Token总数超过300B，处于国际领先水平，首期开源的语料库主要由泰语、俄语、阿拉伯语、韩语和越南语5个子集构成，每个子集的数据规模均超过150GB
MIT License
•0•19•0•0•Updated Feb 13, 2025Feb 13, 2025
ProverGen
Public
[ICLR 2025] This is the official implementation for the paper: "Large Language Models Meet Symbolic Provers for Logical Reasoning Evaluation"
Python
•4•12•0•0•Updated Feb 11, 2025Feb 11, 2025
DocLayout-YOLO
Public
DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception
Python
•
GNU Affero General Public License v3.0
•69•923•10•1•Updated Jan 16, 2025Jan 16, 2025
PDF-Extract-Kit
Public
A Comprehensive Toolkit for High-Quality PDF Content Extraction
Python
•
GNU Affero General Public License v3.0
•476•7k•80•4•Updated Jan 3, 2025Jan 3, 2025
CRaFT
Public
[AAAI25] Certainty Represented Knowledge Flow for Refusal-Aware Instruction Tuning
Python
•0•3•0•0•Updated Jan 1, 2025Jan 1, 2025
Miner-PDF-Benchmark
Public archive
MPB (Miner-PDF-Benchmark) is an end-to-end PDF document comprehension evaluation suite designed for large-scale model data scenarios.
Python
•
Apache License 2.0
•5•21•0•0•Updated Dec 11, 2024Dec 11, 2024
magic-html
Public
Python
•
Apache License 2.0
•35•398•7•0•Updated Nov 22, 2024Nov 22, 2024
CLIP-Parrot-Bias
Public
ECCV2024_Parrot Captions Teach CLIP to Spot Text
Python
•
Apache License 2.0
•2•64•3•0•Updated Sep 6, 2024Sep 6, 2024
CrossViewDiff
Public
The official implementation of the paper "CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesis"
JavaScript
•1•14•1•0•Updated Sep 2, 2024Sep 2, 2024
MLS-BRN
Public
[CVPR 2024] 3D Building Reconstruction from Monocular Remote Sensing Images with Multi-level Supervisions
Python
•4•60•7•0•Updated Aug 30, 2024Aug 30, 2024
CHARM
Public
[ACL 2024 Main Conference] Chinese commonsense benchmark for LLMs
Python
•
Apache License 2.0
•2•30•0•0•Updated Jul 27, 2024Jul 27, 2024
magic-doc
Public
Python
•
Apache License 2.0
•35•450•23•0•Updated Jul 26, 2024Jul 26, 2024
dsdl-sdk
Public
Jupyter Notebook
•
Apache License 2.0
•6•13•0•0•Updated May 29, 2024May 29, 2024
dsdl-docs
Public
Data Set Description Language Specification （新一代人工智能数据集描述语言DSDL）
HTML
•
Apache License 2.0
•6•47•1•0•Updated May 29, 2024May 29, 2024
MLLM-DataEngine
Public
MLLM-DataEngine: An Iterative Refinement Approach for MLLM
Python
•
Apache License 2.0
•5•44•0•0•Updated May 24, 2024May 24, 2024
image-downloader
Public
Python
•
Apache License 2.0
•3•27•2•0•Updated May 13, 2024May 13, 2024
WanJuan2.0-WanJuan-CC
Public
WanJuan-CC是以CommonCrawl为基础，经过数据抽取，规则清洗，去重，安全过滤，质量清洗等步骤得到的高质量数据。
0•13•1•0•Updated Apr 18, 2024Apr 18, 2024