Skip to content

Commit 538d893

Browse files
committed
op doc
1 parent 1dc5ded commit 538d893

File tree

1 file changed

+0
-2
lines changed

1 file changed

+0
-2
lines changed

docs/Operators.md

-2
Original file line numberDiff line numberDiff line change
@@ -107,8 +107,6 @@ All the specific operators are listed below, each featured with several capabili
107107
| image_text_similarity_filter | 🔮Multimodal 🚀GPU 🧩HF 🟢Stable | Filter to keep samples those similarities between image and text within a specific range. 过滤器将图像和文本之间的相似性保持在特定范围内。 | [code](../data_juicer/ops/filter/image_text_similarity_filter.py) | [tests](../tests/ops/filter/test_image_text_similarity_filter.py) |
108108
| image_watermark_filter | 🏞Image 🚀GPU 🧩HF 🟢Stable | Filter to keep samples whose images have no watermark with high probability. 过滤器以保持其图像没有水印的样本具有高概率。 | [code](../data_juicer/ops/filter/image_watermark_filter.py) | [tests](../tests/ops/filter/test_image_watermark_filter.py) |
109109
| language_id_score_filter | 🔤Text 💻CPU 🟢Stable | Filter to keep samples in a specific language with confidence score larger than a specific min value. 过滤器以保留置信度得分大于特定最小值的特定语言的样本。 | [code](../data_juicer/ops/filter/language_id_score_filter.py) | [tests](../tests/ops/filter/test_language_id_score_filter.py) |
110-
| llm_api_difficulty_score_filter | 💻CPU 🔗API 🟡Beta | Filter to keep sample with high difficulty score estimated by LLM in API. 在API中过滤以保持LLM估计的高难度分数的样本。 | [code](../data_juicer/ops/filter/llm_api_difficulty_score_filter.py) | [tests](../tests/ops/filter/test_llm_api_difficulty_score_filter.py) |
111-
| llm_api_quality_score_filter | 💻CPU 🔗API 🟡Beta | Filter to keep sample with high quality score estimated by LLM in API. 在API中过滤以保持LLM估计的高质量分数的样品。 | [code](../data_juicer/ops/filter/llm_api_quality_score_filter.py) | [tests](../tests/ops/filter/test_llm_api_quality_score_filter.py) |
112110
| llm_difficulty_score_filter | 💻CPU 🌊vLLM 🔗API 🟡Beta | Filter to keep sample with high difficulty score estimated by LLM in API. 在API中过滤以保持LLM估计的高难度分数的样本。 | [code](../data_juicer/ops/filter/llm_difficulty_score_filter.py) | [tests](../tests/ops/filter/test_llm_difficulty_score_filter.py) |
113111
| llm_quality_score_filter | 💻CPU 🌊vLLM 🔗API 🟡Beta | Filter to keep sample with high quality score estimated by LLM in API. 在API中过滤以保持LLM估计的高质量分数的样品。 | [code](../data_juicer/ops/filter/llm_quality_score_filter.py) | [tests](../tests/ops/filter/test_llm_quality_score_filter.py) |
114112
| maximum_line_length_filter | 🔤Text 💻CPU 🟢Stable | Filter to keep samples with maximum line length within a specific range. 过滤器将最大行长度的样本保持在特定范围内。 | [code](../data_juicer/ops/filter/maximum_line_length_filter.py) | [tests](../tests/ops/filter/test_maximum_line_length_filter.py) |

0 commit comments

Comments
 (0)