Skip to content

Add traceAI and ai-evaluation to Development Tools#152

Open
SuhaniNagpal7 wants to merge 1 commit into
reorx:masterfrom
SuhaniNagpal7:add-trace-and-eval
Open

Add traceAI and ai-evaluation to Development Tools#152
SuhaniNagpal7 wants to merge 1 commit into
reorx:masterfrom
SuhaniNagpal7:add-trace-and-eval

Conversation

@SuhaniNagpal7
Copy link
Copy Markdown

Summary

  • Adds traceAI — OpenTelemetry-native tracing for OpenAI/ChatGPT API apps
  • Adds ai-evaluation — LLM evaluation framework with 50+ metrics

Both placed under the Development → Tools section.

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adds two new tools, traceAI and ai-evaluation, to the README. Feedback suggests updating the Chinese documentation (README.cn.md) for consistency and refining the tool descriptions by removing redundant prefixes and improving grammar through provided code suggestions.

Comment thread README.md
Comment on lines +508 to +514
- [traceAI](https://github.com/future-agi/traceAI)

Open-source OpenTelemetry-native tracing framework for LLM and AI agent applications. Auto-instruments 20+ frameworks (OpenAI, Anthropic, LangChain, LlamaIndex, CrewAI, Bedrock) capturing prompts, tokens, latency, and errors out of the box.

- [ai-evaluation](https://github.com/future-agi/ai-evaluation)

Open-source LLM evaluation framework with 50+ metrics, LLM-as-Judge, guardrail scanners (jailbreak, PII, injection), and AutoEval pipelines with CI/CD support.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The repository maintains a Chinese version of the documentation in README.cn.md. To ensure consistency across the project, please add these new entries to the ### 工具 section in README.cn.md as well.

Comment thread README.md

- [traceAI](https://github.com/future-agi/traceAI)

Open-source OpenTelemetry-native tracing framework for LLM and AI agent applications. Auto-instruments 20+ frameworks (OpenAI, Anthropic, LangChain, LlamaIndex, CrewAI, Bedrock) capturing prompts, tokens, latency, and errors out of the box.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

Removed the redundant 'Open-source' prefix to match the existing style in the Tools section. Also added a comma after the framework list for better grammatical flow.

Suggested change
Open-source OpenTelemetry-native tracing framework for LLM and AI agent applications. Auto-instruments 20+ frameworks (OpenAI, Anthropic, LangChain, LlamaIndex, CrewAI, Bedrock) capturing prompts, tokens, latency, and errors out of the box.
OpenTelemetry-native tracing framework for LLM and AI agent applications. Auto-instruments 20+ frameworks (OpenAI, Anthropic, LangChain, LlamaIndex, CrewAI, Bedrock), capturing prompts, tokens, latency, and errors out of the box.

Comment thread README.md

- [ai-evaluation](https://github.com/future-agi/ai-evaluation)

Open-source LLM evaluation framework with 50+ metrics, LLM-as-Judge, guardrail scanners (jailbreak, PII, injection), and AutoEval pipelines with CI/CD support.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

Removed the 'Open-source' prefix for consistency with other entries in this section.

Suggested change
Open-source LLM evaluation framework with 50+ metrics, LLM-as-Judge, guardrail scanners (jailbreak, PII, injection), and AutoEval pipelines with CI/CD support.
LLM evaluation framework with 50+ metrics, LLM-as-Judge, guardrail scanners (jailbreak, PII, injection), and AutoEval pipelines with CI/CD support.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant