[EVAL] Add RULER for evaluating long context #726

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

NathanHB opened this issue May 15, 2025 · 0 comments · May be fixed by #722

Assignees

Labels

Member

NathanHB commented May 15, 2025

Evaluation short description

Evaluate long context for lLM and figure out the real context size

Evaluation metadata

Provide all available

Paper url:
Github URL: https://github.com/NVIDIA/RULER
Dataset url:

NathanHB self-assigned this

NathanHB added the new-task label

NathanHB linked a pull request

that will close this issue

Adds RULER benchmark #722

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment