Skip to content

Commit 9570501

Browse files
committed
Add SecLens benchmark
1 parent 3b96b69 commit 9570501

1 file changed

Lines changed: 29 additions & 0 deletions

File tree

data/tools/seclens.yml

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
name: SecLens
2+
categories:
3+
- linter
4+
tags:
5+
- security
6+
- python
7+
- javascript
8+
- go
9+
- ruby
10+
- rust
11+
- java
12+
- php
13+
- c
14+
- cpp
15+
- csharp
16+
license: MIT
17+
types:
18+
- cli
19+
source: "https://github.com/mattersec-labs/seclens"
20+
homepage: "https://github.com/mattersec-labs/seclens"
21+
resources:
22+
- title: "SecLens: Role-Specific Evaluation of LLMs for Security Vulnerability Detection"
23+
url: https://arxiv.org/abs/2604.01637
24+
description: >-
25+
Benchmark for evaluating LLMs on security vulnerability detection
26+
using real CVEs. Tests 12 frontier models across 406 CVE tasks
27+
in 10 languages with 8 OWASP-aligned vulnerability categories.
28+
Includes role-specific prompting (developer, auditor, pentester)
29+
and structured scoring rubrics.

0 commit comments

Comments
 (0)