Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Project not in OSS-Fuzz (likely only contains a project.yaml file)" when generate a benchmark-yaml. #498

Open
aT0ngMu opened this issue Jul 19, 2024 · 1 comment
Assignees

Comments

@aT0ngMu
Copy link

aT0ngMu commented Jul 19, 2024

oss-fuzz-gen is a great job, thank you for making your code open source!!!

When I execute this command

python3 runner.py -o oss-fuzz-10 -t 15 -i https://github.com/memononen/nanosvg -m openai,

it generated a project temp-project-4-cov-test-fuzz-build-0-fuzzgen-0temp-project-4-cov-test-fuzz-build-0-fuzzgen-0.zip.

When I execute this command

run_all_experiments.py -l gpt-3.5-turbo -w bench-projects/gen1 -of bench-projects/oss-fuzz -g far-reach-low-coverage,low-cov-with-fuzz-keyword,easy-params-far-reach,optimal-targets -gp temp-project-4-cov-test-fuzz-build-0-fuzzgen-0 ,

it will send a request to the api

https://introspector.oss-fuzz.com/api/far-reach-but-low-coverage?project=temp-project-4-cov-test-fuzz-build-0-fuzzgen-0&exclude-static-functions=True&only-referenced-functions=False&only-with-header-file-declaration=True.

And I get the response of Project not in OSS-Fuzz (likely only contains a project.yaml file).

I have a few questions to ask:

  1. How to get the right response?
  2. I didn't find any code about request processing for this API https://introspector.oss-fuzz.com/api/far-reach-but-low-coveragein introspectot's, is this part of the code somewhere else?
@DavidKorczynski
Copy link
Collaborator

When I execute this command

run_all_experiments.py -l gpt-3.5-turbo -w bench-projects/gen1 -of bench-projects/oss-fuzz -g far-reach-low-coverage,low-cov-with-fuzz-keyword,easy-params-far-reach,optimal-targets -gp temp-project-4-cov-test-fuzz-build-0-fuzzgen-0 ,

You can't run the targets generated from https://github.com/google/oss-fuzz-gen/tree/main/experimental/c-cpp using run_all_experiments.py just yet. At the moment they're a bit detached, but I have a fix in mind to solve this issue, give me a few days and it should be ready. You can follow along here where I'll reference the interim updates as well including when you can take the output from runner.py and use it in run_all_experiments.py: #450

I didn't find any code about request processing for this API https://introspector.oss-fuzz.com/api/far-reach-but-low-coveragein introspectot's, is this part of the code somewhere else?

https://introspector.oss-fuzz.com/api#api-far-reach-but-low-coverage

@DavidKorczynski DavidKorczynski self-assigned this Jul 19, 2024
DavidKorczynski added a commit that referenced this issue Aug 20, 2024
This makes it possible to run OSS-Fuzz-gen on projects that are in a
local OSS-Fuzz folder, but that are not in upstream OSS-Fuzz. This needs
to use a local deployment of Fuzz Introspector.

Will follow-up with PRs for experimental that merges the two with
scripts.

Ref: #498

Signed-off-by: David Korczynski <[email protected]>
arthurscchan pushed a commit that referenced this issue Aug 20, 2024
This makes it possible to run OSS-Fuzz-gen on projects that are in a
local OSS-Fuzz folder, but that are not in upstream OSS-Fuzz. This needs
to use a local deployment of Fuzz Introspector.

Will follow-up with PRs for experimental that merges the two with
scripts.

Ref: #498

---------

Signed-off-by: David Korczynski <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants