Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatically running tiled inference for the test step when memory is insufficient. #478

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

Joao-L-S-Almeida
Copy link
Member

@Joao-L-S-Almeida Joao-L-S-Almeida commented Mar 6, 2025

It will allow the user to run the testing step using tiled inference when the data/model cannot be allocated in the GPU memory.

…ntation task by invoking tiled inference

Signed-off-by: João Lucas de Sousa Almeida <[email protected]>
@Joao-L-S-Almeida Joao-L-S-Almeida added bug Something isn't working stakeh-paolo labels Mar 6, 2025
@Joao-L-S-Almeida Joao-L-S-Almeida self-assigned this Mar 6, 2025
Signed-off-by: João Lucas de Sousa Almeida <[email protected]>
Signed-off-by: João Lucas de Sousa Almeida <[email protected]>
Signed-off-by: João Lucas de Sousa Almeida <[email protected]>
@Joao-L-S-Almeida Joao-L-S-Almeida changed the title [WiP] Automatically running tiled inferencde for the test step when memory is insufficient. Automatically running tiled inferencde for the test step when memory is insufficient. Mar 6, 2025
@Joao-L-S-Almeida Joao-L-S-Almeida marked this pull request as ready for review March 6, 2025 13:46
@Joao-L-S-Almeida Joao-L-S-Almeida changed the title Automatically running tiled inferencde for the test step when memory is insufficient. Automatically running tiled inference for the test step when memory is insufficient. Mar 6, 2025
Signed-off-by: João Lucas de Sousa Almeida <[email protected]>
@Joao-L-S-Almeida
Copy link
Member Author

Already tested for a local set of large images.

Signed-off-by: João Lucas de Sousa Almeida <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
1.0 bug Something isn't working stakeh-paolo
Projects
None yet
Development

Successfully merging this pull request may close these issues.

test step can fail since the tiled inference isn't defined for it.
1 participant