Skip to content

roachtest: transfer-leases/drain failed #146064

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
cockroach-teamcity opened this issue May 5, 2025 · 1 comment · Fixed by #146353
Closed

roachtest: transfer-leases/drain failed #146064

cockroach-teamcity opened this issue May 5, 2025 · 1 comment · Fixed by #146353
Assignees
@tbg
Labels
A-testing Testing tools and infrastructure branch-master Failures and bugs on the master branch. C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. P-3 Issues/test failures with no fix SLA T-kv KV Team target-release-25.3.0

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented May 5, 2025 •
edited by cockroach-jira-scripts
Loading

roachtest.transfer-leases/drain failed with artifacts on master @ 8fdf338279cd0c9c5ae76e2256160aa33fd1ac1f:

(quit.go:64).Fatal: Get "https://20.127.240.223:26258/_status/ranges/local": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
test artifacts and logs in: /artifacts/transfer-leases/drain/run_1

Parameters:

  • arch=amd64
  • cloud=azure
  • coverageBuild=false
  • cpu=4
  • encrypted=false
  • metamorphicBufferedSender=false
  • metamorphicLeases=default
  • runtimeAssertionsBuild=false
  • ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

Jira issue: CRDB-50369
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-kv KV Team labels May 5, 2025
@tbg tbg removed the release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. label May 5, 2025
@tbg tbg self-assigned this May 5, 2025
@tbg
Copy link
Member

tbg commented May 5, 2025

Timed out here:

cockroach/pkg/cmd/roachtest/tests/quit.go

Lines 254 to 256 in 1279453

url := fmt.Sprintf("https://%s/_status/ranges/local", adminAddrs[0])
client := roachtestutil.DefaultHTTPClient(q.c, q.t.L(), roachtestutil.HTTPTimeout(15*time.Second))
if err != nil {

Maybe 15s is not enough. I'll need to take another look, but likely not a release blocker.

@tbg tbg mentioned this issue May 8, 2025
Merged
@tbg tbg added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. A-testing Testing tools and infrastructure P-3 Issues/test failures with no fix SLA labels May 8, 2025
craig bot pushed a commit that referenced this issue May 8, 2025
@RaduBerinde @tbg @rail
Merge #144749 #146353 #146366
442e522 
144749: storage: replace RequiredInPlaceValueBound with SpanPolicyFunc r=RaduBerinde a=RaduBerinde

#### go.mod: bump Pebble to afff98cbf8be

Changes:

 * [`afff98cb`](cockroachdb/pebble@afff98cb) db: introduce SpanPolicy and SpanPolicyFunc

Release note: none.
Epic: none.

#### storage: replace RequiredInPlaceValueBound with SpanPolicyFunc

Epic: none
Release note: None


146353: roachtest: bump http timeout in quit roachtest r=pav-kv a=tbg

Closes #146064.

Epic: none


146366: build: remove ssh key on exit only on TeamCity agents r=jlinder a=rail

Previously, we used `~/.ssh/id_rsa{,.pub}` to remove the SSH key on exit. This caused issues when running the script locally, as it would attempt to remove the SSH key from the local machine. The fix is to use `~agent/.ssh/id_rsa` instead, which is specific to TeamCity agents.

Release note: none
Epic: none

Co-authored-by: Radu Berinde <[email protected]>
Co-authored-by: Tobias Grieger <[email protected]>
Co-authored-by: Rail Aliiev <[email protected]>
@craig craig bot closed this as completed in 45e5f2e May 8, 2025
hakuuww pushed a commit to hakuuww/cockroach that referenced this issue May 11, 2025
@tbg @hakuuww
roachtest: bump http timeout in quit roachtest
fa51923 
Closes cockroachdb#146064.

Epic: none
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tbg tbg

Labels
A-testing Testing tools and infrastructure branch-master Failures and bugs on the master branch. C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. P-3 Issues/test failures with no fix SLA T-kv KV Team target-release-25.3.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

roachtest: bump http timeout in quit roachtest tbg/cockroach
2 participants
@tbg @cockroach-teamcity