Skip to content

sql/catalog/lease: TestIncrementTableVersion failed #166824

@cockroach-teamcity

Description

@cockroach-teamcity

sql/catalog/lease.TestIncrementTableVersion failed with artifacts on release-25.4 @ 429263dc9f8ba15f33601d54be281e2dea61a4a7:

Failed with:

=== RUN   TestIncrementTableVersion
    test_log_scope.go:171: test logs captured to: /artifacts/tmp/_tmp/5b16c701c1da9e1ccd7b3d919dbf90f6/logTestIncrementTableVersion2907318428
    test_log_scope.go:82: use -show-logs to present logs inline
    test_server_shim.go:154: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
*
* WARNING: disk slowness detected: unable to sync log files within 10s
*

Fatal entries found in Cockroach logs:

F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1  disk stall detected: unable to sync log files within 20s
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !goroutine 51173 [running]:
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !runtime/debug.Stack()
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !	GOROOT/src/runtime/debug/stack.go:26 +0x64
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !github.com/cockroachdb/cockroach/pkg/util/debugutil.Stack(...)
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !	pkg/util/debugutil/debugutil.go:63
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !github.com/cockroachdb/cockroach/pkg/util/log.(*loggerT).outputLogEntry(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...})
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !	pkg/util/log/clog.go:292 +0xc4
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !github.com/cockroachdb/cockroach/pkg/util/log.logfDepthInternal({0x61dcb08, 0x9c7a220}, 0x2, 0x4, 0x1, 0x1?, {0x56b7ca2, 0x37}, {0x40074a7fb8, 0x1, ...})
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !	pkg/util/log/channels.go:104 +0x44c
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !github.com/cockroachdb/cockroach/pkg/util/log.shoutfDepth(...)
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !	pkg/util/log/channels.go:111
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !github.com/cockroachdb/cockroach/pkg/util/log.loggerOps.Shoutf(...)
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !	bazel-out/aarch64-fastbuild/bin/pkg/util/log/log_channels_generated.go:1525
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !github.com/cockroachdb/cockroach/pkg/util/log.(*fileSink).flushAndMaybeSyncLocked.func1()
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !	pkg/util/log/file.go:270 +0xa8
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !created by time.goFunc
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !	GOROOT/src/time/sleep.go:215 +0x38
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !For more context, check log files in: /artifacts/tmp/_tmp/5b16c701c1da9e1ccd7b3d919dbf90f6/logTestIncrementTableVersion2907318428
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !****************************************************************************
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !This node experienced a fatal error (printed above), and as a result the
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !process is terminating.
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !Fatal errors can occur due to faulty hardware (disks, memory, clocks) or a
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !problem in CockroachDB. With your help, the support team at Cockroach Labs
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !will try to determine the root cause, recommend next steps, and we can
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !improve CockroachDB based on your report.
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !Please submit a crash report by following the instructions here:
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !    https://github.com/cockroachdb/cockroach/issues/new/choose
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !If you would rather not post publicly, please contact us directly at:
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !    support@cockroachlabs.com
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !
F260326 15:54:05.058626 51173 1@util/log/file.go:270  [-] 1 !The Cockroach Labs team appreciates your feedback.
Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-62105

Metadata

Metadata

Assignees

No one assigned

    Labels

    C-test-failureBroken test (automatically or manually discovered).O-robotOriginated from a bot.T-sql-foundationsSQL Foundations Team (formerly SQL Schema + SQL Sessions)branch-release-25.4Used to mark GA and release blockers and technical advisories for 25.4release-blockerIndicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions