bench/rttanalysis: TestBenchmarkExpectationShard2 failed

[cockroach-teamcity]

bench/rttanalysis.TestBenchmarkExpectationShard2 failed with artifacts on master @ b5e9731871b79876f1011750e5ff3eb10ad9a506:

    validate_benchmark_data.go:120: success: expected Discard/DISCARD_ALL,_no_tables to perform KV lookups in [0, 0], got 0
    validate_benchmark_data.go:120: success: expected ORMQueries/npgsql_fields to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/information_schema._pg_index_position to perform KV lookups in [3, 3], got 3
    validate_benchmark_data.go:120: success: expected AlterTableAddCheckConstraint/alter_table_add_1_check_constraint to perform KV lookups in [14, 14], got 13
    validate_benchmark_data.go:120: success: expected ORMQueries/asyncpg_types to perform KV lookups in [3, 4], got 3
    validate_benchmark_data.go:120: success: expected ORMQueries/has_schema_privilege to perform KV lookups in [0, 0], got 0
    validate_benchmark_data.go:120: success: expected AlterTableAddCheckConstraint/alter_table_add_2_check_constraints to perform KV lookups in [14, 14], got 13
    validate_benchmark_data.go:120: success: expected AlterTableDropConstraint/alter_table_drop_3_check_constraints to perform KV lookups in [13, 13], got 13
    validate_benchmark_data.go:120: success: expected ORMQueries/django_column_introspection_8_tables to perform KV lookups in [3, 3], got 3
    validate_benchmark_data.go:120: success: expected AlterTableAddCheckConstraint/alter_table_add_3_check_constraints to perform KV lookups in [14, 14], got 13
    validate_benchmark_data.go:120: success: expected AlterTableDropConstraint/alter_table_drop_1_check_constraint to perform KV lookups in [13, 13], got 13
    validate_benchmark_data.go:120: success: expected TriggerResolution/insert_into_table_with_after_trigger to perform KV lookups in [1, 1], got 2
    validate_benchmark_data.go:120: success: expected TriggerResolution/insert_into_table_with_before_trigger to perform KV lookups in [1, 1], got 1
    validate_benchmark_data.go:120: success: expected Discard/DISCARD_ALL,_2_tables_in_2_dbs to perform KV lookups in [19, 19], got 19
    validate_benchmark_data.go:120: success: expected ORMQueries/prisma_column_descriptions to perform KV lookups in [5, 5], got 5
    validate_benchmark_data.go:120: success: expected ORMQueries/pg_is_other_temp_schema_multiple_times to perform KV lookups in [6, 6], got 6
    validate_benchmark_data.go:120: success: expected ORMQueries/hasura_column_descriptions_modified to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/pg_my_temp_schema_multiple_times to perform KV lookups in [1, 1], got 1
    validate_benchmark_data.go:120: success: expected ORMQueries/has_column_privilege_using_column_name to perform KV lookups in [0, 0], got 0
    validate_benchmark_data.go:120: success: expected ORMQueries/pg_is_other_temp_schema to perform KV lookups in [6, 6], got 6
    validate_benchmark_data.go:120: success: expected ORMQueries/hasura_column_descriptions_8_tables to perform KV lookups in [19, 19], got 19
    validate_benchmark_data.go:120: success: expected ORMQueries/has_sequence_privilege to perform KV lookups in [0, 0], got 0
    validate_benchmark_data.go:120: success: expected AlterTableDropConstraint/alter_table_drop_2_check_constraints to perform KV lookups in [13, 13], got 13
    validate_benchmark_data.go:120: success: expected ORMQueries/django_table_introspection_8_tables to perform KV lookups in [5, 5], got 5
    validate_benchmark_data.go:120: success: expected DropView/drop_1_view to perform KV lookups in [14, 14], got 14
    validate_benchmark_data.go:120: success: expected ORMQueries/django_comment_introspection_with_comments to perform KV lookups in [5, 5], got 5
    validate_benchmark_data.go:120: success: expected Discard/DISCARD_ALL,_1_tables_in_1_db to perform KV lookups in [14, 14], got 14
    validate_benchmark_data.go:120: success: expected ORMQueries/npgsql_types to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected DropView/drop_2_views to perform KV lookups in [15, 15], got 15
    validate_benchmark_data.go:120: success: expected DropView/drop_3_views to perform KV lookups in [15, 15], got 15
    validate_benchmark_data.go:120: success: expected ORMQueries/liquibase_migrations to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/prisma_column_descriptions_updated to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/sqlalchemy_indexes to perform KV lookups in [3, 3], got 3
    validate_benchmark_data.go:120: success: expected ORMQueries/django_indexes to perform KV lookups in [3, 3], got 3
    validate_benchmark_data.go:120: success: expected ORMQueries/prisma_types_4 to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/column_descriptions_json_agg to perform KV lookups in [5, 5], got 5
    validate_benchmark_data.go:117: fail: expected ORMQueries/prisma_types_16 to perform KV lookups in [4, 4], got 6
    validate_benchmark_data.go:120: success: expected ORMQueries/liquibase_migrations_on_multiple_dbs to perform KV lookups in [11, 11], got 12
    validate_benchmark_data.go:73: see the -rewrite flag to re-run the benchmarks and adjust the expectations
    validate_benchmark_data.go:74: usage: ./dev test --rewrite pkg/bench/rttanalysis -f=TestBenchmarkExpectation/ --test-args '-rewrite-iterations=N'
    validate_benchmark_data.go:107: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/218f1ec986fb6ea2d7ae17fff6ee251f/logTestBenchmarkExpectationShard244811337
--- FAIL: TestBenchmarkExpectationShard2 (136.66s)
--- FAIL: TestBenchmarkExpectationShard2 (137.05s)
=== RUN   TestBenchmarkExpectationShard2/ORMQueries/prisma_types_16
    rtt_analysis_bench.go:224: ORMQueries/prisma_types_16: got 6, expected 4
    rtt_analysis_bench.go:230: wrote jaeger trace to /artifacts/tmp/_tmp/218f1ec986fb6ea2d7ae17fff6ee251f/logTestBenchmarkExpectationShard244811337/ORMQueries_prisma_types_16.jaeger.json
--- FAIL: TestBenchmarkExpectationShard2/ORMQueries/prisma_types_16 (68.84s)
=== RUN   TestBenchmarkExpectationShard2/ORMQueries
--- FAIL: TestBenchmarkExpectationShard2/ORMQueries (136.54s)

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-62115