Skip to content

[Enhancement] fix duplicated properties is not reported #32729

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 7 commits into from

Conversation

xiedeyantu
Copy link
Contributor

Proposed changes

Issue Number: close #32577

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@xiedeyantu
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38244 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2d094789f16c09f15b4684ab7cd92d7998c9ca0b, data reload: false

------ Round 1 ----------------------------------
q1	19365	4284	4172	4172
q2	2109	164	152	152
q3	10574	1163	1222	1163
q4	10317	730	809	730
q5	9099	3069	2989	2989
q6	210	127	124	124
q7	1061	623	576	576
q8	9706	2235	2037	2037
q9	9356	6722	6689	6689
q10	8568	3503	3582	3503
q11	433	234	226	226
q12	440	196	191	191
q13	17961	2907	2885	2885
q14	236	201	201	201
q15	500	456	447	447
q16	492	375	376	375
q17	949	549	612	549
q18	7009	6449	6421	6421
q19	3514	1443	1389	1389
q20	567	255	243	243
q21	3669	2927	2895	2895
q22	350	287	291	287
Total cold run time: 116485 ms
Total hot run time: 38244 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4211	4073	4096	4073
q2	329	226	226	226
q3	2930	2821	2807	2807
q4	1845	1562	1541	1541
q5	5274	5332	5316	5316
q6	194	115	117	115
q7	2229	1901	1861	1861
q8	3160	3283	3304	3283
q9	8745	8661	8661	8661
q10	3772	3783	3790	3783
q11	567	452	461	452
q12	727	564	543	543
q13	16944	2867	2838	2838
q14	280	251	246	246
q15	491	453	455	453
q16	463	425	418	418
q17	1746	1485	1449	1449
q18	7460	7167	7057	7057
q19	1609	1569	1521	1521
q20	1903	1742	1727	1727
q21	4797	4691	4556	4556
q22	551	433	424	424
Total cold run time: 70227 ms
Total hot run time: 53350 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186280 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2d094789f16c09f15b4684ab7cd92d7998c9ca0b, data reload: false

query1	925	363	356	356
query2	7454	2111	1924	1924
query3	6712	215	207	207
query4	31996	21298	21335	21298
query5	4319	493	388	388
query6	278	174	181	174
query7	4636	282	282	282
query8	223	167	170	167
query9	9243	2250	2238	2238
query10	561	245	256	245
query11	14815	14388	14461	14388
query12	143	87	86	86
query13	1655	413	409	409
query14	11759	11473	10976	10976
query15	326	192	195	192
query16	8233	263	272	263
query17	2113	562	537	537
query18	2094	277	282	277
query19	345	150	151	150
query20	90	88	86	86
query21	197	129	130	129
query22	5007	4784	4803	4784
query23	33556	32684	32911	32684
query24	10556	2829	2886	2829
query25	592	364	361	361
query26	1200	154	151	151
query27	2550	340	354	340
query28	7000	1851	1816	1816
query29	905	647	624	624
query30	317	156	160	156
query31	988	750	747	747
query32	89	60	55	55
query33	790	260	271	260
query34	1015	469	489	469
query35	837	618	605	605
query36	1032	892	892	892
query37	114	74	74	74
query38	3512	3425	3428	3425
query39	1493	1429	1415	1415
query40	206	114	111	111
query41	50	51	52	51
query42	109	96	95	95
query43	490	448	447	447
query44	1192	709	722	709
query45	274	255	266	255
query46	1115	686	691	686
query47	1934	1860	1861	1860
query48	433	351	352	351
query49	1101	350	334	334
query50	767	374	362	362
query51	6766	6630	6663	6630
query52	111	95	93	93
query53	342	273	277	273
query54	308	247	244	244
query55	86	82	83	82
query56	265	233	232	232
query57	1199	1143	1151	1143
query58	237	222	213	213
query59	2912	2729	2614	2614
query60	274	248	250	248
query61	112	115	117	115
query62	656	457	453	453
query63	311	285	276	276
query64	5717	4104	4044	4044
query65	3075	3019	3040	3019
query66	912	372	372	372
query67	15458	14820	14922	14820
query68	5623	511	522	511
query69	584	368	359	359
query70	1238	1099	1176	1099
query71	460	289	281	281
query72	6619	2734	2573	2573
query73	688	311	303	303
query74	7041	6707	6620	6620
query75	3829	2847	2827	2827
query76	3805	825	843	825
query77	736	261	255	255
query78	10929	10162	10164	10162
query79	7941	519	507	507
query80	1271	399	381	381
query81	524	212	217	212
query82	896	211	211	211
query83	202	145	143	143
query84	287	78	83	78
query85	1502	315	311	311
query86	469	304	313	304
query87	3725	3533	3499	3499
query88	5163	2256	2279	2256
query89	504	369	358	358
query90	2046	172	176	172
query91	164	136	137	136
query92	66	46	50	46
query93	6237	501	487	487
query94	1197	172	176	172
query95	445	324	329	324
query96	607	278	268	268
query97	3049	2878	2914	2878
query98	236	218	210	210
query99	1229	937	921	921
Total cold run time: 305394 ms
Total hot run time: 186280 ms

@xiedeyantu
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37778 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2d094789f16c09f15b4684ab7cd92d7998c9ca0b, data reload: false

------ Round 1 ----------------------------------
q1	17655	4176	4147	4147
q2	2123	151	150	150
q3	10592	1121	1188	1121
q4	10231	807	744	744
q5	7460	2999	3003	2999
q6	196	122	122	122
q7	1030	584	595	584
q8	9326	1981	1976	1976
q9	7168	6616	6548	6548
q10	8437	3462	3509	3462
q11	442	224	223	223
q12	431	199	197	197
q13	17800	2866	2861	2861
q14	224	211	205	205
q15	514	458	461	458
q16	505	375	373	373
q17	948	540	575	540
q18	7038	6353	6357	6353
q19	4908	1382	1420	1382
q20	545	247	262	247
q21	3568	2797	2986	2797
q22	351	289	291	289
Total cold run time: 111492 ms
Total hot run time: 37778 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4128	4042	4055	4042
q2	325	233	228	228
q3	2960	2875	2831	2831
q4	1805	1523	1553	1523
q5	5287	5344	5318	5318
q6	192	116	117	116
q7	2214	1858	1863	1858
q8	3151	3295	3272	3272
q9	8671	8650	8652	8650
q10	3788	3801	3780	3780
q11	549	452	433	433
q12	739	523	550	523
q13	16919	2882	2855	2855
q14	282	246	258	246
q15	500	469	458	458
q16	472	420	429	420
q17	1713	1487	1485	1485
q18	7330	7172	7143	7143
q19	1862	1518	1511	1511
q20	1920	1731	1689	1689
q21	4811	4707	4551	4551
q22	520	426	438	426
Total cold run time: 70138 ms
Total hot run time: 53358 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186342 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2d094789f16c09f15b4684ab7cd92d7998c9ca0b, data reload: false

query1	925	365	337	337
query2	7371	1987	1909	1909
query3	6714	211	212	211
query4	31630	21280	21377	21280
query5	4304	392	393	392
query6	268	172	171	171
query7	4652	278	282	278
query8	220	163	174	163
query9	9106	2249	2247	2247
query10	560	245	261	245
query11	15748	14468	14411	14411
query12	141	98	88	88
query13	1626	415	413	413
query14	12962	11149	11408	11149
query15	273	204	202	202
query16	8240	265	257	257
query17	2007	547	522	522
query18	2092	278	267	267
query19	338	144	154	144
query20	90	83	85	83
query21	196	124	125	124
query22	5020	4818	4774	4774
query23	33503	32564	32724	32564
query24	10304	2853	2870	2853
query25	574	358	366	358
query26	720	149	155	149
query27	2188	343	348	343
query28	6061	1865	1855	1855
query29	878	658	621	621
query30	303	149	152	149
query31	976	724	721	721
query32	94	55	57	55
query33	667	262	265	262
query34	884	497	487	487
query35	838	609	603	603
query36	1017	869	890	869
query37	110	76	74	74
query38	3544	3418	3454	3418
query39	1456	1418	1434	1418
query40	213	119	117	117
query41	53	51	48	48
query42	104	98	96	96
query43	483	473	471	471
query44	1043	718	702	702
query45	287	256	258	256
query46	1115	699	688	688
query47	1895	1837	1828	1828
query48	447	354	343	343
query49	1069	344	343	343
query50	756	365	365	365
query51	6664	6560	6629	6560
query52	102	92	87	87
query53	349	270	274	270
query54	317	248	233	233
query55	85	80	78	78
query56	252	234	238	234
query57	1185	1150	1147	1147
query58	230	210	202	202
query59	2810	2751	2624	2624
query60	279	248	252	248
query61	114	110	108	108
query62	659	436	441	436
query63	309	277	273	273
query64	5506	4129	4036	4036
query65	3036	3041	3038	3038
query66	894	370	387	370
query67	15433	14951	15034	14951
query68	7118	509	520	509
query69	630	381	377	377
query70	1275	1203	1189	1189
query71	500	286	275	275
query72	6435	2705	2524	2524
query73	720	313	303	303
query74	7225	6741	6643	6643
query75	4062	2879	2933	2879
query76	4900	861	872	861
query77	658	249	251	249
query78	10973	10113	10282	10113
query79	8395	512	519	512
query80	1548	393	384	384
query81	537	222	225	222
query82	868	205	196	196
query83	207	143	142	142
query84	282	73	75	73
query85	1330	313	308	308
query86	460	298	280	280
query87	3647	3551	3493	3493
query88	5022	2260	2260	2260
query89	521	362	361	361
query90	1926	168	170	168
query91	167	135	137	135
query92	58	46	47	46
query93	6689	490	477	477
query94	1134	172	173	172
query95	413	316	323	316
query96	628	263	271	263
query97	3053	2911	2880	2880
query98	233	232	201	201
query99	1285	913	931	913
Total cold run time: 307188 ms
Total hot run time: 186342 ms

@xiedeyantu
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38410 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 20165426302539226ef88a4eb859d3f0590504f5, data reload: false

------ Round 1 ----------------------------------
q1	18098	4286	4114	4114
q2	2109	157	152	152
q3	10579	1154	1198	1154
q4	10616	742	828	742
q5	8516	3042	3029	3029
q6	201	122	123	122
q7	1047	586	578	578
q8	9339	1998	1997	1997
q9	7313	6660	6641	6641
q10	8717	3593	3780	3593
q11	1032	257	247	247
q12	811	224	208	208
q13	19467	3047	3019	3019
q14	277	266	210	210
q15	531	453	455	453
q16	483	371	377	371
q17	953	539	629	539
q18	8023	6566	6574	6566
q19	2290	1380	1469	1380
q20	517	255	258	255
q21	3531	2883	2755	2755
q22	341	285	287	285
Total cold run time: 114791 ms
Total hot run time: 38410 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4093	4054	4024	4024
q2	325	235	233	233
q3	2924	2787	2792	2787
q4	1839	1567	1581	1567
q5	5283	5366	5324	5324
q6	196	117	116	116
q7	2240	1872	1830	1830
q8	3144	3300	3243	3243
q9	8666	8723	8759	8723
q10	3752	3792	3769	3769
q11	544	451	437	437
q12	708	531	538	531
q13	16924	2834	2824	2824
q14	285	251	247	247
q15	500	462	451	451
q16	466	423	420	420
q17	1729	1464	1451	1451
q18	7461	7266	7072	7072
q19	1602	1504	1504	1504
q20	1919	1732	1723	1723
q21	4819	4675	4711	4675
q22	523	456	442	442
Total cold run time: 69942 ms
Total hot run time: 53393 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185645 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 20165426302539226ef88a4eb859d3f0590504f5, data reload: false

query1	937	365	350	350
query2	7432	2012	1990	1990
query3	6712	214	214	214
query4	31870	21285	21260	21260
query5	4370	420	391	391
query6	269	175	166	166
query7	4621	298	287	287
query8	226	180	181	180
query9	9428	2257	2239	2239
query10	589	245	247	245
query11	15624	14268	14506	14268
query12	141	96	90	90
query13	1626	434	413	413
query14	12360	11111	10463	10463
query15	326	204	194	194
query16	8225	254	248	248
query17	2021	553	532	532
query18	2101	288	279	279
query19	349	162	158	158
query20	98	87	92	87
query21	210	132	135	132
query22	5053	4817	4902	4817
query23	33490	32772	32924	32772
query24	10761	2846	2833	2833
query25	595	384	393	384
query26	931	159	160	159
query27	2372	354	353	353
query28	7046	1871	1848	1848
query29	904	682	646	646
query30	303	150	151	150
query31	991	757	742	742
query32	95	60	57	57
query33	782	312	258	258
query34	1001	485	493	485
query35	836	619	640	619
query36	1005	895	897	895
query37	115	79	77	77
query38	3514	3394	3420	3394
query39	1484	1432	1422	1422
query40	213	112	112	112
query41	52	49	47	47
query42	107	93	94	93
query43	481	474	455	455
query44	1169	734	710	710
query45	297	261	270	261
query46	1124	725	707	707
query47	1937	1853	1849	1849
query48	467	347	348	347
query49	1087	332	340	332
query50	755	373	371	371
query51	6705	6574	6634	6574
query52	102	101	90	90
query53	353	275	279	275
query54	315	248	239	239
query55	85	84	84	84
query56	259	314	230	230
query57	1228	1154	1151	1151
query58	244	207	215	207
query59	2706	2578	2490	2490
query60	293	252	264	252
query61	119	115	117	115
query62	662	447	452	447
query63	305	283	275	275
query64	5724	3968	4094	3968
query65	3081	3023	3004	3004
query66	894	385	373	373
query67	15658	15309	14812	14812
query68	8600	532	526	526
query69	659	377	373	373
query70	1252	1108	1091	1091
query71	523	278	277	277
query72	6592	2706	2570	2570
query73	825	313	309	309
query74	7127	6635	6701	6635
query75	4340	2909	2817	2817
query76	5419	927	882	882
query77	682	268	268	268
query78	11041	10081	10032	10032
query79	10085	520	525	520
query80	1710	390	380	380
query81	532	220	211	211
query82	823	204	202	202
query83	216	146	147	146
query84	281	78	79	78
query85	1350	340	318	318
query86	418	294	281	281
query87	3747	3585	3549	3549
query88	4960	2269	2282	2269
query89	502	367	365	365
query90	2022	175	176	175
query91	170	134	143	134
query92	57	48	49	48
query93	6536	502	480	480
query94	1190	180	176	176
query95	428	332	329	329
query96	605	270	266	266
query97	3077	2868	2906	2868
query98	240	219	202	202
query99	1225	915	901	901
Total cold run time: 314469 ms
Total hot run time: 185645 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 20165426302539226ef88a4eb859d3f0590504f5 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          60 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.7 seconds inserted 10000000 Rows, about 460K ops/s

@xiedeyantu
Copy link
Contributor Author

run buildall

@xiedeyantu
Copy link
Contributor Author

run buildall

@xiedeyantu
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37632 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 96239c289d6c9b2eb86e156750a994ef50b365e8, data reload: false

------ Round 1 ----------------------------------
q1	17657	4251	4087	4087
q2	2101	149	146	146
q3	10598	1166	1153	1153
q4	10233	778	749	749
q5	7467	2931	2962	2931
q6	204	126	120	120
q7	1019	601	569	569
q8	9350	2045	1948	1948
q9	7191	6619	6554	6554
q10	8414	3417	3582	3417
q11	435	233	216	216
q12	421	198	192	192
q13	17789	2835	2857	2835
q14	245	208	210	208
q15	510	463	461	461
q16	494	372	368	368
q17	944	623	566	566
q18	7024	6459	6400	6400
q19	3862	1379	1442	1379
q20	533	271	245	245
q21	3540	2861	2808	2808
q22	359	295	280	280
Total cold run time: 110390 ms
Total hot run time: 37632 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4122	4068	4056	4056
q2	324	234	231	231
q3	2915	2841	2823	2823
q4	1846	1511	1502	1502
q5	5297	5311	5308	5308
q6	196	115	120	115
q7	2197	1850	1830	1830
q8	3138	3262	3259	3259
q9	8707	8681	8664	8664
q10	3766	3801	3741	3741
q11	546	444	438	438
q12	713	560	570	560
q13	16917	2849	2860	2849
q14	279	247	269	247
q15	482	462	458	458
q16	490	422	426	422
q17	1712	1483	1476	1476
q18	7516	7106	7164	7106
q19	4591	1574	1509	1509
q20	1895	1718	1707	1707
q21	4624	4567	4690	4567
q22	524	439	452	439
Total cold run time: 72797 ms
Total hot run time: 53307 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181357 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 96239c289d6c9b2eb86e156750a994ef50b365e8, data reload: false

query1	929	371	347	347
query2	6534	1877	1907	1877
query3	6712	219	221	219
query4	31464	21301	21475	21301
query5	4320	397	398	397
query6	264	172	172	172
query7	4628	300	289	289
query8	225	160	179	160
query9	9321	2267	2267	2267
query10	559	246	248	246
query11	17329	14327	14167	14167
query12	130	94	82	82
query13	1615	404	409	404
query14	9778	7741	7864	7741
query15	242	194	200	194
query16	8139	269	263	263
query17	1947	575	555	555
query18	2048	290	281	281
query19	289	160	154	154
query20	95	88	85	85
query21	200	128	123	123
query22	5038	4787	4910	4787
query23	33553	32771	32810	32771
query24	10907	2896	2847	2847
query25	634	388	368	368
query26	1162	149	156	149
query27	2814	348	357	348
query28	7218	1878	1876	1876
query29	909	639	628	628
query30	312	152	148	148
query31	959	724	733	724
query32	96	61	60	60
query33	765	254	247	247
query34	1039	480	487	480
query35	827	597	602	597
query36	1057	902	899	899
query37	121	69	65	65
query38	3505	3408	3416	3408
query39	1461	1478	1431	1431
query40	210	114	111	111
query41	50	47	48	47
query42	106	99	96	96
query43	477	449	453	449
query44	1186	743	748	743
query45	281	266	259	259
query46	1115	708	691	691
query47	1921	1832	1888	1832
query48	442	360	363	360
query49	1159	338	347	338
query50	753	372	367	367
query51	6696	6635	6669	6635
query52	107	94	92	92
query53	341	275	277	275
query54	307	238	243	238
query55	79	81	82	81
query56	242	232	233	232
query57	1205	1125	1127	1125
query58	231	212	211	211
query59	2773	2671	2515	2515
query60	267	246	250	246
query61	115	112	129	112
query62	645	442	454	442
query63	299	277	274	274
query64	5783	4158	4040	4040
query65	3025	2995	3028	2995
query66	859	354	347	347
query67	15529	14747	14714	14714
query68	7023	522	520	520
query69	606	380	374	374
query70	1264	1169	1101	1101
query71	525	269	252	252
query72	6585	2719	2545	2545
query73	726	315	317	315
query74	6924	6489	6352	6352
query75	3534	2176	2216	2176
query76	4833	853	907	853
query77	654	264	259	259
query78	10821	10342	10097	10097
query79	7906	541	530	530
query80	1533	375	361	361
query81	543	211	217	211
query82	894	87	85	85
query83	202	151	142	142
query84	281	81	77	77
query85	1497	318	307	307
query86	469	325	311	311
query87	3750	3530	3546	3530
query88	4802	2363	2368	2363
query89	497	372	370	370
query90	1941	175	173	173
query91	170	138	141	138
query92	59	46	46	46
query93	5867	497	486	486
query94	1141	174	173	173
query95	424	321	325	321
query96	606	276	273	273
query97	2644	2480	2467	2467
query98	238	217	206	206
query99	1185	919	971	919
Total cold run time: 305492 ms
Total hot run time: 181357 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 96239c289d6c9b2eb86e156750a994ef50b365e8 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       20.8 seconds inserted 10000000 Rows, about 480K ops/s

@xiedeyantu
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38469 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c77d79dfd50a7ff785f339ff56316b17036e4ed5, data reload: false

------ Round 1 ----------------------------------
q1	17651	4459	4272	4272
q2	2708	163	150	150
q3	11655	1153	1241	1153
q4	10346	774	825	774
q5	7521	3114	3064	3064
q6	204	130	128	128
q7	1081	606	611	606
q8	9581	2075	2050	2050
q9	7425	6715	6619	6619
q10	8455	3513	3591	3513
q11	430	223	212	212
q12	441	208	198	198
q13	17801	2847	2860	2847
q14	248	199	211	199
q15	509	480	453	453
q16	503	376	377	376
q17	972	519	626	519
q18	7306	6511	6454	6454
q19	1540	1474	1514	1474
q20	543	244	266	244
q21	3613	2923	2864	2864
q22	349	300	302	300
Total cold run time: 110882 ms
Total hot run time: 38469 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4073	4086	4105	4086
q2	330	229	227	227
q3	2977	2883	2844	2844
q4	1879	1585	1564	1564
q5	5362	5451	5338	5338
q6	194	114	116	114
q7	2283	1881	1842	1842
q8	3183	3334	3324	3324
q9	8716	8755	8723	8723
q10	3836	3790	3813	3790
q11	555	449	448	448
q12	719	578	547	547
q13	16915	2855	2856	2855
q14	274	243	261	243
q15	496	463	453	453
q16	476	431	423	423
q17	1739	1504	1490	1490
q18	7451	7129	7178	7129
q19	1638	1544	1550	1544
q20	1910	1719	1728	1719
q21	4848	4667	4705	4667
q22	516	442	450	442
Total cold run time: 70370 ms
Total hot run time: 53812 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181971 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c77d79dfd50a7ff785f339ff56316b17036e4ed5, data reload: false

query1	934	370	361	361
query2	6535	1966	1834	1834
query3	6702	224	230	224
query4	31737	21309	21340	21309
query5	4314	408	405	405
query6	266	180	179	179
query7	4625	296	285	285
query8	225	172	188	172
query9	9092	2250	2236	2236
query10	560	264	245	245
query11	17289	14398	14365	14365
query12	151	96	89	89
query13	1631	417	424	417
query14	11149	8044	8067	8044
query15	247	196	200	196
query16	8128	267	263	263
query17	1979	583	552	552
query18	2070	294	282	282
query19	363	163	163	163
query20	99	89	92	89
query21	200	129	127	127
query22	4956	4849	4823	4823
query23	33171	32798	32781	32781
query24	11925	2869	2846	2846
query25	648	372	389	372
query26	1831	159	154	154
query27	3105	357	353	353
query28	7601	1855	1837	1837
query29	1042	661	616	616
query30	307	148	146	146
query31	969	738	749	738
query32	81	58	57	57
query33	758	266	254	254
query34	1080	477	494	477
query35	821	608	613	608
query36	1027	893	916	893
query37	266	70	68	68
query38	3614	3413	3474	3413
query39	1475	1448	1451	1448
query40	284	117	111	111
query41	51	48	52	48
query42	105	95	97	95
query43	480	447	448	447
query44	1196	742	737	737
query45	282	260	271	260
query46	1113	707	708	707
query47	1915	1841	1857	1841
query48	453	358	366	358
query49	1199	348	332	332
query50	768	368	372	368
query51	6745	6646	6589	6589
query52	113	95	94	94
query53	344	280	285	280
query54	327	252	242	242
query55	90	78	86	78
query56	245	224	229	224
query57	1210	1131	1136	1131
query58	237	207	212	207
query59	2725	2830	2480	2480
query60	268	245	257	245
query61	117	116	114	114
query62	646	449	438	438
query63	309	278	279	278
query64	6699	3954	4083	3954
query65	3122	3042	3049	3042
query66	1392	372	359	359
query67	15568	14716	14832	14716
query68	8722	542	551	542
query69	644	382	377	377
query70	1247	1157	1108	1108
query71	515	267	267	267
query72	6322	2716	2593	2593
query73	1209	316	317	316
query74	6840	6375	6435	6375
query75	3813	2212	2245	2212
query76	5434	831	906	831
query77	654	261	270	261
query78	10991	10185	10313	10185
query79	9856	530	530	530
query80	1582	378	365	365
query81	507	211	216	211
query82	439	87	83	83
query83	216	148	145	145
query84	288	78	79	78
query85	1233	332	316	316
query86	377	296	316	296
query87	3732	3530	3471	3471
query88	4709	2359	2360	2359
query89	480	366	367	366
query90	2106	174	178	174
query91	173	137	139	137
query92	58	50	48	48
query93	6906	505	479	479
query94	1280	180	175	175
query95	441	336	324	324
query96	619	272	271	271
query97	2688	2486	2457	2457
query98	250	221	205	205
query99	1159	923	918	918
Total cold run time: 316466 ms
Total hot run time: 181971 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit c77d79dfd50a7ff785f339ff56316b17036e4ed5 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       20.2 seconds inserted 10000000 Rows, about 495K ops/s

Copy link
Contributor

We're closing this PR because it hasn't been updated in a while.
This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and feel free a maintainer to remove the Stale tag!

@github-actions github-actions bot added the Stale label Sep 23, 2024
@github-actions github-actions bot closed this Sep 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Enhancement] duplicated properties is not reported
2 participants