Skip to content

[fix](Iot&auto partition) Add fix for the auto-partition issue during insert overwrite #59462

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
dataroaring merged 14 commits into from
Jan 20, 2026
Merged

[fix](Iot&auto partition) Add fix for the auto-partition issue during insert overwrite #59462

dataroaring merged 14 commits into from
Jan 20, 2026

Conversation

@0AyanamiRei
Copy link
Contributor

@0AyanamiRei 0AyanamiRei commented Dec 29, 2025 •
edited
Loading

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx #57198

Problem Summary:

In PR #57198, our fix only ensures the idempotence of the createPartition RPC within a single load transaction, but overlooked the case of insert overwrite using replacePartition.

What's more, we add some case in this pr.

Regarding the issue of tablet rebalance occurring during auto-partitioned data loading, you can refer to the details in PR #57198: #57198

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@0AyanamiRei 0AyanamiRei marked this pull request as draft December 29, 2025 13:16
@0AyanamiRei 0AyanamiRei marked this pull request as ready for review December 30, 2025 01:37
@0AyanamiRei 0AyanamiRei marked this pull request as draft December 30, 2025 01:38
@0AyanamiRei 0AyanamiRei marked this pull request as ready for review December 30, 2025 06:30
@0AyanamiRei
Copy link
Contributor Author

0AyanamiRei commented Dec 30, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 30, 2025

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.38% (1771/2231)
Line Coverage 64.69% (31326/48424)
Region Coverage 65.26% (15589/23887)
Branch Coverage 55.87% (8286/14832)

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 30, 2025

BE UT Coverage Report

Increment line coverage 0.00% (0/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.41% (18964/35508)
Line Coverage 39.28% (176005/448064)
Region Coverage 33.82% (136086/402432)
Branch Coverage 34.77% (58812/169142)

@0AyanamiRei
Copy link
Contributor Author

0AyanamiRei commented Dec 30, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Dec 30, 2025

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.38% (1771/2231)
Line Coverage 64.68% (31321/48424)
Region Coverage 65.21% (15577/23887)
Branch Coverage 55.85% (8283/14832)

@doris-robot
Copy link

doris-robot commented Dec 30, 2025

TPC-H: Total hot run time: 36004 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 54c0b55bce4cb6ad35d8d1e83b974d6311dd5f71, data reload: false

------ Round 1 ----------------------------------
q1	17643	4198	4050	4050
q2	2013	364	243	243
q3	10190	1293	765	765
q4	10239	894	331	331
q5	7756	2164	1950	1950
q6	263	173	140	140
q7	951	812	658	658
q8	9299	1447	1167	1167
q9	7203	5165	5162	5162
q10	6849	1814	1413	1413
q11	507	310	299	299
q12	720	767	588	588
q13	17784	3859	3151	3151
q14	285	285	278	278
q15	586	518	515	515
q16	718	695	663	663
q17	726	729	663	663
q18	7517	7817	7853	7817
q19	1143	1032	665	665
q20	461	391	254	254
q21	4574	4172	4166	4166
q22	1158	1066	1070	1066
Total cold run time: 108585 ms
Total hot run time: 36004 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4270	4358	4259	4259
q2	346	413	319	319
q3	2364	2955	2408	2408
q4	1471	1870	1615	1615
q5	4329	4308	4349	4308
q6	213	176	128	128
q7	1997	1875	1725	1725
q8	2569	2378	2383	2378
q9	7195	7005	7183	7005
q10	2401	2539	2101	2101
q11	548	446	440	440
q12	683	731	573	573
q13	3439	3823	3099	3099
q14	272	280	262	262
q15	526	501	493	493
q16	619	674	618	618
q17	1111	1253	1296	1253
q18	7580	7212	7370	7212
q19	895	900	892	892
q20	1877	1950	1791	1791
q21	4622	4325	4252	4252
q22	1107	1040	1017	1017
Total cold run time: 50434 ms
Total hot run time: 48148 ms

@doris-robot
Copy link

doris-robot commented Dec 30, 2025

TPC-DS: Total hot run time: 174982 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 54c0b55bce4cb6ad35d8d1e83b974d6311dd5f71, data reload: false

query5	4357	583	436	436
query6	324	218	215	215
query7	4226	478	265	265
query8	334	248	236	236
query9	8757	2636	2645	2636
query10	502	373	321	321
query11	15199	15234	14943	14943
query12	171	120	114	114
query13	1271	515	397	397
query14	6091	3030	2742	2742
query14_1	2700	2706	2669	2669
query15	204	195	184	184
query16	972	478	452	452
query17	1110	706	607	607
query18	2476	446	351	351
query19	231	233	195	195
query20	124	118	117	117
query21	216	145	126	126
query22	3899	4138	3892	3892
query23	16000	15664	15502	15502
query23_1	15603	15453	15546	15453
query24	7443	1606	1214	1214
query24_1	1234	1202	1235	1202
query25	569	490	426	426
query26	1246	273	170	170
query27	2752	471	300	300
query28	4487	2246	2186	2186
query29	774	544	434	434
query30	303	238	209	209
query31	775	629	563	563
query32	75	67	67	67
query33	537	329	290	290
query34	885	879	559	559
query35	766	799	692	692
query36	870	901	788	788
query37	122	96	74	74
query38	2762	2753	2732	2732
query39	762	752	718	718
query39_1	695	698	718	698
query40	216	132	116	116
query41	71	64	64	64
query42	108	103	105	103
query43	432	494	411	411
query44	1363	771	756	756
query45	188	184	176	176
query46	883	998	619	619
query47	1333	1432	1243	1243
query48	329	334	248	248
query49	599	408	327	327
query50	671	282	213	213
query51	3938	3744	3797	3744
query52	107	109	96	96
query53	301	332	272	272
query54	288	260	259	259
query55	76	76	76	76
query56	322	294	288	288
query57	1005	1020	885	885
query58	264	285	262	262
query59	1984	2233	2184	2184
query60	319	317	297	297
query61	161	162	159	159
query62	400	354	309	309
query63	297	269	276	269
query64	5016	1300	1004	1004
query65	3788	3712	3710	3710
query66	1437	434	319	319
query67	14795	14683	14915	14683
query68	5155	1036	735	735
query69	500	350	306	306
query70	1075	894	955	894
query71	353	301	283	283
query72	6230	4926	4826	4826
query73	681	601	316	316
query74	8804	8763	8621	8621
query75	2884	2890	2572	2572
query76	3791	1070	679	679
query77	518	379	284	284
query78	9806	9933	9225	9225
query79	1031	947	619	619
query80	716	568	485	485
query81	479	263	228	228
query82	411	143	107	107
query83	271	255	238	238
query84	255	117	102	102
query85	880	510	468	468
query86	344	330	302	302
query87	2874	2849	2786	2786
query88	3276	2312	2308	2308
query89	397	350	325	325
query90	1959	157	155	155
query91	175	172	145	145
query92	72	69	64	64
query93	1103	911	566	566
query94	619	325	285	285
query95	567	389	306	306
query96	584	463	214	214
query97	2316	2391	2262	2262
query98	210	200	200	200
query99	590	598	520	520
Total cold run time: 250414 ms
Total hot run time: 174982 ms

@doris-robot
Copy link

doris-robot commented Dec 30, 2025

ClickBench: Total hot run time: 27.84 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 54c0b55bce4cb6ad35d8d1e83b974d6311dd5f71, data reload: false

query1	0.05	0.04	0.04
query2	0.14	0.07	0.08
query3	0.31	0.07	0.08
query4	1.60	0.10	0.08
query5	0.26	0.24	0.25
query6	1.14	0.65	0.64
query7	0.03	0.03	0.02
query8	0.07	0.06	0.06
query9	0.57	0.50	0.50
query10	0.56	0.56	0.55
query11	0.26	0.13	0.15
query12	0.26	0.14	0.14
query13	0.63	0.63	0.61
query14	1.02	1.03	1.00
query15	0.88	0.82	0.82
query16	0.43	0.38	0.39
query17	1.05	1.04	1.02
query18	0.24	0.21	0.22
query19	1.88	1.85	1.87
query20	0.02	0.01	0.01
query21	15.42	0.29	0.24
query22	4.99	0.10	0.10
query23	15.40	0.40	0.22
query24	2.37	0.48	0.30
query25	0.10	0.09	0.10
query26	0.19	0.17	0.17
query27	0.10	0.09	0.09
query28	3.71	1.14	0.97
query29	12.58	4.04	3.23
query30	0.33	0.13	0.10
query31	2.80	0.65	0.43
query32	3.23	0.60	0.49
query33	2.97	3.13	2.99
query34	16.99	5.17	4.50
query35	4.58	4.48	4.57
query36	0.62	0.49	0.52
query37	0.25	0.09	0.08
query38	0.21	0.06	0.06
query39	0.07	0.05	0.05
query40	0.20	0.17	0.17
query41	0.14	0.07	0.06
query42	0.08	0.05	0.04
query43	0.06	0.06	0.05
Total cold run time: 98.79 s
Total hot run time: 27.84 s

@doris-robot
Copy link

doris-robot commented Dec 30, 2025

BE UT Coverage Report

Increment line coverage 0.00% (0/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.37% (18951/35508)
Line Coverage 39.25% (175873/448071)
Region Coverage 33.77% (135877/402407)
Branch Coverage 34.74% (58753/169142)

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 30, 2025

FE Regression Coverage Report

Increment line coverage 0.00% (0/83) 🎉
Increment coverage report
Complete coverage report

1 similar comment
@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 30, 2025

FE Regression Coverage Report

Increment line coverage 0.00% (0/83) 🎉
Increment coverage report
Complete coverage report

@0AyanamiRei
Copy link
Contributor Author

0AyanamiRei commented Jan 4, 2026

run buildall

@doris-robot
Copy link

doris-robot commented Jan 4, 2026

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.52% (1774/2231)
Line Coverage 64.84% (31423/48466)
Region Coverage 65.38% (15626/23901)
Branch Coverage 56.04% (8318/14844)

@doris-robot
Copy link

doris-robot commented Jan 10, 2026

TPC-H: Total hot run time: 32240 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 952410bc4e189e9c88b1fa210f27c26df2159922, data reload: false

------ Round 1 ----------------------------------
q1	17638	4391	4142	4142
q2	2036	368	246	246
q3	10147	1283	732	732
q4	10280	918	337	337
q5	8877	2101	1881	1881
q6	221	168	137	137
q7	944	797	659	659
q8	9283	1426	1176	1176
q9	5144	4704	4616	4616
q10	6852	1800	1396	1396
q11	517	323	286	286
q12	745	739	594	594
q13	17787	3874	3118	3118
q14	294	288	265	265
q15	586	508	509	508
q16	703	676	626	626
q17	680	821	526	526
q18	6659	6463	7031	6463
q19	1204	1209	645	645
q20	433	417	255	255
q21	3282	2663	2578	2578
q22	1165	1097	1054	1054
Total cold run time: 105477 ms
Total hot run time: 32240 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4317	4379	4298	4298
q2	344	404	317	317
q3	2256	2824	2392	2392
q4	1435	1896	1425	1425
q5	4632	4458	4401	4401
q6	214	166	125	125
q7	2041	1909	1774	1774
q8	2541	2404	2407	2404
q9	7153	7181	7416	7181
q10	2495	2702	2208	2208
q11	536	485	434	434
q12	662	699	581	581
q13	3411	3753	3081	3081
q14	283	292	256	256
q15	523	485	481	481
q16	615	654	620	620
q17	1120	1269	1290	1269
q18	7251	7217	7181	7181
q19	865	826	830	826
q20	1875	1971	1811	1811
q21	4554	4292	4233	4233
q22	1088	1018	978	978
Total cold run time: 50211 ms
Total hot run time: 48276 ms

@doris-robot
Copy link

doris-robot commented Jan 10, 2026

TPC-DS: Total hot run time: 173524 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 952410bc4e189e9c88b1fa210f27c26df2159922, data reload: false

query5	4380	583	429	429
query6	348	238	228	228
query7	4222	459	277	277
query8	332	253	240	240
query9	8769	2644	2659	2644
query10	522	370	320	320
query11	15187	15239	14870	14870
query12	171	117	111	111
query13	1268	483	378	378
query14	6104	3018	2768	2768
query14_1	2689	2655	2686	2655
query15	203	203	172	172
query16	1013	490	454	454
query17	1110	685	582	582
query18	2504	437	347	347
query19	238	223	196	196
query20	122	117	115	115
query21	216	143	123	123
query22	3796	3894	3982	3894
query23	15954	15553	15542	15542
query23_1	15505	15407	15370	15370
query24	7450	1540	1203	1203
query24_1	1159	1171	1190	1171
query25	588	435	377	377
query26	1252	258	156	156
query27	2778	450	285	285
query28	4566	2136	2119	2119
query29	794	525	446	446
query30	311	238	213	213
query31	793	623	565	565
query32	77	68	73	68
query33	532	335	277	277
query34	908	880	514	514
query35	721	756	682	682
query36	862	912	842	842
query37	127	93	77	77
query38	2742	2662	2670	2662
query39	779	749	757	749
query39_1	706	732	715	715
query40	214	128	115	115
query41	67	62	98	62
query42	106	104	102	102
query43	459	459	395	395
query44	1354	715	723	715
query45	185	183	173	173
query46	841	946	603	603
query47	1387	1438	1295	1295
query48	319	329	235	235
query49	615	427	329	329
query50	641	274	199	199
query51	3723	3812	3719	3719
query52	110	110	98	98
query53	291	328	280	280
query54	277	253	245	245
query55	77	72	74	72
query56	274	293	282	282
query57	1012	993	864	864
query58	266	243	254	243
query59	2139	2219	2111	2111
query60	307	312	291	291
query61	164	161	163	161
query62	392	362	307	307
query63	306	267	270	267
query64	5032	1305	1001	1001
query65	3798	3777	3712	3712
query66	1418	418	298	298
query67	15142	14865	14995	14865
query68	2777	995	737	737
query69	461	355	303	303
query70	984	930	950	930
query71	322	298	281	281
query72	6125	3612	3581	3581
query73	591	724	300	300
query74	8776	8803	8618	8618
query75	2742	2796	2456	2456
query76	2926	1071	678	678
query77	521	362	287	287
query78	9648	9795	9099	9099
query79	1086	940	603	603
query80	649	569	469	469
query81	509	265	231	231
query82	355	143	108	108
query83	258	263	239	239
query84	262	118	98	98
query85	887	520	446	446
query86	324	308	316	308
query87	2870	2874	2815	2815
query88	3217	2245	2251	2245
query89	396	352	340	340
query90	2031	153	148	148
query91	175	159	143	143
query92	69	68	63	63
query93	1026	927	537	537
query94	553	319	296	296
query95	575	384	303	303
query96	594	476	209	209
query97	2358	2377	2305	2305
query98	204	208	205	205
query99	608	588	508	508
Total cold run time: 246116 ms
Total hot run time: 173524 ms

@doris-robot
Copy link

doris-robot commented Jan 10, 2026

BE UT Coverage Report

Increment line coverage 0.00% (0/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.03% (18978/35789)
Line Coverage 39.10% (175881/449879)
Region Coverage 33.68% (136240/404536)
Branch Coverage 34.69% (58869/169688)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 10, 2026

BE Regression && UT Coverage Report

Increment line coverage 100.00% (3/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.38% (24958/34964)
Line Coverage 57.91% (259695/448483)
Region Coverage 52.44% (214239/408571)
Branch Coverage 54.05% (91998/170217)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 10, 2026

FE Regression Coverage Report

Increment line coverage 0.00% (0/91) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 10, 2026

BE Regression && UT Coverage Report

Increment line coverage 100.00% (3/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 73.56% (25722/34966)
Line Coverage 60.90% (273164/448544)
Region Coverage 55.82% (228081/408634)
Branch Coverage 57.57% (98002/170237)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 10, 2026

BE Regression && UT Coverage Report

Increment line coverage 100.00% (3/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 73.55% (25716/34966)
Line Coverage 60.88% (273074/448544)
Region Coverage 55.81% (228068/408634)
Branch Coverage 57.56% (97994/170237)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 10, 2026

FE Regression Coverage Report

Increment line coverage 0.00% (0/91) 🎉
Increment coverage report
Complete coverage report

1 similar comment
@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 10, 2026

FE Regression Coverage Report

Increment line coverage 0.00% (0/91) 🎉
Increment coverage report
Complete coverage report

@liaoxin01
Copy link
Contributor

liaoxin01 commented Jan 18, 2026

run buildall

@doris-robot
Copy link

doris-robot commented Jan 18, 2026

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.52% (1786/2246)
Line Coverage 64.75% (31802/49114)
Region Coverage 65.44% (15837/24201)
Branch Coverage 56.00% (8416/15028)

@doris-robot
Copy link

doris-robot commented Jan 18, 2026

TPC-H: Total hot run time: 31816 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 952410bc4e189e9c88b1fa210f27c26df2159922, data reload: false

------ Round 1 ----------------------------------
q1	17594	4192	4052	4052
q2	2038	353	250	250
q3	10142	1256	726	726
q4	10236	766	299	299
q5	8473	2128	1863	1863
q6	243	173	139	139
q7	973	801	657	657
q8	9279	1416	1074	1074
q9	4977	4699	4689	4689
q10	6823	1827	1409	1409
q11	516	293	279	279
q12	731	743	597	597
q13	17818	3870	3041	3041
q14	291	289	279	279
q15	586	508	505	505
q16	698	682	645	645
q17	665	848	427	427
q18	7217	6514	7171	6514
q19	1293	1036	664	664
q20	409	376	263	263
q21	3227	2620	2361	2361
q22	1159	1107	1083	1083
Total cold run time: 105388 ms
Total hot run time: 31816 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4394	4410	4330	4330
q2	345	413	335	335
q3	2289	2868	2491	2491
q4	1438	1878	1551	1551
q5	4483	4339	4335	4335
q6	212	169	127	127
q7	2055	1899	1800	1800
q8	2489	2394	2370	2370
q9	7353	7473	7307	7307
q10	2428	2768	2240	2240
q11	547	465	442	442
q12	673	706	580	580
q13	3353	3822	3063	3063
q14	269	300	263	263
q15	536	494	480	480
q16	633	669	592	592
q17	1116	1285	1312	1285
q18	7572	7419	7066	7066
q19	851	792	795	792
q20	1879	1925	1821	1821
q21	4465	4294	4202	4202
q22	1073	1007	981	981
Total cold run time: 50453 ms
Total hot run time: 48453 ms

@doris-robot
Copy link

doris-robot commented Jan 18, 2026

TPC-DS: Total hot run time: 173884 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 952410bc4e189e9c88b1fa210f27c26df2159922, data reload: false

query5	4513	613	474	474
query6	320	221	193	193
query7	4228	455	257	257
query8	331	246	232	232
query9	8745	2899	2891	2891
query10	524	395	308	308
query11	15170	15319	14892	14892
query12	172	112	112	112
query13	1241	496	375	375
query14	6142	3056	2781	2781
query14_1	2665	2971	2677	2677
query15	211	189	179	179
query16	986	480	486	480
query17	1095	683	559	559
query18	2468	439	331	331
query19	226	218	198	198
query20	117	116	113	113
query21	235	141	116	116
query22	3872	4007	3993	3993
query23	16134	15655	15402	15402
query23_1	15480	15420	15597	15420
query24	7084	1535	1171	1171
query24_1	1155	1196	1198	1196
query25	540	452	404	404
query26	1244	274	152	152
query27	2747	450	279	279
query28	4574	2188	2157	2157
query29	756	542	445	445
query30	317	244	207	207
query31	811	628	570	570
query32	85	74	81	74
query33	570	343	305	305
query34	884	886	529	529
query35	730	774	682	682
query36	881	890	777	777
query37	133	95	86	86
query38	2715	2776	2698	2698
query39	782	743	736	736
query39_1	700	702	699	699
query40	216	134	116	116
query41	65	61	63	61
query42	104	105	102	102
query43	439	430	405	405
query44	1319	756	749	749
query45	185	193	177	177
query46	840	952	581	581
query47	1454	1511	1380	1380
query48	312	316	232	232
query49	602	431	339	339
query50	608	280	203	203
query51	3798	3776	3735	3735
query52	107	107	93	93
query53	287	318	270	270
query54	279	266	256	256
query55	80	77	77	77
query56	300	310	315	310
query57	1016	1013	936	936
query58	268	256	256	256
query59	2018	2111	2055	2055
query60	314	326	297	297
query61	148	141	148	141
query62	392	356	325	325
query63	297	279	262	262
query64	4917	1248	973	973
query65	3821	3756	3674	3674
query66	1441	439	324	324
query67	15502	15430	15421	15421
query68	2448	1083	776	776
query69	470	354	319	319
query70	1002	934	962	934
query71	331	307	290	290
query72	5248	3217	3235	3217
query73	598	743	315	315
query74	8649	8798	8482	8482
query75	2728	2785	2470	2470
query76	2285	1066	657	657
query77	351	363	305	305
query78	9691	9773	9077	9077
query79	2172	935	589	589
query80	1684	572	480	480
query81	545	269	229	229
query82	962	141	108	108
query83	317	256	235	235
query84	248	113	92	92
query85	885	484	430	430
query86	404	325	296	296
query87	2865	2878	2710	2710
query88	3479	2593	2554	2554
query89	389	348	325	325
query90	1980	172	162	162
query91	159	159	135	135
query92	74	76	65	65
query93	1098	879	543	543
query94	650	318	288	288
query95	576	342	304	304
query96	640	504	235	235
query97	2359	2436	2295	2295
query98	213	207	198	198
query99	609	579	544	544
Total cold run time: 247926 ms
Total hot run time: 173884 ms

@doris-robot
Copy link

doris-robot commented Jan 18, 2026

ClickBench: Total hot run time: 27.95 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 952410bc4e189e9c88b1fa210f27c26df2159922, data reload: false

query1	0.06	0.04	0.04
query2	0.14	0.06	0.06
query3	0.33	0.08	0.08
query4	1.61	0.09	0.09
query5	0.26	0.25	0.25
query6	1.13	0.65	0.67
query7	0.04	0.02	0.04
query8	0.08	0.06	0.06
query9	0.58	0.49	0.49
query10	0.55	0.56	0.56
query11	0.26	0.13	0.13
query12	0.26	0.14	0.14
query13	0.62	0.60	0.61
query14	0.98	0.99	0.98
query15	0.89	0.81	0.82
query16	0.38	0.38	0.41
query17	0.99	1.01	1.02
query18	0.24	0.22	0.22
query19	1.88	1.79	1.85
query20	0.03	0.01	0.01
query21	15.40	0.27	0.25
query22	4.95	0.10	0.09
query23	15.42	0.39	0.23
query24	2.35	0.53	0.32
query25	0.10	0.10	0.10
query26	0.17	0.17	0.17
query27	0.10	0.10	0.08
query28	3.79	1.13	0.96
query29	12.51	4.07	3.28
query30	0.35	0.12	0.11
query31	2.79	0.64	0.44
query32	3.24	0.62	0.50
query33	2.98	3.16	3.09
query34	15.99	5.13	4.45
query35	4.52	4.49	4.59
query36	0.61	0.50	0.50
query37	0.24	0.09	0.09
query38	0.20	0.05	0.05
query39	0.07	0.05	0.05
query40	0.20	0.19	0.17
query41	0.13	0.06	0.07
query42	0.08	0.05	0.05
query43	0.06	0.05	0.05
Total cold run time: 97.56 s
Total hot run time: 27.95 s

@doris-robot
Copy link

doris-robot commented Jan 18, 2026

BE UT Coverage Report

Increment line coverage 0.00% (0/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.43% (19041/36314)
Line Coverage 35.71% (176312/493764)
Region Coverage 32.23% (136438/423344)
Branch Coverage 33.13% (59004/178091)

@0AyanamiRei
Copy link
Contributor Author

0AyanamiRei commented Jan 20, 2026

run buildall

@doris-robot
Copy link

doris-robot commented Jan 20, 2026

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.52% (1786/2246)
Line Coverage 64.75% (31802/49114)
Region Coverage 65.48% (15848/24201)
Branch Coverage 56.02% (8418/15028)

@doris-robot
Copy link

doris-robot commented Jan 20, 2026

TPC-H: Total hot run time: 32159 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f0ba2ef1fba072c24c89df0f03c5f2f277b083b7, data reload: false

------ Round 1 ----------------------------------
q1	17645	4199	4050	4050
q2	2110	359	230	230
q3	10140	1314	718	718
q4	10276	847	306	306
q5	8387	2087	1868	1868
q6	236	167	135	135
q7	983	773	655	655
q8	9270	1398	1143	1143
q9	5126	4549	4669	4549
q10	6837	1776	1403	1403
q11	544	300	275	275
q12	744	730	587	587
q13	17791	3816	3070	3070
q14	302	289	270	270
q15	592	507	501	501
q16	692	680	665	665
q17	772	819	493	493
q18	6697	6610	7130	6610
q19	1561	1031	668	668
q20	413	375	256	256
q21	3298	2701	2675	2675
q22	1129	1077	1032	1032
Total cold run time: 105545 ms
Total hot run time: 32159 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4572	4295	4284	4284
q2	330	399	316	316
q3	2316	2827	2590	2590
q4	1421	1871	1439	1439
q5	4379	4299	4317	4299
q6	229	168	128	128
q7	1992	1941	1897	1897
q8	2561	2340	2376	2340
q9	7325	7082	7360	7082
q10	2487	2883	2241	2241
q11	543	495	481	481
q12	713	746	607	607
q13	3565	3847	3104	3104
q14	274	278	271	271
q15	517	487	477	477
q16	614	641	592	592
q17	1107	1399	1402	1399
q18	7359	7263	7294	7263
q19	842	804	798	798
q20	1899	1949	1793	1793
q21	4418	4235	4117	4117
q22	1065	1029	967	967
Total cold run time: 50528 ms
Total hot run time: 48485 ms

@doris-robot
Copy link

doris-robot commented Jan 20, 2026

TPC-DS: Total hot run time: 174004 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f0ba2ef1fba072c24c89df0f03c5f2f277b083b7, data reload: false

query5	4407	620	468	468
query6	330	234	222	222
query7	4229	474	270	270
query8	339	248	241	241
query9	8721	2870	2895	2870
query10	533	383	345	345
query11	15248	15019	14893	14893
query12	173	116	111	111
query13	1255	489	393	393
query14	6129	3001	2811	2811
query14_1	2617	2556	2596	2556
query15	193	185	175	175
query16	1000	515	479	479
query17	1065	640	520	520
query18	2499	409	316	316
query19	212	213	183	183
query20	116	110	110	110
query21	217	141	123	123
query22	3822	4000	4068	4000
query23	15939	15639	15337	15337
query23_1	15413	15490	15550	15490
query24	7073	1517	1153	1153
query24_1	1164	1156	1178	1156
query25	507	429	402	402
query26	1236	261	154	154
query27	2767	451	286	286
query28	4569	2190	2180	2180
query29	782	536	432	432
query30	316	242	208	208
query31	798	618	585	585
query32	87	72	73	72
query33	537	355	304	304
query34	917	885	540	540
query35	721	781	672	672
query36	913	926	849	849
query37	138	94	84	84
query38	2762	2694	2745	2694
query39	776	745	734	734
query39_1	706	733	708	708
query40	221	137	122	122
query41	72	71	69	69
query42	107	112	104	104
query43	435	428	422	422
query44	1314	750	753	750
query45	189	183	175	175
query46	848	935	587	587
query47	1326	1460	1341	1341
query48	318	352	251	251
query49	625	434	346	346
query50	605	271	205	205
query51	3744	3734	3851	3734
query52	103	109	98	98
query53	292	331	273	273
query54	309	304	272	272
query55	86	85	81	81
query56	322	317	322	317
query57	1008	1013	958	958
query58	277	264	262	262
query59	2177	2091	2065	2065
query60	346	348	328	328
query61	170	173	167	167
query62	410	373	323	323
query63	297	267	271	267
query64	5001	1270	929	929
query65	3784	3735	3706	3706
query66	1445	424	313	313
query67	15705	15491	15578	15491
query68	2739	1084	751	751
query69	440	360	324	324
query70	983	872	942	872
query71	325	314	293	293
query72	5434	3181	3233	3181
query73	609	713	314	314
query74	8820	8693	8490	8490
query75	2730	2839	2449	2449
query76	2379	1044	649	649
query77	376	395	300	300
query78	9921	10035	9195	9195
query79	1051	924	574	574
query80	1312	574	481	481
query81	547	265	233	233
query82	1012	147	108	108
query83	364	256	237	237
query84	254	109	99	99
query85	896	481	426	426
query86	407	324	332	324
query87	2847	2879	2774	2774
query88	3477	2595	2563	2563
query89	373	344	334	334
query90	1948	166	166	166
query91	170	158	134	134
query92	78	72	68	68
query93	1013	884	541	541
query94	621	310	305	305
query95	577	387	305	305
query96	634	493	228	228
query97	2358	2374	2288	2288
query98	214	201	200	200
query99	619	559	517	517
Total cold run time: 247530 ms
Total hot run time: 174004 ms

@doris-robot
Copy link

doris-robot commented Jan 20, 2026

ClickBench: Total hot run time: 26.86 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f0ba2ef1fba072c24c89df0f03c5f2f277b083b7, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.05	0.05
query3	0.25	0.08	0.08
query4	1.61	0.12	0.10
query5	0.27	0.25	0.25
query6	1.15	0.67	0.65
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.58	0.49	0.50
query10	0.54	0.54	0.55
query11	0.15	0.10	0.09
query12	0.14	0.10	0.11
query13	0.59	0.58	0.59
query14	0.95	0.94	0.92
query15	0.79	0.77	0.78
query16	0.40	0.39	0.38
query17	1.04	1.04	1.02
query18	0.23	0.21	0.21
query19	1.99	1.87	1.90
query20	0.02	0.01	0.01
query21	15.46	0.28	0.15
query22	5.05	0.05	0.05
query23	15.77	0.28	0.10
query24	1.98	0.48	0.34
query25	0.11	0.05	0.08
query26	0.15	0.14	0.13
query27	0.09	0.06	0.05
query28	4.40	1.07	0.88
query29	12.52	3.84	3.08
query30	0.28	0.14	0.13
query31	2.80	0.64	0.38
query32	3.24	0.56	0.45
query33	2.98	3.01	3.03
query34	16.14	5.06	4.48
query35	4.42	4.45	5.18
query36	0.68	0.54	0.55
query37	0.11	0.07	0.09
query38	0.07	0.05	0.04
query39	0.05	0.03	0.04
query40	0.16	0.15	0.15
query41	0.09	0.04	0.03
query42	0.04	0.02	0.03
query43	0.05	0.03	0.03
Total cold run time: 97.57 s
Total hot run time: 26.86 s

@doris-robot
Copy link

doris-robot commented Jan 20, 2026

BE UT Coverage Report

Increment line coverage 0.00% (0/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.39% (19040/36340)
Line Coverage 35.68% (176291/494029)
Region Coverage 32.22% (136475/423616)
Branch Coverage 33.12% (59016/178162)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 20, 2026

BE Regression && UT Coverage Report

Increment line coverage 100.00% (3/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.44% (25447/35619)
Line Coverage 53.97% (266315/493471)
Region Coverage 51.62% (220982/428119)
Branch Coverage 53.02% (94869/178923)

dataroaring
dataroaring approved these changes Jan 20, 2026
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit ef13377 into apache:master Jan 20, 2026
25 of 27 checks passed
github-actions bot pushed a commit that referenced this pull request Jan 20, 2026
@0AyanamiRei
[fix](Iot&auto partition) Add fix for the auto-partition issue during…
8b5ee19 
… insert overwrite (#59462)

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx #57198
@github-actions github-actions bot mentioned this pull request Jan 20, 2026
Merged
yiguolei pushed a commit that referenced this pull request Jan 21, 2026
@github-actions @0AyanamiRei
branch-4.0: [fix](Iot&auto partition) Add fix for the auto-partition …
9cdc911 
…issue during insert overwrite #59462 (#60081)

Cherry-picked from #59462

Co-authored-by: Refrain <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@liaoxin01 liaoxin01 liaoxin01 approved these changes

@dataroaring dataroaring dataroaring approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/3.1.x dev/4.0.3-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@0AyanamiRei @hello-stephen @doris-robot @liaoxin01 @dataroaring @yiguolei