Skip to content

[refactor](local shuffle) Plan local exchanger in FE (BE part)#60886

Open
Gabriel39 wants to merge 2 commits intoapache:masterfrom
Gabriel39:dev_0227
Open

[refactor](local shuffle) Plan local exchanger in FE (BE part)#60886
Gabriel39 wants to merge 2 commits intoapache:masterfrom
Gabriel39:dev_0227

Conversation

@Gabriel39
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Feb 27, 2026

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Gabriel39
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.33% (1796/2264)
Line Coverage 64.79% (32002/49393)
Region Coverage 65.52% (15975/24383)
Branch Coverage 55.96% (8488/15168)

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

TPC-H: Total hot run time: 28895 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit afda6283bd08dce1f47d0d09fb661e081f57807a, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17656	4514	4310	4310
q2	q3	10646	805	528	528
q4	4689	366	252	252
q5	7564	1225	1030	1030
q6	173	177	145	145
q7	793	862	669	669
q8	9289	1492	1363	1363
q9	4835	4750	4734	4734
q10	6790	1868	1643	1643
q11	469	259	243	243
q12	760	572	459	459
q13	17767	4260	3441	3441
q14	224	228	226	226
q15	942	809	801	801
q16	765	715	682	682
q17	735	880	434	434
q18	6554	5498	5195	5195
q19	1119	973	630	630
q20	513	497	389	389
q21	4467	2001	1468	1468
q22	383	307	253	253
Total cold run time: 97133 ms
Total hot run time: 28895 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4732	4600	4557	4557
q2	q3	1819	2238	1775	1775
q4	933	1205	822	822
q5	4091	4390	4335	4335
q6	188	170	140	140
q7	1794	1621	1521	1521
q8	2481	2910	2552	2552
q9	7593	7387	7523	7387
q10	2675	2824	2416	2416
q11	514	435	419	419
q12	514	581	445	445
q13	3981	4511	3574	3574
q14	291	292	289	289
q15	866	781	801	781
q16	731	741	698	698
q17	1169	1556	1344	1344
q18	7152	6676	6563	6563
q19	892	960	1112	960
q20	2068	2203	2006	2006
q21	4028	3493	3371	3371
q22	479	433	394	394
Total cold run time: 48991 ms
Total hot run time: 46349 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183986 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit afda6283bd08dce1f47d0d09fb661e081f57807a, data reload: false

query5	4708	630	519	519
query6	320	223	199	199
query7	4205	482	292	292
query8	341	253	241	241
query9	8732	2762	2746	2746
query10	517	371	345	345
query11	17066	17434	17280	17280
query12	208	137	131	131
query13	1327	509	353	353
query14	6723	3442	3082	3082
query14_1	2930	2944	2920	2920
query15	199	210	178	178
query16	976	503	398	398
query17	1564	756	617	617
query18	2697	427	333	333
query19	204	209	171	171
query20	134	122	128	122
query21	216	129	117	117
query22	5002	4913	4940	4913
query23	17254	16794	16648	16648
query23_1	16634	16733	16703	16703
query24	7222	1596	1221	1221
query24_1	1230	1230	1223	1223
query25	551	464	414	414
query26	1251	260	148	148
query27	2777	485	283	283
query28	4512	1874	1847	1847
query29	782	607	466	466
query30	320	244	208	208
query31	872	730	656	656
query32	78	71	77	71
query33	508	330	281	281
query34	920	899	581	581
query35	638	717	611	611
query36	1095	1144	969	969
query37	130	93	84	84
query38	2949	2927	2901	2901
query39	915	868	852	852
query39_1	831	816	833	816
query40	228	149	134	134
query41	63	59	57	57
query42	109	104	107	104
query43	373	372	348	348
query44	
query45	198	188	179	179
query46	891	987	607	607
query47	2139	2131	2075	2075
query48	306	309	222	222
query49	666	474	410	410
query50	694	281	217	217
query51	4115	4068	4055	4055
query52	107	106	96	96
query53	288	333	282	282
query54	320	269	249	249
query55	87	88	79	79
query56	313	298	321	298
query57	1384	1350	1274	1274
query58	292	270	272	270
query59	2573	2738	2543	2543
query60	336	331	322	322
query61	150	141	145	141
query62	622	599	538	538
query63	309	282	266	266
query64	4870	1251	973	973
query65	
query66	1396	457	369	369
query67	16488	16469	16265	16265
query68	
query69	396	300	279	279
query70	982	989	943	943
query71	334	303	294	294
query72	2911	2866	2561	2561
query73	545	550	326	326
query74	10035	9942	9779	9779
query75	2901	2758	2476	2476
query76	2304	1057	689	689
query77	361	399	334	334
query78	11241	11425	10756	10756
query79	3128	801	583	583
query80	1800	662	537	537
query81	567	283	242	242
query82	1010	147	118	118
query83	367	259	241	241
query84	258	125	103	103
query85	879	503	437	437
query86	438	331	289	289
query87	3080	3082	2939	2939
query88	3524	2643	2619	2619
query89	426	362	349	349
query90	1957	170	164	164
query91	168	156	132	132
query92	73	77	67	67
query93	1604	875	506	506
query94	643	298	267	267
query95	600	397	311	311
query96	643	522	227	227
query97	2459	2500	2431	2431
query98	230	222	216	216
query99	1017	985	918	918
Total cold run time: 257370 ms
Total hot run time: 183986 ms

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 19.01% (46/242) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.55% (19585/37272)
Line Coverage 36.18% (182919/505568)
Region Coverage 32.50% (141978/436871)
Branch Coverage 33.46% (61551/183955)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 67.77% (164/242) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.48% (26094/36505)
Line Coverage 54.25% (273466/504074)
Region Coverage 51.44% (226874/441047)
Branch Coverage 52.92% (97664/184547)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 67.77% (164/242) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.57% (26128/36505)
Line Coverage 54.33% (273872/504074)
Region Coverage 51.52% (227241/441047)
Branch Coverage 53.01% (97828/184547)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants