Skip to content

[SPARK-55876][SQL] Add query statistics summary bar to SQL tab#56090

Open
XdithyX wants to merge 1 commit into
apache:masterfrom
XdithyX:SPARK-55876
Open

[SPARK-55876][SQL] Add query statistics summary bar to SQL tab#56090
XdithyX wants to merge 1 commit into
apache:masterfrom
XdithyX:SPARK-55876

Conversation

@XdithyX
Copy link
Copy Markdown
Contributor

@XdithyX XdithyX commented May 24, 2026

What changes were proposed in this pull request?

This PR adds a SQL workload summary table at the top of the SQL tab (SPARK-55876).

The summary is returned as part of the existing SQL table REST response and rendered above the SQL executions table. The UI follows the existing Spark UI table pattern used by the Executors page: the summary is rendered as a compact DataTable with paging, searching, ordering, and info disabled.

The summary contains the following fields:

  • Total Queries: total number of SQL executions known to the SQL status store.
  • Average Duration: average duration across SQL executions. Completed and failed executions use their final duration. Running executions use their current elapsed duration, consistent with how the SQL executions table displays duration.
  • Running Queries: number of SQL executions whose current status is RUNNING.
  • Failed Queries: number of SQL executions whose current status is FAILED.
  • Failure Rate: failed queries divided by total queries, displayed as a percentage. When there are no queries, this is displayed as 0.0%.

The SQL executions table remains unchanged functionally.

Why are the changes needed?

The SQL tab currently requires users to inspect the full executions table to understand the overall SQL workload state.

Adding a summary table provides an at-a-glance view of SQL workload health, including total query volume, average duration, currently running queries, and failure rate.

Does this PR introduce any user-facing change?

Yes.

The SQL / DataFrame tab now shows a Summary table above the SQL Executions table. The existing SQL executions table and status filter continue to work as before.

How was this patch tested?

Ran:

  • build/sbt 'sql/testOnly org.apache.spark.status.api.v1.sql.SqlResourceWithActualMetricsSuite'
  • build/sbt 'sql/testOnly org.apache.spark.sql.execution.ui.AllExecutionsPageWithInMemoryStoreSuite'

Was this patch authored or co-authored using generative AI tooling?

Generated-by: OpenAI Codex GPT 5.5

Before

before

After

Screenshot 2026-05-24 at 6 37 52 PM

@XdithyX
Copy link
Copy Markdown
Contributor Author

XdithyX commented May 24, 2026

Hi @yaooqinn @sarutak, could you please have a look when you get a chance? I’d appreciate your feedback on whether the summary bar aligns with what you had in mind for SPARK-55876.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant