List view

[native_datafusion] Enable native_datafusion in auto scan mode — test failure tracking

Status: Open.

#3321 In apache/datafusion-comet;

· andygrove opened on Jan 29, 2026

Remove mutable Parquet buffer use from native_iceberg_compat

enhancementNew feature or requestNew feature or request

Status: Open.

#2152 In apache/datafusion-comet;

· andygrove opened on Aug 14, 2025

Implement zero-copy FFI transfer of batches from JVM to Native

enhancementNew feature or requestNew feature or request

Status: Open.

#2171 In apache/datafusion-comet;

· andygrove opened on Aug 17, 2025

Fork DataFusion SMJ in Comet repo

enhancementNew feature or requestNew feature or request

Status: Open.

#3771 In apache/datafusion-comet;

· andygrove opened on Mar 23, 2026

[EPIC] Improve awslabs published results for Comet w/ TPC-DS

enhancementNew feature or requestNew feature or request

performance

Status: Open.

#3799 In apache/datafusion-comet;

· andygrove opened on Mar 26, 2026

AQE may materialize a non-supported Final-mode HashAggregate

area:aggregationHash aggregates, aggregate expressionsHash aggregates, aggregate expressions

bugSomething isn't workingSomething isn't working

priority:criticalData corruption, silent wrong results, security issuesData corruption, silent wrong results, security issues

Status: Open.

#1389 In apache/datafusion-comet;

· EmilyMatt opened on Feb 12, 2025

Mismatch in Data Types Between Partial and Final Stages in Aggregations

area:aggregationHash aggregates, aggregate expressionsHash aggregates, aggregate expressions

bugSomething isn't workingSomething isn't working

priority:criticalData corruption, silent wrong results, security issuesData corruption, silent wrong results, security issues

Status: Open.

#1287 In apache/datafusion-comet;

· andygrove opened on Jan 14, 2025

Dropping a GlobalRef in a detached thread

area:ffiArrow FFI / JNI boundaryArrow FFI / JNI boundary

bugSomething isn't workingSomething isn't working

priority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakage

Status: Open.

#2470 In apache/datafusion-comet;

· andygrove opened on Sep 26, 2025

ExecutionMemoryPool errors releasing more memory than allocated

bugSomething isn't workingSomething isn't working

priority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakage

Status: Open.

#2453 In apache/datafusion-comet;

· andygrove opened on Sep 25, 2025

Shuffle memory pool accounting: peak RSS significantly exceeds configured memory limit

area:shuffleShuffle (JVM and native)Shuffle (JVM and native)

Status: Open.

#3821 In apache/datafusion-comet;

· andygrove opened on Mar 27, 2026

Explore zero-copy batch coalescing during shuffle write

area:shuffleShuffle (JVM and native)Shuffle (JVM and native)

performance

Status: Open.

#3836 In apache/datafusion-comet;

· andygrove opened on Mar 29, 2026

Wrap in CoalesceBatchesExec more operators

enhancementNew feature or requestNew feature or request

Status: Open.

#2187 In apache/datafusion-comet;

· akupchinskiy opened on Aug 19, 2025

Experiment: immediate-mode shuffle

enhancementNew feature or requestNew feature or request

priority:lowMinor issues, test failures, tooling, cosmeticMinor issues, test failures, tooling, cosmetic

Status: Open.

#3855 In apache/datafusion-comet;

· andygrove opened on Mar 31, 2026

Spark cannot reclaim memory from native operators (spill callback returns 0)

performance

priority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakage

Status: Open.

#3873 In apache/datafusion-comet;

· andygrove opened on Apr 1, 2026

Current shuffle format has too much overhead with default batch size

area:shuffleShuffle (JVM and native)Shuffle (JVM and native)

bugSomething isn't workingSomething isn't working

performance

priority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakage

Status: Open.

#3882 In apache/datafusion-comet;

· andygrove opened on Apr 2, 2026

Comet 0.15.0 Release

enhancementNew feature or requestNew feature or request

Status: Open.

#3907 In apache/datafusion-comet;

· andygrove opened on Apr 8, 2026

Avoid FFI import/export when passing batches between two native plans

area:ffiArrow FFI / JNI boundaryArrow FFI / JNI boundary

area:shuffleShuffle (JVM and native)Shuffle (JVM and native)

enhancementNew feature or requestNew feature or request

performance

Status: Open.

#3925 In apache/datafusion-comet;

· andygrove opened on Apr 10, 2026