Feature Request / Improvement
Currently SnapshotChanges only provides a caching interface that eagerly materializes all file changes into in-memory lists and returns Iterable. There are use cases where returning a streaming CloseableIterable would be preferable see #13556 for example.
I think we probably should just add CloseableIterable interfaces to SnapshotChanges as well and just have the caching calls wrap them.
Query engine
None
Willingness to contribute
Feature Request / Improvement
Currently
SnapshotChangesonly provides a caching interface that eagerly materializes all file changes into in-memory lists and returnsIterable. There are use cases where returning a streamingCloseableIterablewould be preferable see #13556 for example.I think we probably should just add CloseableIterable interfaces to SnapshotChanges as well and just have the caching calls wrap them.
Query engine
None
Willingness to contribute