Skip to content

Lazy-mode for loading Sortinganalyzer#4623

Open
alejoe91 wants to merge 10 commits into
SpikeInterface:mainfrom
alejoe91:lazy-extensions
Open

Lazy-mode for loading Sortinganalyzer#4623
alejoe91 wants to merge 10 commits into
SpikeInterface:mainfrom
alejoe91:lazy-extensions

Conversation

@alejoe91

@alejoe91 alejoe91 commented Jun 22, 2026

Copy link
Copy Markdown
Member

The SortingAnalyzer, especially for chronic data, can be very memory hungry. This PR adds a lazy mode at load that:

  • Reads the spike vector in lazy mode (memmaps memory folder, virtual memmap for zarr - TODO)
  • Reads vector-extensions as memmaps or keeps them as zarr array
  • Implements a memmap-like ZarrSpikeVector

NOTE: in lazy mode, save/select/merge/split operations are not permitted!

@alejoe91 alejoe91 added core Changes to core module performance Performance issues/improvements labels Jun 22, 2026
Comment thread src/spikeinterface/core/sortingfolder.py
@alejoe91 alejoe91 marked this pull request as ready for review June 24, 2026 15:19
@alejoe91 alejoe91 requested a review from samuelgarcia June 24, 2026 15:23
@alejoe91 alejoe91 added this to the 0.105.0 milestone Jul 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Changes to core module performance Performance issues/improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants