Skip to content

increase performance another 10-15% - #356

Merged
Byron merged 2 commits into
mainfrom
performance
Aug 1, 2026
Merged

increase performance another 10-15%#356
Byron merged 2 commits into
mainfrom
performance

Conversation

@Byron

@Byron Byron commented Jul 31, 2026

Copy link
Copy Markdown
Owner

Turn completion-order metadata reads into small stealable jobs so directory enumeration and stat calls overlap across the worker pool. Use LIFO local queues and idle-aware relay waking to increase useful parallelism without a shared wake lock. Keep parent-first traversal on the existing batched path and cover wide-tree worker participation with a regression test.

@Byron
Byron force-pushed the performance branch 2 times, most recently from b103597 to 2feabd1 Compare August 1, 2026 09:19
<!-- agent -->
Track whether aggregate progress has actually been rendered before clearing the
terminal line. Keep sorted multi-root progress visible until final output, while
clearing before immediate unsorted results, and cover fast roots that previously
emitted repeated invisible erase sequences.

Assisted-by: GPT 5.6
Co-authored-by: GPT 5.6 <codex@openai.com>
<!-- agent -->
Split completion-order directory entries into small stealable metadata jobs
and use idle-aware relay waking with LIFO local queues. Submit all top-level
roots to the same worker pool, carrying a root index through descendant jobs and
result batches so aggregate and interactive traversal retain per-root accounting
without serial barriers.

Also, track pending work per root and emit completion events after all of a
root's batches are delivered. Flush the longest completed input-order prefix so
--no-sort prints results immediately without serializing the shared worker pool.

Assisted-by: GPT 5.6
Co-authored-by: GPT 5.6 <codex@openai.com>
@Byron
Byron marked this pull request as ready for review August 1, 2026 16:22
@Byron
Byron merged commit fea714d into main Aug 1, 2026
2 checks passed

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 4dba3ad3ac

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/aggregate.rs
Comment thread src/traverse.rs
Comment thread src/aggregate.rs
@Byron
Byron deleted the performance branch August 1, 2026 16:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant