Skip to content

DM-54879: Add --retry-missing-outputs-for for when upstream outputs are selectively retained#363

Open
hsinfang wants to merge 2 commits into
mainfrom
tickets/DM-54879
Open

DM-54879: Add --retry-missing-outputs-for for when upstream outputs are selectively retained#363
hsinfang wants to merge 2 commits into
mainfrom
tickets/DM-54879

Conversation

@hsinfang

@hsinfang hsinfang commented May 12, 2026

Copy link
Copy Markdown
Contributor

Checklist

  • ran Jenkins
  • added a release note for user-visible changes to doc/changes

@codecov

codecov Bot commented May 12, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 94.91525% with 3 lines in your changes missing coverage. Please review.
✅ Project coverage is 86.24%. Comparing base (e1dbdc4) to head (6e59a82).
✅ All tests successful. No failed tests found.

Files with missing lines Patch % Lines
python/lsst/ctrl/mpexec/cli/script/qgraph.py 71.42% 1 Missing and 1 partial ⚠️
tests/test_run.py 98.03% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #363      +/-   ##
==========================================
+ Coverage   86.04%   86.24%   +0.19%     
==========================================
  Files          44       44              
  Lines        2565     2624      +59     
  Branches      267      270       +3     
==========================================
+ Hits         2207     2263      +56     
- Misses        256      257       +1     
- Partials      102      104       +2     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

@hsinfang hsinfang force-pushed the tickets/DM-54879 branch 2 times, most recently from 5f0c018 to 4a242aa Compare May 13, 2026 17:16
@hsinfang hsinfang force-pushed the tickets/DM-54879 branch from 4a242aa to 0b65260 Compare May 28, 2026 23:41
@hsinfang

Copy link
Copy Markdown
Contributor Author

ignore_metadata_for is renamed to retry_missing_outputs_for

@hsinfang hsinfang changed the title DM-54879: Add --ignore-existing-metadata-for for when upstream outputs are selectively retained DM-54879: Add --retry-missing-outputs-for for when upstream outputs are selectively retained May 28, 2026
@hsinfang hsinfang force-pushed the tickets/DM-54879 branch 2 times, most recently from 8483f76 to 24bb217 Compare June 9, 2026 18:43
hsinfang added 2 commits June 11, 2026 15:58
Expose the retained_dataset_types parameter of QuantumGraphBuilder as a CLI
option.  Accept a path to a YAML file listing dataset type names or glob-style
wildcard patterns for types that are expected to be present in
--skip-existing-in when the producing task ran successfully.  Has no effect
without --skip-existing-in.

script/run.py is not modified because commands.run passes all Click options as
**kwargs to both script.qgraph (which consumes the new option at graph-build
time) and script.run (which absorbs unrecognized kwargs, like the existing
dataset_query_constraint).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants