Skip to content

DPL Analysis: use Input/OutputSpec metadata to detect special tables instead of origins#15213

Open
aalkin wants to merge 1 commit intoAliceO2Group:devfrom
aalkin:metadata-instead-of-origin
Open

DPL Analysis: use Input/OutputSpec metadata to detect special tables instead of origins#15213
aalkin wants to merge 1 commit intoAliceO2Group:devfrom
aalkin:metadata-instead-of-origin

Conversation

@aalkin
Copy link
Copy Markdown
Member

@aalkin aalkin commented Mar 25, 2026

  • Populate OutputSpec for spawned or index table with corresponding metadata, similar to the one present in InputSpec for the same table
  • Use the presence of these metadata entries to form the inputs list for the aod-spawner and index-builder

Previously, special origins DYN/IDX were used to identify spawned and index tables. With embedding in mind, we will need to distinguish between the spawned and index tables coming from different file sources, meaning we can no longer rely on origins. This change moves the logic to metadata inspection, that permits us to free the origins for their original purpose - determining the source of data.

@aalkin aalkin requested a review from a team as a code owner March 25, 2026 11:51
@github-actions
Copy link
Copy Markdown
Contributor

REQUEST FOR PRODUCTION RELEASES:
To request your PR to be included in production software, please add the corresponding labels called "async-" to your PR. Add the labels directly (if you have the permissions) or add a comment of the form (note that labels are separated by a ",")

+async-label <label1>, <label2>, !<label3> ...

This will add <label1> and <label2> and removes <label3>.

The following labels are available
async-2023-pbpb-apass4
async-2023-pp-apass4
async-2024-pp-apass1
async-2022-pp-apass7
async-2024-pp-cpass0
async-2024-PbPb-apass1
async-2024-ppRef-apass1
async-2024-PbPb-apass2
async-2023-PbPb-apass5

@aalkin aalkin force-pushed the metadata-instead-of-origin branch from fa96f06 to a27eaf1 Compare March 25, 2026 11:54
@alibuild
Copy link
Copy Markdown
Collaborator

alibuild commented Mar 31, 2026

Error while checking build/O2/fullCI_slc9 for a27eaf1 at 2026-04-10 02:15:

## sw/BUILD/O2-full-system-test-latest/log
command o2-sim --field=ccdb -j 24 --run 310000 -n 5 -g pythia8pp -e TGeant4 -o sig --configKeyValues GeneratorPythia8.config=/sw/slc9_x86-64/O2/slc9_x86-64-slc9_x86-64-local11/prodtests/full-system-test/pythia8.cfg --embedIntoFile o2sim_MCHeader.root had nonzero exit code 1
[ERROR] SHUTTING DOWN DUE TO SIGNALED EXIT IN COMPONENT 2724
[02:14:36][ERROR] CCDBDownloader CURL transfer error - Timeout was reached
[02:14:36][ERROR] CcdbDownloader finished transfer http://alice-ccdb.cern.ch/Users/m/mgiacalo/WGAN_ExtGenPair for 1775780071280 (agent_id: o2-sim-primary-/o2-sim-primary-server-device-runner@2687 target/Linux_x86_64 init/1775780070320 id/mesosci@alimetal05.cern.ch session/NZRKbH67) with http code: 0
[02:14:36][ERROR] File Users/m/mgiacalo/WGAN_ExtGenPair could not be retrieved. No more hosts to try.
[02:14:36][ERROR] Unable to find object Users/m/mgiacalo/WGAN_ExtGenPair/1775780071280, Aborting
[02:14:36][FATAL] Error: issues in retrieving Users/m/mgiacalo/WGAN_ExtGenPair from CCDB!
[02:15:37][ERROR] No configuration received within 60000ms
[02:15:38][ERROR] Could not initialize simulation


## sw/BUILD/o2checkcode-latest/log
--
========== List of errors found ==========
++ GRERR=0
++ grep -v clang-diagnostic-error error-log.txt
++ grep ' error:'
grep: error-log.txt: binary file matches
++ GRERR=1
++ [[ 1 == 0 ]]
++ mkdir -p /sw/INSTALLROOT/bddf314dccac6eb43b582653d7203d7778bde1ce/slc9_x86-64/o2checkcode/1.0-local53/etc/modulefiles
++ cat
--

Full log here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants