Skip to content

ci(publish): use tool versions for Node release runtime#199

Merged
Abhijeet Prasad (AbhiPrasad) merged 1 commit into
mainfrom
abhi-fix-npm-trusted-publishing-cli
Jun 9, 2026
Merged

ci(publish): use tool versions for Node release runtime#199
Abhijeet Prasad (AbhiPrasad) merged 1 commit into
mainfrom
abhi-fix-npm-trusted-publishing-cli

Conversation

@AbhiPrasad

Copy link
Copy Markdown
Member

Configure the JavaScript publish workflow to read Node from .tool-versions and add the same Node, npm, and pnpm tool versions used by the working braintrust-sdk-javascript publish flow.

The previous rerun cleared npm token environment variables correctly, but the GitHub runner's Node 22 image used npm 10.9.8 and failed trusted publishing with ENEEDAUTH. Moving the publish workflow to Node 24 gives it npm 11 support for GitHub OIDC trusted publishing without a one-off npm install step.

Configure the JavaScript publish workflow to read Node from .tool-versions and
add the same Node, npm, and pnpm tool versions used by the working
braintrust-sdk-javascript publish flow.

The previous rerun cleared npm token environment variables correctly, but the
GitHub runner's Node 22 image used npm 10.9.8 and failed trusted publishing with
ENEEDAUTH. Moving the publish workflow to Node 24 gives it npm 11 support for
GitHub OIDC trusted publishing without a one-off npm install step.
@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown

Braintrust eval report

Autoevals (HEAD-1781027834)

Score Average Improvements Regressions
NumericDiff 77.1% (-1pp) 4 🟢 8 🔴
Time_to_first_token 8.93tok (-0.2tok) 121 🟢 93 🔴
Llm_calls 1.55 (+0) 1 🟢 -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 528.42tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 478.25tok (+14.88tok) 89 🟢 109 🔴
Completion_reasoning_tokens 365.09tok (+13.4tok) 79 🟢 96 🔴
Completion_accepted_prediction_tokens 0tok (+0tok) - -
Completion_rejected_prediction_tokens 0tok (+0tok) - -
Completion_audio_tokens 0tok (+0tok) - -
Total_tokens 1006.68tok (+14.88tok) 89 🟢 109 🔴
Estimated_cost 0$ (+0$) 78 🟢 100 🔴
Duration 8.93s (-0.2s) 121 🟢 93 🔴
Llm_duration 9.63s (-0.22s) 120 🟢 93 🔴

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) merged commit b0500ed into main Jun 9, 2026
15 checks passed
@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown

Braintrust eval report

Autoevals (main-1781028032)

Score Average Improvements Regressions
NumericDiff 79.1% (+2pp) 10 🟢 3 🔴
Time_to_first_token 9.21tok (+0.28tok) 98 🟢 121 🔴
Llm_calls 1.55 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 528.42tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 474.19tok (-4.06tok) 107 🟢 102 🔴
Completion_reasoning_tokens 362.76tok (-2.33tok) 91 🟢 96 🔴
Completion_accepted_prediction_tokens 0tok (+0tok) - -
Completion_rejected_prediction_tokens 0tok (+0tok) - -
Completion_audio_tokens 0tok (+0tok) - -
Total_tokens 1002.61tok (-4.06tok) 107 🟢 102 🔴
Estimated_cost 0$ (0$) 92 🟢 93 🔴
Duration 9.21s (+0.28s) 98 🟢 121 🔴
Llm_duration 10s (+0.38s) 95 🟢 124 🔴

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants