Skip to content

ci(publish): clear npm tokens for trusted publishing#198

Merged
Abhijeet Prasad (AbhiPrasad) merged 1 commit into
mainfrom
abhi-fix-npm-trusted-publishing-token
Jun 9, 2026
Merged

ci(publish): clear npm tokens for trusted publishing#198
Abhijeet Prasad (AbhiPrasad) merged 1 commit into
mainfrom
abhi-fix-npm-trusted-publishing-token

Conversation

@AbhiPrasad

Copy link
Copy Markdown
Member

Clear NODE_AUTH_TOKEN and NPM_TOKEN on the npm publish steps so npm uses GitHub OIDC trusted publishing instead of an injected token from setup-node.

The failed autoevals@0.3.0 release had a NODE_AUTH_TOKEN present during npm publish, which caused npm to attempt token-based publishing and return a misleading 404 for the package. This mirrors the working publish setup in braintrust-sdk-javascript while preserving provenance publishing for both stable and prerelease releases.

Clear NODE_AUTH_TOKEN and NPM_TOKEN on the npm publish steps so npm uses
GitHub OIDC trusted publishing instead of an injected token from setup-node.

The failed autoevals@0.3.0 release had a NODE_AUTH_TOKEN present during
npm publish, which caused npm to attempt token-based publishing and return a
misleading 404 for the package. This mirrors the working publish setup in
braintrust-sdk-javascript while preserving provenance publishing for both stable
and prerelease releases.
@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown

Braintrust eval report

Autoevals (HEAD-1781027049)

Score Average Improvements Regressions
NumericDiff 77.4% (-1pp) 8 🟢 15 🔴
Time_to_first_token 9.83tok (-0.57tok) 128 🟢 90 🔴
Llm_calls 1.55 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - 1 🔴
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 524.36tok (-4.06tok) 1 🟢 -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 473.15tok (-4.84tok) 112 🟢 96 🔴
Completion_reasoning_tokens 360.73tok (-4.36tok) 100 🟢 90 🔴
Completion_accepted_prediction_tokens 0tok (+0tok) - -
Completion_rejected_prediction_tokens 0tok (+0tok) - -
Completion_audio_tokens 0tok (+0tok) - -
Total_tokens 997.51tok (-8.9tok) 112 🟢 96 🔴
Estimated_cost 0$ (0$) 102 🟢 91 🔴
Duration 9.81s (-0.59s) 129 🟢 90 🔴
Llm_duration 10.52s (-0.59s) 129 🟢 90 🔴

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) merged commit 8eb18c2 into main Jun 9, 2026
15 checks passed
@AbhiPrasad Abhijeet Prasad (AbhiPrasad) deleted the abhi-fix-npm-trusted-publishing-token branch June 9, 2026 17:48
@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown

Braintrust eval report

Autoevals (main-1781027291)

Score Average Improvements Regressions
NumericDiff 78.5% (+1pp) 11 🟢 9 🔴
Time_to_first_token 9.12tok (-0.74tok) 121 🟢 92 🔴
Llm_calls 1.52 (0) - 1 🔴
Tool_calls 0 (+0) - -
Errors 0 (0) 1 🟢 -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 528.42tok (+4.16tok) - 1 🔴
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 462.59tok (-14.31tok) 106 🟢 96 🔴
Completion_reasoning_tokens 350.84tok (-13.1tok) 93 🟢 84 🔴
Completion_accepted_prediction_tokens 0tok (+0tok) - -
Completion_rejected_prediction_tokens 0tok (+0tok) - -
Completion_audio_tokens 0tok (+0tok) - -
Total_tokens 991.01tok (-10.15tok) 106 🟢 96 🔴
Estimated_cost 0$ (0$) 95 🟢 83 🔴
Duration 9.16s (-0.72s) 121 🟢 93 🔴
Llm_duration 9.89s (-0.71s) 119 🟢 94 🔴

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants