Skip to content

fix: Limit all extra to production dependencies#196

Merged
Abhijeet Prasad (AbhiPrasad) merged 1 commit into
mainfrom
abhi-chore-prod-all-extra-deps
Jun 8, 2026
Merged

fix: Limit all extra to production dependencies#196
Abhijeet Prasad (AbhiPrasad) merged 1 commit into
mainfrom
abhi-chore-prod-all-extra-deps

Conversation

@AbhiPrasad

Copy link
Copy Markdown
Member

Summary

  • change autoevals[all] to include only the production scipy extra
  • keep litellm installable explicitly via autoevals[litellm]
  • refresh uv.lock

Testing

  • uv lock
  • pre-commit hooks during commit

@github-actions

github-actions Bot commented Jun 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Autoevals (HEAD-1780946721)

Score Average Improvements Regressions
NumericDiff 77.4% (-2pp) 6 🟢 7 🔴
Time_to_first_token 9.76tok (+0.81tok) 45 🟢 74 🔴
Llm_calls 1.09 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 317.7tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 241.12tok (-8.1tok) 62 🟢 41 🔴
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 558.82tok (-8.1tok) 62 🟢 41 🔴
Estimated_cost 0$ (0$) 58 🟢 40 🔴
Duration 12s (+2.56s) 54 🟢 165 🔴
Llm_duration 11.17s (+0.63s) 51 🟢 68 🔴

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) changed the title Limit all extra to production dependencies fix: Limit all extra to production dependencies Jun 8, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

stamp

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) merged commit 74aafa3 into main Jun 8, 2026
12 checks passed
@github-actions

github-actions Bot commented Jun 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Autoevals (main-1780947411)

Score Average Improvements Regressions
NumericDiff 78.6% (+1pp) 11 🟢 9 🔴
Time_to_first_token 9.66tok (-0.09tok) 62 🟢 57 🔴
Llm_calls 1.09 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 317.7tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 239.51tok (-1.6tok) 48 🟢 54 🔴
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 557.21tok (-1.6tok) 48 🟢 54 🔴
Estimated_cost 0$ (0$) 43 🟢 53 🔴
Duration 10.18s (-1.82s) 151 🟢 68 🔴
Llm_duration 11.01s (-0.16s) 64 🟢 55 🔴

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants