Skip to content

Expand Gemini eval coverage#52

Merged
HarshCasper merged 1 commit into
mainfrom
eval-tests
Jul 4, 2026
Merged

Expand Gemini eval coverage#52
HarshCasper merged 1 commit into
mainfrom
eval-tests

Conversation

@HarshCasper

@HarshCasper HarshCasper commented Jul 4, 2026

Copy link
Copy Markdown
Member

Summary

  • Expands the Gemini comprehensive MCP eval dataset from broad discovery prompts into explicit tool scenarios with argument expectations.
  • Updates eval runtime and failure logging so long-running cases have enough time and failures include full case details.

Add broader Gemini-hosted MCP scenarios with explicit tool expectations and richer failure output so eval regressions are easier to diagnose.
@HarshCasper HarshCasper merged commit 6617f94 into main Jul 4, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant