-
Notifications
You must be signed in to change notification settings - Fork 652
FEAT: Adding TargetIdentifier
#1336
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
ValbuenaVC
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Minor comments, overall looks great!
rlundeen2
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great!
Can you make sure to run pytest .\tests\integration\memory\
And the Scorer Evals notebooks to make sure everything looks like it's working?
Description
This PR adds a
TargetIdentifierclasses and refactors the building of target identifiers across all prompt targets and now includestarget_specific_paramsas well as other granular identifying parameters. This follows the pattern ofScorerIdentifierandConverterIdentifierclasses.All classes that reference target identifiers now use the object and print a deprecation method if dict is used via the
normalizemethod inidentifier.py.Misc:
Tests and Documentation
Added and ran unit tests