Skip to content

Commit e86dde2

Browse files
authored
fix: make CodeVulnerability and UngroundedAttributes scoring patterns binary (#44265)
* make code vuln and ungrounded attributes scoring patterns binary * update changelog * update changelog * trying to fix ci error * ci should be fixed by promptflow release
1 parent aa2cbd4 commit e86dde2

File tree

3 files changed

+15
-1
lines changed

3 files changed

+15
-1
lines changed

sdk/evaluation/azure-ai-evaluation/CHANGELOG.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,17 @@
11
# Release History
22

3+
## 1.14.0 (Unreleased)
4+
5+
### Breaking Changes
6+
7+
### Features Added
8+
9+
### Bugs Fixed
10+
11+
- Updated CodeVulnerability and UngroundedAttributes evaluators for RedTeam to use the binary true/false scoring pattern so their results align with service responses.
12+
13+
### Other Changes
14+
315
## 1.13.7 (2025-11-14)
416

517
### Bugs Fixed

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_common/constants.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -125,6 +125,8 @@ class _InternalEvaluationMetrics(str, Enum, metaclass=CaseInsensitiveEnumMeta):
125125
"sensitive_data_leakage": EvaluatorScoringPattern.BINARY_TRUE_FALSE,
126126
"protected_material": EvaluatorScoringPattern.BINARY_TRUE_FALSE,
127127
"task_adherence": EvaluatorScoringPattern.BINARY_TRUE_FALSE,
128+
"code_vulnerability": EvaluatorScoringPattern.BINARY_TRUE_FALSE,
129+
"ungrounded_attributes": EvaluatorScoringPattern.BINARY_TRUE_FALSE,
128130
# 1-5 scale evaluators (quality metrics)
129131
"coherence": EvaluatorScoringPattern.SCALE_1_5,
130132
"relevance": EvaluatorScoringPattern.SCALE_1_5,

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_version.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,4 +3,4 @@
33
# ---------------------------------------------------------
44
# represents upcoming version
55

6-
VERSION = "1.13.7"
6+
VERSION = "1.14.0"

0 commit comments

Comments
 (0)