File tree 1 file changed +21
-2
lines changed 1 file changed +21
-2
lines changed Original file line number Diff line number Diff line change 2
2
3
3
## [ Upcoming]
4
4
5
- - Add changes for the upcoming release here
5
+ ### Models
6
+
7
+ - Added BigCode (#1506 )
8
+ - Added GPT-4 (#1457 )
9
+ - Added OPT 1.3B and 6.7B (#1468 )
10
+
11
+ ### Scenarios
12
+
13
+ - Added legal summarization scenarios (#1454 )
14
+ - Fixed corner cases in window service truncation (#1449 )
15
+ - Pinned file order for ICE, APPS (code) and ICE scenarios (#1352 )
16
+ - Fixed random seed for entity matching scenario (#1475 )
17
+
18
+ ### Metrics
19
+
20
+ - Fixed bug in multi-choice exact match calculation when scores are tied (#1494 )
21
+
22
+ ### Framework
23
+
24
+ - Added script for estimating the cost of a run suite (#1480 )
25
+ - Added support for human critique evaluation using Surge AI (#1330 )
6
26
7
27
## [ v0.2.2] - 2023-03-30
8
28
40
60
### Models
41
61
42
62
- Added BigCode SantaCoder (#1312 )
43
- - Added OPT-IML, Cohere Command, CodeGeeX (#1331 )
44
63
45
64
### Scenarios
46
65
You can’t perform that action at this time.
0 commit comments