Skip to content

Commit b86f9ec

Browse files
authored
Update CHANGELOG (stanford-crfm#1509)
1 parent c3471e5 commit b86f9ec

File tree

1 file changed

+21
-2
lines changed

1 file changed

+21
-2
lines changed

CHANGELOG.md

Lines changed: 21 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,27 @@
22

33
## [Upcoming]
44

5-
- Add changes for the upcoming release here
5+
### Models
6+
7+
- Added BigCode (#1506)
8+
- Added GPT-4 (#1457)
9+
- Added OPT 1.3B and 6.7B (#1468)
10+
11+
### Scenarios
12+
13+
- Added legal summarization scenarios (#1454)
14+
- Fixed corner cases in window service truncation (#1449)
15+
- Pinned file order for ICE, APPS (code) and ICE scenarios (#1352)
16+
- Fixed random seed for entity matching scenario (#1475)
17+
18+
### Metrics
19+
20+
- Fixed bug in multi-choice exact match calculation when scores are tied (#1494)
21+
22+
### Framework
23+
24+
- Added script for estimating the cost of a run suite (#1480)
25+
- Added support for human critique evaluation using Surge AI (#1330)
626

727
## [v0.2.2] - 2023-03-30
828

@@ -40,7 +60,6 @@
4060
### Models
4161

4262
- Added BigCode SantaCoder (#1312)
43-
- Added OPT-IML, Cohere Command, CodeGeeX (#1331)
4463

4564
### Scenarios
4665

0 commit comments

Comments
 (0)