Skip to content

Pull requests: IBM/unitxt

New pull request New
29 Open 1,418 Closed
29 Open 1,418 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Text2sql metrics update and optional caching
#1672 opened Mar 11, 2025 by oktie Loading…
Granite guardian: add raw prompt to the result
#1671 opened Mar 11, 2025 by martinscooper Loading…
LLM Judge: add prompts to the result by default
#1670 opened Mar 11, 2025 by martinscooper Loading…
Return float instead float32 in granite guardian metric
#1669 opened Mar 11, 2025 by martinscooper Loading…
Safety eval updates
#1668 opened Mar 11, 2025 by bnayahu • Draft
Test branch to evaluate impact of different format
#1667 opened Mar 10, 2025 by yoavkatz • Draft
Support for asynchronous requests for watsonx.ai chat
#1666 opened Mar 10, 2025 by pawelknes Loading…
@pawelknes
3
Let evaluator name to be a string
#1665 opened Mar 10, 2025 by martinscooper Loading…
BugFix: Use dumping of task data and source only when dumping
#1661 opened Mar 9, 2025 by elronbandel Loading…
1
BugFix: Handle cases where all sample scores are the same (yields nan)
#1660 opened Mar 9, 2025 by elronbandel Loading…
1
2
Add docstring to LLMJudge classes
#1652 opened Mar 6, 2025 by martinscooper Loading…
@elronbandel @yoavkatz
Add inference engine caching
#1645 opened Mar 4, 2025 by eladven Loading…
6
Use elaborated cache key and use it for filelock semaphore
#1644 opened Mar 4, 2025 by elronbandel Loading…
7
Allow preformance to also report based on time() diffs, rather than only cProfile
#1642 opened Mar 2, 2025 by dafnapension Loading…
Add positional bias summary to the response
#1640 opened Feb 28, 2025 by martinscooper Loading…
Add batch size control to Huggingface pipeline based inference engine
#1636 opened Feb 27, 2025 by elronbandel Loading…
Added example of multi-choice QA
#1634 opened Feb 26, 2025 by yoavkatz Loading…
Add prediction variable name customization to LLM as Judge
#1622 opened Feb 21, 2025 by martinscooper Loading…
4
Add breakpoint to every unitxt catalog asset at its core logic
#1595 opened Feb 11, 2025 by elronbandel • Draft
Add download data count
#1592 opened Feb 10, 2025 by elronbandel Loading…
Add Multi Turn Metrics Support
#1579 opened Feb 5, 2025 by elronbandel • Draft
Try re-using huggingface cache in GitHub Actions
#1571 opened Feb 3, 2025 by elronbandel Loading…
Add text2sql blog post
#1558 opened Jan 27, 2025 by perlitz • Draft
3
Add documentation for Settings and Constants management
#1521 opened Jan 19, 2025 by elronbandel Loading…
1
20
Remove IBM GenAI support and moved legacy GenAI metrics to use CrossProviderInferenceEngine
#1508 opened Jan 13, 2025 by yoavkatz Loading…
2
ProTip! no:milestone will show everything without a milestone.