Skip to content

Commit 9f4dcdb

Browse files
committed
added readme for SEMANTICS data
1 parent 6fe2fbc commit 9f4dcdb

File tree

1 file changed

+8
-0
lines changed
  • 2023-Semantics_Developing-Scalable-Benchmark-for-LLM-KGE

1 file changed

+8
-0
lines changed
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
# Results of LLM-KG-Bench runs SEMANTICS 2023 poster track
2+
3+
Results and log of [LLM-KG-Bench](https://github.com/AKSW/LLM-KG-Bench) runs described in article "Developing a Scalable Benchmark for Assessing Large Language Models in Knowledge Graph Engineering", Meyer et al., to appear in [SEMANTICS 2023 poster track](https://2023-eu.semantics.cc/page/accepted_posters) proceedings.
4+
5+
We collected data in multiple runs, each resulting in files with date and time of experiment start in filename:
6+
* result files (`.json`, `.txt`, `.yaml`, same info in different serializations) containing task, response and evaluation data
7+
* model log files (`.jsonnl` in directory `modelLog`) containing details on LLM interaction
8+
* full log files (`.log` in directory `log`) containing debug log for runs

0 commit comments

Comments
 (0)