Skip to content

Commit 17d1938

Browse files
authored
added result files
1 parent 0ee7489 commit 17d1938

File tree

91 files changed

+460844
-59881
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

91 files changed

+460844
-59881
lines changed

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-02_22-31-31_TurtleError-20x.json

+3,522
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_12-40-34-FactExtract.json

+922
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_12-40-34.txt

+5,218
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_12-40-34.yaml

+2,879
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_13-37-59-FactExtract.json

+922
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_13-37-59.txt

+6,580
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_13-37-59.yaml

+3,903
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_13-53-48-FactExtract.json

+922
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_13-53-48.txt

+5,423
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_13-53-48.yaml

+3,069
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_18-12-03_generation-gpt3-10to80-5x_error-1x70.json

+1,211
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_18-27-18_generation-gpt4-10to80-5x.json

+1,242
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-03_18-32-16_generation-claude100k-10to80-5x.json

+1,242
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-04_07-57-39.txt

+18,137
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-04_07-57-39.yaml

+13,747
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-04_07-57-39_generation-gpt3-10to80-15x.json

+3,722
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-04_10-02-37_generation-claude100k-10to80-15x.json

+3,722
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-04_10-03-06_generation-gpt4-10to80-15x.json

+3,722
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-18_10-31-37.yaml

-10,246
This file was deleted.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-18_10-31-37_FriendCount-gpt35-claude-5x.json

-2,732
This file was deleted.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-19_12-27-33.yaml

-10,246
This file was deleted.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-19_12-27-33_FriendCount-gpt4-claude-5x.json

-2,732
This file was deleted.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-26_13-25-51-FactExtract-claude2.json

+922
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-26_13-25-51.txt

+5,815
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-26_13-25-51.yaml

+3,309
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-26_13-59-53.txt

+4,485
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-26_13-59-53.yaml

+2,998
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-26_13-59-53_TurtleError-claude2.json

+882
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-19_12-27-33.txt 2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_13-26-37.txt

+21,584-15,104
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_13-26-37.yaml

+14,921
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_13-26-37_FriendCount-claude100k.json

+6,402
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-18_10-31-37.txt 2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_13-45-55.txt

+21,696-15,230
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_13-45-55.yaml

+14,921
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_13-45-55_FriendCount-claude2.json

+6,402
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-06-21.txt

+1,575
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-06-21.yaml

+1,221
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-06-21_ConnectionExplanation-claude100k.json

+942
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-22_14-24-11.txt 2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-08-57.txt

+240-515
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-22_14-24-11.yaml 2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-08-57.yaml

+275-449
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-22_14-24-11_ConnectionExplanation-5x.json 2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-08-57_ConnectionExplanation-claude2.json

+238-373
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-27-19.txt

+1,580
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-27-19.yaml

+1,341
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-27-19_ConnectionExplanation-gpt35.json

+942
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-29-22.txt

+1,597
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-29-22.yaml

+1,375
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-29-22_ConnectionExplanation-gpt4.json

+942
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-45-01.txt

+31,559
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-45-01.yaml

+14,807
Large diffs are not rendered by default.

2023-DL4KG_Automated-Tests-with-LLM-KGE-Bench/llm-kg-bench-results_2023-07-27_17-45-01_FriendCount-gpt35-1kTo8k-2xErr2k.json

+6,322
Large diffs are not rendered by default.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,198 @@
1+
TaskExecInfo(startTime=datetime.datetime(2023, 7, 27, 17, 52, 19, 995099),
2+
modelId='GPT--gpt-3.5-turbo--gpt-3.5-turbo-0613',
3+
taskInfo=TaskInfo(taskId='TurtleFriendCount',
4+
version='2.0',
5+
gitCommit='dd716f229c6d9c627544a513aa00d953882a1f45'),
6+
scores={'brevity': 0.5512820512820513,
7+
'f1': 1.0,
8+
'noSpecialFriends': 1.0,
9+
'precision': 1.0,
10+
'recall': 1},
11+
info={'answerPersonCount': 1,
12+
'graphSizeChar': 1773,
13+
'persons': 16,
14+
'personsInAnswer': ['4'],
15+
'specialFriendsInAnswer': 0,
16+
'specialNode': 'http://example.org/people/person-00000004',
17+
'triples': 51},
18+
duration=datetime.timedelta(seconds=1, microseconds=221846),
19+
interactions=[('prompt',
20+
datetime.datetime(2023, 7, 27, 17, 52, 19, 995104),
21+
'Please name the person which is known by the most '
22+
'persons according to the following RDF graph in '
23+
'turtle syntax. Give just the IRI of this person '
24+
'with most incomming links as answer, without '
25+
'abbreviation or explanation.@prefix ex: '
26+
'<http://example.org/people/> .\n'
27+
'@prefix foaf: <http://xmlns.com/foaf/0.1/> .\n'
28+
'\n'
29+
'ex:person-00000001 a foaf:Person ;\n'
30+
' foaf:knows ex:person-00000002,\n'
31+
' ex:person-00000003 .\n'
32+
'\n'
33+
'ex:person-00000002 a foaf:Person ;\n'
34+
' foaf:knows ex:person-00000003,\n'
35+
' ex:person-00000004 .\n'
36+
'\n'
37+
'ex:person-00000003 a foaf:Person ;\n'
38+
' foaf:knows ex:person-00000004,\n'
39+
' ex:person-00000005 .\n'
40+
'\n'
41+
'ex:person-00000005 a foaf:Person ;\n'
42+
' foaf:knows ex:person-00000006,\n'
43+
' ex:person-00000007 .\n'
44+
'\n'
45+
'ex:person-00000006 a foaf:Person ;\n'
46+
' foaf:knows ex:person-00000007,\n'
47+
' ex:person-00000008 .\n'
48+
'\n'
49+
'ex:person-00000007 a foaf:Person ;\n'
50+
' foaf:knows ex:person-00000004,\n'
51+
' ex:person-00000008,\n'
52+
' ex:person-00000009 .\n'
53+
'\n'
54+
'ex:person-00000008 a foaf:Person ;\n'
55+
' foaf:knows ex:person-00000004,\n'
56+
' ex:person-00000009,\n'
57+
' ex:person-0000000a .\n'
58+
'\n'
59+
'ex:person-00000009 a foaf:Person ;\n'
60+
' foaf:knows ex:person-00000004,\n'
61+
' ex:person-0000000a,\n'
62+
' ex:person-0000000b .\n'
63+
'\n'
64+
'ex:person-0000000a a foaf:Person ;\n'
65+
' foaf:knows ex:person-0000000b,\n'
66+
' ex:person-0000000c .\n'
67+
'\n'
68+
'ex:person-0000000b a foaf:Person ;\n'
69+
' foaf:knows ex:person-0000000c,\n'
70+
' ex:person-0000000d .\n'
71+
'\n'
72+
'ex:person-0000000c a foaf:Person ;\n'
73+
' foaf:knows ex:person-0000000d,\n'
74+
' ex:person-0000000e .\n'
75+
'\n'
76+
'ex:person-0000000d a foaf:Person ;\n'
77+
' foaf:knows ex:person-0000000e,\n'
78+
' ex:person-0000000f .\n'
79+
'\n'
80+
'ex:person-0000000e a foaf:Person ;\n'
81+
' foaf:knows ex:person-0000000f,\n'
82+
' ex:person-00000010 .\n'
83+
'\n'
84+
'ex:person-0000000f a foaf:Person ;\n'
85+
' foaf:knows ex:person-00000001,\n'
86+
' ex:person-00000010 .\n'
87+
'\n'
88+
'ex:person-00000010 a foaf:Person ;\n'
89+
' foaf:knows ex:person-00000001,\n'
90+
' ex:person-00000002 .\n'
91+
'\n'
92+
'ex:person-00000004 a foaf:Person ;\n'
93+
' foaf:knows ex:person-00000005,\n'
94+
' ex:person-00000006 .\n'
95+
'\n'),
96+
('response',
97+
datetime.datetime(2023, 7, 27, 17, 52, 21, 216945),
98+
'The person known by the most persons in the RDF '
99+
'graph is "ex:person-00000004".')])
100+
TaskExecInfo(startTime=datetime.datetime(2023, 7, 27, 17, 52, 21, 234129),
101+
modelId='GPT--gpt-3.5-turbo--gpt-3.5-turbo-0613',
102+
taskInfo=TaskInfo(taskId='TurtleFriendCount',
103+
version='2.0',
104+
gitCommit='dd716f229c6d9c627544a513aa00d953882a1f45'),
105+
scores={'brevity': 0.7049180327868853,
106+
'f1': 1.0,
107+
'noSpecialFriends': 1.0,
108+
'precision': 1.0,
109+
'recall': 1},
110+
info={'answerPersonCount': 1,
111+
'graphSizeChar': 1773,
112+
'persons': 16,
113+
'personsInAnswer': ['4'],
114+
'specialFriendsInAnswer': 0,
115+
'specialNode': 'http://example.org/people/person-00000004',
116+
'triples': 51},
117+
duration=datetime.timedelta(seconds=1, microseconds=205219),
118+
interactions=[('prompt',
119+
datetime.datetime(2023, 7, 27, 17, 52, 21, 234134),
120+
'Please name the person which is known by the most '
121+
'persons according to the following RDF graph in '
122+
'turtle syntax. Give just the IRI of this person '
123+
'with most incomming links as answer, without '
124+
'abbreviation or explanation.@prefix ex: '
125+
'<http://example.org/people/> .\n'
126+
'@prefix foaf: <http://xmlns.com/foaf/0.1/> .\n'
127+
'\n'
128+
'ex:person-00000001 a foaf:Person ;\n'
129+
' foaf:knows ex:person-00000002,\n'
130+
' ex:person-00000003 .\n'
131+
'\n'
132+
'ex:person-00000002 a foaf:Person ;\n'
133+
' foaf:knows ex:person-00000003,\n'
134+
' ex:person-00000004 .\n'
135+
'\n'
136+
'ex:person-00000003 a foaf:Person ;\n'
137+
' foaf:knows ex:person-00000004,\n'
138+
' ex:person-00000005 .\n'
139+
'\n'
140+
'ex:person-00000005 a foaf:Person ;\n'
141+
' foaf:knows ex:person-00000006,\n'
142+
' ex:person-00000007 .\n'
143+
'\n'
144+
'ex:person-00000006 a foaf:Person ;\n'
145+
' foaf:knows ex:person-00000007,\n'
146+
' ex:person-00000008 .\n'
147+
'\n'
148+
'ex:person-00000007 a foaf:Person ;\n'
149+
' foaf:knows ex:person-00000004,\n'
150+
' ex:person-00000008,\n'
151+
' ex:person-00000009 .\n'
152+
'\n'
153+
'ex:person-00000008 a foaf:Person ;\n'
154+
' foaf:knows ex:person-00000004,\n'
155+
' ex:person-00000009,\n'
156+
' ex:person-0000000a .\n'
157+
'\n'
158+
'ex:person-00000009 a foaf:Person ;\n'
159+
' foaf:knows ex:person-00000004,\n'
160+
' ex:person-0000000a,\n'
161+
' ex:person-0000000b .\n'
162+
'\n'
163+
'ex:person-0000000a a foaf:Person ;\n'
164+
' foaf:knows ex:person-0000000b,\n'
165+
' ex:person-0000000c .\n'
166+
'\n'
167+
'ex:person-0000000b a foaf:Person ;\n'
168+
' foaf:knows ex:person-0000000c,\n'
169+
' ex:person-0000000d .\n'
170+
'\n'
171+
'ex:person-0000000c a foaf:Person ;\n'
172+
' foaf:knows ex:person-0000000d,\n'
173+
' ex:person-0000000e .\n'
174+
'\n'
175+
'ex:person-0000000d a foaf:Person ;\n'
176+
' foaf:knows ex:person-0000000e,\n'
177+
' ex:person-0000000f .\n'
178+
'\n'
179+
'ex:person-0000000e a foaf:Person ;\n'
180+
' foaf:knows ex:person-0000000f,\n'
181+
' ex:person-00000010 .\n'
182+
'\n'
183+
'ex:person-0000000f a foaf:Person ;\n'
184+
' foaf:knows ex:person-00000001,\n'
185+
' ex:person-00000010 .\n'
186+
'\n'
187+
'ex:person-00000010 a foaf:Person ;\n'
188+
' foaf:knows ex:person-00000001,\n'
189+
' ex:person-00000002 .\n'
190+
'\n'
191+
'ex:person-00000004 a foaf:Person ;\n'
192+
' foaf:knows ex:person-00000005,\n'
193+
' ex:person-00000006 .\n'
194+
'\n'),
195+
('response',
196+
datetime.datetime(2023, 7, 27, 17, 52, 22, 439348),
197+
'The person known by the most persons is '
198+
'"ex:person-00000004".')])
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,121 @@
1+
---
2+
- !!python/object:LlmKgBench.api.task.TaskExecInfo
3+
duration: !!python/object/apply:datetime.timedelta
4+
- 0
5+
- 1
6+
- 221846
7+
info:
8+
answerPersonCount: 1
9+
graphSizeChar: 1773
10+
persons: 16
11+
personsInAnswer:
12+
- '4'
13+
specialFriendsInAnswer: 0
14+
specialNode: http://example.org/people/person-00000004
15+
triples: 51
16+
interactions:
17+
- !!python/tuple
18+
- prompt
19+
- 2023-07-27 17:52:19.995104
20+
- "Please name the person which is known by the most persons according to the\
21+
\ following RDF graph in turtle syntax. Give just the IRI of this person with\
22+
\ most incomming links as answer, without abbreviation or explanation.@prefix\
23+
\ ex: <http://example.org/people/> .\n@prefix foaf: <http://xmlns.com/foaf/0.1/>\
24+
\ .\n\nex:person-00000001 a foaf:Person ;\n foaf:knows ex:person-00000002,\n\
25+
\ ex:person-00000003 .\n\nex:person-00000002 a foaf:Person ;\n foaf:knows\
26+
\ ex:person-00000003,\n ex:person-00000004 .\n\nex:person-00000003 a\
27+
\ foaf:Person ;\n foaf:knows ex:person-00000004,\n ex:person-00000005\
28+
\ .\n\nex:person-00000005 a foaf:Person ;\n foaf:knows ex:person-00000006,\n\
29+
\ ex:person-00000007 .\n\nex:person-00000006 a foaf:Person ;\n foaf:knows\
30+
\ ex:person-00000007,\n ex:person-00000008 .\n\nex:person-00000007 a\
31+
\ foaf:Person ;\n foaf:knows ex:person-00000004,\n ex:person-00000008,\n\
32+
\ ex:person-00000009 .\n\nex:person-00000008 a foaf:Person ;\n foaf:knows\
33+
\ ex:person-00000004,\n ex:person-00000009,\n ex:person-0000000a\
34+
\ .\n\nex:person-00000009 a foaf:Person ;\n foaf:knows ex:person-00000004,\n\
35+
\ ex:person-0000000a,\n ex:person-0000000b .\n\nex:person-0000000a\
36+
\ a foaf:Person ;\n foaf:knows ex:person-0000000b,\n ex:person-0000000c\
37+
\ .\n\nex:person-0000000b a foaf:Person ;\n foaf:knows ex:person-0000000c,\n\
38+
\ ex:person-0000000d .\n\nex:person-0000000c a foaf:Person ;\n foaf:knows\
39+
\ ex:person-0000000d,\n ex:person-0000000e .\n\nex:person-0000000d a\
40+
\ foaf:Person ;\n foaf:knows ex:person-0000000e,\n ex:person-0000000f\
41+
\ .\n\nex:person-0000000e a foaf:Person ;\n foaf:knows ex:person-0000000f,\n\
42+
\ ex:person-00000010 .\n\nex:person-0000000f a foaf:Person ;\n foaf:knows\
43+
\ ex:person-00000001,\n ex:person-00000010 .\n\nex:person-00000010 a\
44+
\ foaf:Person ;\n foaf:knows ex:person-00000001,\n ex:person-00000002\
45+
\ .\n\nex:person-00000004 a foaf:Person ;\n foaf:knows ex:person-00000005,\n\
46+
\ ex:person-00000006 .\n\n"
47+
- !!python/tuple
48+
- response
49+
- 2023-07-27 17:52:21.216945
50+
- The person known by the most persons in the RDF graph is "ex:person-00000004".
51+
modelId: GPT--gpt-3.5-turbo--gpt-3.5-turbo-0613
52+
scores:
53+
brevity: 0.5512820512820513
54+
f1: 1.0
55+
noSpecialFriends: 1.0
56+
precision: 1.0
57+
recall: 1
58+
startTime: 2023-07-27 17:52:19.995099
59+
taskInfo: !!python/object:LlmKgBench.api.task.TaskInfo
60+
taskId: TurtleFriendCount
61+
version: '2.0'
62+
- !!python/object:LlmKgBench.api.task.TaskExecInfo
63+
duration: !!python/object/apply:datetime.timedelta
64+
- 0
65+
- 1
66+
- 205219
67+
info:
68+
answerPersonCount: 1
69+
graphSizeChar: 1773
70+
persons: 16
71+
personsInAnswer:
72+
- '4'
73+
specialFriendsInAnswer: 0
74+
specialNode: http://example.org/people/person-00000004
75+
triples: 51
76+
interactions:
77+
- !!python/tuple
78+
- prompt
79+
- 2023-07-27 17:52:21.234134
80+
- "Please name the person which is known by the most persons according to the\
81+
\ following RDF graph in turtle syntax. Give just the IRI of this person with\
82+
\ most incomming links as answer, without abbreviation or explanation.@prefix\
83+
\ ex: <http://example.org/people/> .\n@prefix foaf: <http://xmlns.com/foaf/0.1/>\
84+
\ .\n\nex:person-00000001 a foaf:Person ;\n foaf:knows ex:person-00000002,\n\
85+
\ ex:person-00000003 .\n\nex:person-00000002 a foaf:Person ;\n foaf:knows\
86+
\ ex:person-00000003,\n ex:person-00000004 .\n\nex:person-00000003 a\
87+
\ foaf:Person ;\n foaf:knows ex:person-00000004,\n ex:person-00000005\
88+
\ .\n\nex:person-00000005 a foaf:Person ;\n foaf:knows ex:person-00000006,\n\
89+
\ ex:person-00000007 .\n\nex:person-00000006 a foaf:Person ;\n foaf:knows\
90+
\ ex:person-00000007,\n ex:person-00000008 .\n\nex:person-00000007 a\
91+
\ foaf:Person ;\n foaf:knows ex:person-00000004,\n ex:person-00000008,\n\
92+
\ ex:person-00000009 .\n\nex:person-00000008 a foaf:Person ;\n foaf:knows\
93+
\ ex:person-00000004,\n ex:person-00000009,\n ex:person-0000000a\
94+
\ .\n\nex:person-00000009 a foaf:Person ;\n foaf:knows ex:person-00000004,\n\
95+
\ ex:person-0000000a,\n ex:person-0000000b .\n\nex:person-0000000a\
96+
\ a foaf:Person ;\n foaf:knows ex:person-0000000b,\n ex:person-0000000c\
97+
\ .\n\nex:person-0000000b a foaf:Person ;\n foaf:knows ex:person-0000000c,\n\
98+
\ ex:person-0000000d .\n\nex:person-0000000c a foaf:Person ;\n foaf:knows\
99+
\ ex:person-0000000d,\n ex:person-0000000e .\n\nex:person-0000000d a\
100+
\ foaf:Person ;\n foaf:knows ex:person-0000000e,\n ex:person-0000000f\
101+
\ .\n\nex:person-0000000e a foaf:Person ;\n foaf:knows ex:person-0000000f,\n\
102+
\ ex:person-00000010 .\n\nex:person-0000000f a foaf:Person ;\n foaf:knows\
103+
\ ex:person-00000001,\n ex:person-00000010 .\n\nex:person-00000010 a\
104+
\ foaf:Person ;\n foaf:knows ex:person-00000001,\n ex:person-00000002\
105+
\ .\n\nex:person-00000004 a foaf:Person ;\n foaf:knows ex:person-00000005,\n\
106+
\ ex:person-00000006 .\n\n"
107+
- !!python/tuple
108+
- response
109+
- 2023-07-27 17:52:22.439348
110+
- The person known by the most persons is "ex:person-00000004".
111+
modelId: GPT--gpt-3.5-turbo--gpt-3.5-turbo-0613
112+
scores:
113+
brevity: 0.7049180327868853
114+
f1: 1.0
115+
noSpecialFriends: 1.0
116+
precision: 1.0
117+
recall: 1
118+
startTime: 2023-07-27 17:52:21.234129
119+
taskInfo: !!python/object:LlmKgBench.api.task.TaskInfo
120+
taskId: TurtleFriendCount
121+
version: '2.0'

0 commit comments

Comments
 (0)