Skip to content

Commit 5a5df6e

Browse files
huiguangjunhuiguangjun
committed
add bench test data.
1 parent d19e097 commit 5a5df6e

7 files changed

+423
-0
lines changed

‎bench/README.md

+12
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
# Benchmark
2+
3+
## Goofys tests
4+
5+
These tests are run with `./run_bench.sh` in this directory. They're rather simple but the results are also included for completeness:
6+
7+
![benchmark results](bench.png?raw=true "Benchmark Results")
8+
9+
The test was run on an ECS ecs.s6-c1m2.xlarge 4CPU 8GiB in cn-shenshen connected to a bucket in oss-cn-shenshen. Units are seconds.
10+
Using `-ostat_cache_expire=1` for s3fs（version 1.91）and ossfs.
11+
Using `--stat-cache-ttl 1s --type-cache-ttl 1s` for goofys.
12+
Using `-ostat_cache_expire=1 -oreaddir_optimize` for ossfs+readdir-optimize.

‎bench/bench.data

+11
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
#operation,time
2+
Create 100 files 10.105 9.368 11.014 10.528444444444444 9.822 11.384 5.3599000000000006 4.81 5.838 10.331500000000002 9.901 10.858
3+
Create 100 files (parallel) 4.991444444444444 4.673 5.391 5.6676 5.233 6.307 0.9472000000000002 0.787 1.129 5.365777777777777 4.932 6.43
4+
Unlink 100 files 2.6174 2.395 2.916 2.6270000000000002 2.359 3.103 2.6775555555555552 2.429 2.914 2.6721999999999997 2.456 3.031
5+
Unlink 100 files (parallel) 3.1605 2.638 3.673 3.404 2.987 3.914 2.9871111111111115 2.798 3.312 3.2489000000000003 2.83 3.624
6+
ls with 1000 files 0.5623333333333335 0.537 0.602 0.6181111111111111 0.575 0.719 0.16188888888888886 0.156 0.171 0.15644444444444447 0.147 0.167
7+
`find' with 1000 dirs/files 2.4784444444444444 2.234 2.75 2.417 2.034 2.843 0.16866666666666666 0.155 0.189 0.933 0.728 1.421
8+
Write 1GB 7.706333333333333 7.538 7.889 9.87788888888889 9.73 10.15 4.532399999999999 4.399 4.699 7.7941111111111105 7.517 8.097
9+
Read 1GB 7.132777777777777 6.783 7.666 7.741 7.077 8.273 3.493 3.407 3.606 7.284333333333334 6.785 7.985
10+
Rename 1GB 0.147 0.13 0.168 18.197400000000002 16.813 19.796 0.10677777777777778 0.096 0.131 0.1551111111111111 0.134 0.186
11+
Time to 1st byte 0.3184 0.24 0.395 0.34288888888888885 0.197 0.464 0.025333333333333333 0.021 0.033 0.2822222222222222 0.223 0.357

‎bench/bench.goofys

+100
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,100 @@
1+
create_files 5.239
2+
rm_files 2.674
3+
create_files 5.838
4+
rm_files 2.703
5+
create_files 4.810
6+
rm_files 2.735
7+
create_files 5.200
8+
rm_files 3.419
9+
create_files 5.447
10+
rm_files 2.762
11+
create_files 5.380
12+
rm_files 2.743
13+
create_files 5.189
14+
rm_files 2.429
15+
create_files 5.199
16+
rm_files 2.561
17+
create_files 5.660
18+
rm_files 2.577
19+
create_files 5.637
20+
rm_files 2.914
21+
create_files_parallel 1.129
22+
rm_files_parallel 2.965
23+
create_files_parallel 0.904
24+
rm_files_parallel 2.817
25+
create_files_parallel 0.787
26+
rm_files_parallel 3.312
27+
create_files_parallel 0.853
28+
rm_files_parallel 3.027
29+
create_files_parallel 0.987
30+
rm_files_parallel 2.843
31+
create_files_parallel 1.017
32+
rm_files_parallel 3.925
33+
create_files_parallel 1.016
34+
rm_files_parallel 3.101
35+
create_files_parallel 0.855
36+
rm_files_parallel 2.798
37+
create_files_parallel 1.012
38+
rm_files_parallel 3.044
39+
create_files_parallel 0.912
40+
rm_files_parallel 2.977
41+
write_md5 4.631
42+
read_md5 3.453
43+
read_first_byte 0.028
44+
rename_large_file 0.098
45+
write_md5 4.699
46+
read_md5 3.407
47+
read_first_byte 0.026
48+
rename_large_file 0.116
49+
write_md5 4.399
50+
read_md5 3.523
51+
read_first_byte 0.023
52+
rename_large_file 0.108
53+
write_md5 4.540
54+
read_md5 3.532
55+
read_first_byte 0.037
56+
rename_large_file 0.097
57+
write_md5 4.645
58+
read_md5 3.606
59+
read_first_byte 0.023
60+
rename_large_file 0.110
61+
write_md5 4.417
62+
read_md5 3.316
63+
read_first_byte 0.024
64+
rename_large_file 0.184
65+
write_md5 4.439
66+
read_md5 3.468
67+
read_first_byte 0.033
68+
rename_large_file 0.098
69+
write_md5 4.552
70+
read_md5 3.460
71+
read_first_byte 0.025
72+
rename_large_file 0.131
73+
write_md5 4.599
74+
read_md5 3.480
75+
read_first_byte 0.025
76+
rename_large_file 0.107
77+
write_md5 4.403
78+
read_md5 3.508
79+
read_first_byte 0.021
80+
rename_large_file 0.096
81+
ls_files 0.158
82+
ls_files 0.161
83+
ls_files 0.157
84+
ls_files 0.178
85+
ls_files 0.162
86+
ls_files 0.171
87+
ls_files 0.156
88+
ls_files 0.166
89+
ls_files 0.164
90+
ls_files 0.162
91+
find_files 0.128
92+
find_files 0.166
93+
find_files 0.155
94+
find_files 0.189
95+
find_files 0.169
96+
find_files 0.166
97+
find_files 0.171
98+
find_files 0.160
99+
find_files 0.158
100+
find_files 0.184

‎bench/bench.ossfs

+100
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,100 @@
1+
create_files 11.014
2+
rm_files 2.395
3+
create_files 9.940
4+
rm_files 2.916
5+
create_files 9.605
6+
rm_files 2.800
7+
create_files 10.720
8+
rm_files 2.662
9+
create_files 10.233
10+
rm_files 2.456
11+
create_files 9.911
12+
rm_files 2.420
13+
create_files 9.581
14+
rm_files 2.496
15+
create_files 10.468
16+
rm_files 2.705
17+
create_files 10.210
18+
rm_files 2.651
19+
create_files 9.368
20+
rm_files 2.673
21+
create_files_parallel 4.787
22+
rm_files_parallel 3.096
23+
create_files_parallel 4.673
24+
rm_files_parallel 2.835
25+
create_files_parallel 4.830
26+
rm_files_parallel 2.638
27+
create_files_parallel 5.391
28+
rm_files_parallel 3.489
29+
create_files_parallel 5.237
30+
rm_files_parallel 3.286
31+
create_files_parallel 4.910
32+
rm_files_parallel 3.673
33+
create_files_parallel 4.933
34+
rm_files_parallel 2.946
35+
create_files_parallel 4.946
36+
rm_files_parallel 3.509
37+
create_files_parallel 5.706
38+
rm_files_parallel 2.770
39+
create_files_parallel 5.216
40+
rm_files_parallel 3.363
41+
write_md5 8.180
42+
read_md5 8.440
43+
read_first_byte 0.366
44+
rename_large_file 0.195
45+
write_md5 7.729
46+
read_md5 7.642
47+
read_first_byte 0.325
48+
rename_large_file 0.157
49+
write_md5 7.784
50+
read_md5 7.089
51+
read_first_byte 0.324
52+
rename_large_file 0.142
53+
write_md5 7.889
54+
read_md5 7.666
55+
read_first_byte 0.395
56+
rename_large_file 0.139
57+
write_md5 7.576
58+
read_md5 6.822
59+
read_first_byte 0.240
60+
rename_large_file 0.159
61+
write_md5 7.839
62+
read_md5 7.054
63+
read_first_byte 0.339
64+
rename_large_file 0.130
65+
write_md5 7.601
66+
read_md5 6.783
67+
read_first_byte 0.268
68+
rename_large_file 0.142
69+
write_md5 7.538
70+
read_md5 6.823
71+
read_first_byte 0.370
72+
rename_large_file 0.153
73+
write_md5 7.588
74+
read_md5 7.164
75+
read_first_byte 0.284
76+
rename_large_file 0.133
77+
write_md5 7.813
78+
read_md5 7.152
79+
read_first_byte 0.273
80+
rename_large_file 0.168
81+
ls_files 0.602
82+
ls_files 0.560
83+
ls_files 0.537
84+
ls_files 0.576
85+
ls_files 1.198
86+
ls_files 0.577
87+
ls_files 0.543
88+
ls_files 0.559
89+
ls_files 0.561
90+
ls_files 0.546
91+
find_files 2.297
92+
find_files 2.357
93+
find_files 2.437
94+
find_files 2.322
95+
find_files 1.910
96+
find_files 2.750
97+
find_files 2.601
98+
find_files 2.234
99+
find_files 2.624
100+
find_files 2.684

‎bench/bench.ossfs+readdir-optimize

+100
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,100 @@
1+
create_files 10.686
2+
rm_files 2.635
3+
create_files 10.500
4+
rm_files 2.643
5+
create_files 10.076
6+
rm_files 2.541
7+
create_files 10.444
8+
rm_files 2.680
9+
create_files 9.901
10+
rm_files 2.529
11+
create_files 10.153
12+
rm_files 2.627
13+
create_files 9.952
14+
rm_files 2.456
15+
create_files 10.575
16+
rm_files 3.005
17+
create_files 10.858
18+
rm_files 3.031
19+
create_files 10.170
20+
rm_files 2.575
21+
create_files_parallel 6.430
22+
rm_files_parallel 3.352
23+
create_files_parallel 5.005
24+
rm_files_parallel 3.624
25+
create_files_parallel 5.397
26+
rm_files_parallel 3.041
27+
create_files_parallel 5.342
28+
rm_files_parallel 3.195
29+
create_files_parallel 5.238
30+
rm_files_parallel 3.042
31+
create_files_parallel 5.346
32+
rm_files_parallel 3.474
33+
create_files_parallel 4.932
34+
rm_files_parallel 2.830
35+
create_files_parallel 6.643
36+
rm_files_parallel 3.283
37+
create_files_parallel 5.062
38+
rm_files_parallel 3.523
39+
create_files_parallel 5.540
40+
rm_files_parallel 3.125
41+
write_md5 7.817
42+
read_md5 6.785
43+
read_first_byte 0.234
44+
rename_large_file 0.152
45+
write_md5 7.709
46+
read_md5 7.068
47+
read_first_byte 0.511
48+
rename_large_file 0.156
49+
write_md5 7.772
50+
read_md5 7.146
51+
read_first_byte 0.257
52+
rename_large_file 0.134
53+
write_md5 7.950
54+
read_md5 7.985
55+
read_first_byte 0.246
56+
rename_large_file 0.154
57+
write_md5 7.818
58+
read_md5 7.241
59+
read_first_byte 0.352
60+
rename_large_file 0.144
61+
write_md5 8.465
62+
read_md5 7.396
63+
read_first_byte 0.357
64+
rename_large_file 0.199
65+
write_md5 8.097
66+
read_md5 7.488
67+
read_first_byte 0.344
68+
rename_large_file 0.154
69+
write_md5 7.517
70+
read_md5 6.925
71+
read_first_byte 0.247
72+
rename_large_file 0.143
73+
write_md5 7.846
74+
read_md5 7.525
75+
read_first_byte 0.223
76+
rename_large_file 0.173
77+
write_md5 7.621
78+
read_md5 8.635
79+
read_first_byte 0.280
80+
rename_large_file 0.186
81+
ls_files 0.149
82+
ls_files 0.147
83+
ls_files 0.167
84+
ls_files 0.153
85+
ls_files 0.167
86+
ls_files 0.159
87+
ls_files 0.151
88+
ls_files 0.156
89+
ls_files 0.159
90+
ls_files 0.200
91+
find_files 0.929
92+
find_files 0.990
93+
find_files 0.987
94+
find_files 1.421
95+
find_files 0.837
96+
find_files 1.475
97+
find_files 0.886
98+
find_files 0.728
99+
find_files 0.810
100+
find_files 0.809

‎bench/bench.png

45 KB
Loading

0 commit comments

Comments
 (0)