Skip to content

Commit 6a2a27d

Browse files
committed
wget: override robots.txt for zh.cppreference.com
Close #13
1 parent 2c3a401 commit 6a2a27d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

zh.diff

+1-1
Original file line numberDiff line numberDiff line change
@@ -136,7 +136,7 @@ index 22d5596..559fe38 100644
136136
wget --adjust-extension --page-requisites --convert-links \
137137
- --force-directories --recursive --level=15 \
138138
- --span-hosts --domains=en.cppreference.com,upload.cppreference.com \
139-
+ --force-directories --recursive --level=17 \
139+
+ --force-directories --recursive --level=17 -e robots=off \
140140
+ --span-hosts --domains=zh.cppreference.com,upload.cppreference.com \
141141
--reject-regex $$regex \
142142
- --timeout=5 --tries=50 --no-verbose \

0 commit comments

Comments
 (0)