Skip to content

Commit 79c71af

Browse files
committed
Improve readme structure
- Take test case headings one level up. - Improve notes on testing scope. - Update/fix notes on nested folders from last commit. Signed-off-by: Fon E. Noel NFEBE <[email protected]>
1 parent 70e6801 commit 79c71af

File tree

1 file changed

+17
-19
lines changed

1 file changed

+17
-19
lines changed

README.md

Lines changed: 17 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -34,8 +34,8 @@ Run `./upload-test.py test-tree/apod --archive-path "/archives/rclone QA 1 (0a0j
3434

3535
## Testing scope
3636

37-
The scope of testing here verifies the possibility of correctly uploading and downloading
38-
a finite set of file types in a particular size range to [Permanent.org](Permanent.org) using [rclone](https://rclone.org/)
37+
The scope of testing via the test cases documented below verifies the possibility of correctly uploading and downloading
38+
a defined set of file types in a particular size range to [Permanent.org](Permanent.org) using [rclone](https://rclone.org/)
3939
which talks to permanent using the [SFTP service](https://github.com/PermanentOrg/sftp-service)
4040

4141
### What file types are tested?
@@ -46,9 +46,9 @@ The scope of testing here verifies the possibility of correctly uploading and do
4646
- Videos in `.mp4`, `.webm`, `.gifs` and `.3gp` common in mobile devices.
4747
- Executable files in `.exe`, `.run`, `.sh`, `.dep` and extension-less bin executables.
4848

49-
### What test cases are covered?
49+
## Test Cases?
5050

51-
#### Challenging Names
51+
### Challenging Names
5252

5353
Run `./generate-tree.py` to generate test data, which will be placed
5454
in a new subdirectory named `test-tree/challenging-names`.
@@ -60,13 +60,13 @@ first, of course). See the long comment at the top of
6060
[upload-test.sh](upload-test.sh) for information about what it's
6161
trying to do and what problems we know about so far.
6262

63-
#### Duplicates
63+
### Duplicates
6464

6565
A duplicate is a file/folder with exactly the same name. Of course this is not possible on regular file systems but Permanent does support it.
6666
There is a deduplication algorithm from Permanent that the `sftp-service` relies to ensure that files with identical names on Permanent won't be
6767
be considered as the same on regular file systems.
6868

69-
##### How test duplicate
69+
#### How test duplicate
7070

7171
- Create a folder in the test archive of the remote (permanent.org or permanent.dev depending on your test target) e.g 'duplicates'.
7272
- Upload at least two copies of multiple identical files into the folder `duplicates` for example (`file.txt`, `file.txt`, `file.txt` and `photo.png`, `photo.png` ...)
@@ -75,7 +75,7 @@ There is a deduplication algorithm from Permanent that the `sftp-service` relies
7575
```
7676
`./test-download.py --remote=prod --archive-path "/archives/rclone QA 1 (0a0j-0000)/My Files/" --remote-dir=duplicates`
7777
```
78-
##### Expected results
78+
#### Expected results
7979

8080
- Check downloads folder in `test-tree/downloads` and ensure that results looks like:
8181

@@ -89,19 +89,19 @@ There is a deduplication algorithm from Permanent that the `sftp-service` relies
8989
9090
0 directories, 5 files
9191
```
92-
##### Multiple Identical Uploads
92+
#### Multiple Identical Uploads
9393

9494
This test case captures what happens if you sync the same path with unchanged content multiples times.
9595

96-
##### How test identical uploads
96+
#### How test identical uploads
9797

9898
- Generate challenging names if not generated earlier, see [Challenging Names](#challenging-names)
9999

100100
Run `./upload-test.py test-tree/challenging-names --only=414 --remote-dir=test-414 --log-file=log-duplicate-upload.txt --remote=prod --archive-path="/archives/QA (0a21-0000)/My Files/"`
101101

102102
*Notice the use of the `--only` flag which specifies only files containing the number `414` should be uploaded, you can change this number to follow a string pattern in the generated challenging names but the provide example works just fine.*
103103

104-
##### Expected results
104+
#### Expected results
105105

106106
- `rclone` should report `Sizes identical` and `Unchanged skipping`
107107

@@ -111,8 +111,8 @@ Run `./upload-test.py test-tree/challenging-names --only=414 --remote-dir=test-4
111111
```
112112
- No duplicates should be be seen on Permanent UI.
113113

114-
##### Large uploads
115-
###### Uploads
114+
#### Large uploads
115+
##### Uploads
116116

117117
To test large file (`400MB` +) uploads, a couple of large files are required. Some ready-made test files can be downloaded via:
118118

@@ -138,9 +138,9 @@ Once the files are on disk:
138138

139139
Run `./upload-test.py test-tree/special-files/large --remote-dir=large-files --log-file=log-large-files.txt --remote=prod --archive-path="/archives/QA (0a21-0000)/My Files/"`
140140

141-
##### Nested folders/files
141+
#### Nested folders/files
142142

143-
###### Uploading
143+
##### Uploading
144144

145145
We have a default nest of folders that goes down 4 levels.
146146

@@ -161,19 +161,17 @@ test-tree/misc/nested/
161161
└── record-level-0.txt
162162
```
163163

164-
To test a nest with more levels, simply paste the folder structure inside `test-tree/misc/nested` or manually created more folder levels in the existing nest.
164+
To test a nest with more levels, simply paste a nested folder structure inside `test-tree/misc/nested` or manually create more folder levels in the existing nest.
165165

166-
###### Downloading
166+
##### Downloading
167167

168168
*The steps in the upload section above must be completed before this step*
169169

170170
Run
171171

172172
`./test-download.py --remote=prod --archive-path="/archives/rclone QA 1 (0a21-0000)/My Files/" --remote-dir=nested`
173173

174-
- Check downloads folder in `test-tree/downloads` and ensure `downloads/nested` that results looks like the structured previous uploaded in the nested folder upload tests above.
175-
176-
174+
Check downloads folder in `test-tree/downloads` and ensure `downloads/nested` that results looks like the structured previous uploaded in the nested folder upload tests above.
177175

178176

179177
### What file types and scenarios are left out?

0 commit comments

Comments
 (0)