You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+20-1Lines changed: 20 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,6 +18,8 @@ These jobs are using _PySpark_ to process larger volumes of data and are suppose
18
18
19
19
### Local Setup
20
20
21
+
> 💡 Use the [Devcontainer setup](#devcontainer-setup) if you encounter issues.
22
+
21
23
#### Pre-requisites
22
24
23
25
Please make sure you have the following installed and can run them
@@ -32,12 +34,29 @@ We recommend using WSL 2 on Windows for this exercise, due to the [lack of suppo
32
34
33
35
Follow instructions on the [Windows official page](https://learn.microsoft.com/en-us/windows/wsl/setup/environment) and then the linux install.
34
36
37
+
> 💡 Use the [Devcontainer setup](#devcontainer-setup) if you encounter issues.
38
+
35
39
#### Install all dependencies
36
40
37
41
```bash
38
42
poetry install
39
43
```
40
44
45
+
### Devcontainer setup
46
+
47
+
Configuration to use dev containers is provided in `.devcontainer`
48
+
49
+
> ⚠️ this take up to 7 minutes to setup, make sure to have things running before the interview.
50
+
51
+
#### In VSCode
52
+
53
+
Follow instructions in https://code.visualstudio.com/docs/devcontainers/containers
54
+
55
+
### In Github codespaces
56
+
57
+
1.[Fork](https://github.com/techops-recsys-lateral-hiring/dataengineer-transformations-python/fork) this repository.
58
+
2. Follow [codespace instructions](https://docs.github.com/en/codespaces/developing-in-a-codespace/creating-a-codespace-for-a-repository#the-codespace-creation-process) from the forked repository, to create the environment.
59
+
41
60
### Verify setup
42
61
43
62
> All of the following commands should be running successfully
@@ -87,6 +106,7 @@ The following section provides context over them.
87
106
```
88
107
89
108
/
109
+
├─ /.devcontainer # Contains configurations for dev containers
90
110
├─ /data_transformations # Contains the main python library
91
111
│ # with the code to the transformations
92
112
│
@@ -102,7 +122,6 @@ The following section provides context over them.
0 commit comments