feat: Accept an app key + refresh token for Dropbox

Author: edgarrmondragon

.github/workflows/ci_workflow.yml

@@ -14,7 +14,6 @@ on:
     - pyproject.toml
     - tox.ini
   pull_request:
-    branches: [main]
     paths:
     - .github/workflows/ci_workflow.yml
     - .github/workflows/constraints.txt

README.md

@@ -93,20 +93,18 @@ Optionally, the files definition can be provided by an external json file:
 
 #### FTP
 
-| Setting      | Required | Default | Description             |
-| :----------- | :------- | :------ | :---------------------- |
-| ftp          | False    | None    | FTP connection settings |
-| ftp.host     | True     | None    | FTP server host         |
-| ftp.port     | False    | 21      | FTP server port         |
-| ftp.username | False    | None    | FTP username            |
-| ftp.password | False    | None    | FTP password            |
-| ftp.encoding | False    | utf-8   | FTP server encoding     |
+| Setting      | Required | Default | Description         |
+| :----------- | :------- | :------ | :------------------ |
+| ftp.host     | True     | None    | FTP server host     |
+| ftp.port     | False    | 21      | FTP server port     |
+| ftp.username | False    | None    | FTP username        |
+| ftp.password | False    | None    | FTP password        |
+| ftp.encoding | False    | utf-8   | FTP server encoding |
 
 #### GitHub
 
 | Setting         | Required | Default | Description                                                 |
 | :-------------- | :------- | :------ | :---------------------------------------------------------- |
-| github          | False    | None    | GitHub connection settings                                  |
 | github.org      | True     | None    | GitHub organization or user where the repository is located |
 | github.repo     | True     | None    | GitHub repository                                           |
 | github.username | False    | None    | GitHub username                                             |
@@ -141,10 +139,10 @@ Optionally, the files definition can be provided by an external json file:
 
 #### Dropbox
 
-| Setting       | Required | Default | Description                 |
-| :------------ | :------- | :------ | :-------------------------- |
-| dropbox       | False    | None    | Dropbox connection settings |
-| dropbox.token | True     | None    | Dropbox token               |
+| Setting               | Required | Default | Description           |
+| :-------------------- | :------- | :------ | :-------------------- |
+| dropbox.app_key       | True     | None    | Dropbox App key       |
+| dropbox.refresh_token | True     | None    | Dropbox refresh token |
 
 The token needs the `files.content.read` scope:
 
@@ -158,7 +156,8 @@ The token needs the `files.content.read` scope:
   "add_metadata_columns": true,
   "filesystem": "dropbox",
   "dropbox": {
-	"token": "...."
+    "app_key": "your_app_key",
+    "refresh_token": "your_refresh_token"
   },
   "files": [
     {

meltano.yml

@@ -75,9 +75,14 @@ plugins:
         sensitive: true
 
       # Dropbox settings
-      - name: dropbox.token
-        label: Dropbox Token
-        description: Token for Dropbox
+      - name: dropbox.app_key
+        label: Dropbox App Key
+        description: OAuth2 app key for Dropbox
+        kind: string
+        sensitive: true
+      - name: dropbox.refresh_token
+        label: Dropbox Refresh Token
+        description: OAuth2 refresh Token for Dropbox
         kind: password
         sensitive: true
 

tap_csv/filesystem_config.py

@@ -76,11 +76,18 @@
     "dropbox",
     th.ObjectType(
         th.Property(
-            "token",
+            "app_key",
+            th.StringType,
+            secret=True,
+            required=True,
+            description="Dropbox App key",
+        ),
+        th.Property(
+            "refresh_token",
             th.StringType,
             secret=True,
             required=True,
-            description="Dropbox token",
+            description="Dropbox refresh token",
         ),
     ),
     description="Dropbox connection settings",