Support arcs in tagger (#34)

Author: neelkamath

docs/developing.md

@@ -7,20 +7,28 @@ Replace `<MODEL>` with the name of the [spaCy model](https://spacy.io/models) (e
 ### Development
 
 ```
-SPACY_MODEL=<MODEL> SENSE2VEC=<ENABLED> docker-compose -p dev --project-directory . \
-    -f docker/docker-compose.yml -f docker/docker-compose.override.yml up --build
+SPACY_MODEL=<MODEL> SENSE2VEC=<ENABLED> docker-compose \
+    -p dev \
+    --project-directory . \
+    -f docker/docker-compose.yml \
+    -f docker/docker-compose.override.yml \
+    up --build
 ```
-
 The server will be running on `http://localhost:8000`, and has automatic reload enabled.
 
 ### Testing
 
-```
-docker-compose -p test --project-directory . -f docker/docker-compose.yml -f docker/docker-compose.test.yml \
-    run --service-ports app sh -c '. scripts/setup.sh && bash'
-   ```
-
-Changes to the source code will automatically be mirrored in the container. A bind mount connects the project directory and the container so that you can run commands like `pytest`.
+1. Start the container. A bind mount connects the project directory and the container so that changes to the source code will automatically be mirrored in the container.
+    ```
+    docker-compose \
+        -p test \
+        --project-directory . \
+        -f docker/docker-compose.yml \
+        -f docker/docker-compose.test.yml \
+        run --service-ports app sh -c '. scripts/setup.sh && bash'
+    ```
+1. Test whenever you want by running `pytest`.
+1. Exit the container once you're done: `exit`
 
 ### Production
 

docs/spec/pos.yaml

@@ -32,6 +32,7 @@ post:
                     text_with_ws: 'Google '
                     whitespace: " "
                     head: is
+                    head_index: 1
                     left_edge: Google
                     right_edge: Google
                     index: 0
@@ -68,6 +69,7 @@ post:
                     text_with_ws: 'is '
                     whitespace: " "
                     head: is
+                    head_index: 1
                     left_edge: Google
                     right_edge: "."
                     index: 1
@@ -104,6 +106,7 @@ post:
                     text_with_ws: 'a '
                     whitespace: " "
                     head: company
+                    head_index: 3
                     left_edge: a
                     right_edge: a
                     index: 2
@@ -140,6 +143,7 @@ post:
                     text_with_ws: company
                     whitespace: ''
                     head: is
+                    head_index: 1
                     left_edge: a
                     right_edge: company
                     index: 3
@@ -176,6 +180,7 @@ post:
                     text_with_ws: ". "
                     whitespace: " "
                     head: is
+                    head_index: 1
                     left_edge: "."
                     right_edge: "."
                     index: 4
@@ -214,6 +219,7 @@ post:
                     text_with_ws: 'Sundar '
                     whitespace: " "
                     head: Pichai
+                    head_index: 6
                     left_edge: Sundar
                     right_edge: Sundar
                     index: 5
@@ -250,6 +256,7 @@ post:
                     text_with_ws: 'Pichai '
                     whitespace: " "
                     head: is
+                    head_index: 7
                     left_edge: Sundar
                     right_edge: Pichai
                     index: 6
@@ -286,6 +293,7 @@ post:
                     text_with_ws: 'is '
                     whitespace: " "
                     head: is
+                    head_index: 7
                     left_edge: Sundar
                     right_edge: "."
                     index: 7
@@ -322,6 +330,7 @@ post:
                     text_with_ws: it
                     whitespace: ''
                     head: "'s"
+                    head_index: 9
                     left_edge: it
                     right_edge: it
                     index: 8
@@ -358,6 +367,7 @@ post:
                     text_with_ws: "'s "
                     whitespace: " "
                     head: is
+                    head_index: 7
                     left_edge: it
                     right_edge: CEO
                     index: 9
@@ -394,6 +404,7 @@ post:
                     text_with_ws: CEO
                     whitespace: ''
                     head: "'s"
+                    head_index: 9
                     left_edge: CEO
                     right_edge: CEO
                     index: 10
@@ -430,6 +441,7 @@ post:
                     text_with_ws: "."
                     whitespace: ''
                     head: is
+                    head_index: 7
                     left_edge: "."
                     right_edge: "."
                     index: 11

src/main.py

@@ -159,6 +159,7 @@ class Token:
     text_with_ws: str
     whitespace: str
     head: str
+    head_index: int
     left_edge: str
     right_edge: str
     index: int
@@ -236,6 +237,7 @@ def build_token_with_sent(token) -> TokenWithSentence:
             text_with_ws=token.text_with_ws,
             whitespace=token.whitespace_,
             head=token.head.text,
+            head_index=token.head.i,
             left_edge=token.left_edge.text,
             right_edge=token.right_edge.text,
             index=token.i,