Add a ReSharing protocol to both re-share to existing parties and create shares for additional parties (#684)

* refactor: no longer have degree 2 galois ring sharing in library at all

* feat: add more points to exceptional sequence of galois sharing

feat: more generic inverse computation for degree 4 galois rings

* test: more exhaustive tests for galois rings

* feat: basic reshare protocol implemented

To be integrated into client/server infrastructure

* feat: also send and check eye in reshare message

* Revert "feat: also send and check eye in reshare message"

This reverts commit 4f3562a.

* feat: include both eyes in the sent message

* feat: basic reshare client

* feat: basic server and seed binary for v2 dbs

* feat: working basic reshare client and server
probably lacks robustness + tracing

* fix: cargo clippy fixes

* fix: more clippy fixes

* build(deps): add protobuf-compiler to docker build images and ci

* fix: clippy and missing protobuf for docs ci

* docs: simple readme for reshare protocol run

* docs: update documentation for reshare

* Update iris-mpc-upgrade/src/bin/README.md

Co-authored-by: Carlo Mazzaferro <[email protected]>

* reshare deploy values

* reshare common values

* feat: compute allowed proto message size from batch size

* refactor: remove unused config values, make client retry backoff time configurable

* document config

* feat: derive common seed from AWS KMS

* test derive shared secret with localstack

* feat: add sanity check on correlated randomness

* workaround for localstack bug for local testing

* clippy fix

* unify the store functionality to not have 2 similar structs due to new main changes

* reshare common values

* consolidate reshare server values

* add server and client to dockerfiles

* typo

---------

Co-authored-by: Carlo Mazzaferro <[email protected]>
Co-authored-by: Carlo Mazzaferro <[email protected]>

Author: dkales

.github/workflows/build-all-targets.yml

@@ -4,7 +4,7 @@ on:
   push:
 
 concurrency:
-  group: '${{ github.workflow }} @ ${{ github.event.pull_request.head.label || github.head_ref || github.ref }}'
+  group: "${{ github.workflow }} @ ${{ github.event.pull_request.head.label || github.head_ref || github.ref }}"
   cancel-in-progress: true
 
 jobs:
@@ -13,6 +13,8 @@ jobs:
     steps:
       - name: Checkout code
         uses: actions/checkout@v4
+      - name: Install Dependencies
+        run: sudo apt install protobuf-compiler
       - name: Cache build products
         uses: Swatinem/[email protected]
         with:
@@ -31,6 +33,8 @@ jobs:
     steps:
       - name: Checkout code
         uses: actions/checkout@v4
+      - name: Install Dependencies
+        run: sudo apt install protobuf-compiler
       - name: Cache build products
         uses: Swatinem/[email protected]
         with:

.github/workflows/doc.yml

@@ -4,7 +4,7 @@ on:
   push:
 
 concurrency:
-  group: '${{ github.workflow }} @ ${{ github.event.pull_request.head.label || github.head_ref || github.ref }}'
+  group: "${{ github.workflow }} @ ${{ github.event.pull_request.head.label || github.head_ref || github.ref }}"
   cancel-in-progress: true
 
 jobs:
@@ -13,6 +13,8 @@ jobs:
     steps:
       - name: Checkout code
         uses: actions/checkout@v4
+      - name: Install Dependencies
+        run: sudo apt install protobuf-compiler
       - name: Show errors inline
         uses: r7kamura/rust-problem-matchers@v1
       - name: Install Rust nightly

.github/workflows/lint-clippy.yaml

@@ -4,7 +4,7 @@ on:
   push:
 
 concurrency:
-  group: '${{ github.workflow }} @ ${{ github.event.pull_request.head.label || github.head_ref || github.ref }}'
+  group: "${{ github.workflow }} @ ${{ github.event.pull_request.head.label || github.head_ref || github.ref }}"
   cancel-in-progress: true
 
 permissions:
@@ -21,6 +21,8 @@ jobs:
     steps:
       - name: Checkout code
         uses: actions/checkout@v4
+      - name: Install Dependencies
+        run: sudo apt install protobuf-compiler
       - name: Install Rust nightly
         run: rustup toolchain install nightly-2024-07-10
       - name: Set Rust nightly as default

.github/workflows/run-unit-tests.yaml

@@ -5,10 +5,10 @@ on:
     branches:
       - main
   pull_request:
-    types: [ opened, synchronize ]
+    types: [opened, synchronize]
 
 concurrency:
-  group: '${{ github.workflow }} @ ${{ github.event.pull_request.head.label || github.head_ref || github.ref }}'
+  group: "${{ github.workflow }} @ ${{ github.event.pull_request.head.label || github.head_ref || github.ref }}"
   cancel-in-progress: true
 
 jobs:
@@ -28,6 +28,8 @@ jobs:
     steps:
       - name: Checkout code
         uses: actions/checkout@v4
+      - name: Install Dependencies
+        run: sudo apt install protobuf-compiler
       - name: Cache build products
         uses: Swatinem/[email protected]
         with:

.github/workflows/test-gpu.yaml

@@ -30,8 +30,8 @@ jobs:
           sudo ln -sf /usr/bin/gcc-11 /usr/bin/gcc
           gcc --version
 
-      - name: Install OpenSSL && pkg-config
-        run: sudo apt-get update && sudo apt-get install -y pkg-config libssl-dev
+      - name: Install OpenSSL && pkg-config && protobuf-compiler
+        run: sudo apt-get update && sudo apt-get install -y pkg-config libssl-dev protobuf-compiler
 
       - name: Install CUDA and NCCL dependencies
         if: steps.cache-cuda-nccl.outputs.cache-hit != 'true'