Skip to content

Conversation

@spompea-cfa
Copy link
Contributor

@spompea-cfa spompea-cfa commented Sep 16, 2025

Initial version of the Exporter middleware: exports data from a Senzing database and uploads it as a JSON file to an S3 bucket.

Ancillary changes not specific to Exporter that are also included here:

  • loglib module
  • some additional README changes

@spompea-cfa spompea-cfa requested a review from a team as a code owner September 16, 2025 14:55
@spompea-cfa spompea-cfa changed the title feat: Exporter middleware [WIP] feat: Exporter middleware Sep 16, 2025
@spompea-cfa spompea-cfa marked this pull request as draft September 16, 2025 22:52
@spompea-cfa spompea-cfa changed the title [WIP] feat: Exporter middleware feat: Exporter middleware Sep 16, 2025
@spompea-cfa spompea-cfa marked this pull request as ready for review September 16, 2025 23:02
@jamesiarmes jamesiarmes requested a review from Copilot September 17, 2025 15:41
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR introduces an Exporter middleware that exports data from a Senzing database and uploads it as JSON files to an S3 bucket. The implementation includes proper logging infrastructure and Docker containerization for the new service.

  • Adds a new Exporter middleware service with S3 upload capabilities
  • Introduces a reusable logging library module for consistent log formatting
  • Provides Docker configuration and documentation for running the exporter

Reviewed Changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
middleware/exporter.py Main exporter implementation that connects to Senzing, exports JSON entity reports, and uploads to S3
middleware/loglib.py Shared logging utility module with standardized formatters and logger management
Dockerfile.exporter Docker configuration for the exporter service
docker-compose.yaml Service definition for the exporter with environment configuration
README.md Updated documentation with exporter usage instructions
.trivyignore.yaml Security scan exception for the exporter Dockerfile
middleware/sample-data/hemingway.txt Sample text file for testing purposes

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@jamesiarmes jamesiarmes merged commit b64caf1 into main Sep 18, 2025
9 checks passed
@jamesiarmes jamesiarmes deleted the exporter-middleware branch September 18, 2025 15:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants