-
Notifications
You must be signed in to change notification settings - Fork 0
feat: Exporter middleware #13
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
e887385 to
e77a405
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR introduces an Exporter middleware that exports data from a Senzing database and uploads it as JSON files to an S3 bucket. The implementation includes proper logging infrastructure and Docker containerization for the new service.
- Adds a new Exporter middleware service with S3 upload capabilities
- Introduces a reusable logging library module for consistent log formatting
- Provides Docker configuration and documentation for running the exporter
Reviewed Changes
Copilot reviewed 7 out of 7 changed files in this pull request and generated 5 comments.
Show a summary per file
| File | Description |
|---|---|
| middleware/exporter.py | Main exporter implementation that connects to Senzing, exports JSON entity reports, and uploads to S3 |
| middleware/loglib.py | Shared logging utility module with standardized formatters and logger management |
| Dockerfile.exporter | Docker configuration for the exporter service |
| docker-compose.yaml | Service definition for the exporter with environment configuration |
| README.md | Updated documentation with exporter usage instructions |
| .trivyignore.yaml | Security scan exception for the exporter Dockerfile |
| middleware/sample-data/hemingway.txt | Sample text file for testing purposes |
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
a7067df to
da23316
Compare
a7dcf5a to
4c02130
Compare
Initial version of the Exporter middleware: exports data from a Senzing database and uploads it as a JSON file to an S3 bucket.
Ancillary changes not specific to Exporter that are also included here: