Skip to content

add: max_bytes_before_external_group_by and max_bytes_before_external… - #97

Closed
ayushjhanwar-png wants to merge 1 commit into
mainfrom
fix/import-memory-optimization-and-csv-logging
Closed

add: max_bytes_before_external_group_by and max_bytes_before_external…#97
ayushjhanwar-png wants to merge 1 commit into
mainfrom
fix/import-memory-optimization-and-csv-logging

Conversation

@ayushjhanwar-png

Copy link
Copy Markdown

…_sort and csv logging per byte

- Added csvDataSizeBytes to ImportStageResult interface
- Calculate actual CSV size being sent to ClickHouse
- Log CSV size in MB for each batch and final batch
- Helps monitor data volume during imports

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@ayushjhanwar-png
ayushjhanwar-png force-pushed the fix/import-memory-optimization-and-csv-logging branch from b411cfe to f370f93 Compare February 3, 2026 07:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant