Column-store (based on Clickhouse) implementation for nomenklatura statement-based store for ftm entities.
Minimum Python version: 3.11
It is compatible as a store for ftmq
Set up a running clickhouse instance (pointed to via DATABASE_URI env var,
default: localhost), for developing purposes this could work:
make clickhouse
Then initialize the required table schema:
ftmcs init
Or drop existing data and recreate:
ftmcs init --recreate
When using the make clickhouse command, you can play around with SQL queries
in your browser: http://127.0.0.1:8123/play
# Insert a bunch of FtM entities into a store:
cat ftm-entities.ijson | ftmcs write -d my_dataset
# Re-create the entities in aggregated form:
ftmcs iterate -d my_dataset | alephclient write-entities -f my_dataset