LAB-215: Configured migrated account events topic + some cleanup #1048

tosan88 · 2025-10-30T14:34:03Z

A prerequisite to https://github.com/utilitywarehouse/go-mono/pull/2912

linear · 2025-10-30T14:34:06Z

LAB-215 Rewrite reconciliation of account balances

sys-terraform-applier · 2025-10-30T14:34:20Z

Auto plan is disabled for this PR.
Please post @terraform-applier plan <module_name> as comment if you want to request terraform plan for a particular module.

tosan88 · 2025-10-30T14:39:49Z

@terraform-applier plan all

sys-terraform-applier · 2025-10-30T14:50:11Z

Terraform run output for

Cluster: dev-aws
Module: pubsub/kafka-shared-msk-ledgers
Path: dev-aws/kafka-shared-msk/ledgers
Commit ID: 7d7a64b140a91866badc72a06262052881ce07e2

✅ Run Status: Ok, Run Summary: Plan: 5 to add, 0 to change, 5 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  + create
  - destroy

Terraform will perform the following actions:

  # kafka_topic.migrated_account_events will be created
  + resource "kafka_topic" "migrated_account_events" {
      + config             = {
          + "cleanup.policy"   = "delete"
          + "compression.type" = "zstd"
          + "retention.ms"     = "1800000"
        }
      + id                 = (known after apply)
      + name               = "ledgers.account.migrated.events"
      + partitions         = 10
      + replication_factor = 3
    }

  # kafka_topic.synthetic_account_balance_events will be destroyed
  # (because kafka_topic.synthetic_account_balance_events is not in configuration)
  - resource "kafka_topic" "synthetic_account_balance_events" {
      - config             = {
          - "cleanup.policy"   = "delete"
          - "compression.type" = "zstd"
          - "retention.ms"     = "1800000"
        } -> null
      - id                 = "ledgers.synthetic-account-balance.events" -> null
      - name               = "ledgers.synthetic-account-balance.events" -> null
      - partitions         = 10 -> null
      - replication_factor = 3 -> null
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-api"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because key ["ledgers.synthetic-account-balance.events"] is not in for_each map)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-api" -> null
      - id                           = "User:CN=ledgers/ledger-api|*|Write|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_consumer.kafka_acl.group_acl["ledgers.ledger-consumer"] will be created
  + resource "kafka_acl" "group_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.ledger-consumer"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Group"
    }

  # module.ledger_consumer.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_consumer.kafka_acl.topic_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "topic_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_operational.kafka_acl.group_acl["ledgers.ledger-operational"] will be destroyed
  # (because kafka_acl.group_acl is not in configuration)
  - resource "kafka_acl" "group_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Group|ledgers.ledger-operational|Literal" -> null
      - resource_name                = "ledgers.ledger-operational" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Group" -> null
    }

  # module.ledger_operational.kafka_acl.producer_acl["ledgers.account-balance.events"] will be destroyed
  # (because kafka_acl.producer_acl is not in configuration)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Write|Allow|Topic|ledgers.account-balance.events|Literal" -> null
      - resource_name                = "ledgers.account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_operational.kafka_acl.topic_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because kafka_acl.topic_acl is not in configuration)
  - resource "kafka_acl" "topic_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

Plan: 5 to add, 0 to change, 5 to destroy.

To manually trigger plan again please post @terraform-applier plan dev-aws/kafka-shared-msk/ledgers as comment.

sys-terraform-applier · 2025-10-30T14:50:12Z

Terraform run output for

Cluster: dev-aws
Module: pubsub/kafka-shared-msk-backup-bucket-retention
Path: dev-aws/kafka-shared-msk/msk-backup-bucket-retention
Commit ID: f934e346164b31bfeffd13c31e6566a71fc6452b

✅ Run Status: Ok, Run Summary: Plan: 0 to add, 1 to change, 0 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  ~ update in-place

Terraform will perform the following actions:

  # aws_s3_bucket_lifecycle_configuration.msk_topics_retention will be updated in-place
  ~ resource "aws_s3_bucket_lifecycle_configuration" "msk_topics_retention" {
        id                                     = "uw-dev-pubsub-msk-backup"
        # (4 unchanged attributes hidden)

      ~ rule {
          ~ id     = "ledgers.synthetic-account-balance.events" -> "ledgers.account.migrated.events"
            # (2 unchanged attributes hidden)

          ~ filter {
              ~ prefix = "msk-backup-parquet/ledgers.synthetic-account-balance.events/" -> "msk-backup-parquet/ledgers.account.migrated.events/"
            }

            # (1 unchanged block hidden)
        }

        # (183 unchanged blocks hidden)
    }

Plan: 0 to add, 1 to change, 0 to destroy.

To manually trigger plan again please post @terraform-applier plan dev-aws/kafka-shared-msk/msk-backup-bucket-retention as comment.

sys-terraform-applier · 2025-10-30T14:54:21Z

Terraform run output for

Cluster: prod-aws
Module: pubsub/kafka-shared-msk-ledgers
Path: prod-aws/kafka-shared-msk/ledgers
Commit ID: 7d7a64b140a91866badc72a06262052881ce07e2

✅ Run Status: Ok, Run Summary: Plan: 5 to add, 0 to change, 5 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  + create
  - destroy

Terraform will perform the following actions:

  # kafka_topic.migrated_account_events will be created
  + resource "kafka_topic" "migrated_account_events" {
      + config             = {
          + "cleanup.policy"        = "delete"
          + "compression.type"      = "zstd"
          + "local.retention.ms"    = "172800000"
          + "remote.storage.enable" = "true"
          + "retention.ms"          = "2629800000"
        }
      + id                 = (known after apply)
      + name               = "ledgers.account.migrated.events"
      + partitions         = 10
      + replication_factor = 3
    }

  # kafka_topic.synthetic_account_balance_events will be destroyed
  # (because kafka_topic.synthetic_account_balance_events is not in configuration)
  - resource "kafka_topic" "synthetic_account_balance_events" {
      - config             = {
          - "cleanup.policy"   = "delete"
          - "compression.type" = "zstd"
          - "retention.ms"     = "1800000"
        } -> null
      - id                 = "ledgers.synthetic-account-balance.events" -> null
      - name               = "ledgers.synthetic-account-balance.events" -> null
      - partitions         = 10 -> null
      - replication_factor = 3 -> null
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-api"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because key ["ledgers.synthetic-account-balance.events"] is not in for_each map)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-api" -> null
      - id                           = "User:CN=ledgers/ledger-api|*|Write|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_consumer.kafka_acl.group_acl["ledgers.ledger-consumer"] will be created
  + resource "kafka_acl" "group_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.ledger-consumer"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Group"
    }

  # module.ledger_consumer.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_consumer.kafka_acl.topic_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "topic_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_operational.kafka_acl.group_acl["ledgers.ledger-operational"] will be destroyed
  # (because kafka_acl.group_acl is not in configuration)
  - resource "kafka_acl" "group_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Group|ledgers.ledger-operational|Literal" -> null
      - resource_name                = "ledgers.ledger-operational" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Group" -> null
    }

  # module.ledger_operational.kafka_acl.producer_acl["ledgers.account-balance.events"] will be destroyed
  # (because kafka_acl.producer_acl is not in configuration)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Write|Allow|Topic|ledgers.account-balance.events|Literal" -> null
      - resource_name                = "ledgers.account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_operational.kafka_acl.topic_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because kafka_acl.topic_acl is not in configuration)
  - resource "kafka_acl" "topic_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

Plan: 5 to add, 0 to change, 5 to destroy.

To manually trigger plan again please post @terraform-applier plan prod-aws/kafka-shared-msk/ledgers as comment.

sys-terraform-applier · 2025-10-30T14:54:21Z

Terraform run output for

Cluster: prod-aws
Module: pubsub/kafka-shared-msk-backup-bucket-retention
Path: prod-aws/kafka-shared-msk/msk-backup-bucket-retention
Commit ID: f934e346164b31bfeffd13c31e6566a71fc6452b

✅ Run Status: Ok, Run Summary: Plan: 0 to add, 1 to change, 0 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  ~ update in-place

Terraform will perform the following actions:

  # aws_s3_bucket_lifecycle_configuration.msk_topics_retention will be updated in-place
  ~ resource "aws_s3_bucket_lifecycle_configuration" "msk_topics_retention" {
        id                                     = "uw-prod-pubsub-msk-backup"
        # (4 unchanged attributes hidden)

      ~ rule {
          ~ id     = "ledgers.synthetic-account-balance.events" -> "ledgers.account.migrated.events"
            # (2 unchanged attributes hidden)

          ~ expiration {
              ~ days                         = 1 -> 31
                # (1 unchanged attribute hidden)
            }

          ~ filter {
              ~ prefix = "msk-backup-parquet/ledgers.synthetic-account-balance.events/" -> "msk-backup-parquet/ledgers.account.migrated.events/"
            }
        }

        # (173 unchanged blocks hidden)
    }

Plan: 0 to add, 1 to change, 0 to destroy.

To manually trigger plan again please post @terraform-applier plan prod-aws/kafka-shared-msk/msk-backup-bucket-retention as comment.

dev-aws/kafka-shared-msk/ledgers/ledger.tf

…igr-evt

sys-terraform-applier · 2025-10-30T15:13:00Z

Terraform run output for

Cluster: dev-aws
Module: pubsub/kafka-shared-msk-ledgers
Path: dev-aws/kafka-shared-msk/ledgers
Commit ID: 06311341acae573a83383d36648d40850382486f

✅ Run Status: Ok, Run Summary: Plan: 5 to add, 0 to change, 5 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  + create
  - destroy

Terraform will perform the following actions:

  # kafka_topic.account_migrated_events will be created
  + resource "kafka_topic" "account_migrated_events" {
      + config             = {
          + "cleanup.policy"   = "delete"
          + "compression.type" = "zstd"
          + "retention.ms"     = "1800000"
        }
      + id                 = (known after apply)
      + name               = "ledgers.account.migrated.events"
      + partitions         = 10
      + replication_factor = 3
    }

  # kafka_topic.synthetic_account_balance_events will be destroyed
  # (because kafka_topic.synthetic_account_balance_events is not in configuration)
  - resource "kafka_topic" "synthetic_account_balance_events" {
      - config             = {
          - "cleanup.policy"   = "delete"
          - "compression.type" = "zstd"
          - "retention.ms"     = "1800000"
        } -> null
      - id                 = "ledgers.synthetic-account-balance.events" -> null
      - name               = "ledgers.synthetic-account-balance.events" -> null
      - partitions         = 10 -> null
      - replication_factor = 3 -> null
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-api"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because key ["ledgers.synthetic-account-balance.events"] is not in for_each map)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-api" -> null
      - id                           = "User:CN=ledgers/ledger-api|*|Write|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_consumer.kafka_acl.group_acl["ledgers.ledger-consumer"] will be created
  + resource "kafka_acl" "group_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.ledger-consumer"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Group"
    }

  # module.ledger_consumer.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_consumer.kafka_acl.topic_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "topic_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_operational.kafka_acl.group_acl["ledgers.ledger-operational"] will be destroyed
  # (because kafka_acl.group_acl is not in configuration)
  - resource "kafka_acl" "group_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Group|ledgers.ledger-operational|Literal" -> null
      - resource_name                = "ledgers.ledger-operational" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Group" -> null
    }

  # module.ledger_operational.kafka_acl.producer_acl["ledgers.account-balance.events"] will be destroyed
  # (because kafka_acl.producer_acl is not in configuration)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Write|Allow|Topic|ledgers.account-balance.events|Literal" -> null
      - resource_name                = "ledgers.account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_operational.kafka_acl.topic_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because kafka_acl.topic_acl is not in configuration)
  - resource "kafka_acl" "topic_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

Plan: 5 to add, 0 to change, 5 to destroy.

To manually trigger plan again please post @terraform-applier plan dev-aws/kafka-shared-msk/ledgers as comment.

sys-terraform-applier · 2025-10-30T15:13:25Z

Terraform run output for

Cluster: prod-aws
Module: pubsub/kafka-shared-msk-ledgers
Path: prod-aws/kafka-shared-msk/ledgers
Commit ID: 06311341acae573a83383d36648d40850382486f

✅ Run Status: Ok, Run Summary: Plan: 5 to add, 0 to change, 5 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  + create
  - destroy

Terraform will perform the following actions:

  # kafka_topic.account_migrated_events will be created
  + resource "kafka_topic" "account_migrated_events" {
      + config             = {
          + "cleanup.policy"        = "delete"
          + "compression.type"      = "zstd"
          + "local.retention.ms"    = "172800000"
          + "remote.storage.enable" = "true"
          + "retention.ms"          = "2629800000"
        }
      + id                 = (known after apply)
      + name               = "ledgers.account.migrated.events"
      + partitions         = 10
      + replication_factor = 3
    }

  # kafka_topic.synthetic_account_balance_events will be destroyed
  # (because kafka_topic.synthetic_account_balance_events is not in configuration)
  - resource "kafka_topic" "synthetic_account_balance_events" {
      - config             = {
          - "cleanup.policy"   = "delete"
          - "compression.type" = "zstd"
          - "retention.ms"     = "1800000"
        } -> null
      - id                 = "ledgers.synthetic-account-balance.events" -> null
      - name               = "ledgers.synthetic-account-balance.events" -> null
      - partitions         = 10 -> null
      - replication_factor = 3 -> null
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-api"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because key ["ledgers.synthetic-account-balance.events"] is not in for_each map)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-api" -> null
      - id                           = "User:CN=ledgers/ledger-api|*|Write|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_consumer.kafka_acl.group_acl["ledgers.ledger-consumer"] will be created
  + resource "kafka_acl" "group_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.ledger-consumer"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Group"
    }

  # module.ledger_consumer.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_consumer.kafka_acl.topic_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "topic_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_operational.kafka_acl.group_acl["ledgers.ledger-operational"] will be destroyed
  # (because kafka_acl.group_acl is not in configuration)
  - resource "kafka_acl" "group_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Group|ledgers.ledger-operational|Literal" -> null
      - resource_name                = "ledgers.ledger-operational" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Group" -> null
    }

  # module.ledger_operational.kafka_acl.producer_acl["ledgers.account-balance.events"] will be destroyed
  # (because kafka_acl.producer_acl is not in configuration)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Write|Allow|Topic|ledgers.account-balance.events|Literal" -> null
      - resource_name                = "ledgers.account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_operational.kafka_acl.topic_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because kafka_acl.topic_acl is not in configuration)
  - resource "kafka_acl" "topic_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

Plan: 5 to add, 0 to change, 5 to destroy.

To manually trigger plan again please post @terraform-applier plan prod-aws/kafka-shared-msk/ledgers as comment.

AtakanColakSoftwire

lgtm

sys-terraform-applier · 2025-10-31T07:38:39Z

Terraform run output for

Cluster: dev-aws
Module: pubsub/kafka-shared-msk-ledgers
Path: dev-aws/kafka-shared-msk/ledgers
Commit ID: 60105a1c2d7bcf06c1ea8f79c2eef1807c1a4720

✅ Run Status: Ok, Run Summary: Apply complete! Resources: 5 added, 0 changed, 5 destroyed

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  + create
  - destroy

Terraform will perform the following actions:

  # kafka_topic.account_migrated_events will be created
  + resource "kafka_topic" "account_migrated_events" {
      + config             = {
          + "cleanup.policy"   = "delete"
          + "compression.type" = "zstd"
          + "retention.ms"     = "1800000"
        }
      + id                 = (known after apply)
      + name               = "ledgers.account.migrated.events"
      + partitions         = 10
      + replication_factor = 3
    }

  # kafka_topic.synthetic_account_balance_events will be destroyed
  # (because kafka_topic.synthetic_account_balance_events is not in configuration)
  - resource "kafka_topic" "synthetic_account_balance_events" {
      - config             = {
          - "cleanup.policy"   = "delete"
          - "compression.type" = "zstd"
          - "retention.ms"     = "1800000"
        } -> null
      - id                 = "ledgers.synthetic-account-balance.events" -> null
      - name               = "ledgers.synthetic-account-balance.events" -> null
      - partitions         = 10 -> null
      - replication_factor = 3 -> null
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-api"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because key ["ledgers.synthetic-account-balance.events"] is not in for_each map)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-api" -> null
      - id                           = "User:CN=ledgers/ledger-api|*|Write|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_consumer.kafka_acl.group_acl["ledgers.ledger-consumer"] will be created
  + resource "kafka_acl" "group_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.ledger-consumer"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Group"
    }

  # module.ledger_consumer.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_consumer.kafka_acl.topic_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "topic_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_operational.kafka_acl.group_acl["ledgers.ledger-operational"] will be destroyed
  # (because kafka_acl.group_acl is not in configuration)
  - resource "kafka_acl" "group_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Group|ledgers.ledger-operational|Literal" -> null
      - resource_name                = "ledgers.ledger-operational" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Group" -> null
    }

  # module.ledger_operational.kafka_acl.producer_acl["ledgers.account-balance.events"] will be destroyed
  # (because kafka_acl.producer_acl is not in configuration)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Write|Allow|Topic|ledgers.account-balance.events|Literal" -> null
      - resource_name                = "ledgers.account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_operational.kafka_acl.topic_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because kafka_acl.topic_acl is not in configuration)
  - resource "kafka_acl" "topic_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

Plan: 5 to add, 0 to change, 5 to destroy.
module.ledger_api.kafka_acl.producer_acl["ledgers.synthetic-account-balance.events"]: Destroying... [id=User:CN=ledgers/ledger-api|*|Write|Allow|Topic|ledgers.synthetic-account-balance.events|Literal]
module.ledger_operational.kafka_acl.topic_acl["ledgers.synthetic-account-balance.events"]: Destroying... [id=User:CN=ledgers/ledger-operational|*|Read|Allow|Topic|ledgers.synthetic-account-balance.events|Literal]
module.ledger_operational.kafka_acl.group_acl["ledgers.ledger-operational"]: Destroying... [id=User:CN=ledgers/ledger-operational|*|Read|Allow|Group|ledgers.ledger-operational|Literal]
module.ledger_operational.kafka_acl.producer_acl["ledgers.account-balance.events"]: Destroying... [id=User:CN=ledgers/ledger-operational|*|Write|Allow|Topic|ledgers.account-balance.events|Literal]
kafka_topic.account_migrated_events: Creating...
module.ledger_consumer.kafka_acl.group_acl["ledgers.ledger-consumer"]: Creating...
module.ledger_consumer.kafka_acl.group_acl["ledgers.ledger-consumer"]: Creation complete after 1s [id=User:CN=ledgers/ledger-consumer|*|Read|Allow|Group|ledgers.ledger-consumer|Literal]
module.ledger_operational.kafka_acl.group_acl["ledgers.ledger-operational"]: Destruction complete after 1s
module.ledger_operational.kafka_acl.topic_acl["ledgers.synthetic-account-balance.events"]: Destruction complete after 1s
module.ledger_api.kafka_acl.producer_acl["ledgers.synthetic-account-balance.events"]: Destruction complete after 1s
module.ledger_operational.kafka_acl.producer_acl["ledgers.account-balance.events"]: Destruction complete after 1s
kafka_topic.synthetic_account_balance_events: Destroying... [id=ledgers.synthetic-account-balance.events]
kafka_topic.account_migrated_events: Creation complete after 1s [id=ledgers.account.migrated.events]
module.ledger_consumer.kafka_acl.producer_acl["ledgers.account.migrated.events"]: Creating...
module.ledger_consumer.kafka_acl.topic_acl["ledgers.account.migrated.events"]: Creating...
module.ledger_api.kafka_acl.producer_acl["ledgers.account.migrated.events"]: Creating...
module.ledger_consumer.kafka_acl.producer_acl["ledgers.account.migrated.events"]: Creation complete after 1s [id=User:CN=ledgers/ledger-consumer|*|Write|Allow|Topic|ledgers.account.migrated.events|Literal]
module.ledger_consumer.kafka_acl.topic_acl["ledgers.account.migrated.events"]: Creation complete after 1s [id=User:CN=ledgers/ledger-consumer|*|Read|Allow|Topic|ledgers.account.migrated.events|Literal]
module.ledger_api.kafka_acl.producer_acl["ledgers.account.migrated.events"]: Creation complete after 1s [id=User:CN=ledgers/ledger-api|*|Write|Allow|Topic|ledgers.account.migrated.events|Literal]
kafka_topic.synthetic_account_balance_events: Destruction complete after 4s

Warning: Argument is deprecated

  with provider["registry.terraform.io/mongey/kafka"],
  on __env.tf line 12, in provider "kafka":
  12: provider "kafka" {

This parameter is now deprecated and will be removed in a later release,
please use `client_key` instead.

(and one more similar warning elsewhere)

Apply complete! Resources: 5 added, 0 changed, 5 destroyed.

To manually trigger plan again please post @terraform-applier plan dev-aws/kafka-shared-msk/ledgers as comment.

sys-terraform-applier · 2025-10-31T07:39:31Z

Terraform run output for

Cluster: prod-aws
Module: pubsub/kafka-shared-msk-ledgers
Path: prod-aws/kafka-shared-msk/ledgers
Commit ID: 60105a1c2d7bcf06c1ea8f79c2eef1807c1a4720

⛔ Run Status: Errored, Run Summary: unable to apply module

{
  "terraform_version": "1.13.3",
  "platform": "linux_amd64",
  "provider_selections": {},
  "terraform_outdated": true
}
Initializing the backend...

Successfully configured the backend "s3"! Terraform will automatically
use this backend unless the backend configuration changes.
Initializing modules...
- ledger_api in ../../../modules/tls-app
- ledger_consumer in ../../../modules/tls-app
Initializing provider plugins...
- Finding mongey/kafka versions matching ">= 0.7.0"...
- Using mongey/kafka v0.13.1 from the shared cache directory
Terraform has created a lock file .terraform.lock.hcl to record the provider
selections it made above. Include this file in your version control repository
so that Terraform can guarantee to make the same selections by default when
you run "terraform init" in the future.


Warning: Incomplete lock file information for providers

Due to your customized provider installation methods, Terraform was forced to
calculate lock file checksums locally for the following providers:
  - mongey/kafka

The current .terraform.lock.hcl file only includes checksums for linux_amd64,
so Terraform running on another platform will fail to install these
providers.

To calculate additional checksums for another platform, run:
  terraform providers lock -platform=linux_amd64
(where linux_amd64 is the platform to generate)
Terraform has been successfully initialized!

unable to apply module

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  + create
  - destroy

Terraform will perform the following actions:

  # kafka_topic.account_migrated_events will be created
  + resource "kafka_topic" "account_migrated_events" {
      + config             = {
          + "cleanup.policy"        = "delete"
          + "compression.type"      = "zstd"
          + "local.retention.ms"    = "172800000"
          + "remote.storage.enable" = "true"
          + "retention.ms"          = "2629800000"
        }
      + id                 = (known after apply)
      + name               = "ledgers.account.migrated.events"
      + partitions         = 10
      + replication_factor = 3
    }

  # kafka_topic.synthetic_account_balance_events will be destroyed
  # (because kafka_topic.synthetic_account_balance_events is not in configuration)
  - resource "kafka_topic" "synthetic_account_balance_events" {
      - config             = {
          - "cleanup.policy"   = "delete"
          - "compression.type" = "zstd"
          - "retention.ms"     = "1800000"
        } -> null
      - id                 = "ledgers.synthetic-account-balance.events" -> null
      - name               = "ledgers.synthetic-account-balance.events" -> null
      - partitions         = 10 -> null
      - replication_factor = 3 -> null
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-api"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_api.kafka_acl.producer_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because key ["ledgers.synthetic-account-balance.events"] is not in for_each map)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-api" -> null
      - id                           = "User:CN=ledgers/ledger-api|*|Write|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_consumer.kafka_acl.group_acl["ledgers.ledger-consumer"] will be created
  + resource "kafka_acl" "group_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.ledger-consumer"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Group"
    }

  # module.ledger_consumer.kafka_acl.producer_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "producer_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Write"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_consumer.kafka_acl.topic_acl["ledgers.account.migrated.events"] will be created
  + resource "kafka_acl" "topic_acl" {
      + acl_host                     = "*"
      + acl_operation                = "Read"
      + acl_permission_type          = "Allow"
      + acl_principal                = "User:CN=ledgers/ledger-consumer"
      + id                           = (known after apply)
      + resource_name                = "ledgers.account.migrated.events"
      + resource_pattern_type_filter = "Literal"
      + resource_type                = "Topic"
    }

  # module.ledger_operational.kafka_acl.group_acl["ledgers.ledger-operational"] will be destroyed
  # (because kafka_acl.group_acl is not in configuration)
  - resource "kafka_acl" "group_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Group|ledgers.ledger-operational|Literal" -> null
      - resource_name                = "ledgers.ledger-operational" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Group" -> null
    }

  # module.ledger_operational.kafka_acl.producer_acl["ledgers.account-balance.events"] will be destroyed
  # (because kafka_acl.producer_acl is not in configuration)
  - resource "kafka_acl" "producer_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Write" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Write|Allow|Topic|ledgers.account-balance.events|Literal" -> null
      - resource_name                = "ledgers.account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

  # module.ledger_operational.kafka_acl.topic_acl["ledgers.synthetic-account-balance.events"] will be destroyed
  # (because kafka_acl.topic_acl is not in configuration)
  - resource "kafka_acl" "topic_acl" {
      - acl_host                     = "*" -> null
      - acl_operation                = "Read" -> null
      - acl_permission_type          = "Allow" -> null
      - acl_principal                = "User:CN=ledgers/ledger-operational" -> null
      - id                           = "User:CN=ledgers/ledger-operational|*|Read|Allow|Topic|ledgers.synthetic-account-balance.events|Literal" -> null
      - resource_name                = "ledgers.synthetic-account-balance.events" -> null
      - resource_pattern_type_filter = "Literal" -> null
      - resource_type                = "Topic" -> null
    }

Plan: 5 to add, 0 to change, 5 to destroy.
module.ledger_operational.kafka_acl.group_acl["ledgers.ledger-operational"]: Destroying... [id=User:CN=ledgers/ledger-operational|*|Read|Allow|Group|ledgers.ledger-operational|Literal]
module.ledger_operational.kafka_acl.topic_acl["ledgers.synthetic-account-balance.events"]: Destroying... [id=User:CN=ledgers/ledger-operational|*|Read|Allow|Topic|ledgers.synthetic-account-balance.events|Literal]
module.ledger_api.kafka_acl.producer_acl["ledgers.synthetic-account-balance.events"]: Destroying... [id=User:CN=ledgers/ledger-api|*|Write|Allow|Topic|ledgers.synthetic-account-balance.events|Literal]
module.ledger_operational.kafka_acl.producer_acl["ledgers.account-balance.events"]: Destroying... [id=User:CN=ledgers/ledger-operational|*|Write|Allow|Topic|ledgers.account-balance.events|Literal]
kafka_topic.account_migrated_events: Creating...
module.ledger_consumer.kafka_acl.group_acl["ledgers.ledger-consumer"]: Creating...
module.ledger_consumer.kafka_acl.group_acl["ledgers.ledger-consumer"]: Creation complete after 0s [id=User:CN=ledgers/ledger-consumer|*|Read|Allow|Group|ledgers.ledger-consumer|Literal]
module.ledger_api.kafka_acl.producer_acl["ledgers.synthetic-account-balance.events"]: Destruction complete after 0s
module.ledger_operational.kafka_acl.group_acl["ledgers.ledger-operational"]: Destruction complete after 0s
module.ledger_operational.kafka_acl.producer_acl["ledgers.account-balance.events"]: Destruction complete after 0s
module.ledger_operational.kafka_acl.topic_acl["ledgers.synthetic-account-balance.events"]: Destruction complete after 0s
kafka_topic.synthetic_account_balance_events: Destroying... [id=ledgers.synthetic-account-balance.events]
kafka_topic.account_migrated_events: Creation complete after 1s [id=ledgers.account.migrated.events]
module.ledger_consumer.kafka_acl.producer_acl["ledgers.account.migrated.events"]: Creating...
module.ledger_api.kafka_acl.producer_acl["ledgers.account.migrated.events"]: Creating...
module.ledger_consumer.kafka_acl.topic_acl["ledgers.account.migrated.events"]: Creating...
module.ledger_api.kafka_acl.producer_acl["ledgers.account.migrated.events"]: Creation complete after 0s [id=User:CN=ledgers/ledger-api|*|Write|Allow|Topic|ledgers.account.migrated.events|Literal]
module.ledger_consumer.kafka_acl.producer_acl["ledgers.account.migrated.events"]: Creation complete after 0s [id=User:CN=ledgers/ledger-consumer|*|Write|Allow|Topic|ledgers.account.migrated.events|Literal]
module.ledger_consumer.kafka_acl.topic_acl["ledgers.account.migrated.events"]: Creation complete after 0s [id=User:CN=ledgers/ledger-consumer|*|Read|Allow|Topic|ledgers.account.migrated.events|Literal]

Error: ledgers.synthetic-account-balance.events : kafka server: The client is not authorized to access this topic

To manually trigger plan again please post @terraform-applier plan prod-aws/kafka-shared-msk/ledgers as comment.

sys-terraform-applier · 2025-10-31T07:40:47Z

Terraform run output for

Cluster: prod-aws
Module: pubsub/kafka-shared-msk-backup-bucket-retention
Path: prod-aws/kafka-shared-msk/msk-backup-bucket-retention
Commit ID: 60105a1c2d7bcf06c1ea8f79c2eef1807c1a4720

✅ Run Status: Ok, Run Summary: Apply complete! Resources: 0 added, 1 changed, 0 destroyed

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  ~ update in-place

Terraform will perform the following actions:

  # aws_s3_bucket_lifecycle_configuration.msk_topics_retention will be updated in-place
  ~ resource "aws_s3_bucket_lifecycle_configuration" "msk_topics_retention" {
        id                                     = "uw-prod-pubsub-msk-backup"
        # (4 unchanged attributes hidden)

      ~ rule {
          ~ id     = "ledgers.synthetic-account-balance.events" -> "ledgers.account.migrated.events"
            # (2 unchanged attributes hidden)

          ~ expiration {
              ~ days                         = 1 -> 31
                # (1 unchanged attribute hidden)
            }

          ~ filter {
              ~ prefix = "msk-backup-parquet/ledgers.synthetic-account-balance.events/" -> "msk-backup-parquet/ledgers.account.migrated.events/"
            }
        }

        # (173 unchanged blocks hidden)
    }

Plan: 0 to add, 1 to change, 0 to destroy.
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Modifying... [id=uw-prod-pubsub-msk-backup]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Still modifying... [id=uw-prod-pubsub-msk-backup, 00m10s elapsed]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Still modifying... [id=uw-prod-pubsub-msk-backup, 00m20s elapsed]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Still modifying... [id=uw-prod-pubsub-msk-backup, 00m30s elapsed]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Still modifying... [id=uw-prod-pubsub-msk-backup, 00m40s elapsed]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Still modifying... [id=uw-prod-pubsub-msk-backup, 00m50s elapsed]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Modifications complete after 56s [id=uw-prod-pubsub-msk-backup]

Apply complete! Resources: 0 added, 1 changed, 0 destroyed.

To manually trigger plan again please post @terraform-applier plan prod-aws/kafka-shared-msk/msk-backup-bucket-retention as comment.

sys-terraform-applier · 2025-10-31T07:40:53Z

Terraform run output for

Cluster: dev-aws
Module: pubsub/kafka-shared-msk-backup-bucket-retention
Path: dev-aws/kafka-shared-msk/msk-backup-bucket-retention
Commit ID: 60105a1c2d7bcf06c1ea8f79c2eef1807c1a4720

✅ Run Status: Ok, Run Summary: Apply complete! Resources: 0 added, 1 changed, 0 destroyed

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  ~ update in-place

Terraform will perform the following actions:

  # aws_s3_bucket_lifecycle_configuration.msk_topics_retention will be updated in-place
  ~ resource "aws_s3_bucket_lifecycle_configuration" "msk_topics_retention" {
        id                                     = "uw-dev-pubsub-msk-backup"
        # (4 unchanged attributes hidden)

      ~ rule {
          ~ id     = "ledgers.synthetic-account-balance.events" -> "ledgers.account.migrated.events"
            # (2 unchanged attributes hidden)

          ~ filter {
              ~ prefix = "msk-backup-parquet/ledgers.synthetic-account-balance.events/" -> "msk-backup-parquet/ledgers.account.migrated.events/"
            }

            # (1 unchanged block hidden)
        }

        # (183 unchanged blocks hidden)
    }

Plan: 0 to add, 1 to change, 0 to destroy.
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Modifying... [id=uw-dev-pubsub-msk-backup]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Still modifying... [id=uw-dev-pubsub-msk-backup, 00m10s elapsed]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Still modifying... [id=uw-dev-pubsub-msk-backup, 00m20s elapsed]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Still modifying... [id=uw-dev-pubsub-msk-backup, 00m30s elapsed]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Still modifying... [id=uw-dev-pubsub-msk-backup, 00m40s elapsed]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Still modifying... [id=uw-dev-pubsub-msk-backup, 00m50s elapsed]
aws_s3_bucket_lifecycle_configuration.msk_topics_retention: Modifications complete after 57s [id=uw-dev-pubsub-msk-backup]

Apply complete! Resources: 0 added, 1 changed, 0 destroyed.

To manually trigger plan again please post @terraform-applier plan dev-aws/kafka-shared-msk/msk-backup-bucket-retention as comment.

Configured migrated account events topic + some cleanup

7d7a64b

[AUTOMATED]: generate files

f934e34

tosan88 marked this pull request as ready for review October 30, 2025 14:49

tosan88 requested a review from a team as a code owner October 30, 2025 14:49

ggeorgiu reviewed Oct 30, 2025

View reviewed changes

dev-aws/kafka-shared-msk/ledgers/ledger.tf Outdated Show resolved Hide resolved

tosan88 added 2 commits October 30, 2025 17:12

Review: naming

0631134

Merge remote-tracking branch 'origin/lab-acc-migr-evt' into lab-acc-m…

32393b3

…igr-evt

AtakanColakSoftwire approved these changes Oct 30, 2025

View reviewed changes

ggeorgiu approved these changes Oct 30, 2025

View reviewed changes

Merge branch 'main' into lab-acc-migr-evt

c9f2215

tosan88 merged commit 60105a1 into main Oct 31, 2025
3 checks passed

tosan88 deleted the lab-acc-migr-evt branch October 31, 2025 07:38

LAB-215: Configured migrated account events topic + some cleanup #1048

LAB-215: Configured migrated account events topic + some cleanup #1048

Uh oh!

Conversation

tosan88 commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

linear bot commented Oct 30, 2025

Uh oh!

sys-terraform-applier bot commented Oct 30, 2025

Uh oh!

tosan88 commented Oct 30, 2025

Uh oh!

sys-terraform-applier bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sys-terraform-applier bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sys-terraform-applier bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sys-terraform-applier bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

sys-terraform-applier bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sys-terraform-applier bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

AtakanColakSoftwire left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

sys-terraform-applier bot commented Oct 31, 2025

Uh oh!

sys-terraform-applier bot commented Oct 31, 2025

Uh oh!

sys-terraform-applier bot commented Oct 31, 2025

Uh oh!

sys-terraform-applier bot commented Oct 31, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

tosan88 commented Oct 30, 2025 •

edited

Loading

sys-terraform-applier bot commented Oct 30, 2025 •

edited

Loading

sys-terraform-applier bot commented Oct 30, 2025 •

edited

Loading

sys-terraform-applier bot commented Oct 30, 2025 •

edited

Loading

sys-terraform-applier bot commented Oct 30, 2025 •

edited

Loading

sys-terraform-applier bot commented Oct 30, 2025 •

edited

Loading

sys-terraform-applier bot commented Oct 30, 2025 •

edited

Loading