google_container_cluster: min_master_version Error 400 "No valid versions with the prefix (prefix) found."

[glasnt]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request.
• Please do not leave +1 or me too comments, they generate extra noise for issue followers and do not help prioritize the request.
• If you are interested in working on this issue or have submitted a pull request, please leave a comment.
• If an issue is assigned to a user, that user is claiming responsibility for the issue.
• Customers working with a Google Technical Account Manager or Customer Engineer can ask them to reach out internally to expedite investigation and resolution of this issue.

Terraform Version & Provider Version(s)

Terraform vX.X.X
on gcr.io/cloud-foundation-cicd/cft/developer-tools:1.23

• provider registry.terraform.io/hashicorp/google v6.27.0
• provider registry.terraform.io/hashicorp/google-beta v6.27.0

Affected Resource(s)

google_container_cluster

Terraform Configuration

resource "google_container_cluster" "default" {
  name               = "default"
  location           = "us-central1-a"
  initial_node_count = 1
  # Set `min_master_version` because secondary_boot_disks require GKE 1.28.3-gke.106700 or later.
  min_master_version = "1.28"
  # Setting `deletion_protection` to `true` would prevent
  # accidental deletion of this instance using Terraform.
  deletion_protection = false
}

https://github.com/terraform-google-modules/terraform-docs-samples/blob/2f6d313346987c0e27c2903fe569d168836d2d2e/gke/standard/zonal/secondary-boot-disk/main.tf#L1

Debug Output

Returning due to fatal error: FatalError{Underlying: error while running command: exit status 1; 
Error: googleapi: Error 400: No valid versions with the prefix "1.28" found.
Details:
[
  {
    "@type": "type.googleapis.com/google.rpc.RequestInfo",
    "requestId": "0x42e36d83de7f21db"
  }
]
, badRequest

Full log https://github.com/terraform-google-modules/terraform-docs-samples/runs/39646325722

Expected Behavior

If a min_master_version is defined that is earlier than the available versions, then it shouldn't error, it should just be ignored.

Actual Behavior

Error 400: No valid versions with the prefix "1.28" found.

Steps to reproduce

1. terraform apply

Important Factoids

This version is also referenced in https://cloud.google.com/kubernetes-engine/docs/how-to/data-container-image-preloading

References

No response

b/407600526

[rileykarson]

Personally I don't entirely agree that we should ignore the value if the specified version is unavailable in GKE- it's a bit surprising of behaviour and would take an extra call to figure out the current versions- but it's also a bit surprising that the "minimum" version specified is also reused as the initial version on creation given it's not well-covered by https://registry.terraform.io/providers/hashicorp/google/latest/docs/resources/container_cluster#min_master_version-1

Forwarding to GKE team to decide on handling, though.