regex matches only the last occurence

[blezoray]

How are you running Renovate?

Self-hosted Renovate

If you're self-hosting Renovate, tell us which platform (GitHub, GitLab, etc) and which version of Renovate.

local

Please tell us more about your question or problem

Hello,

I have the following file that contains several helm releases, with their repo, ...

myfluentd:
  repo: https://repos.tech.orange/artifactory/mpms-openshift-virt-helm-stable
  chart: orange-fluentd
  version: 1.6.0
  values: helmValues/orange-fluentd.yaml
  historyMax: 2

myprometheus:
  repo: https://repos.tech.orange/artifactory/mpms-openshift-virt-helm-stable
  chart: orange-prometheus
  version: 1.6.2
  values: helmValues/orange-prometheus.yaml
  historyMax: 2

vector:
  repo: https://repos.tech.orange/artifactory/mpms-openshift-virt-helm-stable
  chart: orange-vector
  version: 0.38.1
  values: helmValues/orange-vector.yaml
  historyMax: 2

To detect new helm version, I created this renovate.json config:

{
  "$schema": "https://docs.renovatebot.com/renovate-schema.json",
  "extends": [
    "config:recommended",
    ":dependencyDashboard"
  ],
  "labels": [
    "dependencies"
  ],
  "customManagers": [
    {
      "description": "helmRequirements file",
      "customType": "regex",
      "fileMatch": [
        "openshift-deploy/.*/helmRequirements\\.y[a]*ml$"
      ],
      "matchStringsStrategy": "combination",
      "matchStrings": [
        "^(?<helmRelease>.+?):\\s+\\n",
        "version:\\s+(?<currentValue>.*?)\\n",
        "repo:\\s+(?<registryUrl>.*?)\\n",
        "chart:\\s+(?<depName>.*?)\\n"
      ],
      "datasourceTemplate": "helm",
      "versioningTemplate": "semver"
    }
  ]
}

When I run renovate with this config locally, it matches on the last helm entry:

$ docker run --rm -v "${PWD}:/usr/src/app" -e LOG_LEVEL=debug -e "RENOVATE_CONFIG_FILE=/usr/src/app/.gitlab/renovate.json" renovate/renovate --platform=local --repository-cache=reset
DEBUG: Using RE2 regex engine
DEBUG: Parsing configs
DEBUG: Checking for config file in /usr/src/app/.gitlab/renovate.json
DEBUG: File config
       "config": {
         "$schema": "https://docs.renovatebot.com/renovate-schema.json",
         "extends": ["config:recommended", ":dependencyDashboard"],
         "labels": ["dependencies"],
         "customManagers": [
           {
             "description": ["helmRequirements file"],
             "customType": "regex",
             "fileMatch": ["openshift-deploy/.*/helmRequirements\\.y[a]*ml$"],
             "matchStringsStrategy": "combination",
             "matchStrings": [
               "^(?<helmRelease>.+?):\\s+\\n",
               "version:\\s+(?<currentValue>.*?)\\n",
               "repo:\\s+(?<registryUrl>.*?)\\n",
               "chart:\\s+(?<depName>.*?)\\n"
             ],
             "datasourceTemplate": "helm",
             "versioningTemplate": "semver"
           }
         ]
       }
...
DEBUG: packageFiles with updates (repository=local)
       "config": {
         "gitlabci-include": [
           {
             "deps": [
               {
                 "datasource": "gitlab-tags",
                 "depName": "diod/market/deploy",
                 "depType": "repository",
                 "currentValue": "4.5.3",
                 "updates": [],
                 "packageName": "diod/market/deploy",
                 "versioning": "semver-coerced",
                 "warnings": [
                   {
                     "topic": "diod/market/deploy",
                     "message": "Failed to look up gitlab-tags package diod/market/deploy"
                   }
                 ]
               }
             ],
             "packageFile": ".gitlab-ci.yml"
           }
         ],
         "regex": [
           {
             "deps": [
               {
                 "depName": "orange-vector",
                 "currentValue": "0.38.1",
                 "datasource": "helm",
                 "versioning": "semver",
                 "registryUrls": [
                   "https://repos.tech.orange/artifactory/mpms-openshift-virt-helm-stable"
                 ],
                 "replaceString": "version: 0.38.1\n",
                 "updates": [],
                 "packageName": "orange-vector",
                 "warnings": [],
                 "sourceUrl": "https://gitlab.tech.orange/diod-marketplace-services/services/vector/orange-vector-helm",
                 "registryUrl": "https://repos.tech.orange/artifactory/mpms-openshift-virt-helm-stable",
                 "homepage": "https://vector.dev/",
                 "currentVersion": "0.38.1",
                 "currentVersionTimestamp": "2024-12-12T16:39:37.155Z",
                 "currentVersionAgeInDays": 76,
                 "fixedVersion": "0.38.1"
               }
             ],
             "matchStrings": [
               "^(?<helmRelease>.+?):\\s+\\n",
               "version:\\s+(?<currentValue>.*?)\\n",
               "repo:\\s+(?<registryUrl>.*?)\\n",
               "chart:\\s+(?<depName>.*?)\\n"
             ],
             "matchStringsStrategy": "combination",
             "datasourceTemplate": "helm",
             "versioningTemplate": "semver",
             "packageFile": "openshift-deploy/base/helmRequirements.yml"
           },
           {
             "deps": [
               {
                 "depName": "orange-vector",
                 "currentValue": "0.38.1",
                 "datasource": "helm",
                 "versioning": "semver",
                 "registryUrls": [
                   "https://repos.tech.orange/artifactory/mpms-openshift-virt-helm-stable"
                 ],
                 "replaceString": "version: 0.38.1\n",
                 "updates": [],
                 "packageName": "orange-vector",
                 "warnings": [],
                 "sourceUrl": "https://gitlab.tech.orange/diod-marketplace-services/services/vector/orange-vector-helm",
                 "registryUrl": "https://repos.tech.orange/artifactory/mpms-openshift-virt-helm-stable",
                 "homepage": "https://vector.dev/",
                 "currentVersion": "0.38.1",
                 "currentVersionTimestamp": "2024-12-12T16:39:37.155Z",
                 "currentVersionAgeInDays": 76,
                 "fixedVersion": "0.38.1"
               }
             ],
             "matchStrings": [
               "^(?<helmRelease>.+?):\\s+\\n",
               "version:\\s+(?<currentValue>.*?)\\n",
               "repo:\\s+(?<registryUrl>.*?)\\n",
               "chart:\\s+(?<depName>.*?)\\n"
             ],
             "matchStringsStrategy": "combination",
             "datasourceTemplate": "helm",
             "versioningTemplate": "semver",
             "packageFile": "openshift-deploy/base/helmRequirements.yml"
           }
         ]
       }
...

Any idea to match all the entries of this file ?

Logs (if relevant)

Logs

Replace this text with your logs, between the starting and ending triple backticks

[viceice]

use jsonata custom manager it supports yaml files too

[blezoray]

No more success with this config

{
  "$schema": "https://docs.renovatebot.com/renovate-schema.json",
  "extends": [
    "config:recommended",
    ":dependencyDashboard"
  ],
  "labels": [
    "dependencies"
  ],
  "customManagers": [
    {
      "description": "helmRequirements file",
      "customType": "jsonata",
      "fileMatch": [
        "openshift-deploy/.*/helmRequirements\\.y[a]*ml$"
      ],
      "fileFormat": "yaml",
      "matchStrings": [
        "*.{\"depName\": chart, \"currentValue\": version, \"registryUrl\": repo}"
      ],
      "datasourceTemplate": "helm",
      "versioningTemplate": "semver"
    }
  ]
}

[viceice]

logs?

[blezoray]

The log:
renovate.log

[blezoray]

any advice ?

[blezoray]

I created this project with public helm repos in order to reproduce the issue:
https://github.com/blezoray/renovate-34526