Skip to content

Node affinity #125

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 128 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
128 commits
Select commit Hold shift + click to select a range
02644c2
feat: migrate to gotocompany (#2)
mabdh Mar 14, 2023
a6e7e6d
feat(meteor): add telegraf support (#1)
haveiss Mar 15, 2023
e0a6fdc
fix(compass): fix command args for server and migration (#3)
sudo-suhas Mar 15, 2023
f2e61b4
ci: don't run release for PRs (#4)
sudo-suhas Mar 15, 2023
582bfc1
fix(meteor): template telegraf wrong key (#5)
haveiss Mar 16, 2023
d41eb1a
fix(meteor): use gotocompany meteor image v0.8.0 (#6)
sudo-suhas Mar 17, 2023
190cbc1
feat(meteor): configure deadline for cron jobs (#7)
sudo-suhas Mar 20, 2023
ede393d
fix(meteor): telegraf sidecar exit coordination (#8)
haveiss Mar 21, 2023
3f46841
Update README.md
mabdh Mar 24, 2023
f71ebbd
feat: add tolerations, affinity, volumes & volumeMounts (#9)
ishanarya0 Apr 18, 2023
586a325
fix: nest volumeMount under firehose object (#10)
ishanarya0 Apr 20, 2023
6d05c95
chore: fix typo (#11)
ishanarya0 Apr 21, 2023
2577a3e
fix: nest under secret key (#12)
ishanarya0 Apr 21, 2023
db60191
feat(app): add custom pod labels (#13)
feminovia May 8, 2023
09e3209
feat(app): add custom labels to cron and migration-job (#14)
feminovia May 9, 2023
ba81880
fix: add cron job for optimus DB cleanup (#16)
Mryashbhardwaj May 9, 2023
a16f947
feat(siren): update app chart version (#15)
feminovia May 9, 2023
15480bf
feat(siren): add podLabels value in workers (#17)
feminovia May 11, 2023
92feeac
feat(compass): deprecated APIs removed in 1.25 (#19)
haveiss May 15, 2023
5668aca
feat: otel collector sidecar (#22)
spy16 Jun 8, 2023
ce18aa8
feat: bump up chart version (#23)
spy16 Jun 8, 2023
84296c2
fix: port naming & protocol issues for otel-collector (#24)
spy16 Jun 13, 2023
0e11abf
fix: change command to arg (#25)
spy16 Jun 19, 2023
f567ee0
feat: expose pod info using downward api (#26)
spy16 Jun 23, 2023
7d3add2
feat: secrets and volumes as secrets (#27)
ishanarya0 Jul 13, 2023
5f514d9
feat(firehose): set metrics config (#28)
StewartJingga Jul 26, 2023
1010920
fix: change METRIC_STATSD_PORT to string (#29)
ishanarya0 Jul 28, 2023
db8fc35
fix: change statsd port to string (#30)
ishanarya0 Jul 28, 2023
de9b9d5
fix: remove app from global tags (#31)
ishanarya0 Jul 31, 2023
f93e46c
feat: bump app chart dep for Compass v{0.5.0 => 0.5.6} (#33)
sudo-suhas Aug 1, 2023
a36f254
chore: bump up entropy app deps (#34)
mabdh Aug 8, 2023
36cbb94
chore: bump up dex app deps (#35)
mabdh Aug 8, 2023
2815b57
chore: bump shield app chart (#36)
mabdh Aug 21, 2023
579459d
fix: mount secret values to be base64 decoded (#37)
ishanarya0 Aug 22, 2023
c5da778
fix: change mount secret to use data (#39)
ishanarya0 Aug 22, 2023
d66176c
fix: volume mount secret name (#41)
ishanarya0 Aug 28, 2023
6c44d2e
feat: app and entropy support custom service account (#42)
mabdh Aug 31, 2023
51e2a06
fix: bump up app chart (#43)
mabdh Aug 31, 2023
209a310
fix: entropy support custom service account (#44)
mabdh Aug 31, 2023
cd9adda
feat(dex): update use app chart 0.1.3 (#45)
StewartJingga Sep 1, 2023
ce1d226
chore(guardian): remove optional field from secret config (#47)
bsushmith Sep 14, 2023
a48c807
fix: increase monitoring data retention (#46)
Mryashbhardwaj Sep 15, 2023
fdd704b
feat: add initContainers in app chart (#49)
mabdh Sep 19, 2023
76083ba
feat(siren): support plugin and multiple ports (#50)
mabdh Sep 19, 2023
0475cbc
fix(siren): liveness and readiness probes (#51)
mabdh Sep 19, 2023
ea377da
fix: update chart version to 0.0.5 (#48)
Mryashbhardwaj Sep 20, 2023
08da1dd
feat(app): cron support initContainers (#52)
mabdh Sep 20, 2023
a53988c
feat(siren): bump up app chart dep (#53)
mabdh Sep 20, 2023
05fa0f6
feat: add otelcollector support for meteor (#54)
batrov Oct 9, 2023
08aeeb1
feat: omit default resource limits for telegeaf (#55)
ishanarya0 Oct 18, 2023
bf1e46d
feat: add default limits & resources (#56)
ishanarya0 Oct 18, 2023
ff549bd
feat: support iap sidecar in app chart (#57)
mabdh Oct 22, 2023
eef7ea1
fix: app chart (#58)
mabdh Oct 22, 2023
eb15034
feat(siren): bump up chart and support additional services (#59)
mabdh Oct 22, 2023
1f411e6
fix(app): missing field in iap sidecar (#60)
mabdh Oct 22, 2023
79255c9
fix(siren): service selector (#61)
mabdh Oct 24, 2023
d1da6fc
feat: update default telegraf resources (#62)
ishanarya0 Oct 25, 2023
b6ecc7d
change telegraf limits (#63)
ishanarya0 Nov 3, 2023
d27f3b4
fix: update resource and limits for firehose telegraf container (#64)
sumitaich1998 Nov 8, 2023
c07df4f
feat(firehose): set telegraf delete_counter to false (#65)
StewartJingga Nov 22, 2023
8bbb87a
feat(app): add otelcollector healthcheck (#66)
haveiss Nov 24, 2023
736d809
feat(meteor): enable resources config (#67)
haveiss Dec 4, 2023
7dcbb76
feat(app): support additional ingress (#68)
haveiss Dec 6, 2023
a2b51d9
revert(compass): to fix publish pipeline (#69)
haveiss Dec 6, 2023
76d9912
feat(compass): bump version (#70)
haveiss Dec 6, 2023
6f0ab66
fix: Optimus db cleanup cron job (#18)
Mryashbhardwaj Jan 15, 2024
275626d
feat: bump up siren chart (#72)
mabdh Jan 15, 2024
f2faa7a
feat: bump up entropy chart (#71)
mabdh Jan 15, 2024
21a7b2a
chore: bumpup entropy siren chart (#73)
mabdh Jan 15, 2024
edae12e
chore: bump up shield chart (#74)
mabdh Jan 18, 2024
6a6f317
feat: update charts for optimus 0.11.1 (#75)
sbchaos Jan 25, 2024
56d5b8a
chore: add resources for cron jobs (#76)
ayushi0014 Jan 25, 2024
7efd02a
chore: update guardian chart (#77)
ayushi0014 Jan 25, 2024
eab4d02
chore: add resources field for cron (#78)
ayushi0014 Jan 25, 2024
3a3692c
chore: update guardian chart version (#79)
ayushi0014 Jan 25, 2024
8cf1981
feat: configurable resources on sidecar app chart (#80)
mabdh Feb 3, 2024
b3d152e
feat: bump up siren chart to 0.1.11 (#81)
mabdh Feb 5, 2024
b98aada
feat(app): introduce hpa (#20)
haveiss Feb 6, 2024
f21ec04
feat: bump compass chart version to 0.2.3 (#82)
batrov Feb 29, 2024
8168ad5
feat(guardian): support podLabels (#84)
mabdh Apr 2, 2024
371eb32
chore(dex): bump up app chart version (#83)
rahmatrhd Apr 4, 2024
24f7c13
fix(optimus): custom labels are not applied (#86)
irainia Apr 17, 2024
a6f5778
fix(optimus): add labels to pod template (#87)
irainia Apr 17, 2024
1dbfbf8
fix(optimus): update cron job to limit the history and to add label (…
irainia Apr 23, 2024
314f2af
feat: making additional ingress optional in app (#89)
mabdh Apr 29, 2024
f047d3d
feat: capability in meteor to configure service account with token vo…
snorlacs May 16, 2024
10dd3a6
feat: app chart cron yaml update for otel sidecar (#91)
sumslim May 17, 2024
1670ffa
fix(app): conditionally disable deployment app chart for cron jobs (#92)
sumslim May 21, 2024
ac4a01a
fix(app): corrected configMap name otel collector (#93)
sumslim May 21, 2024
fd6a253
fix(app): conditional logic to use secrets for env (#94)
sumslim May 21, 2024
e44575c
fix(app): job name truncate issue (#95)
sumslim May 23, 2024
46a88a6
feat: bump up siren and shield chart (#96)
mabdh Jun 11, 2024
6c662d1
feat(app): add serviceAccountName to cronjob (#97)
StewartJingga Jun 19, 2024
0524c4c
feat(dex): bump app chart version to 0.6.7 (#98)
StewartJingga Jun 19, 2024
300f484
feat(app): inject configmap and secret to otel-collector (#99)
StewartJingga Jun 24, 2024
a582f76
chore(guardian): remove slack config and bump version (#100)
harishkswami Jul 23, 2024
7fe1914
feat(optimus): plugin yaml configmaps (#101)
deryrahman Aug 1, 2024
bbc1de8
feat: set post curl command after meteor ran successfully (#102)
luthfifahlevi Aug 23, 2024
75008a5
feat(entropy): add worker deployment (#104)
FemiNoviaLina Aug 26, 2024
ceb0ca9
fix(entropy): chart dependency (#105)
FemiNoviaLina Aug 26, 2024
4fc42c3
bump(guardian): bump chart version (#103)
lifosmin Aug 27, 2024
01f23c4
chore(app): add resource for cron otel sidecar deployment (#107)
lifosmin Sep 3, 2024
87d7fd4
chore(guardian): cron job update (#106)
lifosmin Sep 3, 2024
38345f3
chore(guardian): fix guardian command (#108)
lifosmin Sep 3, 2024
fdc9ccc
chore(guardian): cron job commands (#109)
lifosmin Sep 5, 2024
2f5d57c
feat: dagger helm chart added (#110)
Vaishnavi190900 Sep 11, 2024
0b38652
feat: add type (#111)
ishanarya0 Sep 11, 2024
0ccb5cd
feat: add dagger annotations (#113)
ishanarya0 Sep 13, 2024
903a7ce
feat: add namespace to metadata (#114)
ishanarya0 Sep 17, 2024
37bbec5
chore: remove annotations (#115)
ishanarya0 Sep 17, 2024
752974e
feat(entropy): update app chart dependency to v0.6.0 (#112)
FemiNoviaLina Sep 17, 2024
8d2d780
feat: add savepoint trigger nonce feature (#116)
ishanarya0 Sep 25, 2024
765d85c
feat: change mode to savepoint (#117)
ishanarya0 Sep 25, 2024
87e4af7
feat: revert upgrademode (#118)
ishanarya0 Sep 25, 2024
6361b97
fix: adding condition check failing part for post cmd (#119)
luthfifahlevi Oct 18, 2024
11ffc3d
fix: increase meteor chart version (#120)
luthfifahlevi Oct 18, 2024
494f241
meteor capability to pass annotations (#122)
snorlacs Nov 26, 2024
9e6cfe1
tags added for dagger flink metrics (#123)
Vaishnavi190900 Dec 4, 2024
5802ae9
feat: app chart support multiple services (#124)
mabdh Dec 24, 2024
be96c6d
chore: bump shield to app 0.7.0 (#125)
mabdh Dec 24, 2024
836b596
feat: metabase chart (#126)
FemiNoviaLina Jan 9, 2025
1626521
fix(metabase): add service template (#127)
FemiNoviaLina Jan 9, 2025
f586b53
feat(metabase): enable custom initcontainers and volume (#128)
FemiNoviaLina Jan 14, 2025
428914c
fix(metabase): template (#129)
FemiNoviaLina Jan 15, 2025
ab16a8d
feat: upgrade entropy chart app version (#130)
ishanarya0 Jan 22, 2025
4e95d9c
fix: verbose error logging in meteor (#133)
batrov Feb 20, 2025
9b2a7dc
chore(dagger): dagger/flink job bucket url convention change (#131)
rajuGT Mar 3, 2025
6bb184a
fix: force string conversion
Apr 3, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 0 additions & 3 deletions .github/workflows/repository.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,9 +3,6 @@ on:
push:
branches:
- main
pull_request:
branches:
- main
release:
types: [published, created]

Expand Down
26 changes: 13 additions & 13 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,20 +1,20 @@
# Charts
[Helm](https://github.com/helm/helm) Charts for Open Data Platform
[Helm](https://github.com/helm/helm) Charts for Goto company ecosystem.

Charts are curated application definitions for [Helm](https://github.com/helm/helm). Use this repository to submit official Open Data Platform helm Charts. For more information about installing and using Helm, see it's `README.md`.
Charts are curated application definitions for [Helm](https://github.com/helm/helm). Use this repository to submit official Goto company helm Charts. For more information about installing and using Helm, see it's `README.md`.

## TL;DR

```bash
$ helm repo add odpf https://odpf.github.io/charts/
$ helm search repo odpf
$ helm install my-release odpf/<chart>
$ helm repo add gotocompany https://goto.github.io/charts/
$ helm search repo gotocompany
$ helm install my-release gotocompany/<chart>
```

## Repository Structure

This repository contains the source for the packaged and versioned charts (released in the [Github Pages](https://odpf.github.io/charts/)).
The Charts in the `stable/` directory in the main branch match the latest packaged Chart in the [Chart Repository](https://odpf.github.io/charts/).
This repository contains the source for the packaged and versioned charts (released in the [Github Pages](https://goto.github.io/charts/)).
The Charts in the `stable/` directory in the main branch match the latest packaged Chart in the [Chart Repository](https://goto.github.io/charts/).
There may be previous versions of a Chart available in the Chart Repository.

The purpose of this repository is to provide a place for maintaining and contributing official Charts, with CI processes in place for managing the releasing of Charts into the Chart Repository.
Expand All @@ -23,21 +23,21 @@ Stable Charts meet the criteria in the technical requirements.

## Usage

Once you have installed the Helm client on your kubernetes cluster, you can deploy a ODPF Helm Chart into a Kubernetes cluster.
Once you have installed the Helm client on your kubernetes cluster, you can deploy a Helm Chart into a Kubernetes cluster.

Please refer to the [Quick Start guide](https://helm.sh/docs/intro/quickstart/) if you wish to get running in just a few commands, otherwise the [Using Helm Guide](https://helm.sh/docs/intro/using_helm/) provides detailed instructions on how to use the Helm client to manage packages on your Kubernetes cluster.

Helm Repo URL: `https://odpf.github.io/charts/`
Helm Repo URL: `https://goto.github.io/charts/`

```bash
# To add ODPF Helm repo
$ helm repo add odpf https://odpf.github.io/charts/
# To add gotocompany Helm repo
$ helm repo add gotocompany https://goto.github.io/charts/

# To list all the charts in the repo
$ helm search repo odpf
$ helm search repo gotocompany

# To install any searched chart
$ helm install my-release odpf/<chart>
$ helm install my-release gotocompany/<chart>
```

## Contributing a Chart
Expand Down
2 changes: 1 addition & 1 deletion stable/app/Chart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@ type: application
# This is the chart version. This version number should be incremented each time you make changes
# to the chart and its templates, including the app version.
# Versions are expected to follow Semantic Versioning (https://semver.org/)
version: 0.4.3
version: 0.7.0
8 changes: 5 additions & 3 deletions stable/app/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,11 +17,11 @@ This chart can be used for deploying any app on kubenetes using helm
To install the chart with the release name `my-release` and image `siren`:

```bash
$ helm install --name my-release . -f ./path-to/values.yaml --set image.repository=odpf/siren --set image.tag=latest --set ingress.enabled=true
$ helm install --name my-release . -f ./path-to/values.yaml --set image.repository=gotocompany/siren --set image.tag=latest --set ingress.enabled=true

```

The command deploys odpf/siren on the Kubernetes cluster in the default configuration. The [configuration](#configuration) section lists the parameters that can be configured during installation.
The command deploys gotocompany/siren on the Kubernetes cluster in the default configuration. The [configuration](#configuration) section lists the parameters that can be configured during installation.

> **Tip**: List all releases using `helm list`

Expand Down Expand Up @@ -55,10 +55,12 @@ The following table lists the configurable parameters of the Siren chart and the
| container.readinessProbe.httpGet.port | string | `"tcp"` | |
| cron.enabled | bool | `false` | |
| cron.jobs[0].name | string | `""` | |
| cron.jobs[0].serviceAccountName | string | `""` | |
| cron.jobs[0].command | string | `""` | |
| cron.jobs[0].args | string | `""` | |
| cron.jobs[0].schedule | string | `"0 0 * * *"` | |
| cron.jobs[0].restartPolicy | string | `Never` | |
| cron.jobs[0].restartPolicy | string | `Never` |
| cron.jobs[0].resources | object | {}
| fullnameOverride | string | `""` | |
| image.pullPolicy | string | `"IfNotPresent"` | Specify the docker image path/repository. |
| image.repository | string | `nil` | |
Expand Down
101 changes: 98 additions & 3 deletions stable/app/templates/cron.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,12 @@
{{- $fullName := include "app.fullname" . -}}
{{- $appLabels := include "app.labels" . -}}
{{- $appSelectorLabels := include "app.selectorLabels" . -}}
{{- $podLabels := .Values.podLabels }}
{{- range $i, $job := .Values.cron.jobs }}
apiVersion: batch/v1
kind: CronJob
metadata:
name: "{{ $fullName | trunc 24 }}-{{ $i }}-{{ $job.name | trunc 24}}"
name: "{{ ($fullName | trunc 24 | trimSuffix "-") }}-{{ $i }}-{{ ($job.name | trunc 24 | trimSuffix "-") }}"
namespace: {{ $.Release.Namespace }}
labels:
{{- $appLabels | nindent 4 }}
Expand All @@ -18,22 +19,116 @@ spec:
template:
metadata:
labels:
{{- $appSelectorLabels | nindent 12 }}
{{- $appSelectorLabels | nindent 12 }}
{{- with $podLabels }}
{{- toYaml . | nindent 12 }}
{{- end }}
spec:
{{- if $job.serviceAccountName }}
serviceAccountName: "{{ $job.serviceAccountName }}"
{{- end }}
{{- if $job.initContainers }}
initContainers:
{{- range $initContainer := $job.initContainers }}
- {{- toYaml $initContainer | nindent 14 }}
{{- end }}
{{- end }}
containers:
- name: {{ $job.name }}
image: "{{ $.Values.image.repository }}:{{ $.Values.image.tag | default $.Chart.AppVersion }}"
imagePullPolicy: {{ $.Values.image.pullPolicy }}
command:
{{- toYaml $job.command | nindent 16 }}
{{- if $.Values.otelcollector.enabled }}
- /bin/sh
- -c
- |
{{ join " " $job.command }}
pkill -SIGTERM otelcol-contrib
{{- else }}
{{- toYaml $job.command | nindent 16 }}
{{- end }}
args:
{{- toYaml $job.args | nindent 16 }}
envFrom:
- configMapRef:
name: {{ $fullName }}
{{- if $.Values.secretConfig }}
- secretRef:
name: {{ $fullName }}-secret
{{- end }}
{{- if $job.volumeMounts }}
volumeMounts:
{{- toYaml $job.volumeMounts | nindent 16 }}
{{- end }}
resources:
{{- toYaml $job.resources | nindent 16 }}
{{- if $.Values.otelcollector.enabled }}
- name: otel-collector-sidecar
image: {{ $.Values.otelcollector.image }}
imagePullPolicy: IfNotPresent
args:
- "--config=/etc/otelcollector/config.yaml"
ports:
- containerPort: 1888
name: pprof
protocol: TCP
- containerPort: 8888
name: prometheusself
protocol: TCP
- containerPort: 8889
name: prometheus
protocol: TCP
- containerPort: 13133
name: healthcheck
protocol: TCP
- containerPort: 4317
name: otlpgrpcrecv
protocol: TCP
- containerPort: 4318
name: otlphttprecv
protocol: TCP
- containerPort: 55679
name: zpages
protocol: TCP
env:
- name: K8S_NODE_NAME
valueFrom:
fieldRef:
fieldPath: spec.nodeName
- name: K8S_POD_NAME
valueFrom:
fieldRef:
fieldPath: metadata.name
- name: K8S_POD_NAMESPACE
valueFrom:
fieldRef:
fieldPath: metadata.namespace
- name: K8S_POD_IP
valueFrom:
fieldRef:
fieldPath: status.podIP
- name: OTEL_RESOURCE_ATTRIBUTES
value: |
k8s.deployment.name={{ $job.name }},k8s.namespace.name=$(K8S_POD_NAMESPACE),k8s.node.name=$(K8S_NODE_NAME),k8s.pod.name=$(K8S_POD_NAME),k8s.pod.ip=$(K8S_POD_IP)
volumeMounts:
- name: otelcollector-conf
mountPath: /etc/otelcollector/
{{- if $.Values.otelcollector.resources }}
resources:
{{- toYaml $.Values.otelcollector.resources | nindent 16 }}
{{- end }}
shareProcessNamespace: true
{{- end}}
restartPolicy: {{ $job.restartPolicy }}
volumes:
{{- range $volume := $job.volumes }}
- {{- toYaml $volume | nindent 14 }}
{{- end }}
{{- if $.Values.otelcollector.enabled }}
- name: otelcollector-conf
configMap:
name: {{ $fullName }}-otelcollector
{{- end }}
---
{{- end -}}
{{- end -}}
Loading