|
3 | 3 | The Stackable platform consists of multiple operators that work together.
|
4 | 4 | Periodically a platform release is made, including all components of the platform at a specific version.
|
5 | 5 |
|
| 6 | +== Release 22.09 |
| 7 | +This is our second release of the Stackable Data Platform. |
| 8 | +It contains lots of new features and bugfixes. |
| 9 | +The main features focus on OpenShift support and security. |
| 10 | + |
| 11 | +=== New platform features |
| 12 | +The following new major platform features were added: |
| 13 | + |
| 14 | +OpenShift compatibility:: |
| 15 | +The following operators are now OpenShift compatible: |
| 16 | + |
| 17 | +* https://github.com/stackabletech/airflow-operator/pull/127[airflow] |
| 18 | +* https://github.com/stackabletech/hbase-operator/pull/232[hbase] |
| 19 | +* https://github.com/stackabletech/spark-k8s-operator/pull/126[spark-k8s] |
| 20 | + |
| 21 | +Support for internal and external TLS:: |
| 22 | +The following operators support operating the products at a maximal level of transport security by using TLS certificates to secure internal and external communication: |
| 23 | + |
| 24 | +* https://github.com/stackabletech/trino-operator/pull/244[trino] |
| 25 | +* https://github.com/stackabletech/zookeeper-operator/pull/479[zookeeper] |
| 26 | + |
| 27 | +LDAP authentication:: |
| 28 | +Use a central LDAP server to manage all of your user identities in a single place. |
| 29 | +The following operators added support for LDAP authentication: |
| 30 | + |
| 31 | +* https://github.com/stackabletech/airflow-operator/pull/133[airflow] |
| 32 | +* https://github.com/stackabletech/nifi-operator/pull/303[nifi] |
| 33 | +* https://github.com/stackabletech/superset-operator/pull/180[superset] |
| 34 | + |
| 35 | +=== stackablectl |
| 36 | + |
| 37 | +`stackablectl` now supports deploying ready-to-use demos, which give and end-to-end demonstration of the usage of the Stackable data platform. |
| 38 | +The xref:stackablectl::quickstart.adoc[quickstart guide] shows how to get started with `stackablectl`. Here you can see the xref:stackablectl::demos/index.adoc[available demos]. |
| 39 | + |
| 40 | +=== Supported Kubernetes versions |
| 41 | +This release supports the following Kubernetes versions: |
| 42 | + |
| 43 | +* `1.24` |
| 44 | +* `1.23` |
| 45 | +* `1.22` |
| 46 | + |
| 47 | +Support for `1.21` was dropped. |
| 48 | + |
| 49 | +=== Upgrade from 22.06 |
| 50 | +==== Using stackablectl |
| 51 | +You can list the available releases as follows |
| 52 | + |
| 53 | +[source,console] |
| 54 | +---- |
| 55 | +$ stackablectl release list |
| 56 | +RELEASE RELEASE DATE DESCRIPTION |
| 57 | +22.06 2022-06-30 First official release of the Stackable Data Platform |
| 58 | +22.09 2022-09-09 Second release focusing on OpenShift support and security |
| 59 | +---- |
| 60 | + |
| 61 | +To uninstall the `22.06` release run |
| 62 | + |
| 63 | +[source,console] |
| 64 | +---- |
| 65 | +$ stackablectl release uninstall 22.06 |
| 66 | +[INFO ] Uninstalling release 22.06 |
| 67 | +[INFO ] Uninstalling airflow operator |
| 68 | +[INFO ] Uninstalling commons operator |
| 69 | +# ... |
| 70 | +---- |
| 71 | + |
| 72 | +To install the `22.09` release run |
| 73 | + |
| 74 | +[source,console] |
| 75 | +---- |
| 76 | +$ stackablectl release install 22.09 |
| 77 | +[INFO ] Installing release 22.09 |
| 78 | +[INFO ] Installing airflow operator in version 0.5.0 |
| 79 | +[INFO ] Installing commons operator in version 0.3.0 |
| 80 | +[INFO ] Installing druid operator in version 0.7.0 |
| 81 | +[INFO ] Installing hbase operator in version 0.4.0 |
| 82 | +[INFO ] Installing hdfs operator in version 0.5.0 |
| 83 | +[INFO ] Installing hive operator in version 0.7.0 |
| 84 | +[INFO ] Installing kafka operator in version 0.7.0 |
| 85 | +[INFO ] Installing nifi operator in version 0.7.0 |
| 86 | +[INFO ] Installing opa operator in version 0.10.0 |
| 87 | +[INFO ] Installing secret operator in version 0.6.0 |
| 88 | +[INFO ] Installing spark-k8s operator in version 0.5.0 |
| 89 | +[INFO ] Installing superset operator in version 0.6.0 |
| 90 | +[INFO ] Installing trino operator in version 0.5.0 |
| 91 | +[INFO ] Installing zookeeper operator in version 0.11.0 |
| 92 | +# ... |
| 93 | +---- |
| 94 | + |
| 95 | +==== Using helm |
| 96 | +Use `helm list` to list the currently installed operators. |
| 97 | + |
| 98 | +You can use the following command to install all of the operators that are part of the release 22.06: |
| 99 | + |
| 100 | +[source,console] |
| 101 | +---- |
| 102 | +$ helm uninstall airflow-operator commons-operator druid-operator hbase-operator hdfs-operator hive-operator kafka-operator nifi-operator opa-operator secret-operator spark-k8s-operator superset-operator trino-operator zookeeper-operator |
| 103 | +release "airflow-operator" uninstalled |
| 104 | +release "commons-operator" uninstalled |
| 105 | +# ... |
| 106 | +---- |
| 107 | + |
| 108 | +To install the release 22.09 run |
| 109 | + |
| 110 | +[source,console] |
| 111 | +---- |
| 112 | +$ helm repo add stackable https://repo.stackable.tech/repository/helm-stable/ |
| 113 | +$ helm install --wait airflow-operator stackable/airflow-operator --version 0.5.0 |
| 114 | +$ helm install --wait commons-operator stackable/commons-operator --version 0.3.0 |
| 115 | +$ helm install --wait druid-operator stackable/druid-operator --version 0.7.0 |
| 116 | +$ helm install --wait hbase-operator stackable/hbase-operator --version 0.4.0 |
| 117 | +$ helm install --wait hdfs-operator stackable/hdfs-operator --version 0.5.0 |
| 118 | +$ helm install --wait hive-operator stackable/hive-operator --version 0.6.0 |
| 119 | +$ helm install --wait kafka-operator stackable/kafka-operator --version 0.6.0 |
| 120 | +$ helm install --wait nifi-operator stackable/nifi-operator --version 0.6.0 |
| 121 | +$ helm install --wait opa-operator stackable/opa-operator --version 0.10.0 |
| 122 | +$ helm install --wait secret-operator stackable/secret-operator --version 0.6.0 |
| 123 | +$ helm install --wait spark-k8s-operator stackable/spark-k8s-operator --version 0.5.0 |
| 124 | +$ helm install --wait superset-operator stackable/superset-operator --version 0.6.0 |
| 125 | +$ helm install --wait trino-operator stackable/trino-operator --version 0.5.0 |
| 126 | +$ helm install --wait zookeeper-operator stackable/zookeeper-operator --version 0.11.0 |
| 127 | +---- |
| 128 | + |
| 129 | +==== Breaking changes |
| 130 | + |
| 131 | +You will need to adapt your existing CRDs to the following breaking changes: |
| 132 | + |
| 133 | +==== druid-operator |
| 134 | +1. HDFS deep storage is now configurable via HDFS discovery config map instead of an url to a HDFS name node (https://github.com/stackabletech/druid-operator/pull/262[#262]). |
| 135 | +Instead of |
| 136 | + |
| 137 | +[source,yaml] |
| 138 | +---- |
| 139 | + deepStorage: |
| 140 | + hdfs: |
| 141 | + storageDirectory: hdfs://druid-hdfs-namenode-default-0:8020/data |
| 142 | +---- |
| 143 | + |
| 144 | +use |
| 145 | + |
| 146 | +[source,yaml] |
| 147 | +---- |
| 148 | + deepStorage: |
| 149 | + hdfs: |
| 150 | + configMapName: druid-hdfs |
| 151 | + directory: /druid |
| 152 | +---- |
| 153 | + |
| 154 | +==== trino-operator |
| 155 | +1. TrinoCatalogs now have their own CRD object and get referenced by the TrinoCluster (https://github.com/stackabletech/trino-operator/pull/263[#263]). Instead of |
| 156 | + |
| 157 | +[source,yaml] |
| 158 | +---- |
| 159 | +apiVersion: trino.stackable.tech/v1alpha1 |
| 160 | +kind: TrinoCluster |
| 161 | +# ... |
| 162 | +spec: |
| 163 | + hiveConfigMapName: hive |
| 164 | + s3: |
| 165 | + inline: |
| 166 | + host: minio |
| 167 | + port: 9000 |
| 168 | + accessStyle: Path |
| 169 | + credentials: |
| 170 | + secretClass: s3-credentials |
| 171 | + # ... |
| 172 | +---- |
| 173 | + |
| 174 | +use |
| 175 | + |
| 176 | +[source,yaml] |
| 177 | +---- |
| 178 | +apiVersion: trino.stackable.tech/v1alpha1 |
| 179 | +kind: TrinoCluster |
| 180 | +# ... |
| 181 | +spec: |
| 182 | + catalogLabelSelector: |
| 183 | + trino: simple-trino |
| 184 | + # ... |
| 185 | +--- |
| 186 | +apiVersion: trino.stackable.tech/v1alpha1 |
| 187 | +kind: TrinoCatalog |
| 188 | +metadata: |
| 189 | + name: hive |
| 190 | + labels: |
| 191 | + trino: trino |
| 192 | +spec: |
| 193 | + connector: |
| 194 | + hive: |
| 195 | + metastore: |
| 196 | + configMap: hive |
| 197 | + s3: |
| 198 | + inline: |
| 199 | + host: minio |
| 200 | + port: 9000 |
| 201 | + accessStyle: Path |
| 202 | + credentials: |
| 203 | + secretClass: s3-credentials |
| 204 | +---- |
6 | 205 |
|
7 | 206 | == Release 22.06
|
8 | 207 |
|
@@ -98,3 +297,9 @@ Read up on the xref:operators:supported_versions.adoc[supported versions] for ea
|
98 | 297 | * xref:commons-operator::index.adoc[] (0.2.0)
|
99 | 298 | * xref:secret-operator::index.adoc[] (0.5.0)
|
100 | 299 |
|
| 300 | +=== Supported Kubernetes versions |
| 301 | +This release supports the following Kubernetes versions: |
| 302 | + |
| 303 | +* `1.23` |
| 304 | +* `1.22` |
| 305 | +* `1.21` |
0 commit comments