59 vagrant box for golden gate (#60)

* Initial Working Setup

* Final Working Install.sh For Golden Gate

This is working sample of the final installation of Golden Gate For Oracle
12c

* Add Vagrant Ip To Kafka Advertised Listeners

* Update Download Location in Readme

* Update GG for Bigdata zip pattern in script.

Remove unused installgg.sh

* Update Install Script, Use Apache Kafka, Externalise configurations

- Setup Apache kafka by downloading zip from apache distribution, defaults to `2.12-2.6.0`.
- Setup Zookeeper and Kafka as systemctl services
- Extract Oracle DB, GoldenGate and GoldenGate for Big Data setup files name to configuration
- Support Golden Gate `19.0.1.0` version
- Rename virtual machine name to `oracle-goldengate-191001-vagrant`
- Update Vagrantfile as per OracleDB Vagrantfile changes

* Add Golden Gate for Oracle 19c Database

* Fix epxort path $ escape, and README correction

* Rename folder 19.1.0 to 19.3.0

Co-authored-by: Ninad Ingole <[email protected]>

Author: ninadingole

OracleGoldenGate/12.2.0.1/.env

@@ -0,0 +1,74 @@
+# Oracle Database 12.2.0.1 configuration file
+#
+# Requires vagrant-env plugin
+#
+# This file will be overwritten on updates, so it is recommended to make
+# a copy of this file called .env.local, then make changes in .env.local.
+#
+# To change a parameter, uncomment it and set it to the desired value.
+# All commented parameters will retain their default values.
+
+# VM name
+# VM_NAME='oracle-12201-vagrant'
+
+# Memory for the VM (in MB, 2048 MB = 2 GB)
+# VM_MEMORY=2048
+
+# VM time zone
+# If not specified, will be set to match host time zone (if possible)
+# Can use time zone name (e.g., 'America/Los_Angeles')
+# or an offset from GMT (e.g., 'Etc/GMT-2')
+# VM_SYSTEM_TIMEZONE=
+
+# Oracle base directory
+# VM_ORACLE_BASE='/opt/oracle'
+
+# Oracle home directory
+# VM_ORACLE_HOME='/opt/oracle/product/12.2.0.1/dbhome_1'
+
+# Oracle SID
+# VM_ORACLE_SID='ORCLCDB'
+
+# PDB name
+# VM_ORACLE_PDB='ORCLPDB1'
+
+# Database character set
+# VM_ORACLE_CHARACTERSET='AL32UTF8'
+
+# Oracle Database edition
+# Valid values are 'EE' for Enterprise Edition or 'SE2' for Standard Edition 2
+# VM_ORACLE_EDITION='EE'
+
+# Listener port
+# VM_LISTENER_PORT=1521
+
+# EM Express port
+# VM_EM_EXPRESS_PORT=5500
+
+# Java Version
+# VM_JAVA_VERSION='1.8.0'
+
+# Scala Version
+# VM_SCALA_VERSION='2.12'
+
+# Apache Kafka Version
+# VM_APACHE_KAFKA_VERSION='2.6.0'
+
+# Apache Kafka port
+# VM_APACHE_KAFKA_PORT=9092
+
+# Apache Zookeeper port
+# VM_APACHE_ZOOKEEPER_PORT=2181
+
+# Oracle DB Installtion zip
+# VM_ORACLE_DB_SETUP_FILE = linux*122*.zip
+
+# Oracle GolgenGate Installtion zip
+# VM_ORACLE_GG_SETUP_FILE = *ggs_Linux*.zip
+
+# Oracle GolgenGate For BigData Installtion zip
+# VM_ORACLE_GG_BD_SETUP_FILE = *BigData_Linux*.zip
+
+# Oracle Database password for SYS, SYSTEM and PDBADMIN accounts
+# If left blank, the password will be generated automatically
+# VM_ORACLE_PWD=

OracleGoldenGate/12.2.0.1/.gitignore

@@ -0,0 +1,2 @@
+*.zip
+.vagrant

OracleGoldenGate/12.2.0.1/README.md

@@ -0,0 +1,69 @@
+# oracle12c-gg-vagrant
+
+A vagrant box that provisions Oracle Database along with Golden Gate automatically, using Vagrant, an Oracle Linux 7.3 box and a shell script.
+
+## Prerequisites
+
+1. Install [Oracle VM VirtualBox](https://www.virtualbox.org/wiki/Downloads)
+2. Install [Vagrant](https://vagrantup.com/)
+
+## Getting started
+
+1. Clone this repository `git clone https://github.com/ninadingole/vagrant-boxes`
+2. Change into the desired version folder
+3. Download the Oracle 12.2.0.1 Database (linuxx64_12201_database.zip) installation zip files from oracle edelivery into this folder - first time only: [edelivery](https://www.oracle.com/database/technologies/oracle12c-linux-12201-downloads.html)
+4. Download the installation zip for golden gate (191004_fbo_ggs_Linux_x64_shiphome.zip) & golden gate for Big Data (OGG_BigData_Linux_x64_19.1.0.0.1) into this folder - first time only: [edelivery](https://www.oracle.com/middleware/technologies/goldengate-downloads.html)
+5. Run `vagrant up`
+   1. The first time you run this it will provision everything and may take a while. Ensure you have (a good) internet connection as the scripts will update the virtual box to the latest via `yum`.
+   2. The Vagrant file allows for customization, if desired (see [Customization](#customization))
+6. Connect to the database.
+7. You can shut down the box via the usual `vagrant halt` and the start it up again via `vagrant up`.
+
+## Connecting to Oracle
+
+- Hostname: `localhost`
+- Port: `1521`
+- SID: `ORCLCDB`
+- PDB: `ORCLPDB1`
+- OEM port: `5500`
+- All passwords are auto-generated and printed on install
+
+## Resetting password
+
+You can reset the password of the Oracle database accounts by executing `/home/oracle/setPassword.sh <Your new password>`.
+
+## Connecting to Apache Kafka
+
+- Hostname: `localhost`
+- Zookeeper: `2181`
+- Kafka-Broker: `9092`
+
+## Other info
+
+- If you need to, you can connect to the machine via `vagrant ssh`.
+- You can `sudo su - oracle` to switch to the oracle user.
+- The Oracle installation path is `/opt/oracle/` by default.
+- On the guest OS, the directory `/vagrant` is a shared folder and maps to wherever you have this file checked out.
+- Golden Gate is available at location `/u01/ogg` & `/u01/oggbd` console is accessible using `./ggsci` command inside the folder.
+- Apache Kafka is available at location `/usr/local/kafka/kafka-xxxx`
+
+### Customization
+
+You can customize your Oracle environment by amending the environment variables in the `Vagrantfile` file.
+The following can be customized:
+
+- `ORACLE_BASE`: `/opt/oracle/`
+- `ORACLE_HOME`: `/opt/oracle/product/12.2.0.1/dbhome_1`
+- `ORACLE_SID`: `ORCLCDB`
+- `ORACLE_PDB`: `ORCLPDB1`
+- `ORACLE_CHARACTERSET`: `AL32UTF8`
+- `ORACLE_EDITION`: `EE` | `SE2`
+- `ORACLE_PWD`: `auto generated`
+- `JAVA_VERSION`: `1.8.0`
+- `SCALA_VERSION`: `2.12`
+- `KAFKA_VERSION`: `2.6.0`
+- `APACHE_ZOOKEEPER_PORT`: `2181`
+- `APACHE_KAFKA_PORT`: `9092`
+- `ORACLE_DB_SETUP_FIL`: `linux*122*.zip`
+- `ORACLE_GG_SETUP_FILE`: `*ggs_Linux*.zip`
+- `ORACLE_GG_BD_SETUP_FILE`: `*BigData_Linux*.zip`

OracleGoldenGate/12.2.0.1/Vagrantfile

@@ -0,0 +1,212 @@
+#
+# LICENSE UPL 1.0
+#
+# Copyright (c) 1982-2018 Oracle and/or its affiliates. All rights reserved.
+#
+# Since: January, 2018
+# Author: [email protected]
+# Description: Creates an Oracle database Vagrant virtual machine.
+# Optional plugins:
+#     vagrant-env (use .env files for configuration)
+#     vagrant-proxyconf (if you don't have direct access to the Internet)
+#         see https://github.com/tmatilai/vagrant-proxyconf for configuration
+#
+# DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS HEADER.
+#
+
+# -*- mode: ruby -*-
+# vi: set ft=ruby :
+
+# Vagrantfile API/syntax version. Don't touch unless you know what you're doing!
+VAGRANTFILE_API_VERSION = "2"
+
+# Box metadata location and box name
+BOX_URL = "https://oracle.github.io/vagrant-projects/boxes"
+BOX_NAME = "oraclelinux/7"
+
+# UI object for printing information
+ui = Vagrant::UI::Prefixed.new(Vagrant::UI::Colored.new, "vagrant")
+
+# Define constants
+Vagrant.configure(VAGRANTFILE_API_VERSION) do |config|
+  # Use vagrant-env plugin if available
+  if Vagrant.has_plugin?("vagrant-env")
+    config.env.load(".env.local", ".env") # enable the plugin
+  end
+
+  # VM name
+  VM_NAME = default_s('VM_NAME', 'oracle-goldengate-123012-vagrant')
+
+  # Memory for the VM (in MB, 2048 MB = 2 GB)
+  VM_MEMORY = default_i('VM_MEMORY', 2048)
+
+  # VM time zone
+  # If not specified, will be set to match host time zone (if possible)
+  VM_SYSTEM_TIMEZONE = default_s('VM_SYSTEM_TIMEZONE', host_tz)
+
+  # Oracle base directory
+  VM_ORACLE_BASE = default_s('VM_ORACLE_BASE', '/opt/oracle')
+
+  # Oracle home directory
+  VM_ORACLE_HOME = default_s('VM_ORACLE_HOME', '/opt/oracle/product/12.2.0.1/dbhome_1')
+
+  # Oracle SID
+  VM_ORACLE_SID = default_s('VM_ORACLE_SID', 'ORCLCDB')
+
+  # PDB name
+  VM_ORACLE_PDB = default_s('VM_ORACLE_PDB', 'ORCLPDB1')
+
+  # Database character set
+  VM_ORACLE_CHARACTERSET = default_s('VM_ORACLE_CHARACTERSET', 'AL32UTF8')
+
+  # Oracle Database edition
+  # Valid values are 'EE' for Enterprise Edition or 'SE2' for Standard Edition 2
+  VM_ORACLE_EDITION = default_s('VM_ORACLE_EDITION', 'EE')
+
+  # Listener port
+  VM_LISTENER_PORT = default_i('VM_LISTENER_PORT', 1521)
+
+  # EM Express port
+  VM_EM_EXPRESS_PORT = default_i('VM_EM_EXPRESS_PORT', 5500)
+
+  # Java Version
+  VM_JAVA_VERSION = default_s('VM_JAVA_VERSION', '1.8.0')
+
+  # ScaLa Version
+  VM_SCALA_VERSION = default_s('VM_SCALA_VERSION', '2.12')
+  
+  # Apache Kafka Version
+  VM_APACHE_KAFKA_VERSION = default_s('VM_APACHE_KAFKA_VERSION', '2.6.0')
+
+  # Apache Zookeeper port
+  VM_APACHE_ZOOKEEPER_PORT = default_i('VM_APACHE_ZOOKEEPER_PORT', 2181)
+
+  # Apache Kafka port
+  VM_APACHE_KAFKA_PORT = default_i('VM_APACHE_KAFKA_PORT', 9092)
+
+  # Oracle DB Setup File
+  VM_ORACLE_DB_SETUP_FILE = default_s('VM_ORACLE_DB_SETUP_FILE', 'linux*122*.zip')
+
+  # Oracle GoldenGate Setup File
+  VM_ORACLE_GG_SETUP_FILE = default_s('VM_ORACLE_GG_SETUP_FILE', '*ggs_Linux*.zip')
+
+  # Oracle GoldenGate for BigData Setup File
+  VM_ORACLE_GG_BD_SETUP_FILE = default_s('VM_ORACLE_GG_BD_SETUP_FILE', '*BigData_Linux*.zip')
+  
+  # Oracle Database password for SYS, SYSTEM and PDBADMIN accounts
+  # If left blank, the password will be generated automatically
+  VM_ORACLE_PWD = default_s('VM_ORACLE_PWD', '')
+end
+
+# Convenience methods
+def default_s(key, default)
+  ENV[key] && ! ENV[key].empty? ? ENV[key] : default
+end
+
+def default_i(key, default)
+  default_s(key, default).to_i
+end
+
+def host_tz
+  # get host time zone for setting VM time zone
+  # if host time zone isn't an integer hour offset from GMT, fall back to UTC
+  offset_sec = Time.now.gmt_offset
+  if (offset_sec % (60 * 60)) == 0
+    offset_hr = ((offset_sec / 60) / 60)
+    timezone_suffix = offset_hr >= 0 ? "-#{offset_hr.to_s}" : "+#{(-offset_hr).to_s}"
+    'Etc/GMT' + timezone_suffix
+  else
+    'UTC'
+  end
+end
+
+Vagrant.configure(VAGRANTFILE_API_VERSION) do |config|
+  config.vm.box = BOX_NAME
+  config.vm.box_url = "#{BOX_URL}/#{BOX_NAME}.json"
+  config.vm.define VM_NAME
+
+  # Provider-specific configuration
+  config.vm.provider "virtualbox" do |v|
+    v.memory = VM_MEMORY
+    v.name = VM_NAME
+  end
+  config.vm.provider :libvirt do |v|
+    v.memory = VM_MEMORY
+  end
+
+  # add proxy configuration from host env - optional
+  if Vagrant.has_plugin?("vagrant-proxyconf")
+    ui.info "Getting Proxy Configuration from Host..."
+    has_proxy = false
+    ["http_proxy", "HTTP_PROXY"].each do |proxy_var|
+      if proxy = ENV[proxy_var]
+        ui.info "HTTP proxy: " + proxy
+        config.proxy.http = proxy
+        has_proxy = true
+        break
+      end
+    end
+
+    ["https_proxy", "HTTPS_PROXY"].each do |proxy_var|
+      if proxy = ENV[proxy_var]
+        ui.info "HTTPS proxy: " + proxy
+        config.proxy.https = proxy
+        has_proxy = true
+        break
+      end
+    end
+
+    if has_proxy
+      # Only consider no_proxy if we have proxies defined.
+      no_proxy = ""
+      ["no_proxy", "NO_PROXY"].each do |proxy_var|
+        if ENV[proxy_var]
+          no_proxy = ENV[proxy_var]
+          ui.info "No proxy: " + no_proxy
+          no_proxy += ","
+          break
+        end
+      end
+      config.proxy.no_proxy = no_proxy + "localhost,127.0.0.1"
+    end
+  else
+    ["http_proxy", "HTTP_PROXY", "https_proxy", "HTTPS_PROXY"].each do |proxy_var|
+      if ENV[proxy_var]
+        ui.warn 'To enable proxies in your VM, install the vagrant-proxyconf plugin'
+        break
+      end
+    end
+  end
+
+  # VM hostname
+  config.vm.hostname = VM_NAME
+
+  # Oracle port forwarding
+  config.vm.network "forwarded_port", guest: VM_LISTENER_PORT, host: VM_LISTENER_PORT
+  config.vm.network "forwarded_port", guest: VM_EM_EXPRESS_PORT, host: VM_EM_EXPRESS_PORT
+  config.vm.network "forwarded_port", guest: VM_APACHE_KAFKA_PORT, host: VM_APACHE_KAFKA_PORT
+  config.vm.network "forwarded_port", guest: VM_APACHE_ZOOKEEPER_PORT, host: VM_APACHE_ZOOKEEPER_PORT
+  
+
+  # Provision everything on the first run
+  config.vm.provision "shell", path: "scripts/install.sh", env:
+    {
+       "SYSTEM_TIMEZONE"          => VM_SYSTEM_TIMEZONE,
+       "ORACLE_BASE"              => VM_ORACLE_BASE,
+       "ORACLE_HOME"              => VM_ORACLE_HOME,
+       "ORACLE_SID"               => VM_ORACLE_SID,
+       "ORACLE_PDB"               => VM_ORACLE_PDB,
+       "ORACLE_CHARACTERSET"      => VM_ORACLE_CHARACTERSET,
+       "ORACLE_EDITION"           => VM_ORACLE_EDITION,
+       "LISTENER_PORT"            => VM_LISTENER_PORT,
+       "EM_EXPRESS_PORT"          => VM_EM_EXPRESS_PORT,
+       "ORACLE_PWD"               => VM_ORACLE_PWD,
+       "JAVA_VERSION"             => VM_JAVA_VERSION,
+       "SCALA_VERSION"            => VM_SCALA_VERSION,
+       "KAFKA_VERSION"            => VM_APACHE_KAFKA_VERSION,
+       "ORACLE_DB_SETUP_FILE"     => VM_ORACLE_DB_SETUP_FILE,
+       "ORACLE_GG_SETUP_FILE"     => VM_ORACLE_GG_SETUP_FILE,
+       "ORACLE_GG_BD_SETUP_FILE"  => VM_ORACLE_GG_BD_SETUP_FILE
+    }
+
+end

OracleGoldenGate/12.2.0.1/ora-response/db_install.rsp.tmpl

@@ -0,0 +1,16 @@
+oracle.install.responseFileVersion=/oracle/install/rspfmt_dbinstall_response_schema_v12.2.0
+oracle.install.option=INSTALL_DB_SWONLY
+UNIX_GROUP_NAME=dba
+INVENTORY_LOCATION=###ORACLE_BASE###/oraInventory
+SELECTED_LANGUAGES=en
+ORACLE_BASE=###ORACLE_BASE###
+ORACLE_HOME=###ORACLE_HOME###
+oracle.install.db.InstallEdition=###ORACLE_EDITION###
+oracle.install.db.DBA_GROUP=dba
+oracle.install.db.BACKUPDBA_GROUP=dba
+oracle.install.db.DGDBA_GROUP=dba
+oracle.install.db.KMDBA_GROUP=dba
+oracle.install.db.OSRACDBA_GROUP=dba
+SECURITY_UPDATES_VIA_MYORACLESUPPORT=false
+DECLINE_SECURITY_UPDATES=true
+oracle.installer.autoupdates.option=SKIP_UPDATES