Evaluate the feasibility of mirroring FASE datasets into PyIceberg tables.

[bashanlam]

Evaluate the feasibility of mirroring FASE datasets into PyIceberg tables including

• Oracle data source extract and load
• Postgres data source extract and load
• Refactor Oracle-based reporting-tool queries to source data from PyIceberg via Superset
• Refactor Trino-based reporting-tool queries to source data from PyIceberg via Superset

[bashanlam]

Data Lake Integration (Trino + Iceberg):

1. Oracle mirroring is completed; however, queries require transformation when accessing the Data Lake via Trino to account for data type shifts. DateTime fields of Oracle database need to be transformed before loading to Iceberg.
2. Evaluated Oracle queries within the reporting-tool for Iceberg/DataLake compatibility. PL/SQL function should be transformed to Trino compatible format.
3. PostgreSQL mirroring is completed; but JSON data types are currently unsupported in the Data Lake and have been converted to TEXT.
4. Evaluated Trino queries within the reporting-tool for Iceberg/DataLake compatibility. JSON search is valid for TEXT field of Iceberg.