v0.8.1-incubating

• Improvement

  [AMORO-3533] Avoid bulk table removal when synchronizing external catalogs and fetching database table listings fails (#3534)
  (hotfix) enhance log for iceberg table maintainer (#3543)
  [AMORO-3559] Extract abstract class for table metrics (#3560)
  [hotfix]update upgrade.sql (#3563)
  [Hotfix] update upgrade.sql for postgres after 0.8.0 release. (#3574)
  Optimize the performance of optimizer pollTask (#3583)
  [AMORO-3578][Improvement] Improving Error Prompts for Login Failures (#3578)
  [Hotfix] Bump parquet-avro to 1.15.2 to fix CVE (#3580)
  Optimize log output for SchedulingPolicy (#3592)
  [AMORO-3594] Improve table identifiers display (#3595)
  [AMORO-3587] Modify the default value of hive catalog clients to 20 (#3590)
  [hotfix] Throw the exception when the tableRuntime disposal fails. (#3557)
  [AMORO-3612][Improvement]: Add the log output function of the StandaloneOptimizer module (#3613)
  [AMORO-3620][Improvement]: Fix the error in the calculation of the health score of table (#3621)
  [AMORO-3633][improvement]: Fix the sorting rules of topTables order by healthScore (#3634)
  [AMORO-3645][Improvement]: Optimize target file size after self-optimizing (#3646)
  [AMORO-3664] Trim the leading and trailing whitespace in ResourceGroup properties (#3664)
  [AMORO-3637] Harden the task completion logic to avoid the task state in ACKED forever
  [Hotfix] Replace Jersey Guava imports with Amoro shaded Guava (#3674)
  [AMORO-3684]fix continually creating unused keep_file when committing for an unpartitioned mixed_hive table optimization (#3690 )
  [AMORO-2519] Improve the display of Duration in the page of Optimizing>Tables to make it more user-friendly (#3694)
  [AMORO-3638] Add support for task retries when task execution times out
  [Improvement] Use fileIndex="nomax" to avoid log loss. (#3701)
  [AMORO-3245] Display comment on Table page. (#3672)
  [AMORO-3703] Use dataFileFormat for deleteFile if not set (#3704)
  [AMORO-3695][Improvement]: Reduce unnecessary details in the log output (#3696)
  [AMORO-3685] Optimize the performance of fillSkipSet for planning (#3688)
  [AMORO-3716]Enhance FlinkUnifiedCatalog getTable efficiency (#3717)

• Bug Tracking

  [AMORO-3502] The flink optimizer often triggers OOM exceptions. In fact, the files processed by each task are not large (#3521)
  [AMORO-3538] Resolve Hive 4 Metastore listing failure on Hadoop2 (#3539)
  [Hotfix] Fix HudiTableDesctiptor error (#3572)
  [AMORO-3549] Fix AMS helm chart cannot set log4j2 because of wrong indentation (#3550)
  [AMORO-3545] Prevent empty tasks list during planning (#3546)
  [AMORO-3599] remove com.esotericsoftware.kryo dependencies in flink optimizer package (#3600)
  [AMORO-3299] Fix the problem that the commit time of the file is displayed incorrectly (#3604)
  [AMORO-3622] Fix expiring data when file without upperbounds (#3623)
  [Hotfix] Handle null partition values in IcebergTableMaintainer to prevent expiration errors (#3635)
  Fixed the memory display error in Spark optimizer resource allocation (#3666)
  [AMORO-3682]Fix table creation failure when comment contains PRIMARY KEY text (#3683)
  [AMORO-3677] Fill catalogProperties in creating catalog rather than building (#3678)
  [AMORO-3718]Inconsistency in capitalization between iceberg and hive partition name within a mixed hive table (#3719)
  [AMORO-3720] fix mixed_format does not support explain for merge into SQL (#3721)
  [AMORO-3713] fix bug of merging into when selecting less columns from souce table than target mixed table (#3722)
  [AMORO-3732] Upgrade commons-beanutils version to 1.11.0 (#3733)
  [AMORO-3739][Bug]: Add iceberg-arrow to ams package (#3740)

• Document Improvement

  fix some doc error (#3551)
  [AMORO-3570] Add Rest Catalog configuration documentation (#3597)
  [AMORO-3616][Improvement] Correct the spelling errors in doc of Managing Optimizers page (#3618)
  [AMORO-3614][Improvement]: Add a document about deploying Amoro in IDE (#3615)
  [AMORO-3631][Improvement]: Update the doc for optimizer management (#3641)
  [AMORO-3552] Optimize binary distribution NOTICE&LICENSE file (#3743)
  [hotfix] Fix doc error in displaying "Using Customized Encryption Method for Configurations" on admin guidance page (#3741)