Tracking issue: repartition

[waynexia]

What does the feature do?

See this RFC #6557

Implementation challenges

• Cross-region file reference Cross region file access #6409
• Global GC worker Tracking issue: global gc worker #6571
• Rule checker Tracking issue for new partition rule checker #6450
• Metasrv
  • Procedure (2 weeks)
    • Scaffold feat: scaffold repartition procedure with plan/resource stubs #7077
  • Allocate/Deallocate resources
• Frontend
  • Grammar and parser (1 week) feat(parser): ALTER TABLE ... REPARTITION ... #7082
  • No ingestion switch (2 weeks)
• Region Server
  • Modify manifest
    • Store PartitionRule feat: Store partition expr in RegionMetadata #6699
  • Region Edit (1 week)
  • Compute manifest (2 weeks) feat: remap SST files for partition change #7071
  • Rollback manifest (1 week)
  • Stage changes
    • Region Staging Mode feat: mito region staging state #6664
    • Stage flush changes feat: persist manifest, SST and index files to staging dir  #6726
    • Exit Staging Mode (1 week) feat: exiting staging mode on success case #6913
    • Enter Staging Mode feat: introduce EnterStagingRequest for RegionEngine #7261
    • Remap manifests interface feat: introduce remap_manifests for RegionEngine #7265
    • Exit Staging Mode with manifest rollback
• Special compaction