domain-driven appends

[Jiaweihu08]

Description

The PR modifies the way appends are done through the following changes:

1. Use the existing index during partition-level domain estimation.
   When a cube c already exists as an inner cube, an element e should be accepted if e.weight < c.existingWeight and count < groupCubeSize.
   When a cube c already exists as a leaf cube, its WeightAndCount should start with its existing group size and add elements until it's full.
2. Compute mergedCubeDomains through a cube-wise sum of the existing domain and the append domains.
3. Compute cube weights from the mergedCubeDomains using Wc = Wpc + dcs / domain.
4. Remove weight merge that was done through harmonic means. The estimated weights from 4. are final.

Fixes #226
The same test from #226 shows that, with these changes, only 0.16% of the append blocks don't update the maxWeight of their corresponding cubes.

Checklist:

• New feature / bug fix has been committed following the Contribution guide.
• Add comments to the code (make it easier for the community!).
• Change the documentation.
• Add tests.
• Your branch is updated to the main branch (dependent changes have been merged).
• Furhter analysis on its impact on Replication

[codecov]

Codecov Report

Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (2d39821) 90.86% compared to head (f2fc149) 92.07%.
Report is 21 commits behind head on main-1.0.0.

❗ Current head f2fc149 differs from pull request most recent head ed25729. Consider uploading reports for the commit ed25729 to get more accurate results

Files	Patch %	Lines
...io/qbeast/core/model/BroadcastedTableChanges.scala	87.50%	1 Missing ⚠️
...cala/io/qbeast/spark/index/OTreeDataAnalyzer.scala	98.11%	1 Missing ⚠️

Additional details and impacted files

@@              Coverage Diff               @@
##           main-1.0.0     #227      +/-   ##
==============================================
+ Coverage       90.86%   92.07%   +1.21%     
==============================================
  Files              93       88       -5     
  Lines            2386     2272     -114     
  Branches          178      176       -2     
==============================================
- Hits             2168     2092      -76     
+ Misses            218      180      -38     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.