Improve kudo concat performance.

[liurenjie1024]

Closes #2913
Closes #2579

This pr improves kudo concatting performace by following approaches:

1. It simplifies SchemaVisitor interface to avlid unnecessary allocation.
2. It replaced lists in KudoTableMerger and MergeInfoCalc with arrays to avoid unnecessary allocation.
3. It improved algorithm of concating validity buffer by remove all possible branch prediction and method call in tight loop codes.

[liurenjie1024]

build

[liurenjie1024]

build

[revans2]

My main question is how much faster did this make shuffle? This is a performance improvement, but I don't see any benchmark results for how much better it is.

[liurenjie1024]

build

[liurenjie1024]

My main question is how much faster did this make shuffle? This is a performance improvement, but I don't see any benchmark results for how much better it is.

I did some local micro benchmark about concating, and it shows 20% performance improvement, mainly introduced by optimizing concat validity buffer. My local branch shows nds result about 2% perf improvement.

[liurenjie1024]

The code is in fact ready for review, I'm marking it as draft since I'm running integration test to verify it.

[revans2]

Looks good. I would prefer better names than caseOne, caseTwo, and caseThree, but it is documented and probably good enoguh.

[liurenjie1024]

build

[liurenjie1024]

Run integeration tests offline and it passed, merge this now.