Could you share more details about kyuubi engine pool mode?

[zhichaoleo]

Hi Team,

We want to use kyuubi engine pool mode. But the document is a little simple about this topic.
As we know, kyuubi engine share mode are: CONNECTION, USER, GROUP, SERVER; And the engine pool mode is enabled through kyuubi.engine.pool.size.
From my point of view, I think engine pool mode should work with other engine share mode. Dose it means we can use engine pool mode for any of these engine share mode?

I tried connection engine share mode and user engine share mode. Seems the pool mode will work under user engine share mode.

But will not work under connection engine share mode:

My config:
# kyuubi engine related
kyuubi.engine.pool.name kyuubi-engine-pool-alex
kyuubi.engine.pool.size 3
kyuubi.engine.pool.size.threshold 5

Could you help to share more details about kyuubi engine pool mode?

Thanks,
Alex

[pan3793]

Dose it means we can use engine pool mode for any of these engine share mode?

Almost right, except to CONNECTION mode.

[pan3793]

Figure 1 shows the how the zk-based engine router works.

Figure 2 gives an example how user A, B, C, D which belong to group ads to use engine pools. The results are:

• User A will randomly get normal-pool-[1-3]
• User B will randomly get sla-pool-[1-3]
• User C will randomly get sla-pool-[1-2]
• User D will always get sla-pool-3

[zhichaoleo]

Got it! Thanks @pan3793 !