You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hey. With a great amount of success I'm using Kyuubi (1.10.0) with spark (3.5.3) and so far everything seemed to be working. However, I stumbled upon a brick wall when trying to test how Ranger can be integrated.
I'm launching my engines on a Kubernetes cluster via spark-submit. They are connecting to Kyuubi normally and everything is perfectly normal. The problem is that spark-submit uses a Kubernetes configmap mounted onto ./conf directory for providing the properties file, which makes the directory read-only and overwrites its original contents. This makes the fact that the Kyuubi's Ranger extension needs the ranger-spark-security.xml file to be exactly there problematic.
I did not find any way to plug into the generated configmap directly nor to change the location where the extension is looking for config files.
Is there an already existing solution to this problem?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hey. With a great amount of success I'm using Kyuubi (1.10.0) with spark (3.5.3) and so far everything seemed to be working. However, I stumbled upon a brick wall when trying to test how Ranger can be integrated.
I'm launching my engines on a Kubernetes cluster via spark-submit. They are connecting to Kyuubi normally and everything is perfectly normal. The problem is that spark-submit uses a Kubernetes configmap mounted onto ./conf directory for providing the properties file, which makes the directory read-only and overwrites its original contents. This makes the fact that the Kyuubi's Ranger extension needs the ranger-spark-security.xml file to be exactly there problematic.
I did not find any way to plug into the generated configmap directly nor to change the location where the extension is looking for config files.
Is there an already existing solution to this problem?
Beta Was this translation helpful? Give feedback.
All reactions