Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed running python -m spylon_kernel install #64

Open
yunjiangster opened this issue Feb 10, 2023 · 0 comments
Open

Failed running python -m spylon_kernel install #64

yunjiangster opened this issue Feb 10, 2023 · 0 comments

Comments

@yunjiangster
Copy link

yunjiangster commented Feb 10, 2023

I got the following error message

Traceback (most recent call last):
  File "/Users/username/miniconda3/lib/python3.9/runpy.py", line 188, in _run_module_as_main
    mod_name, mod_spec, code = _get_module_details(mod_name, _Error)
  File "/Users/username/miniconda3/lib/python3.9/runpy.py", line 147, in _get_module_details
    return _get_module_details(pkg_main_name, error)
  File "/Users/username/miniconda3/lib/python3.9/runpy.py", line 111, in _get_module_details
    __import__(pkg_name)
  File "/Users/username/miniconda3/lib/python3.9/site-packages/spylon_kernel/__init__.py", line 3, in <module>
    from .scala_kernel import SpylonKernel
  File "/Users/username/miniconda3/lib/python3.9/site-packages/spylon_kernel/scala_kernel.py", line 5, in <module>
    from .init_spark_magic import InitSparkMagic
  File "/Users/username/miniconda3/lib/python3.9/site-packages/spylon_kernel/init_spark_magic.py", line 3, in <module>
    import spylon.spark
  File "/Users/username/miniconda3/lib/python3.9/site-packages/spylon/spark/__init__.py", line 27, in <module>
    from .launcher import SparkConfiguration, with_spark_context, with_sql_context
  File "/Users/username/miniconda3/lib/python3.9/site-packages/spylon/spark/launcher.py", line 51, in <module>
    import pyspark
  File "/Users/username/miniconda3/lib/python3.9/site-packages/pyspark/__init__.py", line 46, in <module>
    from pyspark.context import SparkContext
  File "/Users/username/miniconda3/lib/python3.9/site-packages/pyspark/context.py", line 31, in <module>
    from pyspark import accumulators
  File "/Users/username/miniconda3/lib/python3.9/site-packages/pyspark/accumulators.py", line 97, in <module>
    from pyspark.cloudpickle import CloudPickler
  File "/Users/username/miniconda3/lib/python3.9/site-packages/pyspark/cloudpickle.py", line 146, in <module>
    _cell_set_template_code = _make_cell_set_template_code()
  File "/Users/username/miniconda3/lib/python3.9/site-packages/pyspark/cloudpickle.py", line 127, in _make_cell_set_template_code
    return types.CodeType(
TypeError: an integer is required (got type bytes)

environment:
MacOS Monterey, apple M1 pro

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant