AttributeError: module 'lib' has no attribute 'X509_V_FLAG_NOTIFY_POLICY' exception while deploying Dagster code

[gibsondan]

My Dagster code that uses snowflake and/or botocore suddenly started to fail on import / on deployment, with an error like this:

     import snowflake.connector
 .tox/py311/lib/python3.11/site-packages/snowflake/connector/__init__.py:19: in <module>
     from .connection import SnowflakeConnection
 .tox/py311/lib/python3.11/site-packages/snowflake/connector/connection.py:37: in <module>
     from .auth import (
 .tox/py311/lib/python3.11/site-packages/snowflake/connector/auth/__init__.py:7: in <module>
     from ._auth import Auth, get_public_key_fingerprint, get_token_from_private_key
 .tox/py311/lib/python3.11/site-packages/snowflake/connector/auth/_auth.py:55: in <module>
     from ..network import (
 .tox/py311/lib/python3.11/site-packages/snowflake/connector/network.py:21: in <module>
     import OpenSSL.SSL
 .tox/py311/lib/python3.11/site-packages/OpenSSL/__init__.py:8: in <module>
     from OpenSSL import crypto, SSL
 .tox/py311/lib/python3.11/site-packages/OpenSSL/crypto.py:1570: in <module>
     class X509StoreFlags(object):
 .tox/py311/lib/python3.11/site-packages/OpenSSL/crypto.py:1589: in X509StoreFlags
     NOTIFY_POLICY = _lib.X509_V_FLAG_NOTIFY_POLICY
 E   AttributeError: module 'lib' has no attribute 'X509_V_FLAG_NOTIFY_POLICY'

How can I get my Dagster deployment working again?

[gibsondan]

This is caused by an upstream issue in the snowflake-connector-python package: snowflakedb/snowflake-connector-python#2109 allowing versions of the PyOpenSSL package that aren't actually supported by the package.

To fix it, you can add the following to the Python environment your code is running in, usually by editing your setup.py or requirements.txt or pyproject.toml file:

pyOpenSSL>=22.1.0

A workaround will be included in the next released version of dagster-snowflake, planned for the first week of December 2024.