No, I've been running python 3 in my testing environment for sometime now (migrating prod soon) which is why I'm surprised I hadn't encountered this before.
On Wed, Mar 29, 2017 at 7:50 AM Maxime Beauchemin < [email protected]> wrote: > snakebite isn't py3 compatible. > > Did you both upgrade to 1.8.0 and to py3 at the same time? > > Max > > On Wed, Mar 29, 2017 at 1:27 AM, Nicholas Hodgkinson < > [email protected]> wrote: > > > So I upgraded my airflow instance to 1.8.0 and found that several of my > > DAGs wouldn't load due to this exception: > > > > [2017-03-29 07:04:25,294] [5] {models.py:266} ERROR - Failed to import: > > /opt/airflow/dags/automator-sensor.py > > Traceback (most recent call last): > > File "/usr/local/lib/python3.4/dist-packages/airflow/models.py", line > > 263, in process_file > > m = imp.load_source(mod_name, filepath) > > File "/usr/lib/python3.4/imp.py", line 171, in load_source > > module = methods.load() > > File "<frozen importlib._bootstrap>", line 1220, in load > > File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked > > File "<frozen importlib._bootstrap>", line 1129, in _exec > > File "<frozen importlib._bootstrap>", line 1471, in exec_module > > File "<frozen importlib._bootstrap>", line 321, in > > _call_with_frames_removed > > File "/opt/airflow/dags/automator-sensor.py", line 11, in <module> > > from lib.data_loading import DataLoader > > File "/opt/airflow/dags/lib/data_loading.py", line 16, in <module> > > from airflow.operators.sensors import S3KeySensor > > File > > "/usr/local/lib/python3.4/dist-packages/airflow/operators/sensors.py", > > line > > 33, in <module> > > from airflow.hooks.hdfs_hook import HDFSHook > > File "/usr/local/lib/python3.4/dist-packages/airflow/hooks/ > > hdfs_hook.py", > > line 20, in <module> > > from snakebite.client import Client, HAClient, Namenode, > > AutoConfigClient > > File "/usr/local/lib/python3.4/dist-packages/snakebite/client.py", line > > 1473 > > baseTime = min(time * (1L << retries), cap); > > ^ > > SyntaxError: invalid syntax > > > > I had to actually uninstall snakebite to get my DAGs to load properly. > Has > > anyone else encountered this and is there a workaround other than > > uninstalling the library? I didn't find an issue on JIRA for it either, > > happy to submit a ticket if I'm not missing anything. > > > > -N > > [email protected] > > > > -- > > > > > > Read our founder's story. > > <https://collectivehealth.com/blog/started-collective-health/> > > > > *This message may contain confidential, proprietary, or protected > > information. If you are not the intended recipient, you may not review, > > copy, or distribute this message. If you received this message in error, > > please notify the sender by reply email and delete this message.* > > > -- -N [email protected] (913) 927-4891 -- Read our founder's story. <https://collectivehealth.com/blog/started-collective-health/> *This message may contain confidential, proprietary, or protected information. If you are not the intended recipient, you may not review, copy, or distribute this message. If you received this message in error, please notify the sender by reply email and delete this message.*
