Ash Berlin-Taylor created AIRFLOW-1797:
------------------------------------------
Summary: Cannot write task logs to S3 with Python3
Key: AIRFLOW-1797
URL: https://issues.apache.org/jira/browse/AIRFLOW-1797
Project: Apache Airflow
Issue Type: Bug
Reporter: Ash Berlin-Taylor
{noformat}
Traceback (most recent call last):
File
"/usr/local/lib/python3.5/dist-packages/airflow/utils/log/s3_task_handler.py",
line 161, in s3_write
encrypt=configuration.getboolean('core', 'ENCRYPT_S3_LOGS'),
File "/usr/local/lib/python3.5/dist-packages/airflow/hooks/S3_hook.py", line
253, in load_string
client.upload_fileobj(filelike_buffer, bucket_name, key,
ExtraArgs=extra_args)
File "/usr/local/lib/python3.5/dist-packages/boto3/s3/inject.py", line 431,
in upload_fileobj
return future.result()
File "/usr/local/lib/python3.5/dist-packages/s3transfer/futures.py", line 73,
in result
return self._coordinator.result()
File "/usr/local/lib/python3.5/dist-packages/s3transfer/futures.py", line
233, in result
raise self._exception
File "/usr/local/lib/python3.5/dist-packages/s3transfer/tasks.py", line 126,
in __call__
return self._execute_main(kwargs)
File "/usr/local/lib/python3.5/dist-packages/s3transfer/tasks.py", line 150,
in _execute_main
return_value = self._main(**kwargs)
File "/usr/local/lib/python3.5/dist-packages/s3transfer/upload.py", line 679,
in _main
client.put_object(Bucket=bucket, Key=key, Body=body, **extra_args)
File "/usr/local/lib/python3.5/dist-packages/botocore/client.py", line 312,
in _api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/local/lib/python3.5/dist-packages/botocore/client.py", line 586,
in _make_api_call
request_signer=self._request_signer, context=request_context)
File "/usr/local/lib/python3.5/dist-packages/botocore/hooks.py", line 242, in
emit_until_response
responses = self._emit(event_name, kwargs, stop_on_response=True)
File "/usr/local/lib/python3.5/dist-packages/botocore/hooks.py", line 210, in
_emit
response = handler(**kwargs)
File "/usr/local/lib/python3.5/dist-packages/botocore/handlers.py", line 201,
in conditionally_calculate_md5
calculate_md5(params, **kwargs)
File "/usr/local/lib/python3.5/dist-packages/botocore/handlers.py", line 179,
in calculate_md5
binary_md5 = _calculate_md5_from_file(body)
File "/usr/local/lib/python3.5/dist-packages/botocore/handlers.py", line 193,
in _calculate_md5_from_file
md5.update(chunk)
TypeError: Unicode-objects must be encoded before hashing
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
