ckljohn commented on issue #3227: [AIRFLOW-2299] Add S3 Select functionarity to 
S3FileTransformOperator
URL: 
https://github.com/apache/incubator-airflow/pull/3227#issuecomment-432093892
 
 
   @sekikn  if the file storing encoded string, the `Payload` returned is bytes.
   
   At 
https://github.com/sekikn/incubator-airflow/blob/288fca445ffcad718d39f413eddd8712a18dbf85/airflow/hooks/S3_hook.py#L248,
 `''.join()` will raise exception.
   
   ```
     File "/usr/local/lib/python3.6/site-packages/airflow/hooks/S3_hook.py", 
line 249, in select_key
       for event in response['Payload']
   TypeError: sequence item 0: expected str instance, bytes found
   ```
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to