Daniel Frank created AIRFLOW-514:

             Summary: HiveCli hook should be able to load a pandas DataFrame 
                 Key: AIRFLOW-514
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-514
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Daniel Frank
            Assignee: Daniel Frank
            Priority: Minor

Currently the hive cli hook can load_df, which returns a pandas.DataFrame. Many 
of our workflows involve retrieving a hive table in pandas.DataFrame form, 
modifying it and saving it (perhaps elsewhere). In order to save the dataframe 
we have to manually translate the types, save to disk and run load_file() which 
is repetitive and tedious. This workflow could be easily automated with a 
load_df method for HiveCliHook 

This message was sent by Atlassian JIRA

Reply via email to