Tanmay Deshpande created NIFI-5307:
--------------------------------------

             Summary: Select Hive Processor takes longer time to write into CSV 
files
                 Key: NIFI-5307
                 URL: https://issues.apache.org/jira/browse/NIFI-5307
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Configuration
    Affects Versions: 1.6.0
            Reporter: Tanmay Deshpande


Team,

Current Select Hive SQL processor reads each line from result set and writes 
into the file. This can be improved to directly write records in bulk to 
improve the performance. When tried with millions of rows the reading from Hive 
only takes few milliseconds but writing to file takes several minutes. 

 

Thanks,

Tanmay

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to