Ashutosh Chauhan created HIVE-3489: -------------------------------------- Summary: Use OutputCommitter to get rid of requirement of client being alive for long running queries Key: HIVE-3489 URL: https://issues.apache.org/jira/browse/HIVE-3489 Project: Hive Issue Type: Bug Reporter: Ashutosh Chauhan
There is a bunch of work (depending on query) which hive client does once query finishes. This has multiple effects which would be nice to avoid. Few of these work items include: * Moving temp files / dirs around to their final destination. * Creating empty files if required. * Updating metastore with metadata. * More ? If we start using {{OutputCommitter}} then clients can fire and forget, they won't need to be around for all the time query is executing. Plus, since processing is going to happen in cluster, this further makes client lightweight. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira