[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-16892: - Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to master. Thanks for the patch [~anishek] and thanks for the review [~sankarh]. > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > Attachments: HIVE-16892.1.patch, HIVE-16892.2.patch, > HIVE-16892.3.patch, HIVE-16892.4.patch, HIVE-16892.5.patch, HIVE-16892.6.patch > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.6.patch removing the remote iterator. > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > Attachments: HIVE-16892.1.patch, HIVE-16892.2.patch, > HIVE-16892.3.patch, HIVE-16892.4.patch, HIVE-16892.5.patch, HIVE-16892.6.patch > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.5.patch fixing import > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > Attachments: HIVE-16892.1.patch, HIVE-16892.2.patch, > HIVE-16892.3.patch, HIVE-16892.4.patch, HIVE-16892.5.patch > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.4.patch > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > Attachments: HIVE-16892.1.patch, HIVE-16892.2.patch, > HIVE-16892.3.patch, HIVE-16892.4.patch > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: (was: HIVE-16892.4.patch) > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > Attachments: HIVE-16892.1.patch, HIVE-16892.2.patch, > HIVE-16892.3.patch > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.4.patch fixing * org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[exim_11_managed_external] * org.apache.hadoop.hive.ql.parse.TestReplicationScenarios.testViewsReplication * org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_uri_export] * org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[exim_12_nonnative_export] > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > Attachments: HIVE-16892.1.patch, HIVE-16892.2.patch, > HIVE-16892.3.patch, HIVE-16892.4.patch > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.3.patch fixing regressions > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > Attachments: HIVE-16892.1.patch, HIVE-16892.2.patch, > HIVE-16892.3.patch > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.2.patch using the correct path object for detecting the export directory file system > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > Attachments: HIVE-16892.1.patch, HIVE-16892.2.patch > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Status: Patch Available (was: In Progress) > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > Attachments: HIVE-16892.1.patch > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.1.patch > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > Attachments: HIVE-16892.1.patch > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Issue Type: Sub-task (was: Improvement) Parent: HIVE-16865 > Move creation of _files from ReplCopyTask to analysis phase for boostrap > replication > - > > Key: HIVE-16892 > URL: https://issues.apache.org/jira/browse/HIVE-16892 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: anishek > Fix For: 3.0.0 > > > during replication boostrap we create the _files via ReplCopyTask for > partitions and tables, this can be done inline as part of analysis phase > rather than creating the replCopytask, > This is done to prevent creation of huge number of these tasks in memory > before giving it to the execution engine. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
