[jira] [Commented] (HIVE-23499) REPL: repl load should honor "hive.repl.dump.metadata.only=true"
[
https://issues.apache.org/jira/browse/HIVE-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132917#comment-17132917
]
Rajesh Balamohan commented on HIVE-23499:
-
Given that we have {{hive.repl.dump.skip.immutable.data.copy}}, we can use it
in dump side as well. In such cases, same dump can be used multiple times. Need
to ensure that "load complete ack" file is not created in such cases. I will
upload .2 version shortly.
> REPL: repl load should honor "hive.repl.dump.metadata.only=true"
>
>
> Key: HIVE-23499
> URL: https://issues.apache.org/jira/browse/HIVE-23499
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
> Attachments: HIVE-23499.1.patch
>
>
> "{{hive.repl.dump.metadata.only=true"}} is not currently honored during
> "{{repl load"}}. Currently, it ends up copying all files even if this option
> is specified in "repl load". E.g
> {noformat}
> repl load airline_ontime_orc into another_airline_ontime_orc with
> ('hive.repl.rootdir'='s3a://blah/', 'hive.repl.dump.metadata.only'='true');
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23499) REPL: repl load should honor "hive.repl.dump.metadata.only=true"
[
https://issues.apache.org/jira/browse/HIVE-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123745#comment-17123745
]
Aasha Medhi commented on HIVE-23499:
hive.repl.dump.metadata.only=true is a dump side configuration. Should we reuse
the same for load?
> REPL: repl load should honor "hive.repl.dump.metadata.only=true"
>
>
> Key: HIVE-23499
> URL: https://issues.apache.org/jira/browse/HIVE-23499
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
> Attachments: HIVE-23499.1.patch
>
>
> "{{hive.repl.dump.metadata.only=true"}} is not currently honored during
> "{{repl load"}}. Currently, it ends up copying all files even if this option
> is specified in "repl load". E.g
> {noformat}
> repl load airline_ontime_orc into another_airline_ontime_orc with
> ('hive.repl.rootdir'='s3a://blah/', 'hive.repl.dump.metadata.only'='true');
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23499) REPL: repl load should honor "hive.repl.dump.metadata.only=true"
[
https://issues.apache.org/jira/browse/HIVE-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111623#comment-17111623
]
Hive QA commented on HIVE-23499:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13003395/HIVE-23499.1.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17270 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22466/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22466/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22466/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13003395 - PreCommit-HIVE-Build
> REPL: repl load should honor "hive.repl.dump.metadata.only=true"
>
>
> Key: HIVE-23499
> URL: https://issues.apache.org/jira/browse/HIVE-23499
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
> Attachments: HIVE-23499.1.patch
>
>
> "{{hive.repl.dump.metadata.only=true"}} is not currently honored during
> "{{repl load"}}. Currently, it ends up copying all files even if this option
> is specified in "repl load". E.g
> {noformat}
> repl load airline_ontime_orc into another_airline_ontime_orc with
> ('hive.repl.rootdir'='s3a://blah/', 'hive.repl.dump.metadata.only'='true');
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23499) REPL: repl load should honor "hive.repl.dump.metadata.only=true"
[
https://issues.apache.org/jira/browse/HIVE-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111611#comment-17111611
]
Hive QA commented on HIVE-23499:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 12m
2s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
14s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
59s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
16s{color} | {color:blue} ql in master has 1527 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
6s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
59s{color} | {color:red} ql: The patch generated 1 new + 31 unchanged - 0 fixed
= 32 total (was 31) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
36s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
8s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
18s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 30m 26s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22466/dev-support/hive-personality.sh
|
| git revision | master / 2f7a607 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22466/yetus/diff-checkstyle-ql.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22466/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> REPL: repl load should honor "hive.repl.dump.metadata.only=true"
>
>
> Key: HIVE-23499
> URL: https://issues.apache.org/jira/browse/HIVE-23499
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
> Attachments: HIVE-23499.1.patch
>
>
> "{{hive.repl.dump.metadata.only=true"}} is not currently honored during
> "{{repl load"}}. Currently, it ends up copying all files even if this option
> is specified in "repl load". E.g
> {noformat}
> repl load airline_ontime_orc into another_airline_ontime_orc with
> ('hive.repl.rootdir'='s3a://blah/', 'hive.repl.dump.metadata.only'='true');
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
