[jira] [Commented] (HIVE-19948) HiveCli is not splitting the command by semicolon properly if quotes are inside the string
[ https://issues.apache.org/jira/browse/HIVE-19948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526672#comment-16526672 ] Aihua Xu commented on HIVE-19948: - [~hagleitn] I may have misunderstood. So should we retry to get the flaky test to pass or should we get the flaky test to get fixed completely? > HiveCli is not splitting the command by semicolon properly if quotes are > inside the string > --- > > Key: HIVE-19948 > URL: https://issues.apache.org/jira/browse/HIVE-19948 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 2.2.0 >Reporter: Aihua Xu >Assignee: Aihua Xu >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19948.1.patch, HIVE-19948.2.patch, > HIVE-19948.3.patch > > > HIVE-15297 tries to split the command by considering semicolon inside string, > but it doesn't consider the case that quotes can also be inside string. > For the following command {{insert into escape1 partition (ds='1', part='3') > values ("abc' ");}}, it will fail with > {noformat} > 18/06/19 16:37:05 ERROR ql.Driver: FAILED: ParseException line 1:64 > extraneous input ';' expecting EOF near '' > org.apache.hadoop.hive.ql.parse.ParseException: line 1:64 extraneous input > ';' expecting EOF near '' > at > org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:220) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:74) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:67) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:606) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1686) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1633) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1628) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:214) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) > at > org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:239) > at org.apache.hadoop.util.RunJar.main(RunJar.java:153) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19948) HiveCli is not splitting the command by semicolon properly if quotes are inside the string
[ https://issues.apache.org/jira/browse/HIVE-19948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526641#comment-16526641 ] Gunther Hagleitner commented on HIVE-19948: --- [~aihuaxu] there was a vote recently saying we won't commit w/o a green run. Why does this not apply here? > HiveCli is not splitting the command by semicolon properly if quotes are > inside the string > --- > > Key: HIVE-19948 > URL: https://issues.apache.org/jira/browse/HIVE-19948 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 2.2.0 >Reporter: Aihua Xu >Assignee: Aihua Xu >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19948.1.patch, HIVE-19948.2.patch, > HIVE-19948.3.patch > > > HIVE-15297 tries to split the command by considering semicolon inside string, > but it doesn't consider the case that quotes can also be inside string. > For the following command {{insert into escape1 partition (ds='1', part='3') > values ("abc' ");}}, it will fail with > {noformat} > 18/06/19 16:37:05 ERROR ql.Driver: FAILED: ParseException line 1:64 > extraneous input ';' expecting EOF near '' > org.apache.hadoop.hive.ql.parse.ParseException: line 1:64 extraneous input > ';' expecting EOF near '' > at > org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:220) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:74) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:67) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:606) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1686) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1633) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1628) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:214) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) > at > org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:239) > at org.apache.hadoop.util.RunJar.main(RunJar.java:153) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19948) HiveCli is not splitting the command by semicolon properly if quotes are inside the string
[ https://issues.apache.org/jira/browse/HIVE-19948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521411#comment-16521411 ] Hive QA commented on HIVE-19948: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12928845/HIVE-19948.3.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 14595 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.metastore.client.TestRuntimeStats.testCleanup[Embedded] (batchId=212) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/12048/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/12048/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-12048/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12928845 - PreCommit-HIVE-Build > HiveCli is not splitting the command by semicolon properly if quotes are > inside the string > --- > > Key: HIVE-19948 > URL: https://issues.apache.org/jira/browse/HIVE-19948 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 2.2.0 >Reporter: Aihua Xu >Assignee: Aihua Xu >Priority: Major > Attachments: HIVE-19948.1.patch, HIVE-19948.2.patch, > HIVE-19948.3.patch > > > HIVE-15297 tries to split the command by considering semicolon inside string, > but it doesn't consider the case that quotes can also be inside string. > For the following command {{insert into escape1 partition (ds='1', part='3') > values ("abc' ");}}, it will fail with > {noformat} > 18/06/19 16:37:05 ERROR ql.Driver: FAILED: ParseException line 1:64 > extraneous input ';' expecting EOF near '' > org.apache.hadoop.hive.ql.parse.ParseException: line 1:64 extraneous input > ';' expecting EOF near '' > at > org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:220) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:74) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:67) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:606) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1686) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1633) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1628) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:214) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) > at > org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:239) > at org.apache.hadoop.util.RunJar.main(RunJar.java:153) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19948) HiveCli is not splitting the command by semicolon properly if quotes are inside the string
[ https://issues.apache.org/jira/browse/HIVE-19948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521392#comment-16521392 ] Hive QA commented on HIVE-19948: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m 46s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 17s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 10s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 26s{color} | {color:blue} cli in master has 13 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 11s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 17s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 16s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 16s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 10s{color} | {color:red} cli: The patch generated 2 new + 43 unchanged - 2 fixed = 45 total (was 45) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m 33s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 11s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 9m 50s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-12048/dev-support/hive-personality.sh | | git revision | master / 4b7f88a | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-12048/yetus/diff-checkstyle-cli.txt | | modules | C: cli U: cli | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-12048/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > HiveCli is not splitting the command by semicolon properly if quotes are > inside the string > --- > > Key: HIVE-19948 > URL: https://issues.apache.org/jira/browse/HIVE-19948 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 2.2.0 >Reporter: Aihua Xu >Assignee: Aihua Xu >Priority: Major > Attachments: HIVE-19948.1.patch, HIVE-19948.2.patch, > HIVE-19948.3.patch > > > HIVE-15297 tries to split the command by considering semicolon inside string, > but it doesn't consider the case that quotes can also be inside string. > For the following command {{insert into escape1 partition (ds='1', part='3') > values ("abc' ");}}, it will fail with > {noformat} > 18/06/19 16:37:05 ERROR ql.Driver: FAILED: ParseException line 1:64 > extraneous input ';' expecting EOF near '' > org.apache.hadoop.hive.ql.parse.ParseException: line 1:64 extraneous input > ';' expecting EOF near '' > at > org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:220) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:74) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:67) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:606) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1686) > at
[jira] [Commented] (HIVE-19948) HiveCli is not splitting the command by semicolon properly if quotes are inside the string
[ https://issues.apache.org/jira/browse/HIVE-19948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520911#comment-16520911 ] Hive QA commented on HIVE-19948: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12928651/HIVE-19948.2.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 14591 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestMiniDruidKafkaCliDriver.testCliDriver[druidkafkamini_basic] (batchId=257) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/12003/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/12003/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-12003/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12928651 - PreCommit-HIVE-Build > HiveCli is not splitting the command by semicolon properly if quotes are > inside the string > --- > > Key: HIVE-19948 > URL: https://issues.apache.org/jira/browse/HIVE-19948 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 2.2.0 >Reporter: Aihua Xu >Assignee: Aihua Xu >Priority: Major > Attachments: HIVE-19948.1.patch, HIVE-19948.2.patch, > HIVE-19948.3.patch > > > HIVE-15297 tries to split the command by considering semicolon inside string, > but it doesn't consider the case that quotes can also be inside string. > For the following command {{insert into escape1 partition (ds='1', part='3') > values ("abc' ");}}, it will fail with > {noformat} > 18/06/19 16:37:05 ERROR ql.Driver: FAILED: ParseException line 1:64 > extraneous input ';' expecting EOF near '' > org.apache.hadoop.hive.ql.parse.ParseException: line 1:64 extraneous input > ';' expecting EOF near '' > at > org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:220) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:74) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:67) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:606) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1686) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1633) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1628) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:214) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) > at > org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:239) > at org.apache.hadoop.util.RunJar.main(RunJar.java:153) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19948) HiveCli is not splitting the command by semicolon properly if quotes are inside the string
[ https://issues.apache.org/jira/browse/HIVE-19948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520872#comment-16520872 ] Hive QA commented on HIVE-19948: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 47s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 18s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 10s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 27s{color} | {color:blue} cli in master has 13 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 12s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 18s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 17s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 17s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 10s{color} | {color:red} cli: The patch generated 2 new + 43 unchanged - 2 fixed = 45 total (was 45) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m 37s{color} | {color:red} cli generated 1 new + 13 unchanged - 0 fixed = 14 total (was 13) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 11s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 11m 8s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | FindBugs | module:cli | | | Switch statement found in org.apache.hadoop.hive.cli.CliDriver.splitSemiColon(String) where default case is missing At CliDriver.java:where default case is missing At CliDriver.java:[lines 433-448] | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-12003/dev-support/hive-personality.sh | | git revision | master / 23d2b80 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-12003/yetus/diff-checkstyle-cli.txt | | findbugs | http://104.198.109.242/logs//PreCommit-HIVE-Build-12003/yetus/new-findbugs-cli.html | | modules | C: cli U: cli | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-12003/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > HiveCli is not splitting the command by semicolon properly if quotes are > inside the string > --- > > Key: HIVE-19948 > URL: https://issues.apache.org/jira/browse/HIVE-19948 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 2.2.0 >Reporter: Aihua Xu >Assignee: Aihua Xu >Priority: Major > Attachments: HIVE-19948.1.patch, HIVE-19948.2.patch > > > HIVE-15297 tries to split the command by considering semicolon inside string, > but it doesn't consider the case that quotes can also be inside string. > For the following command {{insert into escape1 partition (ds='1', part='3') > values ("abc' ");}}, it will fail with > {noformat} > 18/06/19 16:37:05 ERROR ql.Driver: FAILED: ParseException line 1:64 > extraneous input ';' expecting EOF near '' > org.apache.hadoop.hive.ql.parse.ParseException: line 1:64 extraneous input > ';' expecting EOF near '' > at >
[jira] [Commented] (HIVE-19948) HiveCli is not splitting the command by semicolon properly if quotes are inside the string
[ https://issues.apache.org/jira/browse/HIVE-19948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519607#comment-16519607 ] Aihua Xu commented on HIVE-19948: - patch-2: splitSemiColon needs to be public since it's used in QTestUtils.java > HiveCli is not splitting the command by semicolon properly if quotes are > inside the string > --- > > Key: HIVE-19948 > URL: https://issues.apache.org/jira/browse/HIVE-19948 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 2.2.0 >Reporter: Aihua Xu >Assignee: Aihua Xu >Priority: Major > Attachments: HIVE-19948.1.patch, HIVE-19948.2.patch > > > HIVE-15297 tries to split the command by considering semicolon inside string, > but it doesn't consider the case that quotes can also be inside string. > For the following command {{insert into escape1 partition (ds='1', part='3') > values ("abc' ");}}, it will fail with > {noformat} > 18/06/19 16:37:05 ERROR ql.Driver: FAILED: ParseException line 1:64 > extraneous input ';' expecting EOF near '' > org.apache.hadoop.hive.ql.parse.ParseException: line 1:64 extraneous input > ';' expecting EOF near '' > at > org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:220) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:74) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:67) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:606) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1686) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1633) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1628) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:214) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) > at > org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:239) > at org.apache.hadoop.util.RunJar.main(RunJar.java:153) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19948) HiveCli is not splitting the command by semicolon properly if quotes are inside the string
[ https://issues.apache.org/jira/browse/HIVE-19948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519577#comment-16519577 ] Hive QA commented on HIVE-19948: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12928526/HIVE-19948.1.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/11973/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/11973/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-11973/ Messages: {noformat} This message was trimmed, see log for full details [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/org/eclipse/jetty/jetty-server/9.3.20.v20170531/jetty-server-9.3.20.v20170531.jar(org/eclipse/jetty/server/handler/HandlerList.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/org/eclipse/jetty/jetty-servlet/9.3.20.v20170531/jetty-servlet-9.3.20.v20170531.jar(org/eclipse/jetty/servlet/FilterHolder.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/org/eclipse/jetty/jetty-servlet/9.3.20.v20170531/jetty-servlet-9.3.20.v20170531.jar(org/eclipse/jetty/servlet/ServletContextHandler.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/org/eclipse/jetty/jetty-servlet/9.3.20.v20170531/jetty-servlet-9.3.20.v20170531.jar(org/eclipse/jetty/servlet/ServletHolder.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/org/eclipse/jetty/jetty-xml/9.3.20.v20170531/jetty-xml-9.3.20.v20170531.jar(org/eclipse/jetty/xml/XmlConfiguration.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/org/slf4j/jul-to-slf4j/1.7.10/jul-to-slf4j-1.7.10.jar(org/slf4j/bridge/SLF4JBridgeHandler.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar(javax/servlet/DispatcherType.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar(javax/servlet/Filter.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar(javax/servlet/FilterChain.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar(javax/servlet/FilterConfig.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar(javax/servlet/ServletException.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar(javax/servlet/ServletRequest.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar(javax/servlet/ServletResponse.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar(javax/servlet/annotation/WebFilter.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar(javax/servlet/http/HttpServletRequest.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar(javax/servlet/http/HttpServletResponse.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/apache-github-source-source/classification/target/hive-classification-4.0.0-SNAPSHOT.jar(org/apache/hadoop/hive/common/classification/InterfaceAudience$LimitedPrivate.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/apache-github-source-source/classification/target/hive-classification-4.0.0-SNAPSHOT.jar(org/apache/hadoop/hive/common/classification/InterfaceStability$Unstable.class)]] [loading ZipFileIndexFileObject[/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar(java/io/ByteArrayOutputStream.class)]] [loading ZipFileIndexFileObject[/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar(java/io/OutputStream.class)]] [loading ZipFileIndexFileObject[/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar(java/io/Closeable.class)]] [loading ZipFileIndexFileObject[/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar(java/lang/AutoCloseable.class)]] [loading ZipFileIndexFileObject[/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar(java/io/Flushable.class)]] [loading ZipFileIndexFileObject[/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar(javax/xml/bind/annotation/XmlRootElement.class)]] [loading ZipFileIndexFileObject[/data/hiveptest/working/maven/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar(org/apache/commons/exec/ExecuteException.class)]] [loading
[jira] [Commented] (HIVE-19948) HiveCli is not splitting the command by semicolon properly if quotes are inside the string
[ https://issues.apache.org/jira/browse/HIVE-19948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518633#comment-16518633 ] Sahil Takiar commented on HIVE-19948: - +1 LGTM > HiveCli is not splitting the command by semicolon properly if quotes are > inside the string > --- > > Key: HIVE-19948 > URL: https://issues.apache.org/jira/browse/HIVE-19948 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 2.2.0 >Reporter: Aihua Xu >Assignee: Aihua Xu >Priority: Major > Attachments: HIVE-19948.1.patch > > > HIVE-15297 tries to split the command by considering semicolon inside string, > but it doesn't consider the case that quotes can also be inside string. > For the following command {{insert into escape1 partition (ds='1', part='3') > values ("abc' ");}}, it will fail with > {noformat} > 18/06/19 16:37:05 ERROR ql.Driver: FAILED: ParseException line 1:64 > extraneous input ';' expecting EOF near '' > org.apache.hadoop.hive.ql.parse.ParseException: line 1:64 extraneous input > ';' expecting EOF near '' > at > org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:220) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:74) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:67) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:606) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1686) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1633) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1628) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:214) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) > at > org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:239) > at org.apache.hadoop.util.RunJar.main(RunJar.java:153) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19948) HiveCli is not splitting the command by semicolon properly if quotes are inside the string
[ https://issues.apache.org/jira/browse/HIVE-19948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518596#comment-16518596 ] Aihua Xu commented on HIVE-19948: - [~stakiar] Can you help take a look? > HiveCli is not splitting the command by semicolon properly if quotes are > inside the string > --- > > Key: HIVE-19948 > URL: https://issues.apache.org/jira/browse/HIVE-19948 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 2.2.0 >Reporter: Aihua Xu >Assignee: Aihua Xu >Priority: Major > Attachments: HIVE-19948.1.patch > > > HIVE-15297 tries to split the command by considering semicolon inside string, > but it doesn't consider the case that quotes can also be inside string. > For the following command {{insert into escape1 partition (ds='1', part='3') > values ("abc' ");}}, it will fail with > {noformat} > 18/06/19 16:37:05 ERROR ql.Driver: FAILED: ParseException line 1:64 > extraneous input ';' expecting EOF near '' > org.apache.hadoop.hive.ql.parse.ParseException: line 1:64 extraneous input > ';' expecting EOF near '' > at > org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:220) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:74) > at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:67) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:606) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1686) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1633) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1628) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:214) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) > at > org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:239) > at org.apache.hadoop.util.RunJar.main(RunJar.java:153) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)