[jira] [Commented] (HIVE-19453) Extend Load Data statement to take Input file format and Serde as parameters

2018-05-11 Thread Deepak Jaiswal (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472360#comment-16472360
 ] 

Deepak Jaiswal commented on HIVE-19453:
---

committed to branch-3.

> Extend Load Data statement to take Input file format and Serde as parameters
> 
>
> Key: HIVE-19453
> URL: https://issues.apache.org/jira/browse/HIVE-19453
> Project: Hive
>  Issue Type: Task
>Reporter: Deepak Jaiswal
>Assignee: Deepak Jaiswal
>Priority: Major
> Attachments: HIVE-19453.01-branch-3.patch, HIVE-19453.1.patch
>
>
> Extend the load data statement to take the inputformat of the source files 
> and the serde to interpret it as parameter. For eg,
>  
> load data local inpath 
> '../../data/files/load_data_job/partitions/load_data_2_partitions.txt' INTO 
> TABLE srcbucket_mapjoin
> INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat'
> SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe';



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-19453) Extend Load Data statement to take Input file format and Serde as parameters

2018-05-10 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471369#comment-16471369
 ] 

Hive QA commented on HIVE-19453:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12922702/HIVE-19453.01-branch-3.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 30 failed/errored test(s), 13373 tests 
executed
*Failed tests:*
{noformat}
TestBeeLineDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=253)
TestDbNotificationListener - did not produce a TEST-*.xml file (likely timed 
out) (batchId=247)
TestDummy - did not produce a TEST-*.xml file (likely timed out) (batchId=253)
TestHCatHiveCompatibility - did not produce a TEST-*.xml file (likely timed 
out) (batchId=247)
TestMiniDruidCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=253)
TestMiniDruidKafkaCliDriver - did not produce a TEST-*.xml file (likely timed 
out) (batchId=253)
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=95)

[jira] [Commented] (HIVE-19453) Extend Load Data statement to take Input file format and Serde as parameters

2018-05-10 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471308#comment-16471308
 ] 

Hive QA commented on HIVE-19453:


| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | {color:red} patch {color} | {color:red}  0m  8s{color} 
| {color:red} 
/data/hiveptest/logs/PreCommit-HIVE-Build-10812/patches/PreCommit-HIVE-Build-10812.patch
 does not apply to master. Rebase required? Wrong Branch? See 
http://cwiki.apache.org/confluence/display/Hive/HowToContribute for help. 
{color} |
\\
\\
|| Subsystem || Report/Notes ||
| Console output | 
http://104.198.109.242/logs//PreCommit-HIVE-Build-10812/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |


This message was automatically generated.



> Extend Load Data statement to take Input file format and Serde as parameters
> 
>
> Key: HIVE-19453
> URL: https://issues.apache.org/jira/browse/HIVE-19453
> Project: Hive
>  Issue Type: Task
>Reporter: Deepak Jaiswal
>Assignee: Deepak Jaiswal
>Priority: Major
> Attachments: HIVE-19453.01-branch-3.patch, HIVE-19453.1.patch
>
>
> Extend the load data statement to take the inputformat of the source files 
> and the serde to interpret it as parameter. For eg,
>  
> load data local inpath 
> '../../data/files/load_data_job/partitions/load_data_2_partitions.txt' INTO 
> TABLE srcbucket_mapjoin
> INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat'
> SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe';



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-19453) Extend Load Data statement to take Input file format and Serde as parameters

2018-05-09 Thread Deepak Jaiswal (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469298#comment-16469298
 ] 

Deepak Jaiswal commented on HIVE-19453:
---

Thanks for the review [~jdere]. Committed to master. Now preparing for branch-3

> Extend Load Data statement to take Input file format and Serde as parameters
> 
>
> Key: HIVE-19453
> URL: https://issues.apache.org/jira/browse/HIVE-19453
> Project: Hive
>  Issue Type: Task
>Reporter: Deepak Jaiswal
>Assignee: Deepak Jaiswal
>Priority: Major
> Attachments: HIVE-19453.1.patch
>
>
> Extend the load data statement to take the inputformat of the source files 
> and the serde to interpret it as parameter. For eg,
>  
> load data local inpath 
> '../../data/files/load_data_job/partitions/load_data_2_partitions.txt' INTO 
> TABLE srcbucket_mapjoin
> INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat'
> SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe';



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-19453) Extend Load Data statement to take Input file format and Serde as parameters

2018-05-09 Thread Jason Dere (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469229#comment-16469229
 ] 

Jason Dere commented on HIVE-19453:
---

+1

> Extend Load Data statement to take Input file format and Serde as parameters
> 
>
> Key: HIVE-19453
> URL: https://issues.apache.org/jira/browse/HIVE-19453
> Project: Hive
>  Issue Type: Task
>Reporter: Deepak Jaiswal
>Assignee: Deepak Jaiswal
>Priority: Major
> Attachments: HIVE-19453.1.patch
>
>
> Extend the load data statement to take the inputformat of the source files 
> and the serde to interpret it as parameter. For eg,
>  
> load data local inpath 
> '../../data/files/load_data_job/partitions/load_data_2_partitions.txt' INTO 
> TABLE srcbucket_mapjoin
> INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat'
> SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe';



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-19453) Extend Load Data statement to take Input file format and Serde as parameters

2018-05-09 Thread Deepak Jaiswal (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468553#comment-16468553
 ] 

Deepak Jaiswal commented on HIVE-19453:
---

No new failures.

> Extend Load Data statement to take Input file format and Serde as parameters
> 
>
> Key: HIVE-19453
> URL: https://issues.apache.org/jira/browse/HIVE-19453
> Project: Hive
>  Issue Type: Task
>Reporter: Deepak Jaiswal
>Assignee: Deepak Jaiswal
>Priority: Major
> Attachments: HIVE-19453.1.patch
>
>
> Extend the load data statement to take the inputformat of the source files 
> and the serde to interpret it as parameter. For eg,
>  
> load data local inpath 
> '../../data/files/load_data_job/partitions/load_data_2_partitions.txt' INTO 
> TABLE srcbucket_mapjoin
> INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat'
> SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe';



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-19453) Extend Load Data statement to take Input file format and Serde as parameters

2018-05-09 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468524#comment-16468524
 ] 

Hive QA commented on HIVE-19453:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12922402/HIVE-19453.1.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 44 failed/errored test(s), 13543 tests 
executed
*Failed tests:*
{noformat}
TestDbNotificationListener - did not produce a TEST-*.xml file (likely timed 
out) (batchId=247)
TestHCatHiveCompatibility - did not produce a TEST-*.xml file (likely timed 
out) (batchId=247)
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=95)

[jira] [Commented] (HIVE-19453) Extend Load Data statement to take Input file format and Serde as parameters

2018-05-09 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468487#comment-16468487
 ] 

Hive QA commented on HIVE-19453:


| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  7m 
35s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m  
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
39s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue}  4m  
2s{color} | {color:blue} ql in master has 2321 extant Findbugs warnings. 
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
53s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m  
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  1m  
5s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red}  0m 
38s{color} | {color:red} ql: The patch generated 1 new + 9 unchanged - 0 fixed 
= 10 total (was 9) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  4m  
5s{color} | {color:red} ql generated 10 new + 2311 unchanged - 10 fixed = 2321 
total (was 2321) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
54s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red}  0m 
14s{color} | {color:red} The patch generated 1 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 23m  3s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:ql |
|  |  Should org.apache.hadoop.hive.ql.parse.HiveParser$DFA226 be a _static_ 
inner class?  At HiveParser.java:inner class?  At HiveParser.java:[lines 
46328-46341] |
|  |  Should org.apache.hadoop.hive.ql.parse.HiveParser$DFA270 be a _static_ 
inner class?  At HiveParser.java:inner class?  At HiveParser.java:[lines 
46664-46677] |
|  |  Dead store to LA28_125 in 
org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int, 
IntStream)  At 
HiveParser.java:org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int,
 IntStream)  At HiveParser.java:[line 46068] |
|  |  Dead store to LA28_127 in 
org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int, 
IntStream)  At 
HiveParser.java:org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int,
 IntStream)  At HiveParser.java:[line 46081] |
|  |  Dead store to LA28_129 in 
org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int, 
IntStream)  At 
HiveParser.java:org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int,
 IntStream)  At HiveParser.java:[line 46094] |
|  |  Dead store to LA28_131 in 
org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int, 
IntStream)  At 
HiveParser.java:org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int,
 IntStream)  At HiveParser.java:[line 46107] |
|  |  Dead store to LA28_133 in 
org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int, 
IntStream)  At 
HiveParser.java:org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int,
 IntStream)  At HiveParser.java:[line 46120] |
|  |  Dead store to LA28_135 in 
org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int, 
IntStream)  At 
HiveParser.java:org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int,
 IntStream)  At HiveParser.java:[line 46133] |
|  |  Dead store to LA28_137 in 
org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int, 
IntStream)  At 
HiveParser.java:org.apache.hadoop.hive.ql.parse.HiveParser$DFA28.specialStateTransition(int,
 IntStream)  At HiveParser.java:[line 46146] |
|  |  Dead store to LA28_139 in