[jira] [Commented] (HIVE-8931) Test TestAccumuloCliDriver is not completing

2015-06-06 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575912#comment-14575912
 ] 

Hive QA commented on HIVE-8931:
---



{color:red}Overall{color}: -1 no tests executed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738126/HIVE-8931.001.patch

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4200/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4200/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4200/

Messages:
{noformat}
 This message was trimmed, see log for full details 
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-odbc ---
[INFO] Executing tasks

main:
[mkdir] Created dir: 
/data/hive-ptest/working/apache-github-source-source/odbc/target/tmp
[mkdir] Created dir: 
/data/hive-ptest/working/apache-github-source-source/odbc/target/warehouse
[mkdir] Created dir: 
/data/hive-ptest/working/apache-github-source-source/odbc/target/tmp/conf
 [copy] Copying 11 files to 
/data/hive-ptest/working/apache-github-source-source/odbc/target/tmp/conf
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ 
hive-odbc ---
[INFO] 
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-odbc ---
[INFO] Installing 
/data/hive-ptest/working/apache-github-source-source/odbc/pom.xml to 
/home/hiveptest/.m2/repository/org/apache/hive/hive-odbc/1.3.0-SNAPSHOT/hive-odbc-1.3.0-SNAPSHOT.pom
[INFO] 
[INFO] 
[INFO] Building Hive Shims Aggregator 1.3.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-shims-aggregator 
---
[INFO] Deleting 
/data/hive-ptest/working/apache-github-source-source/shims/target
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/shims 
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @ 
hive-shims-aggregator ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
hive-shims-aggregator ---
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ 
hive-shims-aggregator ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ 
hive-shims-aggregator ---
[INFO] Executing tasks

main:
[mkdir] Created dir: 
/data/hive-ptest/working/apache-github-source-source/shims/target/tmp
[mkdir] Created dir: 
/data/hive-ptest/working/apache-github-source-source/shims/target/warehouse
[mkdir] Created dir: 
/data/hive-ptest/working/apache-github-source-source/shims/target/tmp/conf
 [copy] Copying 11 files to 
/data/hive-ptest/working/apache-github-source-source/shims/target/tmp/conf
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ 
hive-shims-aggregator ---
[INFO] 
[INFO] --- maven-install-plugin:2.4:install (default-install) @ 
hive-shims-aggregator ---
[INFO] Installing 
/data/hive-ptest/working/apache-github-source-source/shims/pom.xml to 
/home/hiveptest/.m2/repository/org/apache/hive/hive-shims-aggregator/1.3.0-SNAPSHOT/hive-shims-aggregator-1.3.0-SNAPSHOT.pom
[INFO] 
[INFO] 
[INFO] Building Hive TestUtils 1.3.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-testutils ---
[INFO] Deleting 
/data/hive-ptest/working/apache-github-source-source/testutils/target
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/testutils 
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @ 
hive-testutils ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-testutils 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ 
hive-testutils ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 
/data/hive-ptest/working/apache-github-source-source/testutils/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-testutils ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] ---

[jira] [Commented] (HIVE-10929) In Tez mode,dynamic partitioning query with union all fails at moveTask,Invalid partition key values

2015-06-06 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575622#comment-14575622
 ] 

Hive QA commented on HIVE-10929:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738075/HIVE-10929.4.patch

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4196/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4196/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4196/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12738075 - PreCommit-HIVE-TRUNK-Build

 In Tez mode,dynamic partitioning query with union all fails at 
 moveTask,Invalid partition key  values
 --

 Key: HIVE-10929
 URL: https://issues.apache.org/jira/browse/HIVE-10929
 Project: Hive
  Issue Type: Bug
  Components: Tez
Affects Versions: 1.2.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
 Attachments: HIVE-10929.1.patch, HIVE-10929.2.patch, 
 HIVE-10929.3.patch, HIVE-10929.4.patch


 {code}
 create table dummy(i int);
 insert into table dummy values (1);
 select * from dummy;
 create table partunion1(id1 int) partitioned by (part1 string);
 set hive.exec.dynamic.partition.mode=nonstrict;
 set hive.execution.engine=tez;
 explain insert into table partunion1 partition(part1)
 select temps.* from (
 select 1 as id1, '2014' as part1 from dummy 
 union all 
 select 2 as id1, '2014' as part1 from dummy ) temps;
 insert into table partunion1 partition(part1)
 select temps.* from (
 select 1 as id1, '2014' as part1 from dummy 
 union all 
 select 2 as id1, '2014' as part1 from dummy ) temps;
 select * from partunion1;
 {code}
 fails.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (HIVE-10881) The bucket number is not respected in insert overwrite.

2015-06-06 Thread Xuefu Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-10881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xuefu Zhang resolved HIVE-10881.

Resolution: Duplicate

Duplicated of HIVE-10880.

 The bucket number is not respected in insert overwrite.
 ---

 Key: HIVE-10881
 URL: https://issues.apache.org/jira/browse/HIVE-10881
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.2.0, 1.3.0
Reporter: Yongzhi Chen
Assignee: Yongzhi Chen
Priority: Critical

 When hive.enforce.bucketing is true, the bucket number defined in the table 
 is no longer respected in current master and 1.2. This is a regression.
 Reproduce:
 {noformat}
 CREATE TABLE IF NOT EXISTS buckettestinput( 
 data string 
 ) 
 ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';
 CREATE TABLE IF NOT EXISTS buckettestoutput1( 
 data string 
 )CLUSTERED BY(data) 
 INTO 2 BUCKETS 
 ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';
 CREATE TABLE IF NOT EXISTS buckettestoutput2( 
 data string 
 )CLUSTERED BY(data) 
 INTO 2 BUCKETS 
 ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';
 Then I inserted the following data into the buckettestinput table
 firstinsert1 
 firstinsert2 
 firstinsert3 
 firstinsert4 
 firstinsert5 
 firstinsert6 
 firstinsert7 
 firstinsert8 
 secondinsert1 
 secondinsert2 
 secondinsert3 
 secondinsert4 
 secondinsert5 
 secondinsert6 
 secondinsert7 
 secondinsert8
 set hive.enforce.bucketing = true; 
 set hive.enforce.sorting=true;
 insert overwrite table buckettestoutput1 
 select * from buckettestinput where data like 'first%';
 set hive.auto.convert.sortmerge.join=true; 
 set hive.optimize.bucketmapjoin = true; 
 set hive.optimize.bucketmapjoin.sortedmerge = true; 
 select * from buckettestoutput1 a join buckettestoutput2 b on (a.data=b.data);
 Error: Error while compiling statement: FAILED: SemanticException [Error 
 10141]: Bucketed table metadata is not correct. Fix the metadata or don't use 
 bucketed mapjoin, by setting hive.enforce.bucketmapjoin to false. The number 
 of buckets for table buckettestoutput1 is 2, whereas the number of files is 1 
 (state=42000,code=10141)
 {noformat}
 The related debug information related to insert overwrite:
 {noformat}
 0: jdbc:hive2://localhost:1 insert overwrite table buckettestoutput1 
 select * from buckettestinput where data like 'first%'insert overwrite table 
 buckettestoutput1 
 0: jdbc:hive2://localhost:1 ;
 select * from buckettestinput where data like ' 
 first%';
 INFO  : Number of reduce tasks determined at compile time: 2
 INFO  : In order to change the average load for a reducer (in bytes):
 INFO  :   set hive.exec.reducers.bytes.per.reducer=number
 INFO  : In order to limit the maximum number of reducers:
 INFO  :   set hive.exec.reducers.max=number
 INFO  : In order to set a constant number of reducers:
 INFO  :   set mapred.reduce.tasks=number
 INFO  : Job running in-process (local Hadoop)
 INFO  : 2015-06-01 11:09:29,650 Stage-1 map = 86%,  reduce = 100%
 INFO  : Ended Job = job_local107155352_0001
 INFO  : Loading data to table default.buckettestoutput1 from 
 file:/user/hive/warehouse/buckettestoutput1/.hive-staging_hive_2015-06-01_11-09-28_166_3109203968904090801-1/-ext-1
 INFO  : Table default.buckettestoutput1 stats: [numFiles=1, numRows=4, 
 totalSize=52, rawDataSize=48]
 No rows affected (1.692 seconds)
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10906) Value based UDAF function without orderby expression throws NPE

2015-06-06 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575814#comment-14575814
 ] 

Hive QA commented on HIVE-10906:




{color:red}Overall{color}: -1 no tests executed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738112/HIVE-10906.2.patch

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4197/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4197/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4197/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit 
status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]]
+ export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
+ JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
+ export 
PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
+ 
PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost 
-Dhttp.proxyPort=3128'
+ M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost 
-Dhttp.proxyPort=3128'
+ cd /data/hive-ptest/working/
+ tee /data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4197/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ cd apache-github-source-source
+ git fetch origin
From https://github.com/apache/hive
   777999a..65626de  branch-1   - origin/branch-1
   491222e..a4d0298  branch-1.2 - origin/branch-1.2
   8a10730..29af41c  master - origin/master
+ git reset --hard HEAD
HEAD is now at 8a10730 HIVE-10932 : Unit test udf_nondeterministic failure due 
to HIVE-10728 (Aihua Xu via Ashutosh Chauhan)
+ git clean -f -d
Removing ql/src/test/queries/clientpositive/tez_union_dynamic_partition.q
Removing 
ql/src/test/results/clientpositive/tez/tez_union_dynamic_partition.q.out
+ git checkout master
Already on 'master'
Your branch is behind 'origin/master' by 1 commit, and can be fast-forwarded.
+ git reset --hard origin/master
HEAD is now at 29af41c HIVE-10941: Provide option to disable spark tests 
outside itests (Hari Sankar Sivarama Subramaniyan, reviewed by Ashutosh Chauhan)
+ git merge --ff-only origin/master
Already up-to-date.
+ git gc
+ patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hive-ptest/working/scratch/build.patch
+ [[ -f /data/hive-ptest/working/scratch/build.patch ]]
+ chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh 
/data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0, p1, or p2
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12738112 - PreCommit-HIVE-TRUNK-Build

 Value based UDAF function without orderby expression throws NPE
 ---

 Key: HIVE-10906
 URL: https://issues.apache.org/jira/browse/HIVE-10906
 Project: Hive
  Issue Type: Sub-task
  Components: PTF-Windowing
Reporter: Aihua Xu
Assignee: Aihua Xu
 Attachments: HIVE-10906.2.patch, HIVE-10906.patch


 The following query throws NPE.
 {noformat}
 select key, value, min(value) over (partition by key range between unbounded 
 preceding and current row) from small;
 FAILED: NullPointerException null
 2015-06-03 13:48:09,268 ERROR [main]: ql.Driver 
 (SessionState.java:printError(957)) - FAILED: NullPointerException null
 java.lang.NullPointerException
 at 
 org.apache.hadoop.hive.ql.parse.WindowingSpec.validateValueBoundary(WindowingSpec.java:293)
 at 
 org.apache.hadoop.hive.ql.parse.WindowingSpec.validateWindowFrame(WindowingSpec.java:281)
 at 
 org.apache.hadoop.hive.ql.parse.WindowingSpec.validateAndMakeEffective(WindowingSpec.java:155)
 at 
 org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genWindowingPlan(SemanticAnalyzer.java:11965)
 at

[jira] [Commented] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements

2015-06-06 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576044#comment-14576044
 ] 

Hive QA commented on HIVE-10841:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738118/HIVE-10841.1.patch

{color:red}ERROR:{color} -1 due to 98 failed/errored test(s), 9002 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join12
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join23
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_sortmerge_join_12
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_bucketsortoptimize_insert_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_bucketsortoptimize_insert_7
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_cond_pushdown
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_join_breaktask
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join12
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join19
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join23
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join28
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join32
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join32_lessSize
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join33
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_alt_syntax
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_hive_626
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_star
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_vc
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_view
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lateral_view_ppd
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapjoin_subquery
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapjoin_subquery2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multiMapJoin1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multi_join_union
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_no_hooks
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_join5
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_outer_join5
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoin
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_smb_mapjoin9
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udtf_json_tuple
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udtf_parse_url_tuple
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union22
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_inner_join
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_mr_diff_schema_alias
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_auto_sortmerge_join_12
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_bucket_map_join_tez1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynamic_partition_pruning
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_explainuser_2
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_filter_join_breaktask
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_hybridgrace_hashjoin_2
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_lvj_mapjoin
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_skewjoin
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_inner_join
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_mr_diff_schema_alias
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vectorized_dynamic_partition_pruning
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join12
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join16

[jira] [Updated] (HIVE-10955) CliDriver leaves tables behind at end of test run

2015-06-06 Thread Ashutosh Chauhan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-10955:

Description: When run serially with other drivers, this causes problems  
(was: When run serially with other drives, this causes problems)

 CliDriver leaves tables behind at end of test run 
 --

 Key: HIVE-10955
 URL: https://issues.apache.org/jira/browse/HIVE-10955
 Project: Hive
  Issue Type: Test
  Components: Testing Infrastructure
Affects Versions: 1.3.0
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-10955.patch


 When run serially with other drivers, this causes problems



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-10958) Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails

2015-06-06 Thread Pengcheng Xiong (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pengcheng Xiong updated HIVE-10958:
---
Attachment: HIVE-10958.01.patch

 Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails
 --

 Key: HIVE-10958
 URL: https://issues.apache.org/jira/browse/HIVE-10958
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-10958.01.patch


 Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails due to the 
 statement set mapred.reduce.tasks = 18;



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-10955) CliDriver leaves tables behind at end of test run

2015-06-06 Thread Ashutosh Chauhan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-10955:

Affects Version/s: (was: 1.3.0)
   1.2.0

 CliDriver leaves tables behind at end of test run 
 --

 Key: HIVE-10955
 URL: https://issues.apache.org/jira/browse/HIVE-10955
 Project: Hive
  Issue Type: Test
  Components: Testing Infrastructure
Affects Versions: 1.2.0
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 1.2.1

 Attachments: HIVE-10955.patch


 When run serially with other drivers, this causes problems



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10955) CliDriver leaves tables behind at end of test run

2015-06-06 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575948#comment-14575948
 ] 

Ashutosh Chauhan commented on HIVE-10955:
-

Test failures are unrelated. [~hsubramaniyan] can you please take a look?

 CliDriver leaves tables behind at end of test run 
 --

 Key: HIVE-10955
 URL: https://issues.apache.org/jira/browse/HIVE-10955
 Project: Hive
  Issue Type: Test
  Components: Testing Infrastructure
Affects Versions: 1.3.0
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-10955.patch


 When run serially with other drivers, this causes problems



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10956) HS2 leaks HMS connections

2015-06-06 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575961#comment-14575961
 ] 

Hive QA commented on HIVE-10956:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738129/HIVE-10956.1.patch

{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4201/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4201/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4201/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12738129 - PreCommit-HIVE-TRUNK-Build

 HS2 leaks HMS connections
 -

 Key: HIVE-10956
 URL: https://issues.apache.org/jira/browse/HIVE-10956
 Project: Hive
  Issue Type: Bug
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang
 Fix For: 1.3.0

 Attachments: HIVE-10956.1.patch


 HS2 uses threadlocal to cache HMS client in class Hive. When the thread is 
 dead, the HMS client is not closed. So the connection to the HMS is leaked.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-10939) Make TestFileDump robust

2015-06-06 Thread Ashutosh Chauhan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-10939:

Affects Version/s: (was: 1.3.0)
   1.2.0

 Make TestFileDump robust
 

 Key: HIVE-10939
 URL: https://issues.apache.org/jira/browse/HIVE-10939
 Project: Hive
  Issue Type: Test
  Components: Tests
Affects Versions: 1.2.0
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 1.2.1

 Attachments: HIVE-10939.patch


 It fails on Windows OS currently.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (HIVE-10774) ReduceSinkDedup undoes Distinct Rewrite

2015-06-06 Thread Ashutosh Chauhan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan resolved HIVE-10774.
-
Resolution: Won't Fix

As described above, ReduceSinkDedup is doing the right thing. There is nothing 
to fix here.

 ReduceSinkDedup undoes Distinct Rewrite
 ---

 Key: HIVE-10774
 URL: https://issues.apache.org/jira/browse/HIVE-10774
 Project: Hive
  Issue Type: Improvement
  Components: CBO, Logical Optimizer
Affects Versions: 1.2.0
Reporter: Mostafa Mokhtar
Assignee: Ashutosh Chauhan
 Attachments: HIVE-10774.patch


 Now distinct rewrite can fire in more cases.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10957) QueryPlan's start time is incorrect in certain cases

2015-06-06 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575998#comment-14575998
 ] 

Hive QA commented on HIVE-10957:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738139/HIVE-10957.2.patch

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchAbortAndCommit
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4203/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4203/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4203/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12738139 - PreCommit-HIVE-TRUNK-Build

 QueryPlan's start time is incorrect in certain cases
 

 Key: HIVE-10957
 URL: https://issues.apache.org/jira/browse/HIVE-10957
 Project: Hive
  Issue Type: Bug
Reporter: Gunther Hagleitner
Assignee: Wei Zheng
 Attachments: HIVE-10957.1.patch, HIVE-10957.2.patch


 In some cases the start time of the previous query is used mistakenly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-10233) Hive on LLAP: Memory manager

2015-06-06 Thread Vikram Dixit K (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-10233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vikram Dixit K updated HIVE-10233:
--
Attachment: HIVE-10233-WIP-7.patch

Join only patch.

 Hive on LLAP: Memory manager
 

 Key: HIVE-10233
 URL: https://issues.apache.org/jira/browse/HIVE-10233
 Project: Hive
  Issue Type: Bug
  Components: Tez
Affects Versions: llap
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
 Attachments: HIVE-10233-WIP-2.patch, HIVE-10233-WIP-3.patch, 
 HIVE-10233-WIP-4.patch, HIVE-10233-WIP-5.patch, HIVE-10233-WIP-6.patch, 
 HIVE-10233-WIP-7.patch


 We need a memory manager in llap/tez to manage the usage of memory across 
 threads. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10958) Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails

2015-06-06 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576074#comment-14576074
 ] 

Hive QA commented on HIVE-10958:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738205/HIVE-10958.01.patch

{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_index_auto_mult_tables_compact
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4205/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4205/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4205/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12738205 - PreCommit-HIVE-TRUNK-Build

 Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails
 --

 Key: HIVE-10958
 URL: https://issues.apache.org/jira/browse/HIVE-10958
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-10958.01.patch


 Centos: TestMiniTezCliDriver.testCliDriver_mergejoin fails due to the 
 statement set mapred.reduce.tasks = 18;



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10955) CliDriver leaves tables behind at end of test run

2015-06-06 Thread Mostafa Mokhtar (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576059#comment-14576059
 ] 

Mostafa Mokhtar commented on HIVE-10955:


[~ekoifman]
Could this be related to the issues you saw with TDE?

 CliDriver leaves tables behind at end of test run 
 --

 Key: HIVE-10955
 URL: https://issues.apache.org/jira/browse/HIVE-10955
 Project: Hive
  Issue Type: Test
  Components: Testing Infrastructure
Affects Versions: 1.2.0
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 1.2.1

 Attachments: HIVE-10955.patch


 When run serially with other drivers, this causes problems



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10944) Fix HS2 for Metrics

2015-06-06 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576090#comment-14576090
 ] 

Hive QA commented on HIVE-10944:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738208/HIVE-10944.2.patch

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4206/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4206/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4206/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12738208 - PreCommit-HIVE-TRUNK-Build

 Fix HS2 for Metrics
 ---

 Key: HIVE-10944
 URL: https://issues.apache.org/jira/browse/HIVE-10944
 Project: Hive
  Issue Type: Bug
Reporter: Szehon Ho
Assignee: Szehon Ho
 Attachments: HIVE-10944.2.patch, HIVE-10944.patch


 Some issues about initializing the new HS2 metrics
 1.  Metrics is not working properly in HS2 due to wrong init checks
 2.  If not enabled, JVMPauseMonitor logs trash to HS2 logs as it wasnt 
 checking if metrics was enabled.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (HIVE-10907) Hive on Tez: Classcast exception in some cases with SMB joins

2015-06-06 Thread Vikram Dixit K (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575843#comment-14575843
 ] 

Vikram Dixit K edited comment on HIVE-10907 at 6/6/15 5:41 PM:
---

[~sershe] Can you please review this? The purpose of the patch is to prevent 
smb joins in cases where one of the sides would be a map side work and the 
other is coming from a shuffle. This jira is a work around to stop class cast 
exceptions from occurring in that case. The way to prevent this is in 
ConvertJoinMapJoin code where a check is made to see if the number of reduce 
sinks above the parent of the join operator is either 0 or non-zero on all 
sides of the join.

a join b

Non-Kosher case:
{noformat}
 | There should be either no RS left of this boundary or there 
should be one or more for both sides. If that is not the case, no SMB.
RS - Gby -  | RS - Join -
TS - Fil - |   RS /
{noformat}

[~hagleitn] reviewed the patch earlier and made a comment that I addressed 
(basically uncommented the code). Can you take a look and review this patch 
please? This needs to go to branch-1.2 as well.

Thanks
Vikram.


was (Author: vikram.dixit):
[~sershe] Can you please review this? The purpose of the patch is to prevent 
smb joins in cases where one of the sides would be a map side work and the 
other is coming from a shuffle. This jira is a work around to stop class cast 
exceptions from occurring in that case. The way to prevent this is in 
ConvertJoinMapJoin code where a check is made to see if the number of reduce 
sinks above the parent of the join operator is either 0 or non-zero on all 
sides of the join.

a join b

Non-Kosher case:
{noformat}
   | There should be either no RS left of this boundary or 
there should be one or more for both sides. If that is not the case, no SMB.
RS - Gby -  | RS - Join -
TS - Filter - |   RS /
{noformat}

[~hagleitn] reviewed the patch earlier and made a comment that I addressed 
(basically uncommented the code). Can you take a look and review this patch 
please? This needs to go to branch-1.2 as well.

Thanks
Vikram.

 Hive on Tez: Classcast exception in some cases with SMB joins
 -

 Key: HIVE-10907
 URL: https://issues.apache.org/jira/browse/HIVE-10907
 Project: Hive
  Issue Type: Bug
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
 Attachments: HIVE-10907.1.patch, HIVE-10907.2.patch, 
 HIVE-10907.3.patch, HIVE-10907.4.patch


 In cases where there is a mix of Map side work and reduce side work, we get a 
 classcast exception because we assume homogeneity in the code. We need to fix 
 this correctly. For now this is a workaround.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10907) Hive on Tez: Classcast exception in some cases with SMB joins

2015-06-06 Thread Vikram Dixit K (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575843#comment-14575843
 ] 

Vikram Dixit K commented on HIVE-10907:
---

[~sershe] Can you please review this? The purpose of the patch is to prevent 
smb joins in cases where one of the sides would be a map side work and the 
other is coming from a shuffle. This jira is a work around to stop class cast 
exceptions from occurring in that case. The way to prevent this is in 
ConvertJoinMapJoin code where a check is made to see if the number of reduce 
sinks above the parent of the join operator is either 0 or non-zero on all 
sides of the join.

a join b

Non-Kosher case:
{noformat}
   | There should be either no RS left of this boundary or 
there should be one or more for both sides. If that is not the case, no SMB.
RS - Gby -  | RS - Join -
TS - Filter - |   RS /
{noformat}

[~hagleitn] reviewed the patch earlier and made a comment that I addressed 
(basically uncommented the code). Can you take a look and review this patch 
please? This needs to go to branch-1.2 as well.

Thanks
Vikram.

 Hive on Tez: Classcast exception in some cases with SMB joins
 -

 Key: HIVE-10907
 URL: https://issues.apache.org/jira/browse/HIVE-10907
 Project: Hive
  Issue Type: Bug
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
 Attachments: HIVE-10907.1.patch, HIVE-10907.2.patch, 
 HIVE-10907.3.patch, HIVE-10907.4.patch


 In cases where there is a mix of Map side work and reduce side work, we get a 
 classcast exception because we assume homogeneity in the code. We need to fix 
 this correctly. For now this is a workaround.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10910) Alter table drop partition queries in encrypted zone failing to remove data from HDFS

2015-06-06 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575862#comment-14575862
 ] 

Hive QA commented on HIVE-10910:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738120/HIVE-10910.2.patch

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9002 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4198/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4198/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4198/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12738120 - PreCommit-HIVE-TRUNK-Build

 Alter table drop partition queries in encrypted zone failing to remove data 
 from HDFS
 -

 Key: HIVE-10910
 URL: https://issues.apache.org/jira/browse/HIVE-10910
 Project: Hive
  Issue Type: Sub-task
  Components: Hive
Affects Versions: 1.2.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Eugene Koifman
 Attachments: HIVE-10910.2.patch, HIVE-10910.patch


 Alter table query trying to drop partition removes metadata of partition but 
 fails to remove the data from HDFS
 hive create table table_1(name string, age int, gpa double) partitioned by 
 (b string) stored as textfile;
 OK
 Time taken: 0.732 seconds
 hive alter table table_1 add partition (b='2010-10-10');
 OK
 Time taken: 0.496 seconds
 hive show partitions table_1;
 OK
 b=2010-10-10
 Time taken: 0.781 seconds, Fetched: 1 row(s)
 hive alter table table_1 drop partition (b='2010-10-10');
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. Got exception: java.io.IOException 
 Failed to move to trash: 
 hdfs://ip-address:8020/warehouse-dir/table_1/b=2010-10-10
 hive show partitions table_1;
 OK
 Time taken: 0.622 seconds



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-10900) Fix the indeterministic stats for some hive queries

2015-06-06 Thread Ashutosh Chauhan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-10900:

Affects Version/s: 1.1.0
   1.0.0
   1.2.0

 Fix the indeterministic stats for some hive queries 
 

 Key: HIVE-10900
 URL: https://issues.apache.org/jira/browse/HIVE-10900
 Project: Hive
  Issue Type: Improvement
  Components: Tests
Affects Versions: 1.0.0, 1.2.0, 1.1.0
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
Priority: Minor
 Fix For: 1.2.1

 Attachments: HIVE-10900.01.patch


 If we do not run compute stats for a table and then we do some operation on 
 that table, we will get different stats numbers when we run explain. The main 
 reason is due to the different OS/FS configurations that Hive Stats depends 
 on when there is no table stats. A simple fix is to add compute stats for 
 those  indeterministic stats.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-10900) Fix the indeterministic stats for some hive queries

2015-06-06 Thread Ashutosh Chauhan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-10900:

Component/s: Tests

 Fix the indeterministic stats for some hive queries 
 

 Key: HIVE-10900
 URL: https://issues.apache.org/jira/browse/HIVE-10900
 Project: Hive
  Issue Type: Improvement
  Components: Tests
Affects Versions: 1.0.0, 1.2.0, 1.1.0
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
Priority: Minor
 Fix For: 1.2.1

 Attachments: HIVE-10900.01.patch


 If we do not run compute stats for a table and then we do some operation on 
 that table, we will get different stats numbers when we run explain. The main 
 reason is due to the different OS/FS configurations that Hive Stats depends 
 on when there is no table stats. A simple fix is to add compute stats for 
 those  indeterministic stats.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10955) CliDriver leaves tables behind at end of test run

2015-06-06 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575905#comment-14575905
 ] 

Hive QA commented on HIVE-10955:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12738097/HIVE-10955.patch

{color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 9001 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vectorized_parquet_types
org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchAbort
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchEmptyCommit
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4199/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4199/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4199/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 5 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12738097 - PreCommit-HIVE-TRUNK-Build

 CliDriver leaves tables behind at end of test run 
 --

 Key: HIVE-10955
 URL: https://issues.apache.org/jira/browse/HIVE-10955
 Project: Hive
  Issue Type: Test
  Components: Testing Infrastructure
Affects Versions: 1.3.0
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-10955.patch


 When run serially with other drives, this causes problems



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (HIVE-10907) Hive on Tez: Classcast exception in some cases with SMB joins

2015-06-06 Thread Vikram Dixit K (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575843#comment-14575843
 ] 

Vikram Dixit K edited comment on HIVE-10907 at 6/6/15 5:42 PM:
---

[~sershe] Can you please review this? The purpose of the patch is to prevent 
smb joins in cases where one of the sides would be a map side work and the 
other is coming from a shuffle. This jira is a work around to stop class cast 
exceptions from occurring in that case. The way to prevent this is in 
ConvertJoinMapJoin code where a check is made to see if the number of reduce 
sinks above the parent of the join operator is either 0 or non-zero on all 
sides of the join.

a join b

Non-Kosher case:
{noformat}
  | There should be either no RS left of this boundary or there 
should be one or more for both sides. If that is not the case, no SMB.
RS - Gby -  | RS - Join -
TS - Fil -  |   RS /
{noformat}

[~hagleitn] reviewed the patch earlier and made a comment that I addressed 
(basically uncommented the code). Can you take a look and review this patch 
please? This needs to go to branch-1.2 as well.

Thanks
Vikram.


was (Author: vikram.dixit):
[~sershe] Can you please review this? The purpose of the patch is to prevent 
smb joins in cases where one of the sides would be a map side work and the 
other is coming from a shuffle. This jira is a work around to stop class cast 
exceptions from occurring in that case. The way to prevent this is in 
ConvertJoinMapJoin code where a check is made to see if the number of reduce 
sinks above the parent of the join operator is either 0 or non-zero on all 
sides of the join.

a join b

Non-Kosher case:
{noformat}
 | There should be either no RS left of this boundary or there 
should be one or more for both sides. If that is not the case, no SMB.
RS - Gby -  | RS - Join -
TS - Fil - |   RS /
{noformat}

[~hagleitn] reviewed the patch earlier and made a comment that I addressed 
(basically uncommented the code). Can you take a look and review this patch 
please? This needs to go to branch-1.2 as well.

Thanks
Vikram.

 Hive on Tez: Classcast exception in some cases with SMB joins
 -

 Key: HIVE-10907
 URL: https://issues.apache.org/jira/browse/HIVE-10907
 Project: Hive
  Issue Type: Bug
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
 Attachments: HIVE-10907.1.patch, HIVE-10907.2.patch, 
 HIVE-10907.3.patch, HIVE-10907.4.patch


 In cases where there is a mix of Map side work and reduce side work, we get a 
 classcast exception because we assume homogeneity in the code. We need to fix 
 this correctly. For now this is a workaround.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)