[jira] [Resolved] (HIVE-10133) hive -summery
[ https://issues.apache.org/jira/browse/HIVE-10133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bhuwan resolved HIVE-10133. --- Resolution: Done hive -summery - Key: HIVE-10133 URL: https://issues.apache.org/jira/browse/HIVE-10133 Project: Hive Issue Type: Bug Reporter: bhuwan -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10084) Improve common join performance [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385598#comment-14385598
]
Hive QA commented on HIVE-10084:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12708014/HIVE-10084.1-spark.patch
{color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 8707 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_nonmr_fetch
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union31
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_remove_22
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_remove_6_subq
org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/812/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/812/console
Test logs:
http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-812/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 5 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12708014 - PreCommit-HIVE-SPARK-Build
Improve common join performance [Spark Branch]
--
Key: HIVE-10084
URL: https://issues.apache.org/jira/browse/HIVE-10084
Project: Hive
Issue Type: Sub-task
Components: Spark
Reporter: Xuefu Zhang
Attachments: HIVE-10084.1-spark.patch
Benchmark shows that Hive on Spark shows some numbers which indicate that
common join performance can be improved. This task is to investigate and fix
the issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-10038) Add Calcite's ProjectMergeRule.
[ https://issues.apache.org/jira/browse/HIVE-10038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-10038: Attachment: HIVE-10038.6.patch another golden file update Add Calcite's ProjectMergeRule. --- Key: HIVE-10038 URL: https://issues.apache.org/jira/browse/HIVE-10038 Project: Hive Issue Type: New Feature Components: CBO, Logical Optimizer Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-10038.2.patch, HIVE-10038.3.patch, HIVE-10038.4.patch, HIVE-10038.5.patch, HIVE-10038.6.patch, HIVE-10038.patch Helps to improve latency by shortening operator pipeline. Folds adjacent projections in one. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10038) Add Calcite's ProjectMergeRule.
[
https://issues.apache.org/jira/browse/HIVE-10038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385520#comment-14385520
]
Hive QA commented on HIVE-10038:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12708002/HIVE-10038.6.patch
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 8679 tests executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_Json
org.apache.hive.jdbc.TestJdbcWithLocalClusterSpark.testTempTable
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3198/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3198/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-3198/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12708002 - PreCommit-HIVE-TRUNK-Build
Add Calcite's ProjectMergeRule.
---
Key: HIVE-10038
URL: https://issues.apache.org/jira/browse/HIVE-10038
Project: Hive
Issue Type: New Feature
Components: CBO, Logical Optimizer
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
Attachments: HIVE-10038.2.patch, HIVE-10038.3.patch,
HIVE-10038.4.patch, HIVE-10038.5.patch, HIVE-10038.6.patch, HIVE-10038.patch
Helps to improve latency by shortening operator pipeline. Folds adjacent
projections in one.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-10050) Support overriding memory configuration for AM launched for TempletonControllerJob
[
https://issues.apache.org/jira/browse/HIVE-10050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385250#comment-14385250
]
Hive QA commented on HIVE-10050:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12707905/HIVE-10050.3.patch
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 8679 tests executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.testPigPopulation
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3194/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3194/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-3194/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12707905 - PreCommit-HIVE-TRUNK-Build
Support overriding memory configuration for AM launched for
TempletonControllerJob
--
Key: HIVE-10050
URL: https://issues.apache.org/jira/browse/HIVE-10050
Project: Hive
Issue Type: Bug
Components: WebHCat
Reporter: Hitesh Shah
Assignee: Hitesh Shah
Attachments: HIVE-10050.1.patch, HIVE-10050.2.patch,
HIVE-10050.3.patch
The MR AM launched for the TempletonControllerJob does not do any heavy
lifting and therefore can be configured to use a small memory footprint ( as
compared to potentially using the default footprint for most MR jobs on a
cluster ).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-10130) Merge from Spark branch to trunk 03/27/2015 [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-10130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10130: --- Summary: Merge from Spark branch to trunk 03/27/2015 [Spark Branch] (was: Merge from Spark branch to trunk 03/27/2015) Merge from Spark branch to trunk 03/27/2015 [Spark Branch] -- Key: HIVE-10130 URL: https://issues.apache.org/jira/browse/HIVE-10130 Project: Hive Issue Type: Sub-task Components: Spark Affects Versions: spark-branch Reporter: Xuefu Zhang Assignee: Xuefu Zhang Attachments: HIVE-10130.1-spark.patch, HIVE-10130.2-spark.patch, HIVE-10130.2-spark.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10038) Add Calcite's ProjectMergeRule.
[
https://issues.apache.org/jira/browse/HIVE-10038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385366#comment-14385366
]
Hive QA commented on HIVE-10038:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12707928/HIVE-10038.5.patch
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 8679 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_decimal_2
org.apache.hive.spark.client.TestSparkClient.testJobSubmission
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3195/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3195/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-3195/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12707928 - PreCommit-HIVE-TRUNK-Build
Add Calcite's ProjectMergeRule.
---
Key: HIVE-10038
URL: https://issues.apache.org/jira/browse/HIVE-10038
Project: Hive
Issue Type: New Feature
Components: CBO, Logical Optimizer
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
Attachments: HIVE-10038.2.patch, HIVE-10038.3.patch,
HIVE-10038.4.patch, HIVE-10038.5.patch, HIVE-10038.patch
Helps to improve latency by shortening operator pipeline. Folds adjacent
projections in one.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-10089) RCFile: lateral view explode caused ConcurrentModificationException
[
https://issues.apache.org/jira/browse/HIVE-10089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385217#comment-14385217
]
Hive QA commented on HIVE-10089:
{color:green}Overall{color}: +1 all checks pass
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12707884/HIVE-10089.1.patch
{color:green}SUCCESS:{color} +1 8679 tests passed
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3192/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3192/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-3192/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12707884 - PreCommit-HIVE-TRUNK-Build
RCFile: lateral view explode caused ConcurrentModificationException
---
Key: HIVE-10089
URL: https://issues.apache.org/jira/browse/HIVE-10089
Project: Hive
Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Selina Zhang
Assignee: Selina Zhang
Attachments: HIVE-10089.1.patch
CREATE TABLE test_table123 (a INT, b MAPSTRING, STRING) STORED AS RCFILE;
INSERT OVERWRITE TABLE test_table123 SELECT 1, MAP(a1, b1, c1, d1)
FROM src LIMIT 1;
The following query will lead to ConcurrentModificationException
SELECT * FROM (SELECT b FROM test_table123) t1 LATERAL VIEW explode(b) x AS
b,c LIMIT 1;
Failed with exception
java.io.IOException:java.util.ConcurrentModificationException
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-10120) Disallow create table with dot/colon in column name
[
https://issues.apache.org/jira/browse/HIVE-10120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385159#comment-14385159
]
Hive QA commented on HIVE-10120:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12707863/HIVE-10120.01.patch
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 8673 tests executed
*Failed tests:*
{noformat}
TestSparkClient - did not produce a TEST-*.xml file
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_percentile_approx_23
org.apache.hive.jdbc.TestSSL.testSSLFetchHttp
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3190/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3190/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-3190/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12707863 - PreCommit-HIVE-TRUNK-Build
Disallow create table with dot/colon in column name
---
Key: HIVE-10120
URL: https://issues.apache.org/jira/browse/HIVE-10120
Project: Hive
Issue Type: Improvement
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
Attachments: HIVE-10120.01.patch
Since we don't allow users to query column names with dot in the middle such
as emp.no, don't allow users to create tables with such columns that cannot
be queried. Fix the documentation to reflect this fix.
Here is an example. Consider this table:
{code}
CREATE TABLE a (`emp.no` string);
select `emp.no` from a; fails with this message:
FAILED: RuntimeException java.lang.RuntimeException: cannot find field emp
from [0:emp.no]
{code}
The hive documentation needs to be fixed:
{code}
(https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL) seems
to indicate that any Unicode character can go between the backticks in the
select statement, but it doesn’t like the dot/colon or even select * when
there is a column that has a dot/colon.
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-10114) Split strategies for ORC
[
https://issues.apache.org/jira/browse/HIVE-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385188#comment-14385188
]
Hive QA commented on HIVE-10114:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12707872/HIVE-10114.2.patch
{color:red}ERROR:{color} -1 due to 18 failed/errored test(s), 8679 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_acid_vectorization_partition
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_sortmerge_join_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_delete_all_partitioned
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_delete_where_partitioned
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_delete_whole_partition
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_orig_table
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_values_orig_table
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_update_all_partitioned
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_update_where_partitioned
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_dynamic
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_delete_all_partitioned
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_delete_where_partitioned
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_delete_whole_partition
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_insert_orig_table
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_update_all_partitioned
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_update_where_partitioned
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_index_bitmap_auto
org.apache.hadoop.hive.ql.io.orc.TestOrcRawRecordMerger.testRecordReaderIncompleteDelta
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3191/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3191/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-3191/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 18 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12707872 - PreCommit-HIVE-TRUNK-Build
Split strategies for ORC
Key: HIVE-10114
URL: https://issues.apache.org/jira/browse/HIVE-10114
Project: Hive
Issue Type: Improvement
Affects Versions: 1.2.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran
Attachments: HIVE-10114.1.patch, HIVE-10114.2.patch
ORC split generation does not have clearly defined strategies for different
scenarios (many small orc files, few small orc files, many large files etc.).
Few strategies like storing the file footer in orc split, making entire file
as a orc split already exists. This JIRA to make the split generation
simpler, support different strategies for various use cases (BI, ETL, ACID
etc.) and to lay the foundation for HIVE-7428.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-10132) LLAP: Tez heartbeats are delayed by ~500+ ms due to Hadoop IPC client
[ https://issues.apache.org/jira/browse/HIVE-10132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10132: --- Attachment: HIVE-10132.NOT.A.patch This turns off the client-cache, which uses the socket factory object as the key. But is not the right fix. LLAP: Tez heartbeats are delayed by ~500+ ms due to Hadoop IPC client - Key: HIVE-10132 URL: https://issues.apache.org/jira/browse/HIVE-10132 Project: Hive Issue Type: Sub-task Reporter: Gopal V Assignee: Siddharth Seth Attachments: HIVE-10132.NOT.A.patch HADOOP-11772 has a clearer bug report of the core issue inside hadoop-common. Due to the delayed heartbeats reaching the AM, the reducers are losing up-to a couple of seconds for a 60ms (x10 parallel) mapper + 300ms reducer instead of finishing the query in under a second. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
