Re: Apache Hive 3.0.0 release preparation

2018-04-13 Thread Vihang Karajgaonkar
Hi Vineet, I created a profile on ptest-server so that tests can be run on branch-3. It is the same as branch-2 patches. You will need to include branch-3 in the patch name. Eg. HIVE-1234.01-branch-3.patch -Vihang On Mon, Apr 9, 2018 at 4:35 PM, Vineet Garg wrote: > I

Recent change to skip tests

2018-04-13 Thread Deepak Jaiswal
Hi, It seems someone committed a patch to modify ptests. I see this on the ptest console output, “Checking PreCommit-HIVE-Build queue... PreCommit-HIVE-Build has the following jira(s) in queue: [18845, 19161, 19054, 19161, 19126, 19184, 18652, 19184, 19187, 19175, 18902, 19104, 16041, 12369,

[jira] [Created] (HIVE-19206) Automatic memory management for open streaming writers

2018-04-13 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-19206: Summary: Automatic memory management for open streaming writers Key: HIVE-19206 URL: https://issues.apache.org/jira/browse/HIVE-19206 Project: Hive

Re: Review Request 66571: HIVE-19161: Add authorizations to information schema

2018-04-13 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66571/ --- (Updated April 13, 2018, 8:49 p.m.) Review request for hive. Repository:

[jira] [Created] (HIVE-19213) QueryCache: Stop opening transactions on _dummy_table

2018-04-13 Thread Gopal V (JIRA)
Gopal V created HIVE-19213: -- Summary: QueryCache: Stop opening transactions on _dummy_table Key: HIVE-19213 URL: https://issues.apache.org/jira/browse/HIVE-19213 Project: Hive Issue Type: Bug

Re: Review Request 66571: HIVE-19161: Add authorizations to information schema

2018-04-13 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66571/ --- (Updated April 13, 2018, 8:48 p.m.) Review request for hive. Repository:

[jira] [Created] (HIVE-19212) Fix findbugs yetus pre-commit checks

2018-04-13 Thread Sahil Takiar (JIRA)
Sahil Takiar created HIVE-19212: --- Summary: Fix findbugs yetus pre-commit checks Key: HIVE-19212 URL: https://issues.apache.org/jira/browse/HIVE-19212 Project: Hive Issue Type: Bug

Re: Apache Hive 3.0.0 release preparation

2018-04-13 Thread Vineet Garg
Thanks Vihang! > On Apr 13, 2018, at 12:36 PM, Vihang Karajgaonkar wrote: > > Hi Vineet, > > I created a profile on ptest-server so that tests can be run on branch-3. > It is the same as branch-2 patches. You will need to include branch-3 in > the patch name. Eg.

Re: Review Request 66571: HIVE-19161: Add authorizations to information schema

2018-04-13 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66571/#review201119 --- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java Lines

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-13 Thread Matt McCline
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/#review201121 ---

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-13 Thread Deepak Jaiswal
> On April 13, 2018, 6:05 p.m., Matt McCline wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/ReduceSinkOperator.java > > Lines 338 (patched) > > > > > > Logging per row too expensive to leave in. Thanks for

[jira] [Created] (HIVE-19209) Streaming ingest record writers should accept input stream

2018-04-13 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-19209: Summary: Streaming ingest record writers should accept input stream Key: HIVE-19209 URL: https://issues.apache.org/jira/browse/HIVE-19209 Project:

Re: Recent change to skip tests

2018-04-13 Thread Deepak Jaiswal
I reopened HIVE-19077 to remove the future instance instead of the current one. On 4/13/18, 11:10 AM, "Deepak Jaiswal" wrote: Hi, It seems someone committed a patch to modify ptests. I see this on the ptest console output, “Checking

[jira] [Created] (HIVE-19207) Support avro record writer for streaming ingest

2018-04-13 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-19207: Summary: Support avro record writer for streaming ingest Key: HIVE-19207 URL: https://issues.apache.org/jira/browse/HIVE-19207 Project: Hive

[jira] [Created] (HIVE-19210) Create separate module for streaming ingest

2018-04-13 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-19210: Summary: Create separate module for streaming ingest Key: HIVE-19210 URL: https://issues.apache.org/jira/browse/HIVE-19210 Project: Hive

[jira] [Created] (HIVE-19204) Detailed errors from some tasks are not displayed to the client because the tasks don't set exception when they fail

2018-04-13 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-19204: --- Summary: Detailed errors from some tasks are not displayed to the client because the tasks don't set exception when they fail Key: HIVE-19204 URL:

[jira] [Created] (HIVE-19205) Hive streaming ingest improvements (v2)

2018-04-13 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-19205: Summary: Hive streaming ingest improvements (v2) Key: HIVE-19205 URL: https://issues.apache.org/jira/browse/HIVE-19205 Project: Hive Issue

[jira] [Created] (HIVE-19208) Automatic distribution for non-bucketed tables during streaming ingest

2018-04-13 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-19208: Summary: Automatic distribution for non-bucketed tables during streaming ingest Key: HIVE-19208 URL: https://issues.apache.org/jira/browse/HIVE-19208

[jira] [Created] (HIVE-19211) New streaming ingest API and support for dynamic partitioning

2018-04-13 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-19211: Summary: New streaming ingest API and support for dynamic partitioning Key: HIVE-19211 URL: https://issues.apache.org/jira/browse/HIVE-19211 Project:

Re: Review Request 66571: HIVE-19161: Add authorizations to information schema

2018-04-13 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66571/ --- (Updated April 13, 2018, 10:30 p.m.) Review request for hive. Repository:

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-13 Thread Jason Dere
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/#review201133 --- hbase-handler/src/test/results/positive/external_table_ppd.q.out

Re: Review Request 66571: HIVE-19161: Add authorizations to information schema

2018-04-13 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66571/#review201142 ---

Re: Review Request 66571: HIVE-19161: Add authorizations to information schema

2018-04-13 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66571/#review201144 --- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java Lines

Re: Review Request 66614: HIVE-19210: Create separate module for streaming ingest

2018-04-13 Thread j . prasanth . j
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66614/ --- (Updated April 13, 2018, 11:58 p.m.) Review request for hive, Ashutosh Chauhan

[jira] [Created] (HIVE-19214) High throughput ingest ORC format

2018-04-13 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-19214: Summary: High throughput ingest ORC format Key: HIVE-19214 URL: https://issues.apache.org/jira/browse/HIVE-19214 Project: Hive Issue Type:

Review Request 66614: HIVE-19210: Create separate module for streaming ingest

2018-04-13 Thread j . prasanth . j
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66614/ --- Review request for hive, Ashutosh Chauhan and EugeneBK EugeneBK. Repository:

Re: Review Request 66614: HIVE-19210: Create separate module for streaming ingest

2018-04-13 Thread j . prasanth . j
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66614/ --- (Updated April 13, 2018, 10:49 p.m.) Review request for hive, Ashutosh Chauhan

[jira] [Created] (HIVE-19215) JavaUtils.AnyIdDirFilter ignores base_n directories

2018-04-13 Thread Eugene Koifman (JIRA)
Eugene Koifman created HIVE-19215: - Summary: JavaUtils.AnyIdDirFilter ignores base_n directories Key: HIVE-19215 URL: https://issues.apache.org/jira/browse/HIVE-19215 Project: Hive Issue

[jira] [Created] (HIVE-19200) Vectorization: Disable vectorization for LLAP I/O when a non-VECTORIZED_INPUT_FILE_FORMAT mode is needed (i.e. rows) and data type conversion is needed

2018-04-13 Thread Matt McCline (JIRA)
Matt McCline created HIVE-19200: --- Summary: Vectorization: Disable vectorization for LLAP I/O when a non-VECTORIZED_INPUT_FILE_FORMAT mode is needed (i.e. rows) and data type conversion is needed Key: HIVE-19200

[jira] [Created] (HIVE-19201) Hive doesn't read Druid data correctly

2018-04-13 Thread Tournadre (JIRA)
Tournadre created HIVE-19201: Summary: Hive doesn't read Druid data correctly Key: HIVE-19201 URL: https://issues.apache.org/jira/browse/HIVE-19201 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-19199) ACID: DbTxnManager heartbeat-service needs static sync init

2018-04-13 Thread Gopal V (JIRA)
Gopal V created HIVE-19199: -- Summary: ACID: DbTxnManager heartbeat-service needs static sync init Key: HIVE-19199 URL: https://issues.apache.org/jira/browse/HIVE-19199 Project: Hive Issue Type:

Review Request 66604: HIVE-19158: Fix NPE in the HiveMetastore add partition tests

2018-04-13 Thread Marta Kuczora via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66604/ --- Review request for hive, Peter Vary and Adam Szita. Bugs: HIVE-19158

[jira] [Created] (HIVE-19202) CBO failed due to NullPointerException in HiveAggregate.isBucketedInput()

2018-04-13 Thread zhuwei (JIRA)
zhuwei created HIVE-19202: - Summary: CBO failed due to NullPointerException in HiveAggregate.isBucketedInput() Key: HIVE-19202 URL: https://issues.apache.org/jira/browse/HIVE-19202 Project: Hive

[GitHub] hive pull request #37: Fix bug when OrcFileStripeMergeRecordReader get nextS...

2018-04-13 Thread FanTn
Github user FanTn closed the pull request at: https://github.com/apache/hive/pull/37 ---

[jira] [Created] (HIVE-19203) Thread-Safety Issue in HiveMetaStore

2018-04-13 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created HIVE-19203: -- Summary: Thread-Safety Issue in HiveMetaStore Key: HIVE-19203 URL: https://issues.apache.org/jira/browse/HIVE-19203 Project: Hive Issue Type: Bug

Re: Unable to read hive external table data which is linked to s3 after upgradation from 2.1.1 to 2.3.3

2018-04-13 Thread Anup Tiwari
looping dev in for suggestions. Regards, Anup Tiwari On Thu, Apr 12, 2018 at 8:39 PM, Richard A. Bross wrote: > To be honest, my advice was just based on your post - we only use Hive in > AWS EMR, so I couldn't tell you. > > Glad that at least you're back up though. > >