[jira] [Created] (HIVE-14486) Add CREATE MATERIALIZED VIEW statement

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14486: -- Summary: Add CREATE MATERIALIZED VIEW statement Key: HIVE-14486 URL: https://issues.apache.org/jira/browse/HIVE-14486 Project: Hive

[jira] [Created] (HIVE-14495) Add SHOW MATERIALIZED VIEWS statement

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14495: -- Summary: Add SHOW MATERIALIZED VIEWS statement Key: HIVE-14495 URL: https://issues.apache.org/jira/browse/HIVE-14495 Project: Hive Issue

[jira] [Created] (HIVE-14485) Create 'materialized view' table type

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14485: -- Summary: Create 'materialized view' table type Key: HIVE-14485 URL: https://issues.apache.org/jira/browse/HIVE-14485 Project: Hive Issue

[jira] [Created] (HIVE-14484) Extensions for initial materialized views implementation

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14484: -- Summary: Extensions for initial materialized views implementation Key: HIVE-14484 URL: https://issues.apache.org/jira/browse/HIVE-14484 Project:

Re: Review Request 50873: HIVE-14453 refactor physical writing of ORC data and metadata to FS from the logical writers

2016-08-09 Thread Sergey Shelukhin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50873/ --- (Updated Aug. 9, 2016, 6:24 p.m.) Review request for hive and Prasanth_J.

[jira] [Created] (HIVE-14494) Add support for BUILD DEFERRED

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14494: -- Summary: Add support for BUILD DEFERRED Key: HIVE-14494 URL: https://issues.apache.org/jira/browse/HIVE-14494 Project: Hive Issue Type:

[jira] [Created] (HIVE-14489) Add tests for DESCRIBE [EXTENDED|FORMATTED] statement on materialized views

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14489: -- Summary: Add tests for DESCRIBE [EXTENDED|FORMATTED] statement on materialized views Key: HIVE-14489 URL: https://issues.apache.org/jira/browse/HIVE-14489

[jira] [Created] (HIVE-14488) Add DROP MATERIALIZED VIEW statement

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14488: -- Summary: Add DROP MATERIALIZED VIEW statement Key: HIVE-14488 URL: https://issues.apache.org/jira/browse/HIVE-14488 Project: Hive Issue

[jira] [Created] (HIVE-14490) Block ACID for materialized views

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14490: -- Summary: Block ACID for materialized views Key: HIVE-14490 URL: https://issues.apache.org/jira/browse/HIVE-14490 Project: Hive Issue

[jira] [Created] (HIVE-14491) Implement access control for materialized views

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14491: -- Summary: Implement access control for materialized views Key: HIVE-14491 URL: https://issues.apache.org/jira/browse/HIVE-14491 Project: Hive

[jira] [Created] (HIVE-14492) Optimize query in CREATE MATERIALIZED VIEW statement in Calcite

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14492: -- Summary: Optimize query in CREATE MATERIALIZED VIEW statement in Calcite Key: HIVE-14492 URL: https://issues.apache.org/jira/browse/HIVE-14492

[jira] [Created] (HIVE-14496) Enable Calcite rewriting with materialized views

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14496: -- Summary: Enable Calcite rewriting with materialized views Key: HIVE-14496 URL: https://issues.apache.org/jira/browse/HIVE-14496 Project: Hive

[jira] [Created] (HIVE-14497) Fine control for using materialized views in rewriting

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14497: -- Summary: Fine control for using materialized views in rewriting Key: HIVE-14497 URL: https://issues.apache.org/jira/browse/HIVE-14497 Project:

[jira] [Created] (HIVE-14487) Add REBUILD statement for materialized views

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14487: -- Summary: Add REBUILD statement for materialized views Key: HIVE-14487 URL: https://issues.apache.org/jira/browse/HIVE-14487 Project: Hive

[jira] [Created] (HIVE-14509) AvroSerde mutates tinyint and smallint columns when specifying native columns

2016-08-09 Thread Mark Wagner (JIRA)
Mark Wagner created HIVE-14509: -- Summary: AvroSerde mutates tinyint and smallint columns when specifying native columns Key: HIVE-14509 URL: https://issues.apache.org/jira/browse/HIVE-14509 Project:

filter push down help

2016-08-09 Thread Zhu Li
Hi, I am working on a connector where I need to push filters down to readers of Hive tables. So I should convert the filter in predicate to ExprNodeGenericFuncDesc first. I could code this by myself but I guess there must be some methods in Hive that are actually doing this. However, it is

Re: Hive unit testing in other projects

2016-08-09 Thread Matt Burgess
I am interested in this as well, we have Hive processors (in Apache NiFi) but have been using Derby to test the processor logic (not necessarily the interaction with Hive). With an embedded/small Hive it would be an integration test but still would help a great deal to iron out bugs. Regards,

Hive unit testing in other projects

2016-08-09 Thread Chris Teoh
Hi folks, I'm working on a Sqoop patch that imports to Hive and am wondering what's the easiest way to incorporate a unit test that uses a mini Hive server without requiring a full dependency on Hive project? Kind Regards Chris

Review Request 50942: HIVE-14376: Schema evolution tests takes a long time

2016-08-09 Thread j . prasanth . j
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50942/ --- Review request for hive and Siddharth Seth. Bugs: HIVE-14376

Re: Review Request 50359: HIVE-14270: Write temporary data to HDFS when doing inserts on tables located on S3

2016-08-09 Thread Lefty Leverenz
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50359/#review145307 --- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java (lines

Re: Review Request 50359: HIVE-14270: Write temporary data to HDFS when doing inserts on tables located on S3

2016-08-09 Thread Lefty Leverenz
> On July 30, 2016, 8:44 a.m., Lefty Leverenz wrote: > > common/src/java/org/apache/hadoop/hive/conf/HiveConf.java, lines 3066-3067 > > > > > > Typo: Commad-separated --> Comma-separated > > > >

Re: Review Request 50359: HIVE-14270: Write temporary data to HDFS when doing inserts on tables located on S3

2016-08-09 Thread Lefty Leverenz
> On July 30, 2016, 8:44 a.m., Lefty Leverenz wrote: > > common/src/java/org/apache/hadoop/hive/conf/HiveConf.java, lines 3066-3067 > > > > > > Typo: Commad-separated --> Comma-separated > > > >

Re: Review Request 50906: HIVE-14444 Upgrade qtest execution framework to junit4 - migrate most of them

2016-08-09 Thread Zoltan Haindrich
> On Aug. 9, 2016, 12:14 a.m., Peter Vary wrote: > > Hi Zoltan, > > > > Thanks for the patch, I can see, that you were working on it even on the > > weekend. > > > > Please help me to understand the components a little more, so I could help > > with the review. > > As I can see there are 3

Review Request 50916: HIVE-14481: Remove the comments from the query

2016-08-09 Thread Ryu Kobayashi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50916/ --- Review request for hive. Repository: hive-git Description ---

[jira] [Created] (HIVE-14482) Drop table partition is not audit logged in HMS

2016-08-09 Thread Eric Lin (JIRA)
Eric Lin created HIVE-14482: --- Summary: Drop table partition is not audit logged in HMS Key: HIVE-14482 URL: https://issues.apache.org/jira/browse/HIVE-14482 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-14483) java.lang.ArrayIndexOutOfBoundsException org.apache.orc.impl.TreeReaderFactory$BytesColumnVectorUtil.commonReadByteArrays

2016-08-09 Thread Sergey Zadoroshnyak (JIRA)
Sergey Zadoroshnyak created HIVE-14483: -- Summary: java.lang.ArrayIndexOutOfBoundsException org.apache.orc.impl.TreeReaderFactory$BytesColumnVectorUtil.commonReadByteArrays Key: HIVE-14483 URL:

[jira] [Created] (HIVE-14498) Timeout for query rewriting using materialized views

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14498: -- Summary: Timeout for query rewriting using materialized views Key: HIVE-14498 URL: https://issues.apache.org/jira/browse/HIVE-14498 Project: Hive

Re: Review Request 50906: HIVE-14444 Upgrade qtest execution framework to junit4 - migrate most of them

2016-08-09 Thread Peter Vary
> On Aug. 9, 2016, 12:14 a.m., Peter Vary wrote: > > Hi Zoltan, > > > > Thanks for the patch, I can see, that you were working on it even on the > > weekend. > > > > Please help me to understand the components a little more, so I could help > > with the review. > > As I can see there are 3

[jira] [Created] (HIVE-14501) MiniTez test for union_type_chk.q is slow

2016-08-09 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-14501: Summary: MiniTez test for union_type_chk.q is slow Key: HIVE-14501 URL: https://issues.apache.org/jira/browse/HIVE-14501 Project: Hive Issue

[jira] [Created] (HIVE-14502) Convert MiniTez tests to MiniLlap tests

2016-08-09 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-14502: Summary: Convert MiniTez tests to MiniLlap tests Key: HIVE-14502 URL: https://issues.apache.org/jira/browse/HIVE-14502 Project: Hive Issue

[jira] [Created] (HIVE-14505) Analyze org.apache.hive.jdbc.TestJdbcWithMiniHS2.testAddJarConstructorUnCaching failure

2016-08-09 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
Hari Sankar Sivarama Subramaniyan created HIVE-14505: Summary: Analyze org.apache.hive.jdbc.TestJdbcWithMiniHS2.testAddJarConstructorUnCaching failure Key: HIVE-14505 URL:

[jira] [Created] (HIVE-14506) TestQueryLifeTimeHook hang

2016-08-09 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
Hari Sankar Sivarama Subramaniyan created HIVE-14506: Summary: TestQueryLifeTimeHook hang Key: HIVE-14506 URL: https://issues.apache.org/jira/browse/HIVE-14506 Project: Hive

Re: Review Request 50359: HIVE-14270: Write temporary data to HDFS when doing inserts on tables located on S3

2016-08-09 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50359/#review145269 ---

[jira] [Created] (HIVE-14508) Explore surefire parallel testing options

2016-08-09 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-14508: Summary: Explore surefire parallel testing options Key: HIVE-14508 URL: https://issues.apache.org/jira/browse/HIVE-14508 Project: Hive Issue

[jira] [Created] (HIVE-14507) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_orc_llap_counters failure

2016-08-09 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
Hari Sankar Sivarama Subramaniyan created HIVE-14507: Summary: org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_orc_llap_counters failure Key: HIVE-14507 URL:

Re: Review Request 50359: HIVE-14270: Write temporary data to HDFS when doing inserts on tables located on S3

2016-08-09 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50359/ --- (Updated Aug. 9, 2016, 7:53 p.m.) Review request for hive. Changes ---

Review Request 50934: HIVE-14233 Improve vectorization for ACID by eliminating row-by-row stitching

2016-08-09 Thread Saket Saurabh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50934/ --- Review request for hive and Eugene Koifman. Repository: hive-git Description

[jira] [Created] (HIVE-14504) tez_join_hash.q test is slow

2016-08-09 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-14504: Summary: tez_join_hash.q test is slow Key: HIVE-14504 URL: https://issues.apache.org/jira/browse/HIVE-14504 Project: Hive Issue Type:

[jira] [Created] (HIVE-14493) Partitioning support for materialized views

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14493: -- Summary: Partitioning support for materialized views Key: HIVE-14493 URL: https://issues.apache.org/jira/browse/HIVE-14493 Project: Hive

Re: Review Request 50896: HIVE-14404: Allow delimiterfordsv to use multiple-character delimiters

2016-08-09 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50896/#review145227 --- I'm ambivilent, I would rather have pursued the change to make it

[jira] [Created] (HIVE-14503) Remove explicit order by in qfiles and replace them with SORT_QUERY_RESULTS

2016-08-09 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-14503: Summary: Remove explicit order by in qfiles and replace them with SORT_QUERY_RESULTS Key: HIVE-14503 URL: https://issues.apache.org/jira/browse/HIVE-14503

[jira] [Created] (HIVE-14499) Add HMS metrics for materialized views

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14499: -- Summary: Add HMS metrics for materialized views Key: HIVE-14499 URL: https://issues.apache.org/jira/browse/HIVE-14499 Project: Hive

[jira] [Created] (HIVE-14500) Support masking of columns for materialized views

2016-08-09 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14500: -- Summary: Support masking of columns for materialized views Key: HIVE-14500 URL: https://issues.apache.org/jira/browse/HIVE-14500 Project: Hive

Re: Review Request 50359: HIVE-14270: Write temporary data to HDFS when doing inserts on tables located on S3

2016-08-09 Thread Sergio Pena
> On Aug. 9, 2016, 9:49 p.m., Ashutosh Chauhan wrote: > > ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java, lines > > 1807-1814 > > > > > > Why not use newly added