[jira] [Commented] (HIVE-18723) CompactorOutputCommitter.commitJob() - check rename() ret val

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392524#comment-16392524 ] Hive QA commented on HIVE-18723: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18883) Add findbugs to yetus pre-commit checks

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392509#comment-16392509 ] Hive QA commented on HIVE-18883: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18832) Support change management for trashing data files from ACID tables.

2018-03-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392492#comment-16392492 ] anishek commented on HIVE-18832: not sure why PR is not getting logged here

[jira] [Updated] (HIVE-18832) Support change management for trashing data files from ACID tables.

2018-03-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-18832: --- Attachment: (was: HIVE-18832.1.patch) > Support change management for trashing data files from ACID

[jira] [Updated] (HIVE-18832) Support change management for trashing data files from ACID tables.

2018-03-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-18832: --- Attachment: HIVE-18832.1.patch > Support change management for trashing data files from ACID tables. >

[jira] [Updated] (HIVE-18832) Support change management for trashing data files from ACID tables.

2018-03-08 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18832: Issue Type: Sub-task (was: Bug) Parent: HIVE-18320 > Support change management for

[jira] [Commented] (HIVE-18883) Add findbugs to yetus pre-commit checks

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392478#comment-16392478 ] Hive QA commented on HIVE-18883: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HIVE-18751) ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.

2018-03-08 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18751: Status: Patch Available (was: Open) > ACID table scan through get_splits UDF doesn't

[jira] [Updated] (HIVE-18751) ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.

2018-03-08 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18751: Attachment: HIVE-18751.01.patch > ACID table scan through get_splits UDF doesn't receive

[jira] [Updated] (HIVE-18751) ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.

2018-03-08 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18751: Attachment: (was: HIVE-18751.01.patch) > ACID table scan through get_splits UDF doesn't

[jira] [Updated] (HIVE-18864) ValidWriteIdList snapshot seems incorrect if obtained after allocating writeId by current transaction.

2018-03-08 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18864: Status: Patch Available (was: Open) > ValidWriteIdList snapshot seems incorrect if

[jira] [Updated] (HIVE-18864) ValidWriteIdList snapshot seems incorrect if obtained after allocating writeId by current transaction.

2018-03-08 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18864: Status: Open (was: Patch Available) > ValidWriteIdList snapshot seems incorrect if

[jira] [Updated] (HIVE-18864) ValidWriteIdList snapshot seems incorrect if obtained after allocating writeId by current transaction.

2018-03-08 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18864: Attachment: HIVE-18864.02.patch > ValidWriteIdList snapshot seems incorrect if obtained

[jira] [Updated] (HIVE-18751) ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.

2018-03-08 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18751: Status: Open (was: Patch Available) > ACID table scan through get_splits UDF doesn't

[jira] [Updated] (HIVE-18864) ValidWriteIdList snapshot seems incorrect if obtained after allocating writeId by current transaction.

2018-03-08 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18864: Attachment: (was: HIVE-18864.02.patch) > ValidWriteIdList snapshot seems incorrect if

[jira] [Commented] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392450#comment-16392450 ] Hive QA commented on HIVE-18739: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15393) Update Guava version

2018-03-08 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392441#comment-16392441 ] Thejas M Nair commented on HIVE-15393: -- bq. Hadoop 3 is compatible with Guava 21 See HADOOP-14386,

[jira] [Commented] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392400#comment-16392400 ] Hive QA commented on HIVE-18739: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-18899) Separate FetchWork required for each query that uses the results cache

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392388#comment-16392388 ] Hive QA commented on HIVE-18899: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18912) Stats task should set accurate flag to false on failure

2018-03-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392354#comment-16392354 ] Sergey Shelukhin commented on HIVE-18912: - I added a bug to StatsTask (some exception in the

[jira] [Commented] (HIVE-18912) Stats task should set accurate flag to false on failure

2018-03-08 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392337#comment-16392337 ] Ashutosh Chauhan commented on HIVE-18912: - Do you have sequence of steps which resulted in this?

[jira] [Commented] (HIVE-18899) Separate FetchWork required for each query that uses the results cache

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392336#comment-16392336 ] Hive QA commented on HIVE-18899: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HIVE-17178) Spark Partition Pruning Sink Operator can't target multiple Works

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392328#comment-16392328 ] Sahil Takiar commented on HIVE-17178: - +1 > Spark Partition Pruning Sink Operator can't target

[jira] [Commented] (HIVE-16855) org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392325#comment-16392325 ] Hive QA commented on HIVE-16855: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18436) Upgrade to Spark 2.3.0

2018-03-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392316#comment-16392316 ] Rui Li commented on HIVE-18436: --- Got it. Thanks for explaining. +1 > Upgrade to Spark 2.3.0 >

[jira] [Updated] (HIVE-18093) Improve logging when HoS application is killed

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18093: Attachment: HIVE-18093.2.patch > Improve logging when HoS application is killed >

[jira] [Updated] (HIVE-18915) Better client logging when a HoS session can't be opened

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18915: Component/s: Spark > Better client logging when a HoS session can't be opened >

[jira] [Updated] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18916: Component/s: Spark > SparkClientImpl doesn't error out if spark-submit fails >

[jira] [Commented] (HIVE-15218) Kyro Exception on subsequent run of a query in LLAP mode

2018-03-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392297#comment-16392297 ] Sergey Shelukhin commented on HIVE-15218: - Is there a reason this was never committed? > Kyro

[jira] [Commented] (HIVE-16855) org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392263#comment-16392263 ] Hive QA commented on HIVE-16855: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HIVE-18920) CBO: Initialize the Janino providers ahead of 1st query

2018-03-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-18920: -- Assignee: Jesus Camacho Rodriguez > CBO: Initialize the Janino providers ahead of 1st query >

[jira] [Commented] (HIVE-18907) Create utility to fix acid key index issue from HIVE-18817

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392237#comment-16392237 ] Hive QA commented on HIVE-18907: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18571) stats issues for MM tables; ACID doesn't check state for CTAS

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18571: -- Component/s: Transactions > stats issues for MM tables; ACID doesn't check state for CTAS >

[jira] [Updated] (HIVE-18911) LOAD.. code for MM has some suspect/dead code

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18911: -- Component/s: Transactions > LOAD.. code for MM has some suspect/dead code >

[jira] [Commented] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392224#comment-16392224 ] Jason Dere commented on HIVE-18918: --- +1 > Bad error message in CompactorMR.lanuchCompactionJob() >

[jira] [Commented] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392219#comment-16392219 ] Eugene Koifman commented on HIVE-18918: --- [~jdere] could you review please > Bad error message in

[jira] [Updated] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18918: -- Description: {noformat} rj.waitForCompletion(); if (!rj.isSuccessful()) {

[jira] [Updated] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18918: -- Status: Patch Available (was: Open) > Bad error message in CompactorMR.lanuchCompactionJob() >

[jira] [Updated] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18918: -- Attachment: HIVE-18918.01.patch > Bad error message in CompactorMR.lanuchCompactionJob() >

[jira] [Commented] (HIVE-18907) Create utility to fix acid key index issue from HIVE-18817

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392204#comment-16392204 ] Hive QA commented on HIVE-18907: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18918: - > Bad error message in CompactorMR.lanuchCompactionJob() >

[jira] [Updated] (HIVE-18831) Differentiate errors that are thrown by Spark tasks

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18831: Attachment: HIVE-18831.3.patch > Differentiate errors that are thrown by Spark tasks >

[jira] [Commented] (HIVE-18831) Differentiate errors that are thrown by Spark tasks

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392163#comment-16392163 ] Sahil Takiar commented on HIVE-18831: - Fixing test failure. > Differentiate errors that are thrown by

[jira] [Commented] (HIVE-14792) AvroSerde reads the remote schema-file at least once per mapper, per table reference.

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392156#comment-16392156 ] Hive QA commented on HIVE-14792: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18907) Create utility to fix acid key index issue from HIVE-18817

2018-03-08 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-18907: -- Attachment: HIVE-18907.3.patch > Create utility to fix acid key index issue from HIVE-18817 >

[jira] [Updated] (HIVE-18910) Migrate to Murmur hash for shuffle and bucketing

2018-03-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18910: -- Attachment: HIVE-18910.2.patch > Migrate to Murmur hash for shuffle and bucketing >

[jira] [Updated] (HIVE-18917) Add spark.home to hive.conf.restricted.list

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18917: Status: Patch Available (was: Open) > Add spark.home to hive.conf.restricted.list >

[jira] [Updated] (HIVE-18917) Add spark.home to hive.conf.restricted.list

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18917: Attachment: HIVE-18917.1.patch > Add spark.home to hive.conf.restricted.list >

[jira] [Updated] (HIVE-18879) Disallow embedded element in UDFXPathUtil needs to work if xercesImpl.jar in classpath

2018-03-08 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-18879: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.3.3 3.0.0

[jira] [Commented] (HIVE-14792) AvroSerde reads the remote schema-file at least once per mapper, per table reference.

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392093#comment-16392093 ] Hive QA commented on HIVE-14792: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HIVE-18917) Add spark.home to hive.conf.restricted.list

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-18917: --- > Add spark.home to hive.conf.restricted.list > --- > >

[jira] [Updated] (HIVE-18871) hive on tez execution error due to set hive.aux.jars.path to hdfs://

2018-03-08 Thread zhuwei (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuwei updated HIVE-18871: -- Fix Version/s: 2.2.1 Status: Patch Available (was: Open) > hive on tez execution error due to set

[jira] [Updated] (HIVE-18871) hive on tez execution error due to set hive.aux.jars.path to hdfs://

2018-03-08 Thread zhuwei (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuwei updated HIVE-18871: -- Status: Open (was: Patch Available) > hive on tez execution error due to set hive.aux.jars.path to hdfs:// >

[jira] [Updated] (HIVE-18871) hive on tez execution error due to set hive.aux.jars.path to hdfs://

2018-03-08 Thread zhuwei (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuwei updated HIVE-18871: -- Status: Open (was: Patch Available) > hive on tez execution error due to set hive.aux.jars.path to hdfs:// >

[jira] [Updated] (HIVE-18871) hive on tez execution error due to set hive.aux.jars.path to hdfs://

2018-03-08 Thread zhuwei (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuwei updated HIVE-18871: -- Status: Patch Available (was: Open) > hive on tez execution error due to set hive.aux.jars.path to hdfs:// >

[jira] [Comment Edited] (HIVE-14792) AvroSerde reads the remote schema-file at least once per mapper, per table reference.

2018-03-08 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392040#comment-16392040 ] Aihua Xu edited comment on HIVE-14792 at 3/8/18 11:08 PM: -- By checking the patch,

[jira] [Commented] (HIVE-17580) Remove dependency of get_fields_with_environment_context API to serde

2018-03-08 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392082#comment-16392082 ] Alan Gates commented on HIVE-17580: --- +1 for the latest PR.  Thank Vihang, this was a lot of work. >

[jira] [Commented] (HIVE-18878) Lower MoveTask Lock Logging to Debug

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392075#comment-16392075 ] Hive QA commented on HIVE-18878: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18727) Update GenericUDFEnforceNotNullConstraint to throw an ERROR instead of Exception on failure

2018-03-08 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392074#comment-16392074 ] Vineet Garg commented on HIVE-18727: bq. include information about the row/column which has the issue

[jira] [Commented] (HIVE-18727) Update GenericUDFEnforceNotNullConstraint to throw an ERROR instead of Exception on failure

2018-03-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392065#comment-16392065 ] Gopal V commented on HIVE-18727: The files need APL license headers and it is important to rename

[jira] [Commented] (HIVE-18727) Update GenericUDFEnforceNotNullConstraint to throw an ERROR instead of Exception on failure

2018-03-08 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392058#comment-16392058 ] Vineet Garg commented on HIVE-18727: Thanks [~vbeshka]. [~gopalv] Would you mind taking a look at it

[jira] [Commented] (HIVE-18804) StatsUtils.getColStatisticsFromExprMap may only provide info for a column once

2018-03-08 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392047#comment-16392047 ] Ashutosh Chauhan commented on HIVE-18804: - Can you please explain the problem and proposed fix? I

[jira] [Commented] (HIVE-14792) AvroSerde reads the remote schema-file at least once per mapper, per table reference.

2018-03-08 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392040#comment-16392040 ] Aihua Xu commented on HIVE-14792: - By checking the patch, since we are calling getTableMetadata() which

[jira] [Commented] (HIVE-18873) Skipping predicate pushdown for MR silently at HiveInputFormat can cause storage handlers to produce erroneous result

2018-03-08 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392041#comment-16392041 ] Josh Elser commented on HIVE-18873: --- {quote}The original issue in HIVE-15680 is when there are 2 table

[jira] [Commented] (HIVE-18878) Lower MoveTask Lock Logging to Debug

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392025#comment-16392025 ] Sahil Takiar commented on HIVE-18878: - Do you have an example of when this causes a lot of verbosity

[jira] [Commented] (HIVE-17580) Remove dependency of get_fields_with_environment_context API to serde

2018-03-08 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392022#comment-16392022 ] Vihang Karajgaonkar commented on HIVE-17580: I update the PR to include the above proposed

[jira] [Commented] (HIVE-14792) AvroSerde reads the remote schema-file at least once per mapper, per table reference.

2018-03-08 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392017#comment-16392017 ] Mithun Radhakrishnan commented on HIVE-14792: - bq. since you have all the context. For what

[jira] [Commented] (HIVE-16855) org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392014#comment-16392014 ] Sahil Takiar commented on HIVE-16855: - +1 pending Hive QA >

[jira] [Commented] (HIVE-14792) AvroSerde reads the remote schema-file at least once per mapper, per table reference.

2018-03-08 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392015#comment-16392015 ] Aihua Xu commented on HIVE-14792: - The test is going on. BTW: I tried the test after changing the config

[jira] [Commented] (HIVE-18901) Lower ResourceDownloader Logging to Debug

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392011#comment-16392011 ] Sahil Takiar commented on HIVE-18901: - Can you give an example of when this is causing overly verbose

[jira] [Commented] (HIVE-14792) AvroSerde reads the remote schema-file at least once per mapper, per table reference.

2018-03-08 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392007#comment-16392007 ] Aihua Xu commented on HIVE-14792: - Probably you are the best person to review the change since you have

[jira] [Updated] (HIVE-18723) CompactorOutputCommitter.commitJob() - check rename() ret val

2018-03-08 Thread Kryvenko Igor (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kryvenko Igor updated HIVE-18723: - Attachment: HIVE-18723.3.patch > CompactorOutputCommitter.commitJob() - check rename() ret val >

[jira] [Updated] (HIVE-18343) Remove LinkedList from ColumnStatsSemanticAnalyzer.java

2018-03-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HIVE-18343: --- Status: Patch Available (was: Open) Added patch to address a bunch of check-style issues as well >

[jira] [Commented] (HIVE-14792) AvroSerde reads the remote schema-file at least once per mapper, per table reference.

2018-03-08 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392004#comment-16392004 ] Mithun Radhakrishnan commented on HIVE-14792: - Hey, [~aihuaxu]. Thanks for verifying that the

[jira] [Updated] (HIVE-18034) Improving logging with HoS executors spend lots of time in GC

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18034: Attachment: HIVE-18034.6.patch > Improving logging with HoS executors spend lots of time in GC >

[jira] [Updated] (HIVE-18343) Remove LinkedList from ColumnStatsSemanticAnalyzer.java

2018-03-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HIVE-18343: --- Attachment: HIVE-18343.2.patch > Remove LinkedList from ColumnStatsSemanticAnalyzer.java >

[jira] [Updated] (HIVE-18343) Remove LinkedList from ColumnStatsSemanticAnalyzer.java

2018-03-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HIVE-18343: --- Status: Open (was: Patch Available) > Remove LinkedList from ColumnStatsSemanticAnalyzer.java >

[jira] [Updated] (HIVE-18883) Add findbugs to yetus pre-commit checks

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-18883: Attachment: HIVE-18883.2.patch > Add findbugs to yetus pre-commit checks >

[jira] [Commented] (HIVE-18883) Add findbugs to yetus pre-commit checks

2018-03-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391980#comment-16391980 ] Sahil Takiar commented on HIVE-18883: - Hive QA hasn't run yet, but attaching updated patch: *

[jira] [Commented] (HIVE-18878) Lower MoveTask Lock Logging to Debug

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391971#comment-16391971 ] Hive QA commented on HIVE-18878: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HIVE-18889) update all parts of Hive to use the same Guava version

2018-03-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18889: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-18910) Migrate to Murmur hash for shuffle and bucketing

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391946#comment-16391946 ] Hive QA commented on HIVE-18910: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18831) Differentiate errors that are thrown by Spark tasks

2018-03-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391930#comment-16391930 ] Hive QA commented on HIVE-18831: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18911) LOAD.. code for MM has some suspect/dead code

2018-03-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391914#comment-16391914 ] Sergey Shelukhin commented on HIVE-18911: - cc [~ekoifman] [~steveyeom2017] > LOAD.. code for MM

[jira] [Updated] (HIVE-18912) Stats task should set accurate flag to false on failure

2018-03-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18912: Description: In my testing, I noticed that sometimes when stats task fails, the

[jira] [Commented] (HIVE-18912) Stats task should set accurate flag to false on failure

2018-03-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391912#comment-16391912 ] Sergey Shelukhin commented on HIVE-18912: - [~ashutoshc] fyi > Stats task should set accurate flag

[jira] [Commented] (HIVE-18344) Remove LinkedList from SharedWorkOptimizer.java

2018-03-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391911#comment-16391911 ] BELUGA BEHR commented on HIVE-18344: [~pvary] [~aihuaxu] Commit please :) > Remove LinkedList from

[jira] [Updated] (HIVE-18910) Migrate to Murmur hash for shuffle and bucketing

2018-03-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18910: -- Attachment: HIVE-18910.1.patch > Migrate to Murmur hash for shuffle and bucketing >

[jira] [Commented] (HIVE-16855) org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

2018-03-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391908#comment-16391908 ] BELUGA BEHR commented on HIVE-16855: [~stakiar] Posted new patch with the {Arrays#fill}} added back

[jira] [Updated] (HIVE-18912) Stats task should set accurate flag to false on failure

2018-03-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18912: Summary: Stats task should set accurate flag to false on failure (was: Stats task should

[jira] [Comment Edited] (HIVE-16855) org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

2018-03-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391908#comment-16391908 ] BELUGA BEHR edited comment on HIVE-16855 at 3/8/18 9:07 PM: [~stakiar] Posted

[jira] [Work started] (HIVE-18910) Migrate to Murmur hash for shuffle and bucketing

2018-03-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-18910 started by Deepak Jaiswal. - > Migrate to Murmur hash for shuffle and bucketing >

[jira] [Updated] (HIVE-16855) org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

2018-03-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HIVE-16855: --- Status: Patch Available (was: Open) > org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

[jira] [Updated] (HIVE-18910) Migrate to Murmur hash for shuffle and bucketing

2018-03-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18910: -- Status: Patch Available (was: In Progress) > Migrate to Murmur hash for shuffle and bucketing

[jira] [Updated] (HIVE-18875) Enable SMB Join by default in Tez

2018-03-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18875: -- Issue Type: Task (was: Bug) > Enable SMB Join by default in Tez >

[jira] [Updated] (HIVE-16855) org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

2018-03-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HIVE-16855: --- Attachment: HIVE-16855.3.patch > org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements >

[jira] [Updated] (HIVE-16855) org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

2018-03-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HIVE-16855: --- Status: Open (was: Patch Available) > org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

[jira] [Updated] (HIVE-18910) Migrate to Murmur hash for shuffle and bucketing

2018-03-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18910: -- Issue Type: Task (was: Bug) > Migrate to Murmur hash for shuffle and bucketing >

[jira] [Assigned] (HIVE-18910) Migrate to Murmur hash for shuffle and bucketing

2018-03-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18910: - > Migrate to Murmur hash for shuffle and bucketing >

[jira] [Commented] (HIVE-18878) Lower MoveTask Lock Logging to Debug

2018-03-08 Thread Kryvenko Igor (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391904#comment-16391904 ] Kryvenko Igor commented on HIVE-18878: -- [~stakiar] Please, could you review please? > Lower MoveTask

  1   2   >