[jira] [Commented] (HIVE-10165) Improve hive-hcatalog-streaming extensibility and support updates and deletes.

2015-05-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559879#comment-14559879 ] Alan Gates commented on HIVE-10165: --- I'll review if someone else doesn't get to it

[jira] [Commented] (HIVE-11483) Add encoding and decoding for query string config

2015-08-12 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693611#comment-14693611 ] Alan Gates commented on HIVE-11483: --- bq. How do we distinguish between actual ^A with

[jira] [Commented] (HIVE-11540) HDP 2.3 and Flume 1.6: Hive Streaming – Too many delta files

2015-08-12 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694397#comment-14694397 ] Alan Gates commented on HIVE-11540: --- cc [~owen.omalley], [~ekoifman] HDP 2.3 and Flume

[jira] [Assigned] (HIVE-11540) HDP 2.3 and Flume 1.6: Hive Streaming – Too many delta files

2015-08-12 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates reassigned HIVE-11540: - Assignee: Alan Gates HDP 2.3 and Flume 1.6: Hive Streaming – Too many delta files

[jira] [Commented] (HIVE-11591) change thrift generation to use undated annotations

2015-08-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14701708#comment-14701708 ] Alan Gates commented on HIVE-11591: --- If 0.9.3 is not yet released I say we wait. Having

[jira] [Updated] (HIVE-11564) HBaseSchemaTool should be able to list objects

2015-08-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11564: -- Attachment: HIVE-11564.patch I ended up completely rewriting HBaseSchemaTool. It now operates on all

[jira] [Commented] (HIVE-8007) Clean up Thrift definitions

2015-08-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707095#comment-14707095 ] Alan Gates commented on HIVE-8007: -- bq. I can't get Thrift 0.9 to build on my Mac so I'm

[jira] [Commented] (HIVE-11552) implement basic methods for getting/putting file metadata

2015-08-20 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14705440#comment-14705440 ] Alan Gates commented on HIVE-11552: --- +1 One small comment, given that you don't expect

[jira] [Commented] (HIVE-10289) Support filter on non-first partition key and non-string partition key

2015-08-20 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14705545#comment-14705545 ] Alan Gates commented on HIVE-10289: --- It looks to me like you are using

[jira] [Commented] (HIVE-10289) Support filter on non-first partition key and non-string partition key

2015-08-20 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14705713#comment-14705713 ] Alan Gates commented on HIVE-10289: --- Ok, thanks. That makes sense. Then my only other

[jira] [Commented] (HIVE-11030) Enhance storage layer to create one delta file per write

2015-06-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606294#comment-14606294 ] Alan Gates commented on HIVE-11030: --- AcidUtils.serializeDeltas and

[jira] [Updated] (HIVE-11061) Table renames not propagated to partition table in HBase metastore

2015-06-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11061: -- Attachment: HIVE-11061.patch This patch does the work in both the tbls and partitions tables to figure

[jira] [Commented] (HIVE-11055) HPL/SQL - Implementing Procedural SQL in Hive (PL/HQL Contribution)

2015-06-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606523#comment-14606523 ] Alan Gates commented on HIVE-11055: --- I ran rat on this and all looks good except for a

[jira] [Commented] (HIVE-11145) Remove OFFLINE and NO_DROP from tables and partitions

2015-06-30 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608667#comment-14608667 ] Alan Gates commented on HIVE-11145: --- Thanks [~damien.carol], I'll fix that. Remove

[jira] [Commented] (HIVE-11145) Remove OFFLINE and NO_DROP from tables and partitions

2015-06-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607500#comment-14607500 ] Alan Gates commented on HIVE-11145: --- Yes, I rebased it to master. Putting it on

[jira] [Updated] (HIVE-11145) Remove OFFLINE and NO_DROP from tables and partitions

2015-06-30 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11145: -- Attachment: HIVE-11145.2.patch New version of the patch with expected output changes for tests. If

[jira] [Updated] (HIVE-11389) hbase import should allow partial imports and should work in parallel

2015-07-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11389: -- Attachment: HIVE-11389.patch I basically rewrote HBaseImport. The user can now pick selected objects

[jira] [Commented] (HIVE-10166) Merge Spark branch to master 7/30/2015

2015-07-31 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649302#comment-14649302 ] Alan Gates commented on HIVE-10166: --- All of the metastore generated files have been

[jira] [Updated] (HIVE-11378) Remove hadoop-1 support from master branch

2015-07-28 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11378: -- Attachment: HIVE-11378.2.patch Fixed the two pom files I missed. Remove hadoop-1 support from master

[jira] [Updated] (HIVE-11378) Remove hadoop-1 support from master branch

2015-07-28 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11378: -- Attachment: HIVE-11378.3.patch Fixed a few empty hadoop-2 profiles I left around and fixed a spot where

[jira] [Commented] (HIVE-11317) ACID: Improve transaction Abort logic due to timeout

2015-08-05 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658546#comment-14658546 ] Alan Gates commented on HIVE-11317: --- Why did you decide to go with a separate thread

[jira] [Commented] (HIVE-11389) hbase import should allow partial imports and should work in parallel

2015-07-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646956#comment-14646956 ] Alan Gates commented on HIVE-11389: --- Linking to HIVE-9752 since the tool has many user

[jira] [Commented] (HIVE-11511) Output the message of orcfiledump when ORC files are not specified

2015-08-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682028#comment-14682028 ] Alan Gates commented on HIVE-11511: --- +1 Output the message of orcfiledump when ORC

[jira] [Commented] (HIVE-11483) Add encoding and decoding for query string config

2015-08-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682088#comment-14682088 ] Alan Gates commented on HIVE-11483: --- Several comments: # You should attach a patch so

[jira] [Commented] (HIVE-10289) Support filter on non-first partition key and non-string partition key

2015-08-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682130#comment-14682130 ] Alan Gates commented on HIVE-10289: --- This patch no longer applies. Can you update it

[jira] [Commented] (HIVE-11500) implement file footer / splits cache in HBase metastore

2015-08-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682158#comment-14682158 ] Alan Gates commented on HIVE-11500: --- I am guessing that this will be the first of

[jira] [Commented] (HIVE-11354) HPL/SQL extending compatibility with Transact-SQL

2015-08-04 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654517#comment-14654517 ] Alan Gates commented on HIVE-11354: --- +1 HPL/SQL extending compatibility with

[jira] [Commented] (HIVE-11087) DbTxnManager exceptions should include txnid

2015-08-06 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660474#comment-14660474 ] Alan Gates commented on HIVE-11087: --- +1 DbTxnManager exceptions should include txnid

[jira] [Commented] (HIVE-11511) Output the message of orcfiledump when ORC files are not specified

2015-08-10 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680840#comment-14680840 ] Alan Gates commented on HIVE-11511: --- In general looks good. We should avoid the

[jira] [Commented] (HIVE-11500) implement file footer / splits cache in HBase metastore

2015-08-14 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697368#comment-14697368 ] Alan Gates commented on HIVE-11500: --- bq. I think we should use YAGNI principle... That's

[jira] [Commented] (HIVE-11317) ACID: Improve transaction Abort logic due to timeout

2015-08-14 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697453#comment-14697453 ] Alan Gates commented on HIVE-11317: --- +1 ACID: Improve transaction Abort logic due to

[jira] [Commented] (HIVE-10289) Support filter on non-first partition key and non-string partition key

2015-08-14 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697356#comment-14697356 ] Alan Gates commented on HIVE-10289: --- I'm not done reviewing the patch yet, but I have

[jira] [Commented] (HIVE-11552) implement basic methods for getting/putting file metadata

2015-08-14 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697934#comment-14697934 ] Alan Gates commented on HIVE-11552: --- I can review it. implement basic methods for

[jira] [Commented] (HIVE-11568) merge master into branch

2015-08-14 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697911#comment-14697911 ] Alan Gates commented on HIVE-11568: --- +1, looks like all the relevant changes are outside

[jira] [Updated] (HIVE-11379) Bump Tephra version to 0.6.0

2015-07-27 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11379: -- Attachment: HIVE-11379.patch Updated the Tephra version to 0.6.0. Note that this still doesn't pass

[jira] [Updated] (HIVE-11378) Remove hadoop-1 support from master branch

2015-07-27 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11378: -- Attachment: HIVE-11378.patch This patch is mostly changes to the pom files. I have removed dead code

[jira] [Updated] (HIVE-11382) Invalidate aggregate column stats on alter partition

2015-07-27 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11382: -- Fix Version/s: (was: hbase-metastore-branch) Invalidate aggregate column stats on alter partition

[jira] [Updated] (HIVE-11382) Invalidate aggregate column stats on alter partition

2015-07-27 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11382: -- Affects Version/s: hbase-metastore-branch Invalidate aggregate column stats on alter partition

[jira] [Updated] (HIVE-11382) Invalidate aggregate column stats on alter partition

2015-07-27 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11382: -- Fix Version/s: hbase-metastore-branch Invalidate aggregate column stats on alter partition

[jira] [Updated] (HIVE-11382) Invalidate aggregate column stats on alter partition

2015-07-27 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11382: -- Attachment: HIVE-11382.patch Added invalidation calls to alterPartition and alterPartitions.

[jira] [Commented] (HIVE-11077) Add support in parser and wire up to txn manager

2015-07-22 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637257#comment-14637257 ] Alan Gates commented on HIVE-11077: --- +1 Add support in parser and wire up to txn

[jira] [Updated] (HIVE-11300) HBase metastore: Support token and master key methods

2015-07-22 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11300: -- Attachment: HIVE-11300.2.patch A new version of the patch rebased after HIVE-11294 was checked in.

[jira] [Commented] (HIVE-11320) ACID enable predicate pushdown for insert-only delta file

2015-07-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635403#comment-14635403 ] Alan Gates commented on HIVE-11320: --- +1 ACID enable predicate pushdown for insert-only

[jira] [Commented] (HIVE-11254) Process result sets returned by a stored procedure

2015-07-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635397#comment-14635397 ] Alan Gates commented on HIVE-11254: --- Why are you including hive-jdbc version 1.2.1? It

[jira] [Commented] (HIVE-11229) Mutation API: Coordinator communication with meta store should be optional

2015-07-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635470#comment-14635470 ] Alan Gates commented on HIVE-11229: --- +1 Mutation API: Coordinator communication with

[jira] [Commented] (HIVE-11077) Add support in parser and wire up to txn manager

2015-07-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635611#comment-14635611 ] Alan Gates commented on HIVE-11077: --- Comments posted to review board. Add support in

[jira] [Commented] (HIVE-11294) Use HBase to cache aggregated stats

2015-07-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635866#comment-14635866 ] Alan Gates commented on HIVE-11294: --- Incorporated most of the feedback. Responses a

[jira] [Commented] (HIVE-11294) Use HBase to cache aggregated stats

2015-07-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640711#comment-14640711 ] Alan Gates commented on HIVE-11294: --- Good question, I don't know. I'll ask the HBase

[jira] [Commented] (HIVE-11290) Cursor attributes %ISOPEN, %FOUND, %NOTFOUND and SYS_REFCURSOR variable

2015-07-23 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639115#comment-14639115 ] Alan Gates commented on HIVE-11290: --- +1, pending tests Cursor attributes %ISOPEN,

[jira] [Updated] (HIVE-11349) Update HBase metastore hbase version to 1.1.1

2015-07-22 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11349: -- Attachment: HIVE-11349.patch Updated version of HBase to 1.1.1. This breaks Tephra, but we aren't

[jira] [Commented] (HIVE-11254) Process result sets returned by a stored procedure

2015-07-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635932#comment-14635932 ] Alan Gates commented on HIVE-11254: --- I think changing the pom entry to: {code}

[jira] [Updated] (HIVE-11294) Use HBase to cache aggregated stats

2015-07-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11294: -- Attachment: HIVE-11294.2.patch New patch that incorporates changes based on Thejas' feedback. Use

[jira] [Commented] (HIVE-11145) Remove OFFLINE and NO_DROP from tables and partitions

2015-07-15 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629005#comment-14629005 ] Alan Gates commented on HIVE-11145: --- [~leftylev] I made changes in the indicated

[jira] [Updated] (HIVE-11294) Use HBase to cache aggregated stats

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11294: -- Attachment: HIVE-11294.patch This patch adds caching of the aggregates stats to HBase. It also

[jira] [Commented] (HIVE-11077) Add support in parser and wire up to txn manager

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631809#comment-14631809 ] Alan Gates commented on HIVE-11077: --- This is a big patch. Could you create a review

[jira] [Updated] (HIVE-9904) Perform stats aggregation in HBase co-processor [hbase-metastore branch]

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-9904: - Affects Version/s: hbase-metastore-branch Perform stats aggregation in HBase co-processor

[jira] [Updated] (HIVE-11300) HBase metastore: Support token and master key methods

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11300: -- Attachment: HIVE-11300.patch HBase metastore: Support token and master key methods

[jira] [Updated] (HIVE-9452) Use HBase to store Hive metadata

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-9452: - Affects Version/s: hbase-metastore-branch Use HBase to store Hive metadata

[jira] [Updated] (HIVE-10950) Unit test against HBase Metastore

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-10950: -- Affects Version/s: hbase-metastore-branch Unit test against HBase Metastore

[jira] [Updated] (HIVE-10289) Support filter on non-first partition key and non-string partition key

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-10289: -- Affects Version/s: hbase-metastore-branch Support filter on non-first partition key and non-string

[jira] [Updated] (HIVE-9453) Initial patch [hbase-metastore branch]

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-9453: - Affects Version/s: hbase-metastore-branch Initial patch [hbase-metastore branch]

[jira] [Updated] (HIVE-9578) Add support for getDatabases and alterDatabase calls [hbase-metastore branch]

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-9578: - Affects Version/s: hbase-metastore-branch Add support for getDatabases and alterDatabase calls

[jira] [Updated] (HIVE-10953) Get partial stats instead of complete stats in some queries

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-10953: -- Affects Version/s: hbase-metastore-branch Get partial stats instead of complete stats in some queries

[jira] [Updated] (HIVE-10169) get metatool to work with hbase metastore

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-10169: -- Affects Version/s: hbase-metastore-branch get metatool to work with hbase metastore

[jira] [Resolved] (HIVE-9905) Investigate ways to improve NDV calculations during stats aggregation [hbase-metastore branch]

2015-07-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates resolved HIVE-9905. -- Resolution: Duplicate This isn't HBase metastore specific. Besides it looks like HIVE-9689 will do

[jira] [Commented] (HIVE-11635) import tool fails on non-secure cluster

2015-08-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14710363#comment-14710363 ] Alan Gates commented on HIVE-11635: --- Do you want to fix this or want me to? I can, but

[jira] [Commented] (HIVE-11633) import tool should print help by default

2015-08-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14710360#comment-14710360 ] Alan Gates commented on HIVE-11633: --- +1 import tool should print help by default

[jira] [Updated] (HIVE-11378) Remove hadoop-1 support from master branch

2015-10-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11378: -- Attachment: HIVE-11378.4.patch Rebased patch. Also I think I found the issue that was keeping it from

[jira] [Updated] (HIVE-11564) HBaseSchemaTool should be able to list objects

2015-10-22 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11564: -- Attachment: HIVE-11564.3.patch Rebased the patch since it had gone stale. [~thejas], [~daijy], could I

[jira] [Updated] (HIVE-12170) normalize HBase metastore connection configuration

2015-10-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-12170: -- Attachment: HIVE-12170.2.patch Second version of the patch, it adds an info message if the config has

[jira] [Commented] (HIVE-11591) upgrade thrift to 0.9.3 and change generation to use undated annotations

2015-10-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967604#comment-14967604 ] Alan Gates commented on HIVE-11591: --- +1 > upgrade thrift to 0.9.3 and change generation to use undated

[jira] [Commented] (HIVE-11378) Remove hadoop-1 support from master branch

2015-10-22 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970139#comment-14970139 ] Alan Gates commented on HIVE-11378: --- [~ashutoshc], [~sershe] could one of you guys review? > Remove

[jira] [Commented] (HIVE-12187) Release plan once a query is executed

2015-10-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967791#comment-14967791 ] Alan Gates commented on HIVE-12187: --- The change looks good to me from a locks perspective. [~ekoifman]

[jira] [Commented] (HIVE-11378) Remove hadoop-1 support from master branch

2015-10-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975149#comment-14975149 ] Alan Gates commented on HIVE-11378: --- After rebasing from master only TestJsonFileDump and TestHCatClient

[jira] [Updated] (HIVE-11564) HBaseSchemaTool should be able to list objects

2015-10-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11564: -- Attachment: HIVE-11564.4.patch Fixed issues brought up by Daniel's review. Added a test for

[jira] [Commented] (HIVE-11564) HBaseSchemaTool should be able to list objects

2015-10-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975230#comment-14975230 ] Alan Gates commented on HIVE-11564: --- bq. Where is the "install" cmd after the patch? oops. Good catch.

[jira] [Commented] (HIVE-11564) HBaseSchemaTool should be able to list objects

2015-10-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980596#comment-14980596 ] Alan Gates commented on HIVE-11564: --- I linked it to HIVE-9752, which is already labeled TODO2.0 so that

[jira] [Commented] (HIVE-9752) Documentation for HBase metastore

2015-10-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980594#comment-14980594 ] Alan Gates commented on HIVE-9752: -- Need to document HBaseSchemaTool > Documentation for HBase metastore

[jira] [Commented] (HIVE-11881) Supporting HPL/SQL Packages

2015-10-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981226#comment-14981226 ] Alan Gates commented on HIVE-11881: --- +1 > Supporting HPL/SQL Packages > --- > >

[jira] [Commented] (HIVE-11293) HiveConnection.setAutoCommit(true) throws exception

2015-10-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981485#comment-14981485 ] Alan Gates commented on HIVE-11293: --- The spec doesn't seem to specify what to do if someone calls

[jira] [Updated] (HIVE-11293) HiveConnection.setAutoCommit(true) throws exception

2015-10-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11293: -- Attachment: HIVE-11293.2.patch > HiveConnection.setAutoCommit(true) throws exception >

[jira] [Updated] (HIVE-11378) Remove hadoop-1 support from master branch

2015-10-23 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11378: -- Attachment: HIVE-11378.5.patch The TestHCatClient failures were not related, but the others were.

[jira] [Updated] (HIVE-11564) HBaseSchemaTool should be able to list objects

2015-10-27 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-11564: -- Attachment: HIVE-11564.5.patch Added a return after insert, so it doesn't do anything else; removed the

[jira] [Commented] (HIVE-11378) Remove hadoop-1 support from master branch

2015-10-27 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977291#comment-14977291 ] Alan Gates commented on HIVE-11378: --- [~leftylev] thanks for digging up all the places this needs

[jira] [Commented] (HIVE-11378) Remove hadoop-1 support from master branch

2015-10-28 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979193#comment-14979193 ] Alan Gates commented on HIVE-11378: --- [~leftylev] I've gone over the above docs and edited them. Reviews

[jira] [Commented] (HIVE-11378) Remove hadoop-1 support from master branch

2015-10-22 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970363#comment-14970363 ] Alan Gates commented on HIVE-11378: --- Done: https://reviews.apache.org/r/39578/ > Remove hadoop-1

[jira] [Commented] (HIVE-11540) HDP 2.3 and Flume 1.6: Hive Streaming – Too many delta files during Compaction

2015-10-22 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970389#comment-14970389 ] Alan Gates commented on HIVE-11540: --- Changes look good to me, +1 assuming you can get the patch to run

[jira] [Commented] (HIVE-12061) add file type support to file metadata by expr call

2015-10-21 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967862#comment-14967862 ] Alan Gates commented on HIVE-12061: --- I definitely like decoupling this from ORC. The only concern I

[jira] [Commented] (HIVE-12376) make hive.compactor.worker.threads use a thread pool, etc

2015-11-10 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999120#comment-14999120 ] Alan Gates commented on HIVE-12376: --- The default min/max for server threads in the metastore is

[jira] [Commented] (HIVE-11948) Investigate TxnHandler and CompactionTxnHandler to see where we improve concurrency

2015-11-16 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007498#comment-15007498 ] Alan Gates commented on HIVE-11948: --- In TxnHandler, around line 495: bq. Why doesn't this get a txnid as

[jira] [Commented] (HIVE-11388) there should only be 1 Initiator for compactions per Hive installation

2015-11-11 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001077#comment-15001077 ] Alan Gates commented on HIVE-11388: --- Avoiding ZK is a major bonus. I'm wondering if your first proposal

[jira] [Commented] (HIVE-12421) Streaming API TransactionBatch.beginNextTransaction() does not wait for locks

2015-11-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009159#comment-15009159 ] Alan Gates commented on HIVE-12421: --- [~roshan_naik] can comment further, but I think the thinking was

[jira] [Commented] (HIVE-11948) Investigate TxnHandler and CompactionTxnHandler to see where we improve concurrency

2015-11-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009126#comment-15009126 ] Alan Gates commented on HIVE-11948: --- bq. There is a RB link for this patch, it may be easier to add

[jira] [Commented] (HIVE-11293) HiveConnection.setAutoCommit(true) throws exception

2015-10-30 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983709#comment-14983709 ] Alan Gates commented on HIVE-11293: --- TestHBaseCliDriver fails for me on master also. All of the others

[jira] [Commented] (HIVE-12316) Improved integration test for Hive

2015-11-04 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990403#comment-14990403 ] Alan Gates commented on HIVE-12316: --- Sure. For an idea of what tests look like take a look in the

[jira] [Commented] (HIVE-10982) Customizable the value of java.sql.statement.setFetchSize in Hive JDBC Driver

2015-11-03 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988190#comment-14988190 ] Alan Gates commented on HIVE-10982: --- This patch doesn't apply anymore because of HIVE-11718, which makes

[jira] [Updated] (HIVE-10804) CBO: Calcite Operator To Hive Operator (Calcite Return Path): optimizer for limit 0 does not work

2015-11-05 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-10804: -- Assignee: Pengcheng Xiong (was: Alan Gates) > CBO: Calcite Operator To Hive Operator (Calcite Return

[jira] [Assigned] (HIVE-10804) CBO: Calcite Operator To Hive Operator (Calcite Return Path): optimizer for limit 0 does not work

2015-11-05 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates reassigned HIVE-10804: - Assignee: Alan Gates (was: Pengcheng Xiong) > CBO: Calcite Operator To Hive Operator (Calcite

[jira] [Updated] (HIVE-12316) Improved integration test for Hive

2015-11-03 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-12316: -- Attachment: HIVE-12316.patch An initial patch. Apologies as I know this is large and a lot to absorb.

[jira] [Commented] (HIVE-12318) qtest failing due to NPE in logStats

2015-11-02 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986272#comment-14986272 ] Alan Gates commented on HIVE-12318: --- +1 to getting this in ASAP. I'm seeing this affecting

<    1   2   3   4   5   6   7   8   9   10   >