[jira] [Commented] (HIVE-633) ADD FILE command does not accept quoted filenames

[ https://issues.apache.org/jira/browse/HIVE-633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566331#comment-13566331 ] kiran sreekumar commented on HIVE-633: -- is this issue still relevant, as i would like

[jira] [Created] (HIVE-3962) number of distinct values are in column statistics

Amareshwari Sriramadasu created HIVE-3962: - Summary: number of distinct values are in column statistics Key: HIVE-3962 URL: https://issues.apache.org/jira/browse/HIVE-3962 Project: Hive

[jira] [Updated] (HIVE-3962) Number of distinct values are wrong in column statistics

[ https://issues.apache.org/jira/browse/HIVE-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HIVE-3962: -- Summary: Number of distinct values are wrong in column statistics (was: number

[jira] [Commented] (HIVE-3785) Core hive changes for HiveServer2 implementation

[ https://issues.apache.org/jira/browse/HIVE-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566399#comment-13566399 ] Namit Jain commented on HIVE-3785: -- I am sorry for the delay on my part. Can you refresh ?

[jira] [Commented] (HIVE-3785) Core hive changes for HiveServer2 implementation

[ https://issues.apache.org/jira/browse/HIVE-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566400#comment-13566400 ] Namit Jain commented on HIVE-3785: -- cc [~mgrover], [~prasadm] Core hive

[jira] [Commented] (HIVE-3950) Remove code for merging files via MR job

[ https://issues.apache.org/jira/browse/HIVE-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566401#comment-13566401 ] Hudson commented on HIVE-3950: -- Integrated in Hive-trunk-hadoop2 #97 (See

[jira] [Commented] (HIVE-933) Infer bucketing/sorting properties

[ https://issues.apache.org/jira/browse/HIVE-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566402#comment-13566402 ] Hudson commented on HIVE-933: - Integrated in Hive-trunk-hadoop2 #97 (See

[jira] [Updated] (HIVE-3403) user should not specify mapjoin to perform sort-merge bucketed join

[ https://issues.apache.org/jira/browse/HIVE-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3403: - Attachment: hive.3403.19.patch user should not specify mapjoin to perform sort-merge bucketed join

[jira] [Commented] (HIVE-3950) Remove code for merging files via MR job

[ https://issues.apache.org/jira/browse/HIVE-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566422#comment-13566422 ] Hudson commented on HIVE-3950: -- Integrated in Hive-trunk-h0.21 #1946 (See

Hive-trunk-h0.21 - Build # 1946 - Failure

Changes for Build #1944 [namit] HIVE-3873 lot of tests failing for hadoop 23 (Gang Tim Liu via namit) Changes for Build #1945 [hashutosh] Missed deleting empty file GenMRRedSink4.java while commiting 3784 [hashutosh] HIVE-de-emphasize mapjoin hint (Namit Jain via Ashutosh Chauhan) Changes for

[jira] [Commented] (HIVE-933) Infer bucketing/sorting properties

[ https://issues.apache.org/jira/browse/HIVE-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566726#comment-13566726 ] Hudson commented on HIVE-933: - Integrated in Hive-trunk-h0.21 #1947 (See

Hive-trunk-h0.21 - Build # 1947 - Fixed

Changes for Build #1944 [namit] HIVE-3873 lot of tests failing for hadoop 23 (Gang Tim Liu via namit) Changes for Build #1945 [hashutosh] Missed deleting empty file GenMRRedSink4.java while commiting 3784 [hashutosh] HIVE-de-emphasize mapjoin hint (Namit Jain via Ashutosh Chauhan) Changes for

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3874: - Attachment: hive.3874.2.patch Create a new Optimized Row Columnar file format for Hive

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566727#comment-13566727 ] Namit Jain commented on HIVE-3874: -- I took a stab at it. I am attaching it just in case -

[jira] [Updated] (HIVE-3940) Track columns accessed in each table in a query

[ https://issues.apache.org/jira/browse/HIVE-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Samuel Yuan updated HIVE-3940: -- Attachment: HIVE-3940.3.patch.txt Updated. Track columns accessed in each table in a

[jira] [Commented] (HIVE-2340) optimize orderby followed by a groupby

[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566810#comment-13566810 ] Gunther Hagleitner commented on HIVE-2340: -- FYI: Ran all unit tests on patch .9.

[jira] [Updated] (HIVE-2340) optimize orderby followed by a groupby

[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-2340: - Attachment: testclidriver.txt just the diff of the latest unit test run.

[jira] [Commented] (HIVE-2340) optimize orderby followed by a groupby

[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566898#comment-13566898 ] Phabricator commented on HIVE-2340: --- hagleitn has commented on the revision HIVE-2340

[jira] [Commented] (HIVE-2340) optimize orderby followed by a groupby

[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566902#comment-13566902 ] Gunther Hagleitner commented on HIVE-2340: -- Partial review on phabricator. Biggest

[jira] [Updated] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3917: --- Attachment: HIVE-3917.patch.2 Support noscan operation for analyze command

[jira] [Work started] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-3917 started by Gang Tim Liu. Support noscan operation for analyze command Key: HIVE-3917

[jira] [Updated] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3917: --- Status: Patch Available (was: In Progress) patch is available. Support noscan

Jenkins build is back to normal : Hive-0.10.0-SNAPSHOT-h0.20.1 #50

See https://builds.apache.org/job/Hive-0.10.0-SNAPSHOT-h0.20.1/50/

[jira] [Updated] (HIVE-3940) Track columns accessed in each table in a query

[ https://issues.apache.org/jira/browse/HIVE-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-3940: Resolution: Fixed Fix Version/s: 0.11.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-896) Add LEAD/LAG/FIRST/LAST analytical windowing functions to Hive.

[ https://issues.apache.org/jira/browse/HIVE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566946#comment-13566946 ] Ashutosh Chauhan commented on HIVE-896: --- PTFDesc only contains a serialized string for

[jira] [Commented] (HIVE-896) Add LEAD/LAG/FIRST/LAST analytical windowing functions to Hive.

[ https://issues.apache.org/jira/browse/HIVE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566952#comment-13566952 ] Ashutosh Chauhan commented on HIVE-896: --- Also need to make sure that ASTNode and other

[jira] [Created] (HIVE-3963) Allow Hive to get connect to RDBMS

Maxime LANCIAUX created HIVE-3963: - Summary: Allow Hive to get connect to RDBMS Key: HIVE-3963 URL: https://issues.apache.org/jira/browse/HIVE-3963 Project: Hive Issue Type: New Feature

[jira] [Updated] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3917: --- Attachment: (was: HIVE-3917.patch.2) Support noscan operation for analyze command

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Attachment: HIVE-3778.patch.8 Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[jira] [Work started] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-3778 started by Gang Tim Liu. Add MapJoinDesc.isBucketMapJoin() as part of explain plan -

[jira] [Commented] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567023#comment-13567023 ] Gang Tim Liu commented on HIVE-3778: patch is attached to the jira also.

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Status: Patch Available (was: In Progress) patch is available https://reviews.facebook.net/D8259

[jira] [Commented] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567024#comment-13567024 ] Gang Tim Liu commented on HIVE-3917: patch is in both

Jenkins build is back to normal : Hive-0.9.1-SNAPSHOT-h0.21 #277

See https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/277/

[jira] [Commented] (HIVE-3940) Track columns accessed in each table in a query

[ https://issues.apache.org/jira/browse/HIVE-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567149#comment-13567149 ] Hudson commented on HIVE-3940: -- Integrated in hive-trunk-hadoop1 #60 (See

[jira] [Created] (HIVE-3964) Add upgrade script for Oracle backend to metastore.

Mithun Radhakrishnan created HIVE-3964: -- Summary: Add upgrade script for Oracle backend to metastore. Key: HIVE-3964 URL: https://issues.apache.org/jira/browse/HIVE-3964 Project: Hive

[jira] [Commented] (HIVE-896) Add LEAD/LAG/FIRST/LAST analytical windowing functions to Hive.

[ https://issues.apache.org/jira/browse/HIVE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567271#comment-13567271 ] Harish Butani commented on HIVE-896: Yes, exactly. Will start to introduce the new Spec

[jira] [Updated] (HIVE-3958) support partial scan for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhuoluo (Clark) Yang updated HIVE-3958: --- Description: analyze commands allows us to collect statistics on existing

[jira] [Commented] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567318#comment-13567318 ] Ashutosh Chauhan commented on HIVE-3778: Gang cool idea to address the concern. I

[jira] [Commented] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567331#comment-13567331 ] Gang Tim Liu commented on HIVE-3778: [~ashutoshc]glad you like it. yes, here is the

[jira] [Created] (HIVE-3965) Reduce output of explain plan by printing boolean value only if it is true

Gang Tim Liu created HIVE-3965: -- Summary: Reduce output of explain plan by printing boolean value only if it is true Key: HIVE-3965 URL: https://issues.apache.org/jira/browse/HIVE-3965 Project: Hive

[jira] [Commented] (HIVE-3833) object inspectors should be initialized based on partition metadata

[ https://issues.apache.org/jira/browse/HIVE-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567336#comment-13567336 ] Namit Jain commented on HIVE-3833: -- [~jakobhoman], this was definitely not intentional.

[jira] [Commented] (HIVE-3953) Reading of partitioned Avro data fails because of missing properties

[ https://issues.apache.org/jira/browse/HIVE-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567337#comment-13567337 ] Namit Jain commented on HIVE-3953: -- Copying from HIVE-3833. Can you provide me a complete

reduced unit test timings

I have noticed that the time taken to run the unit tests has reduced considerably (it has become nearly half) from the last week or so. Just wondering, if anyone else has noticed this too. If yes, does anyone know the root cause of this speedup ? Thanks, -namit

[jira] [Commented] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567345#comment-13567345 ] Namit Jain commented on HIVE-3778: -- +1 Running tests Add

Review Request: Request to review the change.

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9171/ --- Review request for hive. Description --- Patch for issue

[jira] [Commented] (HIVE-3850) hour() function returns 12 hour clock value when using timestamp datatype

[ https://issues.apache.org/jira/browse/HIVE-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567355#comment-13567355 ] Mark Grover commented on HIVE-3850: --- For completeness, review is at:

[jira] [Commented] (HIVE-3850) hour() function returns 12 hour clock value when using timestamp datatype

[ https://issues.apache.org/jira/browse/HIVE-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567356#comment-13567356 ] Mark Grover commented on HIVE-3850: --- Patch looks good to me. Usually, I would ask for

[jira] [Reopened] (HIVE-3850) hour() function returns 12 hour clock value when using timestamp datatype

[ https://issues.apache.org/jira/browse/HIVE-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover reopened HIVE-3850: --- The change wasn't committed, re-opening the JIRA. hour() function returns 12 hour clock

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Attachment: HIVE-3778.patch.9 Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3778: - Status: Open (was: Patch Available) comments Add MapJoinDesc.isBucketMapJoin() as part

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Attachment: HIVE-3778.patch.10 Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Attachment: HIVE-3778.patch.10 Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Status: Patch Available (was: Open) patch is available. Add

[jira] [Updated] (HIVE-3403) user should not specify mapjoin to perform sort-merge bucketed join

[ https://issues.apache.org/jira/browse/HIVE-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3403: - Attachment: hive.3403.21.patch user should not specify mapjoin to perform sort-merge bucketed join

Re: reduced unit test timings

I am not sure about half, but https://issues.apache.org/jira/browse/HIVE-3947 has certainly helped. Both MiniMRCliDriver and NegativeMiniMRCliDriver used to remain in hung state for ~10 minutes after all tests have run and minicluster is tearing down. That patch has saved atleast ~15 mins for test

Re: reduced unit test timings

I run tests on a parallel cluster (8 machines). For that, the test time has gone down from 2:15hours to approx. 1:15 On 1/31/13 11:55 AM, Ashutosh Chauhan hashut...@apache.org wrote: I am not sure about half, but https://issues.apache.org/jira/browse/HIVE-3947 has certainly helped. Both

[jira] [Updated] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3917: --- Attachment: HIVE-3917.patch.3 Support noscan operation for analyze command

[jira] [Updated] (HIVE-3403) user should not specify mapjoin to perform sort-merge bucketed join

[ https://issues.apache.org/jira/browse/HIVE-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3403: - Attachment: hive.3403.22.patch user should not specify mapjoin to perform sort-merge bucketed join

[jira] [Commented] (HIVE-3403) user should not specify mapjoin to perform sort-merge bucketed join

[ https://issues.apache.org/jira/browse/HIVE-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567412#comment-13567412 ] Namit Jain commented on HIVE-3403: -- To help in review, the class hierarchy is: