[jira] [Commented] (HIVE-5018) Avoiding object instantiation in loops (issue 6)

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756385#comment-13756385 ] Thejas M Nair commented on HIVE-5018: - I haven't seen that checkstyle error you are

[jira] [Commented] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-09-03 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756390#comment-13756390 ] Vaibhav Gumashta commented on HIVE-4617: Just for comparison, metastore currently

[jira] [Commented] (HIVE-5163) refactor org.apache.hadoop.mapred.HCatMapRedUtil

2013-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756398#comment-13756398 ] Hudson commented on HIVE-5163: -- FAILURE: Integrated in Hive-trunk-hadoop2 #398 (See

[jira] [Commented] (HIVE-5163) refactor org.apache.hadoop.mapred.HCatMapRedUtil

2013-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756399#comment-13756399 ] Hudson commented on HIVE-5163: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #82 (See

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756400#comment-13756400 ] Hudson commented on HIVE-5137: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #82 (See

[jira] [Commented] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-09-03 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756418#comment-13756418 ] Phabricator commented on HIVE-4617: --- cwsteinbach has commented on the revision HIVE-4617

[jira] [Commented] (HIVE-5196) ThriftCLIService.java uses stderr to print the stack trace, it should use the logger instead.

2013-09-03 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756425#comment-13756425 ] Carl Steinbach commented on HIVE-5196: -- [~vgumashta] Thanks for catching this. I think

[jira] [Commented] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-09-03 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756429#comment-13756429 ] Phabricator commented on HIVE-4617: --- vaibhavgumashta has commented on the revision

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756465#comment-13756465 ] Hudson commented on HIVE-5137: -- SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #149 (See

[jira] [Commented] (HIVE-5163) refactor org.apache.hadoop.mapred.HCatMapRedUtil

2013-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756464#comment-13756464 ] Hudson commented on HIVE-5163: -- SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #149 (See

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756583#comment-13756583 ] Hudson commented on HIVE-5137: -- FAILURE: Integrated in Hive-trunk-hadoop2 #399 (See

[jira] [Updated] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5149: --- Status: Patch Available (was: Open) trigger the pre-commit build ReduceSinkDeDuplication

[jira] [Updated] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5149: --- Status: Open (was: Patch Available) ReduceSinkDeDuplication can pick the wrong partitioning columns

[jira] [Commented] (HIVE-1511) Hive plan serialization is slow

2013-09-03 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756646#comment-13756646 ] Brock Noland commented on HIVE-1511: Looks like there was a compilation issue in

Re: RFC: Major HCatalog refactoring

2013-09-03 Thread Brock Noland
OK that should be fine. Though I would echo Edwards sentiment about adding so much test time. Do these tests have to run each time? Does it make sense to have an test target such as test-all-hcatalog and then have then run them periodically manually, especially before releases? On Mon, Sep 2,

[jira] [Updated] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5149: --- Attachment: HIVE-5149.3.patch ReduceSinkDeDuplication can pick the wrong partitioning columns

[jira] [Updated] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5149: --- Attachment: (was: HIVE-5149.3.patch) ReduceSinkDeDuplication can pick the wrong partitioning columns

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-09-03 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756680#comment-13756680 ] Edward Capriolo commented on HIVE-5137: --- If you call fetchAll() does it return empty

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756671#comment-13756671 ] Hudson commented on HIVE-5137: -- FAILURE: Integrated in Hive-trunk-h0.21 #2307 (See

[jira] [Updated] (HIVE-5112) Upgrade protobuf to 2.5 from 2.4

2013-09-03 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-5112: --- Attachment: HIVE-5112.2.patch v2 of the patch uses Hadoop 2.1.0-beta. Upgrade

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756723#comment-13756723 ] Thejas M Nair commented on HIVE-5137: - [~appodictic] I didn't understand your comment.

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-09-03 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756730#comment-13756730 ] Edward Capriolo commented on HIVE-5137: --- HiveInterface.fetchAll(). I know we have

[jira] [Commented] (HIVE-5196) ThriftCLIService.java uses stderr to print the stack trace, it should use the logger instead.

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756733#comment-13756733 ] Thejas M Nair commented on HIVE-5196: - [~cwsteinbach] The jdbc driver itself does not

[jira] [Commented] (HIVE-5018) Avoiding object instantiation in loops (issue 6)

2013-09-03 Thread Benjamin Jakobus (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756731#comment-13756731 ] Benjamin Jakobus commented on HIVE-5018: Here is some sample code: {quote}

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756739#comment-13756739 ] Thejas M Nair commented on HIVE-5137: - HiveInterface is specific to hiveserver1, so

[jira] [Commented] (HIVE-5018) Avoiding object instantiation in loops (issue 6)

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756749#comment-13756749 ] Thejas M Nair commented on HIVE-5018: - What was the runtime ? To reduce the impact of

Re: RFC: Major HCatalog refactoring

2013-09-03 Thread Eugene Koifman
Current (sequential) run of all hive/hcat unit tests takes 10-15 hours. Is another 20-30 minutes that significant? I'm generally wary of unit tests that are not run continuously and automatically. It delays the detection of problems and then what was probably an obvious fix at the time the

[jira] [Commented] (HIVE-1511) Hive plan serialization is slow

2013-09-03 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756764#comment-13756764 ] Hive QA commented on HIVE-1511: --- {color:red}Overall{color}: -1 at least one tests failed

Re: Hive Metastore Server 0.9 Connection Reset and Connection Timeout errors

2013-09-03 Thread agateaaa
Uploaded a patch for HiVE-5172. Can someone please review? Do I have to be a contributor before I submit a patch? Did run about test with the patch in our test environment (Ran about 1000 pig jobs to read and insert into hive table (via hcatalog), along with equal number of alter table

Re: RFC: Major HCatalog refactoring

2013-09-03 Thread Thejas Nair
One thing to note is that the 0.11 interfaces are going to be deprecated and will be taken away in a later release. When the interface is taken away, the additional unit tests will also go away. On Tue, Sep 3, 2013 at 9:57 AM, Eugene Koifman ekoif...@hortonworks.com wrote: Current (sequential)

Re: RFC: Major HCatalog refactoring

2013-09-03 Thread Edward Capriolo
I would say a main goal of unit and integration testing is to try all code paths. If a testing framework is truly testing all code paths twice, there is not much of a win there from a unit/integration tests standpoint. If the unit tests created more coverage of the code that would be an obvious

[jira] [Commented] (HIVE-5182) log more stuff via PerfLogger

2013-09-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756813#comment-13756813 ] Sergey Shelukhin commented on HIVE-5182: This test is known flaky test, seems to be

[jira] [Updated] (HIVE-5197) TestE2EScenerios.createTaskAttempt should use MapRedUtil

2013-09-03 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-5197: --- Priority: Minor (was: Major) Issue Type: Test (was: Bug)

[jira] [Updated] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-09-03 Thread Harish Butani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Butani updated HIVE-5129: Resolution: Fixed Status: Resolved (was: Patch Available) Multiple table insert fails

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-09-03 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756845#comment-13756845 ] Edward Capriolo commented on HIVE-5137: --- Ok makes sense. A Hive

[jira] [Created] (HIVE-5197) TestE2EScenerios.createTaskAttempt should use MapRedUtil

2013-09-03 Thread Brock Noland (JIRA)
Brock Noland created HIVE-5197: -- Summary: TestE2EScenerios.createTaskAttempt should use MapRedUtil Key: HIVE-5197 URL: https://issues.apache.org/jira/browse/HIVE-5197 Project: Hive Issue Type:

[jira] [Commented] (HIVE-5060) JDBC driver assumes executeStatement is synchronous

2013-09-03 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756847#comment-13756847 ] Henry Robinson commented on HIVE-5060: -- [~vgumashta] - sorry about the delay, I've

[jira] [Updated] (HIVE-5197) TestE2EScenerios.createTaskAttempt should use MapRedUtil

2013-09-03 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-5197: --- Attachment: HIVE-5197.patch Trivial patch attached.

Review Request 13948: JDBC driver assumes executeStatement is synchronous

2013-09-03 Thread Henry Robinson
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13948/ --- Review request for hive. Bugs: HIVE-5060

[jira] [Commented] (HIVE-4914) filtering via partition name should be done inside metastore server (implementation)

2013-09-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756817#comment-13756817 ] Sergey Shelukhin commented on HIVE-4914: somehow phabricator created the new

[jira] [Updated] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5129: --- Fix Version/s: 0.12.0 Multiple table insert fails on count(distinct)

[jira] [Updated] (HIVE-5197) TestE2EScenerios.createTaskAttempt should use MapRedUtil

2013-09-03 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-5197: --- Assignee: Brock Noland Status: Patch Available (was: Open)

Re: RFC: Major HCatalog refactoring

2013-09-03 Thread Eugene Koifman
Edward, If a testing framework is truly testing all code paths twice, there is not much of a win there from a unit/integration tests standpoint. If the unit tests created more coverage of the code that would be an obvious win. I have not looked at your patch but from your description it sounds

[jira] [Updated] (HIVE-4914) filtering via partition name should be done inside metastore server (implementation)

2013-09-03 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4914: -- Attachment: HIVE-4914.D12561.2.patch sershe updated the revision HIVE-4914 [jira] filtering via

[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory

2013-09-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756866#comment-13756866 ] Daniel Dai commented on HIVE-4441: -- [~thejas] DistributedFileSystem.getHomeDirectory() has

[jira] [Commented] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-03 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756867#comment-13756867 ] Hive QA commented on HIVE-5149: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Updated] (HIVE-4959) Vectorized plan generation should be added as an optimization transform.

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4959: --- Resolution: Fixed Fix Version/s: vectorization-branch Status: Resolved

[jira] [Commented] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756916#comment-13756916 ] Hudson commented on HIVE-5129: -- FAILURE: Integrated in Hive-trunk-hadoop2 #401 (See

[jira] [Comment Edited] (HIVE-4959) Vectorized plan generation should be added as an optimization transform.

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756886#comment-13756886 ] Ashutosh Chauhan edited comment on HIVE-4959 at 9/3/13 7:05 PM:

[jira] [Updated] (HIVE-5152) Vector operators should inherit from non-vector operators for code re-use.

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5152: --- Resolution: Fixed Fix Version/s: vectorization-branch Status: Resolved

[jira] [Commented] (HIVE-5152) Vector operators should inherit from non-vector operators for code re-use.

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756920#comment-13756920 ] Ashutosh Chauhan commented on HIVE-5152: For completeness, shall we make

[jira] [Commented] (HIVE-5131) JDBC client's hive variables are not passed to HS2

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756933#comment-13756933 ] Thejas M Nair commented on HIVE-5131: - The changes look good. For the unit test,

[jira] [Updated] (HIVE-5131) JDBC client's hive variables are not passed to HS2

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-5131: Status: Open (was: Patch Available) JDBC client's hive variables are not passed to HS2

Re: RFC: Major HCatalog refactoring

2013-09-03 Thread Edward Capriolo
I understand. Can we do something like this? oldpackage.HCatologLoader extends newpackage.HCatlogloader { } If we do something like this we don't need to test both classes, it is safe to assume they both do the same thing. I understand that we do not want users to have to specify a new class

[jira] [Commented] (HIVE-5152) Vector operators should inherit from non-vector operators for code re-use.

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756921#comment-13756921 ] Ashutosh Chauhan commented on HIVE-5152: Oh sorry missed that one. VectorFS already

[jira] [Commented] (HIVE-5131) JDBC client's hive variables are not passed to HS2

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756936#comment-13756936 ] Thejas M Nair commented on HIVE-5131: - While you are at it, can you also make a minor

[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory

2013-09-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756894#comment-13756894 ] Eugene Koifman commented on HIVE-4441: -- I think this needs to be in the JavaDoc and at

[jira] [Commented] (HIVE-5113) webhcat should allow configuring memory used by templetoncontroller map job in hadoop2

2013-09-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756941#comment-13756941 ] Eugene Koifman commented on HIVE-5113: -- [~thejas] Some comments: 1. can

[jira] [Commented] (HIVE-3976) Support specifying scale and precision with Hive decimal type

2013-09-03 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756943#comment-13756943 ] Xuefu Zhang commented on HIVE-3976: --- [~jdere] Thanks for posting your code regarding

Re: RFC: Major HCatalog refactoring

2013-09-03 Thread Edward Capriolo
You may have already said this but remind me again. If we go with this approach, how long until we retired the duplicated code and insist end users use the new name? 1 release? A similar debate is likely why the hive classes are still packaged as org.apache.hadoop.hive, rather then

Re: RFC: Major HCatalog refactoring

2013-09-03 Thread Edward Capriolo
There is already a few things in hcat that I would argue are things we do not need to test. Example: testAMQListener I would say it is a bit out of scope to have a component like this. Could we mock the message queue, do we need these dependencies in project? I can not even fathom how long the

Re: RFC: Major HCatalog refactoring

2013-09-03 Thread Eugene Koifman
We explored the idea you suggest and given the number of APIs (and their transitive closure) it would would be very difficult and the result would be fragile. So unfortunately that is not possible. For example, oldpackage.A has a method foo() that returns oldpackage.B. You could create

[jira] [Commented] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-09-03 Thread Harish Butani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756812#comment-13756812 ] Harish Butani commented on HIVE-5129: - Committed to trunk. Thanks, Vikram!

[jira] [Updated] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5149: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk.

[jira] [Resolved] (HIVE-4586) [HCatalog] WebHCat should return 404 error for undefined resource

2013-09-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved HIVE-4586. -- Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. [HCatalog]

[jira] [Created] (HIVE-5198) WebHCat returns exitcode 143 (w/o an explanation)

2013-09-03 Thread Eugene Koifman (JIRA)
Eugene Koifman created HIVE-5198: Summary: WebHCat returns exitcode 143 (w/o an explanation) Key: HIVE-5198 URL: https://issues.apache.org/jira/browse/HIVE-5198 Project: Hive Issue Type: Bug

[jira] [Commented] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756969#comment-13756969 ] Yin Huai commented on HIVE-5149: groupby2.q is also used in TestMTQueries. Probably the

[jira] [Commented] (HIVE-5186) Remove JoinReducerProc from ReduceSinkDeDuplication

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756973#comment-13756973 ] Ashutosh Chauhan commented on HIVE-5186: I am not sure we want this. Wherever

[jira] [Commented] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756975#comment-13756975 ] Ashutosh Chauhan commented on HIVE-5149: Right. Yeah, likely that was the reason

[jira] [Updated] (HIVE-5186) Remove JoinReducerProc from ReduceSinkDeDuplication

2013-09-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5186: --- Status: Open (was: Patch Available) Remove JoinReducerProc from ReduceSinkDeDuplication

[jira] [Commented] (HIVE-5112) Upgrade protobuf to 2.5 from 2.4

2013-09-03 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757012#comment-13757012 ] Hive QA commented on HIVE-5112: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-5113) webhcat should allow configuring memory used by templetoncontroller map job in hadoop2

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756978#comment-13756978 ] Thejas M Nair commented on HIVE-5113: - canceling patch while comments are addressed.

[jira] [Updated] (HIVE-4442) [HCatalog] WebHCat should not override user.name parameter for Queue call

2013-09-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-4442: - Attachment: HIVE-4443-3.patch [~ekoifman] That's fine, I don't have a preference with API. I also borrow

[jira] [Updated] (HIVE-5131) JDBC client's hive variables are not passed to HS2

2013-09-03 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-5131: -- Attachment: HIVE-5131.1.patch Patch is updated based on review comments. JDBC

[jira] [Updated] (HIVE-5187) Enhance explain to indicate vectorized execution of operators.

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5187: --- Resolution: Fixed Fix Version/s: vectorization-branch Status: Resolved

[jira] [Updated] (HIVE-4442) [HCatalog] WebHCat should not override user.name parameter for Queue call

2013-09-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-4442: - Attachment: HIVE-4442-3.patch [HCatalog] WebHCat should not override user.name parameter for Queue

[jira] [Updated] (HIVE-4442) [HCatalog] WebHCat should not override user.name parameter for Queue call

2013-09-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-4442: - Attachment: (was: HIVE-4443-3.patch) [HCatalog] WebHCat should not override user.name parameter

[jira] [Commented] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-09-03 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757019#comment-13757019 ] Phabricator commented on HIVE-4617: --- thejas has commented on the revision HIVE-4617

[jira] [Commented] (HIVE-5186) Remove JoinReducerProc from ReduceSinkDeDuplication

2013-09-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757010#comment-13757010 ] Yin Huai commented on HIVE-5186: Right, I am removing cases associated with the pattern

[jira] [Commented] (HIVE-5104) HCatStorer fails to store boolean type

2013-09-03 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756979#comment-13756979 ] Sushanth Sowmyan commented on HIVE-5104: Actually, on manual application, the

[jira] [Commented] (HIVE-4442) [HCatalog] WebHCat should not override user.name parameter for Queue call

2013-09-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757061#comment-13757061 ] Eugene Koifman commented on HIVE-4442: -- The point is that UgiFactory creates a proxy

[jira] [Created] (HIVE-5199) Read Only Custom SerDe works with HDP 1.1 but not with HDP 1.3

2013-09-03 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
Hari Sankar Sivarama Subramaniyan created HIVE-5199: --- Summary: Read Only Custom SerDe works with HDP 1.1 but not with HDP 1.3 Key: HIVE-5199 URL: https://issues.apache.org/jira/browse/HIVE-5199

Re: Review Request 11334: HIVE-4568 Beeline needs to support resolving variables

2013-09-03 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11334/#review25859 --- beeline/src/java/org/apache/hive/beeline/BeeLine.java

[jira] [Commented] (HIVE-5107) Change hive's build to maven

2013-09-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757047#comment-13757047 ] Sergey Shelukhin commented on HIVE-5107: I was thinking about splitting metastore

[jira] [Updated] (HIVE-5096) Add q file tests for ORC predicate pushdown

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5096: --- Status: Open (was: Patch Available) There is already over10k file in data/files/ Can you use

[jira] [Commented] (HIVE-5107) Change hive's build to maven

2013-09-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757049#comment-13757049 ] Sergey Shelukhin commented on HIVE-5107: I figure if there will be disturbance in

[jira] [Commented] (HIVE-5049) Create an ORC test case that has a 0.11 ORC file

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757080#comment-13757080 ] Ashutosh Chauhan commented on HIVE-5049: +1 Create an ORC test

[jira] [Commented] (HIVE-5131) JDBC client's hive variables are not passed to HS2

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757043#comment-13757043 ] Thejas M Nair commented on HIVE-5131: - [~xuefuz] This was never documented in the doc

[jira] [Commented] (HIVE-5014) [HCatalog] Fix HCatalog build issue on Windows

2013-09-03 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757091#comment-13757091 ] Sushanth Sowmyan commented on HIVE-5014: Filename was not set appropriately for

[jira] [Updated] (HIVE-5157) ReduceSinkDeDuplication ignores hive.groupby.skewindata=true

2013-09-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5157: --- Description: If hive.groupby.skewindata=true, we should generate two MR jobs. But, ReduceSinkDeDuplication

[jira] [Updated] (HIVE-5014) [HCatalog] Fix HCatalog build issue on Windows

2013-09-03 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-5014: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed. Thanks, Daniel.

[jira] [Commented] (HIVE-5104) HCatStorer fails to store boolean type

2013-09-03 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756967#comment-13756967 ] Sushanth Sowmyan commented on HIVE-5104: Hi, From looking through the patch, the

[jira] [Updated] (HIVE-5131) JDBC client's hive variables are not passed to HS2

2013-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-5131: Status: Patch Available (was: Open) +1 . Making it patch available to kick off the tests.

[jira] [Updated] (HIVE-1511) Hive plan serialization is slow

2013-09-03 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-1511: --- Attachment: HIVE-1511.11.patch v11 fixes the hbase tests. Hive plan serialization

[jira] [Commented] (HIVE-5104) HCatStorer fails to store boolean type

2013-09-03 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757028#comment-13757028 ] Sushanth Sowmyan commented on HIVE-5104: One more required change was that null as

[jira] [Updated] (HIVE-5104) HCatStorer fails to store boolean type

2013-09-03 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-5104: --- Attachment: HIVE-5104.2.patch HCatStorer fails to store boolean type

[jira] [Commented] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757092#comment-13757092 ] Ashutosh Chauhan commented on HIVE-4750: +1 Fix

[jira] [Commented] (HIVE-5096) Add q file tests for ORC predicate pushdown

2013-09-03 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757094#comment-13757094 ] Prasanth J commented on HIVE-5096: -- I just manually added few empty (NULL) values to

[jira] [Updated] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4750: --- Resolution: Fixed Status: Resolved (was: Patch Available) Fix

[jira] [Commented] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23

2013-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757112#comment-13757112 ] Ashutosh Chauhan commented on HIVE-4750: Test 6,7,8 on both mac OS and ubuntu after

  1   2   3   >