[jira] [Commented] (HIVE-11969) start Tez session in background when starting CLI

2015-09-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14939055#comment-14939055 ] Siddharth Seth commented on HIVE-11969: --- With the patch - prewarm is moving into the async

[jira] [Commented] (HIVE-11923) allow qtests to run via a single client session for tez and llap

2015-09-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934445#comment-14934445 ] Siddharth Seth commented on HIVE-11923: --- Removing HIVE-11924 as a blocker. SessionState is being

[jira] [Commented] (HIVE-11923) allow qtests to run via a single client session for tez and llap

2015-09-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903790#comment-14903790 ] Siddharth Seth commented on HIVE-11923: --- [~sershe] - not much point submitting this to jenkins yet.

[jira] [Updated] (HIVE-11923) allow qtests to run via a single client session for tez and llap

2015-09-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-11923: -- Attachment: HIVE-11923.branch-1.txt HIVE-11923.1.txt Patches for branch-1 and

[jira] [Updated] (HIVE-11923) allow qtests to run via a single client session for tez and llap

2015-09-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-11923: -- Attachment: HIVE-11923.2.txt HIVE-11923.2.branchllap.txt Patches for master and

[jira] [Updated] (HIVE-11660) LLAP: TestTaskExecutorService is flaky

2015-08-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-11660: -- Attachment: HIVE-11660.1.txt Attaching patch to fix the tests. Have run 100 iterations of both

[jira] [Commented] (HIVE-11660) LLAP: TestTaskExecutorService is flaky

2015-08-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720833#comment-14720833 ] Siddharth Seth commented on HIVE-11660: --- On the TaskExecutor, this mainly moves some

[jira] [Commented] (HIVE-12422) LLAP: add security to Web UI endpoint

2015-12-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047604#comment-15047604 ] Siddharth Seth commented on HIVE-12422: --- +1. A follow up jira would be required to support ACLs, and

[jira] [Commented] (HIVE-12558) LLAP: output QueryFragmentCounters somewhere

2015-12-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047765#comment-15047765 ] Siddharth Seth commented on HIVE-12558: --- Have been using a very hacky patch for HIVE-12626 for

[jira] [Commented] (HIVE-12558) LLAP: output QueryFragmentCounters somewhere

2015-12-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047763#comment-15047763 ] Siddharth Seth commented on HIVE-12558: --- Related: https://issues.apache.org/jira/browse/HIVE-12626 ?

[jira] [Commented] (HIVE-12599) Add logging to debug rare unexpected refCount error from the LLAP IO layer

2015-12-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047741#comment-15047741 ] Siddharth Seth commented on HIVE-12599: --- Patch for logging looks good to me. +1 if you think there's

[jira] [Commented] (HIVE-12621) PTest Backup additional spark logs

2015-12-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047795#comment-15047795 ] Siddharth Seth commented on HIVE-12621: --- Ideally stdout*, stderr* as well, and dag_*. Should I file

[jira] [Updated] (HIVE-12599) Unexpected refCount error from the LLAP IO layer

2015-12-04 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12599: -- Assignee: Sergey Shelukhin > Unexpected refCount error from the LLAP IO layer >

[jira] [Updated] (HIVE-12577) NPE in LlapTaskCommunicator when unregistering containers

2015-12-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12577: -- Attachment: HIVE-12577.1.wip.txt Work in progress patch. > NPE in LlapTaskCommunicator when

[jira] [Commented] (HIVE-12659) LLAP should detect all nodes down state and stop issuing queries

2015-12-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053836#comment-15053836 ] Siddharth Seth commented on HIVE-12659: --- This is related to the jira which attempts to detect

[jira] [Updated] (HIVE-12692) Make use of the Tez HadoopShim in TaskRunner usage

2015-12-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12692: -- Attachment: HIVE-12692.1.txt > Make use of the Tez HadoopShim in TaskRunner usage >

[jira] [Commented] (HIVE-12470) Allow splits to provide custom consistent locations, instead of being tied to data locality

2015-12-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061390#comment-15061390 ] Siddharth Seth commented on HIVE-12470: --- RB already exists. On the sorting - the list can change on

[jira] [Updated] (HIVE-12470) Allow splits to provide custom consistent locations, instead of being tied to data locality

2015-12-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12470: -- Attachment: HIVE-12470.1.txt Patch for review. cc [~gopalv], [~sershe] > Allow splits to

[jira] [Updated] (HIVE-12577) NPE in LlapTaskCommunicator when unregistering containers

2015-12-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12577: -- Attachment: HIVE-12577.1.txt Patch for jenkins. > NPE in LlapTaskCommunicator when

[jira] [Updated] (HIVE-12577) NPE in LlapTaskCommunicator when unregistering containers

2015-12-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12577: -- Attachment: HIVE-12577.1.review.txt In addition to the fix, the patch renames one class.

[jira] [Updated] (HIVE-12623) Add an option to force allocation of fragments on requested nodes

2015-12-17 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12623: -- Attachment: HIVE-12623.1.txt Patch with unit tests, and some fixes identified by the tests. cc

[jira] [Commented] (HIVE-12623) Add an option to force allocation of fragments on requested nodes

2015-12-17 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062936#comment-15062936 ] Siddharth Seth commented on HIVE-12623: --- Tried creating a RB link - that isn't working. Please

[jira] [Commented] (HIVE-12172) LLAP: Cache metrics are incorrect

2015-12-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058723#comment-15058723 ] Siddharth Seth commented on HIVE-12172: --- [~prasanth_j] - is this fixed now via a different jira ?

[jira] [Updated] (HIVE-12577) NPE in LlapTaskCommunicator when unregistering containers

2015-12-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12577: -- Attachment: HIVE-12577.2.txt > NPE in LlapTaskCommunicator when unregistering containers >

[jira] [Updated] (HIVE-12577) NPE in LlapTaskCommunicator when unregistering containers

2015-12-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12577: -- Attachment: HIVE-12577.2.review.txt Patch for review. Addresses the comments, except

[jira] [Commented] (HIVE-11687) TaskExecutorService can reject work even if capacity is available

2015-12-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059274#comment-15059274 ] Siddharth Seth commented on HIVE-11687: --- [~prasanth_j] - I don't think I ever saw this. However,

[jira] [Commented] (HIVE-12445) Tracking of completed dags is a slow memory leak

2015-12-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051968#comment-15051968 ] Siddharth Seth commented on HIVE-12445: --- +1. Looks good. > Tracking of completed dags is a slow

[jira] [Updated] (HIVE-12448) Change to tracking of dag status via dagIdentifier instead of dag name

2015-12-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12448: -- Attachment: HIVE-12448.3.txt Updated patch with rb comments addressed. > Change to tracking of

[jira] [Commented] (HIVE-12528) don't start HS2 Tez sessions in a single thread

2015-12-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052192#comment-15052192 ] Siddharth Seth commented on HIVE-12528: --- {code} +if (threadCount <= 1) { + for (int i = 0;

[jira] [Commented] (HIVE-12577) NPE in LlapTaskCommunicator when unregistering containers

2015-12-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056438#comment-15056438 ] Siddharth Seth commented on HIVE-12577: --- EntityTracker tracks the relationship between containers

[jira] [Updated] (HIVE-12448) Change to tracking of dag status via dagIdentifier instead of dag name

2015-12-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12448: -- Attachment: HIVE-12448.4.txt rebased patch after some recent conflicting changes. > Change to

[jira] [Commented] (HIVE-12528) don't start HS2 Tez sessions in a single thread

2015-12-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056441#comment-15056441 ] Siddharth Seth commented on HIVE-12528: --- NPE where ? Some of the variables being setup may not be

[jira] [Commented] (HIVE-12658) Task rejection by an llap daemon spams the log with RejectedExecutionExceptions

2015-12-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056815#comment-15056815 ] Siddharth Seth commented on HIVE-12658: --- Something along those lines. I think it'll be better to

[jira] [Commented] (HIVE-12658) Task rejection by an llap daemon spams the log with RejectedExecutionExceptions

2015-12-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056810#comment-15056810 ] Siddharth Seth commented on HIVE-12658: --- Sure. > Task rejection by an llap daemon spams the log

[jira] [Updated] (HIVE-12692) Make use of the Tez HadoopShim in TaskRunner usage

2016-01-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12692: -- Attachment: HIVE-12692.2.txt Rebased patch. > Make use of the Tez HadoopShim in TaskRunner

[jira] [Commented] (HIVE-12528) don't start HS2 Tez sessions in a single thread

2015-12-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064902#comment-15064902 ] Siddharth Seth commented on HIVE-12528: --- [~sershe] - haven't looked at the new patch yet. Will try

[jira] [Updated] (HIVE-12470) Allow splits to provide custom consistent locations, instead of being tied to data locality

2015-12-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12470: -- Attachment: HIVE-12470.2.txt Updated patch with RB comments addressed. > Allow splits to

[jira] [Commented] (HIVE-12710) add better logging for Tez session creation thread failures

2015-12-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065157#comment-15065157 ] Siddharth Seth commented on HIVE-12710: --- Looks good. Why the differentiation between LOG. and

[jira] [Commented] (HIVE-12710) add better logging for Tez session creation thread failures

2015-12-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065159#comment-15065159 ] Siddharth Seth commented on HIVE-12710: --- That was +1, looks good - to be explicit. > add better

[jira] [Updated] (HIVE-12577) NPE in LlapTaskCommunicator when unregistering containers

2015-12-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12577: -- Attachment: HIVE-12577.3.txt Patch with the unit test compile failure fixed. > NPE in

[jira] [Commented] (HIVE-12510) LLAP: Append attempt id either to thread name or NDC

2015-11-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025661#comment-15025661 ] Siddharth Seth commented on HIVE-12510: --- If the NDC is taking care of this - setting it in the

[jira] [Updated] (HIVE-12513) Change LlapTokenIdentifier to use protobuf

2015-11-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12513: -- Summary: Change LlapTokenIdentifier to use protobuf (was: Change LlapTokenIdentifier to use

[jira] [Commented] (HIVE-12513) Change LlapTokenIdentifier to use protobuf

2015-11-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025736#comment-15025736 ] Siddharth Seth commented on HIVE-12513: --- Writable just required bytes to be written and read back

[jira] [Updated] (HIVE-12514) Setup renewal of LLAP tokens

2015-11-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12514: -- Assignee: (was: Thejas M Nair) > Setup renewal of LLAP tokens >

[jira] [Commented] (HIVE-12357) Allow user to set tez job name

2015-11-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027680#comment-15027680 ] Siddharth Seth commented on HIVE-12357: --- Yes. HIVE-12448 will be required to get llap tests to work

[jira] [Commented] (HIVE-12513) Change LlapTokenIdentifier to use protobuf

2015-11-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025737#comment-15025737 ] Siddharth Seth commented on HIVE-12513: --- See AMRMTokenIdentifier > Change LlapTokenIdentifier to

[jira] [Commented] (HIVE-12448) Change to tracking of dag status via dagIdentifier instead of dag name

2015-11-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032290#comment-15032290 ] Siddharth Seth commented on HIVE-12448: --- https://reviews.apache.org/r/40800/ > Change to tracking

[jira] [Updated] (HIVE-12470) Allow splits to provide custom consistent locations, instead of being tied to data locality

2015-11-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12470: -- Attachment: HIVE-12470.1.wip.txt WIP patch. > Allow splits to provide custom consistent

[jira] [Updated] (HIVE-12534) Date functions with vectorization is returning wrong results

2015-12-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12534: -- Priority: Critical (was: Major) > Date functions with vectorization is returning wrong results

[jira] [Commented] (HIVE-12430) Remove remaining reference to the hadoop-2 profile

2015-11-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011996#comment-15011996 ] Siddharth Seth commented on HIVE-12430: --- Test failures are not related to the patch. Committing. >

[jira] [Updated] (HIVE-12447) Fix LlapTaskReporter post TEZ-808 changes

2015-11-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12447: -- Attachment: HIVE-12447.1.patch > Fix LlapTaskReporter post TEZ-808 changes >

[jira] [Updated] (HIVE-12448) Change to tracking of dag status via dagIdentifier instead of dag name

2015-11-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12448: -- Attachment: HIVE-12448.1.txt > Change to tracking of dag status via dagIdentifier instead of

[jira] [Resolved] (HIVE-12494) LLAP fails to build with latest Tez

2015-11-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-12494. --- Resolution: Duplicate https://issues.apache.org/jira/browse/HIVE-12446 > LLAP fails to build

[jira] [Updated] (HIVE-12448) Change to tracking of dag status via dagIdentifier instead of dag name

2015-11-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12448: -- Attachment: HIVE-12448.2.txt Updated patch. > Change to tracking of dag status via

[jira] [Updated] (HIVE-12446) Tracking jira for changes required for move to Tez 0.8.2

2016-01-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12446: -- Attachment: HIVE-12446.combined.1.txt Combined patch (12447, 12448, 12692, 12850, 12470) for

[jira] [Commented] (HIVE-12692) Make use of the Tez HadoopShim in TaskRunner usage

2016-01-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095218#comment-15095218 ] Siddharth Seth commented on HIVE-12692: --- [~sershe] - please review. > Make use of the Tez

[jira] [Updated] (HIVE-12850) Fixes after changes made in TEZ-2669 and TEZ-3024

2016-01-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12850: -- Summary: Fixes after changes made in TEZ-2669 and TEZ-3024 (was: Fix Exceptions tez on plugins

[jira] [Updated] (HIVE-12850) Fixes after changes made in TEZ-2669 and TEZ-3024

2016-01-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-12850: -- Attachment: HIVE-12850.1.txt Turned out to be simpler than I though. Just renames. [~sershe] -

[jira] [Resolved] (HIVE-13916) Reduce the max runtime of a test further

2016-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-13916. --- Resolution: Fixed Fix Version/s: 2.2.0 > Reduce the max runtime of a test further >

[jira] [Commented] (HIVE-13916) Reduce the max runtime of a test further

2016-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312900#comment-15312900 ] Siddharth Seth commented on HIVE-13916: --- Committing. Thanks for the review. [~spena] - when you get

[jira] [Updated] (HIVE-13917) Investigate and fix tests which are timing out in the precommit build

2016-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13917: -- Assignee: Siddharth Seth Status: Patch Available (was: Open) > Investigate and fix tests

[jira] [Updated] (HIVE-13917) Investigate and fix tests which are timing out in the precommit build

2016-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13917: -- Attachment: HIVE-13917.01.patch This patch seems to fix all three failing tests, by pulling in

[jira] [Commented] (HIVE-13917) Investigate and fix tests which are timing out in the precommit build

2016-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313372#comment-15313372 ] Siddharth Seth commented on HIVE-13917: --- Looks like the MiniCluster was not starting properly, and

[jira] [Updated] (HIVE-13934) Configure Tez to make nocondiional task size memory available for the Processor

2016-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13934: -- Summary: Configure Tez to make nocondiional task size memory available for the Processor (was:

[jira] [Updated] (HIVE-13934) Configure Tez to make nocondiional task size memory available for the Processor

2016-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13934: -- Description: Currently, noconditionaltasksize is not validated against the container size, the

[jira] [Commented] (HIVE-13258) LLAP: Add hdfs bytes read and spilled bytes to tez print summary

2016-06-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317964#comment-15317964 ] Siddharth Seth commented on HIVE-13258: --- Left comments on RB - mostly minor. > LLAP: Add hdfs bytes

[jira] [Updated] (HIVE-13599) LLAP: Incorrect handling of the preemption queue on finishable state updates

2016-06-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13599: -- Resolution: Fixed Fix Version/s: 2.1.1 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-13599) LLAP: Incorrect handling of the preemption queue on finishable state updates

2016-06-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317762#comment-15317762 ] Siddharth Seth commented on HIVE-13599: --- Thanks for the review. Test failures are unrelated.

[jira] [Commented] (HIVE-13759) LlapTaskUmbilicalExternalClient should be closed by the record reader

2016-06-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321543#comment-15321543 ] Siddharth Seth commented on HIVE-13759: --- +1. Looks good. You may want to add a note somewhere in the

[jira] [Commented] (HIVE-13675) LLAP: add HMAC signatures to LLAPIF splits

2016-06-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317647#comment-15317647 ] Siddharth Seth commented on HIVE-13675: --- That would explain the failure. llap-client included, but

[jira] [Commented] (HIVE-13986) LLAP: kill Tez AM on token errors from plugin

2016-06-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323430#comment-15323430 ] Siddharth Seth commented on HIVE-13986: --- {code} if (((cause instanceof InvalidToken &&

[jira] [Commented] (HIVE-13443) LLAP: signing for the second state of submit (the event)

2016-06-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322834#comment-15322834 ] Siddharth Seth commented on HIVE-13443: --- +1 > LLAP: signing for the second state of submit (the

[jira] [Updated] (HIVE-13490) Change itests to be part of the main Hive build

2016-05-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13490: -- Assignee: Zoltan Haindrich > Change itests to be part of the main Hive build >

[jira] [Commented] (HIVE-13490) Change itests to be part of the main Hive build

2016-05-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300912#comment-15300912 ] Siddharth Seth commented on HIVE-13490: --- Changed the owner. You should be able to change it as well

[jira] [Updated] (HIVE-13538) LLAPTaskScheduler should consider local tasks before non-local tasks at the same priority level

2016-05-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13538: -- Target Version/s: 2.2.0 (was: 2.1.0) > LLAPTaskScheduler should consider local tasks before

[jira] [Updated] (HIVE-13678) Add a utility method to construct various urls related to a single llap instance

2016-05-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13678: -- Target Version/s: 2.2.0 (was: 2.1.0) > Add a utility method to construct various urls related

[jira] [Commented] (HIVE-13484) LLAPTaskScheduler should handle situations where the node may be blacklisted by Tez

2016-05-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300814#comment-15300814 ] Siddharth Seth commented on HIVE-13484: --- This is targeted at 2.1.0 > LLAPTaskScheduler should

[jira] [Updated] (HIVE-13490) Change itests to be part of the main Hive build

2016-05-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13490: -- Assignee: (was: Siddharth Seth) > Change itests to be part of the main Hive build >

[jira] [Commented] (HIVE-13800) Disable auth enabled by default on LLAP UI for secure clusters

2016-05-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300935#comment-15300935 ] Siddharth Seth commented on HIVE-13800: --- Test failures are unrelated. Committing. > Disable auth

[jira] [Updated] (HIVE-13800) Disable auth enabled by default on LLAP UI for secure clusters

2016-05-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13800: -- Resolution: Fixed Fix Version/s: 2.1.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-13720) TestLlapTaskCommunicator fails on master

2016-05-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13720: -- Resolution: Fixed Fix Version/s: 2.1.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-13490) Change itests to be part of the main Hive build

2016-05-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305073#comment-15305073 ] Siddharth Seth commented on HIVE-13490: --- This looks good to me, at least to enable better itests

[jira] [Updated] (HIVE-13490) Change itests to be part of the main Hive build

2016-05-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13490: -- Status: Patch Available (was: Open) > Change itests to be part of the main Hive build >

[jira] [Updated] (HIVE-13511) Run clidriver tests from within the qtest dir for the precommit tests

2016-05-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13511: -- Attachment: HIVE-13511.03.addendum.patch Addendum patch over the previous one whcih changes the

[jira] [Commented] (HIVE-14003) queries running against llap hang at times - likely due to preemption'

2016-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327669#comment-15327669 ] Siddharth Seth commented on HIVE-14003: --- This is a continuation of HIVE-13858. Not all problems

[jira] [Updated] (HIVE-14003) queries running against llap hang at times - preemption issues

2016-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14003: -- Status: Patch Available (was: Open) > queries running against llap hang at times - preemption

[jira] [Assigned] (HIVE-14003) queries running against llap hang at times - likely due to preemption'

2016-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-14003: - Assignee: Siddharth Seth > queries running against llap hang at times - likely due to

[jira] [Comment Edited] (HIVE-14003) queries running against llap hang at times - preemption issues

2016-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327672#comment-15327672 ] Siddharth Seth edited comment on HIVE-14003 at 6/13/16 4:21 PM: Patch to

[jira] [Commented] (HIVE-14003) queries running against llap hang at times - preemption issues

2016-06-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329052#comment-15329052 ] Siddharth Seth commented on HIVE-14003: --- [~hagleitn] - mind taking a look at the patch, and

[jira] [Commented] (HIVE-14008) Duplicate line in LLAP SecretManager

2016-06-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329016#comment-15329016 ] Siddharth Seth commented on HIVE-14008: --- +1 > Duplicate line in LLAP SecretManager >

[jira] [Commented] (HIVE-13986) LLAP: kill Tez AM on token errors from plugin

2016-06-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329021#comment-15329021 ] Siddharth Seth commented on HIVE-13986: --- +1 > LLAP: kill Tez AM on token errors from plugin >

[jira] [Updated] (HIVE-14003) queries running against llap hang at times - likely due to preemption'

2016-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14003: -- Attachment: HIVE-14003.01.patch Patch to fix the issue mentioned below. I've left some TODOs

[jira] [Updated] (HIVE-14003) queries running against llap hang at times - preemption issues

2016-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14003: -- Summary: queries running against llap hang at times - preemption issues (was: queries running

[jira] [Commented] (HIVE-13675) LLAP: add HMAC signatures to LLAPIF splits

2016-06-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317532#comment-15317532 ] Siddharth Seth commented on HIVE-13675: --- Thought llap-common was already part of the epic jar.

[jira] [Updated] (HIVE-13511) Run clidriver tests from within the qtest dir for the precommit tests

2016-05-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13511: -- Attachment: sparkTestMemAllocateErrorLogs_run432.tar.gz

[jira] [Commented] (HIVE-13511) Run clidriver tests from within the qtest dir for the precommit tests

2016-05-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1530#comment-1530 ] Siddharth Seth commented on HIVE-13511: --- Thanks [~spena]. I think the problem introduced by this

[jira] [Comment Edited] (HIVE-13511) Run clidriver tests from within the qtest dir for the precommit tests

2016-05-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1530#comment-1530 ] Siddharth Seth edited comment on HIVE-13511 at 5/28/16 7:30 PM: Thanks

[jira] [Updated] (HIVE-13599) LLAP: Race condition when task scheduler pre-emption is enabled

2016-05-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13599: -- Status: Patch Available (was: Open) > LLAP: Race condition when task scheduler pre-emption is

[jira] [Updated] (HIVE-13599) LLAP: Race condition when task scheduler pre-emption is enabled

2016-05-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13599: -- Attachment: HIVE-13599.01.patch The exception trace itself is not very damaging - this was a

[jira] [Updated] (HIVE-13599) LLAP: Incorrect handling of the preemption queue on finishable state updates

2016-05-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13599: -- Summary: LLAP: Incorrect handling of the preemption queue on finishable state updates (was:

<    1   2   3   4   5   6   7   8   9   10   >