[jira] [Updated] (HIVE-13511) Run clidriver tests from within the qtest dir for the precommit tests

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13511: -- Description: The tests are currently run from the itests directory - which means there's

[jira] [Updated] (HIVE-13511) Run clidriver tests from within the qtest dir for the precommit tests

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13511: -- Attachment: example_testExecution.txt example_maven-test.txt > Run clidriver

[jira] [Updated] (HIVE-13496) Create initial test data once across multiple test runs

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13496: -- Status: Patch Available (was: Open) > Create initial test data once across multiple test runs

[jira] [Updated] (HIVE-13511) Run clidriver tests from within the qtest dir for the precommit tests

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13511: -- Status: Patch Available (was: Open) > Run clidriver tests from within the qtest dir for the

[jira] [Updated] (HIVE-13504) Add a timeout for static initialization blocks

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13504: -- Target Version/s: 2.1.0 > Add a timeout for static initialization blocks >

[jira] [Updated] (HIVE-13496) Create initial test data once across multiple test runs

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13496: -- Attachment: HIVE-13496.01.patch Patch to make this change. This does the third point mentioned

[jira] [Updated] (HIVE-13507) Improved logging for ptest

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13507: -- Description: Include information about batch runtimes, outlier lists, host completion times,

[jira] [Updated] (HIVE-13495) Add timeout for individual tests

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13495: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-13503 > Add timeout for

[jira] [Updated] (HIVE-13496) Create initial test data once across multiple test runs

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13496: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-13503 > Create initial test data

[jira] [Commented] (HIVE-13503) [Umbrella] Test sub-system improvements

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240003#comment-15240003 ] Siddharth Seth commented on HIVE-13503: --- The initial build, deploy phase takes close to 30 minutes,

[jira] [Updated] (HIVE-13505) Skip running TestDummy where possibe during precommit builds

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13505: -- Summary: Skip running TestDummy where possibe during precommit builds (was: Skip running

[jira] [Assigned] (HIVE-13505) Skip running TestDummy where possibe during precommit builds

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-13505: - Assignee: Siddharth Seth > Skip running TestDummy where possibe during precommit builds

[jira] [Updated] (HIVE-13505) Skip running TestDummy where possibe during precommit builds

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13505: -- Attachment: HIVE-13505.01.patch Simple patch to avoid running TestDummy. These tests don't

[jira] [Updated] (HIVE-13505) Skip running TestDummy where possibe during precommit builds

2016-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13505: -- Status: Patch Available (was: Open) > Skip running TestDummy where possibe during precommit

[jira] [Commented] (HIVE-13496) Create initial test data once across multiple test runs

2016-04-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241538#comment-15241538 ] Siddharth Seth commented on HIVE-13496: --- Thanks Ashutosh. I'm going to commit this and monitor the

[jira] [Updated] (HIVE-13496) Create initial test data once across multiple test runs - TestCliDriver

2016-04-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13496: -- Resolution: Fixed Fix Version/s: 2.1.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-13490) Change itests to be part of the main Hive build

2016-04-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13490: -- Status: Patch Available (was: Open) Will update another patch shortly to change the build

[jira] [Commented] (HIVE-13507) Improved logging for ptest

2016-04-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251498#comment-15251498 ] Siddharth Seth commented on HIVE-13507: --- Oops. Sorry about that. I'll go back and see what caused

[jira] [Commented] (HIVE-13490) Change itests to be part of the main Hive build

2016-04-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251435#comment-15251435 ] Siddharth Seth commented on HIVE-13490: --- OK. That helps me understand why these have been kept

[jira] [Updated] (HIVE-13511) Run clidriver tests from within the qtest dir for the precommit tests

2016-04-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-13511: -- Attachment: HIVE-13511.03.patch Thanks for pointing that out [~ashutoshc]. Uploaded a new patch

[jira] [Commented] (HIVE-13467) Show llap info on hs2 ui when available

2016-04-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251576#comment-15251576 ] Siddharth Seth commented on HIVE-13467: --- Is this hardcoded to use the name "llap0" ? That should

[jira] [Commented] (HIVE-13444) LLAP: add HMAC signatures to LLAP; verify them on LLAP side

2016-05-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298741#comment-15298741 ] Siddharth Seth commented on HIVE-13444: --- +1, after addressing two minor comments. > LLAP: add HMAC

[jira] [Commented] (HIVE-13444) LLAP: add HMAC signatures to LLAP; verify them on LLAP side

2016-05-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298740#comment-15298740 ] Siddharth Seth commented on HIVE-13444: --- +1, after addressing two minor comments. > LLAP: add HMAC

[jira] [Commented] (HIVE-14316) TestLlapTokenChecker.testCheckPermissions, testGetToken fail

2016-07-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392881#comment-15392881 ] Siddharth Seth commented on HIVE-14316: --- +1 pending precommit. >

[jira] [Commented] (HIVE-14225) Llap slider package should support configuring YARN rolling log aggregation

2016-07-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392806#comment-15392806 ] Siddharth Seth commented on HIVE-14225: --- Think we need a full writup on llap logging at some point;

[jira] [Commented] (HIVE-14213) Add timeouts for various components in llap status check

2016-07-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375348#comment-15375348 ] Siddharth Seth commented on HIVE-14213: --- Setting component configs in the main site files -

[jira] [Commented] (HIVE-14213) Add timeouts for various components in llap status check

2016-07-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373913#comment-15373913 ] Siddharth Seth commented on HIVE-14213: --- bq. Why do we need a separate set of config settings?

[jira] [Updated] (HIVE-14213) Add timeouts for various components in llap status check

2016-07-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14213: -- Attachment: HIVE-14213.01.patch The patch adds various timeouts. Hadoop and timeouts seems to

[jira] [Comment Edited] (HIVE-14213) Add timeouts for various components in llap status check

2016-07-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372231#comment-15372231 ] Siddharth Seth edited comment on HIVE-14213 at 7/12/16 6:16 AM: The patch

[jira] [Comment Edited] (HIVE-14213) Add timeouts for various components in llap status check

2016-07-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372231#comment-15372231 ] Siddharth Seth edited comment on HIVE-14213 at 7/12/16 6:17 AM: The patch

[jira] [Updated] (HIVE-14213) Add timeouts for various components in llap status check

2016-07-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14213: -- Status: Patch Available (was: Open) > Add timeouts for various components in llap status check

[jira] [Commented] (HIVE-9756) LLAP: use log4j 2 for llap (log to separate files, etc.)

2016-07-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378441#comment-15378441 ] Siddharth Seth commented on HIVE-9756: -- {code} + Field field =

[jira] [Commented] (HIVE-9756) LLAP: use log4j 2 for llap (log to separate files, etc.)

2016-07-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378469#comment-15378469 ] Siddharth Seth commented on HIVE-9756: -- Also the pop followed by push in TaskRunnerCallable could be

[jira] [Comment Edited] (HIVE-9756) LLAP: use log4j 2 for llap (log to separate files, etc.)

2016-07-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378469#comment-15378469 ] Siddharth Seth edited comment on HIVE-9756 at 7/14/16 9:58 PM: --- Also the pop

[jira] [Commented] (HIVE-14167) Use work directories provided by Tez instead of directly using YARN local dirs

2016-07-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389926#comment-15389926 ] Siddharth Seth commented on HIVE-14167: --- This completely broke LLAP. LlapProxy.setDaemon happens in

[jira] [Updated] (HIVE-14167) Use work directories provided by Tez instead of directly using YARN local dirs

2016-07-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14167: -- Fix Version/s: (was: 2.1.1) (was: 2.2.0) > Use work directories

[jira] [Reopened] (HIVE-14167) Use work directories provided by Tez instead of directly using YARN local dirs

2016-07-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reopened HIVE-14167: --- > Use work directories provided by Tez instead of directly using YARN local dirs >

[jira] [Updated] (HIVE-14167) Use work directories provided by Tez instead of directly using YARN local dirs

2016-07-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14167: -- Status: Patch Available (was: Reopened) > Use work directories provided by Tez instead of

[jira] [Commented] (HIVE-14167) Use work directories provided by Tez instead of directly using YARN local dirs

2016-07-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390140#comment-15390140 ] Siddharth Seth commented on HIVE-14167: --- +1. Tried it out. Lets wait for jenkins, or run tests

[jira] [Updated] (HIVE-14364) Update timeouts for llap comparator tests

2016-07-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14364: -- Attachment: HIVE-14364.01.patch Trivial patch. [~sershe] - could you please take a look. >

[jira] [Updated] (HIVE-14321) Improvements to the log uri provided by llap to tez

2016-07-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14321: -- Description: Currently none provided - since yarn does not have a listing page to display

[jira] [Updated] (HIVE-14225) Llap slider package should support configuring YARN rolling log aggregation

2016-07-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14225: -- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-14225) Llap slider package should support configuring YARN rolling log aggregation

2016-07-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390872#comment-15390872 ] Siddharth Seth commented on HIVE-14225: --- Test failures are not related. Verified

[jira] [Updated] (HIVE-14316) TestLlapTokenChecker.testCheckPermissions, testGetToken fail

2016-07-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14316: -- Summary: TestLlapTokenChecker.testCheckPermissions, testGetToken fail (was:

[jira] [Commented] (HIVE-14386) UGI clone shim also needs to clone credentials

2016-07-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400914#comment-15400914 ] Siddharth Seth commented on HIVE-14386: --- +1. > UGI clone shim also needs to clone credentials >

[jira] [Updated] (HIVE-14392) llap daemons should try using YARN local dirs, if available

2016-07-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14392: -- Status: Patch Available (was: Open) > llap daemons should try using YARN local dirs, if

[jira] [Updated] (HIVE-14392) llap daemons should try using YARN local dirs, if available

2016-07-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14392: -- Attachment: HIVE-14392.01.patch The ordering is as follows. 1. work.dirs specified - they will

[jira] [Comment Edited] (HIVE-14364) Update timeouts for llap comparator tests

2016-07-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396663#comment-15396663 ] Siddharth Seth edited comment on HIVE-14364 at 7/27/16 11:39 PM: - bq. Why

[jira] [Commented] (HIVE-14364) Update timeouts for llap comparator tests

2016-07-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396663#comment-15396663 ] Siddharth Seth commented on HIVE-14364: --- bq. Why cannot classloader stuff be moved into pre-test by

[jira] [Resolved] (HIVE-14364) Update timeouts for llap comparator tests

2016-07-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-14364. --- Resolution: Fixed Fix Version/s: 2.2.0 Committed to master. > Update timeouts for

[jira] [Commented] (HIVE-14332) Reduce logging from VectorMapOperator

2016-07-26 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394108#comment-15394108 ] Siddharth Seth commented on HIVE-14332: --- Would it be useful to retain this at the DEBUG level? (or

[jira] [Comment Edited] (HIVE-14403) LLAP node specific preemption will only preempt once on a node per AM

2016-08-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405003#comment-15405003 ] Siddharth Seth edited comment on HIVE-14403 at 8/2/16 11:21 PM: Minor

[jira] [Updated] (HIVE-14403) LLAP node specific preemption will only preempt once on a node per AM

2016-08-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14403: -- Attachment: HIVE-14403.02.patch Minor update to fix an import and re-introduce a break

[jira] [Commented] (HIVE-14504) tez_join_hash.q test is slow

2016-08-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417668#comment-15417668 ] Siddharth Seth commented on HIVE-14504: --- I'm not sure if pre-commit is configured to ignore patches

[jira] [Commented] (HIVE-14405) Have tests log to the console along with hive.log

2016-08-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413880#comment-15413880 ] Siddharth Seth commented on HIVE-14405: --- Thanks for taking a look [~ashutoshc]. My concern is that

[jira] [Commented] (HIVE-14501) MiniTez test for union_type_chk.q is slow

2016-08-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415756#comment-15415756 ] Siddharth Seth commented on HIVE-14501: --- +1 > MiniTez test for union_type_chk.q is slow >

[jira] [Commented] (HIVE-14502) Convert MiniTez tests to MiniLlap tests

2016-08-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415819#comment-15415819 ] Siddharth Seth commented on HIVE-14502: --- I don't think we should move MiniLlap to use MiniHbase - it

[jira] [Commented] (HIVE-14439) LlapTaskScheduler should try scheduling tasks when a node is disabled

2016-08-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414369#comment-15414369 ] Siddharth Seth commented on HIVE-14439: --- Thanks for the reviews. Committing. > LlapTaskScheduler

[jira] [Updated] (HIVE-14439) LlapTaskScheduler should try scheduling tasks when a node is disabled

2016-08-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14439: -- Resolution: Fixed Fix Version/s: 2.1.1 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-14501) MiniTez test for union_type_chk.q is slow

2016-08-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14501: -- Fix Version/s: 2.2.0 > MiniTez test for union_type_chk.q is slow >

[jira] [Updated] (HIVE-14403) LLAP node specific preemption will only preempt once on a node per AM

2016-08-03 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14403: -- Resolution: Fixed Fix Version/s: 2.1.1 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-14403) LLAP node specific preemption will only preempt once on a node per AM

2016-08-03 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406180#comment-15406180 ] Siddharth Seth commented on HIVE-14403: --- Test failures are unrelated. Cannot reproduce

[jira] [Commented] (HIVE-14504) tez_join_hash.q test is slow

2016-08-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419579#comment-15419579 ] Siddharth Seth commented on HIVE-14504: --- +1 > tez_join_hash.q test is slow >

[jira] [Commented] (HIVE-14405) Have tests log to the console along with hive.log

2016-08-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415812#comment-15415812 ] Siddharth Seth commented on HIVE-14405: --- Looks like all of that is already in place. Re-triggering a

[jira] [Updated] (HIVE-14213) Add timeouts for various components in llap status check

2016-07-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14213: -- Description: The llapstatus check connects to various compoennts - YARN, HDFS via Slider,

[jira] [Updated] (HIVE-14213) Add timeouts for various components in llap status check

2016-07-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14213: -- Attachment: HIVE-14213.02.patch Updated patch with the config names changed to use "llapcli"

[jira] [Commented] (HIVE-14223) beeline should look for jdbc standalone jar in dist/jdbc dir instead of dist/lib

2016-07-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375495#comment-15375495 ] Siddharth Seth commented on HIVE-14223: --- +1 > beeline should look for jdbc standalone jar in

[jira] [Updated] (HIVE-14224) LLAP rename query specific log files once a query is complete

2016-07-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14224: -- Attachment: HIVE-14224.wip.01.patch WIP patch based on top of HIVE-13258, HIVE-9756.5. Still

[jira] [Updated] (HIVE-14213) Add timeouts for various components in llap status check

2016-07-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14213: -- Resolution: Fixed Fix Version/s: 2.1.1 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-14224) LLAP rename query specific log files once a query is complete

2016-07-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14224: -- Attachment: HIVE-14224.03.patch Updated patch with RB comments addressed. Also added logic to

[jira] [Commented] (HIVE-14225) Llap slider package should support configuring YARN rolling log aggregation

2016-07-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386838#comment-15386838 ] Siddharth Seth commented on HIVE-14225: --- Think the query-routing name still makes sense - since this

[jira] [Updated] (HIVE-14225) Llap slider package should support configuring YARN rolling log aggregation

2016-07-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14225: -- Status: Patch Available (was: Open) > Llap slider package should support configuring YARN

[jira] [Updated] (HIVE-14224) LLAP rename query specific log files once a query is complete

2016-07-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14224: -- Attachment: HIVE-14224.05.patch Updated patch with a log message, and some null checks. The

[jira] [Commented] (HIVE-14224) LLAP rename query specific log files once a query is complete

2016-07-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386854#comment-15386854 ] Siddharth Seth commented on HIVE-14224: --- Thanks for the reviews. Committing. The test failures are

[jira] [Updated] (HIVE-14224) LLAP rename query specific log files once a query is complete

2016-07-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14224: -- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-14224) LLAP rename query specific log files once a query is complete

2016-07-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14224: -- Attachment: HIVE-14224.04.patch Noticed some issues with the previous patch while testing it

[jira] [Commented] (HIVE-14167) Use work directories provided by Tez instead of directly using YARN local dirs

2016-07-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385129#comment-15385129 ] Siddharth Seth commented on HIVE-14167: --- +1. Assuming you've tested it on a cluster, and seen the

[jira] [Updated] (HIVE-14225) Llap slider package should support configuring YARN rolling log aggregation

2016-07-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14225: -- Attachment: HIVE-14225.01.patch Patch to - configure slider to inform YARN to aggregate files

[jira] [Commented] (HIVE-14213) Add timeouts for various components in llap status check

2016-07-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380148#comment-15380148 ] Siddharth Seth commented on HIVE-14213: --- bq. So no documentation is needed, right? No. I don't think

[jira] [Commented] (HIVE-14167) Use work directories provided by Tez instead of directly using YARN local dirs

2016-07-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378453#comment-15378453 ] Siddharth Seth commented on HIVE-14167: --- {code} +if (LlapProxy.isDaemon()) { + localDirList

[jira] [Commented] (HIVE-14111) better concurrency handling for TezSessionState - part I

2016-07-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373545#comment-15373545 ] Siddharth Seth commented on HIVE-14111: --- +1. Is the test failure on

[jira] [Commented] (HIVE-14224) LLAP rename query specific log files once a query is complete

2016-07-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380393#comment-15380393 ] Siddharth Seth commented on HIVE-14224: --- Have to check whether any of the other log4j2 config files

[jira] [Updated] (HIVE-14224) LLAP rename query specific log files once a query is complete

2016-07-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14224: -- Attachment: HIVE-14224.02.patch Updated patch. This has the changes the query-router to log

[jira] [Updated] (HIVE-14224) LLAP rename query specific log files once a query is complete

2016-07-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14224: -- Status: Patch Available (was: Open) > LLAP rename query specific log files once a query is

[jira] [Commented] (HIVE-14163) LLAP: use different kerberized/unkerberized zk paths for registry

2016-07-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363229#comment-15363229 ] Siddharth Seth commented on HIVE-14163: --- [~sershe] - should we making the namespace configurable ?

[jira] [Commented] (HIVE-14163) LLAP: use different kerberized/unkerberized zk paths for registry

2016-07-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363260#comment-15363260 ] Siddharth Seth commented on HIVE-14163: --- Shared ZK - admins want to control paths maybe. If the same

[jira] [Updated] (HIVE-14167) Use work directories provided by Tez instead of directly using YARN local dirs

2016-07-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14167: -- Affects Version/s: 2.1.0 Target Version/s: 2.2.0 > Use work directories provided by Tez

[jira] [Commented] (HIVE-9756) LLAP: use log4j 2 for llap (log to separate files, etc.)

2016-07-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363252#comment-15363252 ] Siddharth Seth commented on HIVE-9756: -- [~prasanth_j] - along with this, I think we need to add an

[jira] [Commented] (HIVE-14111) better concurrency handling for TezSessionState - part I

2016-07-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366550#comment-15366550 ] Siddharth Seth commented on HIVE-14111: --- Lets wait for HiveQA - it's identified a bunch of issues

[jira] [Commented] (HIVE-14163) LLAP: use different kerberized/unkerberized zk paths for registry

2016-07-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364793#comment-15364793 ] Siddharth Seth commented on HIVE-14163: --- +1. Looks good, other than a small change to move

[jira] [Commented] (HIVE-14168) Avoid serializing all parameters from HiveConf.java into in-memory HiveConf instances

2016-07-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368644#comment-15368644 ] Siddharth Seth commented on HIVE-14168: --- Any thoughts on this ? > Avoid serializing all parameters

[jira] [Commented] (HIVE-14197) LLAP service driver precondition failure should include the values

2016-07-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368460#comment-15368460 ] Siddharth Seth commented on HIVE-14197: --- +1 > LLAP service driver precondition failure should

[jira] [Updated] (HIVE-14202) Change tez version used to 0.8.4

2016-07-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14202: -- Attachment: HIVE-14202.01.patch > Change tez version used to 0.8.4 >

[jira] [Updated] (HIVE-14202) Change tez version used to 0.8.4

2016-07-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14202: -- Status: Patch Available (was: Open) > Change tez version used to 0.8.4 >

[jira] [Updated] (HIVE-14168) Avoid serializing all parameters from HiveConf.java into in-memory HiveConf instances

2016-07-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14168: -- Target Version/s: 2.2.0 > Avoid serializing all parameters from HiveConf.java into in-memory

[jira] [Updated] (HIVE-14168) Avoid serializing all parameters from HiveConf.java into in-memory HiveConf instances

2016-07-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14168: -- Issue Type: Improvement (was: Bug) > Avoid serializing all parameters from HiveConf.java into

[jira] [Updated] (HIVE-14202) Change tez version used to 0.8.4

2016-07-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14202: -- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-14421) FS.deleteOnExit holds references to _tmp_space.db files

2016-08-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14421: -- Attachment: HIVE-14421.02.patch Updated patch to address review comments. [~thejas] - could you

[jira] [Commented] (HIVE-14430) More instances of HiveConf and the associated UDFClassLoader than expected

2016-08-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409781#comment-15409781 ] Siddharth Seth commented on HIVE-14430: --- Not sure. I think the thread local instances are cleaned up

[jira] [Updated] (HIVE-14439) LlapTaskScheduler should try scheduling tasks when a node is disabled

2016-08-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14439: -- Attachment: HIVE-14439.01.patch cc [~prasanth_j], [~hagleitn] for review. > LlapTaskScheduler

<    3   4   5   6   7   8   9   10   11   12   >