[jira] [Commented] (HIVE-9976) LLAP: Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363909#comment-14363909 ] Siddharth Seth commented on HIVE-9976: -- I'll take a look. Assuming this was run with

[jira] [Commented] (HIVE-9756) LLAP: use log4j 2 for llap

2015-03-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363919#comment-14363919 ] Siddharth Seth commented on HIVE-9756: -- [~gopalv] - Tez is moving to slf4j in the 0.7

[jira] [Updated] (HIVE-9999) LLAP: Handle task rejection from daemons in the AM

2015-03-17 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-: - Attachment: HIVE-.1.patch LLAP: Handle task rejection from daemons in the AM

[jira] [Resolved] (HIVE-9999) LLAP: Handle task rejection from daemons in the AM

2015-03-17 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-. -- Resolution: Fixed LLAP: Handle task rejection from daemons in the AM

[jira] [Updated] (HIVE-9912) LLAP: Improvements to the Shuffle handler to avoid unnecessary disk scans

2015-03-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9912: - Attachment: HIVE-9912.1.txt Patch to cache files which have been previously scanned, and add a

[jira] [Resolved] (HIVE-9912) LLAP: Improvements to the Shuffle handler to avoid unnecessary disk scans

2015-03-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-9912. -- Resolution: Fixed LLAP: Improvements to the Shuffle handler to avoid unnecessary disk scans

[jira] [Updated] (HIVE-10025) LLAP: Queued work times out

2015-03-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10025: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-7926 LLAP: Queued work times out

[jira] [Updated] (HIVE-9912) LLAP: Improvements to the Shuffle handler to avoid unnecessary disk scans

2015-03-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9912: - Attachment: (was: HIVE-9912.1.txt) LLAP: Improvements to the Shuffle handler to avoid

[jira] [Updated] (HIVE-9912) LLAP: Improvements to the Shuffle handler to avoid unnecessary disk scans

2015-03-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9912: - Attachment: HIVE-9912.1.txt LLAP: Improvements to the Shuffle handler to avoid unnecessary disk

[jira] [Updated] (HIVE-10026) LLAP: AM should get notifications on daemons going down or restarting

2015-03-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10026: -- Fix Version/s: llap LLAP: AM should get notifications on daemons going down or restarting

[jira] [Updated] (HIVE-10025) LLAP: Queued work times out

2015-03-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10025: -- Fix Version/s: llap LLAP: Queued work times out ---

[jira] [Commented] (HIVE-9807) LLAP: Add event logging for execution elements

2015-03-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370599#comment-14370599 ] Siddharth Seth commented on HIVE-9807: -- This doesn't need any additional user

[jira] [Updated] (HIVE-9808) LLAP: Push work into daemons instead of the current pull

2015-03-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9808: - Attachment: HIVE-9808.2.txt Rebased patch. Will commit shortly; this one was painful to rebase.

[jira] [Resolved] (HIVE-9808) LLAP: Push work into daemons instead of the current pull

2015-03-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-9808. -- Resolution: Fixed LLAP: Push work into daemons instead of the current pull

[jira] [Updated] (HIVE-9775) LLAP: Add a MiniLLAPCluster for tests

2015-03-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9775: - Attachment: HIVE-9775.2.patch Re-based patch. LLAP: Add a MiniLLAPCluster for tests

[jira] [Resolved] (HIVE-9910) LLAP: Update usage of APIs changed by TEZ-2175 and TEZ-2187

2015-03-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-9910. -- Resolution: Fixed Already committed. LLAP: Update usage of APIs changed by TEZ-2175 and

[jira] [Updated] (HIVE-9910) LLAP: Update usage of APIs changed by TEZ-2175 and TEZ-2187

2015-03-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9910: - Attachment: HIVE-9910.1.patch Trivial patch. LLAP: Update usage of APIs changed by TEZ-2175 and

[jira] [Commented] (HIVE-9891) LLAP: disable plan caching

2015-03-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352337#comment-14352337 ] Siddharth Seth commented on HIVE-9891: -- Would be nice if the plan were immutable - I'm

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9976: - Affects Version/s: (was: 1.1.0) 1.0.0 Fix Version/s: (was:

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9976: - Issue Type: Bug (was: Sub-task) Parent: (was: HIVE-7926) Possible race condition in

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9976: - Fix Version/s: 1.1.1 1.2.0 Possible race condition in DynamicPartitionPruner

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9976: - Summary: Possible race condition in DynamicPartitionPruner for 200ms tasks (was: LLAP: Possible

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9976: - Affects Version/s: (was: llap) 1.1.0 Possible race condition in

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9976: - Attachment: HIVE-9976.1.patch Patch to handle out of order events. Also initializes the pruner

[jira] [Updated] (HIVE-9976) Possible race condition in DynamicPartitionPruner for 200ms tasks

2015-03-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9976: - Attachment: HIVE-9976.2.patch Thanks for the review. Updated patch with comments addressed, and

[jira] [Resolved] (HIVE-10104) LLAP: Generate consistent splits and locations for the same split across jobs

2015-03-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10104. --- Resolution: Fixed LLAP: Generate consistent splits and locations for the same split across

[jira] [Updated] (HIVE-10106) Regression : Dynamic partition pruning not working after HIVE-9976

2015-03-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10106: -- Attachment: HIVE-10106.1.patch I believe this is caused by the way mapWork is setup. It's now

[jira] [Updated] (HIVE-9775) LLAP: Add a MiniLLAPCluster for tests

2015-03-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9775: - Attachment: HIVE-9775.1.patch Patch to add a MiniLLAPCluster. This isn't wired into the tests and

[jira] [Updated] (HIVE-9807) LLAP: Add event logging for execution elements

2015-02-26 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9807: - Attachment: HIVE-9807.1.patch Sample log lines - additional details will be populated in a later

[jira] [Commented] (HIVE-9808) LLAP: Push work into daemons instead of the current pull

2015-02-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14340878#comment-14340878 ] Siddharth Seth commented on HIVE-9808: -- Applies on top of TEZ-9807. LLAP: Push work

[jira] [Commented] (HIVE-10113) LLAP: reducers running in LLAP starve out map retries

2015-03-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384247#comment-14384247 ] Siddharth Seth commented on HIVE-10113: --- Related:

[jira] [Updated] (HIVE-10117) LLAP: Use task number, attempt number to cache plans

2015-03-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10117: -- Fix Version/s: llap LLAP: Use task number, attempt number to cache plans

[jira] [Updated] (HIVE-10104) LLAP: Generate consistent splits and locations for the same split across jobs

2015-03-26 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10104: -- Attachment: HIVE-10104.1.txt Patch to order the original splits by size and name. Location is

[jira] [Updated] (HIVE-10104) LLAP: Generate consistent splits and locations for the same split across jobs

2015-03-26 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10104: -- Attachment: HIVE-10104.2.txt Updated patch with the sort removed from the scheduler. Tested on

[jira] [Resolved] (HIVE-9913) LLAP: Avoid fetching data multiple times in case of broadcast

2015-04-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-9913. -- Resolution: Fixed LLAP: Avoid fetching data multiple times in case of broadcast

[jira] [Updated] (HIVE-9913) LLAP: Avoid fetching data multiple times in case of broadcast

2015-04-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9913: - Attachment: HIVE-9913.1.txt Patch delays the start to when the Input is actually used for

[jira] [Updated] (HIVE-10408) LLAP: NPE in scheduler in case of rejected tasks

2015-04-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10408: -- Summary: LLAP: NPE in scheduler in case of rejected tasks (was: LLAP: query fails - NPE (old

[jira] [Updated] (HIVE-10475) LLAP: Minor fixes after tez api enhancements for dag completion

2015-04-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10475: -- Attachment: HIVE-10475.1.txt LLAP: Minor fixes after tez api enhancements for dag completion

[jira] [Updated] (HIVE-10405) LLAP: Provide runtime information to daemons to decide on preemption order

2015-04-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10405: -- Attachment: HIVE-10405.1.txt The following information is sent into daemons at fragment

[jira] [Updated] (HIVE-10424) LLAP: Factor known capacity into scheduling decisions

2015-04-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10424: -- Attachment: HIVE-10424.1.txt Patch to factor in running queue + wait queue capacity per node.

[jira] [Resolved] (HIVE-10424) LLAP: Factor known capacity into scheduling decisions

2015-04-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10424. --- Resolution: Fixed LLAP: Factor known capacity into scheduling decisions

[jira] [Commented] (HIVE-10394) LLAP: Notify AM of pre-emption

2015-04-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503373#comment-14503373 ] Siddharth Seth commented on HIVE-10394: --- The information isn't actually being sent

[jira] [Commented] (HIVE-10480) LLAP: Tez task is interrupted for unknown reason after an IPC exception and then fails to report completion

2015-04-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14511738#comment-14511738 ] Siddharth Seth commented on HIVE-10480: --- This is what is happening here. The

[jira] [Resolved] (HIVE-10475) LLAP: Minor fixes after tez api enhancements for dag completion

2015-04-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10475. --- Resolution: Fixed LLAP: Minor fixes after tez api enhancements for dag completion

[jira] [Assigned] (HIVE-10480) LLAP: Tez task is interrupted for unknown reason after an IPC exception and then fails to report completion

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-10480: - Assignee: Siddharth Seth LLAP: Tez task is interrupted for unknown reason after an IPC

[jira] [Commented] (HIVE-10482) LLAP: AsertionError cannot allocate when reading from orc

2015-04-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522282#comment-14522282 ] Siddharth Seth commented on HIVE-10482: --- The default. 1 GB I believe. LLAP:

[jira] [Resolved] (HIVE-10560) LLAP: a different NPE in shuffle

2015-04-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10560. --- Resolution: Fixed Fix Version/s: llap LLAP: a different NPE in shuffle

[jira] [Updated] (HIVE-10560) LLAP: a different NPE in shuffle

2015-04-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10560: -- Attachment: HIVE-10560.1.txt Forgot to add a check for the dirWatcher in case it's disabled.

[jira] [Resolved] (HIVE-9911) LLAP: Clean up structures and intermediate data when a query completes

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-9911. -- Resolution: Fixed Committed to branch. LLAP: Clean up structures and intermediate data when a

[jira] [Updated] (HIVE-10480) LLAP: Tez task is interrupted for unknown reason after an IPC exception and then fails to report completion

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10480: -- Attachment: HIVE-10480.1.txt TEZ-2367 fixes this in a way which requires a minor update to the

[jira] [Updated] (HIVE-9911) LLAP: Clean up structures and intermediate data when a query completes

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-9911: - Attachment: HIVE-9911.1.txt The patch changes intermediate data to be written to a dag specific

[jira] [Assigned] (HIVE-9911) LLAP: Clean up structures and intermediate data when a query completes

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-9911: Assignee: Siddharth Seth LLAP: Clean up structures and intermediate data when a query

[jira] [Updated] (HIVE-10682) LLAP: Make use of the task runner which allows killing tasks

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10682: -- Attachment: HIVE-10682.1.txt LLAP: Make use of the task runner which allows killing tasks

[jira] [Reopened] (HIVE-10682) LLAP: Make use of the task runner which allows killing tasks

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reopened HIVE-10682: --- LLAP: Make use of the task runner which allows killing tasks

[jira] [Resolved] (HIVE-10682) LLAP: Make use of the task runner which allows killing tasks

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10682. --- Resolution: Fixed LLAP: Make use of the task runner which allows killing tasks

[jira] [Resolved] (HIVE-10682) LLAP: Make use of the task runner which allows killing tasks

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10682. --- Resolution: Pending Closed LLAP: Make use of the task runner which allows killing tasks

[jira] [Updated] (HIVE-10700) LLAP: Log additional debug information in the scheduler

2015-05-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10700: -- Attachment: HIVE-10700.1.txt LLAP: Log additional debug information in the scheduler

[jira] [Resolved] (HIVE-10700) LLAP: Log additional debug information in the scheduler

2015-05-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10700. --- Resolution: Fixed LLAP: Log additional debug information in the scheduler

[jira] [Resolved] (HIVE-10652) LLAP: AM task communication retry is too long

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10652. --- Resolution: Fixed Fix Version/s: llap LLAP: AM task communication retry is too long

[jira] [Resolved] (HIVE-10649) LLAP: AM gets stuck completely if one node is dead

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10649. --- Resolution: Duplicate LLAP: AM gets stuck completely if one node is dead

[jira] [Updated] (HIVE-10683) LLAP: Add a mechanism for daemons to inform the AM about killed tasks

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10683: -- Attachment: HIVE-10683.1.txt LLAP: Add a mechanism for daemons to inform the AM about killed

[jira] [Updated] (HIVE-10652) LLAP: AM task communication retry is too long

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10652: -- Attachment: HIVE-10652.1.addendum.txt Addendum patch to remove some unused imports. LLAP: AM

[jira] [Resolved] (HIVE-10683) LLAP: Add a mechanism for daemons to inform the AM about killed tasks

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10683. --- Resolution: Fixed LLAP: Add a mechanism for daemons to inform the AM about killed tasks

[jira] [Updated] (HIVE-10652) LLAP: AM task communication retry is too long

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10652: -- Attachment: HIVE-10652.1.txt Made configurable, and defaults to 16s. LLAP: AM task

[jira] [Updated] (HIVE-10649) LLAP: AM gets stuck completely if one node is dead

2015-05-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10649: -- Assignee: (was: Siddharth Seth) LLAP: AM gets stuck completely if one node is dead

[jira] [Resolved] (HIVE-10730) LLAP: fix guava stopwatch conflict

2015-05-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10730. --- Resolution: Fixed LLAP: fix guava stopwatch conflict --

[jira] [Commented] (HIVE-10737) LLAP: task scheduler thread-count keeps growing

2015-05-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14549200#comment-14549200 ] Siddharth Seth commented on HIVE-10737: --- There's other OOMs on the TaskCommunicator

[jira] [Commented] (HIVE-10737) LLAP: task scheduler thread-count keeps growing

2015-05-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14547624#comment-14547624 ] Siddharth Seth commented on HIVE-10737: --- [~gopalv] - do you happen to have a stack

[jira] [Commented] (HIVE-10233) Hive on LLAP: Memory manager

2015-04-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497034#comment-14497034 ] Siddharth Seth commented on HIVE-10233: --- Looked at just the Tez Configuration

[jira] [Commented] (HIVE-10029) LLAP: Scheduling of work from different queries within the daemon

2015-04-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498716#comment-14498716 ] Siddharth Seth commented on HIVE-10029: --- Yes, to the most part. We'll likely a need

[jira] [Updated] (HIVE-10335) LLAP: IndexOutOfBound in MapJoinOperator

2015-04-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10335: -- Fix Version/s: llap LLAP: IndexOutOfBound in MapJoinOperator

[jira] [Commented] (HIVE-10335) LLAP: IndexOutOfBound in MapJoinOperator

2015-04-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494916#comment-14494916 ] Siddharth Seth commented on HIVE-10335: --- Also {code}

[jira] [Updated] (HIVE-10229) Set conf and processor context in the constructor instead of init

2015-04-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10229: -- Issue Type: Bug (was: Sub-task) Parent: (was: HIVE-7926) Set conf and processor

[jira] [Updated] (HIVE-10229) Set conf and processor context in the constructor instead of init

2015-04-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10229: -- Attachment: HIVE-10229.1.patch Fairly simple patch to set jconf and context during

[jira] [Commented] (HIVE-10229) LLAP: NPE in ReduceRecordProcessor

2015-04-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482118#comment-14482118 ] Siddharth Seth commented on HIVE-10229: --- Yep. Same issue I saw. ProcessorContext is

[jira] [Assigned] (HIVE-10229) Set conf and processor context in the constructor instead of init

2015-04-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-10229: - Assignee: Siddharth Seth (was: Gunther Hagleitner) Set conf and processor context in

[jira] [Updated] (HIVE-10229) Set conf and processor context in the constructor instead of init

2015-04-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10229: -- Summary: Set conf and processor context in the constructor instead of init (was: LLAP: NPE in

[jira] [Assigned] (HIVE-10025) LLAP: Queued work times out

2015-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-10025: - Assignee: Siddharth Seth LLAP: Queued work times out ---

[jira] [Resolved] (HIVE-10013) NPE in LLAP logs in heartbeat

2015-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10013. --- Resolution: Done This should be fixed as part of TEZ-2257. Please re-open if seen again.

[jira] [Resolved] (HIVE-10025) LLAP: Queued work times out

2015-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10025. --- Resolution: Fixed LLAP: Queued work times out ---

[jira] [Updated] (HIVE-10157) Make use of the timed version of getDagStatus in TezJobMonitor

2015-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10157: -- Fix Version/s: 1.2.0 Make use of the timed version of getDagStatus in TezJobMonitor

[jira] [Commented] (HIVE-10185) LLAP: LLAP IO doesn't get invoked inside MiniTezCluster q tests

2015-04-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393097#comment-14393097 ] Siddharth Seth commented on HIVE-10185: --- MiniLlapCluster is not used yet. There's a

[jira] [Commented] (HIVE-10012) LLAP: Hive sessions run before Slider registers to YARN registry fail to launch

2015-04-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14490497#comment-14490497 ] Siddharth Seth commented on HIVE-10012: --- Glanced over. Mostly looks good to me. This

[jira] [Updated] (HIVE-10279) LLAP: Allow the runtime to check whether a task can run to completion

2015-04-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10279: -- Fix Version/s: llap LLAP: Allow the runtime to check whether a task can run to completion

[jira] [Resolved] (HIVE-10767) LLAP: Improve the way task finishable information is processed

2015-05-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10767. --- Resolution: Fixed Fix Version/s: llap LLAP: Improve the way task finishable

[jira] [Reopened] (HIVE-10764) LLAP: Wait queue scheduler goes into tight loop

2015-05-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reopened HIVE-10764: --- LLAP: Wait queue scheduler goes into tight loop ---

[jira] [Resolved] (HIVE-10764) LLAP: Wait queue scheduler goes into tight loop

2015-05-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10764. --- Resolution: Implemented Done as part of HIVE-10767. The patch here was reverted. LLAP: Wait

[jira] [Updated] (HIVE-10767) LLAP: Improve the way task finishable information is processed

2015-05-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10767: -- Attachment: HIVE-10767.1.txt LLAP: Improve the way task finishable information is processed

[jira] [Updated] (HIVE-10756) LLAP: Misc changes to daemon scheduling

2015-05-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10756: -- Attachment: HIVE-10756.1.txt [~prasanth_j] - could you take a quick look please. LLAP: Misc

[jira] [Resolved] (HIVE-10756) LLAP: Misc changes to daemon scheduling

2015-05-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10756. --- Resolution: Fixed Thanks. Committed. LLAP: Misc changes to daemon scheduling

[jira] [Resolved] (HIVE-10765) LLAP: NPE when calling abort on the TezProcessor

2015-05-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10765. --- Resolution: Fixed Fix Version/s: llap Assignee: Siddharth Seth LLAP: NPE

[jira] [Updated] (HIVE-10765) LLAP: NPE when calling abort on the TezProcessor

2015-05-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10765: -- Attachment: HIVE-10765.2.txt Removed the volatile modifier which was part of the initial test

[jira] [Assigned] (HIVE-10779) LLAP: Daemons should shutdown in case of fatal errors

2015-06-04 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-10779: - Assignee: Siddharth Seth LLAP: Daemons should shutdown in case of fatal errors

[jira] [Updated] (HIVE-10779) LLAP: Daemons should shutdown in case of fatal errors

2015-06-04 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10779: -- Attachment: HIVE-10779.1.txt Patch adds an UncauhtExceptionHandler and a shutdown hook to stop

[jira] [Resolved] (HIVE-10779) LLAP: Daemons should shutdown in case of fatal errors

2015-06-04 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10779. --- Resolution: Fixed Fix Version/s: llap Committed to the llap branch. LLAP: Daemons

[jira] [Updated] (HIVE-10961) LLAP: ShuffleHandler + Submit work init race condition

2015-06-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-10961: -- Attachment: HIVE-10961.1.txt LLAP: ShuffleHandler + Submit work init race condition

[jira] [Resolved] (HIVE-10961) LLAP: ShuffleHandler + Submit work init race condition

2015-06-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10961. --- Resolution: Fixed LLAP: ShuffleHandler + Submit work init race condition

[jira] [Commented] (HIVE-10947) LLAP: preemption appears to count against failure count for the task

2015-06-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579604#comment-14579604 ] Siddharth Seth commented on HIVE-10947: --- If this happens again, please capture the

[jira] [Commented] (HIVE-11046) Filesystem Closed Exception

2015-06-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592478#comment-14592478 ] Siddharth Seth commented on HIVE-11046: --- [~raj_velu] - bunch of questions. Do you

[jira] [Resolved] (HIVE-10762) LLAP: Kill any fragments running in a daemon when a query completes

2015-06-17 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-10762. --- Resolution: Fixed Committed to the llap branch. LLAP: Kill any fragments running in a

  1   2   3   4   5   6   7   8   9   10   >