[jira] [Updated] (DRILL-5016) Config param drill.exec.sort.purge.threshold is misnamed

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5016: --- Summary: Config param drill.exec.sort.purge.threshold is misnamed (was: drill.exec.sort.purge.thresho

[jira] [Commented] (DRILL-5014) ExternalSortBatch cache size, spill count differs from config setting

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15648544#comment-15648544 ] Paul Rogers commented on DRILL-5014: The issue actually seems more complex. ESB seems

[jira] [Comment Edited] (DRILL-5014) ExternalSortBatch cache size, spill count differs from config setting

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15648544#comment-15648544 ] Paul Rogers edited comment on DRILL-5014 at 11/8/16 7:29 PM: -

[jira] [Commented] (DRILL-5014) ExternalSortBatch cache size, spill count differs from config setting

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649126#comment-15649126 ] Paul Rogers commented on DRILL-5014: Proposed solution. Set an overall ESB memory lim

[jira] [Comment Edited] (DRILL-5014) ExternalSortBatch cache size, spill count differs from config setting

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649126#comment-15649126 ] Paul Rogers edited comment on DRILL-5014 at 11/8/16 11:12 PM: --

[jira] [Commented] (DRILL-5011) External Sort Batch memory use depends on record width

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649214#comment-15649214 ] Paul Rogers commented on DRILL-5011: Proposed solution: The best solution is to revis

[jira] [Comment Edited] (DRILL-5014) ExternalSortBatch cache size, spill count differs from config setting

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15648544#comment-15648544 ] Paul Rogers edited comment on DRILL-5014 at 11/8/16 11:57 PM: --

[jira] [Created] (DRILL-5019) ExternalSortBatch spills all batches to disk even if even one spills

2016-11-08 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5019: -- Summary: ExternalSortBatch spills all batches to disk even if even one spills Key: DRILL-5019 URL: https://issues.apache.org/jira/browse/DRILL-5019 Project: Apache Drill

[jira] [Created] (DRILL-5020) ExernalSortBatch has inconsistent notions of the memory limit

2016-11-08 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5020: -- Summary: ExernalSortBatch has inconsistent notions of the memory limit Key: DRILL-5020 URL: https://issues.apache.org/jira/browse/DRILL-5020 Project: Apache Drill

[jira] [Updated] (DRILL-5008) Refactor, document and simplify ExternalSortBatch

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5008: --- Description: ExternalSortBatch provides a spillable sort operator for Drill. The code works fine, but

[jira] [Created] (DRILL-5021) ExternalSortBatch redundantly redefines the batch schema

2016-11-08 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5021: -- Summary: ExternalSortBatch redundantly redefines the batch schema Key: DRILL-5021 URL: https://issues.apache.org/jira/browse/DRILL-5021 Project: Apache Drill Iss

[jira] [Comment Edited] (DRILL-5011) External Sort Batch memory use depends on record width

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649214#comment-15649214 ] Paul Rogers edited comment on DRILL-5011 at 11/9/16 1:11 AM: -

[jira] [Created] (DRILL-5022) ExternalSortBatch sets two different limits for "copier" memory

2016-11-08 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5022: -- Summary: ExternalSortBatch sets two different limits for "copier" memory Key: DRILL-5022 URL: https://issues.apache.org/jira/browse/DRILL-5022 Project: Apache Drill

[jira] [Created] (DRILL-5023) ExternalSortBatch does not spill fully, throws off spill calculations

2016-11-08 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5023: -- Summary: ExternalSortBatch does not spill fully, throws off spill calculations Key: DRILL-5023 URL: https://issues.apache.org/jira/browse/DRILL-5023 Project: Apache Drill

[jira] [Updated] (DRILL-5023) ExternalSortBatch does not spill fully, throws off spill calculations

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5023: --- Description: The {{ExternalSortBatch}} (ESB) operator sorts records, spilling to disk as needed to op

[jira] [Commented] (DRILL-5023) ExternalSortBatch does not spill fully, throws off spill calculations

2016-11-08 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649938#comment-15649938 ] Paul Rogers commented on DRILL-5023: More detail. This behavior seems to be an artifac

[jira] [Assigned] (DRILL-5023) ExternalSortBatch does not spill fully, throws off spill calculations

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-5023: -- Assignee: Paul Rogers > ExternalSortBatch does not spill fully, throws off spill calculations >

[jira] [Assigned] (DRILL-5011) External Sort Batch memory use depends on record width

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-5011: -- Assignee: Paul Rogers > External Sort Batch memory use depends on record width > --

[jira] [Assigned] (DRILL-5008) Refactor, document and simplify ExternalSortBatch

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-5008: -- Assignee: Paul Rogers > Refactor, document and simplify ExternalSortBatch > ---

[jira] [Assigned] (DRILL-5022) ExternalSortBatch sets two different limits for "copier" memory

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-5022: -- Assignee: Paul Rogers > ExternalSortBatch sets two different limits for "copier" memory > -

[jira] [Updated] (DRILL-5012) External Sort Batch does not check free disk space before writing

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5012: --- Summary: External Sort Batch does not check free disk space before writing (was: External Sort Batch

[jira] [Assigned] (DRILL-5014) ExternalSortBatch cache size, spill count differs from config setting

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-5014: -- Assignee: Paul Rogers > ExternalSortBatch cache size, spill count differs from config setting >

[jira] [Assigned] (DRILL-5020) ExernalSortBatch has inconsistent notions of the memory limit

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-5020: -- Assignee: Paul Rogers > ExernalSortBatch has inconsistent notions of the memory limit > ---

[jira] [Updated] (DRILL-5020) ExternalSortBatch has inconsistent notions of the memory limit

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5020: --- Summary: ExternalSortBatch has inconsistent notions of the memory limit (was: ExernalSortBatch has in

[jira] [Created] (DRILL-5025) ExternalSortBatch provides weak control over spill file size

2016-11-09 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5025: -- Summary: ExternalSortBatch provides weak control over spill file size Key: DRILL-5025 URL: https://issues.apache.org/jira/browse/DRILL-5025 Project: Apache Drill

[jira] [Assigned] (DRILL-5026) ExternalSortBatch uses two memory allocators; one will do

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-5026: -- Assignee: Paul Rogers > ExternalSortBatch uses two memory allocators; one will do > ---

[jira] [Created] (DRILL-5026) ExternalSortBatch uses two memory allocators; one will do

2016-11-09 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5026: -- Summary: ExternalSortBatch uses two memory allocators; one will do Key: DRILL-5026 URL: https://issues.apache.org/jira/browse/DRILL-5026 Project: Apache Drill Is

[jira] [Created] (DRILL-5027) ExternalSortBatch can use excessive memory for very large queries

2016-11-09 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5027: -- Summary: ExternalSortBatch can use excessive memory for very large queries Key: DRILL-5027 URL: https://issues.apache.org/jira/browse/DRILL-5027 Project: Apache Drill

[jira] [Commented] (DRILL-5027) ExternalSortBatch can use excessive memory for very large queries

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653067#comment-15653067 ] Paul Rogers commented on DRILL-5027: Appears that the above comment is slightly off. A

[jira] [Commented] (DRILL-5027) ExternalSortBatch can use excessive memory for very large queries

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653085#comment-15653085 ] Paul Rogers commented on DRILL-5027: Inspection reveals that the intermediate spill ev

[jira] [Commented] (DRILL-5027) ExternalSortBatch can use excessive memory for very large queries

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653086#comment-15653086 ] Paul Rogers commented on DRILL-5027: Inspection reveals that the intermediate spill ev

[jira] [Updated] (DRILL-5027) ExternalSortBatch is efficient, leaks files for large queries

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5027: --- Summary: ExternalSortBatch is efficient, leaks files for large queries (was: ExternalSortBatch can us

[jira] [Updated] (DRILL-5027) ExternalSortBatch is inefficient, leaks files for large queries

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5027: --- Summary: ExternalSortBatch is inefficient, leaks files for large queries (was: ExternalSortBatch is e

[jira] [Updated] (DRILL-5027) ExternalSortBatch is inefficient, leaks files for large queries

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5027: --- Description: The {{ExternalSortBatch}} (ESB) operator sorts data while spilling to disk as needed to

[jira] [Issue Comment Deleted] (DRILL-5027) ExternalSortBatch is inefficient, leaks files for large queries

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5027: --- Comment: was deleted (was: Appears that the above comment is slightly off. Actual behavior is that wh

[jira] [Issue Comment Deleted] (DRILL-5027) ExternalSortBatch is inefficient, leaks files for large queries

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5027: --- Comment: was deleted (was: Inspection reveals that the intermediate spill events do not clean up the

[jira] [Assigned] (DRILL-5027) ExternalSortBatch is inefficient, leaks files for large queries

2016-11-09 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-5027: -- Assignee: Paul Rogers > ExternalSortBatch is inefficient, leaks files for large queries > -

[jira] [Commented] (DRILL-5027) ExternalSortBatch is inefficient, leaks files for large queries

2016-11-10 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654495#comment-15654495 ] Paul Rogers commented on DRILL-5027: Proposed solution, which seems reachable by rearr

[jira] [Commented] (DRILL-5027) ExternalSortBatch is inefficient, leaks files for large queries

2016-11-10 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654610#comment-15654610 ] Paul Rogers commented on DRILL-5027: Another issue with the existing ESB: The code to

[jira] [Commented] (DRILL-5025) ExternalSortBatch provides weak control over spill file size

2016-11-10 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655275#comment-15655275 ] Paul Rogers commented on DRILL-5025: Cancelling for now; spill file size is determined

[jira] [Resolved] (DRILL-5025) ExternalSortBatch provides weak control over spill file size

2016-11-10 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers resolved DRILL-5025. Resolution: Invalid Assignee: Paul Rogers > ExternalSortBatch provides weak control over spill

[jira] [Closed] (DRILL-5025) ExternalSortBatch provides weak control over spill file size

2016-11-10 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers closed DRILL-5025. -- > ExternalSortBatch provides weak control over spill file size > ---

[jira] [Updated] (DRILL-5027) ExternalSortBatch is inefficient: rewrites data unnecessarily

2016-11-11 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5027: --- Summary: ExternalSortBatch is inefficient: rewrites data unnecessarily (was: ExternalSortBatch is ine

[jira] [Issue Comment Deleted] (DRILL-5027) ExternalSortBatch is inefficient: rewrites data unnecessarily

2016-11-11 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5027: --- Comment: was deleted (was: Inspection reveals that the intermediate spill events do not clean up the

[jira] [Commented] (DRILL-5042) Settings in drill-env.sh are not overriding the same settings in distrib-env.sh

2016-11-16 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15672065#comment-15672065 ] Paul Rogers commented on DRILL-5042: Turns out that Drill works correctly, but the par

[jira] [Resolved] (DRILL-5042) Settings in drill-env.sh are not overriding the same settings in distrib-env.sh

2016-11-16 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers resolved DRILL-5042. Resolution: Not A Problem See description above. Distrib-env.sh must follow the right pattern for th

[jira] [Commented] (DRILL-5042) Settings in drill-env.sh are not overriding the same settings in distrib-env.sh

2016-11-16 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15672821#comment-15672821 ] Paul Rogers commented on DRILL-5042: Prior to 1.8 we had just one file: drill-env.sh.

[jira] [Updated] (DRILL-4995) Allow lazy init when dynamic UDF support is disabled

2016-11-18 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-4995: --- Assignee: Arina Ielchiieva (was: Paul Rogers) > Allow lazy init when dynamic UDF support is disabled

[jira] [Created] (DRILL-5052) Option to debug generated Java code using an IDE

2016-11-19 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5052: -- Summary: Option to debug generated Java code using an IDE Key: DRILL-5052 URL: https://issues.apache.org/jira/browse/DRILL-5052 Project: Apache Drill Issue Type:

[jira] [Updated] (DRILL-5052) Option to debug generated Java code using an IDE

2016-11-19 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5052: --- Description: Drill makes extensive use of Java code generation to implement its operators. Drill uses

[jira] [Comment Edited] (DRILL-5052) Option to debug generated Java code using an IDE

2016-11-19 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15680323#comment-15680323 ] Paul Rogers edited comment on DRILL-5052 at 11/20/16 3:11 AM: --

[jira] [Commented] (DRILL-5052) Option to debug generated Java code using an IDE

2016-11-19 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15680323#comment-15680323 ] Paul Rogers commented on DRILL-5052: To use the feature, do the following: * Set the

[jira] [Created] (DRILL-5053) Remove excessive output from unit test cases

2016-11-20 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5053: -- Summary: Remove excessive output from unit test cases Key: DRILL-5053 URL: https://issues.apache.org/jira/browse/DRILL-5053 Project: Apache Drill Issue Type: Imp

[jira] [Commented] (DRILL-5053) Remove excessive output from unit test cases

2016-11-20 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15682276#comment-15682276 ] Paul Rogers commented on DRILL-5053: {{org.apache.drill.common.exceptions.TestUserExce

[jira] [Commented] (DRILL-5053) Remove excessive output from unit test cases

2016-11-20 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15682304#comment-15682304 ] Paul Rogers commented on DRILL-5053: {{org.apache.drill.common.expression.parser.TreeT

[jira] [Commented] (DRILL-5053) Remove excessive output from unit test cases

2016-11-20 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15682308#comment-15682308 ] Paul Rogers commented on DRILL-5053: Many tests based on {{org.apache.drill.test.Drill

[jira] [Commented] (DRILL-5053) Remove excessive output from unit test cases

2016-11-20 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15682378#comment-15682378 ] Paul Rogers commented on DRILL-5053: {{org.apache.drill.exec.DrillSeparatePlanningTest

[jira] [Comment Edited] (DRILL-5053) Remove excessive output from unit test cases

2016-11-20 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15682378#comment-15682378 ] Paul Rogers edited comment on DRILL-5053 at 11/21/16 3:31 AM: --

[jira] [Created] (DRILL-5055) External Sort does not delete spill file if error occurs during close

2016-11-21 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5055: -- Summary: External Sort does not delete spill file if error occurs during close Key: DRILL-5055 URL: https://issues.apache.org/jira/browse/DRILL-5055 Project: Apache Drill

[jira] [Created] (DRILL-5056) UserException does not log full message to log

2016-11-21 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5056: -- Summary: UserException does not log full message to log Key: DRILL-5056 URL: https://issues.apache.org/jira/browse/DRILL-5056 Project: Apache Drill Issue Type: I

[jira] [Created] (DRILL-5057) UserException is unchecked, but is the primary way to report errors

2016-11-21 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5057: -- Summary: UserException is unchecked, but is the primary way to report errors Key: DRILL-5057 URL: https://issues.apache.org/jira/browse/DRILL-5057 Project: Apache Drill

[jira] [Created] (DRILL-5058) External sort does not handle its own UserExceptions

2016-11-21 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5058: -- Summary: External sort does not handle its own UserExceptions Key: DRILL-5058 URL: https://issues.apache.org/jira/browse/DRILL-5058 Project: Apache Drill Issue T

[jira] [Updated] (DRILL-5058) External sort does not handle its own UserExceptions

2016-11-21 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5058: --- Description: The external sort throws a {{UserException}} in a variety of conditions: error during sp

[jira] [Updated] (DRILL-5056) UserException does not write full message to log

2016-11-21 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5056: --- Summary: UserException does not write full message to log (was: UserException does not log full messa

[jira] [Created] (DRILL-5059) JDBC tests queries by dumping query to stdout

2016-11-21 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5059: -- Summary: JDBC tests queries by dumping query to stdout Key: DRILL-5059 URL: https://issues.apache.org/jira/browse/DRILL-5059 Project: Apache Drill Issue Type: Bu

[jira] [Updated] (DRILL-5059) JDBC tests queries by dumping query to stdout

2016-11-21 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5059: --- Description: The JDBC tests in {{org.apache.drill.jdbc.test.TestJdbcDistQuery}}, {{TestBugFixes}} (an

[jira] [Commented] (DRILL-5057) UserException is unchecked, but is the primary way to report errors

2016-11-21 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684404#comment-15684404 ] Paul Rogers commented on DRILL-5057: Right, but that is rather the point. There are ma

[jira] [Created] (DRILL-5060) External Sort does not recognize query cancellation during long events

2016-11-21 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5060: -- Summary: External Sort does not recognize query cancellation during long events Key: DRILL-5060 URL: https://issues.apache.org/jira/browse/DRILL-5060 Project: Apache Dril

[jira] [Created] (DRILL-5061) Query cancel requests are not synchronous; data still arrives after cancelling

2016-11-21 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5061: -- Summary: Query cancel requests are not synchronous; data still arrives after cancelling Key: DRILL-5061 URL: https://issues.apache.org/jira/browse/DRILL-5061 Project: Apa

[jira] [Created] (DRILL-5062) External sort refers to the deprecated HDFS fs.default.name param

2016-11-21 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5062: -- Summary: External sort refers to the deprecated HDFS fs.default.name param Key: DRILL-5062 URL: https://issues.apache.org/jira/browse/DRILL-5062 Project: Apache Drill

[jira] [Commented] (DRILL-5057) UserException is unchecked, but is the primary way to report errors

2016-11-22 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15687184#comment-15687184 ] Paul Rogers commented on DRILL-5057: Thanks! The meaning of UserException is a bit unc

[jira] [Updated] (DRILL-5058) External sort does not handle its own UserExceptions

2016-11-22 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5058: --- Priority: Minor (was: Major) > External sort does not handle its own UserExceptions > ---

[jira] [Updated] (DRILL-5057) UserException is unchecked, but is the primary way to report errors

2016-11-22 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5057: --- Description: Drill operator implementations have a somewhat inconsistent way to handle exceptions. So

[jira] [Commented] (DRILL-5058) External sort does not handle its own UserExceptions

2016-11-22 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15687203#comment-15687203 ] Paul Rogers commented on DRILL-5058: Putting this on hold. Seems the original behavior

[jira] [Assigned] (DRILL-5019) ExternalSortBatch spills all batches to disk even if even one spills

2016-11-23 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-5019: -- Assignee: Paul Rogers > ExternalSortBatch spills all batches to disk even if even one spills >

[jira] [Assigned] (DRILL-4181) Improve memory limit assignment for Sort operators

2016-11-23 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-4181: -- Assignee: Paul Rogers > Improve memory limit assignment for Sort operators > --

[jira] [Assigned] (DRILL-5017) Config param drill.exec.sort.external.batch.size is not used

2016-11-23 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-5017: -- Assignee: Paul Rogers > Config param drill.exec.sort.external.batch.size is not used >

[jira] [Reopened] (DRILL-5025) ExternalSortBatch provides weak control over spill file size

2016-11-23 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reopened DRILL-5025: Reopening - issue applies just to "first generation" spill files. > ExternalSortBatch provides weak con

[jira] [Created] (DRILL-5066) External sort attempts to retry sv2 memory alloc, even if can never succeed

2016-11-23 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5066: -- Summary: External sort attempts to retry sv2 memory alloc, even if can never succeed Key: DRILL-5066 URL: https://issues.apache.org/jira/browse/DRILL-5066 Project: Apache

[jira] [Created] (DRILL-5069) MaterializeVisitor.visitSchemaPath silently ignores missing fields

2016-11-25 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5069: -- Summary: MaterializeVisitor.visitSchemaPath silently ignores missing fields Key: DRILL-5069 URL: https://issues.apache.org/jira/browse/DRILL-5069 Project: Apache Drill

[jira] [Created] (DRILL-5070) Code cache compares sources, but method order varies

2016-11-25 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5070: -- Summary: Code cache compares sources, but method order varies Key: DRILL-5070 URL: https://issues.apache.org/jira/browse/DRILL-5070 Project: Apache Drill Issue T

[jira] [Created] (DRILL-5071) CodeGenerator class unnecessarily keeps two copies of generated code

2016-11-25 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5071: -- Summary: CodeGenerator class unnecessarily keeps two copies of generated code Key: DRILL-5071 URL: https://issues.apache.org/jira/browse/DRILL-5071 Project: Apache Drill

[jira] [Created] (DRILL-5073) Memory allocation failure in test DrillSeparatePlanningTest.testPlanning

2016-11-27 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5073: -- Summary: Memory allocation failure in test DrillSeparatePlanningTest.testPlanning Key: DRILL-5073 URL: https://issues.apache.org/jira/browse/DRILL-5073 Project: Apache Dr

[jira] [Created] (DRILL-5074) Excessive logging for permission denied error in CTAS

2016-11-27 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5074: -- Summary: Excessive logging for permission denied error in CTAS Key: DRILL-5074 URL: https://issues.apache.org/jira/browse/DRILL-5074 Project: Apache Drill Issue

[jira] [Commented] (DRILL-5070) Code cache compares sources, but method order varies

2016-11-27 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700579#comment-15700579 ] Paul Rogers commented on DRILL-5070: Analysis of impact. Method order is random. If a

[jira] [Commented] (DRILL-5073) Memory allocation failure in test DrillSeparatePlanningTest.testPlanning

2016-11-27 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700592#comment-15700592 ] Paul Rogers commented on DRILL-5073: Also occurs in {{TestLocalExchange}}. > Memory a

[jira] [Created] (DRILL-5075) Tests complain about Parquet metadata parse errors in Drill-created files

2016-11-27 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5075: -- Summary: Tests complain about Parquet metadata parse errors in Drill-created files Key: DRILL-5075 URL: https://issues.apache.org/jira/browse/DRILL-5075 Project: Apache D

[jira] [Updated] (DRILL-5073) Memory allocation failure in test DrillSeparatePlanningTest.testPlanning

2016-11-27 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5073: --- Description: Run the test {{DrillSeparatePlanningTest.testPlanning}}. (Or, run the whole {{DrillSepar

[jira] [Created] (DRILL-5076) Provide sources, Javadoc for Drill-private forks of Parquet, etc.

2016-11-27 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5076: -- Summary: Provide sources, Javadoc for Drill-private forks of Parquet, etc. Key: DRILL-5076 URL: https://issues.apache.org/jira/browse/DRILL-5076 Project: Apache Drill

[jira] [Commented] (DRILL-5076) Provide sources, Javadoc for Drill-private forks of Parquet, etc.

2016-11-27 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700772#comment-15700772 ] Paul Rogers commented on DRILL-5076: Thanks! And thanks for hosting the jar files. I

[jira] [Comment Edited] (DRILL-5073) Memory allocation failure in test DrillSeparatePlanningTest.testPlanning

2016-11-27 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700592#comment-15700592 ] Paul Rogers edited comment on DRILL-5073 at 11/28/16 4:48 AM: --

[jira] [Updated] (DRILL-5070) Code gen: create methods in fixed order to allow test verification

2016-11-28 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5070: --- Summary: Code gen: create methods in fixed order to allow test verification (was: Code cache compares

[jira] [Issue Comment Deleted] (DRILL-5070) Code gen: create methods in fixed order to allow test verification

2016-11-28 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5070: --- Comment: was deleted (was: Analysis of impact. Method order is random. If a generated class has n met

[jira] [Updated] (DRILL-5070) Code gen: create methods in fixed order to allow test verification

2016-11-28 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5070: --- Description: A handy technique in testing is to compare generated code against a "golden" copy that d

[jira] [Created] (DRILL-5080) Create a memory-managed version of the External Sort operator

2016-11-28 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5080: -- Summary: Create a memory-managed version of the External Sort operator Key: DRILL-5080 URL: https://issues.apache.org/jira/browse/DRILL-5080 Project: Apache Drill

[jira] [Updated] (DRILL-5080) Create a memory-managed version of the External Sort operator

2016-11-28 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5080: --- Attachment: ManagedExternalSortDesign.pdf Design document for the managed external sort operator. Plea

[jira] [Updated] (DRILL-5066) External sort attempts to retry sv2 memory alloc, even if can never succeed

2016-11-28 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5066: --- Issue Type: Sub-task (was: Bug) Parent: DRILL-5080 > External sort attempts to retry sv2 memo

[jira] [Updated] (DRILL-5008) Refactor, document and simplify ExternalSortBatch

2016-11-28 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5008: --- Issue Type: Sub-task (was: Improvement) Parent: DRILL-5080 > Refactor, document and simplify

[jira] [Updated] (DRILL-5014) ExternalSortBatch cache size, spill count differs from config setting

2016-11-28 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5014: --- Issue Type: Sub-task (was: Bug) Parent: DRILL-5080 > ExternalSortBatch cache size, spill coun

[jira] [Updated] (DRILL-5020) ExternalSortBatch has inconsistent notions of the memory limit

2016-11-28 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers updated DRILL-5020: --- Issue Type: Sub-task (was: Bug) Parent: DRILL-5080 > ExternalSortBatch has inconsistent notio

<    1   2   3   4   5   6   7   8   9   10   >