[jira] [Created] (DRILL-5236) Need more detail on specifying list of directories for spilling

2017-01-31 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5236: --- Summary: Need more detail on specifying list of directories for spilling Key: DRILL-5236 URL: https://issues.apache.org/jira/browse/DRILL-5236 Project: Apache Drill

[jira] [Updated] (DRILL-5080) Create a memory-managed version of the External Sort operator

2017-02-06 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5080: Labels: ready-to-commit (was: ) > Create a memory-managed version of the External Sort operator >

[jira] [Commented] (DRILL-5288) JSON data not read as string when store.json.all_text_mode=true

2017-02-22 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878974#comment-15878974 ] Boaz Ben-Zvi commented on DRILL-5288: - This query fails even without the "all text: setting; maybe the

[jira] [Created] (DRILL-5293) Poor performance of Hash Table due to same hash value as distribution below

2017-02-22 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5293: --- Summary: Poor performance of Hash Table due to same hash value as distribution below Key: DRILL-5293 URL: https://issues.apache.org/jira/browse/DRILL-5293 Project:

[jira] [Commented] (DRILL-5293) Poor performance of Hash Table due to same hash value as distribution below

2017-02-22 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879781#comment-15879781 ] Boaz Ben-Zvi commented on DRILL-5293: - Yes, seems like a good idea (and the MurmurHash3 does a proper

[jira] [Updated] (DRILL-5284) Roll-up of final fixes for managed sort

2017-02-28 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5284: Labels: ready-to-commit (was: ) > Roll-up of final fixes for managed sort >

[jira] [Commented] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-02 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459314#comment-15459314 ] Boaz Ben-Zvi commented on DRILL-3898: - Testing further 1.8 in embedded - the NPE shows up when

[jira] [Updated] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-02 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-3898: Attachment: sqlline_3898.ver_1_8.log Log from 1.8 on embedded, with limited spill space (note no

[jira] [Commented] (DRILL-4872) NPE from CTAS partitioned by a projected casted null

2016-09-02 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459987#comment-15459987 ] Boaz Ben-Zvi commented on DRILL-4872: - And the NPE error can be recreated with the same data as in

[jira] [Commented] (DRILL-4872) NPE from CTAS partitioned by a projected casted null

2016-09-02 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459977#comment-15459977 ] Boaz Ben-Zvi commented on DRILL-4872: - Likely related - notice the similarity: below is the stack from

[jira] [Commented] (DRILL-4872) NPE from CTAS partitioned by a projected casted null

2016-09-02 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459989#comment-15459989 ] Boaz Ben-Zvi commented on DRILL-4872: - Likely related ... > NPE from CTAS partitioned by a projected

[jira] [Updated] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-01 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-3898: Affects Version/s: 1.8.0 Summary: No space error during external sort does not cancel

[jira] [Comment Edited] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-01 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456799#comment-15456799 ] Boaz Ben-Zvi edited comment on DRILL-3898 at 9/1/16 10:42 PM: -- When testing

[jira] [Updated] (DRILL-4872) NPE from CTAS partitioned by a projected casted null

2016-09-01 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-4872: Description: Extracted from DRILL-3898 : Running the same test case on a smaller table (

[jira] [Commented] (DRILL-3898) NPE during external sort when there is not enough space for spilling

2016-09-01 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456799#comment-15456799 ] Boaz Ben-Zvi commented on DRILL-3898: - When testing in embedded, on a smaller TPCDS SF1, only the NPE

[jira] [Created] (DRILL-4872) NPE from CTAS partitioned by a projected casted null

2016-09-01 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-4872: --- Summary: NPE from CTAS partitioned by a projected casted null Key: DRILL-4872 URL: https://issues.apache.org/jira/browse/DRILL-4872 Project: Apache Drill

[jira] [Comment Edited] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497761#comment-15497761 ] Boaz Ben-Zvi edited comment on DRILL-3898 at 9/17/16 12:04 AM: --- The code in

[jira] [Comment Edited] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497761#comment-15497761 ] Boaz Ben-Zvi edited comment on DRILL-3898 at 9/16/16 11:54 PM: --- The code in

[jira] [Commented] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497761#comment-15497761 ] Boaz Ben-Zvi commented on DRILL-3898: - The code in the above comment should be (Jira does not let me

[jira] [Comment Edited] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497761#comment-15497761 ] Boaz Ben-Zvi edited comment on DRILL-3898 at 9/16/16 11:55 PM: --- The code in

[jira] [Comment Edited] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497761#comment-15497761 ] Boaz Ben-Zvi edited comment on DRILL-3898 at 9/17/16 12:01 AM: --- The code in

[jira] [Comment Edited] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497761#comment-15497761 ] Boaz Ben-Zvi edited comment on DRILL-3898 at 9/17/16 12:02 AM: --- The code in

[jira] [Comment Edited] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497761#comment-15497761 ] Boaz Ben-Zvi edited comment on DRILL-3898 at 9/16/16 11:56 PM: --- The code in

[jira] [Resolved] (DRILL-3898) No space error during external sort does not cancel the query

2016-09-19 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi resolved DRILL-3898. - Resolution: Fixed Fix Version/s: (was: Future) 1.9.0 Commit ID:

[jira] [Created] (DRILL-4896) After a failed CTAS, the table both exists and does not exist

2016-09-19 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-4896: --- Summary: After a failed CTAS, the table both exists and does not exist Key: DRILL-4896 URL: https://issues.apache.org/jira/browse/DRILL-4896 Project: Apache Drill

[jira] [Created] (DRILL-4904) NPE from backquoted LIKE argument

2016-09-23 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-4904: --- Summary: NPE from backquoted LIKE argument Key: DRILL-4904 URL: https://issues.apache.org/jira/browse/DRILL-4904 Project: Apache Drill Issue Type: Bug

[jira] [Closed] (DRILL-4542) if external sort fails to spill to disk, memory is leaked and wrong error message is displayed

2016-09-22 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi closed DRILL-4542. --- Resolution: Duplicate Fix Version/s: 1.9.0 Exactly the same as DRILL-3898 > if external sort

[jira] [Created] (DRILL-4921) Scripts drill_config.sh, drillbit.sh, and drill-embedded fail when accessed via a symbolic link

2016-09-30 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-4921: --- Summary: Scripts drill_config.sh, drillbit.sh, and drill-embedded fail when accessed via a symbolic link Key: DRILL-4921 URL: https://issues.apache.org/jira/browse/DRILL-4921

[jira] [Commented] (DRILL-4921) Scripts drill_config.sh, drillbit.sh, and drill-embedded fail when accessed via a symbolic link

2016-09-30 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537059#comment-15537059 ] Boaz Ben-Zvi commented on DRILL-4921: - To save some time/effort: maybe this work can be lumped

[jira] [Created] (DRILL-4960) Wrong columns after scanning Json files where some files have missing columns

2016-10-24 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-4960: --- Summary: Wrong columns after scanning Json files where some files have missing columns Key: DRILL-4960 URL: https://issues.apache.org/jira/browse/DRILL-4960 Project:

[jira] [Created] (DRILL-4961) Schema change error due to a missing column in a Json file

2016-10-24 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-4961: --- Summary: Schema change error due to a missing column in a Json file Key: DRILL-4961 URL: https://issues.apache.org/jira/browse/DRILL-4961 Project: Apache Drill

[jira] [Commented] (DRILL-4954) allTextMode in the MapRDB plugin always return nulls

2016-10-20 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592496#comment-15592496 ] Boaz Ben-Zvi commented on DRILL-4954: - PR624 : Here is my pull request:

[jira] [Created] (DRILL-4954) allTextMode in the MapRDB plugin always return nulls

2016-10-20 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-4954: --- Summary: allTextMode in the MapRDB plugin always return nulls Key: DRILL-4954 URL: https://issues.apache.org/jira/browse/DRILL-4954 Project: Apache Drill

[jira] [Updated] (DRILL-4921) Scripts drill_config.sh, drillbit.sh, and drill-embedded fail when accessed via a symbolic link

2016-10-20 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-4921: Assignee: Smidth Panchamia (was: Paul Rogers) > Scripts drill_config.sh, drillbit.sh, and

[jira] [Assigned] (DRILL-4921) Scripts drill_config.sh, drillbit.sh, and drill-embedded fail when accessed via a symbolic link

2016-10-20 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi reassigned DRILL-4921: --- Assignee: Boaz Ben-Zvi (was: Smidth Panchamia) > Scripts drill_config.sh, drillbit.sh, and

[jira] [Updated] (DRILL-5056) UserException does not write full message to log

2016-11-21 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5056: Assignee: Paul Rogers (was: Boaz Ben-Zvi) > UserException does not write full message to log >

[jira] [Updated] (DRILL-5058) External sort does not handle its own UserExceptions

2016-11-21 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5058: Assignee: Paul Rogers (was: Boaz Ben-Zvi) > External sort does not handle its own UserExceptions >

[jira] [Updated] (DRILL-4946) org.objectweb.asm.tree.analysis.AnalyzerException printed to console in embedded mode

2016-11-18 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-4946: Assignee: Chunhui Shi (was: Boaz Ben-Zvi) > org.objectweb.asm.tree.analysis.AnalyzerException

[jira] [Created] (DRILL-4993) Documentation: Wrong output displayed for convert_from() with a map

2016-11-02 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-4993: --- Summary: Documentation: Wrong output displayed for convert_from() with a map Key: DRILL-4993 URL: https://issues.apache.org/jira/browse/DRILL-4993 Project: Apache

[jira] [Updated] (DRILL-5352) Extend test framework profile parser printer for multi-fragment queries

2017-03-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5352: Labels: ready-to-commit (was: ) > Extend test framework profile parser printer for multi-fragment

[jira] [Updated] (DRILL-5385) Vector serializer fails to read saved SV2

2017-04-04 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5385: Labels: ready-to-commit (was: ) > Vector serializer fails to read saved SV2 >

[jira] [Updated] (DRILL-5234) External sort's spilling functionality does not work when the spilled columns contains a map type column

2017-04-04 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5234: Labels: ready-to-commit (was: ) > External sort's spilling functionality does not work when the

[jira] [Updated] (DRILL-5226) External Sort encountered an error while spilling to disk

2017-03-03 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5226: Labels: ready-to-commit (was: ) > External Sort encountered an error while spilling to disk >

[jira] [Commented] (DRILL-5327) Hash aggregate can return empty batch which can cause schema change exception

2017-03-07 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900405#comment-15900405 ] Boaz Ben-Zvi commented on DRILL-5327: - DRILL-5293 has only exposed this existing bug (e.g., seen

[jira] [Updated] (DRILL-5442) Managed Sort: IndexOutOfBounds with a join over an inlist

2017-04-18 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5442: Description: The following query fails with IOOB when a managed sort is used, but passes with the

[jira] [Created] (DRILL-5442) Managed Sort: IndexOutOfBounds with a join over an inlist

2017-04-18 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5442: --- Summary: Managed Sort: IndexOutOfBounds with a join over an inlist Key: DRILL-5442 URL: https://issues.apache.org/jira/browse/DRILL-5442 Project: Apache Drill

[jira] [Commented] (DRILL-5588) Hash Aggregate: Avoid copy on output of aggregate columns

2017-08-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129749#comment-16129749 ] Boaz Ben-Zvi commented on DRILL-5588: - For AVG(), the division does not take place in the Hash-Agg

[jira] [Commented] (DRILL-5588) Hash Aggregate: Avoid copy on output of aggregate columns

2017-08-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129792#comment-16129792 ] Boaz Ben-Zvi commented on DRILL-5588: - For decimal data types, the internal value columns are not just

[jira] [Commented] (DRILL-5588) Hash Aggregate: Avoid copy on output of aggregate columns

2017-08-16 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129752#comment-16129752 ] Boaz Ben-Zvi commented on DRILL-5588: - Another point is the location of the "value" value vectors

[jira] [Updated] (DRILL-5665) planner.force_2phase.aggr Set to TRUE for HashAgg may cause wrong results for VARIANCE and STD_DEV

2017-07-11 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5665: Reviewer: Paul Rogers > planner.force_2phase.aggr Set to TRUE for HashAgg may cause wrong results

[jira] [Created] (DRILL-5665) planner.force_2phase.aggr Set to TRUE for HashAgg may cause wrong results for VARIANCE and STD_DEV

2017-07-07 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5665: --- Summary: planner.force_2phase.aggr Set to TRUE for HashAgg may cause wrong results for VARIANCE and STD_DEV Key: DRILL-5665 URL: https://issues.apache.org/jira/browse/DRILL-5665

[jira] [Commented] (DRILL-5665) planner.force_2phase.aggr Set to TRUE for HashAgg may cause wrong results for VARIANCE and STD_DEV

2017-07-07 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078907#comment-16078907 ] Boaz Ben-Zvi commented on DRILL-5665: - Two phase aggregation can only work when the aggregation

[jira] [Commented] (DRILL-5669) Multiple TPCH queries failed due to OOM

2017-07-12 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16085064#comment-16085064 ] Boaz Ben-Zvi commented on DRILL-5669: - Hash Agg does not currently follow this 20MB initial

[jira] [Updated] (DRILL-5665) planner.force_2phase.aggr Set to TRUE for HashAgg may cause wrong results for VARIANCE and STD_DEV

2017-07-11 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5665: Reviewer: Aman Sinha (was: Paul Rogers) > planner.force_2phase.aggr Set to TRUE for HashAgg may

[jira] [Reopened] (DRILL-5616) Hash Agg Spill: OOM while reading irregular varchar data

2017-07-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi reopened DRILL-5616: - > Hash Agg Spill: OOM while reading irregular varchar data >

[jira] [Updated] (DRILL-5616) Hash Agg Spill: OOM while reading irregular varchar data

2017-07-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5616: Labels: ready-to-commit (was: ) > Hash Agg Spill: OOM while reading irregular varchar data >

[jira] [Updated] (DRILL-5669) Multiple TPCH queries failed due to OOM

2017-07-18 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5669: Remaining Estimate: 72h Original Estimate: 72h Reviewer: Paul Rogers > Multiple

[jira] [Updated] (DRILL-5665) planner.force_2phase.aggr Set to TRUE for HashAgg may cause wrong results for VARIANCE and STD_DEV

2017-07-18 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5665: Labels: ready-to-commit (was: ) Remaining Estimate: 48h Original Estimate: 48h

[jira] [Updated] (DRILL-5669) Multiple TPCH queries failed due to OOM

2017-07-18 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5669: Labels: ready-to-commit (was: ) > Multiple TPCH queries failed due to OOM >

[jira] [Created] (DRILL-5616) Hash Agg Spill: OOM while reading irregular varchar data

2017-06-28 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5616: --- Summary: Hash Agg Spill: OOM while reading irregular varchar data Key: DRILL-5616 URL: https://issues.apache.org/jira/browse/DRILL-5616 Project: Apache Drill

[jira] [Commented] (DRILL-5616) Hash Agg Spill: OOM while reading irregular varchar data

2017-06-28 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067407#comment-16067407 ] Boaz Ben-Zvi commented on DRILL-5616: - More detail about the above failure: {code} Unable to allocate

[jira] [Updated] (DRILL-5616) Hash Agg Spill: OOM while reading irregular varchar data

2017-06-28 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5616: Description: An OOM while aggregating a table of two varchar columns where sizes vary

[jira] [Commented] (DRILL-5616) Hash Agg Spill: OOM while reading irregular varchar data

2017-06-28 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067409#comment-16067409 ] Boaz Ben-Zvi commented on DRILL-5616: - Here is what likely caused the OOM – an internal doubling of

[jira] [Commented] (DRILL-5616) Hash Agg Spill: OOM while reading irregular varchar data

2017-06-28 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067410#comment-16067410 ] Boaz Ben-Zvi commented on DRILL-5616: - Another possible solution: Increase the frequency of memory

[jira] [Created] (DRILL-5446) Offset Vector in VariableLengthVectors may waste up to 256KB per value vector

2017-04-26 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5446: --- Summary: Offset Vector in VariableLengthVectors may waste up to 256KB per value vector Key: DRILL-5446 URL: https://issues.apache.org/jira/browse/DRILL-5446 Project:

[jira] [Updated] (DRILL-5385) Vector serializer fails to read saved SV2

2017-04-28 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5385: Labels: ready-to-commit (was: ) > Vector serializer fails to read saved SV2 >

[jira] [Updated] (DRILL-5344) External sort priority queue copier fails with an empty batch

2017-04-27 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5344: Labels: ready-to-commit (was: ) > External sort priority queue copier fails with an empty batch >

[jira] [Updated] (DRILL-5728) Hash Aggregate: Useless bigint value vector in the values batch

2017-08-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5728: Description: When aggregating a non-nullable column (like *sum(l_partkey)* below), the code

[jira] [Updated] (DRILL-5728) Hash Aggregate: Useless bigint value vector in the values batch

2017-08-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5728: Description: When aggregating a non-nullable column (like *sum(l_partkey)* below), the code

[jira] [Commented] (DRILL-5728) Hash Aggregate: Useless bigint value vector in the values batch

2017-08-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131488#comment-16131488 ] Boaz Ben-Zvi commented on DRILL-5728: - This Jira has some relation to DRILL-5588 -- we'd need to

[jira] [Created] (DRILL-5728) Hash Aggregate: Useless bigint value vector in the values batch

2017-08-17 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5728: --- Summary: Hash Aggregate: Useless bigint value vector in the values batch Key: DRILL-5728 URL: https://issues.apache.org/jira/browse/DRILL-5728 Project: Apache Drill

[jira] [Commented] (DRILL-5728) Hash Aggregate: Useless bigint value vector in the values batch

2017-08-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131478#comment-16131478 ] Boaz Ben-Zvi commented on DRILL-5728: - Similar code is used when the underlying value column is

[jira] [Updated] (DRILL-5728) Hash Aggregate: Useless bigint value vector in the values batch

2017-08-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5728: Description: When aggregating a non-nullable column (like *sum(l_partkey)* below), the code

[jira] [Commented] (DRILL-5588) Hash Aggregate: Avoid copy on output of aggregate columns

2017-08-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131486#comment-16131486 ] Boaz Ben-Zvi commented on DRILL-5588: - See DRILL-5728 : The generated code allocates a special bigint

[jira] [Updated] (DRILL-5728) Hash Aggregate: Useless bigint value vector in the values batch

2017-08-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5728: Description: When aggregating a non-nullable column (like *sum(l_partkey)* below), the code

[jira] [Updated] (DRILL-5728) Hash Aggregate: Useless bigint value vector in the values batch

2017-08-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5728: Description: When aggregating a non-nullable column (like *sum(l_partkey)* below), the code

[jira] [Updated] (DRILL-5728) Hash Aggregate: Useless bigint value vector in the values batch

2017-08-17 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5728: Description: When aggregating a non-nullable column (like *sum(l_partkey)* below), the code

[jira] [Commented] (DRILL-5694) hash agg spill to disk, second phase OOM

2017-08-22 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137752#comment-16137752 ] Boaz Ben-Zvi commented on DRILL-5694: - Managed to recreate in embedded mode, but the failure shows

[jira] [Updated] (DRILL-5457) Support Spill to Disk for the Hash Aggregate Operator

2017-06-19 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5457: Labels: ready-to-commit (was: ) > Support Spill to Disk for the Hash Aggregate Operator >

[jira] [Created] (DRILL-5588) Hash Aggregate: Avoid copy on output of aggregate columns

2017-06-14 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5588: --- Summary: Hash Aggregate: Avoid copy on output of aggregate columns Key: DRILL-5588 URL: https://issues.apache.org/jira/browse/DRILL-5588 Project: Apache Drill

[jira] [Updated] (DRILL-5457) Support Spill to Disk for the Hash Aggregate Operator

2017-06-15 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5457: Labels: ready-to-commit (was: ) Reviewer: Paul Rogers > Support Spill to Disk for the Hash

[jira] [Created] (DRILL-5457) Support Spill to Disk for the Hash Aggregate Operator

2017-05-01 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5457: --- Summary: Support Spill to Disk for the Hash Aggregate Operator Key: DRILL-5457 URL: https://issues.apache.org/jira/browse/DRILL-5457 Project: Apache Drill

[jira] [Commented] (DRILL-5808) Reduce memory allocator strictness for "managed" operators

2017-09-20 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173659#comment-16173659 ] Boaz Ben-Zvi commented on DRILL-5808: - Implementing a dynamic system of memory "quotas" would work

[jira] [Resolved] (DRILL-5740) hash agg fail to read spill file

2017-09-20 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi resolved DRILL-5740. - Resolution: Fixed Fix Version/s: 1.12.0 The commit for DRILL-5694 (PR #938) also solves

[jira] [Updated] (DRILL-5694) hash agg spill to disk, second phase OOM

2017-09-20 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5694: Labels: ready-to-commit (was: ) > hash agg spill to disk, second phase OOM >

[jira] [Resolved] (DRILL-5715) Performance of refactored HashAgg operator regressed

2017-09-20 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi resolved DRILL-5715. - Resolution: Fixed Reviewer: Paul Rogers The commit for DRILL-5694 (PR #938) also solves

[jira] [Created] (DRILL-5852) Display the "memory per query per node" in the query's profile

2017-10-06 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5852: --- Summary: Display the "memory per query per node" in the query's profile Key: DRILL-5852 URL: https://issues.apache.org/jira/browse/DRILL-5852 Project: Apache Drill

[jira] [Updated] (DRILL-5694) hash agg spill to disk, second phase OOM

2017-09-08 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5694: Reviewer: Paul Rogers > hash agg spill to disk, second phase OOM >

[jira] [Updated] (DRILL-5755) TOP_N_SORT operator does not free memory while running

2017-08-30 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5755: Attachment: 2658c253-20b6-db90-362a-139aae4a327e.sys.drill > TOP_N_SORT operator does not free

[jira] [Created] (DRILL-5755) TOP_N_SORT operator does not free memory while running

2017-08-30 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5755: --- Summary: TOP_N_SORT operator does not free memory while running Key: DRILL-5755 URL: https://issues.apache.org/jira/browse/DRILL-5755 Project: Apache Drill

[jira] [Created] (DRILL-5824) 1st phase Hash Aggregate allocates more memory than the limit

2017-09-28 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5824: --- Summary: 1st phase Hash Aggregate allocates more memory than the limit Key: DRILL-5824 URL: https://issues.apache.org/jira/browse/DRILL-5824 Project: Apache Drill

[jira] [Commented] (DRILL-5824) 1st phase Hash Aggregate allocates more memory than the limit

2017-09-28 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184913#comment-16184913 ] Boaz Ben-Zvi commented on DRILL-5824: - The problem seems to be in the 1st phase Hash Aggr – this

[jira] [Commented] (DRILL-5740) hash agg fail to read spill file

2017-08-25 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142545#comment-16142545 ] Boaz Ben-Zvi commented on DRILL-5740: - [~paul-rogers] and I brainstormed and have a good guess of the

[jira] [Assigned] (DRILL-5740) hash agg fail to read spill file

2017-08-25 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi reassigned DRILL-5740: --- Assignee: Paul Rogers (was: Boaz Ben-Zvi) > hash agg fail to read spill file >

[jira] [Comment Edited] (DRILL-5889) sqlline loses RPC connection

2017-10-18 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210261#comment-16210261 ] Boaz Ben-Zvi edited comment on DRILL-5889 at 10/18/17 11:53 PM: The latest

[jira] [Commented] (DRILL-5898) Query returns columns in the wrong order

2017-10-23 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215933#comment-16215933 ] Boaz Ben-Zvi commented on DRILL-5898: - The actual results look more correct than the expected results

[jira] [Commented] (DRILL-5889) sqlline loses RPC connection

2017-10-18 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210261#comment-16210261 ] Boaz Ben-Zvi commented on DRILL-5889: - The latest time in the attached log is 2017-10-18 14:00:55,598

[jira] [Created] (DRILL-5935) Hash Join projects unneeded columns

2017-11-06 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5935: --- Summary: Hash Join projects unneeded columns Key: DRILL-5935 URL: https://issues.apache.org/jira/browse/DRILL-5935 Project: Apache Drill Issue Type: Bug

[jira] [Updated] (DRILL-5935) Hash Join projects unneeded columns

2017-11-06 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boaz Ben-Zvi updated DRILL-5935: Attachment: 26045873-f26c-8417-3f13-4e74af1f2317.sys.drill > Hash Join projects unneeded columns >

[jira] [Commented] (DRILL-5922) Intermittent Memory Leaks in the ROOT allocator

2017-11-02 Thread Boaz Ben-Zvi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236653#comment-16236653 ] Boaz Ben-Zvi commented on DRILL-5922: - Isn't the QueryContext.close() is actually invoked as an

  1   2   3   4   >