[jira] [Commented] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576700#comment-16576700 ] Thomas Graves commented on SPARK-25081: --- thanks, wanted to clarify since the description only

[jira] [Created] (SPARK-25089) remove lintr checks for 2.0 and 2.1

2018-08-10 Thread shane knapp (JIRA)
shane knapp created SPARK-25089: --- Summary: remove lintr checks for 2.0 and 2.1 Key: SPARK-25089 URL: https://issues.apache.org/jira/browse/SPARK-25089 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards

2018-08-10 Thread Parth Gandhi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576467#comment-16576467 ] Parth Gandhi commented on SPARK-24935: -- [~cloud_fan] [~lian cheng], What do you think of my

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-08-10 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576559#comment-16576559 ] Liang-Chi Hsieh commented on SPARK-24152: - I checked locally. Seems fine, I don't see the error

[jira] [Assigned] (SPARK-25089) remove lintr checks for 2.0 and 2.1

2018-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25089: Assignee: Apache Spark (was: shane knapp) > remove lintr checks for 2.0 and 2.1 >

[jira] [Commented] (SPARK-25089) remove lintr checks for 2.0 and 2.1

2018-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576819#comment-16576819 ] Apache Spark commented on SPARK-25089: -- User 'shaneknapp' has created a pull request for this

[jira] [Commented] (SPARK-25089) remove lintr checks for 2.0 and 2.1

2018-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576820#comment-16576820 ] Apache Spark commented on SPARK-25089: -- User 'shaneknapp' has created a pull request for this

[jira] [Assigned] (SPARK-25089) remove lintr checks for 2.0 and 2.1

2018-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25089: Assignee: shane knapp (was: Apache Spark) > remove lintr checks for 2.0 and 2.1 >

[jira] [Issue Comment Deleted] (SPARK-25089) remove lintr checks for 2.0 and 2.1

2018-08-10 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-25089: Comment: was deleted (was: https://github.com/apache/spark/pull/22073

[jira] [Commented] (SPARK-25089) remove lintr checks for 2.0 and 2.1

2018-08-10 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576821#comment-16576821 ] shane knapp commented on SPARK-25089: - https://github.com/apache/spark/pull/22073

[jira] [Updated] (SPARK-25089) remove lintr checks for 2.0 and 2.1

2018-08-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25089: -- Priority: Minor (was: Major) > remove lintr checks for 2.0 and 2.1 >

[jira] [Created] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

2018-08-10 Thread Mark Morrisson (JIRA)
Mark Morrisson created SPARK-25090: -- Summary: java.lang.ClassCastException when using a CrossValidator Key: SPARK-25090 URL: https://issues.apache.org/jira/browse/SPARK-25090 Project: Spark

[jira] [Commented] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576724#comment-16576724 ] Apache Spark commented on SPARK-25081: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results

2018-08-10 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576709#comment-16576709 ] Thomas Graves commented on SPARK-23298: --- [~mjukiewicz] have you tried spark with fix for

[jira] [Commented] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

2018-08-10 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576711#comment-16576711 ] Yuming Wang commented on SPARK-25085: - I'm working on this. > Insert overwrite a non-partitioned

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-08-10 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576862#comment-16576862 ] Liang-Chi Hsieh commented on SPARK-24152: - I found retriggered test still failed. I found out

[jira] [Updated] (SPARK-24908) [R] remove spaces to make lintr happy

2018-08-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24908: -- Fix Version/s: 2.4.0 2.3.2 > [R] remove spaces to make lintr happy >

[jira] [Resolved] (SPARK-25089) remove lintr checks for 2.0 and 2.1

2018-08-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25089. --- Resolution: Fixed Fix Version/s: 2.0.3 2.1.4 Issue resolved by pull

[jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25081: - Fix Version/s: 2.4.0 2.3.2 > Nested spill in ShuffleExternalSorter may

[jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25081: - Affects Version/s: 2.3.0 > Nested spill in ShuffleExternalSorter may access a released memory

[jira] [Commented] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576636#comment-16576636 ] Shixiong Zhu commented on SPARK-25081: -- That's possible. That's why I added the "corrnectness"

[jira] [Comment Edited] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-10 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576417#comment-16576417 ] yucai edited comment on SPARK-25084 at 8/10/18 3:17 PM: [~smilegator],

[jira] [Commented] (SPARK-25087) update/port all builds to run on ubuntu 16.04 LTS

2018-08-10 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576470#comment-16576470 ] shane knapp commented on SPARK-25087: - been in progress jan-mar and may-present.  more details

[jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25081: - Affects Version/s: 1.6.3 2.0.2 2.1.3

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-10 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576417#comment-16576417 ] yucai commented on SPARK-25084: --- [~smilegator][~jerryshao] Thanks a lot for marking it blocker. A lot of

[jira] [Created] (SPARK-25087) update/port all builds to run on ubuntu 16.04 LTS

2018-08-10 Thread shane knapp (JIRA)
shane knapp created SPARK-25087: --- Summary: update/port all builds to run on ubuntu 16.04 LTS Key: SPARK-25087 URL: https://issues.apache.org/jira/browse/SPARK-25087 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-08-10 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576559#comment-16576559 ] Liang-Chi Hsieh edited comment on SPARK-24152 at 8/10/18 4:53 PM: -- I

[jira] [Created] (SPARK-25086) Incorrect Default Value For "escape" For CSV Files

2018-08-10 Thread David Wilcox (JIRA)
David Wilcox created SPARK-25086: Summary: Incorrect Default Value For "escape" For CSV Files Key: SPARK-25086 URL: https://issues.apache.org/jira/browse/SPARK-25086 Project: Spark Issue

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-08-10 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576491#comment-16576491 ] Liang-Chi Hsieh commented on SPARK-24152: - Sorry just see this. I will ask CRAN sysadmin again.

[jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25081: - Fix Version/s: (was: 2.3.2) 2.3.3 > Nested spill in

[jira] [Commented] (SPARK-10816) EventTime based sessionization

2018-08-10 Thread Mike Sukmanowsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576503#comment-16576503 ] Mike Sukmanowsky commented on SPARK-10816: -- Voted, but want to express that we're definitely

[jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25081: - Affects Version/s: 2.3.2 > Nested spill in ShuffleExternalSorter may access a released memory

[jira] [Created] (SPARK-25088) Rest Server default & doc updates

2018-08-10 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-25088: Summary: Rest Server default & doc updates Key: SPARK-25088 URL: https://issues.apache.org/jira/browse/SPARK-25088 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-25066) Provide Spark R image for deploying Spark on kubernetes.

2018-08-10 Thread Yinan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576555#comment-16576555 ] Yinan Li commented on SPARK-25066: -- R support is still being worked on and will likely go into 2.4. Is

[jira] [Commented] (SPARK-25051) where clause on dataset gives AnalysisException

2018-08-10 Thread MIK (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576576#comment-16576576 ] MIK commented on SPARK-25051: - Any update on this issue ? thanks. > where clause on dataset gives

[jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25081: - Affects Version/s: 1.6.2 > Nested spill in ShuffleExternalSorter may access a released memory

[jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25081: - Priority: Blocker (was: Major) > Nested spill in ShuffleExternalSorter may access a released

[jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25081: - Affects Version/s: 1.6.0 1.6.1 2.0.0

[jira] [Resolved] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-25081. -- Resolution: Fixed > Nested spill in ShuffleExternalSorter may access a released memory page

[jira] [Assigned] (SPARK-25088) Rest Server default & doc updates

2018-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25088: Assignee: Apache Spark (was: Imran Rashid) > Rest Server default & doc updates >

[jira] [Commented] (SPARK-25088) Rest Server default & doc updates

2018-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576537#comment-16576537 ] Apache Spark commented on SPARK-25088: -- User 'squito' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25088) Rest Server default & doc updates

2018-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25088: Assignee: Imran Rashid (was: Apache Spark) > Rest Server default & doc updates >

[jira] [Commented] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers

2018-08-10 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577041#comment-16577041 ] Bruce Robbins commented on SPARK-23207: --- I can help out here. I will make a PR for branch-2.2 in

[jira] [Commented] (SPARK-22236) CSV I/O: does not respect RFC 4180

2018-08-10 Thread Joe Pallas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577063#comment-16577063 ] Joe Pallas commented on SPARK-22236: One can always repartition after reading, and if the input is

[jira] [Commented] (SPARK-25079) [PYTHON] upgrade python 3.4 -> 3.5

2018-08-10 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576720#comment-16576720 ] shane knapp commented on SPARK-25079: - holding off on this until after the 2.4 cut. testing here:

[jira] [Commented] (SPARK-24908) [R] remove spaces to make lintr happy

2018-08-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576780#comment-16576780 ] Sean Owen commented on SPARK-24908: --- Resolved by https://github.com/apache/spark/pull/21864 > [R]

[jira] [Resolved] (SPARK-20919) Simplification of CachedKafkaConsumer.

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-20919. -- Resolution: Duplicate > Simplification of CachedKafkaConsumer. >

[jira] [Updated] (SPARK-24699) Watermark / Append mode should work with Trigger.Once

2018-08-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-24699: - Fix Version/s: 2.4.0 > Watermark / Append mode should work with Trigger.Once >

[jira] [Comment Edited] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110)

2018-08-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575966#comment-16575966 ] Hyukjin Kwon edited comment on SPARK-25080 at 8/10/18 8:51 AM: --- Can you

[jira] [Commented] (SPARK-25071) BuildSide is coming not as expected with join queries

2018-08-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575963#comment-16575963 ] Hyukjin Kwon commented on SPARK-25071: -- cc [~ZenWzh] > BuildSide is coming not as expected with

[jira] [Commented] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110)

2018-08-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575966#comment-16575966 ] Hyukjin Kwon commented on SPARK-25080: -- Can you provide input / output / code / expected output? >

[jira] [Commented] (SPARK-25072) PySpark custom Row class can be given extra parameters

2018-08-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575980#comment-16575980 ] Hyukjin Kwon commented on SPARK-25072: -- >From a cursory look, we should add a check in {code} def

[jira] [Assigned] (SPARK-24127) Support text socket source in continuous mode

2018-08-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-24127: Assignee: Arun Mahadevan > Support text socket source in continuous mode >

[jira] [Resolved] (SPARK-24127) Support text socket source in continuous mode

2018-08-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24127. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21199

[jira] [Commented] (SPARK-25060) PySpark UDF in case statement is always run

2018-08-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575953#comment-16575953 ] Hyukjin Kwon commented on SPARK-25060: -- If the issue describes conditional execution for Python

[jira] [Resolved] (SPARK-19355) Use map output statistices to improve global limit's parallelism

2018-08-10 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19355. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.4.0 >

[jira] [Created] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

2018-08-10 Thread Rui Li (JIRA)
Rui Li created SPARK-25085: -- Summary: Insert overwrite a non-partitioned table can delete table folder Key: SPARK-25085 URL: https://issues.apache.org/jira/browse/SPARK-25085 Project: Spark Issue

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-10 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575791#comment-16575791 ] Xiao Li commented on SPARK-25084: - Could you investigate which PR introduced this bug? What is the error

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-10 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575790#comment-16575790 ] Xiao Li commented on SPARK-25084: - Let us mark it as a blocker. How about the master branch? Does it

[jira] [Updated] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-10 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25084: Priority: Blocker (was: Major) > "distribute by" on multiple columns may lead to codegen issue >

[jira] [Updated] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-10 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-25084: -- Description: Test Query: {code:java} select * from store_sales distribute by (ss_sold_time_sk, ss_item_sk,

[jira] [Updated] (SPARK-25067) Active tasks does not match the total cores of an executor in WebUI

2018-08-10 Thread StanZhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] StanZhai updated SPARK-25067: - Attachment: WX20180810-144212.png > Active tasks does not match the total cores of an executor in WebUI

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575856#comment-16575856 ] Apache Spark commented on SPARK-25084: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-10 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575860#comment-16575860 ] Lantao Jin commented on SPARK-25084: I offer other fix way.

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-10 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575808#comment-16575808 ] yucai commented on SPARK-25084: --- It is a regression, when the generated codes size is more than 1024,

[jira] [Updated] (SPARK-25067) Active tasks does not match the total cores of an executor in WebUI

2018-08-10 Thread StanZhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] StanZhai updated SPARK-25067: - Summary: Active tasks does not match the total cores of an executor in WebUI (was: Active tasks exceed

[jira] [Reopened] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-08-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-24152: -- Reopening this since the same thing happens again {code} * checking CRAN incoming feasibility

[jira] [Commented] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-10 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576234#comment-16576234 ] Thomas Graves commented on SPARK-25081: --- Does this ever result in the task reading the wrong data

[jira] [Updated] (SPARK-24555) logNumExamples in KMeans/BiKM/GMM/AFT/NB

2018-08-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24555: -- Priority: Minor (was: Major) > logNumExamples in KMeans/BiKM/GMM/AFT/NB >

[jira] [Updated] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt

2018-08-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25036: -- Affects Version/s: (was: 2.3.0) Target Version/s: 2.4.0 Fix Version/s: (was: