[jira] [Resolved] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes

2018-09-08 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-25021. - Resolution: Fixed Fix Version/s: 3.0.0 Merged for 3 - open to the discussion around backporting.

[jira] [Assigned] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes

2018-09-08 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reassigned SPARK-25021: --- Assignee: Ilan Filonenko > Add spark.executor.pyspark.memory support to Kubernetes >

[jira] [Commented] (SPARK-25072) PySpark custom Row class can be given extra parameters

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608293#comment-16608293 ] Apache Spark commented on SPARK-25072: -- User 'xuanyuanking' has created a pull request for this

[jira] [Commented] (SPARK-25072) PySpark custom Row class can be given extra parameters

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608292#comment-16608292 ] Apache Spark commented on SPARK-25072: -- User 'xuanyuanking' has created a pull request for this

[jira] [Commented] (SPARK-25368) Incorrect predicate pushdown returns wrong result

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608291#comment-16608291 ] Apache Spark commented on SPARK-25368: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-25368) Incorrect predicate pushdown returns wrong result

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608290#comment-16608290 ] Apache Spark commented on SPARK-25368: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25368) Incorrect predicate pushdown returns wrong result

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25368: Assignee: (was: Apache Spark) > Incorrect predicate pushdown returns wrong result >

[jira] [Assigned] (SPARK-25368) Incorrect predicate pushdown returns wrong result

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25368: Assignee: Apache Spark > Incorrect predicate pushdown returns wrong result >

[jira] [Updated] (SPARK-23880) table cache should be lazy and don't trigger any job

2018-09-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23880: Summary: table cache should be lazy and don't trigger any job (was: table cache should be lazy and don't

[jira] [Commented] (SPARK-25378) ArrayData.toArray assume UTF8String

2018-09-08 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608256#comment-16608256 ] Liang-Chi Hsieh commented on SPARK-25378: - Thanks for pinging me. I agreed with [~hvanhovell].

[jira] [Commented] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608217#comment-16608217 ] Apache Spark commented on SPARK-17916: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-25241) Configurable empty values when reading/writing CSV files

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608216#comment-16608216 ] Apache Spark commented on SPARK-25241: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608215#comment-16608215 ] Apache Spark commented on SPARK-17916: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608189#comment-16608189 ] Apache Spark commented on SPARK-25384: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608188#comment-16608188 ] Apache Spark commented on SPARK-25384: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25384: Assignee: Apache Spark > Removing spark.sql.fromJsonForceNullableSchema >

[jira] [Commented] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608187#comment-16608187 ] Apache Spark commented on SPARK-25384: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25384: Assignee: (was: Apache Spark) > Removing spark.sql.fromJsonForceNullableSchema >

[jira] [Created] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema

2018-09-08 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-25384: -- Summary: Removing spark.sql.fromJsonForceNullableSchema Key: SPARK-25384 URL: https://issues.apache.org/jira/browse/SPARK-25384 Project: Spark Issue Type:

[jira] [Commented] (SPARK-25378) ArrayData.toArray assume UTF8String

2018-09-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608171#comment-16608171 ] Xiangrui Meng commented on SPARK-25378: --- Btw, thanks for suggesting the right way to get strings

[jira] [Resolved] (SPARK-25375) Reenable qualified perm. function checks in UDFSuite

2018-09-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25375. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.4.0 > Reenable qualified

[jira] [Resolved] (SPARK-20636) Eliminate unnecessary shuffle with adjacent Window expressions

2018-09-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20636. - Resolution: Fixed Fix Version/s: 3.0.0 > Eliminate unnecessary shuffle with adjacent Window

[jira] [Assigned] (SPARK-20636) Eliminate unnecessary shuffle with adjacent Window expressions

2018-09-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20636: --- Assignee: Michael Styles (was: Apache Spark) > Eliminate unnecessary shuffle with adjacent Window

[jira] [Commented] (SPARK-23243) Shuffle+Repartition on an RDD could lead to incorrect answers

2018-09-08 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608169#comment-16608169 ] Bruce Robbins commented on SPARK-23243: --- BTW, I took a stab at back porting it to 2.2, but to get

[jira] [Commented] (SPARK-23243) Shuffle+Repartition on an RDD could lead to incorrect answers

2018-09-08 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608167#comment-16608167 ] Bruce Robbins commented on SPARK-23243: --- Any plans to back port this to 2.2? >

[jira] [Commented] (SPARK-25378) ArrayData.toArray assume UTF8String

2018-09-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608165#comment-16608165 ] Xiangrui Meng commented on SPARK-25378: --- This is a breaking change anyway. The error comes from

[jira] [Commented] (SPARK-25378) ArrayData.toArray assume UTF8String

2018-09-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608122#comment-16608122 ] Herman van Hovell commented on SPARK-25378: --- I think this particular use is wrong.

[jira] [Commented] (SPARK-25381) Stratified sampling by Column argument

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608109#comment-16608109 ] Apache Spark commented on SPARK-25381: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25381) Stratified sampling by Column argument

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25381: Assignee: (was: Apache Spark) > Stratified sampling by Column argument >

[jira] [Commented] (SPARK-25381) Stratified sampling by Column argument

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608108#comment-16608108 ] Apache Spark commented on SPARK-25381: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25381) Stratified sampling by Column argument

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25381: Assignee: Apache Spark > Stratified sampling by Column argument >

[jira] [Updated] (SPARK-25382) Remove ImageSchema.readImages in 3.0

2018-09-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25382: -- Description: A follow-up task from SPARK-25345. We might need to support sampling

[jira] [Created] (SPARK-25383) Image data source supports sample pushdown

2018-09-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-25383: - Summary: Image data source supports sample pushdown Key: SPARK-25383 URL: https://issues.apache.org/jira/browse/SPARK-25383 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-25345) Deprecate readImages APIs from ImageSchema

2018-09-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25345: -- Description: After SPARK-22666, we can deprecate the public APIs in ImageSchema

[jira] [Created] (SPARK-25382) Remove ImageSchema.readImages in 3.0

2018-09-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-25382: - Summary: Remove ImageSchema.readImages in 3.0 Key: SPARK-25382 URL: https://issues.apache.org/jira/browse/SPARK-25382 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-25345) Deprecate readImages APIs from ImageSchema

2018-09-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25345: -- Summary: Deprecate readImages APIs from ImageSchema (was: Deprecate public APIs from

[jira] [Assigned] (SPARK-25345) Deprecate public APIs from ImageSchema

2018-09-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-25345: - Assignee: Weichen Xu > Deprecate public APIs from ImageSchema >

[jira] [Resolved] (SPARK-25345) Deprecate public APIs from ImageSchema

2018-09-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-25345. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22349

[jira] [Created] (SPARK-25381) Stratified sampling by Column argument

2018-09-08 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-25381: -- Summary: Stratified sampling by Column argument Key: SPARK-25381 URL: https://issues.apache.org/jira/browse/SPARK-25381 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-25378) ArrayData.toArray assume UTF8String

2018-09-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608092#comment-16608092 ] Xiangrui Meng commented on SPARK-25378: --- Seems caused by SPARK-23875. cc: [~viirya] [~hvanhovell]

[jira] [Commented] (SPARK-25368) Incorrect predicate pushdown returns wrong result

2018-09-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608079#comment-16608079 ] Yuming Wang commented on SPARK-25368: - I think the root cause is

[jira] [Commented] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

2018-09-08 Thread Michael Spector (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608047#comment-16608047 ] Michael Spector commented on SPARK-23670: - Reported: SPARK-25380 > Memory leak of

[jira] [Commented] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

2018-09-08 Thread Michael Spector (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608045#comment-16608045 ] Michael Spector commented on SPARK-25380: - Originally reported in SPARK-23670   > Generated

[jira] [Created] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

2018-09-08 Thread Michael Spector (JIRA)
Michael Spector created SPARK-25380: --- Summary: Generated plans occupy over 50% of Spark driver memory Key: SPARK-25380 URL: https://issues.apache.org/jira/browse/SPARK-25380 Project: Spark

[jira] [Updated] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

2018-09-08 Thread Michael Spector (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Spector updated SPARK-25380: Attachment: Screen Shot 2018-09-06 at 23.19.56.png > Generated plans occupy over 50% of

[jira] [Updated] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

2018-09-08 Thread Michael Spector (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Spector updated SPARK-25380: Attachment: heapdump_OOM.png > Generated plans occupy over 50% of Spark driver memory >

[jira] [Commented] (SPARK-25368) Incorrect predicate pushdown returns wrong result

2018-09-08 Thread Lev Katzav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608030#comment-16608030 ] Lev Katzav commented on SPARK-25368: [~yumwang] yes, the code worked as expected on the master

[jira] [Commented] (SPARK-25368) Incorrect predicate pushdown returns wrong result

2018-09-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608013#comment-16608013 ] Yuming Wang commented on SPARK-25368: - Can you try master, You provided test case can passed since 

[jira] [Assigned] (SPARK-25379) Improve ColumnPruning performance

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25379: Assignee: (was: Apache Spark) > Improve ColumnPruning performance >

[jira] [Commented] (SPARK-25379) Improve ColumnPruning performance

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607975#comment-16607975 ] Apache Spark commented on SPARK-25379: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Commented] (SPARK-25379) Improve ColumnPruning performance

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607977#comment-16607977 ] Apache Spark commented on SPARK-25379: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25379) Improve ColumnPruning performance

2018-09-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25379: Assignee: Apache Spark > Improve ColumnPruning performance >

[jira] [Commented] (SPARK-25091) UNCACHE TABLE, CLEAR CACHE, rdd.unpersist() does not clean up executor memory

2018-09-08 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607970#comment-16607970 ] Liang-Chi Hsieh commented on SPARK-25091: - I think this is duplicate to SPARK-24889. > UNCACHE

[jira] [Updated] (SPARK-25379) Improve ColumnPruning performance

2018-09-08 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-25379: Description: The {{--}} operation on {{AttributeSet}} is quite expensive, especially where many

[jira] [Created] (SPARK-25379) Improve ColumnPruning performance

2018-09-08 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-25379: --- Summary: Improve ColumnPruning performance Key: SPARK-25379 URL: https://issues.apache.org/jira/browse/SPARK-25379 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-25378) ArrayData.toArray assume UTF8String

2018-09-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-25378: - Summary: ArrayData.toArray assume UTF8String Key: SPARK-25378 URL: https://issues.apache.org/jira/browse/SPARK-25378 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-25377) spark sql dataframe cache is invalid

2018-09-08 Thread Iverson Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iverson Hu updated SPARK-25377: --- Description:   When I use SQL dataframe in application, I found that dataframe.cache is invalid,

[jira] [Created] (SPARK-25377) spark sql dataframe cache is invalid

2018-09-08 Thread Iverson Hu (JIRA)
Iverson Hu created SPARK-25377: -- Summary: spark sql dataframe cache is invalid Key: SPARK-25377 URL: https://issues.apache.org/jira/browse/SPARK-25377 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-25376) Scenarios we should handle but missed in 2.4 for barrier execution mode

2018-09-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25376: -- Summary: Scenarios we should handle but missed in 2.4 for barrier execution mode (was:

[jira] [Updated] (SPARK-25376) Scenarios we should handle but missed for barrier execution mode

2018-09-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25376: -- Description: [~irashid] You mentioned that there are couple scenarios we should handle in