[jira] [Reopened] (SPARK-17997) Aggregation function for counting distinct values for multiple intervals

2017-09-21 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-17997: - Assignee: Zhenhua Wang > Aggregation function for counting distinct values for multiple interva

[jira] [Resolved] (SPARK-22090) There is no need for fileStatusCache to invalidateAll when InMemoryFileIndex refresh

2017-09-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22090. --- Resolution: Duplicate > There is no need for fileStatusCache to invalidateAll when InMemoryFileIndex

[jira] [Created] (SPARK-22091) There is no need for fileStatusCache to invalidateAll when InMemoryFileIndex refresh

2017-09-21 Thread guichaoxian (JIRA)
guichaoxian created SPARK-22091: --- Summary: There is no need for fileStatusCache to invalidateAll when InMemoryFileIndex refresh Key: SPARK-22091 URL: https://issues.apache.org/jira/browse/SPARK-22091

[jira] [Created] (SPARK-22090) There is no need for fileStatusCache to invalidateAll when InMemoryFileIndex refresh

2017-09-21 Thread guichaoxian (JIRA)
guichaoxian created SPARK-22090: --- Summary: There is no need for fileStatusCache to invalidateAll when InMemoryFileIndex refresh Key: SPARK-22090 URL: https://issues.apache.org/jira/browse/SPARK-22090

[jira] [Created] (SPARK-22089) There is no need for fileStatusCache to invalidateAll when InMemoryFileIndex refresh

2017-09-21 Thread guichaoxian (JIRA)
guichaoxian created SPARK-22089: --- Summary: There is no need for fileStatusCache to invalidateAll when InMemoryFileIndex refresh Key: SPARK-22089 URL: https://issues.apache.org/jira/browse/SPARK-22089

[jira] [Commented] (SPARK-22034) CrossValidator's training and testing set with different set of labels, resulting in encoder transform error

2017-09-21 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174729#comment-16174729 ] Weichen Xu commented on SPARK-22034: Do you mean a pipeline including stage VectorInd

[jira] [Commented] (SPARK-16845) org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB

2017-09-21 Thread Marco Veluscek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174727#comment-16174727 ] Marco Veluscek commented on SPARK-16845: Hello, I have just encountered a simila

[jira] [Commented] (SPARK-19141) VectorAssembler metadata causing memory issues

2017-09-21 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174685#comment-16174685 ] Weichen Xu commented on SPARK-19141: Maybe we need design a sparse format of Attribut

[jira] [Comment Edited] (SPARK-18727) Support schema evolution as new files are inserted into table

2017-09-21 Thread Serge Smertin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174660#comment-16174660 ] Serge Smertin edited comment on SPARK-18727 at 9/21/17 12:31 PM: --

[jira] [Commented] (SPARK-18727) Support schema evolution as new files are inserted into table

2017-09-21 Thread Serge Smertin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174660#comment-16174660 ] Serge Smertin commented on SPARK-18727: --- in one of the use-cases for project in [#c

[jira] [Commented] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-21 Thread Artem Kupchinskiy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174642#comment-16174642 ] Artem Kupchinskiy commented on SPARK-21418: --- There is still a place in FileSour

[jira] [Updated] (SPARK-21777) Simpler Dataset.sample API

2017-09-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-21777: - Fix Version/s: 2.3.0 > Simpler Dataset.sample API > -- > >

[jira] [Resolved] (SPARK-21777) Simpler Dataset.sample API

2017-09-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21777. -- Resolution: Done > Simpler Dataset.sample API > -- > >

[jira] [Assigned] (SPARK-21780) Simpler Dataset.sample API in R

2017-09-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21780: Assignee: Hyukjin Kwon > Simpler Dataset.sample API in R > ---

[jira] [Resolved] (SPARK-21780) Simpler Dataset.sample API in R

2017-09-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21780. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19243 [https://git

[jira] [Assigned] (SPARK-22087) Clear remaining compile errors for 2.12; resolve most warnings

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22087: Assignee: Apache Spark (was: Sean Owen) > Clear remaining compile errors for 2.12; resolv

[jira] [Assigned] (SPARK-22087) Clear remaining compile errors for 2.12; resolve most warnings

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22087: Assignee: Sean Owen (was: Apache Spark) > Clear remaining compile errors for 2.12; resolv

[jira] [Assigned] (SPARK-14650) Compile Spark REPL for Scala 2.12

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14650: Assignee: (was: Apache Spark) > Compile Spark REPL for Scala 2.12 > --

[jira] [Commented] (SPARK-22087) Clear remaining compile errors for 2.12; resolve most warnings

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174570#comment-16174570 ] Apache Spark commented on SPARK-22087: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-14650) Compile Spark REPL for Scala 2.12

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14650: Assignee: Apache Spark > Compile Spark REPL for Scala 2.12 > -

[jira] [Commented] (SPARK-14650) Compile Spark REPL for Scala 2.12

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174571#comment-16174571 ] Apache Spark commented on SPARK-14650: -- User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-21977) SinglePartition optimizations break certain Streaming Stateful Aggregation requirements

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174562#comment-16174562 ] Apache Spark commented on SPARK-21977: -- User 'srowen' has created a pull request for

[jira] [Updated] (SPARK-22061) Add pipeline model of SVM

2017-09-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22061: -- Target Version/s: (was: 2.3.0) Labels: (was: features) Fix Version/s: (was:

[jira] [Updated] (SPARK-22087) Clear remaining compile errors for 2.12; resolve most warnings

2017-09-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22087: -- Description: In the course of finishing SPARK-14650 I found there are still some compile problems and

[jira] [Assigned] (SPARK-22088) Incorrect scalastyle comment causes wrong styles in stringExpressions

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22088: Assignee: (was: Apache Spark) > Incorrect scalastyle comment causes wrong styles in st

[jira] [Assigned] (SPARK-22088) Incorrect scalastyle comment causes wrong styles in stringExpressions

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22088: Assignee: Apache Spark > Incorrect scalastyle comment causes wrong styles in stringExpress

[jira] [Commented] (SPARK-22088) Incorrect scalastyle comment causes wrong styles in stringExpressions

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174531#comment-16174531 ] Apache Spark commented on SPARK-22088: -- User 'viirya' has created a pull request for

[jira] [Created] (SPARK-22088) Incorrect scalastyle comment causes wrong styles in stringExpressions

2017-09-21 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-22088: --- Summary: Incorrect scalastyle comment causes wrong styles in stringExpressions Key: SPARK-22088 URL: https://issues.apache.org/jira/browse/SPARK-22088 Project:

[jira] [Created] (SPARK-22087) Clear remaining compile errors for 2.12; resolve most warnings

2017-09-21 Thread Sean Owen (JIRA)
Sean Owen created SPARK-22087: - Summary: Clear remaining compile errors for 2.12; resolve most warnings Key: SPARK-22087 URL: https://issues.apache.org/jira/browse/SPARK-22087 Project: Spark Iss

[jira] [Comment Edited] (SPARK-21653) Complement SQL expression document

2017-09-21 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174514#comment-16174514 ] Liang-Chi Hsieh edited comment on SPARK-21653 at 9/21/17 9:55 AM: -

[jira] [Commented] (SPARK-21653) Complement SQL expression document

2017-09-21 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174514#comment-16174514 ] Liang-Chi Hsieh commented on SPARK-21653: - I just go through all SQL expressions.

[jira] [Commented] (SPARK-22086) Add expression description for CASE WHEN

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174512#comment-16174512 ] Apache Spark commented on SPARK-22086: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-22086) Add expression description for CASE WHEN

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22086: Assignee: (was: Apache Spark) > Add expression description for CASE WHEN > ---

[jira] [Assigned] (SPARK-22086) Add expression description for CASE WHEN

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22086: Assignee: Apache Spark > Add expression description for CASE WHEN > --

[jira] [Updated] (SPARK-22086) Add expression description for CASE WHEN

2017-09-21 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-22086: Issue Type: Sub-task (was: Documentation) Parent: SPARK-21653 > Add expression des

[jira] [Created] (SPARK-22086) Add expression description for CASE WHEN

2017-09-21 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-22086: --- Summary: Add expression description for CASE WHEN Key: SPARK-22086 URL: https://issues.apache.org/jira/browse/SPARK-22086 Project: Spark Issue Type: Do

[jira] [Commented] (SPARK-22081) Generalized Reduced Error Logistic Regression

2017-09-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174410#comment-16174410 ] Sean Owen commented on SPARK-22081: --- I don't believe this would be added by request. Yo

[jira] [Assigned] (SPARK-22085) When the applicationhas no core left,do not request more executors from the cluster manager in ExecutorAllocationManager

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22085: Assignee: Apache Spark > When the applicationhas no core left,do not request more executor

[jira] [Assigned] (SPARK-22085) When the applicationhas no core left,do not request more executors from the cluster manager in ExecutorAllocationManager

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22085: Assignee: (was: Apache Spark) > When the applicationhas no core left,do not request mo

[jira] [Commented] (SPARK-22085) When the applicationhas no core left,do not request more executors from the cluster manager in ExecutorAllocationManager

2017-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174404#comment-16174404 ] Apache Spark commented on SPARK-22085: -- User '10110346' has created a pull request f

[jira] [Updated] (SPARK-22058) the BufferedInputStream will not be closed if an exception occurs

2017-09-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22058: -- Priority: Trivial (was: Minor) > the BufferedInputStream will not be closed if an exception occurs > -

[jira] [Created] (SPARK-22085) When the applicationhas no core left,do not request more executors from the cluster manager in ExecutorAllocationManager

2017-09-21 Thread liuxian (JIRA)
liuxian created SPARK-22085: --- Summary: When the applicationhas no core left,do not request more executors from the cluster manager in ExecutorAllocationManager Key: SPARK-22085 URL: https://issues.apache.org/jira/brows

<    1   2