[jira] [Updated] (SPARK-20806) Launcher: redundant check for Spark lib dir

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20806: -- Summary: Launcher: redundant check for Spark lib dir (was: Launcher:redundant code,invalid branch of

[jira] [Updated] (SPARK-20806) Launcher:redundant code,invalid branch of judgment

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20806: -- Priority: Trivial (was: Major) Issue Type: Improvement (was: Bug) > Launcher:redundant

[jira] [Commented] (SPARK-20808) External Table unnecessarily not create in Hive-compatible way

2017-05-19 Thread Joachim Hereth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017108#comment-16017108 ] Joachim Hereth commented on SPARK-20808: The warning is caused by an Exeption raised by a call to

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-05-19 Thread Antoine PRANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017120#comment-16017120 ] Antoine PRANG commented on SPARK-18838: --- [~joshrosen] I uploaded the timings I get. I put some

[jira] [Assigned] (SPARK-20807) Add compression/decompression of data to ColumnVector

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20807: Assignee: (was: Apache Spark) > Add compression/decompression of data to ColumnVector

[jira] [Assigned] (SPARK-20807) Add compression/decompression of data to ColumnVector

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20807: Assignee: Apache Spark > Add compression/decompression of data to ColumnVector >

[jira] [Updated] (SPARK-20808) External Table unnecessarily not created in Hive-compatible way

2017-05-19 Thread Joachim Hereth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joachim Hereth updated SPARK-20808: --- Summary: External Table unnecessarily not created in Hive-compatible way (was: External

[jira] [Updated] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-20810: Description: Fitting with SVM classification model on the same dataset, ML {{LinearSVC}} produces

[jira] [Updated] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-20810: Description: Fitting with SVM classification model on the same dataset, ML {{LinearSVC}} produces

[jira] [Assigned] (SPARK-17875) Remove unneeded direct dependence on Netty 3.x

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-17875: - Assignee: (was: Sean Owen) Target Version/s: 3.0.0 At least, we can fix this in

[jira] [Commented] (SPARK-20797) mllib lda's LocalLDAModel's save: out of memory.

2017-05-19 Thread d0evi1 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017128#comment-16017128 ] d0evi1 commented on SPARK-20797: ok, there is: https://github.com/apache/spark/pull/18034 > mllib lda's

[jira] [Commented] (SPARK-20797) mllib lda's LocalLDAModel's save: out of memory.

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017127#comment-16017127 ] Apache Spark commented on SPARK-20797: -- User 'd0evi1' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20797) mllib lda's LocalLDAModel's save: out of memory.

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20797: Assignee: (was: Apache Spark) > mllib lda's LocalLDAModel's save: out of memory. >

[jira] [Commented] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017217#comment-16017217 ] Yanbo Liang commented on SPARK-20810: - cc [~josephkb] [~yuhaoyan] > ML LinearSVC vs MLlib SVMWithSGD

[jira] [Comment Edited] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017300#comment-16017300 ] Yanbo Liang edited comment on SPARK-20810 at 5/19/17 12:02 PM: --- [~srowen]

[jira] [Comment Edited] (SPARK-20806) Launcher:redundant code,invalid branch of judgment

2017-05-19 Thread Phoenix_Dad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017041#comment-16017041 ] Phoenix_Dad edited comment on SPARK-20806 at 5/19/17 8:08 AM: -- [~srowen] the

[jira] [Comment Edited] (SPARK-20806) Launcher:redundant code,invalid branch of judgment

2017-05-19 Thread Phoenix_Dad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017041#comment-16017041 ] Phoenix_Dad edited comment on SPARK-20806 at 5/19/17 8:09 AM: -- [~srowen] the

[jira] [Assigned] (SPARK-20806) Launcher: redundant check for Spark lib dir

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20806: Assignee: (was: Apache Spark) > Launcher: redundant check for Spark lib dir >

[jira] [Commented] (SPARK-20806) Launcher: redundant check for Spark lib dir

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017049#comment-16017049 ] Apache Spark commented on SPARK-20806: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20797) mllib lda's LocalLDAModel's save: out of memory.

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20797: Assignee: Apache Spark > mllib lda's LocalLDAModel's save: out of memory. >

[jira] [Commented] (SPARK-20807) Add compression/decompression of data to ColumnVector

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017154#comment-16017154 ] Apache Spark commented on SPARK-20807: -- User 'kiszk' has created a pull request for this issue:

[jira] [Commented] (SPARK-16365) Ideas for moving "mllib-local" forward

2017-05-19 Thread Cristian Opris (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017192#comment-16017192 ] Cristian Opris commented on SPARK-16365: There's another potential argument for exposing 'local'

[jira] [Updated] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-20810: Description: Fitting with SVM classification model on the same dataset, ML {{LinearSVC}} produces

[jira] [Updated] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-20810: Description: Fitting with SVM classification model on the same dataset, ML {{LinearSVC}} produces

[jira] [Commented] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017300#comment-16017300 ] Yanbo Liang commented on SPARK-20810: - [~srowen] Thanks for your comments. I'm sure both are

[jira] [Assigned] (SPARK-20806) Launcher: redundant check for Spark lib dir

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20806: Assignee: Apache Spark > Launcher: redundant check for Spark lib dir >

[jira] [Updated] (SPARK-18838) High latency of event processing for large jobs

2017-05-19 Thread Antoine PRANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine PRANG updated SPARK-18838: -- Attachment: SparkListernerComputeTime.xlsx execution trace > High latency of event processing

[jira] [Created] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-20810: --- Summary: ML LinearSVC vs MLlib SVMWithSGD output different solution Key: SPARK-20810 URL: https://issues.apache.org/jira/browse/SPARK-20810 Project: Spark

[jira] [Commented] (SPARK-20799) Unable to infer schema for ORC on reading ORC from S3

2017-05-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017258#comment-16017258 ] Steve Loughran commented on SPARK-20799: bq. Spark does output the S3xLoginHelper:90 - The

[jira] [Commented] (SPARK-19569) could not get APP ID and cause failed to connect to spark driver on yarn-client mode

2017-05-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017066#comment-16017066 ] Saisai Shao commented on SPARK-19569: - [~ouyangxc.zte] In you above code you directly call

[jira] [Reopened] (SPARK-20806) Launcher:redundant code,invalid branch of judgment

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-20806: --- OK, I get it. That should be in the description. > Launcher:redundant code,invalid branch of judgment >

[jira] [Commented] (SPARK-17875) Remove unneeded direct dependence on Netty 3.x

2017-05-19 Thread Morten Hornbech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017059#comment-16017059 ] Morten Hornbech commented on SPARK-17875: - Sorry, I have now. If the class files are indeed in

[jira] [Created] (SPARK-20809) PySpark: Java heap space issue despite apparently being within memory limits

2017-05-19 Thread James Porritt (JIRA)
James Porritt created SPARK-20809: - Summary: PySpark: Java heap space issue despite apparently being within memory limits Key: SPARK-20809 URL: https://issues.apache.org/jira/browse/SPARK-20809

[jira] [Updated] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-20810: Description: Fitting with SVM classification model on the same dataset, ML {{LinearSVC}} produces

[jira] [Resolved] (SPARK-20798) GenerateUnsafeProjection should check if value is null before calling the getter

2017-05-19 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20798. --- Resolution: Fixed Assignee: Ala Luszczak Fix Version/s: 2.2.0

[jira] [Created] (SPARK-20807) Add compression/decompression of data to ColumnVector

2017-05-19 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-20807: Summary: Add compression/decompression of data to ColumnVector Key: SPARK-20807 URL: https://issues.apache.org/jira/browse/SPARK-20807 Project: Spark

[jira] [Commented] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017273#comment-16017273 ] Sean Owen commented on SPARK-20810: --- Are you pretty sure both are converged? You set the same params

[jira] [Commented] (SPARK-20799) Unable to infer schema for ORC on reading ORC from S3

2017-05-19 Thread Jork Zijlstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017278#comment-16017278 ] Jork Zijlstra commented on SPARK-20799: --- Hi Steve, Thanks for the quick response. We indeed don't

[jira] [Created] (SPARK-20808) External Table unnecessarily not create in Hive-compatible way

2017-05-19 Thread Joachim Hereth (JIRA)
Joachim Hereth created SPARK-20808: -- Summary: External Table unnecessarily not create in Hive-compatible way Key: SPARK-20808 URL: https://issues.apache.org/jira/browse/SPARK-20808 Project: Spark

[jira] [Updated] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-20810: Description: Fitting with SVM classification model on the same dataset, ML {{LinearSVC}} produces

[jira] [Updated] (SPARK-20810) ML LinearSVC vs MLlib SVMWithSGD output different solution

2017-05-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-20810: Description: Fitting with SVM classification model on the same dataset, ML {{LinearSVC}} produces

[jira] [Commented] (SPARK-20811) GBT Classifier failed with mysterious StackOverflowError

2017-05-19 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018246#comment-16018246 ] Nan Zhu commented on SPARK-20811: - thanks, let me try it > GBT Classifier failed with mysterious

[jira] [Commented] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

2017-05-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018300#comment-16018300 ] Felix Cheung commented on SPARK-20815: -- make sense to me. would you like to contribute the fix? >

[jira] [Commented] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

2017-05-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018313#comment-16018313 ] Felix Cheung commented on SPARK-18825: -- I see about dontrun - yes, I don't think we could remove

[jira] [Comment Edited] (SPARK-20805) updated updateP in SVD++ is error

2017-05-19 Thread BoLing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018315#comment-16018315 ] BoLing edited comment on SPARK-20805 at 5/20/17 4:31 AM: - hi, @Sean Owen, you can

[jira] [Commented] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

2017-05-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018314#comment-16018314 ] Felix Cheung commented on SPARK-18825: -- handling a fork of knitr might be too hard to maintain,

[jira] [Commented] (SPARK-20805) updated updateP in SVD++ is error

2017-05-19 Thread BoLing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018315#comment-16018315 ] BoLing commented on SPARK-20805: hi, Sean Owen, you can see this url

[jira] [Commented] (SPARK-20751) Built-in SQL Function Support - COT

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018321#comment-16018321 ] Apache Spark commented on SPARK-20751: -- User 'wangyum' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-20805) updated updateP in SVD++ is error

2017-05-19 Thread BoLing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018315#comment-16018315 ] BoLing edited comment on SPARK-20805 at 5/20/17 4:32 AM: - hi, Sean Owen, you can

[jira] [Commented] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

2017-05-19 Thread James Shuster (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018326#comment-16018326 ] James Shuster commented on SPARK-20815: --- I have a fix in the works, just adding a test case and

[jira] [Created] (SPARK-20816) MetricsConfig doen't trim the properties file cause the exception very confused

2017-05-19 Thread Lantao Jin (JIRA)
Lantao Jin created SPARK-20816: -- Summary: MetricsConfig doen't trim the properties file cause the exception very confused Key: SPARK-20816 URL: https://issues.apache.org/jira/browse/SPARK-20816

[jira] [Commented] (SPARK-20805) updated updateP in SVD++ is error

2017-05-19 Thread BoLing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018329#comment-16018329 ] BoLing commented on SPARK-20805: hi, Sean Owen, you can see this url

[jira] [Issue Comment Deleted] (SPARK-20805) updated updateP in SVD++ is error

2017-05-19 Thread BoLing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BoLing updated SPARK-20805: --- Comment: was deleted (was: hi, Sean Owen, you can see this url

[jira] [Commented] (SPARK-20752) Build-in SQL Function Support - SQRT

2017-05-19 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018330#comment-16018330 ] Kazuaki Ishizaki commented on SPARK-20752: -- I am working on this > Build-in SQL Function

[jira] [Updated] (SPARK-20727) Skip SparkR tests when missing Hadoop winutils on CRAN windows machines

2017-05-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20727: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > Skip SparkR tests when missing

[jira] [Assigned] (SPARK-20759) SCALA_VERSION in _config.yml,LICENSE and Dockerfile should be consistent with pom.xml

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20759: - Assignee: liuzhaokun Priority: Trivial (was: Minor) > SCALA_VERSION in _config.yml,LICENSE

[jira] [Updated] (SPARK-17922) ClassCastException java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator cannot be cast to org.apache.spark.sql.cataly

2017-05-19 Thread Artur Sukhenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artur Sukhenko updated SPARK-17922: --- Affects Version/s: 2.0.1 > ClassCastException java.lang.ClassCastException: >

[jira] [Resolved] (SPARK-20773) ParquetWriteSupport.writeFields is quadratic in number of fields

2017-05-19 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20773. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.2 >

[jira] [Resolved] (SPARK-20759) SCALA_VERSION in _config.yml,LICENSE and Dockerfile should be consistent with pom.xml

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20759. --- Resolution: Fixed Fix Version/s: 2.1.2 2.2.0 Issue resolved by pull

[jira] [Assigned] (SPARK-20607) Add new unit tests to ShuffleSuite

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20607: - Assignee: caoxuewen Priority: Trivial (was: Minor) > Add new unit tests to ShuffleSuite >

[jira] [Resolved] (SPARK-20607) Add new unit tests to ShuffleSuite

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20607. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 17868

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-05-19 Thread Mathieu D (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017528#comment-16017528 ] Mathieu D commented on SPARK-18838: --- I'm not very familiar with this part of Spark, but I'd like to

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-05-19 Thread Antoine PRANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017560#comment-16017560 ] Antoine PRANG commented on SPARK-18838: --- [~mathieude]]: Yep, I introduced a blocking strategy for

[jira] [Created] (SPARK-20811) GBT Classifier failed with mysterious StackOverflowException

2017-05-19 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-20811: --- Summary: GBT Classifier failed with mysterious StackOverflowException Key: SPARK-20811 URL: https://issues.apache.org/jira/browse/SPARK-20811 Project: Spark Issue

[jira] [Updated] (SPARK-20811) GBT Classifier failed with mysterious StackOverflowError

2017-05-19 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-20811: Summary: GBT Classifier failed with mysterious StackOverflowError (was: GBT Classifier failed with

[jira] [Commented] (SPARK-20811) GBT Classifier failed with mysterious StackOverflowError

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017660#comment-16017660 ] Sean Owen commented on SPARK-20811: --- I assume it's serialization of a very deep tree via the Java

[jira] [Assigned] (SPARK-20751) Built-in SQL Function Support - COT

2017-05-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20751: --- Assignee: Yuming Wang > Built-in SQL Function Support - COT > --- >

[jira] [Resolved] (SPARK-20751) Built-in SQL Function Support - COT

2017-05-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20751. - Resolution: Fixed Fix Version/s: 2.3.0 > Built-in SQL Function Support - COT >

[jira] [Comment Edited] (SPARK-18838) High latency of event processing for large jobs

2017-05-19 Thread Antoine PRANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017560#comment-16017560 ] Antoine PRANG edited comment on SPARK-18838 at 5/19/17 3:39 PM:

[jira] [Reopened] (SPARK-12139) REGEX Column Specification for Hive Queries

2017-05-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-12139: - > REGEX Column Specification for Hive Queries > --- > >

[jira] [Created] (SPARK-20812) Add Mesos Secrets support to the spark dispatcher

2017-05-19 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-20812: --- Summary: Add Mesos Secrets support to the spark dispatcher Key: SPARK-20812 URL: https://issues.apache.org/jira/browse/SPARK-20812 Project: Spark

[jira] [Updated] (SPARK-20512) SparkR 2.2 QA: Programming guide, migration guide, vignettes updates

2017-05-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20512: -- Description: Before the release, we need to update the SparkR Programming Guide, its

[jira] [Updated] (SPARK-20813) Web UI executor page tab search by status not working

2017-05-19 Thread Jong Yoon Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jong Yoon Lee updated SPARK-20813: -- Summary: Web UI executor page tab search by status not working (was: executor page search

[jira] [Comment Edited] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

2017-05-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017817#comment-16017817 ] Maciej Szymkiewicz edited comment on SPARK-18825 at 5/19/17 6:42 PM: -

[jira] [Assigned] (SPARK-12139) REGEX Column Specification for Hive Queries

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12139: Assignee: (was: Apache Spark) > REGEX Column Specification for Hive Queries >

[jira] [Updated] (SPARK-20812) Add Mesos Secrets support to the spark dispatcher

2017-05-19 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-20812: Description: Mesos 1.3 supports secrets. In order to support sending keytabs through the

[jira] [Assigned] (SPARK-12139) REGEX Column Specification for Hive Queries

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12139: Assignee: Apache Spark > REGEX Column Specification for Hive Queries >

[jira] [Updated] (SPARK-20763) The function of `month` and `day` return a value which is not we expected

2017-05-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20763: Fix Version/s: (was: 2.3.0) > The function of `month` and `day` return a value which is not we

[jira] [Resolved] (SPARK-20763) The function of `month` and `day` return a value which is not we expected

2017-05-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20763. - Resolution: Fixed Assignee: liuxian Fix Version/s: 2.3.0 2.2.0 > The

[jira] [Updated] (SPARK-20512) SparkR 2.2 QA: Programming guide, migration guide, vignettes updates

2017-05-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20512: -- Description: Before the release, we need to update the SparkR Programming Guide, its

[jira] [Created] (SPARK-20813) executor page search by status not working

2017-05-19 Thread Jong Yoon Lee (JIRA)
Jong Yoon Lee created SPARK-20813: - Summary: executor page search by status not working Key: SPARK-20813 URL: https://issues.apache.org/jira/browse/SPARK-20813 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-20506) ML, Graph 2.2 QA: Programming guide update and migration guide

2017-05-19 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-20506. Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17996

[jira] [Commented] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

2017-05-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017699#comment-16017699 ] Felix Cheung commented on SPARK-18825: -- interesting - do you think knitr can take your change for

[jira] [Commented] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

2017-05-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017817#comment-16017817 ] Maciej Szymkiewicz commented on SPARK-18825: Originally I thought about patching it for our

[jira] [Commented] (SPARK-20814) Mesos scheduler does not respect spark.executor.extraClassPath configuration

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017993#comment-16017993 ] Apache Spark commented on SPARK-20814: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20814) Mesos scheduler does not respect spark.executor.extraClassPath configuration

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20814: Assignee: (was: Apache Spark) > Mesos scheduler does not respect

[jira] [Assigned] (SPARK-20814) Mesos scheduler does not respect spark.executor.extraClassPath configuration

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20814: Assignee: Apache Spark > Mesos scheduler does not respect spark.executor.extraClassPath

[jira] [Commented] (SPARK-20683) Make table uncache chaining optional

2017-05-19 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018008#comment-16018008 ] Andrew Ash commented on SPARK-20683: Thanks for that diff [~shea.parkes] -- we're planning on trying

[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems

2017-05-19 Thread Paul Praet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017912#comment-16017912 ] Paul Praet commented on SPARK-4820: --- I confirm - still an issue when trying to build Spark 2.1.1 on

[jira] [Assigned] (SPARK-20781) the location of Dockerfile in docker.properties.template is wrong

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20781: - Assignee: liuzhaokun Priority: Minor (was: Major) Issue Type: Bug (was:

[jira] [Created] (SPARK-20814) Mesos scheduler does not respect spark.executor.extraClassPath configuration

2017-05-19 Thread Gene Pang (JIRA)
Gene Pang created SPARK-20814: - Summary: Mesos scheduler does not respect spark.executor.extraClassPath configuration Key: SPARK-20814 URL: https://issues.apache.org/jira/browse/SPARK-20814 Project:

[jira] [Commented] (SPARK-20814) Mesos scheduler does not respect spark.executor.extraClassPath configuration

2017-05-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017979#comment-16017979 ] Marcelo Vanzin commented on SPARK-20814: Hmm, this sucks, we should fix it for 2.2 (FYI

[jira] [Updated] (SPARK-20814) Mesos scheduler does not respect spark.executor.extraClassPath configuration

2017-05-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-20814: --- Target Version/s: 2.2.0 Priority: Critical (was: Major) > Mesos scheduler does

[jira] [Assigned] (SPARK-20813) Web UI executor page tab search by status not working

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20813: Assignee: (was: Apache Spark) > Web UI executor page tab search by status not working

[jira] [Assigned] (SPARK-20813) Web UI executor page tab search by status not working

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20813: Assignee: Apache Spark > Web UI executor page tab search by status not working >

[jira] [Commented] (SPARK-20813) Web UI executor page tab search by status not working

2017-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017907#comment-16017907 ] Apache Spark commented on SPARK-20813: -- User 'yoonlee95' has created a pull request for this issue:

[jira] [Resolved] (SPARK-20781) the location of Dockerfile in docker.properties.template is wrong

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20781. --- Resolution: Fixed Fix Version/s: 2.1.2 2.2.0 Issue resolved by pull

[jira] [Commented] (SPARK-20805) updated updateP in SVD++ is error

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016969#comment-16016969 ] Sean Owen commented on SPARK-20805: --- This is hard to understand [~BoLing]. Can you open a PR with the

[jira] [Created] (SPARK-20806) Launcher:redundant code,invalid branch of judgment

2017-05-19 Thread Phoenix_Dad (JIRA)
Phoenix_Dad created SPARK-20806: --- Summary: Launcher:redundant code,invalid branch of judgment Key: SPARK-20806 URL: https://issues.apache.org/jira/browse/SPARK-20806 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-20806) Launcher:redundant code,invalid branch of judgment

2017-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20806. --- Resolution: Invalid It's hard to understand what you're describing. But I looked at the code you

  1   2   >