[jira] [Assigned] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11912: Assignee: Apache Spark > ml.feature.PCA minor refactor > - >

[jira] [Assigned] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11912: Assignee: (was: Apache Spark) > ml.feature.PCA minor refactor >

[jira] [Commented] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021428#comment-15021428 ] Apache Spark commented on SPARK-11912: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-11757) Incorrect join output for joining two dataframes loaded from Parquet format

2015-11-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021534#comment-15021534 ] Jeff Zhang commented on SPARK-11757: I tried it on master, seems this issue has been resolved. >

[jira] [Resolved] (SPARK-11895) Rename and possibly update DatasetExample in mllib/examples

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11895. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9873

[jira] [Updated] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11902: -- Assignee: Benjamin Fradet > Unhandled case in VectorAssembler#transform >

[jira] [Resolved] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11902. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9885

[jira] [Updated] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11902: -- Target Version/s: 1.6.0 > Unhandled case in VectorAssembler#transform >

[jira] [Assigned] (SPARK-11917) Add SQLContext#dropTempTable to PySpark

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11917: Assignee: Apache Spark > Add SQLContext#dropTempTable to PySpark >

[jira] [Commented] (SPARK-11860) Invalid argument specification for registerFunction [Python]

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021545#comment-15021545 ] Apache Spark commented on SPARK-11860: -- User 'zjffdu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11860) Invalid argument specification for registerFunction [Python]

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11860: Assignee: (was: Apache Spark) > Invalid argument specification for registerFunction

[jira] [Assigned] (SPARK-11860) Invalid argument specification for registerFunction [Python]

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11860: Assignee: Apache Spark > Invalid argument specification for registerFunction [Python] >

[jira] [Resolved] (SPARK-6791) Model export/import for spark.ml: CrossValidator

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6791. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9848

[jira] [Updated] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11912: -- Target Version/s: 1.6.0 > ml.feature.PCA minor refactor > - > >

[jira] [Updated] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11912: -- Assignee: Yanbo Liang > ml.feature.PCA minor refactor > - > >

[jira] [Resolved] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11912. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9897

[jira] [Assigned] (SPARK-11916) Expression TRIM/LTRIM/RTRIM to support specific trim word

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11916: Assignee: Apache Spark > Expression TRIM/LTRIM/RTRIM to support specific trim word >

[jira] [Commented] (SPARK-11916) Expression TRIM/LTRIM/RTRIM to support specific trim word

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021606#comment-15021606 ] Apache Spark commented on SPARK-11916: -- User 'adrian-wang' has created a pull request for this

[jira] [Assigned] (SPARK-11916) Expression TRIM/LTRIM/RTRIM to support specific trim word

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11916: Assignee: (was: Apache Spark) > Expression TRIM/LTRIM/RTRIM to support specific trim

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

2015-11-22 Thread Sen Fang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021527#comment-15021527 ] Sen Fang commented on SPARK-2336: - I finally took a crack on the hybrid spill tree for kNN and results so

[jira] [Resolved] (SPARK-11835) Add a menu to the documentation of MLlib

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11835. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9826

[jira] [Assigned] (SPARK-11917) Add SQLContext#dropTempTable to PySpark

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11917: Assignee: (was: Apache Spark) > Add SQLContext#dropTempTable to PySpark >

[jira] [Commented] (SPARK-11917) Add SQLContext#dropTempTable to PySpark

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021625#comment-15021625 ] Apache Spark commented on SPARK-11917: -- User 'zjffdu' has created a pull request for this issue:

[jira] [Created] (SPARK-11917) Add SQLContext#dropTempTable to PySpark

2015-11-22 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-11917: -- Summary: Add SQLContext#dropTempTable to PySpark Key: SPARK-11917 URL: https://issues.apache.org/jira/browse/SPARK-11917 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-11894) Incorrect results are returned when using null

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11894: Assignee: (was: Apache Spark) > Incorrect results are returned when using null >

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021644#comment-15021644 ] Apache Spark commented on SPARK-11894: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11894) Incorrect results are returned when using null

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11894: Assignee: Apache Spark > Incorrect results are returned when using null >

[jira] [Created] (SPARK-11916) Expression TRIM/LTRIM/RTRIM to support specific trim word

2015-11-22 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-11916: --- Summary: Expression TRIM/LTRIM/RTRIM to support specific trim word Key: SPARK-11916 URL: https://issues.apache.org/jira/browse/SPARK-11916 Project: Spark

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021669#comment-15021669 ] Saisai Shao commented on SPARK-11909: - The master will print the master url in web UI and log. Since

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11604: Description: For new public APIs added to MLlib, we need to check the generated HTML doc and

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11604: Description: For new public APIs added to MLlib, we need to check the generated HTML doc and

[jira] [Updated] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11912: Description: Like SPARK-11852, k is params and we should save it under metadata/ rather than both

[jira] [Updated] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11912: Description: Like SPARK-11852, k is params and we should save it under metadata/ rather than both

[jira] [Commented] (SPARK-11619) cannot use UDTF in DataFrame.selectExpr

2015-11-22 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021509#comment-15021509 ] Wenchen Fan commented on SPARK-11619: - Actually this line:

[jira] [Commented] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021511#comment-15021511 ] Patrick Wendell commented on SPARK-11903: - I think it's simply dead code. SKIP_JAVA_TEST related

[jira] [Commented] (SPARK-11906) Speculation Tasks Cause ProgressBar UI Overflow

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021228#comment-15021228 ] Apache Spark commented on SPARK-11906: -- User 'saurfang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11906) Speculation Tasks Cause ProgressBar UI Overflow

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11906: Assignee: (was: Apache Spark) > Speculation Tasks Cause ProgressBar UI Overflow >

[jira] [Assigned] (SPARK-11906) Speculation Tasks Cause ProgressBar UI Overflow

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11906: Assignee: Apache Spark > Speculation Tasks Cause ProgressBar UI Overflow >

[jira] [Commented] (SPARK-11730) Feature Importance for GBT

2015-11-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021301#comment-15021301 ] Joseph K. Bradley commented on SPARK-11730: --- I wrote that note since I did not have time to

[jira] [Commented] (SPARK-10129) math function: stddev_samp

2015-11-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021319#comment-15021319 ] Yin Huai commented on SPARK-10129: -- We have stddev_samp in agg functions. Should we resolve this? Or, it

[jira] [Comment Edited] (SPARK-10129) math function: stddev_samp

2015-11-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021319#comment-15021319 ] Yin Huai edited comment on SPARK-10129 at 11/23/15 1:16 AM: We have

[jira] [Commented] (SPARK-9506) DataFrames Postgresql JDBC unable to support most of the Postgresql's Data Type

2015-11-22 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021499#comment-15021499 ] Wenchen Fan commented on SPARK-9506: I think it's not a workaround, but the right thing to do. We

[jira] [Comment Edited] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021511#comment-15021511 ] Patrick Wendell edited comment on SPARK-11903 at 11/23/15 4:29 AM: --- I

[jira] [Commented] (SPARK-11206) Support SQL UI on the history server

2015-11-22 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021363#comment-15021363 ] Carson Wang commented on SPARK-11206: - To support SQL UI on the history server: 1. I added an

[jira] [Updated] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-22 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-11915: Description: The python test pyspark.sql.group will fail due to items' order in returned

[jira] [Assigned] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11915: Assignee: Apache Spark > Fix flaky python test pyspark.sql.group >

[jira] [Commented] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021498#comment-15021498 ] Apache Spark commented on SPARK-11915: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11915: Assignee: (was: Apache Spark) > Fix flaky python test pyspark.sql.group >

[jira] [Commented] (SPARK-11861) Feature importances for decision trees

2015-11-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021297#comment-15021297 ] Joseph K. Bradley commented on SPARK-11861: --- Exposing the single-tree API for this sounds fine

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11604: Description: For new public APIs added to MLlib, we need to check the generated HTML doc and

[jira] [Commented] (SPARK-11913) support typed aggregate for complex buffer schema

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021454#comment-15021454 ] Apache Spark commented on SPARK-11913: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11913) support typed aggregate for complex buffer schema

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11913: Assignee: Apache Spark > support typed aggregate for complex buffer schema >

[jira] [Assigned] (SPARK-11913) support typed aggregate for complex buffer schema

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11913: Assignee: (was: Apache Spark) > support typed aggregate for complex buffer schema >

[jira] [Updated] (SPARK-11600) Spark MLlib 1.6 QA umbrella

2015-11-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11600: -- Description: This JIRA lists tasks for the next MLlib release's QA period. h2. API *

[jira] [Created] (SPARK-11911) spark-perf test for MultilayerPerceptron

2015-11-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11911: - Summary: spark-perf test for MultilayerPerceptron Key: SPARK-11911 URL: https://issues.apache.org/jira/browse/SPARK-11911 Project: Spark Issue

[jira] [Created] (SPARK-11913) support typed aggregate for complex buffer schema

2015-11-22 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11913: --- Summary: support typed aggregate for complex buffer schema Key: SPARK-11913 URL: https://issues.apache.org/jira/browse/SPARK-11913 Project: Spark Issue Type:

[jira] [Created] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-22 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-11915: --- Summary: Fix flaky python test pyspark.sql.group Key: SPARK-11915 URL: https://issues.apache.org/jira/browse/SPARK-11915 Project: Spark Issue Type:

[jira] [Created] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11912: --- Summary: ml.feature.PCA minor refactor Key: SPARK-11912 URL: https://issues.apache.org/jira/browse/SPARK-11912 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-11914) [SQL] Support coalesce and repartition in Dataset APIs

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021478#comment-15021478 ] Apache Spark commented on SPARK-11914: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11914) [SQL] Support coalesce and repartition in Dataset APIs

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11914: Assignee: (was: Apache Spark) > [SQL] Support coalesce and repartition in Dataset

[jira] [Assigned] (SPARK-11914) [SQL] Support coalesce and repartition in Dataset APIs

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11914: Assignee: Apache Spark > [SQL] Support coalesce and repartition in Dataset APIs >

[jira] [Created] (SPARK-11914) [SQL] Support coalesce and repartition in Dataset APIs

2015-11-22 Thread Xiao Li (JIRA)
Xiao Li created SPARK-11914: --- Summary: [SQL] Support coalesce and repartition in Dataset APIs Key: SPARK-11914 URL: https://issues.apache.org/jira/browse/SPARK-11914 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9506) DataFrames Postgresql JDBC unable to support most of the Postgresql's Data Type

2015-11-22 Thread Marius Van Niekerk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021500#comment-15021500 ] Marius Van Niekerk commented on SPARK-9506: --- Quite a few more additional types are supported in

[jira] [Updated] (SPARK-11907) Allowing errors as values in DataFrames (like 'Either Left/Right')

2015-11-22 Thread Tycho Grouwstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tycho Grouwstra updated SPARK-11907: Description: I like Spark, but one thing I find funny about it is that it is picky about

[jira] [Created] (SPARK-11907) Allowing errors as values in DataFrames (like 'Either Left/Right')

2015-11-22 Thread Tycho Grouwstra (JIRA)
Tycho Grouwstra created SPARK-11907: --- Summary: Allowing errors as values in DataFrames (like 'Either Left/Right') Key: SPARK-11907 URL: https://issues.apache.org/jira/browse/SPARK-11907 Project:

[jira] [Updated] (SPARK-11907) Allowing errors as values in DataFrames (like 'Either Left/Right')

2015-11-22 Thread Tycho Grouwstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tycho Grouwstra updated SPARK-11907: Description: I like Spark, but one thing I find funny about it is that it is picky about

[jira] [Updated] (SPARK-11716) UDFRegistration Drops Input Type Information

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11716: -- Assignee: Yin Huai > UDFRegistration Drops Input Type Information >

[jira] [Commented] (SPARK-11910) Streaming programming guide references wrong dependency version

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021059#comment-15021059 ] Apache Spark commented on SPARK-11910: -- User 'lresende' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11910) Streaming programming guide references wrong dependency version

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11910: Assignee: Apache Spark > Streaming programming guide references wrong dependency version

[jira] [Assigned] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10521: Assignee: (was: Apache Spark) > Utilize Docker to test DB2 JDBC Dialect support >

[jira] [Commented] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021061#comment-15021061 ] Apache Spark commented on SPARK-10521: -- User 'lresende' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10521: Assignee: Apache Spark > Utilize Docker to test DB2 JDBC Dialect support >

[jira] [Created] (SPARK-11910) Streaming programming guide references wrong dependency version

2015-11-22 Thread Luciano Resende (JIRA)
Luciano Resende created SPARK-11910: --- Summary: Streaming programming guide references wrong dependency version Key: SPARK-11910 URL: https://issues.apache.org/jira/browse/SPARK-11910 Project: Spark

[jira] [Assigned] (SPARK-11910) Streaming programming guide references wrong dependency version

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11910: Assignee: (was: Apache Spark) > Streaming programming guide references wrong

[jira] [Assigned] (SPARK-11908) Add NullType support to RowEncoder

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11908: Assignee: Apache Spark > Add NullType support to RowEncoder >

[jira] [Created] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11909: --- Summary: Spark Standalone's master URL accepts URLs without port (assuming default 7077) Key: SPARK-11909 URL: https://issues.apache.org/jira/browse/SPARK-11909

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020976#comment-15020976 ] Sean Owen commented on SPARK-11909: --- I disagree. The default is not a well-known port like 80 for HTTP.

[jira] [Commented] (SPARK-11065) IOException thrown at job submit shutdown

2015-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020982#comment-15020982 ] Jean-Baptiste Onofré commented on SPARK-11065: -- It's not really a problem, but IMHO, it's a

[jira] [Commented] (SPARK-11908) Add NullType support to RowEncoder

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020935#comment-15020935 ] Apache Spark commented on SPARK-11908: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-11908) Add NullType support to RowEncoder

2015-11-22 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-11908: --- Summary: Add NullType support to RowEncoder Key: SPARK-11908 URL: https://issues.apache.org/jira/browse/SPARK-11908 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-11908) Add NullType support to RowEncoder

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11908: Assignee: (was: Apache Spark) > Add NullType support to RowEncoder >

[jira] [Commented] (SPARK-11065) IOException thrown at job submit shutdown

2015-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020981#comment-15020981 ] Maciej Bryński commented on SPARK-11065: [~srowen] OK. But this issue is new in 1.6.0. >

[jira] [Commented] (SPARK-11826) Subtract BlockMatrix

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020979#comment-15020979 ] Sean Owen commented on SPARK-11826: --- OK, given the existence of add(), this probably makes some sense

[jira] [Commented] (SPARK-11065) IOException thrown at job submit shutdown

2015-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020939#comment-15020939 ] Maciej Bryński commented on SPARK-11065: I have the same error. Job run successfully, but this

[jira] [Commented] (SPARK-11065) IOException thrown at job submit shutdown

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020977#comment-15020977 ] Sean Owen commented on SPARK-11065: --- Unless it's causing a problem, I'd ignore it. Shutdown is

[jira] [Commented] (SPARK-11906) Speculation Tasks Cause ProgressBar UI Overflow

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020990#comment-15020990 ] Sean Owen commented on SPARK-11906: --- Yes, can you open a PR? sounds like you already identified the

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021153#comment-15021153 ] Jacek Laskowski commented on SPARK-11909: - _"The default is not a well-known port like 80 for

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021167#comment-15021167 ] Sean Owen commented on SPARK-11909: --- I think that cuts the other way. You're helping people not think

[jira] [Commented] (SPARK-11783) When deployed against remote Hive metastore, HiveContext.executionHive points to wrong metastore

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021082#comment-15021082 ] Apache Spark commented on SPARK-11783: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11847: Assignee: yuhao yang (was: Apache Spark) > Model export/import for spark.ml: LDA >

[jira] [Assigned] (SPARK-11783) When deployed against remote Hive metastore, HiveContext.executionHive points to wrong metastore

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11783: Assignee: Cheng Lian (was: Apache Spark) > When deployed against remote Hive metastore,

[jira] [Commented] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021083#comment-15021083 ] Apache Spark commented on SPARK-11847: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11783) When deployed against remote Hive metastore, HiveContext.executionHive points to wrong metastore

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11783: Assignee: Apache Spark (was: Cheng Lian) > When deployed against remote Hive metastore,

[jira] [Assigned] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11847: Assignee: Apache Spark (was: yuhao yang) > Model export/import for spark.ml: LDA >

[jira] [Commented] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Richard W. Eggert II (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021185#comment-15021185 ] Richard W. Eggert II commented on SPARK-4514: - The unit test attached to this issue fails in

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021186#comment-15021186 ] Jacek Laskowski commented on SPARK-11909: - What about a WARN message about the port in use to

[jira] [Comment Edited] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021186#comment-15021186 ] Jacek Laskowski edited comment on SPARK-11909 at 11/22/15 8:51 PM: ---

[jira] [Comment Edited] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Richard W. Eggert II (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021185#comment-15021185 ] Richard W. Eggert II edited comment on SPARK-4514 at 11/22/15 8:54 PM:

[jira] [Commented] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Richard W. Eggert II (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021187#comment-15021187 ] Richard W. Eggert II commented on SPARK-4514: - This test, however, still fails: {code}

[jira] [Commented] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Richard W. Eggert II (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021194#comment-15021194 ] Richard W. Eggert II commented on SPARK-4514: - I implemented a two-line fix that causes this

  1   2   >