[jira] [Commented] (SPARK-11569) StringIndexer transform fails when column contains nulls

2015-11-08 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995580#comment-14995580 ] Maciej Szymkiewicz commented on SPARK-11569: It looks this problem affects Scala after all:

[jira] [Updated] (SPARK-11567) Add Python API for corr aggregate function

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11567: -- Component/s: PySpark > Add Python API for corr aggregate function >

[jira] [Updated] (SPARK-11562) Provide user an option to init SQLContext or HiveContext in spark shell

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11562: -- Issue Type: Improvement (was: Bug) > Provide user an option to init SQLContext or HiveContext in

[jira] [Updated] (SPARK-11562) Provide user an option to init SQLContext or HiveContext in spark shell

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11562: -- Component/s: SQL > Provide user an option to init SQLContext or HiveContext in spark shell >

[jira] [Commented] (SPARK-11570) ambiguous hostname resolving during startup

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995597#comment-14995597 ] Sean Owen commented on SPARK-11570: --- The solution is to use the script, no? or do what it does. That's

[jira] [Resolved] (SPARK-11476) Incorrect function referred to in MLib Random data generation documentation

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11476. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 1.7.0 1.6.0

[jira] [Commented] (SPARK-2344) Add Fuzzy C-Means algorithm to MLlib

2015-11-08 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995615#comment-14995615 ] Adrian-Cătălin Florea commented on SPARK-2344: -- Hi, I'm working on adding a `fuzzifier`

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-11-08 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995685#comment-14995685 ] yuhao yang commented on SPARK-9273: --- Thanks so much for the helpful suggestions. I have an optimized

[jira] [Created] (SPARK-11570) ambiguous hostname resolving during startup

2015-11-08 Thread Sergey Soldatov (JIRA)
Sergey Soldatov created SPARK-11570: --- Summary: ambiguous hostname resolving during startup Key: SPARK-11570 URL: https://issues.apache.org/jira/browse/SPARK-11570 Project: Spark Issue

[jira] [Resolved] (SPARK-11568) confuse configuration: spark.local.dir

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11568. --- Resolution: Not A Problem It sounds like you are setting client-only config. Unless you are setting

[jira] [Resolved] (SPARK-10046) Hive warehouse dir not set in current directory when not providing hive-site.xml

2015-11-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10046. - Resolution: Fixed Assignee: Xin Wu Fix Version/s: 1.6.0 > Hive warehouse dir not

[jira] [Commented] (SPARK-11575) HiveContext fails to initialize under Java/Windows

2015-11-08 Thread Ali Beydoun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995815#comment-14995815 ] Ali Beydoun commented on SPARK-11575: - Thanks for pointing out that thread. I've already made the

[jira] [Created] (SPARK-11576) [SQL] Incorrect results when using the nested self-join

2015-11-08 Thread Xiao Li (JIRA)
Xiao Li created SPARK-11576: --- Summary: [SQL] Incorrect results when using the nested self-join Key: SPARK-11576 URL: https://issues.apache.org/jira/browse/SPARK-11576 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11451) Support single distinct count on multiple columns

2015-11-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11451: - Assignee: Herman van Hovell > Support single distinct count on multiple columns >

[jira] [Resolved] (SPARK-11451) Support single distinct count on multiple columns

2015-11-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11451. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9409

[jira] [Created] (SPARK-11574) Spark should support StatsD sink out of box

2015-11-08 Thread Xiaofeng Lin (JIRA)
Xiaofeng Lin created SPARK-11574: Summary: Spark should support StatsD sink out of box Key: SPARK-11574 URL: https://issues.apache.org/jira/browse/SPARK-11574 Project: Spark Issue Type:

[jira] [Closed] (SPARK-516) Improve error reporting when slaves fail to start

2015-11-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-516. - Resolution: Not A Problem Marking as not a problem since it's been a really long time. > Improve error

[jira] [Created] (SPARK-11573) correct 'reflective access of structural type member method should be enabled' Scala warnings

2015-11-08 Thread Gabor Liptak (JIRA)
Gabor Liptak created SPARK-11573: Summary: correct 'reflective access of structural type member method should be enabled' Scala warnings Key: SPARK-11573 URL: https://issues.apache.org/jira/browse/SPARK-11573

[jira] [Commented] (SPARK-516) Improve error reporting when slaves fail to start

2015-11-08 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995789#comment-14995789 ] Neelesh Srinivas Salian commented on SPARK-516: --- [~rxin] is this still relevant? > Improve

[jira] [Commented] (SPARK-11570) ambiguous hostname resolving during startup

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995799#comment-14995799 ] Sean Owen commented on SPARK-11570: --- That JIRA was about standardizing the behavior of a bunch of code

[jira] [Assigned] (SPARK-11574) Spark should support StatsD sink out of box

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11574: Assignee: Apache Spark > Spark should support StatsD sink out of box >

[jira] [Commented] (SPARK-11574) Spark should support StatsD sink out of box

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995758#comment-14995758 ] Apache Spark commented on SPARK-11574: -- User 'xflin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11574) Spark should support StatsD sink out of box

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11574: Assignee: (was: Apache Spark) > Spark should support StatsD sink out of box >

[jira] [Resolved] (SPARK-10682) Remove Bagel test suites

2015-11-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10682. - Resolution: Fixed Fix Version/s: 1.6.0 > Remove Bagel test suites >

[jira] [Updated] (SPARK-6932) A Prototype of Parameter Server

2015-11-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6932: --- Target Version/s: (was: 2+) > A Prototype of Parameter Server > --- > >

[jira] [Commented] (SPARK-11575) HiveContext fails to initialize under Java/Windows

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995802#comment-14995802 ] Sean Owen commented on SPARK-11575: --- There have been a few discussions on this, sounding like

[jira] [Assigned] (SPARK-11576) [SQL] Incorrect results when using the nested self-join

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11576: Assignee: (was: Apache Spark) > [SQL] Incorrect results when using the nested

[jira] [Assigned] (SPARK-11576) [SQL] Incorrect results when using the nested self-join

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11576: Assignee: Apache Spark > [SQL] Incorrect results when using the nested self-join >

[jira] [Assigned] (SPARK-10838) Repeat to join one DataFrame twice,there will be AnalysisException.

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10838: Assignee: Apache Spark > Repeat to join one DataFrame twice,there will be

[jira] [Assigned] (SPARK-10838) Repeat to join one DataFrame twice,there will be AnalysisException.

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10838: Assignee: (was: Apache Spark) > Repeat to join one DataFrame twice,there will be

[jira] [Commented] (SPARK-11576) [SQL] Incorrect results when using the nested self-join

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995835#comment-14995835 ] Apache Spark commented on SPARK-11576: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-10838) Repeat to join one DataFrame twice,there will be AnalysisException.

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995834#comment-14995834 ] Apache Spark commented on SPARK-10838: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9865: --- Assignee: Apache Spark > Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame >

[jira] [Commented] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995838#comment-14995838 ] Apache Spark commented on SPARK-9865: - User 'felixcheung' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9865: --- Assignee: (was: Apache Spark) > Flaky SparkR test: test_sparkSQL.R: sample on a

[jira] [Commented] (SPARK-9465) Could not read parquet table after recreating it with the same table name

2015-11-08 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995771#comment-14995771 ] Xin Wu commented on SPARK-9465: --- [~stanzhai] Would you be able to recreate on the later releases? > Could

[jira] [Updated] (SPARK-10046) Hive warehouse dir not set in current directory when not providing hive-site.xml

2015-11-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10046: Fix Version/s: 1.5.3 > Hive warehouse dir not set in current directory when not providing >

[jira] [Updated] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11572: --- Component/s: Spark Core > Exit AsynchronousListenerBus thread when stop() is called >

[jira] [Commented] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995736#comment-14995736 ] Apache Spark commented on SPARK-11572: -- User 'ted-yu' has created a pull request for this issue:

[jira] [Created] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-08 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11572: -- Summary: Exit AsynchronousListenerBus thread when stop() is called Key: SPARK-11572 URL: https://issues.apache.org/jira/browse/SPARK-11572 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11572: Assignee: (was: Apache Spark) > Exit AsynchronousListenerBus thread when stop() is

[jira] [Assigned] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11572: Assignee: Apache Spark > Exit AsynchronousListenerBus thread when stop() is called >

[jira] [Commented] (SPARK-11574) Spark should support StatsD sink out of box

2015-11-08 Thread Xiaofeng Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995757#comment-14995757 ] Xiaofeng Lin commented on SPARK-11574: -- I have a pull request pending which doesn't depend on any

[jira] [Created] (SPARK-11575) HiveContext fails to initialize under Java/Windows

2015-11-08 Thread Ali Beydoun (JIRA)
Ali Beydoun created SPARK-11575: --- Summary: HiveContext fails to initialize under Java/Windows Key: SPARK-11575 URL: https://issues.apache.org/jira/browse/SPARK-11575 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-11554) add map/flatMap to GroupedDataset

2015-11-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11554. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9521

[jira] [Updated] (SPARK-11554) add map/flatMap to GroupedDataset

2015-11-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11554: - Assignee: Wenchen Fan > add map/flatMap to GroupedDataset >

[jira] [Commented] (SPARK-11339) Document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995810#comment-14995810 ] Felix Cheung commented on SPARK-11339: -- [~sunrui] [~shivaram] Is this the list? {code} Attaching

[jira] [Resolved] (SPARK-9110) Refactor dev/tests/* scripts into Python

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9110. --- Resolution: Won't Fix > Refactor dev/tests/* scripts into Python >

[jira] [Commented] (SPARK-9110) Refactor dev/tests/* scripts into Python

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995877#comment-14995877 ] Josh Rosen commented on SPARK-9110: --- Meh, probably not super important. Those scripts themselves don't

[jira] [Closed] (SPARK-4216) Eliminate duplicate Jenkins GitHub posts from AMPLab

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen closed SPARK-4216. - Resolution: Won't Fix Closing as "Won't Fix" for now because I don't think that this JIRA is actionable

[jira] [Assigned] (SPARK-4216) Eliminate duplicate Jenkins GitHub posts from AMPLab

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-4216: - Assignee: Josh Rosen > Eliminate duplicate Jenkins GitHub posts from AMPLab >

[jira] [Updated] (SPARK-9884) Submission scripts are broken on ec2 clusters started with spark-ec2 with private IP's

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9884: -- Component/s: (was: Project Infra) > Submission scripts are broken on ec2 clusters started with

[jira] [Resolved] (SPARK-7016) Refactor dev/run-tests(-jenkins) from Bash to Python

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7016. --- Resolution: Done > Refactor dev/run-tests(-jenkins) from Bash to Python >

[jira] [Comment Edited] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995922#comment-14995922 ] Hyukjin Kwon edited comment on SPARK-9557 at 11/9/15 2:24 AM: -- But I would

[jira] [Assigned] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9557: --- Assignee: Apache Spark (was: Cheng Lian) > Refactor ParquetFilterSuite and remove old

[jira] [Commented] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995942#comment-14995942 ] Apache Spark commented on SPARK-9557: - User 'HyukjinKwon' has created a pull request for this issue:

[jira] [Created] (SPARK-11579) Method SGDOptimizer and LBFGSOptimizer in FeedForwardTrainer should not create new optimizer every time they got invoked

2015-11-08 Thread yuhao yang (JIRA)
yuhao yang created SPARK-11579: -- Summary: Method SGDOptimizer and LBFGSOptimizer in FeedForwardTrainer should not create new optimizer every time they got invoked Key: SPARK-11579 URL:

[jira] [Created] (SPARK-11580) Just do final aggregation when there is no Exchange

2015-11-08 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-11580: - Summary: Just do final aggregation when there is no Exchange Key: SPARK-11580 URL: https://issues.apache.org/jira/browse/SPARK-11580 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11577) Suppress stacktraces in bin/spark-sql for AnalysisExceptions

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995860#comment-14995860 ] Apache Spark commented on SPARK-11577: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-11577) Suppress stacktraces in bin/spark-sql for AnalysisExceptions

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11577: Assignee: Apache Spark > Suppress stacktraces in bin/spark-sql for AnalysisExceptions >

[jira] [Assigned] (SPARK-11573) correct 'reflective access of structural type member method should be enabled' Scala warnings

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11573: Assignee: (was: Apache Spark) > correct 'reflective access of structural type member

[jira] [Assigned] (SPARK-11573) correct 'reflective access of structural type member method should be enabled' Scala warnings

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11573: Assignee: Apache Spark > correct 'reflective access of structural type member method

[jira] [Commented] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995922#comment-14995922 ] Hyukjin Kwon commented on SPARK-9557: - But I would like to just add a just little corrections. I

[jira] [Comment Edited] (SPARK-11568) confuse configuration: spark.local.dir

2015-11-08 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995930#comment-14995930 ] xukun edited comment on SPARK-11568 at 11/9/15 2:04 AM: spark-default.xml is

[jira] [Assigned] (SPARK-11562) Provide user an option to init SQLContext or HiveContext in spark shell

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11562: Assignee: Apache Spark > Provide user an option to init SQLContext or HiveContext in

[jira] [Assigned] (SPARK-11562) Provide user an option to init SQLContext or HiveContext in spark shell

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11562: Assignee: (was: Apache Spark) > Provide user an option to init SQLContext or

[jira] [Created] (SPARK-11578) User facing api for typed aggregation

2015-11-08 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-11578: Summary: User facing api for typed aggregation Key: SPARK-11578 URL: https://issues.apache.org/jira/browse/SPARK-11578 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11580) Just do final aggregation when there is no Exchange

2015-11-08 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-11580: -- Description: I do the SQL as below: {code} cache table src as select * from src distribute by key;

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995880#comment-14995880 ] Josh Rosen commented on SPARK-3873: --- The upstream Scalastyle patch has been merged but we're now blocked

[jira] [Commented] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995912#comment-14995912 ] Hyukjin Kwon commented on SPARK-9557: - This is done by https://github.com/apache/spark/pull/8275. >

[jira] [Closed] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-11-08 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Alexander Spitzer closed SPARK-11415. - Resolution: Not A Problem > Catalyst DateType Shifts Input Data by Local

[jira] [Resolved] (SPARK-5866) pyspark read from s3

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5866. --- Resolution: Incomplete > pyspark read from s3 > > > Key:

[jira] [Resolved] (SPARK-6783) Add timing and test output for PR tests

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6783. --- Resolution: Incomplete > Add timing and test output for PR tests >

[jira] [Commented] (SPARK-11570) ambiguous hostname resolving during startup

2015-11-08 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995905#comment-14995905 ] Konstantin Boudnik commented on SPARK-11570: Doing what the script does might be a way to go;

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-11-08 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995915#comment-14995915 ] Russell Alexander Spitzer commented on SPARK-11415: --- Looks like there are still a lot

[jira] [Commented] (SPARK-11339) Document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-08 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995954#comment-14995954 ] Sun Rui commented on SPARK-11339: - yes > Document the list of functions in R base package that are

[jira] [Assigned] (SPARK-11578) User facing api for typed aggregation

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11578: Assignee: Apache Spark (was: Michael Armbrust) > User facing api for typed aggregation >

[jira] [Assigned] (SPARK-11578) User facing api for typed aggregation

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11578: Assignee: Michael Armbrust (was: Apache Spark) > User facing api for typed aggregation >

[jira] [Commented] (SPARK-11578) User facing api for typed aggregation

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995968#comment-14995968 ] Apache Spark commented on SPARK-11578: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Commented] (SPARK-11573) correct 'reflective access of structural type member method should be enabled' Scala warnings

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995859#comment-14995859 ] Apache Spark commented on SPARK-11573: -- User 'gliptak' has created a pull request for this issue:

[jira] [Resolved] (SPARK-7521) Allow all required release credentials to be specified with env vars

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7521. --- Resolution: Fixed Resolving as fixed now that the new release scripts have been merged into Spark. >

[jira] [Resolved] (SPARK-4359) Empty classifier in "avro-mapred" is misinterpreted in SBT

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4359. --- Resolution: Incomplete > Empty classifier in "avro-mapred" is misinterpreted in SBT >

[jira] [Commented] (SPARK-11562) Provide user an option to init SQLContext or HiveContext in spark shell

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995928#comment-14995928 ] Apache Spark commented on SPARK-11562: -- User 'xguo27' has created a pull request for this issue:

[jira] [Commented] (SPARK-11568) confuse configuration: spark.local.dir

2015-11-08 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995930#comment-14995930 ] xukun commented on SPARK-11568: --- spark-default.xml is client configuration. I think executor should see

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-11-08 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995934#comment-14995934 ] Russell Alexander Spitzer commented on SPARK-11415: --- I re-read a bunch of the

[jira] [Assigned] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9557: --- Assignee: Cheng Lian (was: Apache Spark) > Refactor ParquetFilterSuite and remove old

[jira] [Created] (SPARK-11577) Suppress stacktraces in bin/spark-sql for AnalysisExceptions

2015-11-08 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-11577: Summary: Suppress stacktraces in bin/spark-sql for AnalysisExceptions Key: SPARK-11577 URL: https://issues.apache.org/jira/browse/SPARK-11577 Project: Spark

[jira] [Commented] (SPARK-11530) Return eigenvalues with PCA model

2015-11-08 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995874#comment-14995874 ] Maciej Szymkiewicz commented on SPARK-11530: It should actually target MLlib, shouldn't it?

[jira] [Resolved] (SPARK-5541) Allow running Maven or SBT in run-tests

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5541. --- Resolution: Fixed Assignee: (was: Nicholas Chammas) Fix Version/s: 1.4.0

[jira] [Commented] (SPARK-11081) Shade Jersey dependency to work around the compatibility issue with Jersey2

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995883#comment-14995883 ] Josh Rosen commented on SPARK-11081: I wonder how much work it would be to just remove our need to

[jira] [Commented] (SPARK-11497) PySpark RowMatrix Constructor Has Type Erasure Issue

2015-11-08 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995990#comment-14995990 ] Mike Dusenberry commented on SPARK-11497: - So far, I've only encountered it as an issue with the

[jira] [Comment Edited] (SPARK-10113) Support for unsigned Parquet logical types

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995992#comment-14995992 ] Hyukjin Kwon edited comment on SPARK-10113 at 11/9/15 3:50 AM: --- I think I

[jira] [Commented] (SPARK-10113) Support for unsigned Parquet logical types

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995992#comment-14995992 ] Hyukjin Kwon commented on SPARK-10113: -- I think I can work on this but we need to make several

[jira] [Created] (SPARK-11581) Example mllib code in documentation incorrectly computes MSE

2015-11-08 Thread Brian Webb (JIRA)
Brian Webb created SPARK-11581: -- Summary: Example mllib code in documentation incorrectly computes MSE Key: SPARK-11581 URL: https://issues.apache.org/jira/browse/SPARK-11581 Project: Spark

[jira] [Commented] (SPARK-11564) Dataset Java API

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996041#comment-14996041 ] Apache Spark commented on SPARK-11564: -- User 'rxin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-11564) Dataset Java API

2015-11-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11564. - Resolution: Fixed Fix Version/s: 1.6.0 > Dataset Java API > > >

[jira] [Resolved] (SPARK-11453) append data to partitioned table will messes up the result

2015-11-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11453. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9408

[jira] [Commented] (SPARK-8545) PMML improvement umbrella

2015-11-08 Thread Fazlan Nazeem (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996080#comment-14996080 ] Fazlan Nazeem commented on SPARK-8545: -- The current pmml models generated do not specify the pmml

[jira] [Updated] (SPARK-11577) Handle code review comments for SPARK-11188

2015-11-08 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-11577: - Summary: Handle code review comments for SPARK-11188 (was: Suppress stacktraces in

[jira] [Commented] (SPARK-8545) PMML improvement umbrella

2015-11-08 Thread Fazlan Nazeem (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996089#comment-14996089 ] Fazlan Nazeem commented on SPARK-8545: -- The current pmml models generated do not specify the pmml

  1   2   >