[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4006: --- Fix Version/s: (was: 1.3.0) 1.2.0 Spark Driver crashes whenever an

[jira] [Resolved] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4006. Resolution: Fixed Target Version/s: 1.2.0, 1.1.1, 1.0.3 (was: 1.1.1, 1.2.0,

[jira] [Updated] (SPARK-4184) Improve Spark Streaming documentation

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4184: --- Fix Version/s: (was: 1.3.0) Improve Spark Streaming documentation

[jira] [Updated] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4180: --- Fix Version/s: (was: 1.3.0) 1.2.0 SparkContext constructor should

[jira] [Updated] (SPARK-4231) Add RankingMetrics to examples.MovieLensALS

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4231: --- Target Version/s: 1.3.0 (was: 1.2.0) Add RankingMetrics to examples.MovieLensALS

[jira] [Updated] (SPARK-4237) Generate right Manifest File for maven building

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4237: --- Fix Version/s: (was: 1.3.0) Generate right Manifest File for maven building

[jira] [Updated] (SPARK-4258) NPE with new Parquet Filters

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4258: --- Fix Version/s: (was: 1.3.0) NPE with new Parquet Filters

[jira] [Updated] (SPARK-4237) Generate right Manifest File for maven building

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4237: --- Target Version/s: (was: 1.2.0) Generate right Manifest File for maven building

[jira] [Updated] (SPARK-4231) Add RankingMetrics to examples.MovieLensALS

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4231: --- Fix Version/s: (was: 1.3.0) Add RankingMetrics to examples.MovieLensALS

[jira] [Resolved] (SPARK-4258) NPE with new Parquet Filters

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4258. Resolution: Fixed NPE with new Parquet Filters

[jira] [Updated] (SPARK-4258) NPE with new Parquet Filters

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4258: --- Fix Version/s: 1.2.0 NPE with new Parquet Filters

[jira] [Updated] (SPARK-4355) OnlineSummarizer doesn't merge mean correctly

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4355: --- Fix Version/s: (was: 1.3.0) 1.2.0 OnlineSummarizer doesn't merge mean

[jira] [Updated] (SPARK-4362) Make prediction probability available in NaiveBayesModel

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4362: --- Fix Version/s: (was: 1.3.0) Make prediction probability available in NaiveBayesModel

[jira] [Updated] (SPARK-4355) OnlineSummarizer doesn't merge mean correctly

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4355: --- Labels: backport-needed (was: ) OnlineSummarizer doesn't merge mean correctly

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4422: --- Fix Version/s: (was: 1.3.0) In some cases, Vectors.fromBreeze get wrong results.

[jira] [Updated] (SPARK-4261) make right version info for beeline

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4261: --- Fix Version/s: (was: 1.3.0) make right version info for beeline

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4422: --- Fix Version/s: 1.2.0 In some cases, Vectors.fromBreeze get wrong results.

[jira] [Updated] (SPARK-4449) specify port range in spark

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4449: --- Fix Version/s: (was: 1.3.0) specify port range in spark ---

[jira] [Commented] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259310#comment-14259310 ] Patrick Wendell commented on SPARK-4422: [~mengxr] so should we just close this

[jira] [Updated] (SPARK-4553) query for parquet table with string fields in spark sql hive get binary result

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4553: --- Fix Version/s: (was: 1.3.0) query for parquet table with string fields in spark sql hive

[jira] [Updated] (SPARK-4559) Adding support for ucase and lcase

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4559: --- Fix Version/s: (was: 1.3.0) Adding support for ucase and lcase

[jira] [Updated] (SPARK-4574) Adding support for defining schema in foreign DDL commands.

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4574: --- Fix Version/s: (was: 1.3.0) Adding support for defining schema in foreign DDL commands.

[jira] [Commented] (SPARK-4574) Adding support for defining schema in foreign DDL commands.

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259311#comment-14259311 ] Patrick Wendell commented on SPARK-4574: [~scwf] when creating issues please to

[jira] [Updated] (SPARK-4699) Make caseSensitive configurable in Analyzer.scala

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4699: --- Fix Version/s: (was: 1.3.0) Make caseSensitive configurable in Analyzer.scala

[jira] [Commented] (SPARK-4963) SchemaRDD.sample may return wrong results

2014-12-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259313#comment-14259313 ] Cheng Lian commented on SPARK-4963: --- [~yanboliang] Unfortunately I don't have the

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-12-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259323#comment-14259323 ] Sean Owen commented on SPARK-1529: -- This may be a dumb question on an old issue, but: you

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-27 Thread Andy Petrella (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259341#comment-14259341 ] Andy Petrella commented on SPARK-4923: -- Thanks [~pwendell], when done, I'll start

[jira] [Created] (SPARK-4975) HiveInspectorSuite test failure

2014-12-27 Thread wangfei (JIRA)
wangfei created SPARK-4975: -- Summary: HiveInspectorSuite test failure Key: SPARK-4975 URL: https://issues.apache.org/jira/browse/SPARK-4975 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-4975) HiveInspectorSuite test failure

2014-12-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259370#comment-14259370 ] Apache Spark commented on SPARK-4975: - User 'scwf' has created a pull request for this

[jira] [Created] (SPARK-4976) trust region Newton optimizer in mllib

2014-12-27 Thread Ching-Pei Lee (JIRA)
Ching-Pei Lee created SPARK-4976: Summary: trust region Newton optimizer in mllib Key: SPARK-4976 URL: https://issues.apache.org/jira/browse/SPARK-4976 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-4976) trust region Newton optimizer in mllib

2014-12-27 Thread Ching-Pei Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ching-Pei Lee updated SPARK-4976: - Component/s: MLlib trust region Newton optimizer in mllib

[jira] [Commented] (SPARK-4976) trust region Newton optimizer in mllib

2014-12-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259400#comment-14259400 ] Apache Spark commented on SPARK-4976: - User 'leepei' has created a pull request for

[jira] [Commented] (SPARK-4976) trust region Newton optimizer in mllib

2014-12-27 Thread Ching-Pei Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259399#comment-14259399 ] Ching-Pei Lee commented on SPARK-4976: -- PR: https://github.com/apache/spark/pull/3815

[jira] [Commented] (SPARK-2722) Mechanism for escaping spark configs is not consistent

2014-12-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259459#comment-14259459 ] Sean Owen commented on SPARK-2722: -- The first escaping makes sense and is unavoidable

[jira] [Commented] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2014-12-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259463#comment-14259463 ] Sean Owen commented on SPARK-2914: -- Is this a superset of SPARK-2722 or vice versa?

[jira] [Created] (SPARK-4977) spark-ec2 start resets all the spark/conf configurations

2014-12-27 Thread Noah Young (JIRA)
Noah Young created SPARK-4977: - Summary: spark-ec2 start resets all the spark/conf configurations Key: SPARK-4977 URL: https://issues.apache.org/jira/browse/SPARK-4977 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4977) spark-ec2 start resets all the spark/conf configurations

2014-12-27 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259472#comment-14259472 ] Nicholas Chammas commented on SPARK-4977: - cc [~shivaram] spark-ec2 start resets

[jira] [Created] (SPARK-4978) Core dump when running any example with prebuilt Hadoop 2.4 binaries

2014-12-27 Thread Amy Brown (JIRA)
Amy Brown created SPARK-4978: Summary: Core dump when running any example with prebuilt Hadoop 2.4 binaries Key: SPARK-4978 URL: https://issues.apache.org/jira/browse/SPARK-4978 Project: Spark

[jira] [Updated] (SPARK-4978) Core dump when running any example with prebuilt Hadoop 2.4 binaries

2014-12-27 Thread Amy Brown (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amy Brown updated SPARK-4978: - Description: If I run either of these examples with the prebuilt Hadoop 2.4 binaries: ./bin/run-example

[jira] [Commented] (SPARK-4977) spark-ec2 start resets all the spark/conf configurations

2014-12-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259480#comment-14259480 ] Shivaram Venkataraman commented on SPARK-4977: -- I've run into this before

[jira] [Commented] (SPARK-4389) Set akka.remote.netty.tcp.bind-hostname=0.0.0.0 so driver can be located behind NAT

2014-12-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259488#comment-14259488 ] Josh Rosen commented on SPARK-4389: --- I think it's something like that; currently, I

[jira] [Updated] (SPARK-4501) Create build/mvn to automatically download maven/zinc/scalac

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4501: --- Assignee: Brennon York (was: Prashant Sharma) Create build/mvn to automatically download

[jira] [Resolved] (SPARK-4501) Create build/mvn to automatically download maven/zinc/scalac

2014-12-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4501. Resolution: Fixed Fix Version/s: 1.3.0 Create build/mvn to automatically download

[jira] [Commented] (SPARK-4977) spark-ec2 start resets all the spark/conf configurations

2014-12-27 Thread Noah Young (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259538#comment-14259538 ] Noah Young commented on SPARK-4977: --- I like option 2. Just having

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2014-12-27 Thread Devan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259549#comment-14259549 ] Devan commented on SPARK-4631: -- Hi I like to work on adding mqtt unit test if no one already

[jira] [Updated] (SPARK-4585) Spark dynamic executor allocation shouldn't use maxExecutors as initial number

2014-12-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-4585: -- Summary: Spark dynamic executor allocation shouldn't use maxExecutors as initial number (was: Spark

[jira] [Commented] (SPARK-4921) Performance issue caused by TaskSetManager returning PROCESS_LOCAL for NO_PREF tasks

2014-12-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259562#comment-14259562 ] Apache Spark commented on SPARK-4921: - User 'sryza' has created a pull request for