[jira] [Created] (SPARK-4972) Updated the scala doc for lasso and ridge regression for the change of LeastSquaresGradient

2014-12-26 Thread DB Tsai (JIRA)
DB Tsai created SPARK-4972: -- Summary: Updated the scala doc for lasso and ridge regression for the change of LeastSquaresGradient Key: SPARK-4972 URL: https://issues.apache.org/jira/browse/SPARK-4972

[jira] [Commented] (SPARK-4960) Interceptor pattern in receivers

2014-12-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14258994#comment-14258994 ] Saisai Shao commented on SPARK-4960: What confused me a lot is the type inference, as

[jira] [Commented] (SPARK-4972) Updated the scala doc for lasso and ridge regression for the change of LeastSquaresGradient

2014-12-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14258993#comment-14258993 ] Apache Spark commented on SPARK-4972: - User 'dbtsai' has created a pull request for

[jira] [Comment Edited] (SPARK-4960) Interceptor pattern in receivers

2014-12-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14258994#comment-14258994 ] Saisai Shao edited comment on SPARK-4960 at 12/26/14 8:47 AM: --

[jira] [Commented] (SPARK-4971) fix typo in BlockGenerator

2014-12-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14258995#comment-14258995 ] Sean Owen commented on SPARK-4971: -- I would not even bother with a JIRA for trivial

[jira] [Commented] (SPARK-4971) fix typo in BlockGenerator

2014-12-26 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14258997#comment-14258997 ] Nan Zhu commented on SPARK-4971: didn't they say every PR should be bind with a JIRA? not

[jira] [Commented] (SPARK-4971) fix typo in BlockGenerator

2014-12-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14258998#comment-14258998 ] Sean Owen commented on SPARK-4971: -- No, I think the practice has always been to skip JIRA

[jira] [Commented] (SPARK-4971) fix typo in BlockGenerator

2014-12-26 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259004#comment-14259004 ] Nan Zhu commented on SPARK-4971: I see...thanks for the explanation fix typo in

[jira] [Commented] (SPARK-4787) Resource unreleased during failure in SparkContext initialization

2014-12-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259012#comment-14259012 ] Sean Owen commented on SPARK-4787: -- You don't need it assigned really. Just open a PR.

[jira] [Commented] (SPARK-4787) Resource unreleased during failure in SparkContext initialization

2014-12-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259015#comment-14259015 ] Apache Spark commented on SPARK-4787: - User 'tigerquoll' has created a pull request

[jira] [Commented] (SPARK-4389) Set akka.remote.netty.tcp.bind-hostname=0.0.0.0 so driver can be located behind NAT

2014-12-26 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259020#comment-14259020 ] Shixiong Zhu commented on SPARK-4389: - Try to make sure I understand this issue: The

[jira] [Commented] (SPARK-4962) Put TaskScheduler.start back in SparkContext to shorten cluster resources occupation period

2014-12-26 Thread YanTang Zhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259041#comment-14259041 ] YanTang Zhai commented on SPARK-4962: - The main purpose of this PR is to decrease

[jira] [Commented] (SPARK-4962) Put TaskScheduler.start back in SparkContext to shorten cluster resources occupation period

2014-12-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259042#comment-14259042 ] Apache Spark commented on SPARK-4962: - User 'YanTangZhai' has created a pull request

[jira] [Created] (SPARK-4973) Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled

2014-12-26 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-4973: - Summary: Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled Key: SPARK-4973 URL:

[jira] [Commented] (SPARK-4973) Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled

2014-12-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259052#comment-14259052 ] Apache Spark commented on SPARK-4973: - User 'sarutak' has created a pull request for

[jira] [Commented] (SPARK-4963) SchemaRDD.sample may return wrong results

2014-12-26 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259098#comment-14259098 ] Yanbo Liang commented on SPARK-4963: I also hit this bug. In my experiment, last row

[jira] [Commented] (SPARK-4957) TaskScheduler: when no resources are available: backoff after # of tries and crash.

2014-12-26 Thread Nathan Bijnens (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259131#comment-14259131 ] Nathan Bijnens commented on SPARK-4957: --- What about a configurable hard timeout?

[jira] [Commented] (SPARK-4787) Resource unreleased during failure in SparkContext initialization

2014-12-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259202#comment-14259202 ] Josh Rosen commented on SPARK-4787: --- In general, this issue sounds like a duplicate of

[jira] [Commented] (SPARK-4971) fix typo in BlockGenerator

2014-12-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259204#comment-14259204 ] Josh Rosen commented on SPARK-4971: --- I agree with Sean: please don't file JIRAs for

[jira] [Updated] (SPARK-4971) fix typo in BlockGenerator

2014-12-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4971: -- Labels: (was: patch) fix typo in BlockGenerator -- Key:

[jira] [Resolved] (SPARK-4971) fix typo in BlockGenerator

2014-12-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4971. --- Resolution: Fixed Assignee: Nan Zhu fix typo in BlockGenerator --

[jira] [Created] (SPARK-4974) Circular dependency in pyspark/context.py causes import failure.

2014-12-26 Thread Matt Chapman (JIRA)
Matt Chapman created SPARK-4974: --- Summary: Circular dependency in pyspark/context.py causes import failure. Key: SPARK-4974 URL: https://issues.apache.org/jira/browse/SPARK-4974 Project: Spark

[jira] [Commented] (SPARK-4974) Circular dependency in pyspark/context.py causes import failure.

2014-12-26 Thread Matt Chapman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259258#comment-14259258 ] Matt Chapman commented on SPARK-4974: - First time contributor. Not sure if this is the

[jira] [Commented] (SPARK-4974) Circular dependency in pyspark/context.py causes import failure.

2014-12-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259259#comment-14259259 ] Apache Spark commented on SPARK-4974: - User 'matt2000' has created a pull request for

[jira] [Updated] (SPARK-4974) Circular dependency in pyspark/context.py causes import failure.

2014-12-26 Thread Matt Chapman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Chapman updated SPARK-4974: Description: Steps to reproduce: 1. Run a python cli from the 'python/' directory. (Reproduced

[jira] [Commented] (SPARK-4974) Circular dependency in pyspark/context.py causes import failure.

2014-12-26 Thread Matt Chapman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259278#comment-14259278 ] Matt Chapman commented on SPARK-4974: - With my patch in the PR, I ran into trouble

[jira] [Updated] (SPARK-3787) Assembly jar name is wrong when we build with sbt omitting -Dhadoop.version

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3787: --- Assignee: Kousuke Saruta Assembly jar name is wrong when we build with sbt omitting

[jira] [Updated] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3955: --- Assignee: Jongyoul Lee Different versions between jackson-mapper-asl and jackson-core-asl

[jira] [Resolved] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3955. Resolution: Fixed Fix Version/s: 1.3.0 Different versions between

[jira] [Updated] (SPARK-4954) Add spark version information in log for standalone mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4954: --- Assignee: Zhang, Liye Add spark version information in log for standalone mode

[jira] [Resolved] (SPARK-4954) Add spark version information in log for standalone mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4954. Resolution: Fixed Thanks! Add spark version information in log for standalone mode

[jira] [Updated] (SPARK-4574) Adding support for defining schema in foreign DDL commands.

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4574: --- Fix Version/s: (was: 1.2.0) 1.3.0 Adding support for defining schema

[jira] [Updated] (SPARK-4952) In some cases, spark on yarn failed to start

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4952: --- Target Version/s: 1.3.0, 1.1.2, 1.2.1 (was: 1.1.0, 1.2.0) In some cases, spark on yarn

[jira] [Updated] (SPARK-4553) query for parquet table with string fields in spark sql hive get binary result

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4553: --- Fix Version/s: (was: 1.2.0) 1.3.0 query for parquet table with string

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4422: --- Fix Version/s: (was: 1.2.0) 1.3.0 In some cases, Vectors.fromBreeze

[jira] [Updated] (SPARK-2703) Make Tachyon related unit tests execute without deploying a Tachyon system locally.

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2703: --- Fix Version/s: (was: 1.2.0) 1.3.0 Make Tachyon related unit tests

[jira] [Updated] (SPARK-4261) make right version info for beeline

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4261: --- Fix Version/s: (was: 1.2.0) 1.3.0 make right version info for beeline

[jira] [Updated] (SPARK-2722) Mechanism for escaping spark configs is not consistent

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2722: --- Fix Version/s: (was: 1.2.0) 1.3.0 Mechanism for escaping spark

[jira] [Updated] (SPARK-4362) Make prediction probability available in NaiveBayesModel

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4362: --- Fix Version/s: (was: 1.2.0) 1.3.0 Make prediction probability

[jira] [Updated] (SPARK-2795) Improve DiskBlockObjectWriter API

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2795: --- Fix Version/s: (was: 1.2.0) 1.3.0 Improve DiskBlockObjectWriter API

[jira] [Updated] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4180: --- Fix Version/s: (was: 1.2.0) 1.3.0 SparkContext constructor should

[jira] [Updated] (SPARK-2757) Add Mima test for Spark Sink after 1.10 is released

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2757: --- Fix Version/s: (was: 1.2.0) 1.3.0 Add Mima test for Spark Sink after

[jira] [Updated] (SPARK-4258) NPE with new Parquet Filters

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4258: --- Fix Version/s: (was: 1.2.0) 1.3.0 NPE with new Parquet Filters

[jira] [Updated] (SPARK-3987) NNLS generates incorrect result

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3987: --- Fix Version/s: (was: 1.2.0) 1.3.0 NNLS generates incorrect result

[jira] [Updated] (SPARK-3628) Don't apply accumulator updates multiple times for tasks in result stages

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3628: --- Fix Version/s: (was: 1.2.0) 1.3.0 Don't apply accumulator updates

[jira] [Updated] (SPARK-3379) Implement 'POWER' for sql

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3379: --- Fix Version/s: (was: 1.2.0) 1.3.0 Implement 'POWER' for sql

[jira] [Updated] (SPARK-4355) OnlineSummarizer doesn't merge mean correctly

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4355: --- Fix Version/s: (was: 1.2.0) 1.3.0 OnlineSummarizer doesn't merge mean

[jira] [Updated] (SPARK-4237) Generate right Manifest File for maven building

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4237: --- Fix Version/s: (was: 1.2.0) 1.3.0 Generate right Manifest File for

[jira] [Updated] (SPARK-3505) Augmenting SparkStreaming updateStateByKey API with timestamp

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3505: --- Fix Version/s: (was: 1.2.0) 1.3.0 Augmenting SparkStreaming

[jira] [Updated] (SPARK-2794) Use Java 7 isSymlink when available

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2794: --- Fix Version/s: (was: 1.2.0) 1.3.0 Use Java 7 isSymlink when available

[jira] [Updated] (SPARK-4449) specify port range in spark

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4449: --- Fix Version/s: (was: 1.2.0) 1.3.0 specify port range in spark

[jira] [Updated] (SPARK-2638) Improve concurrency of fetching Map outputs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2638: --- Fix Version/s: (was: 1.2.0) 1.3.0 Improve concurrency of fetching Map

[jira] [Updated] (SPARK-4184) Improve Spark Streaming documentation

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4184: --- Fix Version/s: (was: 1.2.0) 1.3.0 Improve Spark Streaming

[jira] [Updated] (SPARK-4231) Add RankingMetrics to examples.MovieLensALS

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4231: --- Fix Version/s: (was: 1.2.0) 1.3.0 Add RankingMetrics to

[jira] [Updated] (SPARK-2793) Correctly lock directory creation in DiskBlockManager.getFile

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2793: --- Fix Version/s: (was: 1.2.0) 1.3.0 Correctly lock directory creation

[jira] [Updated] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3039: --- Fix Version/s: (was: 1.2.0) 1.3.0 Spark assembly for new hadoop API

[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4006: --- Fix Version/s: (was: 1.2.0) 1.3.0 Spark Driver crashes whenever an

[jira] [Updated] (SPARK-4699) Make caseSensitive configurable in Analyzer.scala

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4699: --- Fix Version/s: (was: 1.2.0) 1.3.0 Make caseSensitive configurable in

[jira] [Updated] (SPARK-2973) Add a way to show tables without executing a job

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2973: --- Fix Version/s: (was: 1.2.0) 1.3.0 Add a way to show tables without

[jira] [Updated] (SPARK-2770) Rename spark-ganglia-lgpl to ganglia-lgpl

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2770: --- Fix Version/s: (was: 1.2.0) 1.3.0 Rename spark-ganglia-lgpl to

[jira] [Updated] (SPARK-3632) ConnectionManager can run out of receive threads with authentication on

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3632: --- Fix Version/s: (was: 1.2.0) 1.3.0 ConnectionManager can run out of

[jira] [Updated] (SPARK-3403) NaiveBayes crashes with blas/lapack native libraries for breeze (netlib-java)

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3403: --- Fix Version/s: (was: 1.2.0) 1.3.0 NaiveBayes crashes with blas/lapack

[jira] [Updated] (SPARK-4559) Adding support for ucase and lcase

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4559: --- Fix Version/s: (was: 1.2.0) 1.3.0 Adding support for ucase and lcase

[jira] [Updated] (SPARK-2913) Spark's log4j.properties should always appear ahead of Hadoop's on classpath

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2913: --- Fix Version/s: (was: 1.2.0) 1.3.0 Spark's log4j.properties should

[jira] [Updated] (SPARK-2167) spark-submit should return exit code based on failure/success

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2167: --- Fix Version/s: (was: 1.2.0) 1.3.0 spark-submit should return exit

[jira] [Updated] (SPARK-2624) Datanucleus jars not accessible in yarn-cluster mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2624: --- Fix Version/s: (was: 1.2.0) 1.3.0 Datanucleus jars not accessible in

[jira] [Updated] (SPARK-1792) Missing Spark-Shell Configure Options

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1792: --- Fix Version/s: (was: 1.2.0) 1.3.0 Missing Spark-Shell Configure

[jira] [Updated] (SPARK-1924) Make local:/ scheme work in more deploy modes

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1924: --- Fix Version/s: (was: 1.2.0) 1.3.0 Make local:/ scheme work in more

[jira] [Updated] (SPARK-2069) MIMA false positives (umbrella)

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2069: --- Fix Version/s: (was: 1.2.0) 1.3.0 MIMA false positives (umbrella)

[jira] [Updated] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1684: --- Fix Version/s: (was: 1.2.0) 1.3.0 Merge script should standardize

[jira] [Updated] (SPARK-1706) Allow multiple executors per worker in Standalone mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1706: --- Fix Version/s: (was: 1.2.0) 1.3.0 Allow multiple executors per worker

[jira] [Updated] (SPARK-1866) Closure cleaner does not null shadowed fields when outer scope is referenced

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1866: --- Fix Version/s: (was: 1.2.0) 1.3.0 Closure cleaner does not null

[jira] [Updated] (SPARK-1921) Allow duplicate jar files among the app jar and secondary jars in yarn-cluster mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1921: --- Fix Version/s: (was: 1.2.0) 1.3.0 Allow duplicate jar files among the

[jira] [Updated] (SPARK-1989) Exit executors faster if they get into a cycle of heavy GC

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1989: --- Fix Version/s: (was: 1.2.0) 1.3.0 Exit executors faster if they get

[jira] [Updated] (SPARK-2584) Do not mutate block storage level on the UI

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2584: --- Fix Version/s: (was: 1.2.0) 1.3.0 Do not mutate block storage level

[jira] [Updated] (SPARK-1911) Warn users if their assembly jars are not built with Java 6

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1911: --- Fix Version/s: (was: 1.2.0) 1.3.0 Warn users if their assembly jars

[jira] [Updated] (SPARK-2063) Creating a SchemaRDD via sql() does not correctly resolve nested types

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2063: --- Fix Version/s: (was: 1.2.0) 1.3.0 Creating a SchemaRDD via sql() does

[jira] [Updated] (SPARK-1272) Don't fail job if some local directories are buggy

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1272: --- Fix Version/s: (was: 1.2.0) 1.3.0 Don't fail job if some local

[jira] [Updated] (SPARK-1079) EC2 scripts should allow mounting as XFS or EXT4

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1079: --- Fix Version/s: (was: 1.2.0) 1.3.0 EC2 scripts should allow mounting

[jira] [Updated] (SPARK-1369) HiveUDF wrappers are slow

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1369: --- Fix Version/s: (was: 1.2.0) 1.3.0 HiveUDF wrappers are slow

[jira] [Updated] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1564: --- Fix Version/s: (was: 1.2.0) 1.3.0 Add JavaScript into Javadoc to turn

[jira] [Updated] (SPARK-1972) Add support for setting and visualizing custom task-related metrics

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1972: --- Fix Version/s: (was: 1.2.0) 1.3.0 Add support for setting and

[jira] [Updated] (SPARK-2068) Remove other uses of @transient lazy val in physical plan nodes

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2068: --- Fix Version/s: (was: 1.2.0) 1.3.0 Remove other uses of @transient

[jira] [Updated] (SPARK-1652) Fixes and improvements for spark-submit/configs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1652: --- Fix Version/s: (was: 1.2.0) 1.3.0 Fixes and improvements for

[jira] [Updated] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1021: --- Fix Version/s: (was: 1.2.0) 1.3.0 sortByKey() launches a cluster job

[jira] [Updated] (SPARK-4952) Handle ConcurrentModificationExceptions in SparkEnv.environmentDetails

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4952: --- Summary: Handle ConcurrentModificationExceptions in SparkEnv.environmentDetails (was: In

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1529: --- Fix Version/s: (was: 1.2.0) 1.3.0 Support setting spark.local.dirs to

[jira] [Resolved] (SPARK-4952) Handle ConcurrentModificationExceptions in SparkEnv.environmentDetails

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4952. Resolution: Fixed Fix Version/s: 1.2.1 1.1.2

[jira] [Updated] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1021: --- Fix Version/s: (was: 1.3.0) sortByKey() launches a cluster job when it shouldn't

[jira] [Updated] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1021: --- Target Version/s: (was: 1.2.0) sortByKey() launches a cluster job when it shouldn't

[jira] [Updated] (SPARK-1079) EC2 scripts should allow mounting as XFS or EXT4

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1079: --- Fix Version/s: (was: 1.3.0) EC2 scripts should allow mounting as XFS or EXT4

[jira] [Updated] (SPARK-1272) Don't fail job if some local directories are buggy

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1272: --- Fix Version/s: (was: 1.3.0) Don't fail job if some local directories are buggy

[jira] [Updated] (SPARK-1369) HiveUDF wrappers are slow

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1369: --- Fix Version/s: (was: 1.3.0) HiveUDF wrappers are slow -

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1529: --- Fix Version/s: (was: 1.3.0) Support setting spark.local.dirs to a hadoop FileSystem

[jira] [Updated] (SPARK-1652) Fixes and improvements for spark-submit/configs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1652: --- Fix Version/s: (was: 1.3.0) 1.2.1 Fixes and improvements for

[jira] [Updated] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1564: --- Fix Version/s: (was: 1.3.0) Add JavaScript into Javadoc to turn ::Experimental:: and

[jira] [Updated] (SPARK-1652) Fixes and improvements for spark-submit/configs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1652: --- Fix Version/s: (was: 1.2.1) 1.2.0 Fixes and improvements for

[jira] [Updated] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1684: --- Labels: starter (was: ) Merge script should standardize SPARK-XXX prefix

[jira] [Resolved] (SPARK-1652) Fixes and improvements for spark-submit/configs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1652. Resolution: Fixed Fixes and improvements for spark-submit/configs

[jira] [Updated] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1684: --- Fix Version/s: (was: 1.3.0) Merge script should standardize SPARK-XXX prefix

  1   2   >