[jira] [Commented] (SPARK-1392) Local spark-shell Runs Out of Memory With Default Settings

[ https://issues.apache.org/jira/browse/SPARK-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039946#comment-14039946 ] Patrick Wendell commented on SPARK-1392: I mentioned this on the pull request, but

[jira] [Commented] (SPARK-1392) Local spark-shell Runs Out of Memory With Default Settings

[ https://issues.apache.org/jira/browse/SPARK-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039953#comment-14039953 ] Patrick Wendell commented on SPARK-1392: Okay great, I confirmed this is fixed by

[jira] [Comment Edited] (SPARK-1392) Local spark-shell Runs Out of Memory With Default Settings

[ https://issues.apache.org/jira/browse/SPARK-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039953#comment-14039953 ] Patrick Wendell edited comment on SPARK-1392 at 6/21/14 9:15 PM:

[jira] [Resolved] (SPARK-1392) Local spark-shell Runs Out of Memory With Default Settings

[ https://issues.apache.org/jira/browse/SPARK-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1392. Resolution: Duplicate Local spark-shell Runs Out of Memory With Default Settings

[jira] [Resolved] (SPARK-1996) Remove use of special Maven repo for Akka

[ https://issues.apache.org/jira/browse/SPARK-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1996. Resolution: Fixed Fix Version/s: (was: 1.0.1) 1.1.0 Fixed

[jira] [Created] (SPARK-2230) Improvements to Jenkins QA Harness

Patrick Wendell created SPARK-2230: -- Summary: Improvements to Jenkins QA Harness Key: SPARK-2230 URL: https://issues.apache.org/jira/browse/SPARK-2230 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-2231) dev/run-tests should include YARN and use a recent Hadoop version

Patrick Wendell created SPARK-2231: -- Summary: dev/run-tests should include YARN and use a recent Hadoop version Key: SPARK-2231 URL: https://issues.apache.org/jira/browse/SPARK-2231 Project: Spark

[jira] [Created] (SPARK-2232) Fix Jenkins tests in Maven

Patrick Wendell created SPARK-2232: -- Summary: Fix Jenkins tests in Maven Key: SPARK-2232 URL: https://issues.apache.org/jira/browse/SPARK-2232 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-1804) Mark 0.9.1 as released in JIRA

[ https://issues.apache.org/jira/browse/SPARK-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1804. Resolution: Fixed Mark 0.9.1 as released in JIRA --

[jira] [Resolved] (SPARK-1803) Rename test resources to be compatible with Windows FS

[ https://issues.apache.org/jira/browse/SPARK-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1803. Resolution: Fixed Resolved via: https://github.com/apache/spark/pull/739 Rename test

[jira] [Resolved] (SPARK-721) Fix remaining deprecation warnings

[ https://issues.apache.org/jira/browse/SPARK-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-721. --- Resolution: Fixed Assignee: (was: Gary Struthers) Fix remaining deprecation

[jira] [Created] (SPARK-2233) make-distribution script should list the git hash in the RELEASE file

Patrick Wendell created SPARK-2233: -- Summary: make-distribution script should list the git hash in the RELEASE file Key: SPARK-2233 URL: https://issues.apache.org/jira/browse/SPARK-2233 Project:

[jira] [Updated] (SPARK-2233) make-distribution script should list the git hash in the RELEASE file

[ https://issues.apache.org/jira/browse/SPARK-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2233: --- Issue Type: Improvement (was: Bug) make-distribution script should list the git hash in

[jira] [Resolved] (SPARK-2231) dev/run-tests should include YARN and use a recent Hadoop version

[ https://issues.apache.org/jira/browse/SPARK-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2231. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1175

[jira] [Updated] (SPARK-2034) KafkaInputDStream doesn't close resources and may prevent JVM shutdown

[ https://issues.apache.org/jira/browse/SPARK-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2034: --- Assignee: Sean Owen KafkaInputDStream doesn't close resources and may prevent JVM shutdown

[jira] [Updated] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2156: --- Target Version/s: 0.9.2, 1.0.1, 1.1.0 (was: 0.9.2, 1.0.1) When the size of serialized

[jira] [Updated] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1112: --- Fix Version/s: 1.0.1 When spark.akka.frameSize 10, task results bigger than 10MiB block

[jira] [Updated] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2156: --- Fix Version/s: 1.0.1 When the size of serialized results for one partition is slightly

[jira] [Updated] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1112: --- Target Version/s: 0.9.2, 1.0.1, 1.1.0 (was: 0.9.2, 1.0.1) When spark.akka.frameSize 10,

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040360#comment-14040360 ] Patrick Wendell commented on SPARK-2156: This is fixed in the 1.0 branch via:

[jira] [Updated] (SPARK-2241) EC2 script should handle quoted arguments correctly

[ https://issues.apache.org/jira/browse/SPARK-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2241: --- Description: We should pass quoted arguments correctly to the underlying ec2 script in

[jira] [Created] (SPARK-2241) EC2 script should handle quoted arguments correctly

Patrick Wendell created SPARK-2241: -- Summary: EC2 script should handle quoted arguments correctly Key: SPARK-2241 URL: https://issues.apache.org/jira/browse/SPARK-2241 Project: Spark Issue

[jira] [Updated] (SPARK-2241) EC2 script should handle quoted arguments correctly

[ https://issues.apache.org/jira/browse/SPARK-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2241: --- Description: We should pass quoted arguments correctly to the underlying ec2 in spark-ec2

[jira] [Resolved] (SPARK-2241) EC2 script should handle quoted arguments correctly

[ https://issues.apache.org/jira/browse/SPARK-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2241. Resolution: Fixed Fix Version/s: 1.1.0 0.9.2

[jira] [Resolved] (SPARK-2166) Enumerating instances to be terminated before the prompting the users to continue.

[ https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2166. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 270

[jira] [Updated] (SPARK-2228) onStageSubmitted does not properly called so NoSuchElement will be thrown in onStageCompleted

[ https://issues.apache.org/jira/browse/SPARK-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2228: --- Target Version/s: 1.0.1, 1.1.0 onStageSubmitted does not properly called so NoSuchElement

[jira] [Updated] (SPARK-2228) onStageSubmitted does not properly called so NoSuchElement will be thrown in onStageCompleted

[ https://issues.apache.org/jira/browse/SPARK-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2228: --- Affects Version/s: (was: 1.1.0) onStageSubmitted does not properly called so

[jira] [Resolved] (SPARK-2118) If tools jar is not present, MIMA build should exit with an exception

[ https://issues.apache.org/jira/browse/SPARK-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2118. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1068

[jira] [Resolved] (SPARK-1768) History Server enhancements

[ https://issues.apache.org/jira/browse/SPARK-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1768. Resolution: Fixed Issue resolved by pull request 718

[jira] [Updated] (SPARK-2204) Scheduler for Mesos in fine-grained mode launches tasks on wrong executors

[ https://issues.apache.org/jira/browse/SPARK-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2204: --- Target Version/s: 1.0.1, 1.1.0 Scheduler for Mesos in fine-grained mode launches tasks on

[jira] [Created] (SPARK-2264) CachedTableSuite SQL Tests are Failing

Patrick Wendell created SPARK-2264: -- Summary: CachedTableSuite SQL Tests are Failing Key: SPARK-2264 URL: https://issues.apache.org/jira/browse/SPARK-2264 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-2269) Clean up and add unit tests for resourceOffers in MesosSchedulerBackend

Patrick Wendell created SPARK-2269: -- Summary: Clean up and add unit tests for resourceOffers in MesosSchedulerBackend Key: SPARK-2269 URL: https://issues.apache.org/jira/browse/SPARK-2269 Project:

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042962#comment-14042962 ] Patrick Wendell commented on SPARK-2156: Fixed in 1.1.0 via:

[jira] [Resolved] (SPARK-2248) spark.default.parallelism does not apply in local mode

[ https://issues.apache.org/jira/browse/SPARK-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2248. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1194

[jira] [Commented] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043738#comment-14043738 ] Patrick Wendell commented on SPARK-1112: [~reachbach] If you are running on

[jira] [Reopened] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-1112: This is not resolved yet because it needs to be back ported into 0.9 When

[jira] [Updated] (SPARK-2269) Clean up and add unit tests for resourceOffers in MesosSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2269: --- Description: This function could be simplified a bit. We could re-write it without

[jira] [Resolved] (SPARK-2270) Kryo cannot serialize results returned by asJavaIterable (and thus groupBy/cogroup are broken in Java APIs when Kryo is used)

[ https://issues.apache.org/jira/browse/SPARK-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2270. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by

[jira] [Resolved] (SPARK-2204) Scheduler for Mesos in fine-grained mode launches tasks on wrong executors

[ https://issues.apache.org/jira/browse/SPARK-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2204. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by

[jira] [Updated] (SPARK-1912) Compression memory issue during reduce

[ https://issues.apache.org/jira/browse/SPARK-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1912: --- Fix Version/s: 0.9.2 Compression memory issue during reduce

[jira] [Updated] (SPARK-1912) Compression memory issue during reduce

[ https://issues.apache.org/jira/browse/SPARK-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1912: --- Fix Version/s: 1.0.1 Compression memory issue during reduce

[jira] [Commented] (SPARK-2279) JavaSparkContext should allow creation of EmptyRDD

[ https://issues.apache.org/jira/browse/SPARK-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14044063#comment-14044063 ] Patrick Wendell commented on SPARK-2279: I think `EmtpyRDD` is a mostly internal

[jira] [Commented] (SPARK-2266) Log page on Worker UI displays Some(app-id)

[ https://issues.apache.org/jira/browse/SPARK-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14044070#comment-14044070 ] Patrick Wendell commented on SPARK-2266: Resolved by:

[jira] [Resolved] (SPARK-2266) Log page on Worker UI displays Some(app-id)

[ https://issues.apache.org/jira/browse/SPARK-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2266. Resolution: Fixed Fix Version/s: 1.0.1 Log page on Worker UI displays Some(app-id)

[jira] [Commented] (SPARK-985) Support Job Cancellation on Mesos Scheduler

[ https://issues.apache.org/jira/browse/SPARK-985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14044079#comment-14044079 ] Patrick Wendell commented on SPARK-985: --- Some more notes on this from a related

[jira] [Updated] (SPARK-985) Support Job Cancellation on Mesos Scheduler

[ https://issues.apache.org/jira/browse/SPARK-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-985: -- Component/s: Mesos Support Job Cancellation on Mesos Scheduler

[jira] [Updated] (SPARK-2204) Scheduler for Mesos in fine-grained mode launches tasks on wrong executors

[ https://issues.apache.org/jira/browse/SPARK-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2204: --- Assignee: Sebastien Rainville Scheduler for Mesos in fine-grained mode launches tasks on

[jira] [Resolved] (SPARK-1749) DAGScheduler supervisor strategy broken with Mesos

[ https://issues.apache.org/jira/browse/SPARK-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1749. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by

[jira] [Resolved] (SPARK-2251) MLLib Naive Bayes Example SparkException: Can only zip RDDs with same number of elements in each partition

[ https://issues.apache.org/jira/browse/SPARK-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2251. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1229

[jira] [Commented] (SPARK-2279) JavaSparkContext should allow creation of EmptyRDD

[ https://issues.apache.org/jira/browse/SPARK-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14045517#comment-14045517 ] Patrick Wendell commented on SPARK-2279: Ah I see - I thought you meant the

[jira] [Resolved] (SPARK-2181) The keys for sorting the columns of Executor page in SparkUI are incorrect

[ https://issues.apache.org/jira/browse/SPARK-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2181. Resolution: Fixed Fix Version/s: 1.0.2 1.1.0 The keys for

[jira] [Commented] (SPARK-2228) onStageSubmitted does not properly called so NoSuchElement will be thrown in onStageCompleted

[ https://issues.apache.org/jira/browse/SPARK-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14045564#comment-14045564 ] Patrick Wendell commented on SPARK-2228: I ran your reproduction locally. What I

[jira] [Commented] (SPARK-2228) onStageSubmitted does not properly called so NoSuchElement will be thrown in onStageCompleted

[ https://issues.apache.org/jira/browse/SPARK-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14045626#comment-14045626 ] Patrick Wendell commented on SPARK-2228: [~rxin] unfortunately I think it's more

[jira] [Resolved] (SPARK-2291) Update EC2 scripts to use instance storage on m3 instance types

[ https://issues.apache.org/jira/browse/SPARK-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2291. Resolution: Duplicate Was already fixed by this PR:

[jira] [Comment Edited] (SPARK-2292) NullPointerException in JavaPairRDD.mapToPair

[ https://issues.apache.org/jira/browse/SPARK-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046445#comment-14046445 ] Patrick Wendell edited comment on SPARK-2292 at 6/27/14 9:54 PM:

[jira] [Updated] (SPARK-2307) SparkUI Storage page cached statuses incorrect

[ https://issues.apache.org/jira/browse/SPARK-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2307: --- Assignee: Andrew Or SparkUI Storage page cached statuses incorrect

[jira] [Resolved] (SPARK-2307) SparkUI Storage page cached statuses incorrect

[ https://issues.apache.org/jira/browse/SPARK-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2307. Resolution: Fixed Fix Version/s: 1.0.1 Issue resolved by pull request 1249

[jira] [Resolved] (SPARK-2259) Spark submit documentation for --deploy-mode is highly misleading

[ https://issues.apache.org/jira/browse/SPARK-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2259. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by

[jira] [Updated] (SPARK-2243) Support multiple SparkContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2243: --- Summary: Support multiple SparkContexts in the same JVM (was: Using several Spark Contexts)

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046574#comment-14046574 ] Patrick Wendell commented on SPARK-2243: This is not supported - but it's

[jira] [Commented] (SPARK-2111) pyspark errors when SPARK_PRINT_LAUNCH_COMMAND=1

[ https://issues.apache.org/jira/browse/SPARK-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046586#comment-14046586 ] Patrick Wendell commented on SPARK-2111: I was thinking that SPARK-2313 might be a

[jira] [Created] (SPARK-2313) PySpark should accept port via a command line argument rather than STDIN

Patrick Wendell created SPARK-2313: -- Summary: PySpark should accept port via a command line argument rather than STDIN Key: SPARK-2313 URL: https://issues.apache.org/jira/browse/SPARK-2313 Project:

[jira] [Commented] (SPARK-2228) onStageSubmitted does not properly called so NoSuchElement will be thrown in onStageCompleted

[ https://issues.apache.org/jira/browse/SPARK-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046940#comment-14046940 ] Patrick Wendell commented on SPARK-2228: So I dug into this more and profiled it

[jira] [Created] (SPARK-2316) StorageStatusListener should avoid O(blocks) operations

Patrick Wendell created SPARK-2316: -- Summary: StorageStatusListener should avoid O(blocks) operations Key: SPARK-2316 URL: https://issues.apache.org/jira/browse/SPARK-2316 Project: Spark

[jira] [Commented] (SPARK-2228) onStageSubmitted does not properly called so NoSuchElement will be thrown in onStageCompleted

[ https://issues.apache.org/jira/browse/SPARK-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046943#comment-14046943 ] Patrick Wendell commented on SPARK-2228: I've created SPARK-2316 to deal with the

[jira] [Commented] (SPARK-2292) NullPointerException in JavaPairRDD.mapToPair

[ https://issues.apache.org/jira/browse/SPARK-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046946#comment-14046946 ] Patrick Wendell commented on SPARK-2292: [~aash] With your example code I was able

[jira] [Updated] (SPARK-2233) make-distribution script should list the git hash in the RELEASE file

[ https://issues.apache.org/jira/browse/SPARK-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2233: --- Assignee: Guillaume Ballet make-distribution script should list the git hash in the RELEASE

[jira] [Resolved] (SPARK-2233) make-distribution script should list the git hash in the RELEASE file

[ https://issues.apache.org/jira/browse/SPARK-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2233. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1216

[jira] [Commented] (SPARK-2292) NullPointerException in JavaPairRDD.mapToPair

[ https://issues.apache.org/jira/browse/SPARK-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047039#comment-14047039 ] Patrick Wendell commented on SPARK-2292: It would still be good to debug and fix

[jira] [Resolved] (SPARK-2003) SparkContext(SparkConf) doesn't work in pyspark

[ https://issues.apache.org/jira/browse/SPARK-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2003. Resolution: Won't Fix SparkContext(SparkConf) doesn't work in pyspark

[jira] [Commented] (SPARK-2003) SparkContext(SparkConf) doesn't work in pyspark

[ https://issues.apache.org/jira/browse/SPARK-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049456#comment-14049456 ] Patrick Wendell commented on SPARK-2003: If I understand correctly,

[jira] [Commented] (SPARK-1981) Add AWS Kinesis streaming support

[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049560#comment-14049560 ] Patrick Wendell commented on SPARK-1981: Assigned! Add AWS Kinesis streaming

[jira] [Resolved] (SPARK-2109) Setting SPARK_MEM for bin/pyspark does not work.

[ https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2109. Resolution: Fixed Fixed in master and 1.0 via

[jira] [Resolved] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2350. Resolution: Fixed Fix Version/s: 1.0.1 Issue resolved by pull request 1289

[jira] [Updated] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2350: --- Assignee: Aaron Davidson Master throws NPE - Key:

[jira] [Commented] (SPARK-2307) SparkUI Storage page cached statuses incorrect

[ https://issues.apache.org/jira/browse/SPARK-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052183#comment-14052183 ] Patrick Wendell commented on SPARK-2307: There was a follow up patch:

[jira] [Updated] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2350: --- Fix Version/s: 0.9.2 Master throws NPE - Key: SPARK-2350

[jira] [Resolved] (SPARK-2282) PySpark crashes if too many tasks complete quickly

[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2282. Resolution: Fixed Fix Version/s: 1.0.0 1.0.1

[jira] [Updated] (SPARK-2282) PySpark crashes if too many tasks complete quickly

[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2282: --- Affects Version/s: 0.9.1 PySpark crashes if too many tasks complete quickly

[jira] [Resolved] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1199. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Resolved via:

[jira] [Created] (SPARK-2380) Support displaying accumulator contents in the web UI

Patrick Wendell created SPARK-2380: -- Summary: Support displaying accumulator contents in the web UI Key: SPARK-2380 URL: https://issues.apache.org/jira/browse/SPARK-2380 Project: Spark

[jira] [Updated] (SPARK-2290) Do not send SPARK_HOME from workers to executors

[ https://issues.apache.org/jira/browse/SPARK-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2290: --- Issue Type: Improvement (was: Bug) Do not send SPARK_HOME from workers to executors

[jira] [Updated] (SPARK-2290) Do not send SPARK_HOME from workers to executors

[ https://issues.apache.org/jira/browse/SPARK-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2290: --- Priority: Major (was: Minor) Do not send SPARK_HOME from workers to executors

[jira] [Updated] (SPARK-2290) Do not send SPARK_HOME from workers to executors

[ https://issues.apache.org/jira/browse/SPARK-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2290: --- Assignee: Patrick Wendell Do not send SPARK_HOME from workers to executors

[jira] [Updated] (SPARK-2290) Do not send SPARK_HOME from workers to executors

[ https://issues.apache.org/jira/browse/SPARK-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2290: --- Summary: Do not send SPARK_HOME from workers to executors (was: Worker should directly use

[jira] [Commented] (SPARK-2290) Do not send SPARK_HOME from workers to executors

[ https://issues.apache.org/jira/browse/SPARK-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054633#comment-14054633 ] Patrick Wendell commented on SPARK-2290: I updated the description here. It is

[jira] [Updated] (SPARK-2348) In Windows having a enviorinment variable named 'classpath' gives error

[ https://issues.apache.org/jira/browse/SPARK-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2348: --- Assignee: Chirag Todarka In Windows having a enviorinment variable named 'classpath' gives

[jira] [Updated] (SPARK-2379) stopReceive in dead loop, cause stackoverflow exception

[ https://issues.apache.org/jira/browse/SPARK-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2379: --- Component/s: Streaming stopReceive in dead loop, cause stackoverflow exception

[jira] [Updated] (SPARK-2409) Make SQLConf thread safe

[ https://issues.apache.org/jira/browse/SPARK-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2409: --- Component/s: SQL Make SQLConf thread safe Key:

[jira] [Updated] (SPARK-2201) Improve FlumeInputDStream's stability and make it scalable

[ https://issues.apache.org/jira/browse/SPARK-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2201: --- Component/s: Streaming Improve FlumeInputDStream's stability and make it scalable

[jira] [Updated] (SPARK-2414) Remove jquery

[ https://issues.apache.org/jira/browse/SPARK-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2414: --- Component/s: Web UI Remove jquery - Key: SPARK-2414

[jira] [Updated] (SPARK-2381) streaming receiver crashed,but seems nothing happened

[ https://issues.apache.org/jira/browse/SPARK-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2381: --- Component/s: Streaming streaming receiver crashed,but seems nothing happened

[jira] [Updated] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2017: --- Component/s: Web UI web ui stage page becomes unresponsive when the number of tasks is

[jira] [Updated] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2345: --- Component/s: Streaming ForEachDStream should have an option of running the foreachfunc on

[jira] [Resolved] (SPARK-2338) Jenkins Spark-Master-Maven-with-YARN builds failing due to test misconfiguration

[ https://issues.apache.org/jira/browse/SPARK-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2338. Resolution: Fixed Assignee: Pete MacKinnon Thanks a ton for getting to the bottom of

[jira] [Created] (SPARK-2416) Allow richer reporting of unit test results

Patrick Wendell created SPARK-2416: -- Summary: Allow richer reporting of unit test results Key: SPARK-2416 URL: https://issues.apache.org/jira/browse/SPARK-2416 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2152) the error of comput rightNodeAgg about Decision tree algorithm in Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2152: --- Assignee: Jon Sondag the error of comput rightNodeAgg about Decision tree algorithm in

[jira] [Commented] (SPARK-2152) the error of comput rightNodeAgg about Decision tree algorithm in Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056157#comment-14056157 ] Patrick Wendell commented on SPARK-2152: FYI this caused some new test failures, I

[jira] [Created] (SPARK-2417) Decision tree tests fail in maven build

Patrick Wendell created SPARK-2417: -- Summary: Decision tree tests fail in maven build Key: SPARK-2417 URL: https://issues.apache.org/jira/browse/SPARK-2417 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2417) Decision tree tests are failing

[ https://issues.apache.org/jira/browse/SPARK-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2417: --- Summary: Decision tree tests are failing (was: Decision tree tests fail in maven build)

<    2   3   4   5   6   7   8   9   10   11   >