[jira] [Assigned] (SPARK-1061) allow Hadoop RDDs to be read w/ a partitioner

[ https://issues.apache.org/jira/browse/SPARK-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-1061: --- Assignee: Imran Rashid > allow Hadoop RDDs to be read w/ a partitioner >

[jira] [Commented] (SPARK-1061) allow Hadoop RDDs to be read w/ a partitioner

[ https://issues.apache.org/jira/browse/SPARK-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310589#comment-14310589 ] Apache Spark commented on SPARK-1061: - User 'squito' has created a pull request for th

[jira] [Created] (SPARK-5663) Delete appStagingDir on local file system

Weizhong created SPARK-5663: --- Summary: Delete appStagingDir on local file system Key: SPARK-5663 URL: https://issues.apache.org/jira/browse/SPARK-5663 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-5662) Flaky test: org.apache.spark.streaming.kafka.KafkaDirectStreamSuite.multi topic stream

[ https://issues.apache.org/jira/browse/SPARK-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5662: --- Priority: Critical (was: Major) > Flaky test: org.apache.spark.streaming.kafka.KafkaDirectStr

[jira] [Created] (SPARK-5662) Flaky test: org.apache.spark.streaming.kafka.KafkaDirectStreamSuite.multi topic stream

Patrick Wendell created SPARK-5662: -- Summary: Flaky test: org.apache.spark.streaming.kafka.KafkaDirectStreamSuite.multi topic stream Key: SPARK-5662 URL: https://issues.apache.org/jira/browse/SPARK-5662

[jira] [Commented] (SPARK-5661) function hasShutdownDeleteTachyonDir should use shutdownDeleteTachyonPaths to determine whether contains file

[ https://issues.apache.org/jira/browse/SPARK-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310378#comment-14310378 ] Apache Spark commented on SPARK-5661: - User 'viper-kun' has created a pull request for

[jira] [Created] (SPARK-5661) function hasShutdownDeleteTachyonDir should use shutdownDeleteTachyonPaths to determine whether contains file

xukun created SPARK-5661: Summary: function hasShutdownDeleteTachyonDir should use shutdownDeleteTachyonPaths to determine whether contains file Key: SPARK-5661 URL: https://issues.apache.org/jira/browse/SPARK-5661

[jira] [Commented] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

[ https://issues.apache.org/jira/browse/SPARK-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310266#comment-14310266 ] Josh Rosen commented on SPARK-5626: --- It's probably easiest to just replace our use of Ea

[jira] [Commented] (SPARK-5660) Local Matrix apply should be public

[ https://issues.apache.org/jira/browse/SPARK-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310237#comment-14310237 ] Apache Spark commented on SPARK-5660: - User 'jkbradley' has created a pull request for

[jira] [Updated] (SPARK-5660) Local Matrix apply should be public

[ https://issues.apache.org/jira/browse/SPARK-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5660: - Summary: Local Matrix apply should be public (was: DenseMatrix, SparseMatrix apply should

[jira] [Updated] (SPARK-5660) Local Matrix apply should be public

[ https://issues.apache.org/jira/browse/SPARK-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5660: - Description: Matrix, DenseMatrix, SparseMatrix apply(i,j) should be public. Otherwise, th

[jira] [Created] (SPARK-5660) DenseMatrix, SparseMatrix apply should be public

Joseph K. Bradley created SPARK-5660: Summary: DenseMatrix, SparseMatrix apply should be public Key: SPARK-5660 URL: https://issues.apache.org/jira/browse/SPARK-5660 Project: Spark Issue

[jira] [Resolved] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5388. Resolution: Fixed Fix Version/s: 1.3.0 > Provide a stable application submission gate

[jira] [Updated] (SPARK-5403) Ignore UserKnownHostsFile in SSH calls

[ https://issues.apache.org/jira/browse/SPARK-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5403: -- Assignee: Grzegorz Dubicki > Ignore UserKnownHostsFile in SSH calls > --

[jira] [Updated] (SPARK-5659) Flaky Test: org.apache.spark.streaming.ReceiverSuite.block

[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5659: --- Labels: flaky-test (was: ) > Flaky Test: org.apache.spark.streaming.ReceiverSuite.block > ---

[jira] [Updated] (SPARK-5659) Flaky Test: org.apache.spark.streaming.ReceiverSuite.block

[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5659: --- Priority: Critical (was: Major) > Flaky Test: org.apache.spark.streaming.ReceiverSuite.block

[jira] [Created] (SPARK-5659) Flaky Test: org.apache.spark.streaming.ReceiverSuite.block

Patrick Wendell created SPARK-5659: -- Summary: Flaky Test: org.apache.spark.streaming.ReceiverSuite.block Key: SPARK-5659 URL: https://issues.apache.org/jira/browse/SPARK-5659 Project: Spark

[jira] [Resolved] (SPARK-5403) Ignore UserKnownHostsFile in SSH calls

[ https://issues.apache.org/jira/browse/SPARK-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5403. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4196 [https://github.com/

[jira] [Resolved] (SPARK-5601) Make streaming algorithms Java-friendly

[ https://issues.apache.org/jira/browse/SPARK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5601. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4432 [https://githu

[jira] [Commented] (SPARK-5658) Finalize DDL and write support APIs

[ https://issues.apache.org/jira/browse/SPARK-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310194#comment-14310194 ] Apache Spark commented on SPARK-5658: - User 'yhuai' has created a pull request for thi

[jira] [Created] (SPARK-5658) Finalize DDL and write support APIs

Yin Huai created SPARK-5658: --- Summary: Finalize DDL and write support APIs Key: SPARK-5658 URL: https://issues.apache.org/jira/browse/SPARK-5658 Project: Spark Issue Type: Improvement Com

[jira] [Commented] (SPARK-1823) ExternalAppendOnlyMap can still OOM if one key is very large

[ https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310162#comment-14310162 ] Sean Owen commented on SPARK-1823: -- NP I might misclassify a few of these with the bulk c

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310161#comment-14310161 ] Sean Owen commented on SPARK-5531: -- What do you mean? nobody changed the site. I'll recap

[jira] [Updated] (SPARK-2996) Standalone and Yarn have different settings for adding the user classpath first

[ https://issues.apache.org/jira/browse/SPARK-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2996: - Priority: Major (was: Minor) > Standalone and Yarn have different settings for adding the user classpath

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310147#comment-14310147 ] DeepakVohra commented on SPARK-5531: Thanks for updating the download links. > Spark

[jira] [Comment Edited] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310130#comment-14310130 ] Sandy Ryza edited comment on SPARK-4550 at 2/6/15 11:13 PM: I

[jira] [Comment Edited] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310130#comment-14310130 ] Sandy Ryza edited comment on SPARK-4550 at 2/6/15 11:13 PM: I

[jira] [Updated] (SPARK-1823) ExternalAppendOnlyMap can still OOM if one key is very large

[ https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1823: - Component/s: (was: PySpark) Spark Core > ExternalAppendOnlyMap can still OOM if one k

[jira] [Commented] (SPARK-1823) ExternalAppendOnlyMap can still OOM if one key is very large

[ https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310133#comment-14310133 ] Andrew Or commented on SPARK-1823: -- Hey [~srowen] this issue belongs more to the Core com

[jira] [Updated] (SPARK-2722) Mechanism for escaping spark configs is not consistent

[ https://issues.apache.org/jira/browse/SPARK-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2722: - Component/s: Spark Core > Mechanism for escaping spark configs is not consistent > ---

[jira] [Updated] (SPARK-2722) Mechanism for escaping spark configs is not consistent

[ https://issues.apache.org/jira/browse/SPARK-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2722: - Priority: Major (was: Minor) > Mechanism for escaping spark configs is not consistent > -

[jira] [Commented] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310130#comment-14310130 ] Sandy Ryza commented on SPARK-4550: --- I got a working prototype and benchmarked the Exter

[jira] [Commented] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310131#comment-14310131 ] Andrew Or commented on SPARK-2914: -- I think these two describe the same issues, but the d

[jira] [Comment Edited] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310130#comment-14310130 ] Sandy Ryza edited comment on SPARK-4550 at 2/6/15 11:08 PM: I

[jira] [Closed] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2914. Resolution: Duplicate > spark.*.extraJavaOptions are evaluated too many times >

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310118#comment-14310118 ] Sean Owen commented on SPARK-5654: -- (SGTM, that's good authoritative reasoning. I was mos

[jira] [Updated] (SPARK-4343) Mima considers protected API methods for exclusion from binary checks.

[ https://issues.apache.org/jira/browse/SPARK-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4343: - Component/s: Build Priority: Minor (was: Major) Are you saying that it should or should not flag p

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4066: - Component/s: Build > Make whether maven builds fails on scalastyle violation configurable > --

[jira] [Updated] (SPARK-3451) spark-submit should support specifying glob wildcards in the --jars CLI option

[ https://issues.apache.org/jira/browse/SPARK-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3451: - Component/s: Spark Submit Priority: Minor (was: Major) > spark-submit should support specifying gl

[jira] [Resolved] (SPARK-4996) Memory leak?

[ https://issues.apache.org/jira/browse/SPARK-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4996. -- Resolution: Not a Problem Target Version/s: (was: 1.3.0, 1.2.1) > Memory leak? > ---

[jira] [Closed] (SPARK-4994) Cleanup removed executors' ShuffleInfo in yarn shuffle service

[ https://issues.apache.org/jira/browse/SPARK-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4994. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Lianhui Wang Target Version/s:

[jira] [Updated] (SPARK-4541) Add --version to spark-submit

[ https://issues.apache.org/jira/browse/SPARK-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4541: - Component/s: Spark Submit > Add --version to spark-submit > - > >

[jira] [Updated] (SPARK-5041) hive-exec jar should be generated with JDK 6

[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5041: - Component/s: SQL > hive-exec jar should be generated with JDK 6 >

[jira] [Updated] (SPARK-4985) Parquet support for date type

[ https://issues.apache.org/jira/browse/SPARK-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4985: - Component/s: SQL > Parquet support for date type > - > > Key:

[jira] [Commented] (SPARK-5533) Replace explicit dependency on org.codehaus.jackson

[ https://issues.apache.org/jira/browse/SPARK-5533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310086#comment-14310086 ] Sean Owen commented on SPARK-5533: -- As far as I can tell, Spark only directly uses the ne

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310076#comment-14310076 ] Andrew Or commented on SPARK-5388: -- Great nullable booleans and numbers are all I'm looki

[jira] [Closed] (SPARK-5444) 'spark.blockManager.port' conflict in netty service

[ https://issues.apache.org/jira/browse/SPARK-5444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5444. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: SaintBacchus Target Version/s:

[jira] [Commented] (SPARK-5597) Model import/export for DecisionTree and ensembles

[ https://issues.apache.org/jira/browse/SPARK-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310068#comment-14310068 ] Apache Spark commented on SPARK-5597: - User 'jkbradley' has created a pull request for

[jira] [Updated] (SPARK-2153) CassandraTest fails for newer Cassandra due to case insensitive key space

[ https://issues.apache.org/jira/browse/SPARK-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2153: - Fix Version/s: (was: 1.0.0) > CassandraTest fails for newer Cassandra due to case insensitive key spac

[jira] [Updated] (SPARK-3917) Compress data before network transfer

[ https://issues.apache.org/jira/browse/SPARK-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3917: - Fix Version/s: (was: 1.1.0) > Compress data before network transfer >

[jira] [Updated] (SPARK-1928) DAGScheduler suspended by local task OOM

[ https://issues.apache.org/jira/browse/SPARK-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1928: - Fix Version/s: (was: 1.0.0) > DAGScheduler suspended by local task OOM > -

[jira] [Updated] (SPARK-1858) Update "third-party Hadoop distros" doc to list more distros

[ https://issues.apache.org/jira/browse/SPARK-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1858: - Fix Version/s: (was: 1.0.0) > Update "third-party Hadoop distros" doc to list more distros > -

[jira] [Updated] (SPARK-1715) Ensure actor is self-contained in DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1715: - Fix Version/s: (was: 1.0.1) > Ensure actor is self-contained in DAGScheduler > ---

[jira] [Updated] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

[ https://issues.apache.org/jira/browse/SPARK-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4180: - Fix Version/s: (was: 1.2.0) > SparkContext constructor should throw exception if another SparkContext

[jira] [Updated] (SPARK-5175) bug in updating counters when starting multiple workers/supervisors in actor-based receiver

[ https://issues.apache.org/jira/browse/SPARK-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5175: - Fix Version/s: (was: 1.2.0) > bug in updating counters when starting multiple workers/supervisors in

[jira] [Updated] (SPARK-1270) An optimized gradient descent implementation

[ https://issues.apache.org/jira/browse/SPARK-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1270: - Fix Version/s: (was: 1.0.0) > An optimized gradient descent implementation > -

[jira] [Updated] (SPARK-3586) Support nested directories in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3586: - Fix Version/s: (was: 1.1.0) > Support nested directories in Spark Streaming >

[jira] [Updated] (SPARK-1351) Documentation Improvements for Spark 1.0

[ https://issues.apache.org/jira/browse/SPARK-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1351: - Fix Version/s: (was: 1.0.0) > Documentation Improvements for Spark 1.0 > -

[jira] [Updated] (SPARK-1155) Clean up and document use of SparkEnv

[ https://issues.apache.org/jira/browse/SPARK-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1155: - Fix Version/s: (was: 1.0.0) > Clean up and document use of SparkEnv >

[jira] [Updated] (SPARK-4205) Timestamp and Date objects with comparison operators

[ https://issues.apache.org/jira/browse/SPARK-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4205: - Fix Version/s: (was: 1.1.0) > Timestamp and Date objects with comparison operators > -

[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2914: - Fix Version/s: (was: 1.2.0) > spark.*.extraJavaOptions are evaluated too many times >

[jira] [Updated] (SPARK-4012) Uncaught OOM in ContextCleaner

[ https://issues.apache.org/jira/browse/SPARK-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4012: - Fix Version/s: (was: 1.1.0) > Uncaught OOM in ContextCleaner > -- > >

[jira] [Updated] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-928: Fix Version/s: (was: 1.0.0) > Add support for Unsafe-based serializer in Kryo 2.22 >

[jira] [Updated] (SPARK-5259) Fix endless retry stage by add task equal() and hashcode() to avoid stage.pendingTasks not empty while stage map output is available

[ https://issues.apache.org/jira/browse/SPARK-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5259: - Fix Version/s: (was: 1.2.0) > Fix endless retry stage by add task equal() and hashcode() to avoid > s

[jira] [Updated] (SPARK-4874) Report number of records read/written in a task

[ https://issues.apache.org/jira/browse/SPARK-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4874: --- Component/s: Web UI Spark Core > Report number of records read/written in a t

[jira] [Resolved] (SPARK-4874) Report number of records read/written in a task

[ https://issues.apache.org/jira/browse/SPARK-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4874. Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: 1.3.0 > Report num

[jira] [Closed] (SPARK-5600) Sort order of unfinished apps can be wrong in History Server

[ https://issues.apache.org/jira/browse/SPARK-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5600. Resolution: Fixed Assignee: Marcelo Vanzin Target Version/s: 1.3.0 > Sort order of unf

[jira] [Resolved] (SPARK-4492) Exception when following SimpleApp tutorial java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4492. -- Resolution: Not a Problem > Exception when following SimpleApp tutorial java.lang.ClassNotFoundException

[jira] [Updated] (SPARK-2802) Improve the Cassandra sample and Add a new sample for Streaming to Cassandra

[ https://issues.apache.org/jira/browse/SPARK-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2802: - Component/s: Streaming > Improve the Cassandra sample and Add a new sample for Streaming to Cassandra > --

[jira] [Updated] (SPARK-5066) Can not get all key that has same hashcode when reading key ordered from different Streaming.

[ https://issues.apache.org/jira/browse/SPARK-5066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5066: - Component/s: Streaming > Can not get all key that has same hashcode when reading key ordered from > dif

[jira] [Updated] (SPARK-4557) Spark Streaming' foreachRDD method should accept a VoidFunction<...>, not a Function<..., Void>

[ https://issues.apache.org/jira/browse/SPARK-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4557: - Component/s: Streaming > Spark Streaming' foreachRDD method should accept a VoidFunction<...>, not a > Fu

[jira] [Updated] (SPARK-5615) Fix testPackage in StreamingContextSuite

[ https://issues.apache.org/jira/browse/SPARK-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5615: - Component/s: Streaming > Fix testPackage in StreamingContextSuite > --

[jira] [Updated] (SPARK-4174) Streaming: Optionally provide notifications to Receivers when DStream has been generated

[ https://issues.apache.org/jira/browse/SPARK-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4174: - Component/s: Streaming > Streaming: Optionally provide notifications to Receivers when DStream has > been

[jira] [Updated] (SPARK-5001) BlockRDD removed unreasonablly in streaming

[ https://issues.apache.org/jira/browse/SPARK-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5001: - Component/s: Streaming > BlockRDD removed unreasonablly in streaming > ---

[jira] [Updated] (SPARK-4600) org.apache.spark.graphx.VertexRDD.diff does not work

[ https://issues.apache.org/jira/browse/SPARK-4600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4600: - Component/s: GraphX > org.apache.spark.graphx.VertexRDD.diff does not work > -

[jira] [Updated] (SPARK-1159) Add Shortest-path computations to graphx.lib

[ https://issues.apache.org/jira/browse/SPARK-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1159: - Component/s: GraphX > Add Shortest-path computations to graphx.lib > -

[jira] [Updated] (SPARK-4591) Add algorithm/model wrappers in spark.ml to adapt the new API

[ https://issues.apache.org/jira/browse/SPARK-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4591: - Component/s: ML > Add algorithm/model wrappers in spark.ml to adapt the new API >

[jira] [Updated] (SPARK-1270) An optimized gradient descent implementation

[ https://issues.apache.org/jira/browse/SPARK-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1270: - Component/s: MLlib > An optimized gradient descent implementation > --

[jira] [Updated] (SPARK-2623) Stacked Auto Encoder (Deep Learning )

[ https://issues.apache.org/jira/browse/SPARK-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2623: - Component/s: MLlib > Stacked Auto Encoder (Deep Learning ) > - > >

[jira] [Updated] (SPARK-1014) MultilogisticRegressionWithSGD

[ https://issues.apache.org/jira/browse/SPARK-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1014: - Component/s: MLlib > MultilogisticRegressionWithSGD > -- > > K

[jira] [Updated] (SPARK-5194) ADD JAR doesn't update classpath until reconnect

[ https://issues.apache.org/jira/browse/SPARK-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5194: - Component/s: SQL > ADD JAR doesn't update classpath until reconnect >

[jira] [Updated] (SPARK-3365) Failure to save Lists to Parquet

[ https://issues.apache.org/jira/browse/SPARK-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3365: - Component/s: SQL > Failure to save Lists to Parquet > > >

[jira] [Updated] (SPARK-5236) java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.MutableAny cannot be cast to org.apache.spark.sql.catalyst.expressions.MutableInt

[ https://issues.apache.org/jira/browse/SPARK-5236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5236: - Component/s: SQL > java.lang.ClassCastException: > org.apache.spark.sql.catalyst.expressions.MutableAny c

[jira] [Updated] (SPARK-3753) Spark hive join results in empty with shared hive context

[ https://issues.apache.org/jira/browse/SPARK-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3753: - Component/s: SQL > Spark hive join results in empty with shared hive context > ---

[jira] [Updated] (SPARK-5109) Loading multiple parquet files into a single SchemaRDD

[ https://issues.apache.org/jira/browse/SPARK-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5109: - Component/s: SQL > Loading multiple parquet files into a single SchemaRDD > --

[jira] [Closed] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5613. Resolution: Fixed Fix Version/s: (was: 1.2.1) (was: 1.2.0)

[jira] [Updated] (SPARK-3113) Using local spark-submit with an EC2 cluster fails to execute job

[ https://issues.apache.org/jira/browse/SPARK-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3113: - Component/s: EC2 > Using local spark-submit with an EC2 cluster fails to execute job > ---

[jira] [Updated] (SPARK-1423) Add scripts for launching Spark on Windows Azure

[ https://issues.apache.org/jira/browse/SPARK-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1423: - Component/s: Windows > Add scripts for launching Spark on Windows Azure >

[jira] [Updated] (SPARK-3284) saveAsParquetFile not working on windows

[ https://issues.apache.org/jira/browse/SPARK-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3284: - Component/s: Windows > saveAsParquetFile not working on windows >

[jira] [Updated] (SPARK-1016) When running examples jar (compiled with maven) logs don't initialize properly

[ https://issues.apache.org/jira/browse/SPARK-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1016: - Component/s: Examples > When running examples jar (compiled with maven) logs don't initialize properly > -

[jira] [Updated] (SPARK-4628) Put external projects and examples behind a build flag

[ https://issues.apache.org/jira/browse/SPARK-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4628: - Component/s: Examples > Put external projects and examples behind a build flag > -

[jira] [Updated] (SPARK-5185) pyspark --jars does not add classes to driver class path

[ https://issues.apache.org/jira/browse/SPARK-5185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5185: - Component/s: PySpark > pyspark --jars does not add classes to driver class path >

[jira] [Resolved] (SPARK-4360) task only execute on one node when spark on yarn

[ https://issues.apache.org/jira/browse/SPARK-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4360. -- Resolution: Cannot Reproduce > task only execute on one node when spark on yarn > --

[jira] [Updated] (SPARK-5589) Split pyspark/sql.py into multiple files

[ https://issues.apache.org/jira/browse/SPARK-5589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5589: - Component/s: PySpark > Split pyspark/sql.py into multiple files >

[jira] [Updated] (SPARK-3316) Spark driver will not exit after python program finished

[ https://issues.apache.org/jira/browse/SPARK-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3316: - Component/s: PySpark > Spark driver will not exit after python program finished >

[jira] [Updated] (SPARK-1823) ExternalAppendOnlyMap can still OOM if one key is very large

[ https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1823: - Component/s: PySpark > ExternalAppendOnlyMap can still OOM if one key is very large >

[jira] [Updated] (SPARK-2971) Orphaned YARN ApplicationMaster lingers forever

[ https://issues.apache.org/jira/browse/SPARK-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2971: - Component/s: YARN > Orphaned YARN ApplicationMaster lingers forever >

[jira] [Updated] (SPARK-5369) remove allocatedHostToContainersMap.synchronized in YarnAllocator

[ https://issues.apache.org/jira/browse/SPARK-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5369: - Component/s: YARN > remove allocatedHostToContainersMap.synchronized in YarnAllocator > --

[jira] [Updated] (SPARK-4360) task only execute on one node when spark on yarn

[ https://issues.apache.org/jira/browse/SPARK-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4360: - Component/s: YARN > task only execute on one node when spark on yarn > ---

[jira] [Updated] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5613: - Component/s: YARN > YarnClientSchedulerBackend fails to get application report when yarn restarts > --

  1   2   3   >