[jira] [Created] (SPARK-2745) Add Java friendly methods to Duration class

Tathagata Das created SPARK-2745: Summary: Add Java friendly methods to Duration class Key: SPARK-2745 URL: https://issues.apache.org/jira/browse/SPARK-2745 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-2260) Spark submit standalone-cluster mode is broken

[ https://issues.apache.org/jira/browse/SPARK-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2260. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1538

[jira] [Updated] (SPARK-2560) Create Spark SQL syntax reference

[ https://issues.apache.org/jira/browse/SPARK-2560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2560: Priority: Critical (was: Major) Target Version/s: 1.1.0 Create Spark SQL

[jira] [Resolved] (SPARK-2179) Public API for DataTypes and Schema

[ https://issues.apache.org/jira/browse/SPARK-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2179. - Resolution: Fixed Fix Version/s: 1.1.0 Public API for DataTypes and Schema

[jira] [Updated] (SPARK-2543) Allow user to set maximum Kryo buffer size

[ https://issues.apache.org/jira/browse/SPARK-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2543: --- Summary: Allow user to set maximum Kryo buffer size (was: Resizable serialization buffers

[jira] [Updated] (SPARK-2178) createSchemaRDD is not thread safe

[ https://issues.apache.org/jira/browse/SPARK-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2178: Target Version/s: 1.2.0 (was: 1.1.0) createSchemaRDD is not thread safe

[jira] [Resolved] (SPARK-2543) Allow user to set maximum Kryo buffer size

[ https://issues.apache.org/jira/browse/SPARK-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2543. Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: 1.1.0 Fixed via

[jira] [Created] (SPARK-2746) Set SBT_MAVEN_PROFILES only when it is not set explicitly by the user

Reynold Xin created SPARK-2746: -- Summary: Set SBT_MAVEN_PROFILES only when it is not set explicitly by the user Key: SPARK-2746 URL: https://issues.apache.org/jira/browse/SPARK-2746 Project: Spark

[jira] [Commented] (SPARK-2746) Set SBT_MAVEN_PROFILES only when it is not set explicitly by the user

[ https://issues.apache.org/jira/browse/SPARK-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079039#comment-14079039 ] Apache Spark commented on SPARK-2746: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-2747) git diff --dirstat can miss sql changes and not run Hive tests

Reynold Xin created SPARK-2747: -- Summary: git diff --dirstat can miss sql changes and not run Hive tests Key: SPARK-2747 URL: https://issues.apache.org/jira/browse/SPARK-2747 Project: Spark

[jira] [Commented] (SPARK-2747) git diff --dirstat can miss sql changes and not run Hive tests

[ https://issues.apache.org/jira/browse/SPARK-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079073#comment-14079073 ] Apache Spark commented on SPARK-2747: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-2641) Spark submit doesn't pick up executor instances from properties file

[ https://issues.apache.org/jira/browse/SPARK-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079114#comment-14079114 ] Apache Spark commented on SPARK-2641: - User 'kjsingh' has created a pull request for

[jira] [Created] (SPARK-2748) Loss of precision for small arguments to Math.exp, Math.log

Sean Owen created SPARK-2748: Summary: Loss of precision for small arguments to Math.exp, Math.log Key: SPARK-2748 URL: https://issues.apache.org/jira/browse/SPARK-2748 Project: Spark Issue

[jira] [Commented] (SPARK-2748) Loss of precision for small arguments to Math.exp, Math.log

[ https://issues.apache.org/jira/browse/SPARK-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079207#comment-14079207 ] Apache Spark commented on SPARK-2748: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-2748) Loss of precision for small arguments to Math.exp, Math.log

[ https://issues.apache.org/jira/browse/SPARK-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079208#comment-14079208 ] Sean Owen commented on SPARK-2748: -- PR: https://github.com/apache/spark/pull/1659 See

[jira] [Created] (SPARK-2749) Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing junit:junit dep

Sean Owen created SPARK-2749: Summary: Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing junit:junit dep Key: SPARK-2749 URL: https://issues.apache.org/jira/browse/SPARK-2749

[jira] [Commented] (SPARK-2749) Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing junit:junit dep

[ https://issues.apache.org/jira/browse/SPARK-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079231#comment-14079231 ] Apache Spark commented on SPARK-2749: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-2308) Add KMeans MiniBatch clustering algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079260#comment-14079260 ] RJ Nowling commented on SPARK-2308: --- Thanks for the clarification. :) I'll run the

[jira] [Created] (SPARK-2750) Add Https support for Web UI

WangTaoTheTonic created SPARK-2750: -- Summary: Add Https support for Web UI Key: SPARK-2750 URL: https://issues.apache.org/jira/browse/SPARK-2750 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-2315) drop, dropRight and dropWhile which take RDD input and return RDD

[ https://issues.apache.org/jira/browse/SPARK-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079300#comment-14079300 ] Erik Erlandson commented on SPARK-2315: --- Updated the PR with a proper lazy-transform

[jira] [Updated] (SPARK-2750) Add Https support for Web UI

[ https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WangTaoTheTonic updated SPARK-2750: --- Description: Now I try to add https support for web ui using Jetty ssl integration.Below is

[jira] [Created] (SPARK-2752) spark sql cli should not exit when get a exception

wangfei created SPARK-2752: -- Summary: spark sql cli should not exit when get a exception Key: SPARK-2752 URL: https://issues.apache.org/jira/browse/SPARK-2752 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2752) spark sql cli should not exit when get a exception

[ https://issues.apache.org/jira/browse/SPARK-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079370#comment-14079370 ] Apache Spark commented on SPARK-2752: - User 'scwf' has created a pull request for this

[jira] [Updated] (SPARK-2753) Is it supposed --archives option in yarn cluster mode to uncompress file?

[ https://issues.apache.org/jira/browse/SPARK-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Manuel Abuín Mosquera updated SPARK-2753: -- Description: Hi all, this is my first sent issue, I googled and

[jira] [Updated] (SPARK-2748) Loss of precision for small arguments to Math.exp, Math.log

[ https://issues.apache.org/jira/browse/SPARK-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2748: - Target Version/s: 1.1.0 Loss of precision for small arguments to Math.exp, Math.log

[jira] [Updated] (SPARK-2748) Loss of precision for small arguments to Math.exp, Math.log

[ https://issues.apache.org/jira/browse/SPARK-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2748: - Assignee: Sean Owen Loss of precision for small arguments to Math.exp, Math.log

[jira] [Resolved] (SPARK-2521) Broadcast RDD object once per TaskSet (instead of sending it for every task)

[ https://issues.apache.org/jira/browse/SPARK-2521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2521. Resolution: Fixed Fix Version/s: 1.1.0 Broadcast RDD object once per TaskSet (instead of

[jira] [Resolved] (SPARK-2747) git diff --dirstat can miss sql changes and not run Hive tests

[ https://issues.apache.org/jira/browse/SPARK-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2747. Resolution: Fixed Fix Version/s: 1.1.0 git diff --dirstat can miss sql changes and not run

[jira] [Commented] (SPARK-2707) Upgrade to Akka 2.3

[ https://issues.apache.org/jira/browse/SPARK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079487#comment-14079487 ] Anand Avati commented on SPARK-2707: [~helena_e] - it turned out to be more than just

[jira] [Created] (SPARK-2754) Document standalone-cluster mode now that it's working

Andrew Or created SPARK-2754: Summary: Document standalone-cluster mode now that it's working Key: SPARK-2754 URL: https://issues.apache.org/jira/browse/SPARK-2754 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2744) The configuration spark.history.retainedApplications is invalid

[ https://issues.apache.org/jira/browse/SPARK-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079497#comment-14079497 ] Marcelo Vanzin commented on SPARK-2744: --- Are you sure that option means what you

[jira] [Created] (SPARK-2755) TorrentBroadcast cannot broadcast very large objects

Xiangrui Meng created SPARK-2755: Summary: TorrentBroadcast cannot broadcast very large objects Key: SPARK-2755 URL: https://issues.apache.org/jira/browse/SPARK-2755 Project: Spark Issue

[jira] [Resolved] (SPARK-1630) PythonRDDs don't handle nulls gracefully

[ https://issues.apache.org/jira/browse/SPARK-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-1630. --- Resolution: Won't Fix Based on some discussion in https://github.com/apache/spark/pull/1551, we've

[jira] [Updated] (SPARK-2316) StorageStatusListener should avoid O(blocks) operations

[ https://issues.apache.org/jira/browse/SPARK-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2316: - Fix Version/s: 1.1.0 StorageStatusListener should avoid O(blocks) operations

[jira] [Updated] (SPARK-2736) Ceeate Pyspark RDD from Apache Avro File

[ https://issues.apache.org/jira/browse/SPARK-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-2736: -- Assignee: Kan Zhang (was: Josh Rosen) Ceeate Pyspark RDD from Apache Avro File

[jira] [Assigned] (SPARK-2736) Ceeate Pyspark RDD from Apache Avro File

[ https://issues.apache.org/jira/browse/SPARK-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-2736: - Assignee: Josh Rosen Ceeate Pyspark RDD from Apache Avro File

[jira] [Resolved] (SPARK-2544) Improve ALS algorithm resource usage

[ https://issues.apache.org/jira/browse/SPARK-2544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2544. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 929

[jira] [Commented] (SPARK-2341) loadLibSVMFile doesn't handle regression datasets

[ https://issues.apache.org/jira/browse/SPARK-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079704#comment-14079704 ] Apache Spark commented on SPARK-2341: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-2736) Ceeate Pyspark RDD from Apache Avro File

[ https://issues.apache.org/jira/browse/SPARK-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079761#comment-14079761 ] Michael Armbrust commented on SPARK-2736: - Another thing to consider is that Avro

[jira] [Updated] (SPARK-2746) Set SBT_MAVEN_PROFILES only when it is not set explicitly by the user

[ https://issues.apache.org/jira/browse/SPARK-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2746: --- Description: dev/run-tests always sets SBT_MAVEN_PROFILES, which is not desired. As a matter of

[jira] [Resolved] (SPARK-2746) Set SBT_MAVEN_PROFILES only when it is not set explicitly by the user

[ https://issues.apache.org/jira/browse/SPARK-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2746. Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: 1.1.0 Set

[jira] [Commented] (SPARK-2664) Deal with `--conf` options in spark-submit that relate to flags

[ https://issues.apache.org/jira/browse/SPARK-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079775#comment-14079775 ] Apache Spark commented on SPARK-2664: - User 'sryza' has created a pull request for

[jira] [Commented] (SPARK-2735) Remove deprecation in jekyll for pygment in _config.yml

[ https://issues.apache.org/jira/browse/SPARK-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079778#comment-14079778 ] Apache Spark commented on SPARK-2735: - User 'RAbraham' has created a pull request for

[jira] [Commented] (SPARK-2741) Publish version of spark assembly which does not contain Hive

[ https://issues.apache.org/jira/browse/SPARK-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079795#comment-14079795 ] Brock Noland commented on SPARK-2741: - https://github.com/apache/spark/pull/1667

[jira] [Commented] (SPARK-2741) Publish version of spark assembly which does not contain Hive

[ https://issues.apache.org/jira/browse/SPARK-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079804#comment-14079804 ] Apache Spark commented on SPARK-2741: - User 'brockn' has created a pull request for

[jira] [Updated] (SPARK-2711) Create a ShuffleMemoryManager that allocates across spilling collections in the same task

[ https://issues.apache.org/jira/browse/SPARK-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-2711: - Priority: Critical (was: Major) Create a ShuffleMemoryManager that allocates across spilling

[jira] [Commented] (SPARK-2523) For partitioned Hive tables, partition-specific ObjectInspectors should be used.

[ https://issues.apache.org/jira/browse/SPARK-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079881#comment-14079881 ] Apache Spark commented on SPARK-2523: - User 'yhuai' has created a pull request for

[jira] [Resolved] (SPARK-2024) Add saveAsSequenceFile to PySpark

[ https://issues.apache.org/jira/browse/SPARK-2024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2024. --- Resolution: Fixed Fix Version/s: 1.1.0 Add saveAsSequenceFile to PySpark

[jira] [Updated] (SPARK-2103) Java + Kafka + Spark Streaming NoSuchMethodError in java.lang.Object.init

[ https://issues.apache.org/jira/browse/SPARK-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2103: - Target Version/s: 1.1.0 Java + Kafka + Spark Streaming NoSuchMethodError in

[jira] [Updated] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2419: - Target Version/s: 1.1.0 Misc updates to streaming programming guide

[jira] [Updated] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2419: - Description: This JIRA collects together a number of small issues that should be added to the

[jira] [Updated] (SPARK-2736) Create Pyspark RDD from Apache Avro File

[ https://issues.apache.org/jira/browse/SPARK-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated SPARK-2736: - Summary: Create Pyspark RDD from Apache Avro File (was: Ceeate Pyspark RDD from Apache Avro File)

[jira] [Commented] (SPARK-2381) streaming receiver crashed,but seems nothing happened

[ https://issues.apache.org/jira/browse/SPARK-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079978#comment-14079978 ] Tathagata Das commented on SPARK-2381: -- Any updates on this? If not, then I am

[jira] [Updated] (SPARK-2736) Create PySpark RDD from Apache Avro File

[ https://issues.apache.org/jira/browse/SPARK-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated SPARK-2736: - Summary: Create PySpark RDD from Apache Avro File (was: Create Pyspark RDD from Apache Avro File)

[jira] [Commented] (SPARK-2012) PySpark StatCounter with numpy arrays

[ https://issues.apache.org/jira/browse/SPARK-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079984#comment-14079984 ] Jeremy Freeman commented on SPARK-2012: --- [~davies] cool, that definitely makes sense

[jira] [Commented] (SPARK-2012) PySpark StatCounter with numpy arrays

[ https://issues.apache.org/jira/browse/SPARK-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080001#comment-14080001 ] Davies Liu commented on SPARK-2012: --- Yes, plz! PySpark StatCounter with numpy arrays

[jira] [Updated] (SPARK-546) Support full outer join and multiple join in a single shuffle

[ https://issues.apache.org/jira/browse/SPARK-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-546: Component/s: Streaming Spark Core Support full outer join and multiple join in a

[jira] [Updated] (SPARK-1730) Make receiver store data reliably to avoid data-loss on executor failures

[ https://issues.apache.org/jira/browse/SPARK-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1730: - Assignee: Hari Shreedharan (was: Tathagata Das) Make receiver store data reliably to avoid

[jira] [Updated] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2419: - Priority: Major (was: Critical) Misc updates to streaming programming guide

[jira] [Updated] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2419: - Priority: Critical (was: Major) Misc updates to streaming programming guide

[jira] [Updated] (SPARK-2463) Creating multiple StreamingContexts from shell generates duplicate Streaming tabs in UI

[ https://issues.apache.org/jira/browse/SPARK-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2463: - Target Version/s: 1.2.0 Creating multiple StreamingContexts from shell generates duplicate

[jira] [Updated] (SPARK-1312) Batch should read based on the batch interval provided in the StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1312: - Target Version/s: 1.2.0 Assignee: Tathagata Das Batch should read based on the

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080035#comment-14080035 ] Ted Malaska commented on SPARK-2447: The build is fixed and the pull request is

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080055#comment-14080055 ] Ted Malaska commented on SPARK-2447: OK had a status meeting with TD. 1. 2447 will be

[jira] [Updated] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1642: - Target Version/s: 1.2.0 (was: 1.1.0) Upgrade FlumeInputDStream's FlumeReceiver to support

[jira] [Updated] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-2447: - Target Version/s: 1.2.0 (was: 1.1.0) Add common solution for sending upsert actions to HBase

[jira] [Updated] (SPARK-944) Give example of writing to HBase from Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-944: Target Version/s: 1.2.0 (was: 1.1.0) Give example of writing to HBase from Spark Streaming

[jira] [Updated] (SPARK-2492) KafkaReceiver minor changes to align with Kafka 0.8

[ https://issues.apache.org/jira/browse/SPARK-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2492: - Target Version/s: 1.1.0 Fix Version/s: (was: 1.1.0) KafkaReceiver minor changes to

[jira] [Commented] (SPARK-2507) Compile error of streaming project with 2.0.0-cdh4.6.0

[ https://issues.apache.org/jira/browse/SPARK-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080111#comment-14080111 ] Tathagata Das commented on SPARK-2507: -- This was solved in PR

[jira] [Created] (SPARK-2756) Decision Tree bugs

Joseph K. Bradley created SPARK-2756: Summary: Decision Tree bugs Key: SPARK-2756 URL: https://issues.apache.org/jira/browse/SPARK-2756 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2756) Decision Tree bugs

[ https://issues.apache.org/jira/browse/SPARK-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2756: - Assignee: Joseph K. Bradley Decision Tree bugs -- Key:

[jira] [Commented] (SPARK-2756) Decision Tree bugs

[ https://issues.apache.org/jira/browse/SPARK-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080134#comment-14080134 ] Apache Spark commented on SPARK-2756: - User 'jkbradley' has created a pull request for

[jira] [Commented] (SPARK-2756) Decision Tree bugs

[ https://issues.apache.org/jira/browse/SPARK-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080136#comment-14080136 ] Joseph K. Bradley commented on SPARK-2756: -- Submitted

[jira] [Issue Comment Deleted] (SPARK-2756) Decision Tree bugs

[ https://issues.apache.org/jira/browse/SPARK-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-2756: - Comment: was deleted (was: Submitted [https://github.com/apache/spark/pull/1673] with

[jira] [Updated] (SPARK-2507) Compile error of streaming project with 2.0.0-cdh4.6.0

[ https://issues.apache.org/jira/browse/SPARK-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2507: - Affects Version/s: 1.0.2 1.0.1 Compile error of streaming project with

[jira] [Resolved] (SPARK-2507) Compile error of streaming project with 2.0.0-cdh4.6.0

[ https://issues.apache.org/jira/browse/SPARK-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2507. -- Resolution: Fixed Compile error of streaming project with 2.0.0-cdh4.6.0

[jira] [Updated] (SPARK-2507) Compile error of streaming project with 2.0.0-cdh4.6.0

[ https://issues.apache.org/jira/browse/SPARK-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2507: - Target Version/s: 1.1.0 (was: 0.9.0, 0.9.1, 1.0.0) Compile error of streaming project with

[jira] [Created] (SPARK-2757) Add Mima test for Spark Sink after 1.10 is released

Hari Shreedharan created SPARK-2757: --- Summary: Add Mima test for Spark Sink after 1.10 is released Key: SPARK-2757 URL: https://issues.apache.org/jira/browse/SPARK-2757 Project: Spark

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080166#comment-14080166 ] Ted Malaska commented on SPARK-2447: Hey Matei, Lets do a webex or something in the

[jira] [Created] (SPARK-2758) UnionRDD's UnionPartition should not reference parent RDDs

Reynold Xin created SPARK-2758: -- Summary: UnionRDD's UnionPartition should not reference parent RDDs Key: SPARK-2758 URL: https://issues.apache.org/jira/browse/SPARK-2758 Project: Spark Issue

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080179#comment-14080179 ] Patrick Wendell commented on SPARK-2447: This is not entirely a duplicate, but

[jira] [Commented] (SPARK-2758) UnionRDD's UnionPartition should not reference parent RDDs

[ https://issues.apache.org/jira/browse/SPARK-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080184#comment-14080184 ] Apache Spark commented on SPARK-2758: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-2706) Enable Spark to support Hive 0.13

[ https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-2706: -- Attachment: spark-hive.err This file shows the error I got after applying tentative patch. Enable Spark to

[jira] [Updated] (SPARK-2706) Enable Spark to support Hive 0.13

[ https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-2706: -- Attachment: spark-2706-v1.txt Tentative patch. I copied Hive 0.13.1 artifacts to local maven repo manually.

[jira] [Commented] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080250#comment-14080250 ] Erik Erlandson commented on SPARK-1021: --- I deferred the compute of the partition

[jira] [Resolved] (SPARK-2741) Publish version of spark assembly which does not contain Hive

[ https://issues.apache.org/jira/browse/SPARK-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2741. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1667

[jira] [Updated] (SPARK-2741) Publish version of spark assembly which does not contain Hive

[ https://issues.apache.org/jira/browse/SPARK-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2741: --- Assignee: Brock Noland (was: Patrick Wendell) Publish version of spark assembly which does

[jira] [Commented] (SPARK-2741) Publish version of spark assembly which does not contain Hive

[ https://issues.apache.org/jira/browse/SPARK-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080264#comment-14080264 ] Brock Noland commented on SPARK-2741: - Thanks guys!! Publish version of spark

[jira] [Updated] (SPARK-1647) Prevent data loss when Streaming driver goes down

[ https://issues.apache.org/jira/browse/SPARK-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1647: - Fix Version/s: (was: 1.1.0) Prevent data loss when Streaming driver goes down

[jira] [Updated] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1478: - Target Version/s: 1.2.0 Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[jira] [Updated] (SPARK-1600) flaky test case in streaming.CheckpointSuite

[ https://issues.apache.org/jira/browse/SPARK-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1600: - Fix Version/s: (was: 1.1.0) flaky test case in streaming.CheckpointSuite

[jira] [Updated] (SPARK-1600) flaky test case in streaming.CheckpointSuite

[ https://issues.apache.org/jira/browse/SPARK-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1600: - Target Version/s: 1.2.0 flaky test case in streaming.CheckpointSuite

[jira] [Updated] (SPARK-1409) Flaky Test: actor input stream test in org.apache.spark.streaming.InputStreamsSuite

[ https://issues.apache.org/jira/browse/SPARK-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1409: - Target Version/s: 1.2.0 Flaky Test: actor input stream test in

[jira] [Updated] (SPARK-1409) Flaky Test: actor input stream test in org.apache.spark.streaming.InputStreamsSuite

[ https://issues.apache.org/jira/browse/SPARK-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1409: - Fix Version/s: (was: 1.1.0) Flaky Test: actor input stream test in

[jira] [Created] (SPARK-2759) The ability to read binary files into Spark

Kevin Mader created SPARK-2759: -- Summary: The ability to read binary files into Spark Key: SPARK-2759 URL: https://issues.apache.org/jira/browse/SPARK-2759 Project: Spark Issue Type:

[jira] [Created] (SPARK-2760) Caching tables from multiple databases does not work

Michael Armbrust created SPARK-2760: --- Summary: Caching tables from multiple databases does not work Key: SPARK-2760 URL: https://issues.apache.org/jira/browse/SPARK-2760 Project: Spark

[jira] [Resolved] (SPARK-2734) DROP TABLE should also uncache table

[ https://issues.apache.org/jira/browse/SPARK-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2734. - Resolution: Fixed Fix Version/s: 1.1.0 DROP TABLE should also uncache table

[jira] [Updated] (SPARK-1580) [MLlib] ALS: Estimate communication and computation costs given a partitioner

[ https://issues.apache.org/jira/browse/SPARK-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tor Myklebust updated SPARK-1580: - Summary: [MLlib] ALS: Estimate communication and computation costs given a partitioner (was:

[jira] [Resolved] (SPARK-2341) loadLibSVMFile doesn't handle regression datasets

[ https://issues.apache.org/jira/browse/SPARK-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2341. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1663

[jira] [Commented] (SPARK-2654) Leveled logging in PySpark

[ https://issues.apache.org/jira/browse/SPARK-2654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080311#comment-14080311 ] Michael Yannakopoulos commented on SPARK-2654: -- Hi Davies, I can work on

  1   2   >