[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390169#comment-14390169 ] Rahul Kumar commented on SPARK-6646: Love this idea, what about private cloud in

[jira] [Updated] (SPARK-6644) [SPARK-SQL]when the partition schema does not match table schema(ADD COLUMN), new column value is NULL

[ https://issues.apache.org/jira/browse/SPARK-6644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6644: -- Description: In Hive, the schema of a partition may differ from the table schema. For example, we may

[jira] [Updated] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6646: --- Description: Mobile computing is quickly rising to dominance, and by the end of 2017, it is

[jira] [Updated] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6646: --- Attachment: Spark on Mobile - Design Doc - v1.pdf Spark 2.0: Rearchitecting Spark for Mobile

[jira] [Assigned] (SPARK-6640) Executor may connect to HeartbeartReceiver before it's setup in the driver side

[ https://issues.apache.org/jira/browse/SPARK-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6640: --- Assignee: Apache Spark Executor may connect to HeartbeartReceiver before it's setup in the

[jira] [Assigned] (SPARK-6640) Executor may connect to HeartbeartReceiver before it's setup in the driver side

[ https://issues.apache.org/jira/browse/SPARK-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6640: --- Assignee: (was: Apache Spark) Executor may connect to HeartbeartReceiver before it's

[jira] [Commented] (SPARK-6640) Executor may connect to HeartbeartReceiver before it's setup in the driver side

[ https://issues.apache.org/jira/browse/SPARK-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390090#comment-14390090 ] Apache Spark commented on SPARK-6640: - User 'zsxwing' has created a pull request for

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390153#comment-14390153 ] Sandy Ryza commented on SPARK-6646: --- This seems like a good opportunity to finally add a

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390160#comment-14390160 ] Yu Ishikawa commented on SPARK-6646: That sounds very interesting! We should support a

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390176#comment-14390176 ] Jeremy Freeman commented on SPARK-6646: --- Very promising [~tdas]! We should evaluate

[jira] [Commented] (SPARK-6631) I am unable to get the Maven Build file in Example 2.13 to build anything but an empty file

[ https://issues.apache.org/jira/browse/SPARK-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390185#comment-14390185 ] Sean Owen commented on SPARK-6631: -- The Debian packaging was removed; I don't know how

[jira] [Updated] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6646: --- Description: Mobile computing is quickly rising to dominance, and by the end of 2017, it is

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390161#comment-14390161 ] Tathagata Das commented on SPARK-6646: -- I have been working on running

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390206#comment-14390206 ] Petar Zecevic commented on SPARK-6646: -- Good one :) Spark 2.0: Rearchitecting Spark

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390183#comment-14390183 ] Sean Owen commented on SPARK-6646: -- Concept: smartphone app that lets you find the

[jira] [Updated] (SPARK-6644) After adding new columns to a partitioned table and inserting data to an old partition, data of newly added columns are all NULL

[ https://issues.apache.org/jira/browse/SPARK-6644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6644: -- Summary: After adding new columns to a partitioned table and inserting data to an old partition, data

[jira] [Commented] (SPARK-4346) YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication

[ https://issues.apache.org/jira/browse/SPARK-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390086#comment-14390086 ] Apache Spark commented on SPARK-4346: - User 'Sephiroth-Lin' has created a pull request

[jira] [Commented] (SPARK-3596) Support changing the yarn client monitor interval

[ https://issues.apache.org/jira/browse/SPARK-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390087#comment-14390087 ] Apache Spark commented on SPARK-3596: - User 'Sephiroth-Lin' has created a pull request

[jira] [Assigned] (SPARK-4346) YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication

[ https://issues.apache.org/jira/browse/SPARK-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4346: --- Assignee: Apache Spark YarnClientSchedulerBack.asyncMonitorApplication should be common

[jira] [Assigned] (SPARK-4346) YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication

[ https://issues.apache.org/jira/browse/SPARK-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4346: --- Assignee: (was: Apache Spark) YarnClientSchedulerBack.asyncMonitorApplication should be

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390158#comment-14390158 ] Reynold Xin commented on SPARK-6646: [~sandyryza] That's an excellent idea. I haven't

[jira] [Assigned] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5682: --- Assignee: (was: Apache Spark) Add encrypted shuffle in spark

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390157#comment-14390157 ] Apache Spark commented on SPARK-5682: - User 'kellyzly' has created a pull request for

[jira] [Assigned] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5682: --- Assignee: Apache Spark Add encrypted shuffle in spark --

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390221#comment-14390221 ] zhichao-li commented on SPARK-6613: --- [~msoutier] , have you found any solution for this

[jira] [Updated] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6646: --- Description: Mobile computing is quickly rising to dominance, and by the end of 2017, it is

[jira] [Commented] (SPARK-5989) Model import/export for LDAModel

[ https://issues.apache.org/jira/browse/SPARK-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390209#comment-14390209 ] Manoj Kumar commented on SPARK-5989: Can this be assigned to me? Thanks! Model

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390208#comment-14390208 ] Kamal Banga commented on SPARK-6646: We want Spark for Apple Watch. That will be the

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390235#comment-14390235 ] liyunzhang_intel commented on SPARK-5682: - Hi all: Now there are two methods to

[jira] [Resolved] (SPARK-4655) Split Stage into ShuffleMapStage and ResultStage subclasses

[ https://issues.apache.org/jira/browse/SPARK-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4655. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4708

[jira] [Updated] (SPARK-6597) Replace `input:checkbox` with `input[type=checkbox] in additional-metrics.js

[ https://issues.apache.org/jira/browse/SPARK-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6597: - Priority: Trivial (was: Minor) Assignee: Kousuke Saruta Replace `input:checkbox` with

[jira] [Resolved] (SPARK-6600) Open ports in ec2/spark_ec2.py to allow HDFS NFS gateway

[ https://issues.apache.org/jira/browse/SPARK-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6600. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5257

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: Design Document of Encrypted Spark Shuffle_20150401.docx Add encrypted shuffle

[jira] [Updated] (SPARK-6626) TwitterUtils.createStream documentation error

[ https://issues.apache.org/jira/browse/SPARK-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6626: - Priority: Trivial (was: Minor) Assignee: Jayson Sunshine TwitterUtils.createStream documentation

[jira] [Resolved] (SPARK-6626) TwitterUtils.createStream documentation error

[ https://issues.apache.org/jira/browse/SPARK-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6626. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Updated] (SPARK-6600) Open ports in ec2/spark_ec2.py to allow HDFS NFS gateway

[ https://issues.apache.org/jira/browse/SPARK-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6600: - Priority: Minor (was: Major) Assignee: Florian Verhein Open ports in ec2/spark_ec2.py to allow HDFS

[jira] [Resolved] (SPARK-6597) Replace `input:checkbox` with `input[type=checkbox] in additional-metrics.js

[ https://issues.apache.org/jira/browse/SPARK-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6597. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5254

[jira] [Commented] (SPARK-6630) SparkConf.setIfMissing should only evaluate the assigned value if indeed missing

[ https://issues.apache.org/jira/browse/SPARK-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390350#comment-14390350 ] Sean Owen commented on SPARK-6630: -- This should be as simple as {{ def setIfMissing(key:

[jira] [Updated] (SPARK-6644) After adding new columns to a partitioned table and inserting data to an old partition, data of newly added columns are all NULL

[ https://issues.apache.org/jira/browse/SPARK-6644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6644: -- Description: In Hive, the schema of a partition may differ from the table schema. For example, we may

[jira] [Commented] (SPARK-6631) I am unable to get the Maven Build file in Example 2.13 to build anything but an empty file

[ https://issues.apache.org/jira/browse/SPARK-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390114#comment-14390114 ] Frank Domoney commented on SPARK-6631: -- Incidentally can you get the Debian build of

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390146#comment-14390146 ] Cong Yue commented on SPARK-6646: - Very cool idea. Current smartphone has much better

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390196#comment-14390196 ] Sandy Ryza commented on SPARK-6646: --- [~srowen] I like the way you think. I know a lot

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390205#comment-14390205 ] Aaron Davidson commented on SPARK-6646: --- Please help, I tried putting spark on

[jira] [Resolved] (SPARK-4927) Spark does not clean up properly during long jobs.

[ https://issues.apache.org/jira/browse/SPARK-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4927. -- Resolution: Cannot Reproduce At the moment I've tried to reproduce this a few ways and wasn't able to.

[jira] [Resolved] (SPARK-1001) Memory leak when reading sequence file and then sorting

[ https://issues.apache.org/jira/browse/SPARK-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1001. -- Resolution: Cannot Reproduce Memory leak when reading sequence file and then sorting

[jira] [Created] (SPARK-6647) Make trait StringComparison as BinaryPredicate and throw error when Predicate can't translate to data source Filter

Liang-Chi Hsieh created SPARK-6647: -- Summary: Make trait StringComparison as BinaryPredicate and throw error when Predicate can't translate to data source Filter Key: SPARK-6647 URL:

[jira] [Updated] (SPARK-3884) If deploy mode is cluster, --driver-memory shouldn't apply to client JVM

[ https://issues.apache.org/jira/browse/SPARK-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3884: - Component/s: (was: Spark Core) Spark Submit Affects Version/s: 1.2.0

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390373#comment-14390373 ] Steve Loughran commented on SPARK-6646: --- Obviously the barrier will be data source

[jira] [Resolved] (SPARK-4544) Spark JVM Metrics doesn't have context.

[ https://issues.apache.org/jira/browse/SPARK-4544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4544. -- Resolution: Duplicate I'd like to bundle this under SPARK-5847, which proposes more general control

[jira] [Updated] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3967: - Component/s: (was: Spark Core) YARN Spark applications fail in yarn-cluster mode

[jira] [Assigned] (SPARK-6647) Make trait StringComparison as BinaryPredicate and throw error when Predicate can't translate to data source Filter

[ https://issues.apache.org/jira/browse/SPARK-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6647: --- Assignee: (was: Apache Spark) Make trait StringComparison as BinaryPredicate and throw

[jira] [Resolved] (SPARK-3884) If deploy mode is cluster, --driver-memory shouldn't apply to client JVM

[ https://issues.apache.org/jira/browse/SPARK-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3884. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Marcelo Vanzin (was: Sandy

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390367#comment-14390367 ] Nan Zhu commented on SPARK-6646: super cool, Spark enables Bigger than Bigger Data in

[jira] [Resolved] (SPARK-4799) Spark should not rely on local host being resolvable on every node

[ https://issues.apache.org/jira/browse/SPARK-4799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4799. -- Resolution: Duplicate Target Version/s: (was: 1.2.1) Looks like this was subsumed by

[jira] [Assigned] (SPARK-6647) Make trait StringComparison as BinaryPredicate and throw error when Predicate can't translate to data source Filter

[ https://issues.apache.org/jira/browse/SPARK-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6647: --- Assignee: Apache Spark Make trait StringComparison as BinaryPredicate and throw error when

[jira] [Commented] (SPARK-6630) SparkConf.setIfMissing should only evaluate the assigned value if indeed missing

[ https://issues.apache.org/jira/browse/SPARK-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390421#comment-14390421 ] Svend Vanderveken commented on SPARK-6630: -- Thanks for you comment. I agree with

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390423#comment-14390423 ] Marius Soutier commented on SPARK-6613: --- Bug report. Starting stream from

[jira] [Assigned] (SPARK-6643) Python API for StandardScalerModel

[ https://issues.apache.org/jira/browse/SPARK-6643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6643: --- Assignee: (was: Apache Spark) Python API for StandardScalerModel

[jira] [Commented] (SPARK-6643) Python API for StandardScalerModel

[ https://issues.apache.org/jira/browse/SPARK-6643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390610#comment-14390610 ] Apache Spark commented on SPARK-6643: - User 'Lewuathe' has created a pull request for

[jira] [Created] (SPARK-6648) Reading Parquet files with different sub-files doesn't work

Marius Soutier created SPARK-6648: - Summary: Reading Parquet files with different sub-files doesn't work Key: SPARK-6648 URL: https://issues.apache.org/jira/browse/SPARK-6648 Project: Spark

[jira] [Updated] (SPARK-6648) Reading Parquet files with different sub-files doesn't work

[ https://issues.apache.org/jira/browse/SPARK-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-6648: -- Description: When reading from multiple parquet files (via

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390782#comment-14390782 ] Evan Sparks commented on SPARK-6646: Guys - you're clearly ignoring prior work. The

[jira] [Updated] (SPARK-6433) hive tests to import spark-sql test JAR for QueryTest access

[ https://issues.apache.org/jira/browse/SPARK-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6433: - Assignee: Steve Loughran hive tests to import spark-sql test JAR for QueryTest access

[jira] [Created] (SPARK-6649) DataFrame created through SQLContext.jdbc() failed if columns table must be quoted

Frédéric Blanc created SPARK-6649: - Summary: DataFrame created through SQLContext.jdbc() failed if columns table must be quoted Key: SPARK-6649 URL: https://issues.apache.org/jira/browse/SPARK-6649

[jira] [Resolved] (SPARK-6433) hive tests to import spark-sql test JAR for QueryTest access

[ https://issues.apache.org/jira/browse/SPARK-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6433. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5119

[jira] [Updated] (SPARK-6334) spark-local dir not getting cleared during ALS

[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi updated SPARK-6334: --- Attachment: gc.png spark-local dir not getting cleared during ALS

[jira] [Commented] (SPARK-6334) spark-local dir not getting cleared during ALS

[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390771#comment-14390771 ] Antony Mayi commented on SPARK-6334: bq. btw. I see based on the sourcecode

[jira] [Reopened] (SPARK-6334) spark-local dir not getting cleared during ALS

[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi reopened SPARK-6334: spark-local dir not getting cleared during ALS --

[jira] [Comment Edited] (SPARK-2243) Support multiple SparkContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391770#comment-14391770 ] Jason Hubbard edited comment on SPARK-2243 at 4/1/15 11:40 PM:

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391770#comment-14391770 ] Jason Hubbard commented on SPARK-2243: -- Apologizing for being flippant is a bit of an

[jira] [Resolved] (SPARK-6553) Support for functools.partial as UserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6553. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Support for functools.partial

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392102#comment-14392102 ] zhichao-li commented on SPARK-6613: --- Just trying to understand the issue but it cann't

[jira] [Updated] (SPARK-6668) repeated asking to remove non-existent executor

[ https://issues.apache.org/jira/browse/SPARK-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-6668: -- Affects Version/s: 1.4.0 repeated asking to remove non-existent executor

[jira] [Created] (SPARK-6670) HiveContext.analyze should throw UnsupportedOperationException instead of NotImplementedError

Yin Huai created SPARK-6670: --- Summary: HiveContext.analyze should throw UnsupportedOperationException instead of NotImplementedError Key: SPARK-6670 URL: https://issues.apache.org/jira/browse/SPARK-6670

[jira] [Created] (SPARK-6662) Allow variable substitution in spark.yarn.historyServer.address

Cheolsoo Park created SPARK-6662: Summary: Allow variable substitution in spark.yarn.historyServer.address Key: SPARK-6662 URL: https://issues.apache.org/jira/browse/SPARK-6662 Project: Spark

[jira] [Updated] (SPARK-6664) Split Ordered RDD into multiple RDDs by keys (boundaries or intervals)

[ https://issues.apache.org/jira/browse/SPARK-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Verhein updated SPARK-6664: --- Description: I can't find this functionality (if I missed something, apologies!), but it

[jira] [Commented] (SPARK-6106) Support user group mapping and groups in view, modify and admin acls

[ https://issues.apache.org/jira/browse/SPARK-6106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392188#comment-14392188 ] Apache Spark commented on SPARK-6106: - User 'colinmjj' has created a pull request for

[jira] [Updated] (SPARK-6580) Optimize LogisticRegressionModel.predictPoint

[ https://issues.apache.org/jira/browse/SPARK-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6580: - Assignee: Yanbo Liang Optimize LogisticRegressionModel.predictPoint

[jira] [Commented] (SPARK-6553) Support for functools.partial as UserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391851#comment-14391851 ] Josh Rosen commented on SPARK-6553: --- This was fixed by

[jira] [Updated] (SPARK-6553) Support for functools.partial as UserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6553: -- Assignee: Kalle Jepsen Support for functools.partial as UserDefinedFunction

[jira] [Commented] (SPARK-6653) New configuration property to specify port for sparkYarnAM actor system

[ https://issues.apache.org/jira/browse/SPARK-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391993#comment-14391993 ] Shixiong Zhu commented on SPARK-6653: - Could you send a pull request to

[jira] [Created] (SPARK-6665) Randomly Shuffle an RDD

Florian Verhein created SPARK-6665: -- Summary: Randomly Shuffle an RDD Key: SPARK-6665 URL: https://issues.apache.org/jira/browse/SPARK-6665 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-6666) org.apache.spark.sql.jdbc.JDBCRDD does not escape/quote column names

John Ferguson created SPARK-: Summary: org.apache.spark.sql.jdbc.JDBCRDD does not escape/quote column names Key: SPARK- URL: https://issues.apache.org/jira/browse/SPARK- Project: Spark

[jira] [Assigned] (SPARK-6106) Support user group mapping and groups in view, modify and admin acls

[ https://issues.apache.org/jira/browse/SPARK-6106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6106: --- Assignee: Apache Spark Support user group mapping and groups in view, modify and admin acls

[jira] [Assigned] (SPARK-6106) Support user group mapping and groups in view, modify and admin acls

[ https://issues.apache.org/jira/browse/SPARK-6106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6106: --- Assignee: (was: Apache Spark) Support user group mapping and groups in view, modify and

[jira] [Comment Edited] (SPARK-2243) Support multiple SparkContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391770#comment-14391770 ] Jason Hubbard edited comment on SPARK-2243 at 4/1/15 11:41 PM:

[jira] [Commented] (SPARK-6664) Split Ordered RDD into multiple RDDs by keys (boundaries or intervals)

[ https://issues.apache.org/jira/browse/SPARK-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391950#comment-14391950 ] Florian Verhein commented on SPARK-6664: The closest approach I've found that

[jira] [Commented] (SPARK-6113) Stabilize DecisionTree and ensembles APIs

[ https://issues.apache.org/jira/browse/SPARK-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392054#comment-14392054 ] Joseph K. Bradley commented on SPARK-6113: -- I just noted that this is blocked by

[jira] [Assigned] (SPARK-6667) hang while collect in PySpark

[ https://issues.apache.org/jira/browse/SPARK-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6667: --- Assignee: Davies Liu (was: Apache Spark) hang while collect in PySpark

[jira] [Assigned] (SPARK-6667) hang while collect in PySpark

[ https://issues.apache.org/jira/browse/SPARK-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6667: --- Assignee: Apache Spark (was: Davies Liu) hang while collect in PySpark

[jira] [Updated] (SPARK-6659) Spark SQL 1.3 cannot read json file that only with a record.

[ https://issues.apache.org/jira/browse/SPARK-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6659: --- Component/s: SQL Spark SQL 1.3 cannot read json file that only with a record.

[jira] [Closed] (SPARK-6659) Spark SQL 1.3 cannot read json file that only with a record.

[ https://issues.apache.org/jira/browse/SPARK-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-6659. -- Resolution: Invalid Per the comment, I think the issue is the JSON is not correctly formatted.

[jira] [Resolved] (SPARK-6642) Change the lambda weight to number of explicit ratings in implicit ALS

[ https://issues.apache.org/jira/browse/SPARK-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6642. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull

[jira] [Updated] (SPARK-3468) WebUI Timeline-View feature

[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3468: -- Affects Version/s: 1.4.0 WebUI Timeline-View feature ---

[jira] [Updated] (SPARK-3468) WebUI Timeline-View feature

[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3468: -- Target Version/s: 1.4.0 WebUI Timeline-View feature ---

[jira] [Assigned] (SPARK-6660) MLLibPythonAPI.pythonToJava doesn't recognize object arrays

[ https://issues.apache.org/jira/browse/SPARK-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6660: --- Assignee: Apache Spark (was: Xiangrui Meng) MLLibPythonAPI.pythonToJava doesn't recognize

[jira] [Commented] (SPARK-6662) Allow variable substitution in spark.yarn.historyServer.address

[ https://issues.apache.org/jira/browse/SPARK-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391825#comment-14391825 ] Apache Spark commented on SPARK-6662: - User 'piaozhexiu' has created a pull request

[jira] [Assigned] (SPARK-6662) Allow variable substitution in spark.yarn.historyServer.address

[ https://issues.apache.org/jira/browse/SPARK-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6662: --- Assignee: Apache Spark Allow variable substitution in spark.yarn.historyServer.address

[jira] [Comment Edited] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390235#comment-14390235 ] liyunzhang_intel edited comment on SPARK-5682 at 4/2/15 1:34 AM:

[jira] [Closed] (SPARK-6658) Incorrect DataFrame Documentation Type References

[ https://issues.apache.org/jira/browse/SPARK-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chet Mancini closed SPARK-6658. --- Incorrect DataFrame Documentation Type References -

  1   2   >