[jira] [Created] (SPARK-5003) cast support date data type

2014-12-30 Thread haiyangsea (JIRA)
haiyangsea created SPARK-5003: - Summary: cast support date data type Key: SPARK-5003 URL: https://issues.apache.org/jira/browse/SPARK-5003 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5003) cast support date data type

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260910#comment-14260910 ] Apache Spark commented on SPARK-5003: - User 'haiyangsea' has created a pull request

[jira] [Commented] (SPARK-4963) SchemaRDD.sample may return wrong results

2014-12-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260914#comment-14260914 ] Yanbo Liang commented on SPARK-4963: [~mengxr] 1. Just like Cheng Michael's

[jira] [Comment Edited] (SPARK-4963) SchemaRDD.sample may return wrong results

2014-12-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260914#comment-14260914 ] Yanbo Liang edited comment on SPARK-4963 at 12/30/14 8:48 AM: --

[jira] [Created] (SPARK-5004) PySpark does not handle SOCKS proxy

2014-12-30 Thread Eric O. LEBIGOT (EOL) (JIRA)
Eric O. LEBIGOT (EOL) created SPARK-5004: Summary: PySpark does not handle SOCKS proxy Key: SPARK-5004 URL: https://issues.apache.org/jira/browse/SPARK-5004 Project: Spark Issue

[jira] [Commented] (SPARK-4986) Graceful shutdown for Spark Streaming does not work in Standalone cluster mode

2014-12-30 Thread Jesper Lundgren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260941#comment-14260941 ] Jesper Lundgren commented on SPARK-4986: Anyone else can confirm if this is an

[jira] [Commented] (SPARK-4992) Prominent Python example has bad, beginner style

2014-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260944#comment-14260944 ] Sean Owen commented on SPARK-4992: -- Yes, that was already in the existing patch. I

[jira] [Created] (SPARK-5005) Failed to start when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
yangping wu created SPARK-5005: -- Summary: Failed to start when using yarn-client mode with the Spark1.2.0 Key: SPARK-5005 URL: https://issues.apache.org/jira/browse/SPARK-5005 Project: Spark

[jira] [Updated] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yangping wu updated SPARK-5005: --- Summary: Failed to start spark-shell when using yarn-client mode with the Spark1.2.0 (was: Failed

[jira] [Commented] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260955#comment-14260955 ] Sean Owen commented on SPARK-5005: -- You should use {{--master yarn-client}} not

[jira] [Commented] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260961#comment-14260961 ] yangping wu commented on SPARK-5005: hi, Sean Owen , When I using {code}

[jira] [Comment Edited] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260962#comment-14260962 ] yangping wu edited comment on SPARK-5005 at 12/30/14 10:03 AM:

[jira] [Comment Edited] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260961#comment-14260961 ] yangping wu edited comment on SPARK-5005 at 12/30/14 10:03 AM:

[jira] [Commented] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260962#comment-14260962 ] yangping wu commented on SPARK-5005: hi, Sean Owen , When I using {code}

[jira] [Issue Comment Deleted] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yangping wu updated SPARK-5005: --- Comment: was deleted (was: hi, Sean Owen , Thank you for you reply , but when I using {code}

[jira] [Comment Edited] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260961#comment-14260961 ] yangping wu edited comment on SPARK-5005 at 12/30/14 10:04 AM:

[jira] [Comment Edited] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260961#comment-14260961 ] yangping wu edited comment on SPARK-5005 at 12/30/14 10:04 AM:

[jira] [Commented] (SPARK-5004) PySpark does not handle SOCKS proxy

2014-12-30 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260969#comment-14260969 ] Eric O. LEBIGOT (EOL) commented on SPARK-5004: -- PPS: A SOCKS proxy can be

[jira] [Comment Edited] (SPARK-5004) PySpark does not handle SOCKS proxy

2014-12-30 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260969#comment-14260969 ] Eric O. LEBIGOT (EOL) edited comment on SPARK-5004 at 12/30/14 10:20 AM:

[jira] [Comment Edited] (SPARK-5004) PySpark does not handle SOCKS proxy

2014-12-30 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260969#comment-14260969 ] Eric O. LEBIGOT (EOL) edited comment on SPARK-5004 at 12/30/14 10:20 AM:

[jira] [Commented] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260988#comment-14260988 ] Sean Owen commented on SPARK-5005: -- Where are these arguments coming from, your .conf

[jira] [Commented] (SPARK-5001) BlockRDD removed unreasonablly in streaming

2014-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260989#comment-14260989 ] Sean Owen commented on SPARK-5001: -- [~hanhg] You should make a pull request against

[jira] [Commented] (SPARK-4997) Check if Spark's conf needs to be put ahead of Hadoop's (for log4j purposes)

2014-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261008#comment-14261008 ] Sean Owen commented on SPARK-4997: -- Duplicate of SPARK-2913? see also SPARK-2007,

[jira] [Commented] (SPARK-4660) JavaSerializer uses wrong classloader

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261014#comment-14261014 ] Apache Spark commented on SPARK-4660: - User 'pkolaczk' has created a pull request for

[jira] [Commented] (SPARK-4660) JavaSerializer uses wrong classloader

2014-12-30 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261016#comment-14261016 ] Piotr Kołaczkowski commented on SPARK-4660: ---

[jira] [Issue Comment Deleted] (SPARK-4660) JavaSerializer uses wrong classloader

2014-12-30 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated SPARK-4660: -- Comment: was deleted (was: https://github.com/apache/spark/pull/3840) JavaSerializer

[jira] [Commented] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261018#comment-14261018 ] yangping wu commented on SPARK-5005: Hi,Sean Owen,{code}executor-cores{code} is read

[jira] [Commented] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261019#comment-14261019 ] yangping wu commented on SPARK-5005: Hi,Sean Owen,{code}executor-cores{code} is read

[jira] [Issue Comment Deleted] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yangping wu updated SPARK-5005: --- Comment: was deleted (was: Hi,Sean Owen,{code}executor-cores{code} is read from

[jira] [Commented] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0

2014-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261022#comment-14261022 ] Sean Owen commented on SPARK-5005: -- {{SPARK_WORKER_CORES}} is for standalone mode but you

[jira] [Created] (SPARK-5006) spark.port.maxRetries doesn't work

2014-12-30 Thread WangTaoTheTonic (JIRA)
WangTaoTheTonic created SPARK-5006: -- Summary: spark.port.maxRetries doesn't work Key: SPARK-5006 URL: https://issues.apache.org/jira/browse/SPARK-5006 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5006) spark.port.maxRetries doesn't work

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261052#comment-14261052 ] Apache Spark commented on SPARK-5006: - User 'WangTaoTheTonic' has created a pull

[jira] [Commented] (SPARK-2757) Add Mima test for Spark Sink after 1.10 is released

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261061#comment-14261061 ] Apache Spark commented on SPARK-2757: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-4998) train methods in object DecisionTree cannot work when using java reflection

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261075#comment-14261075 ] Apache Spark commented on SPARK-4998: - User 'ljzzju' has created a pull request for

[jira] [Commented] (SPARK-4386) Parquet file write performance improvement

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261076#comment-14261076 ] Apache Spark commented on SPARK-4386: - User 'MickDavies' has created a pull request

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2014-12-30 Thread Prabeesh K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261080#comment-14261080 ] Prabeesh K commented on SPARK-4631: --- [~tdas] please refer

[jira] [Created] (SPARK-5007) Try random port when startServiceOnPort to reduce the chance of port collision

2014-12-30 Thread YanTang Zhai (JIRA)
YanTang Zhai created SPARK-5007: --- Summary: Try random port when startServiceOnPort to reduce the chance of port collision Key: SPARK-5007 URL: https://issues.apache.org/jira/browse/SPARK-5007 Project:

[jira] [Commented] (SPARK-5007) Try random port when startServiceOnPort to reduce the chance of port collision

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261097#comment-14261097 ] Apache Spark commented on SPARK-5007: - User 'YanTangZhai' has created a pull request

[jira] [Commented] (SPARK-4995) Replace Vector.toBreeze.activeIterator with foreachActive

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261099#comment-14261099 ] Apache Spark commented on SPARK-4995: - User 'james64' has created a pull request for

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-30 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261185#comment-14261185 ] Peng Cheng commented on SPARK-4923: --- Hey, a guy waiting for it was complaining that the

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261198#comment-14261198 ] Sean Owen commented on SPARK-4923: -- The typesafe repo would not be where the artifacts

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-30 Thread Edwin Jansen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261216#comment-14261216 ] Edwin Jansen commented on SPARK-4923: - I am sorry for any misunderstanding. I did not

[jira] [Commented] (SPARK-4997) Check if Spark's conf needs to be put ahead of Hadoop's (for log4j purposes)

2014-12-30 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261234#comment-14261234 ] Nicholas Chammas commented on SPARK-4997: - Could be, though this issue is specific

[jira] [Created] (SPARK-5008) Persistent HDFS does not recognize EBS Volumes

2014-12-30 Thread Brad Willard (JIRA)
Brad Willard created SPARK-5008: --- Summary: Persistent HDFS does not recognize EBS Volumes Key: SPARK-5008 URL: https://issues.apache.org/jira/browse/SPARK-5008 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4920) current spark version in UI is not striking

2014-12-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4920: -- Target Version/s: 1.1.1, 1.0.3, 1.2.1 (was: 1.2.1) current spark version in UI is not striking

[jira] [Updated] (SPARK-4920) current spark version in UI is not striking

2014-12-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4920: -- Labels: backport-needed (was: ) current spark version in UI is not striking

[jira] [Commented] (SPARK-4920) current spark version in UI is not striking

2014-12-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261271#comment-14261271 ] Josh Rosen commented on SPARK-4920: --- Note that there are multiple PRs attached to this

[jira] [Updated] (SPARK-4882) PySpark broadcast breaks when using KryoSerializer

2014-12-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4882: -- Target Version/s: 1.3.0, 1.2.1 (was: 1.0.3, 1.3.0, 1.2.1) Affects Version/s: (was: 1.1.1)

[jira] [Resolved] (SPARK-4882) PySpark broadcast breaks when using KryoSerializer

2014-12-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4882. --- Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 This was resolved by my PR for

[jira] [Commented] (SPARK-4997) Check if Spark's conf needs to be put ahead of Hadoop's (for log4j purposes)

2014-12-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261285#comment-14261285 ] Josh Rosen commented on SPARK-4997: --- I've noticed this issue on {{spark-ec2}} because

[jira] [Created] (SPARK-5009) allCaseVersions function in SqlLexical leads to StackOverflow Exception

2014-12-30 Thread shengli (JIRA)
shengli created SPARK-5009: -- Summary: allCaseVersions function in SqlLexical leads to StackOverflow Exception Key: SPARK-5009 URL: https://issues.apache.org/jira/browse/SPARK-5009 Project: Spark

[jira] [Created] (SPARK-5010) native openblas library doesn't work: undefined symbol: cblas_dscal

2014-12-30 Thread Tomas Hudik (JIRA)
Tomas Hudik created SPARK-5010: -- Summary: native openblas library doesn't work: undefined symbol: cblas_dscal Key: SPARK-5010 URL: https://issues.apache.org/jira/browse/SPARK-5010 Project: Spark

[jira] [Commented] (SPARK-4997) Check if Spark's conf needs to be put ahead of Hadoop's (for log4j purposes)

2014-12-30 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261308#comment-14261308 ] Nicholas Chammas commented on SPARK-4997: - OK, I'll close this issue as a

[jira] [Closed] (SPARK-4997) Check if Spark's conf needs to be put ahead of Hadoop's (for log4j purposes)

2014-12-30 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas closed SPARK-4997. --- Resolution: Duplicate Check if Spark's conf needs to be put ahead of Hadoop's (for log4j

[jira] [Created] (SPARK-5011) Add support for WITH SERDEPROPERTIES, TBLPROPERTIES in CREATE TEMPORARY TABLE

2014-12-30 Thread shengli (JIRA)
shengli created SPARK-5011: -- Summary: Add support for WITH SERDEPROPERTIES, TBLPROPERTIES in CREATE TEMPORARY TABLE Key: SPARK-5011 URL: https://issues.apache.org/jira/browse/SPARK-5011 Project: Spark

[jira] [Updated] (SPARK-5004) PySpark does not handle SOCKS proxy

2014-12-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5004: -- Priority: Major (was: Blocker) Description: PySpark cannot run even the quick start examples

[jira] [Commented] (SPARK-5011) Add support for WITH SERDEPROPERTIES, TBLPROPERTIES in CREATE TEMPORARY TABLE

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261321#comment-14261321 ] Apache Spark commented on SPARK-5011: - User 'OopsOutOfMemory' has created a pull

[jira] [Commented] (SPARK-4963) SchemaRDD.sample may return wrong results

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261331#comment-14261331 ] Michael Armbrust commented on SPARK-4963: - Mutability is an internal optimization

[jira] [Closed] (SPARK-3588) Gaussian Mixture Model clustering

2014-12-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-3588. Resolution: Duplicate Gaussian Mixture Model clustering -

[jira] [Created] (SPARK-5012) Python API for Gaussian Mixture Model

2014-12-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5012: Summary: Python API for Gaussian Mixture Model Key: SPARK-5012 URL: https://issues.apache.org/jira/browse/SPARK-5012 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-5013) User guide for Gaussian Mixture Model

2014-12-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5013: Summary: User guide for Gaussian Mixture Model Key: SPARK-5013 URL: https://issues.apache.org/jira/browse/SPARK-5013 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5012) Python API for Gaussian Mixture Model

2014-12-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261363#comment-14261363 ] Xiangrui Meng commented on SPARK-5012: -- [~tgaloppo] Would you be interested in

[jira] [Commented] (SPARK-4921) Performance issue caused by TaskSetManager returning PROCESS_LOCAL for NO_PREF tasks

2014-12-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261384#comment-14261384 ] Sandy Ryza commented on SPARK-4921: --- Ah, makes sense. In the query, are some splits

[jira] [Resolved] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4908. - Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Issue resolved by

[jira] [Resolved] (SPARK-4975) HiveInspectorSuite test failure

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4975. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3814

[jira] [Commented] (SPARK-1010) Update all unit tests to use SparkConf instead of system properties

2014-12-30 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261394#comment-14261394 ] Nicholas Chammas commented on SPARK-1010: - [~joshrosen] Haven't you been doing

[jira] [Commented] (SPARK-4861) Refactory command in spark sql

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261395#comment-14261395 ] Apache Spark commented on SPARK-4861: - User 'alexliu68' has created a pull request for

[jira] [Commented] (SPARK-4943) Parsing error for query with table name having dot

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261396#comment-14261396 ] Apache Spark commented on SPARK-4943: - User 'alexliu68' has created a pull request for

[jira] [Commented] (SPARK-5012) Python API for Gaussian Mixture Model

2014-12-30 Thread Travis Galoppo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261413#comment-14261413 ] Travis Galoppo commented on SPARK-5012: --- [~mengxr] I'd be happy to. Python API for

[jira] [Resolved] (SPARK-4904) Remove the foldable checking in HiveGenericUdf.eval

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4904. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3745

[jira] [Commented] (SPARK-1010) Update all unit tests to use SparkConf instead of system properties

2014-12-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261420#comment-14261420 ] Josh Rosen commented on SPARK-1010: --- Yeah, didn't realize there was already a JIRA for

[jira] [Commented] (SPARK-1010) Update all unit tests to use SparkConf instead of system properties

2014-12-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261423#comment-14261423 ] Apache Spark commented on SPARK-1010: - User 'JoshRosen' has created a pull request for

[jira] [Resolved] (SPARK-4893) Clean up uses of System.setProperty in unit tests

2014-12-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4893. --- Resolution: Duplicate Resolving this as a duplicate of SPARK-1010. Clean up uses of

[jira] [Updated] (SPARK-5008) Persistent HDFS does not recognize EBS Volumes

2014-12-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5008: --- Component/s: EC2 Persistent HDFS does not recognize EBS Volumes

[jira] [Updated] (SPARK-5008) Persistent HDFS does not recognize EBS Volumes

2014-12-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5008: --- Labels: (was: amazon aws ec2 hdfs persistent) Persistent HDFS does not recognize EBS

[jira] [Commented] (SPARK-4921) Performance issue caused by TaskSetManager returning PROCESS_LOCAL for NO_PREF tasks

2014-12-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261436#comment-14261436 ] Xuefu Zhang commented on SPARK-4921: Some will be NODE_LOCAL, but others will be

[jira] [Resolved] (SPARK-5002) Using ascending by default when not specify order in order by

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5002. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3838

[jira] [Resolved] (SPARK-4512) Unresolved Attribute Exception for sort by

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4512. - Resolution: Fixed Fix Version/s: 1.3.0 Unresolved Attribute Exception for sort by

[jira] [Updated] (SPARK-4512) Unresolved Attribute Exception for sort by

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4512: Assignee: Cheng Hao Unresolved Attribute Exception for sort by

[jira] [Resolved] (SPARK-4916) [SQL][DOCS]Update SQL programming guide about cache section

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4916. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3759

[jira] [Resolved] (SPARK-4930) [SQL][DOCS]Update SQL programming guide

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4930. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3773

[jira] [Created] (SPARK-5014) GaussianMixture (GMM) improvements

2014-12-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5014: Summary: GaussianMixture (GMM) improvements Key: SPARK-5014 URL: https://issues.apache.org/jira/browse/SPARK-5014 Project: Spark Issue Type:

[jira] [Closed] (SPARK-5014) GaussianMixture (GMM) improvements

2014-12-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-5014. Resolution: Not a Problem No need for umbrella JIRA GaussianMixture (GMM) improvements

[jira] [Created] (SPARK-5015) GaussianMixtureEM should take random seed parameter

2014-12-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5015: Summary: GaussianMixtureEM should take random seed parameter Key: SPARK-5015 URL: https://issues.apache.org/jira/browse/SPARK-5015 Project: Spark

[jira] [Resolved] (SPARK-4928) Operator ,,=,= with decimal between different precision report error

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4928. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3767

[jira] [Created] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

2014-12-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5016: Summary: GaussianMixtureEM should distribute matrix inverse for large numFeatures, k Key: SPARK-5016 URL: https://issues.apache.org/jira/browse/SPARK-5016

[jira] [Created] (SPARK-5017) GaussianMixtureEM should use SVD for Gaussian initialization

2014-12-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5017: Summary: GaussianMixtureEM should use SVD for Gaussian initialization Key: SPARK-5017 URL: https://issues.apache.org/jira/browse/SPARK-5017 Project: Spark

[jira] [Created] (SPARK-5018) Make MultivariateGaussian public

2014-12-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5018: Summary: Make MultivariateGaussian public Key: SPARK-5018 URL: https://issues.apache.org/jira/browse/SPARK-5018 Project: Spark Issue Type:

[jira] [Updated] (SPARK-5017) GaussianMixtureEM should use SVD for Gaussian initialization

2014-12-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5017: - Priority: Critical (was: Major) GaussianMixtureEM should use SVD for Gaussian

[jira] [Updated] (SPARK-5018) Make MultivariateGaussian public

2014-12-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5018: - Priority: Critical (was: Major) Make MultivariateGaussian public

[jira] [Updated] (SPARK-5017) GaussianMixtureEM should use SVD for Gaussian initialization

2014-12-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5017: - Priority: Major (was: Critical) GaussianMixtureEM should use SVD for Gaussian

[jira] [Created] (SPARK-5019) Update GMM API to use MultivariateGaussian

2014-12-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5019: Summary: Update GMM API to use MultivariateGaussian Key: SPARK-5019 URL: https://issues.apache.org/jira/browse/SPARK-5019 Project: Spark Issue Type:

[jira] [Created] (SPARK-5020) GaussianMixtureModel.predictMembership() should take an RDD only

2014-12-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5020: Summary: GaussianMixtureModel.predictMembership() should take an RDD only Key: SPARK-5020 URL: https://issues.apache.org/jira/browse/SPARK-5020 Project:

[jira] [Created] (SPARK-5021) GaussianMixtureEM should be faster for SparseVector input

2014-12-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5021: Summary: GaussianMixtureEM should be faster for SparseVector input Key: SPARK-5021 URL: https://issues.apache.org/jira/browse/SPARK-5021 Project: Spark

[jira] [Resolved] (SPARK-4937) Adding optimization to simplify the filter condition

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4937. - Resolution: Fixed Assignee: Cheng Lian Adding optimization to simplify the filter

[jira] [Resolved] (SPARK-4935) When hive.cli.print.header configured, spark-sql aborted if passed in a invalid sql

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4935. - Resolution: Fixed Issue resolved by pull request 3761

[jira] [Resolved] (SPARK-4570) Add broadcast join to left semi join

2014-12-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4570. - Resolution: Fixed Fix Version/s: (was: 1.1.0) 1.3.0 Issue

[jira] [Created] (SPARK-5023) In Web UI job history, the total job duration is much smaller than the sum of its stages

2014-12-30 Thread Eran Medan (JIRA)
Eran Medan created SPARK-5023: - Summary: In Web UI job history, the total job duration is much smaller than the sum of its stages Key: SPARK-5023 URL: https://issues.apache.org/jira/browse/SPARK-5023

[jira] [Updated] (SPARK-5023) In Web UI job history, the total job duration is incorrect (much smaller than the sum of its stages)

2014-12-30 Thread Eran Medan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eran Medan updated SPARK-5023: -- Summary: In Web UI job history, the total job duration is incorrect (much smaller than the sum of its

[jira] [Created] (SPARK-5024) Provide duration summary by job group ID

2014-12-30 Thread Eran Medan (JIRA)
Eran Medan created SPARK-5024: - Summary: Provide duration summary by job group ID Key: SPARK-5024 URL: https://issues.apache.org/jira/browse/SPARK-5024 Project: Spark Issue Type: Improvement

  1   2   >