[jira] [Assigned] (SPARK-8234) misc function: md5

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8234: --- Assignee: (was: Apache Spark) misc function: md5 --

[jira] [Commented] (SPARK-8234) misc function: md5

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583034#comment-14583034 ] Apache Spark commented on SPARK-8234: - User 'qiansl127' has created a pull request for

[jira] [Assigned] (SPARK-8234) misc function: md5

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8234: --- Assignee: Apache Spark misc function: md5 -- Key:

[jira] [Created] (SPARK-8323) Remove mapOutputTracker field in TaskSchedulerImpl

2015-06-12 Thread patrickliu (JIRA)
patrickliu created SPARK-8323: - Summary: Remove mapOutputTracker field in TaskSchedulerImpl Key: SPARK-8323 URL: https://issues.apache.org/jira/browse/SPARK-8323 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-8323) Remove mapOutputTracker field in TaskSchedulerImpl

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8323: --- Assignee: Apache Spark Remove mapOutputTracker field in TaskSchedulerImpl

[jira] [Assigned] (SPARK-8186) date/time function: date_add

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8186: --- Assignee: (was: Apache Spark) date/time function: date_add

[jira] [Assigned] (SPARK-8187) date/time function: date_sub

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8187: --- Assignee: Apache Spark date/time function: date_sub

[jira] [Assigned] (SPARK-8185) date/time function: datediff

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8185: --- Assignee: (was: Apache Spark) date/time function: datediff

[jira] [Assigned] (SPARK-8187) date/time function: date_sub

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8187: --- Assignee: (was: Apache Spark) date/time function: date_sub

[jira] [Assigned] (SPARK-8186) date/time function: date_add

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8186: --- Assignee: Apache Spark date/time function: date_add

[jira] [Commented] (SPARK-8187) date/time function: date_sub

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583060#comment-14583060 ] Apache Spark commented on SPARK-8187: - User 'adrian-wang' has created a pull request

[jira] [Commented] (SPARK-8185) date/time function: datediff

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583058#comment-14583058 ] Apache Spark commented on SPARK-8185: - User 'adrian-wang' has created a pull request

[jira] [Commented] (SPARK-8186) date/time function: date_add

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583059#comment-14583059 ] Apache Spark commented on SPARK-8186: - User 'adrian-wang' has created a pull request

[jira] [Assigned] (SPARK-8185) date/time function: datediff

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8185: --- Assignee: Apache Spark date/time function: datediff

[jira] [Updated] (SPARK-8287) Filters not pushed with substitution through aggregation

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8287: - Target Version/s: (was: 1.5.0) Filters not pushed with substitution through aggregation

[jira] [Updated] (SPARK-8287) Filters not pushed with substitution through aggregation

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8287: - Fix Version/s: (was: 1.4.0) Filters not pushed with substitution through aggregation

[jira] [Commented] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-06-12 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583115#comment-14583115 ] Saisai Shao commented on SPARK-8297: Hi [~mridulm80], I'm trying to simulate your

[jira] [Commented] (SPARK-7938) Use errorprone in Spark

2015-06-12 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583143#comment-14583143 ] Yijie Shen commented on SPARK-7938: --- What's the status of this ticket? Do we still need

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6197: - Fix Version/s: (was: 1.4.0) handle json parse exception for eventlog file not finished writing

[jira] [Updated] (SPARK-8119) Spark will set total executor when some executors fail.

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8119: - Fix Version/s: (was: 1.4.0) Spark will set total executor when some executors fail.

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6197: - Target Version/s: 1.3.2, 1.4.1 (was: 1.3.2, 1.4.0) handle json parse exception for eventlog file not

[jira] [Assigned] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7284: --- Assignee: Apache Spark (was: Tathagata Das) Update streaming documentation for Spark 1.4.0

[jira] [Assigned] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7284: --- Assignee: Tathagata Das (was: Apache Spark) Update streaming documentation for Spark 1.4.0

[jira] [Commented] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583054#comment-14583054 ] Apache Spark commented on SPARK-7284: - User 'tdas' has created a pull request for this

[jira] [Comment Edited] (SPARK-7106) Support model save/load in Python's FPGrowth

2015-06-12 Thread Hrishikesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581754#comment-14581754 ] Hrishikesh edited comment on SPARK-7106 at 6/12/15 7:32 AM:

[jira] [Commented] (SPARK-7938) Use errorprone in Spark

2015-06-12 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583191#comment-14583191 ] Yijie Shen commented on SPARK-7938: --- Get it. :) Use errorprone in Spark

[jira] [Commented] (SPARK-8311) saveAsTextFile with Hadoop1 could lead to errors

2015-06-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583202#comment-14583202 ] Cheng Lian commented on SPARK-8311: --- Hi [~shivaram], what version of Hadoop 1 were you

[jira] [Assigned] (SPARK-8221) math function: pmod

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8221: --- Assignee: Apache Spark (was: zhichao-li) math function: pmod ---

[jira] [Assigned] (SPARK-8221) math function: pmod

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8221: --- Assignee: zhichao-li (was: Apache Spark) math function: pmod ---

[jira] [Commented] (SPARK-7106) Support model save/load in Python's FPGrowth

2015-06-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583106#comment-14583106 ] Joseph K. Bradley commented on SPARK-7106: -- [~hrishikesh91] Yes, it should.

[jira] [Commented] (SPARK-6724) Model import/export for FPGrowth

2015-06-12 Thread Hrishikesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583139#comment-14583139 ] Hrishikesh commented on SPARK-6724: --- [~josephkb], please assign this ticket to me.

[jira] [Assigned] (SPARK-8323) Remove mapOutputTracker field in TaskSchedulerImpl

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8323: --- Assignee: (was: Apache Spark) Remove mapOutputTracker field in TaskSchedulerImpl

[jira] [Commented] (SPARK-8323) Remove mapOutputTracker field in TaskSchedulerImpl

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583033#comment-14583033 ] Apache Spark commented on SPARK-8323: - User 'yufan-liu' has created a pull request for

[jira] [Commented] (SPARK-8237) misc function: sha2

2015-06-12 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583167#comment-14583167 ] Liang-Chi Hsieh commented on SPARK-8237: I'll take this. Thanks. misc function:

[jira] [Commented] (SPARK-7267) Push down Project when it's child is Limit

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583041#comment-14583041 ] Apache Spark commented on SPARK-7267: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-7289) Combine Limit and Sort to avoid total ordering

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583042#comment-14583042 ] Apache Spark commented on SPARK-7289: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-7938) Use errorprone in Spark

2015-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583147#comment-14583147 ] Reynold Xin commented on SPARK-7938: Yes. Just super swamped prior to Spark Summit.

[jira] [Created] (SPARK-8326) Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'spark_2_2_*'' returned 1. Error: Nothing to do

2015-06-12 Thread Judge Hiciano (JIRA)
Judge Hiciano created SPARK-8326: Summary: Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'spark_2_2_*'' returned 1. Error: Nothing to do Key: SPARK-8326 URL:

[jira] [Resolved] (SPARK-8326) Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'spark_2_2_*'' returned 1. Error: Nothing to do

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8326. -- Resolution: Invalid This is not related to any packaging provided by spark. Fail: Execution of

[jira] [Resolved] (SPARK-8173) A class which holds all the constants should be present

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8173. -- Resolution: Won't Fix A class which holds all the constants should be present

[jira] [Created] (SPARK-8324) Register Query as view through JDBC interface

2015-06-12 Thread Mayoor Rao (JIRA)
Mayoor Rao created SPARK-8324: - Summary: Register Query as view through JDBC interface Key: SPARK-8324 URL: https://issues.apache.org/jira/browse/SPARK-8324 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-8324) Register Query as view through JDBC interface

2015-06-12 Thread Mayoor Rao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayoor Rao updated SPARK-8324: -- Description: We currently have capability of adding csv, json, parquet, etc files as table through

[jira] [Updated] (SPARK-8325) Ability to provide role based row level authorization through Spark SQL

2015-06-12 Thread Mayoor Rao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayoor Rao updated SPARK-8325: -- Attachment: Jira_request_table_authorization.docx More details are covered in the attached document

[jira] [Created] (SPARK-8325) Ability to provide role based row level authorization through Spark SQL

2015-06-12 Thread Mayoor Rao (JIRA)
Mayoor Rao created SPARK-8325: - Summary: Ability to provide role based row level authorization through Spark SQL Key: SPARK-8325 URL: https://issues.apache.org/jira/browse/SPARK-8325 Project: Spark

[jira] [Updated] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-12 Thread Sebastian Walz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Walz updated SPARK-8335: -- Description: org.apache.spark.mllib.tree.model.DecisionTreeModel has a predict method: def

[jira] [Commented] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583916#comment-14583916 ] Apache Spark commented on SPARK-8095: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-7186) Decouple internal Row from external Row

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7186: --- Assignee: Davies Liu (was: Apache Spark) Decouple internal Row from external Row

[jira] [Commented] (SPARK-7186) Decouple internal Row from external Row

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584151#comment-14584151 ] Apache Spark commented on SPARK-7186: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-7186) Decouple internal Row from external Row

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7186: --- Assignee: Apache Spark (was: Davies Liu) Decouple internal Row from external Row

[jira] [Assigned] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8334: --- Assignee: (was: Apache Spark) Binary logical plan should provide more realistic

[jira] [Commented] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583980#comment-14583980 ] Apache Spark commented on SPARK-8334: - User 'navis' has created a pull request for

[jira] [Assigned] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8334: --- Assignee: Apache Spark Binary logical plan should provide more realistic statistics

[jira] [Resolved] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-06-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7819. - Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Yin Huai Isolated Hive

[jira] [Created] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-12 Thread Sebastian Walz (JIRA)
Sebastian Walz created SPARK-8335: - Summary: DecisionTreeModel.predict() return type not convenient! Key: SPARK-8335 URL: https://issues.apache.org/jira/browse/SPARK-8335 Project: Spark

[jira] [Commented] (SPARK-4233) Simplify the Aggregation Function implementation

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583931#comment-14583931 ] Herman van Hovell tot Westerflier commented on SPARK-4233: -- Ok,

[jira] [Commented] (SPARK-7712) Native Spark Window Functions Performance Improvements

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583966#comment-14583966 ] Herman van Hovell tot Westerflier commented on SPARK-7712: -- A

[jira] [Created] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Navis (JIRA)
Navis created SPARK-8334: Summary: Binary logical plan should provide more realistic statistics Key: SPARK-8334 URL: https://issues.apache.org/jira/browse/SPARK-8334 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-6259) Python API for LDA

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6259: --- Assignee: (was: Apache Spark) Python API for LDA --

[jira] [Assigned] (SPARK-6259) Python API for LDA

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6259: --- Assignee: Apache Spark Python API for LDA -- Key:

[jira] [Commented] (SPARK-6259) Python API for LDA

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584010#comment-14584010 ] Apache Spark commented on SPARK-6259: - User 'yu-iskw' has created a pull request for

[jira] [Resolved] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-06-12 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7284. -- Resolution: Fixed Fix Version/s: 1.4.1 Update streaming documentation for Spark 1.4.0

[jira] [Comment Edited] (SPARK-7712) Native Spark Window Functions Performance Improvements

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583966#comment-14583966 ] Herman van Hovell tot Westerflier edited comment on SPARK-7712 at 6/12/15 7:49 PM:

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

2015-06-12 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583886#comment-14583886 ] Debasish Das commented on SPARK-2336: - Very cool idea Sen. Did you also look into

[jira] [Comment Edited] (SPARK-2336) Approximate k-NN Models for MLLib

2015-06-12 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583886#comment-14583886 ] Debasish Das edited comment on SPARK-2336 at 6/12/15 6:51 PM: --

[jira] [Created] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-12 Thread Tao Li (JIRA)
Tao Li created SPARK-8332: - Summary: NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer Key: SPARK-8332 URL: https://issues.apache.org/jira/browse/SPARK-8332 Project: Spark

[jira] [Updated] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-12 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-8332: -- Description: I complied new spark 1.4.0 versio. But when I run a simple WordCount demo, it throws

[jira] [Commented] (SPARK-7897) Column with an unsigned bigint should be treated as DecimalType in JDBCRDD

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583937#comment-14583937 ] Apache Spark commented on SPARK-7897: - User 'rtreffer' has created a pull request for

[jira] [Reopened] (SPARK-7897) Column with an unsigned bigint should be treated as DecimalType in JDBCRDD

2015-06-12 Thread Rene Treffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rene Treffer reopened SPARK-7897: - I think this should be Decimal(20,0), not Decimal.Unlimited Column with an unsigned bigint should

[jira] [Created] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2015-06-12 Thread sheng (JIRA)
sheng created SPARK-8333: Summary: Spark failed to delete temp directory created by HiveContext Key: SPARK-8333 URL: https://issues.apache.org/jira/browse/SPARK-8333 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-7712) Native Spark Window Functions Performance Improvements

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583966#comment-14583966 ] Herman van Hovell tot Westerflier edited comment on SPARK-7712 at 6/12/15 7:49 PM:

[jira] [Commented] (SPARK-6892) Recovery from checkpoint will also reuse the application id when write eventLog in yarn-cluster mode

2015-06-12 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584086#comment-14584086 ] Hari Shreedharan commented on SPARK-6892: - This should have been fixed by

[jira] [Commented] (SPARK-5680) Sum function on all null values, should return zero

2015-06-12 Thread Holman Lan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584448#comment-14584448 ] Holman Lan commented on SPARK-5680: --- Thanks. A closer look at the statement in the

[jira] [Commented] (SPARK-5680) Sum function on all null values, should return zero

2015-06-12 Thread Holman Lan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584324#comment-14584324 ] Holman Lan commented on SPARK-5680: --- Hi Guys, Just curious about this change to return

[jira] [Updated] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8327: --- Affects Version/s: (was: 1.4.0) Ganglia failed to start while starting

[jira] [Created] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration

2015-06-12 Thread Vladimir Vladimirov (JIRA)
Vladimir Vladimirov created SPARK-8338: -- Summary: Ganglia fails to run because of broken httpd.conf configuration Key: SPARK-8338 URL: https://issues.apache.org/jira/browse/SPARK-8338 Project:

[jira] [Comment Edited] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584344#comment-14584344 ] Vladimir Vladimirov edited comment on SPARK-8338 at 6/13/15 12:59 AM:

[jira] [Created] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Ted Yu (JIRA)
Ted Yu created SPARK-8336: - Summary: Fix NullPointerException with functions.rand() Key: SPARK-8336 URL: https://issues.apache.org/jira/browse/SPARK-8336 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8336: --- Assignee: Apache Spark Fix NullPointerException with functions.rand()

[jira] [Assigned] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8336: --- Assignee: (was: Apache Spark) Fix NullPointerException with functions.rand()

[jira] [Commented] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584294#comment-14584294 ] Apache Spark commented on SPARK-8336: - User 'tedyu' has created a pull request for

[jira] [Updated] (SPARK-8318) Spark Streaming Starter JIRAs

2015-06-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8318: --- Issue Type: Improvement (was: Bug) Spark Streaming Starter JIRAs

[jira] [Updated] (SPARK-8338) Ganglia fails to run because of httpd.conf configuration mismatch

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8338: --- Summary: Ganglia fails to run because of httpd.conf configuration mismatch (was:

[jira] [Commented] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584344#comment-14584344 ] Vladimir Vladimirov commented on SPARK-8338: There are several possible

[jira] [Created] (SPARK-8339) Itertools islice requires an integer for the stop argument.

2015-06-12 Thread Kevin Conor (JIRA)
Kevin Conor created SPARK-8339: -- Summary: Itertools islice requires an integer for the stop argument. Key: SPARK-8339 URL: https://issues.apache.org/jira/browse/SPARK-8339 Project: Spark Issue

[jira] [Assigned] (SPARK-8339) Itertools islice requires an integer for the stop argument.

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8339: --- Assignee: (was: Apache Spark) Itertools islice requires an integer for the stop

[jira] [Assigned] (SPARK-8339) Itertools islice requires an integer for the stop argument.

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8339: --- Assignee: Apache Spark Itertools islice requires an integer for the stop argument.

[jira] [Commented] (SPARK-8339) Itertools islice requires an integer for the stop argument.

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584397#comment-14584397 ] Apache Spark commented on SPARK-8339: - User 'kconor' has created a pull request for

[jira] [Created] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

2015-06-12 Thread Amit Ramesh (JIRA)
Amit Ramesh created SPARK-8337: -- Summary: KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version Key: SPARK-8337 URL: https://issues.apache.org/jira/browse/SPARK-8337

[jira] [Commented] (SPARK-5680) Sum function on all null values, should return zero

2015-06-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584338#comment-14584338 ] Michael Armbrust commented on SPARK-5680: - As stated in the comment, the

[jira] [Updated] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-12 Thread Sebastian Walz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Walz updated SPARK-8335: -- Labels: easyfix machine_learning (was: easyfix) DecisionTreeModel.predict() return type not

[jira] [Commented] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584341#comment-14584341 ] Vladimir Vladimirov commented on SPARK-8338: Same exception happens for both

[jira] [Updated] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8338: --- Priority: Minor (was: Major) Ganglia fails to run because of broken httpd.conf

[jira] [Resolved] (SPARK-8314) improvement in performance of MLUtils.appendBias

2015-06-12 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-8314. Resolution: Fixed Merged into master

[jira] [Commented] (SPARK-8338) Ganglia fails to run because of httpd.conf configuration mismatch

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584379#comment-14584379 ] Vladimir Vladimirov commented on SPARK-8338: Here are PRs for branches 1.3 and

[jira] [Commented] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583418#comment-14583418 ] Vladimir Vladimirov commented on SPARK-8327: Root cause: ganglia/init.sh

[jira] [Commented] (SPARK-8159) Improve SQL/DataFrame expression coverage

2015-06-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583423#comment-14583423 ] Jérémy Subtil commented on SPARK-8159: -- I'd be interested by {{collect_set}} and

[jira] [Comment Edited] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583418#comment-14583418 ] Vladimir Vladimirov edited comment on SPARK-8327 at 6/12/15 4:05 PM:

[jira] [Updated] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8327: --- Description: exception shown {code} [FAILED] Starting httpd: httpd: Syntax error on

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583218#comment-14583218 ] Apache Spark commented on SPARK-7993: - User 'zsxwing' has created a pull request for

[jira] [Updated] (SPARK-8324) Register Query as view through JDBC interface

2015-06-12 Thread Mayoor Rao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayoor Rao updated SPARK-8324: -- Attachment: Jira_request_register_query_as_view.docx Further details are covered in the document

  1   2   >