[jira] [Created] (SPARK-7993) Improve DataFrame.show() output

2015-06-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7993: -- Summary: Improve DataFrame.show() output Key: SPARK-7993 URL: https://issues.apache.org/jira/browse/SPARK-7993 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-7799) Move StreamingContext.actorStream to a separate project and deprecate it in StreamingContext

2015-06-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-7799: Summary: Move StreamingContext.actorStream to a separate project and deprecate it in

[jira] [Commented] (SPARK-7966) add Spreading Activation algorithm to GraphX

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566967#comment-14566967 ] Apache Spark commented on SPARK-7966: - User 'tarekauel' has created a pull request for

[jira] [Assigned] (SPARK-7966) add Spreading Activation algorithm to GraphX

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7966: --- Assignee: (was: Apache Spark) add Spreading Activation algorithm to GraphX

[jira] [Assigned] (SPARK-7966) add Spreading Activation algorithm to GraphX

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7966: --- Assignee: Apache Spark add Spreading Activation algorithm to GraphX

[jira] [Created] (SPARK-7994) Remove StreamingContext.actorStream

2015-06-01 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7994: --- Summary: Remove StreamingContext.actorStream Key: SPARK-7994 URL: https://issues.apache.org/jira/browse/SPARK-7994 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-7799) Move StreamingContext.actorStream to a separate project and deprecate it in StreamingContext

2015-06-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-7799: Target Version/s: 1.5.0 (was: 1.6.0) Move StreamingContext.actorStream to a separate project and

[jira] [Created] (SPARK-7995) Move AkkaRpcEnv to a separate project and remove Akka from the dependencies of Core

2015-06-01 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7995: --- Summary: Move AkkaRpcEnv to a separate project and remove Akka from the dependencies of Core Key: SPARK-7995 URL: https://issues.apache.org/jira/browse/SPARK-7995

[jira] [Created] (SPARK-7996) Deprecate the developer api SparkEnv.actorSystem

2015-06-01 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7996: --- Summary: Deprecate the developer api SparkEnv.actorSystem Key: SPARK-7996 URL: https://issues.apache.org/jira/browse/SPARK-7996 Project: Spark Issue Type:

[jira] [Created] (SPARK-7997) Remove the developer api SparkEnv.actorSystem

2015-06-01 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7997: --- Summary: Remove the developer api SparkEnv.actorSystem Key: SPARK-7997 URL: https://issues.apache.org/jira/browse/SPARK-7997 Project: Spark Issue Type:

[jira] [Created] (SPARK-7998) A better frequent item API

2015-06-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7998: -- Summary: A better frequent item API Key: SPARK-7998 URL: https://issues.apache.org/jira/browse/SPARK-7998 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-7998) A better frequent item API

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7998: --- Description: The current freqItems API is really awkward to use. It returns a DataFrame with a

[jira] [Updated] (SPARK-7993) Improve DataFrame.show() output

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7993: --- Labels: starter (was: ) Improve DataFrame.show() output ---

[jira] [Updated] (SPARK-7993) Improve DataFrame.show() output

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7993: --- Description: 1. Each column should be at the minimum 3 characters wide. Right now if the widest

[jira] [Created] (SPARK-7999) Graph complement

2015-06-01 Thread Tarek Auel (JIRA)
Tarek Auel created SPARK-7999: - Summary: Graph complement Key: SPARK-7999 URL: https://issues.apache.org/jira/browse/SPARK-7999 Project: Spark Issue Type: Improvement Reporter: Tarek

[jira] [Updated] (SPARK-7999) Graph complement

2015-06-01 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarek Auel updated SPARK-7999: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-7893 Graph complement

[jira] [Updated] (SPARK-7999) Graph complement

2015-06-01 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarek Auel updated SPARK-7999: -- Description: This task is for implementing the complement operation (compare to parent task).

[jira] [Commented] (SPARK-7999) Graph complement

2015-06-01 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566999#comment-14566999 ] Tarek Auel commented on SPARK-7999: --- I would propose def complement(attr: ED):

[jira] [Comment Edited] (SPARK-7999) Graph complement

2015-06-01 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566999#comment-14566999 ] Tarek Auel edited comment on SPARK-7999 at 6/1/15 7:04 AM: --- I

[jira] [Commented] (SPARK-7980) Support SQLContext.range(end)

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567207#comment-14567207 ] Apache Spark commented on SPARK-7980: - User 'animeshbaranawal' has created a pull

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567221#comment-14567221 ] Sean Owen commented on SPARK-8008: -- Isnt this what connection pooling is for? Is that an

[jira] [Assigned] (SPARK-4782) Add inferSchema support for RDD[Map[String, Any]]

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4782: --- Assignee: (was: Apache Spark) Add inferSchema support for RDD[Map[String, Any]]

[jira] [Assigned] (SPARK-4782) Add inferSchema support for RDD[Map[String, Any]]

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4782: --- Assignee: Apache Spark Add inferSchema support for RDD[Map[String, Any]]

[jira] [Created] (SPARK-8011) DecimalType is not a datatype

2015-06-01 Thread Bipin Roshan Nag (JIRA)
Bipin Roshan Nag created SPARK-8011: --- Summary: DecimalType is not a datatype Key: SPARK-8011 URL: https://issues.apache.org/jira/browse/SPARK-8011 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-06-01 Thread Steven W (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567267#comment-14567267 ] Steven W edited comment on SPARK-5389 at 6/1/15 12:56 PM: -- I

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Rene Treffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567230#comment-14567230 ] Rene Treffer commented on SPARK-8008: - At the moment each partition uses it's own

[jira] [Commented] (SPARK-7890) Document that Spark 2.11 now supports Kafka

2015-06-01 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567167#comment-14567167 ] Iulian Dragos commented on SPARK-7890: -- [~srowen] thanks for fixing it, and sorry for

[jira] [Commented] (SPARK-4782) Add inferSchema support for RDD[Map[String, Any]]

2015-06-01 Thread Jianshi Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567279#comment-14567279 ] Jianshi Huang commented on SPARK-4782: -- Thanks Luca for the clever fix! I also

[jira] [Commented] (SPARK-4782) Add inferSchema support for RDD[Map[String, Any]]

2015-06-01 Thread Luca Rosellini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567254#comment-14567254 ] Luca Rosellini commented on SPARK-4782: --- Hi Jianshi, I've just hit the same problem

[jira] [Commented] (SPARK-6816) Add SparkConf API to configure SparkR

2015-06-01 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567187#comment-14567187 ] Rick Moritz commented on SPARK-6816: One current drawback with SparkR's configuration

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567219#comment-14567219 ] Michael Armbrust commented on SPARK-8008: - I'm okay adding documentation about

[jira] [Commented] (SPARK-4782) Add inferSchema support for RDD[Map[String, Any]]

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567237#comment-14567237 ] Apache Spark commented on SPARK-4782: - User 'lucarosellini' has created a pull request

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567227#comment-14567227 ] Michael Armbrust commented on SPARK-8008: - I think connection pooling is used

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567016#comment-14567016 ] Saisai Shao commented on SPARK-4352: Hi [~sandyr], thanks a lot for your suggestion.

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567020#comment-14567020 ] Reynold Xin commented on SPARK-7993: Thanks. Note that once you change the show

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567234#comment-14567234 ] Michael Armbrust commented on SPARK-8008: - What is the problem with large

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Rene Treffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567240#comment-14567240 ] Rene Treffer commented on SPARK-8008: - I've seen very poor performance when streaming

[jira] [Updated] (SPARK-8011) DecimalType is not a datatype

2015-06-01 Thread Bipin Roshan Nag (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bipin Roshan Nag updated SPARK-8011: Description: When I run the following in spark-shell :

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-06-01 Thread Steven W (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567267#comment-14567267 ] Steven W commented on SPARK-5389: - I started seeing this when I installed JDK 6 on top of

[jira] [Created] (SPARK-8001) Make AsynchronousListenerBus.waitUntilEmpty throw TimeoutException if timeout

2015-06-01 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8001: --- Summary: Make AsynchronousListenerBus.waitUntilEmpty throw TimeoutException if timeout Key: SPARK-8001 URL: https://issues.apache.org/jira/browse/SPARK-8001 Project:

[jira] [Created] (SPARK-8005) Support INPUT__FILE__NAME virtual column

2015-06-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8005: -- Summary: Support INPUT__FILE__NAME virtual column Key: SPARK-8005 URL: https://issues.apache.org/jira/browse/SPARK-8005 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-8006) Support BLOCK__OFFSET__INSIDE__FILE virtual column

2015-06-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8006: -- Summary: Support BLOCK__OFFSET__INSIDE__FILE virtual column Key: SPARK-8006 URL: https://issues.apache.org/jira/browse/SPARK-8006 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

2015-06-01 Thread Akhil Thatipamula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567135#comment-14567135 ] Akhil Thatipamula commented on SPARK-7993: -- [~rxin] Does the 3rd modification

[jira] [Assigned] (SPARK-7980) Support SQLContext.range(end)

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7980: --- Assignee: (was: Apache Spark) Support SQLContext.range(end)

[jira] [Commented] (SPARK-7246) Rank for DataFrames

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567023#comment-14567023 ] Reynold Xin commented on SPARK-7246: This is done now with window functions right?

[jira] [Created] (SPARK-8002) Support virtual columns in SQL and DataFrames

2015-06-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8002: -- Summary: Support virtual columns in SQL and DataFrames Key: SPARK-8002 URL: https://issues.apache.org/jira/browse/SPARK-8002 Project: Spark Issue Type: Umbrella

[jira] [Updated] (SPARK-8003) Support SPARK__PARTITION__ID in SQL

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8003: --- Description: SPARK__PARTITION__ID column should return the partition index of the Spark partition.

[jira] [Updated] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8007: --- Description: Create the infrastructure so we can resolve df(SPARK__PARTITION__ID) to

[jira] [Created] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Rene Treffer (JIRA)
Rene Treffer created SPARK-8008: --- Summary: sqlContext.jdbc can kill your database due to high concurrency Key: SPARK-8008 URL: https://issues.apache.org/jira/browse/SPARK-8008 Project: Spark

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

2015-06-01 Thread Akhil Thatipamula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567017#comment-14567017 ] Akhil Thatipamula commented on SPARK-7993: -- [~rxin] I will work on this.

[jira] [Created] (SPARK-8009) [Mesos] Allow provisioning of executor logging configuration

2015-06-01 Thread Gerard Maas (JIRA)
Gerard Maas created SPARK-8009: -- Summary: [Mesos] Allow provisioning of executor logging configuration Key: SPARK-8009 URL: https://issues.apache.org/jira/browse/SPARK-8009 Project: Spark

[jira] [Commented] (SPARK-7798) Move AkkaRpcEnv to a separate project

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567096#comment-14567096 ] Sean Owen commented on SPARK-7798: -- What do you mean by separate project? I don't think

[jira] [Commented] (SPARK-8010) Implict promote Numeric type to String type in HiveTypeCoercion

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567105#comment-14567105 ] Apache Spark commented on SPARK-8010: - User 'OopsOutOfMemory' has created a pull

[jira] [Assigned] (SPARK-8010) Implict promote Numeric type to String type in HiveTypeCoercion

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8010: --- Assignee: (was: Apache Spark) Implict promote Numeric type to String type in

[jira] [Comment Edited] (SPARK-7993) Improve DataFrame.show() output

2015-06-01 Thread Akhil Thatipamula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567135#comment-14567135 ] Akhil Thatipamula edited comment on SPARK-7993 at 6/1/15 10:25 AM:

[jira] [Comment Edited] (SPARK-7993) Improve DataFrame.show() output

2015-06-01 Thread Akhil Thatipamula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567135#comment-14567135 ] Akhil Thatipamula edited comment on SPARK-7993 at 6/1/15 10:26 AM:

[jira] [Commented] (SPARK-5302) Add support for SQLContext partition columns

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567061#comment-14567061 ] Reynold Xin commented on SPARK-5302: [~btiernay] is this resolved now SPARK-5182 is

[jira] [Created] (SPARK-8004) Spark does not enclose column names when fetchting from jdbc sources

2015-06-01 Thread Rene Treffer (JIRA)
Rene Treffer created SPARK-8004: --- Summary: Spark does not enclose column names when fetchting from jdbc sources Key: SPARK-8004 URL: https://issues.apache.org/jira/browse/SPARK-8004 Project: Spark

[jira] [Created] (SPARK-8003) Support PARTITION__ID in SQL

2015-06-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8003: -- Summary: Support PARTITION__ID in SQL Key: SPARK-8003 URL: https://issues.apache.org/jira/browse/SPARK-8003 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-8010) Implict promote Numeric type to String type in HiveTypeCoercion

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8010: --- Assignee: Apache Spark Implict promote Numeric type to String type in HiveTypeCoercion

[jira] [Commented] (SPARK-7980) Support SQLContext.range(end)

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567142#comment-14567142 ] Apache Spark commented on SPARK-7980: - User 'animeshbaranawal' has created a pull

[jira] [Assigned] (SPARK-7980) Support SQLContext.range(end)

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7980: --- Assignee: Apache Spark Support SQLContext.range(end) -

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

2015-06-01 Thread Akhil Thatipamula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567040#comment-14567040 ] Akhil Thatipamula commented on SPARK-7993: -- Thanks for mentioning, I will take of

[jira] [Created] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-06-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8007: -- Summary: Support resolving virtual columns in DataFrames Key: SPARK-8007 URL: https://issues.apache.org/jira/browse/SPARK-8007 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-7798) Move AkkaRpcEnv to a separate project

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7798. -- Resolution: Duplicate Target Version/s: (was: 1.6.0) You've got some duplication here. I

[jira] [Commented] (SPARK-7798) Move AkkaRpcEnv to a separate project

2015-06-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567103#comment-14567103 ] Shixiong Zhu commented on SPARK-7798: - I want to propose one move and deprecate JIRA

[jira] [Created] (SPARK-8010) Implict promote Numeric type to String type in HiveTypeCoercion

2015-06-01 Thread Li Sheng (JIRA)
Li Sheng created SPARK-8010: --- Summary: Implict promote Numeric type to String type in HiveTypeCoercion Key: SPARK-8010 URL: https://issues.apache.org/jira/browse/SPARK-8010 Project: Spark Issue

[jira] [Assigned] (SPARK-8001) Make AsynchronousListenerBus.waitUntilEmpty throw TimeoutException if timeout

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8001: --- Assignee: (was: Apache Spark) Make AsynchronousListenerBus.waitUntilEmpty throw

[jira] [Updated] (SPARK-8003) Support SPARK__PARTITION__ID in SQL

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8003: --- Summary: Support SPARK__PARTITION__ID in SQL (was: Support PARTITION__ID in SQL) Support

[jira] [Resolved] (SPARK-7893) Complex Operators between Graphs

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7893. -- Resolution: Duplicate I'd prefer to close this kind of overview JIRA, as it doesn't seem to contain

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567036#comment-14567036 ] Reynold Xin commented on SPARK-7993: Please cc me on your pull request (my github id

[jira] [Commented] (SPARK-7999) Graph complement

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567098#comment-14567098 ] Sean Owen commented on SPARK-7999: -- So I'm not sure it's clear the parent issue is even

[jira] [Created] (SPARK-8012) ArrayIndexOutOfBoundsException in SerializationDebugger

2015-06-01 Thread Jianshi Huang (JIRA)
Jianshi Huang created SPARK-8012: Summary: ArrayIndexOutOfBoundsException in SerializationDebugger Key: SPARK-8012 URL: https://issues.apache.org/jira/browse/SPARK-8012 Project: Spark Issue

[jira] [Commented] (SPARK-2315) drop, dropRight and dropWhile which take RDD input and return RDD

2015-06-01 Thread Erik Erlandson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567478#comment-14567478 ] Erik Erlandson commented on SPARK-2315: --- The 'drop' RDD methods have been made

[jira] [Created] (SPARK-8014) DataFrame.write.mode(error).save(...) should not scan the output folder

2015-06-01 Thread Jianshi Huang (JIRA)
Jianshi Huang created SPARK-8014: Summary: DataFrame.write.mode(error).save(...) should not scan the output folder Key: SPARK-8014 URL: https://issues.apache.org/jira/browse/SPARK-8014 Project: Spark

[jira] [Commented] (SPARK-8013) Get JDBC server working with Scala 2.11

2015-06-01 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567561#comment-14567561 ] Iulian Dragos commented on SPARK-8013: -- There's a Scala 2.11.7 milestone due in July,

[jira] [Commented] (SPARK-8004) Spark does not enclose column names when fetchting from jdbc sources

2015-06-01 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567467#comment-14567467 ] Liang-Chi Hsieh commented on SPARK-8004: I think backticks are only working for

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-06-01 Thread Mark Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567468#comment-14567468 ] Mark Smiley commented on SPARK-5389: I have tried several settings for JAVA_HOME

[jira] [Comment Edited] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-06-01 Thread Mark Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567468#comment-14567468 ] Mark Smiley edited comment on SPARK-5389 at 6/1/15 3:54 PM: I

[jira] [Updated] (SPARK-8013) Get JDBC server working with Scala 2.11

2015-06-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8013: --- Target Version/s: 1.5.0 Get JDBC server working with Scala 2.11

[jira] [Updated] (SPARK-8013) Get JDBC server working with Scala 2.11

2015-06-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8013: --- Priority: Critical (was: Major) Get JDBC server working with Scala 2.11

[jira] [Created] (SPARK-8013) Get JDBC server working with Scala 2.11

2015-06-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-8013: -- Summary: Get JDBC server working with Scala 2.11 Key: SPARK-8013 URL: https://issues.apache.org/jira/browse/SPARK-8013 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7857) IDF w/ minDocFreq on SparseVectors results in literal zeros

2015-06-01 Thread Karl Higley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567520#comment-14567520 ] Karl Higley commented on SPARK-7857: This is addressed by the addition of numNonZeros

[jira] [Commented] (SPARK-7987) TransportContext.createServer(int port) is missing in Spark 1.4

2015-06-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567556#comment-14567556 ] Marcelo Vanzin commented on SPARK-7987: --- [~joshrosen] that annotation is nice but it

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567345#comment-14567345 ] Steve Loughran commented on SPARK-4352: --- As usual, when YARN-1042 is done, life gets

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-06-01 Thread Deepak Kumar V (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567389#comment-14567389 ] Deepak Kumar V commented on SPARK-4105: --- I see this issue when reading sequence file

[jira] [Created] (SPARK-8015) flume-sink should not depend on Guava.

2015-06-01 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-8015: - Summary: flume-sink should not depend on Guava. Key: SPARK-8015 URL: https://issues.apache.org/jira/browse/SPARK-8015 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8014) DataFrame.write.mode(error).save(...) should not scan the output folder

2015-06-01 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8014: -- Description: When saving a DataFrame with {{ErrorIfExists}} as save mode, we shouldn't do metadata

[jira] [Updated] (SPARK-8014) DataFrame.write.mode(error).save(...) should not scan the output folder

2015-06-01 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8014: -- Priority: Major (was: Minor) DataFrame.write.mode(error).save(...) should not scan the output folder

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-06-01 Thread Yana Kadiyska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567601#comment-14567601 ] Yana Kadiyska commented on SPARK-5389: -- FWIW I just tried the 1.4-rc3 build

[jira] [Assigned] (SPARK-8014) DataFrame.write.mode(error).save(...) should not scan the output folder

2015-06-01 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-8014: - Assignee: Cheng Lian DataFrame.write.mode(error).save(...) should not scan the output folder

[jira] [Created] (SPARK-8016) YARN cluster / client modes have different app names for python

2015-06-01 Thread Andrew Or (JIRA)
Andrew Or created SPARK-8016: Summary: YARN cluster / client modes have different app names for python Key: SPARK-8016 URL: https://issues.apache.org/jira/browse/SPARK-8016 Project: Spark Issue

[jira] [Commented] (SPARK-7909) spark-ec2 and associated tools not py3 ready

2015-06-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567735#comment-14567735 ] Shivaram Venkataraman commented on SPARK-7909: -- Yeah feel free to open a PR

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567755#comment-14567755 ] Sandy Ryza commented on SPARK-4352: --- [~jerryshao] I wouldn't say that the goal is

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567757#comment-14567757 ] Sean Owen commented on SPARK-8008: -- I suppose I meant you can block waiting on a new

[jira] [Commented] (SPARK-7909) spark-ec2 and associated tools not py3 ready

2015-06-01 Thread Matthew Goodman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567685#comment-14567685 ] Matthew Goodman commented on SPARK-7909: Awesome, thanks for all the help on this.

[jira] [Updated] (SPARK-8016) YARN cluster / client modes have different app names for python

2015-06-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8016: - Component/s: PySpark YARN cluster / client modes have different app names for python

[jira] [Commented] (SPARK-4048) Enhance and extend hadoop-provided profile

2015-06-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567752#comment-14567752 ] Marcelo Vanzin commented on SPARK-4048: --- That is not a regression. The whole point

[jira] [Created] (SPARK-8017) YARN cluster python --py-files does not work

2015-06-01 Thread Andrew Or (JIRA)
Andrew Or created SPARK-8017: Summary: YARN cluster python --py-files does not work Key: SPARK-8017 URL: https://issues.apache.org/jira/browse/SPARK-8017 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8015) flume-sink should not depend on Guava.

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8015: --- Assignee: (was: Apache Spark) flume-sink should not depend on Guava.

  1   2   3   >