[jira] [Created] (SPARK-6927) Sorting Error when codegen on

2015-04-14 Thread Chen Song (JIRA)
Chen Song created SPARK-6927: Summary: Sorting Error when codegen on Key: SPARK-6927 URL: https://issues.apache.org/jira/browse/SPARK-6927 Project: Spark Issue Type: Bug Components: SQL

[jira] [Assigned] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2015-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-1537: Assignee: (was: Marcelo Vanzin) > Add integration with Yarn's Application Timeline Server > ---

[jira] [Updated] (SPARK-6926) Word2Vec's transform method throw IllegalStateException if a word not in vocabulary, but findSynonyms(word: String, num: Int) method neither try catch exception nor thro

2015-04-14 Thread Yi Tian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Tian updated SPARK-6926: --- Description: {code} val doc = sc.textFile("/xxx/segrestxt", args(3).toInt).map(line => line.split(" ").toS

[jira] [Updated] (SPARK-6926) Word2Vec's transform method throw IllegalStateException if a word not in vocabulary, but findSynonyms(word: String, num: Int) method neither try catch exception nor thro

2015-04-14 Thread Yi Tian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Tian updated SPARK-6926: --- Description: {code} val doc = sc.textFile("/xxx/segrestxt", args(3).toInt).map(line => line.split(" ").t

[jira] [Resolved] (SPARK-6871) WITH clause in CTE can not following another WITH clause

2015-04-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6871. - Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Liang-Chi Hsieh > WITH cl

[jira] [Updated] (SPARK-6926) Word2Vec's transform method throw IllegalStateException if a word not in vocabulary, but findSynonyms(word: String, num: Int) method neither try catch exception nor thro

2015-04-14 Thread Yi Tian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Tian updated SPARK-6926: --- Description: {code} val doc = sc.textFile("/xxx/segrestxt", args(3).toInt).map(line => line.split(" "

[jira] [Closed] (SPARK-6925) Word2Vec's transform method throw IllegalStateException if a word not in vocabulary, but findSynonyms(word: String, num: Int) method neither try catch exception nor throw

2015-04-14 Thread chrispy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chrispy closed SPARK-6925. -- Resolution: Duplicate > Word2Vec's transform method throw IllegalStateException if a word not in > vocabulary,

[jira] [Created] (SPARK-6926) Word2Vec's transform method throw IllegalStateException if a word not in vocabulary, but findSynonyms(word: String, num: Int) method neither try catch exception nor thro

2015-04-14 Thread chrispy (JIRA)
chrispy created SPARK-6926: -- Summary: Word2Vec's transform method throw IllegalStateException if a word not in vocabulary, but findSynonyms(word: String, num: Int) method neither try catch exception nor throw exception. Key: SPARK-692

[jira] [Created] (SPARK-6925) Word2Vec's transform method throw IllegalStateException if a word not in vocabulary, but findSynonyms(word: String, num: Int) method neither try catch exception nor thro

2015-04-14 Thread chrispy (JIRA)
chrispy created SPARK-6925: -- Summary: Word2Vec's transform method throw IllegalStateException if a word not in vocabulary, but findSynonyms(word: String, num: Int) method neither try catch exception nor throw exception. Key: SPARK-692

[jira] [Updated] (SPARK-6924) Client hands when net is broken

2015-04-14 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-6924: - Component/s: Spark Core > Client hands when net is broken > --- > > Ke

[jira] [Created] (SPARK-6924) Client hands when net is broken

2015-04-14 Thread xukun (JIRA)
xukun created SPARK-6924: Summary: Client hands when net is broken Key: SPARK-6924 URL: https://issues.apache.org/jira/browse/SPARK-6924 Project: Spark Issue Type: Bug Reporter: xukun I

[jira] [Assigned] (SPARK-6899) Type mismatch when using codegen

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6899: --- Assignee: Apache Spark > Type mismatch when using codegen >

[jira] [Assigned] (SPARK-6899) Type mismatch when using codegen

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6899: --- Assignee: (was: Apache Spark) > Type mismatch when using codegen > --

[jira] [Commented] (SPARK-6899) Type mismatch when using codegen

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495681#comment-14495681 ] Apache Spark commented on SPARK-6899: - User 'viirya' has created a pull request for th

[jira] [Resolved] (SPARK-3839) Reimplement HashOuterJoin to construct hash table of only one relation

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-3839. - Resolution: Duplicate I believe that SPARK-4483 has addressed the issue. > Reimplement HashOuterJoin to c

[jira] [Commented] (SPARK-4502) Spark SQL reads unneccesary nested fields from Parquet

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495635#comment-14495635 ] Yin Huai commented on SPARK-4502: - [~marmbrus] I am inclined to bump the version. What do

[jira] [Commented] (SPARK-6831) Document how to use external data sources

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495630#comment-14495630 ] Yin Huai commented on SPARK-6831: - [~shivaram] I feel that the doc of a data source should

[jira] [Updated] (SPARK-4131) Support "Writing data into the filesystem from queries"

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-4131: Assignee: Fei Wang > Support "Writing data into the filesystem from queries" > -

[jira] [Updated] (SPARK-4497) HiveThriftServer2 does not exit properly on failure

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-4497: Description: start thriftserver with {{sbin/start-thriftserver.sh --master ...}} If there is an error (in

[jira] [Commented] (SPARK-4476) Use MapType for dict in json which has unique keys in each row.

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495623#comment-14495623 ] Yin Huai commented on SPARK-4476: - I will try to find a time to rebase my old patch. > Us

[jira] [Commented] (SPARK-5100) Spark Thrift server monitor page

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495622#comment-14495622 ] Yin Huai commented on SPARK-5100: - [~lian cheng] What is the status of this one? > Spark

[jira] [Assigned] (SPARK-4476) Use MapType for dict in json which has unique keys in each row.

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-4476: --- Assignee: Yin Huai > Use MapType for dict in json which has unique keys in each row. > --

[jira] [Commented] (SPARK-5881) RDD remains cached after the table gets overridden by "CACHE TABLE"

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495621#comment-14495621 ] Yin Huai commented on SPARK-5881: - [~lian cheng] [~marmbrus] I think we need some major ch

[jira] [Assigned] (SPARK-6012) Deadlock when asking for partitions from CoalescedRDD on top of a TakeOrdered operator

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-6012: --- Assignee: Yin Huai > Deadlock when asking for partitions from CoalescedRDD on top of a TakeOrdered >

[jira] [Commented] (SPARK-6012) Deadlock when asking for partitions from CoalescedRDD on top of a TakeOrdered operator

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495618#comment-14495618 ] Yin Huai commented on SPARK-6012: - Seems the problem is that in {{SchemaRDD}}, we have {c

[jira] [Commented] (SPARK-6514) For Kinesis Streaming, use the same region for DynamoDB (KCL checkpoints) as the Kinesis stream itself

2015-04-14 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495613#comment-14495613 ] Chris Fregly commented on SPARK-6514: - [~tdas] can you take a look at this PR when you

[jira] [Updated] (SPARK-1442) Add Window function support

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-1442: Priority: Critical (was: Major) Target Version/s: 1.4.0 I am setting the target version to 1.4.

[jira] [Updated] (SPARK-3860) Improve dimension joins

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-3860: Priority: Major (was: Critical) > Improve dimension joins > --- > > Key

[jira] [Commented] (SPARK-3860) Improve dimension joins

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495610#comment-14495610 ] Yin Huai commented on SPARK-3860: - I am changing the priority to Major. > Improve dimensi

[jira] [Commented] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495608#comment-14495608 ] Yin Huai commented on SPARK-6231: - [~marmbrus] You have fixed it, right? > Join on two ta

[jira] [Commented] (SPARK-6514) For Kinesis Streaming, use the same region for DynamoDB (KCL checkpoints) as the Kinesis stream itself

2015-04-14 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495607#comment-14495607 ] Chris Fregly commented on SPARK-6514: - https://github.com/apache/spark/pull/5375 > Fo

[jira] [Assigned] (SPARK-2873) Support disk spilling in Spark SQL aggregation

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-2873: --- Assignee: Yin Huai > Support disk spilling in Spark SQL aggregation > ---

[jira] [Commented] (SPARK-2873) Support disk spilling in Spark SQL aggregation

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495606#comment-14495606 ] Yin Huai commented on SPARK-2873: - Let me take a look at it and hopefully I can make some

[jira] [Commented] (SPARK-6514) For Kinesis Streaming, use the same region for DynamoDB (KCL checkpoints) as the Kinesis stream itself

2015-04-14 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495605#comment-14495605 ] Chris Fregly commented on SPARK-6514: - hey pawel! i think keeping it regionName is fi

[jira] [Commented] (SPARK-2873) Support disk spilling in Spark SQL aggregation / join

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495604#comment-14495604 ] Yin Huai commented on SPARK-2873: - SPARK-2213 will do the sort merge join, which can signi

[jira] [Updated] (SPARK-2873) Support disk spilling in Spark SQL aggregation

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2873: Summary: Support disk spilling in Spark SQL aggregation (was: Support disk spilling in Spark SQL aggregatio

[jira] [Updated] (SPARK-2213) Sort Merge Join

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2213: Assignee: Adrian Wang (was: Liquan Pei) > Sort Merge Join > --- > > Key: SPARK-

[jira] [Updated] (SPARK-2213) Sort Merge Join

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2213: Target Version/s: 1.4.0 > Sort Merge Join > --- > > Key: SPARK-2213 >

[jira] [Updated] (SPARK-2213) Sort Merge Join

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2213: Priority: Blocker (was: Major) > Sort Merge Join > --- > > Key: SPARK-2213 >

[jira] [Commented] (SPARK-6784) Clean up all the inbound/outbound conversions for DateType

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495600#comment-14495600 ] Yin Huai commented on SPARK-6784: - For example, https://github.com/apache/spark/pull/5350/

[jira] [Assigned] (SPARK-6784) Clean up all the inbound/outbound conversions for DateType

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-6784: --- Assignee: Yin Huai > Clean up all the inbound/outbound conversions for DateType > ---

[jira] [Commented] (SPARK-5960) Allow AWS credentials to be passed to KinesisUtils.createStream()

2015-04-14 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495599#comment-14495599 ] Chris Fregly commented on SPARK-5960: - [~tdas] can you take a look at this PR real qui

[jira] [Created] (SPARK-6923) Get invalid hive table columns after save DataFrame to hive table

2015-04-14 Thread pin_zhang (JIRA)
pin_zhang created SPARK-6923: Summary: Get invalid hive table columns after save DataFrame to hive table Key: SPARK-6923 URL: https://issues.apache.org/jira/browse/SPARK-6923 Project: Spark Issu

[jira] [Commented] (SPARK-6800) Reading from JDBC with SQLContext, using lower/upper bounds and numPartitions gives incorrect results.

2015-04-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495570#comment-14495570 ] Liang-Chi Hsieh commented on SPARK-6800: And according to the explanation from Mic

[jira] [Commented] (SPARK-6800) Reading from JDBC with SQLContext, using lower/upper bounds and numPartitions gives incorrect results.

2015-04-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495564#comment-14495564 ] Liang-Chi Hsieh commented on SPARK-6800: Why the other ones will result in repeate

[jira] [Created] (SPARK-6922) RDD.cartesian is much slower than join

2015-04-14 Thread David Tolnay (JIRA)
David Tolnay created SPARK-6922: --- Summary: RDD.cartesian is much slower than join Key: SPARK-6922 URL: https://issues.apache.org/jira/browse/SPARK-6922 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6899) Type mismatch when using codegen

2015-04-14 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Song updated SPARK-6899: - Description: When I run tests in DataFrameSuite with codegen on, some type mismatched error occured. {co

[jira] [Assigned] (SPARK-5337) respect spark.task.cpus when launch executors

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5337: --- Assignee: (was: Apache Spark) > respect spark.task.cpus when launch executors > -

[jira] [Assigned] (SPARK-5337) respect spark.task.cpus when launch executors

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5337: --- Assignee: Apache Spark > respect spark.task.cpus when launch executors >

[jira] [Created] (SPARK-6921) Spark SQL API "saveAsParquetFile" will output tachyon file with different block size

2015-04-14 Thread zhangxiongfei (JIRA)
zhangxiongfei created SPARK-6921: Summary: Spark SQL API "saveAsParquetFile" will output tachyon file with different block size Key: SPARK-6921 URL: https://issues.apache.org/jira/browse/SPARK-6921 Pr

[jira] [Updated] (SPARK-5634) History server shows misleading message when there are no incomplete apps

2015-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5634: - Target Version/s: 1.3.2, 1.4.0, 1.2.3 (was: 1.4.0) > History server shows misleading message when there a

[jira] [Updated] (SPARK-5634) History server shows misleading message when there are no incomplete apps

2015-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5634: - Fix Version/s: 1.2.3 1.3.2 > History server shows misleading message when there are no

[jira] [Updated] (SPARK-5634) History server shows misleading message when there are no incomplete apps

2015-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5634: - Affects Version/s: 1.2.0 > History server shows misleading message when there are no incomplete apps > ---

[jira] [Closed] (SPARK-5634) History server shows misleading message when there are no incomplete apps

2015-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5634. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Marcelo Vanzin Target Version/s

[jira] [Closed] (SPARK-6890) Local cluster mode is broken with SPARK_PREPEND_CLASSES

2015-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-6890. Resolution: Fixed Fix Version/s: 1.4.0 > Local cluster mode is broken with SPARK_PREPEND_CLASSES > --

[jira] [Created] (SPARK-6920) Be more explicit about references to "executor" and "task" in Spark on Mesos

2015-04-14 Thread Andrew Or (JIRA)
Andrew Or created SPARK-6920: Summary: Be more explicit about references to "executor" and "task" in Spark on Mesos Key: SPARK-6920 URL: https://issues.apache.org/jira/browse/SPARK-6920 Project: Spark

[jira] [Assigned] (SPARK-6919) Add .asDict method to StatCounter

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6919: --- Assignee: Apache Spark > Add .asDict method to StatCounter >

[jira] [Assigned] (SPARK-6196) Add MAPR 4.0.2 support to the build

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6196: --- Assignee: Apache Spark > Add MAPR 4.0.2 support to the build > --

[jira] [Commented] (SPARK-6919) Add .asDict method to StatCounter

2015-04-14 Thread Erik Shilts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495499#comment-14495499 ] Erik Shilts commented on SPARK-6919: Pull request: https://github.com/apache/spark/pul

[jira] [Assigned] (SPARK-6196) Add MAPR 4.0.2 support to the build

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6196: --- Assignee: (was: Apache Spark) > Add MAPR 4.0.2 support to the build > ---

[jira] [Commented] (SPARK-6919) Add .asDict method to StatCounter

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495500#comment-14495500 ] Apache Spark commented on SPARK-6919: - User 'eshilts' has created a pull request for t

[jira] [Assigned] (SPARK-6919) Add .asDict method to StatCounter

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6919: --- Assignee: (was: Apache Spark) > Add .asDict method to StatCounter > -

[jira] [Created] (SPARK-6919) Add .asDict method to StatCounter

2015-04-14 Thread Erik Shilts (JIRA)
Erik Shilts created SPARK-6919: -- Summary: Add .asDict method to StatCounter Key: SPARK-6919 URL: https://issues.apache.org/jira/browse/SPARK-6919 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-6368) Build a specialized serializer for Exchange operator.

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6368: Attachment: SchemaBased.nps Kryo.nps SchemaBased.nps is the profiling result of the new seri

[jira] [Commented] (SPARK-6368) Build a specialized serializer for Exchange operator.

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495475#comment-14495475 ] Yin Huai commented on SPARK-6368: - I am adding results of a simple benchmark. I build the

[jira] [Commented] (SPARK-6772) spark sql error when running code on large number of records

2015-04-14 Thread Sanketh Divveda (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495455#comment-14495455 ] Sanketh Divveda commented on SPARK-6772: Hi All, When I tried to execute the Spar

[jira] [Closed] (SPARK-6897) Remove volatile from BlockingGenerator.currentBuffer

2015-04-14 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhichao-li closed SPARK-6897. - Resolution: Won't Fix May not have too much benefit for removing the volatile > Remove volatile from Blo

[jira] [Commented] (SPARK-4897) Python 3 support

2015-04-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495443#comment-14495443 ] Davies Liu commented on SPARK-4897: --- That PR is pretty close to merge, we are targeting

[jira] [Commented] (SPARK-4897) Python 3 support

2015-04-14 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495439#comment-14495439 ] Nicholas Chammas commented on SPARK-4897: - [~watsonix] You can follow the [active

[jira] [Updated] (SPARK-6918) Secure HBase with Kerberos does not work over YARN

2015-04-14 Thread Dean Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dean Chen updated SPARK-6918: - Description: Attempts to access HBase from Spark executors will fail at the auth to the metastore with: _

[jira] [Created] (SPARK-6918) Secure HBase with Kerberos does not work over YARN

2015-04-14 Thread Dean Chen (JIRA)
Dean Chen created SPARK-6918: Summary: Secure HBase with Kerberos does not work over YARN Key: SPARK-6918 URL: https://issues.apache.org/jira/browse/SPARK-6918 Project: Spark Issue Type: New Feat

[jira] [Resolved] (SPARK-2597) Improve the code related to Table Scan

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-2597. - Resolution: Unresolved Seems this one is outdated. I am resolving it for now. > Improve the code related

[jira] [Commented] (SPARK-5180) Data source API improvement

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495181#comment-14495181 ] Yin Huai commented on SPARK-5180: - Just a note. This is the master JIRA. The main thing le

[jira] [Assigned] (SPARK-5180) Data source API improvement

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-5180: --- Assignee: Yin Huai > Data source API improvement > --- > > Ke

[jira] [Updated] (SPARK-5180) Data source API improvement

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5180: Assignee: (was: Yin Huai) > Data source API improvement > --- > >

[jira] [Updated] (SPARK-5182) Partitioning support for tables created by the data source API

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5182: Assignee: Cheng Lian > Partitioning support for tables created by the data source API >

[jira] [Updated] (SPARK-6413) For data source tables, we should provide better output for DESCRIBE FORMATTED

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6413: Summary: For data source tables, we should provide better output for DESCRIBE FORMATTED (was: For data sour

[jira] [Updated] (SPARK-6413) For data source tables, we should provide better output for described formatted.

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6413: Priority: Minor (was: Major) > For data source tables, we should provide better output for described > for

[jira] [Updated] (SPARK-6413) For data source tables, we should provide better output for DESCRIBE FORMATTED

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6413: Assignee: (was: Yin Huai) > For data source tables, we should provide better output for DESCRIBE FORMATT

[jira] [Updated] (SPARK-6590) Make DataFrame.where accept a string conditionExpr

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6590: Assignee: (was: Yin Huai) > Make DataFrame.where accept a string conditionExpr > ---

[jira] [Updated] (SPARK-6749) Make metastore client robust to underlying socket connection loss

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6749: Priority: Major (was: Blocker) > Make metastore client robust to underlying socket connection loss > --

[jira] [Updated] (SPARK-6749) Make metastore client robust to underlying socket connection loss

2015-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6749: Assignee: (was: Yin Huai) > Make metastore client robust to underlying socket connection loss >

[jira] [Resolved] (SPARK-6796) Add the batch list to StreamingPage

2015-04-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-6796. -- Resolution: Fixed Fix Version/s: 1.4.0 > Add the batch list to StreamingPage > --

[jira] [Updated] (SPARK-6862) Add BatchPage to display details about a batch

2015-04-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-6862: - Assignee: Shixiong Zhu > Add BatchPage to display details about a batch >

[jira] [Comment Edited] (SPARK-2505) Weighted Regularizer

2015-04-14 Thread Devesh Parekh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495170#comment-14495170 ] Devesh Parekh edited comment on SPARK-2505 at 4/14/15 11:57 PM:

[jira] [Commented] (SPARK-2505) Weighted Regularizer

2015-04-14 Thread Devesh Parekh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495170#comment-14495170 ] Devesh Parekh commented on SPARK-2505: -- Can you describe a case where you would want

[jira] [Assigned] (SPARK-5634) History server shows misleading message when there are no incomplete apps

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5634: --- Assignee: (was: Apache Spark) > History server shows misleading message when there are no

[jira] [Commented] (SPARK-5634) History server shows misleading message when there are no incomplete apps

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495160#comment-14495160 ] Apache Spark commented on SPARK-5634: - User 'vanzin' has created a pull request for th

[jira] [Assigned] (SPARK-5634) History server shows misleading message when there are no incomplete apps

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5634: --- Assignee: Apache Spark > History server shows misleading message when there are no incomplete

[jira] [Commented] (SPARK-6916) StringIndexer should preserve non-ML metadata

2015-04-14 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495154#comment-14495154 ] Xiangrui Meng commented on SPARK-6916: -- It outputs a new column. The semantics change

[jira] [Commented] (SPARK-4897) Python 3 support

2015-04-14 Thread watson xi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495152#comment-14495152 ] watson xi commented on SPARK-4897: -- Hi guys, whats the status of this project? I know a f

[jira] [Updated] (SPARK-6917) Broken data returned to PySpark dataframe if any large numbers used in Scala land

2015-04-14 Thread Harry Brundage (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harry Brundage updated SPARK-6917: -- Attachment: part-r-1.parquet Attached is the parquet file I used. > Broken data returned t

[jira] [Created] (SPARK-6917) Broken data returned to PySpark dataframe if any large numbers used in Scala land

2015-04-14 Thread Harry Brundage (JIRA)
Harry Brundage created SPARK-6917: - Summary: Broken data returned to PySpark dataframe if any large numbers used in Scala land Key: SPARK-6917 URL: https://issues.apache.org/jira/browse/SPARK-6917 Pro

[jira] [Created] (SPARK-6916) StringIndexer should preserve non-ML metadata

2015-04-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-6916: Summary: StringIndexer should preserve non-ML metadata Key: SPARK-6916 URL: https://issues.apache.org/jira/browse/SPARK-6916 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-6766) StreamingListenerBatchSubmitted isn't sent and StreamingListenerBatchStarted.batchInfo.processingStartTime is a wrong value

2015-04-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-6766. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.2 > StreamingListenerBatchS

[jira] [Created] (SPARK-6915) VectorIndexer improvements

2015-04-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-6915: Summary: VectorIndexer improvements Key: SPARK-6915 URL: https://issues.apache.org/jira/browse/SPARK-6915 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-6046) Provide an easier way for developers to handle deprecated configs

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6046: --- Assignee: Apache Spark (was: Andrew Or) > Provide an easier way for developers to handle dep

[jira] [Assigned] (SPARK-6046) Provide an easier way for developers to handle deprecated configs

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6046: --- Assignee: Andrew Or (was: Apache Spark) > Provide an easier way for developers to handle dep

[jira] [Commented] (SPARK-6046) Provide an easier way for developers to handle deprecated configs

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495076#comment-14495076 ] Apache Spark commented on SPARK-6046: - User 'vanzin' has created a pull request for th

[jira] [Created] (SPARK-6914) DataFrame.withColumn should take metadata

2015-04-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-6914: Summary: DataFrame.withColumn should take metadata Key: SPARK-6914 URL: https://issues.apache.org/jira/browse/SPARK-6914 Project: Spark Issue Type: I

  1   2   3   >