[jira] [Created] (SPARK-6599) Add Kinesis Direct API

2015-03-29 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-6599: Summary: Add Kinesis Direct API Key: SPARK-6599 URL: https://issues.apache.org/jira/browse/SPARK-6599 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-6369) InsertIntoHiveTable and Parquet Relation should use logic from SparkHadoopWriter

2015-03-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6369: Summary: InsertIntoHiveTable and Parquet Relation should use logic from SparkHadoopWriter (was:

[jira] [Closed] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-6586. -- Resolution: Not a Problem Add the capability of retrieving original logical plan of DataFrame

[jira] [Commented] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386209#comment-14386209 ] Liang-Chi Hsieh commented on SPARK-6586: I am no problem with your opinion. But If

[jira] [Assigned] (SPARK-5203) union with different decimal type report error

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5203: --- Assignee: (was: Apache Spark) union with different decimal type report error

[jira] [Commented] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386068#comment-14386068 ] Liang-Chi Hsieh commented on SPARK-6586: Even just for debuging purpose, I think

[jira] [Updated] (SPARK-6601) Add HDFS NFS gateway module to spark-ec2

2015-03-29 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Verhein updated SPARK-6601: --- Description: Add module hdfs-nfs-gateway, which sets up the gateway for (say,

[jira] [Created] (SPARK-6601) Add HDFS NFS gateway module to spark-ec2

2015-03-29 Thread Florian Verhein (JIRA)
Florian Verhein created SPARK-6601: -- Summary: Add HDFS NFS gateway module to spark-ec2 Key: SPARK-6601 URL: https://issues.apache.org/jira/browse/SPARK-6601 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-5203) union with different decimal type report error

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5203: --- Assignee: Apache Spark union with different decimal type report error

[jira] [Created] (SPARK-6598) Python API for IDFModel

2015-03-29 Thread Kai Sasaki (JIRA)
Kai Sasaki created SPARK-6598: - Summary: Python API for IDFModel Key: SPARK-6598 URL: https://issues.apache.org/jira/browse/SPARK-6598 Project: Spark Issue Type: Task Components: MLlib

[jira] [Commented] (SPARK-6594) Spark Streaming can't receive data from kafka

2015-03-29 Thread q79969786 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386071#comment-14386071 ] q79969786 commented on SPARK-6594: -- 1. Create kafka topic as follow: $kafka-topics.sh

[jira] [Issue Comment Deleted] (SPARK-6594) Spark Streaming can't receive data from kafka

2015-03-29 Thread q79969786 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] q79969786 updated SPARK-6594: - Comment: was deleted (was: 1. Create kafka topic as follow: $kafka-topics.sh --create --zookeeper

[jira] [Commented] (SPARK-6566) Update Spark to use the latest version of Parquet libraries

2015-03-29 Thread Konstantin Shaposhnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386170#comment-14386170 ] Konstantin Shaposhnikov commented on SPARK-6566: Thank you for the update

[jira] [Commented] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386167#comment-14386167 ] Michael Armbrust commented on SPARK-6586: - I can see the utility for seeing the

[jira] [Commented] (SPARK-6261) Python MLlib API missing items: Feature

2015-03-29 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386036#comment-14386036 ] Kai Sasaki commented on SPARK-6261: --- [~josephkb] I created JIRA for IDFModel here.

[jira] [Commented] (SPARK-5564) Support sparse LDA solutions

2015-03-29 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386049#comment-14386049 ] Debasish Das commented on SPARK-5564: - [~josephkb] could you please point me to the

[jira] [Updated] (SPARK-6600) Open ports in spark-ec2.py to allow HDFS NFS gateway

2015-03-29 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Verhein updated SPARK-6600: --- Description: Use case: User has set up the hadoop hdfs nfs gateway service on their

[jira] [Updated] (SPARK-6600) Open ports in ec2/spark_ec2.py to allow HDFS NFS gateway

2015-03-29 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Verhein updated SPARK-6600: --- Summary: Open ports in ec2/spark_ec2.py to allow HDFS NFS gateway(was: Open ports in

[jira] [Comment Edited] (SPARK-5564) Support sparse LDA solutions

2015-03-29 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386049#comment-14386049 ] Debasish Das edited comment on SPARK-5564 at 3/30/15 12:31 AM:

[jira] [Comment Edited] (SPARK-5564) Support sparse LDA solutions

2015-03-29 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386049#comment-14386049 ] Debasish Das edited comment on SPARK-5564 at 3/30/15 12:30 AM:

[jira] [Updated] (SPARK-6600) Open ports in ec2/spark_ec2.py to allow HDFS NFS gateway

2015-03-29 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Verhein updated SPARK-6600: --- Description: Use case: User has set up the hadoop hdfs nfs gateway service on their

[jira] [Updated] (SPARK-6601) Add HDFS NFS gateway module to spark-ec2

2015-03-29 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Verhein updated SPARK-6601: --- Description: Add module hdfs-nfs-gateway, which sets up the gateway for (say,

[jira] [Commented] (SPARK-6119) DataFrame.dropna support

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385642#comment-14385642 ] Apache Spark commented on SPARK-6119: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-03-29 Thread Kannan Rajah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385648#comment-14385648 ] Kannan Rajah commented on SPARK-1529: - I have pushed the first round of commits to my

[jira] [Commented] (SPARK-6593) Provide option for HadoopRDD to skip bad data splits.

2015-03-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385706#comment-14385706 ] Sean Owen commented on SPARK-6593: -- At this level though, what's a bad split? a line of

[jira] [Resolved] (SPARK-4123) Show dependency changes in pull requests

2015-03-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4123. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5093

[jira] [Resolved] (SPARK-6406) Launcher backward compatibility issues

2015-03-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6406. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5085

[jira] [Updated] (SPARK-6406) Launcher backward compatibility issues

2015-03-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6406: - Assignee: Nishkam Ravi Launcher backward compatibility issues --

[jira] [Updated] (SPARK-6593) Provide option for HadoopRDD to skip corrupted files

2015-03-29 Thread Dale Richardson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dale Richardson updated SPARK-6593: --- Description: When reading a large amount of gzip files from HDFS eg. with

[jira] [Resolved] (SPARK-5124) Standardize internal RPC interface

2015-03-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5124. Resolution: Fixed Fix Version/s: 1.4.0 Standardize internal RPC interface

[jira] [Created] (SPARK-6594) Spark Streaming can't receive data from kafka

2015-03-29 Thread q79969786 (JIRA)
q79969786 created SPARK-6594: Summary: Spark Streaming can't receive data from kafka Key: SPARK-6594 URL: https://issues.apache.org/jira/browse/SPARK-6594 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6594) Spark Streaming can't receive data from kafka

2015-03-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385743#comment-14385743 ] Sean Owen commented on SPARK-6594: -- There's no useful detail here. Can you elaborate what

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2015-03-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385890#comment-14385890 ] Steve Loughran commented on SPARK-1537: --- # I've just tried to see where YARN-2444

[jira] [Resolved] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6586. - Resolution: Not a Problem You can already get the original plan from a DataFrame:

[jira] [Updated] (SPARK-6548) Adding stddev to DataFrame functions

2015-03-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6548: Target Version/s: 1.4.0 Adding stddev to DataFrame functions

[jira] [Updated] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6592: Target Version/s: 1.4.0 API of Row trait should be presented in Scala doc

[jira] [Updated] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6592: Priority: Critical (was: Major) API of Row trait should be presented in Scala doc

[jira] [Updated] (SPARK-6587) Inferring schema for case class hierarchy fails with mysterious message

2015-03-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6587: -- Description: (Don't know if this is a functionality bug, error reporting bug or an RFE ...) I define

[jira] [Commented] (SPARK-6587) Inferring schema for case class hierarchy fails with mysterious message

2015-03-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385695#comment-14385695 ] Cheng Lian commented on SPARK-6587: --- This behavior is expected. There are two problems

[jira] [Comment Edited] (SPARK-6587) Inferring schema for case class hierarchy fails with mysterious message

2015-03-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385695#comment-14385695 ] Cheng Lian edited comment on SPARK-6587 at 3/29/15 10:32 AM: -

[jira] [Created] (SPARK-6593) Provide option for HadoopRDD to skip bad data splits.

2015-03-29 Thread Dale Richardson (JIRA)
Dale Richardson created SPARK-6593: -- Summary: Provide option for HadoopRDD to skip bad data splits. Key: SPARK-6593 URL: https://issues.apache.org/jira/browse/SPARK-6593 Project: Spark

[jira] [Resolved] (SPARK-6558) Utils.getCurrentUserName returns the full principal name instead of login name

2015-03-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6558. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5229

[jira] [Resolved] (SPARK-6585) FileServerSuite.test (HttpFileServer should not work with SSL when the server is untrusted) failed is some evn.

2015-03-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6585. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5239

[jira] [Updated] (SPARK-6593) Provide option for HadoopRDD to skip corrupted files

2015-03-29 Thread Dale Richardson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dale Richardson updated SPARK-6593: --- Summary: Provide option for HadoopRDD to skip corrupted files (was: Provide option for

[jira] [Commented] (SPARK-6593) Provide option for HadoopRDD to skip corrupted files

2015-03-29 Thread Dale Richardson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385723#comment-14385723 ] Dale Richardson commented on SPARK-6593: Changed the title and description to

[jira] [Updated] (SPARK-6585) FileServerSuite.test (HttpFileServer should not work with SSL when the server is untrusted) failed is some evn.

2015-03-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6585: - Assignee: June FileServerSuite.test (HttpFileServer should not work with SSL when the server is

[jira] [Updated] (SPARK-6593) Provide option for HadoopRDD to skip corrupted files

2015-03-29 Thread Dale Richardson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dale Richardson updated SPARK-6593: --- Description: When reading a large amount of files from HDFS eg. with

[jira] [Assigned] (SPARK-6580) Optimize LogisticRegressionModel.predictPoint

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6580: --- Assignee: (was: Apache Spark) Optimize LogisticRegressionModel.predictPoint

[jira] [Commented] (SPARK-6580) Optimize LogisticRegressionModel.predictPoint

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385664#comment-14385664 ] Apache Spark commented on SPARK-6580: - User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-6593) Provide option for HadoopRDD to skip bad data splits.

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385715#comment-14385715 ] Apache Spark commented on SPARK-6593: - User 'tigerquoll' has created a pull request

[jira] [Assigned] (SPARK-6593) Provide option for HadoopRDD to skip bad data splits.

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6593: --- Assignee: (was: Apache Spark) Provide option for HadoopRDD to skip bad data splits.

[jira] [Assigned] (SPARK-6593) Provide option for HadoopRDD to skip bad data splits.

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6593: --- Assignee: Apache Spark Provide option for HadoopRDD to skip bad data splits.

[jira] [Commented] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-29 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385724#comment-14385724 ] Nan Zhu commented on SPARK-6592: ? I don't think that makes any difference, as the path

[jira] [Comment Edited] (SPARK-6593) Provide option for HadoopRDD to skip bad data splits.

2015-03-29 Thread Dale Richardson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385716#comment-14385716 ] Dale Richardson edited comment on SPARK-6593 at 3/29/15 11:35 AM:

[jira] [Commented] (SPARK-6593) Provide option for HadoopRDD to skip bad data splits.

2015-03-29 Thread Dale Richardson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385716#comment-14385716 ] Dale Richardson commented on SPARK-6593: With a gz file for example, the entire

[jira] [Assigned] (SPARK-6580) Optimize LogisticRegressionModel.predictPoint

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6580: --- Assignee: Apache Spark Optimize LogisticRegressionModel.predictPoint

[jira] [Commented] (SPARK-6579) save as parquet with overwrite failed

2015-03-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385694#comment-14385694 ] Cheng Lian commented on SPARK-6579: --- Here's another Parquet issue with Hadoop 1.0.4:

[jira] [Updated] (SPARK-6579) save as parquet with overwrite failed when linking with Hadoop 1.0.4

2015-03-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6579: -- Summary: save as parquet with overwrite failed when linking with Hadoop 1.0.4 (was: save as parquet

[jira] [Updated] (SPARK-6593) Provide option for HadoopRDD to skip bad data splits.

2015-03-29 Thread Dale Richardson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dale Richardson updated SPARK-6593: --- Description: When reading a large amount of files from HDFS eg. with

[jira] [Commented] (SPARK-6595) DataFrame self joins with MetastoreRelations fail

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385924#comment-14385924 ] Apache Spark commented on SPARK-6595: - User 'marmbrus' has created a pull request for

[jira] [Assigned] (SPARK-6595) DataFrame self joins with MetastoreRelations fail

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6595: --- Assignee: Michael Armbrust (was: Apache Spark) DataFrame self joins with

[jira] [Assigned] (SPARK-6595) DataFrame self joins with MetastoreRelations fail

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6595: --- Assignee: Apache Spark (was: Michael Armbrust) DataFrame self joins with

[jira] [Commented] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-29 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385964#comment-14385964 ] Nan Zhu commented on SPARK-6592: it contains the reason is that the input of that

[jira] [Commented] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385895#comment-14385895 ] Reynold Xin commented on SPARK-6592: Row.html/class doesn't contain the word catalyst,

[jira] [Created] (SPARK-6595) DataFrame self joins with MetastoreRelations fail

2015-03-29 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-6595: --- Summary: DataFrame self joins with MetastoreRelations fail Key: SPARK-6595 URL: https://issues.apache.org/jira/browse/SPARK-6595 Project: Spark Issue

[jira] [Commented] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385970#comment-14385970 ] Reynold Xin commented on SPARK-6592: Ok then can't you just add apache to it? API

[jira] [Assigned] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6592: --- Assignee: (was: Apache Spark) API of Row trait should be presented in Scala doc

[jira] [Commented] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385991#comment-14385991 ] Apache Spark commented on SPARK-6592: - User 'CodingCat' has created a pull request for

[jira] [Assigned] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6592: --- Assignee: Apache Spark API of Row trait should be presented in Scala doc

[jira] [Created] (SPARK-6596) fix the instruction on building scaladoc

2015-03-29 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-6596: -- Summary: fix the instruction on building scaladoc Key: SPARK-6596 URL: https://issues.apache.org/jira/browse/SPARK-6596 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6596) fix the instruction on building scaladoc

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385993#comment-14385993 ] Apache Spark commented on SPARK-6596: - User 'CodingCat' has created a pull request for

[jira] [Assigned] (SPARK-6596) fix the instruction on building scaladoc

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6596: --- Assignee: (was: Apache Spark) fix the instruction on building scaladoc

[jira] [Updated] (SPARK-6595) DataFrame self joins with MetastoreRelations fail

2015-03-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6595: Target Version/s: 1.3.1, 1.4.0 (was: 1.3.1) DataFrame self joins with MetastoreRelations

[jira] [Assigned] (SPARK-6596) fix the instruction on building scaladoc

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6596: --- Assignee: Apache Spark fix the instruction on building scaladoc

[jira] [Commented] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386009#comment-14386009 ] Liang-Chi Hsieh commented on SPARK-6586: Not true. Because DataFrame now is given

[jira] [Reopened] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh reopened SPARK-6586: Add the capability of retrieving original logical plan of DataFrame

[jira] [Comment Edited] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386009#comment-14386009 ] Liang-Chi Hsieh edited comment on SPARK-6586 at 3/29/15 11:24 PM:

[jira] [Created] (SPARK-6597) Replace `input:checkbox` with `input[type=checkbox] in additional-metrics.js

2015-03-29 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-6597: - Summary: Replace `input:checkbox` with `input[type=checkbox] in additional-metrics.js Key: SPARK-6597 URL: https://issues.apache.org/jira/browse/SPARK-6597

[jira] [Assigned] (SPARK-6597) Replace `input:checkbox` with `input[type=checkbox] in additional-metrics.js

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6597: --- Assignee: Apache Spark Replace `input:checkbox` with `input[type=checkbox] in

[jira] [Assigned] (SPARK-6597) Replace `input:checkbox` with `input[type=checkbox] in additional-metrics.js

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6597: --- Assignee: (was: Apache Spark) Replace `input:checkbox` with `input[type=checkbox] in

[jira] [Commented] (SPARK-6597) Replace `input:checkbox` with `input[type=checkbox] in additional-metrics.js

2015-03-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386017#comment-14386017 ] Apache Spark commented on SPARK-6597: - User 'sarutak' has created a pull request for

[jira] [Commented] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386020#comment-14386020 ] Michael Armbrust commented on SPARK-6586: - Okay, but what is the utility of