Tathagata Das created SPARK-6599:
Summary: Add Kinesis Direct API
Key: SPARK-6599
URL: https://issues.apache.org/jira/browse/SPARK-6599
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-6369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai updated SPARK-6369:
Summary: InsertIntoHiveTable and Parquet Relation should use logic from
SparkHadoopWriter (was:
[
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh closed SPARK-6586.
--
Resolution: Not a Problem
Add the capability of retrieving original logical plan of DataFrame
[
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386209#comment-14386209
]
Liang-Chi Hsieh commented on SPARK-6586:
I am no problem with your opinion. But If
[
https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-5203:
---
Assignee: (was: Apache Spark)
union with different decimal type report error
[
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386068#comment-14386068
]
Liang-Chi Hsieh commented on SPARK-6586:
Even just for debuging purpose, I think
[
https://issues.apache.org/jira/browse/SPARK-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florian Verhein updated SPARK-6601:
---
Description:
Add module hdfs-nfs-gateway, which sets up the gateway for (say,
Florian Verhein created SPARK-6601:
--
Summary: Add HDFS NFS gateway module to spark-ec2
Key: SPARK-6601
URL: https://issues.apache.org/jira/browse/SPARK-6601
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-5203:
---
Assignee: Apache Spark
union with different decimal type report error
Kai Sasaki created SPARK-6598:
-
Summary: Python API for IDFModel
Key: SPARK-6598
URL: https://issues.apache.org/jira/browse/SPARK-6598
Project: Spark
Issue Type: Task
Components: MLlib
[
https://issues.apache.org/jira/browse/SPARK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386071#comment-14386071
]
q79969786 commented on SPARK-6594:
--
1. Create kafka topic as follow:
$kafka-topics.sh
[
https://issues.apache.org/jira/browse/SPARK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
q79969786 updated SPARK-6594:
-
Comment: was deleted
(was: 1. Create kafka topic as follow:
$kafka-topics.sh --create --zookeeper
[
https://issues.apache.org/jira/browse/SPARK-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386170#comment-14386170
]
Konstantin Shaposhnikov commented on SPARK-6566:
Thank you for the update
[
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386167#comment-14386167
]
Michael Armbrust commented on SPARK-6586:
-
I can see the utility for seeing the
[
https://issues.apache.org/jira/browse/SPARK-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386036#comment-14386036
]
Kai Sasaki commented on SPARK-6261:
---
[~josephkb] I created JIRA for IDFModel here.
[
https://issues.apache.org/jira/browse/SPARK-5564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386049#comment-14386049
]
Debasish Das commented on SPARK-5564:
-
[~josephkb] could you please point me to the
[
https://issues.apache.org/jira/browse/SPARK-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florian Verhein updated SPARK-6600:
---
Description:
Use case: User has set up the hadoop hdfs nfs gateway service on their
[
https://issues.apache.org/jira/browse/SPARK-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florian Verhein updated SPARK-6600:
---
Summary: Open ports in ec2/spark_ec2.py to allow HDFS NFS gateway(was:
Open ports in
[
https://issues.apache.org/jira/browse/SPARK-5564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386049#comment-14386049
]
Debasish Das edited comment on SPARK-5564 at 3/30/15 12:31 AM:
[
https://issues.apache.org/jira/browse/SPARK-5564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386049#comment-14386049
]
Debasish Das edited comment on SPARK-5564 at 3/30/15 12:30 AM:
[
https://issues.apache.org/jira/browse/SPARK-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florian Verhein updated SPARK-6600:
---
Description:
Use case: User has set up the hadoop hdfs nfs gateway service on their
[
https://issues.apache.org/jira/browse/SPARK-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florian Verhein updated SPARK-6601:
---
Description:
Add module hdfs-nfs-gateway, which sets up the gateway for (say,
[
https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385642#comment-14385642
]
Apache Spark commented on SPARK-6119:
-
User 'rxin' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385648#comment-14385648
]
Kannan Rajah commented on SPARK-1529:
-
I have pushed the first round of commits to my
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385706#comment-14385706
]
Sean Owen commented on SPARK-6593:
--
At this level though, what's a bad split? a line of
[
https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-4123.
--
Resolution: Fixed
Fix Version/s: 1.4.0
Issue resolved by pull request 5093
[
https://issues.apache.org/jira/browse/SPARK-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6406.
--
Resolution: Fixed
Fix Version/s: 1.4.0
Issue resolved by pull request 5085
[
https://issues.apache.org/jira/browse/SPARK-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-6406:
-
Assignee: Nishkam Ravi
Launcher backward compatibility issues
--
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dale Richardson updated SPARK-6593:
---
Description:
When reading a large amount of gzip files from HDFS eg. with
[
https://issues.apache.org/jira/browse/SPARK-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-5124.
Resolution: Fixed
Fix Version/s: 1.4.0
Standardize internal RPC interface
q79969786 created SPARK-6594:
Summary: Spark Streaming can't receive data from kafka
Key: SPARK-6594
URL: https://issues.apache.org/jira/browse/SPARK-6594
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385743#comment-14385743
]
Sean Owen commented on SPARK-6594:
--
There's no useful detail here. Can you elaborate what
[
https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385890#comment-14385890
]
Steve Loughran commented on SPARK-1537:
---
# I've just tried to see where YARN-2444
[
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-6586.
-
Resolution: Not a Problem
You can already get the original plan from a DataFrame:
[
https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-6548:
Target Version/s: 1.4.0
Adding stddev to DataFrame functions
[
https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-6592:
Target Version/s: 1.4.0
API of Row trait should be presented in Scala doc
[
https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-6592:
Priority: Critical (was: Major)
API of Row trait should be presented in Scala doc
[
https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-6587:
--
Description:
(Don't know if this is a functionality bug, error reporting bug or an RFE ...)
I define
[
https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385695#comment-14385695
]
Cheng Lian commented on SPARK-6587:
---
This behavior is expected. There are two problems
[
https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385695#comment-14385695
]
Cheng Lian edited comment on SPARK-6587 at 3/29/15 10:32 AM:
-
Dale Richardson created SPARK-6593:
--
Summary: Provide option for HadoopRDD to skip bad data splits.
Key: SPARK-6593
URL: https://issues.apache.org/jira/browse/SPARK-6593
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6558.
--
Resolution: Fixed
Fix Version/s: 1.4.0
Issue resolved by pull request 5229
[
https://issues.apache.org/jira/browse/SPARK-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6585.
--
Resolution: Fixed
Fix Version/s: 1.4.0
Issue resolved by pull request 5239
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dale Richardson updated SPARK-6593:
---
Summary: Provide option for HadoopRDD to skip corrupted files (was:
Provide option for
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385723#comment-14385723
]
Dale Richardson commented on SPARK-6593:
Changed the title and description to
[
https://issues.apache.org/jira/browse/SPARK-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-6585:
-
Assignee: June
FileServerSuite.test (HttpFileServer should not work with SSL when the
server is
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dale Richardson updated SPARK-6593:
---
Description:
When reading a large amount of files from HDFS eg. with
[
https://issues.apache.org/jira/browse/SPARK-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6580:
---
Assignee: (was: Apache Spark)
Optimize LogisticRegressionModel.predictPoint
[
https://issues.apache.org/jira/browse/SPARK-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385664#comment-14385664
]
Apache Spark commented on SPARK-6580:
-
User 'yanboliang' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385715#comment-14385715
]
Apache Spark commented on SPARK-6593:
-
User 'tigerquoll' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6593:
---
Assignee: (was: Apache Spark)
Provide option for HadoopRDD to skip bad data splits.
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6593:
---
Assignee: Apache Spark
Provide option for HadoopRDD to skip bad data splits.
[
https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385724#comment-14385724
]
Nan Zhu commented on SPARK-6592:
?
I don't think that makes any difference, as the path
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385716#comment-14385716
]
Dale Richardson edited comment on SPARK-6593 at 3/29/15 11:35 AM:
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385716#comment-14385716
]
Dale Richardson commented on SPARK-6593:
With a gz file for example, the entire
[
https://issues.apache.org/jira/browse/SPARK-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6580:
---
Assignee: Apache Spark
Optimize LogisticRegressionModel.predictPoint
[
https://issues.apache.org/jira/browse/SPARK-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385694#comment-14385694
]
Cheng Lian commented on SPARK-6579:
---
Here's another Parquet issue with Hadoop 1.0.4:
[
https://issues.apache.org/jira/browse/SPARK-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-6579:
--
Summary: save as parquet with overwrite failed when linking with Hadoop
1.0.4 (was: save as parquet
[
https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dale Richardson updated SPARK-6593:
---
Description:
When reading a large amount of files from HDFS eg. with
[
https://issues.apache.org/jira/browse/SPARK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385924#comment-14385924
]
Apache Spark commented on SPARK-6595:
-
User 'marmbrus' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6595:
---
Assignee: Michael Armbrust (was: Apache Spark)
DataFrame self joins with
[
https://issues.apache.org/jira/browse/SPARK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6595:
---
Assignee: Apache Spark (was: Michael Armbrust)
DataFrame self joins with
[
https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385964#comment-14385964
]
Nan Zhu commented on SPARK-6592:
it contains
the reason is that the input of that
[
https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385895#comment-14385895
]
Reynold Xin commented on SPARK-6592:
Row.html/class doesn't contain the word catalyst,
Michael Armbrust created SPARK-6595:
---
Summary: DataFrame self joins with MetastoreRelations fail
Key: SPARK-6595
URL: https://issues.apache.org/jira/browse/SPARK-6595
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385970#comment-14385970
]
Reynold Xin commented on SPARK-6592:
Ok then can't you just add apache to it?
API
[
https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6592:
---
Assignee: (was: Apache Spark)
API of Row trait should be presented in Scala doc
[
https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385991#comment-14385991
]
Apache Spark commented on SPARK-6592:
-
User 'CodingCat' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6592:
---
Assignee: Apache Spark
API of Row trait should be presented in Scala doc
Nan Zhu created SPARK-6596:
--
Summary: fix the instruction on building scaladoc
Key: SPARK-6596
URL: https://issues.apache.org/jira/browse/SPARK-6596
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385993#comment-14385993
]
Apache Spark commented on SPARK-6596:
-
User 'CodingCat' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6596:
---
Assignee: (was: Apache Spark)
fix the instruction on building scaladoc
[
https://issues.apache.org/jira/browse/SPARK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-6595:
Target Version/s: 1.3.1, 1.4.0 (was: 1.3.1)
DataFrame self joins with MetastoreRelations
[
https://issues.apache.org/jira/browse/SPARK-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6596:
---
Assignee: Apache Spark
fix the instruction on building scaladoc
[
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386009#comment-14386009
]
Liang-Chi Hsieh commented on SPARK-6586:
Not true. Because DataFrame now is given
[
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh reopened SPARK-6586:
Add the capability of retrieving original logical plan of DataFrame
[
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386009#comment-14386009
]
Liang-Chi Hsieh edited comment on SPARK-6586 at 3/29/15 11:24 PM:
Kousuke Saruta created SPARK-6597:
-
Summary: Replace `input:checkbox` with `input[type=checkbox] in
additional-metrics.js
Key: SPARK-6597
URL: https://issues.apache.org/jira/browse/SPARK-6597
[
https://issues.apache.org/jira/browse/SPARK-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6597:
---
Assignee: Apache Spark
Replace `input:checkbox` with `input[type=checkbox] in
[
https://issues.apache.org/jira/browse/SPARK-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6597:
---
Assignee: (was: Apache Spark)
Replace `input:checkbox` with `input[type=checkbox] in
[
https://issues.apache.org/jira/browse/SPARK-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386017#comment-14386017
]
Apache Spark commented on SPARK-6597:
-
User 'sarutak' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386020#comment-14386020
]
Michael Armbrust commented on SPARK-6586:
-
Okay, but what is the utility of
82 matches
Mail list logo