[jira] [Commented] (SPARK-16519) Handle SparkR RDD generics that create warnings in R CMD check

2016-08-13 Thread Clark Fitzgerald (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420226#comment-15420226 ] Clark Fitzgerald commented on SPARK-16519: -- Thanks [~shivaram] for the heads up. Good thing I

[jira] [Commented] (SPARK-17049) LAG function fails when selecting all columns

2016-08-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420207#comment-15420207 ] Dongjoon Hyun commented on SPARK-17049: --- Hi, [~gcivan]. Yes. On Spark 2.0, it fails. Fortunately,

[jira] [Created] (SPARK-17049) LAG function fails when selecting all columns

2016-08-13 Thread Gokhan Civan (JIRA)
Gokhan Civan created SPARK-17049: Summary: LAG function fails when selecting all columns Key: SPARK-17049 URL: https://issues.apache.org/jira/browse/SPARK-17049 Project: Spark Issue Type:

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

2016-08-13 Thread Weiqing Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420116#comment-15420116 ] Weiqing Yang commented on SPARK-16966: -- [~srowen] Thanks for the new PR and review. > App Name is a

[jira] [Resolved] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

2016-08-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16966. - Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.1.0

[jira] [Comment Edited] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2016-08-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420106#comment-15420106 ] Dongjoon Hyun edited comment on SPARK-17041 at 8/13/16 10:18 PM: - Since I

[jira] [Commented] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2016-08-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420106#comment-15420106 ] Dongjoon Hyun commented on SPARK-17041: --- Since I don't have the exact script of your situation, it

[jira] [Commented] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2016-08-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420105#comment-15420105 ] Dongjoon Hyun commented on SPARK-17041: --- Hi, [~barrybecker4] I reproduced your problems and I think

[jira] [Commented] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2016-08-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420100#comment-15420100 ] Dongjoon Hyun commented on SPARK-17041: --- Hi, [~barrybecker4]. Could you give us more reproducible

[jira] [Assigned] (SPARK-17035) Conversion of datetime.max to microseconds produces incorrect value

2016-08-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17035: Assignee: Apache Spark > Conversion of datetime.max to microseconds produces incorrect

[jira] [Assigned] (SPARK-17035) Conversion of datetime.max to microseconds produces incorrect value

2016-08-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17035: Assignee: (was: Apache Spark) > Conversion of datetime.max to microseconds produces

[jira] [Commented] (SPARK-17035) Conversion of datetime.max to microseconds produces incorrect value

2016-08-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420090#comment-15420090 ] Apache Spark commented on SPARK-17035: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-17035) Conversion of datetime.max to microseconds produces incorrect value

2016-08-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420086#comment-15420086 ] Dongjoon Hyun commented on SPARK-17035: --- Hi, [~ptkool]. You're right. It seems the microsecond part

[jira] [Commented] (SPARK-6378) srcAttr in graph.triplets don't update when the size of graph is huge

2016-08-13 Thread Rabie Saidi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420006#comment-15420006 ] Rabie Saidi commented on SPARK-6378: The discrepancy between vertices and triplets' vertices seems to

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

2016-08-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419968#comment-15419968 ] Apache Spark commented on SPARK-16966: -- User 'srowen' has created a pull request for this issue:

[jira] [Created] (SPARK-17048) ML model read for custom transformers in a pipeline does not work

2016-08-13 Thread Taras Matyashovskyy (JIRA)
Taras Matyashovskyy created SPARK-17048: --- Summary: ML model read for custom transformers in a pipeline does not work Key: SPARK-17048 URL: https://issues.apache.org/jira/browse/SPARK-17048

[jira] [Updated] (SPARK-17048) ML model read for custom transformers in a pipeline does not work

2016-08-13 Thread Taras Matyashovskyy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Taras Matyashovskyy updated SPARK-17048: Description: 0. Use Java API :( 1. Create any custom ML transformer 2. Make it

[jira] [Created] (SPARK-17047) Spark 2 cannot create ORC table when CLUSTERED.

2016-08-13 Thread Dr Mich Talebzadeh (JIRA)
Dr Mich Talebzadeh created SPARK-17047: -- Summary: Spark 2 cannot create ORC table when CLUSTERED. Key: SPARK-17047 URL: https://issues.apache.org/jira/browse/SPARK-17047 Project: Spark

[jira] [Updated] (SPARK-14880) Parallel Gradient Descent with less map-reduce shuffle overhead

2016-08-13 Thread Ahmed Mahran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Mahran updated SPARK-14880: - External issue URL:

[jira] [Updated] (SPARK-14880) Parallel Gradient Descent with less map-reduce shuffle overhead

2016-08-13 Thread Ahmed Mahran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Mahran updated SPARK-14880: - Description: The current implementation of (Stochastic) Gradient Descent performs one

[jira] [Resolved] (SPARK-16893) Spark CSV Provider option is not documented

2016-08-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16893. --- Resolution: Not A Problem > Spark CSV Provider option is not documented >

[jira] [Updated] (SPARK-17023) Update Kafka connetor to use Kafka 0.10.0.1

2016-08-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17023: -- Assignee: Luciano Resende Priority: Trivial (was: Minor) > Update Kafka connetor to use Kafka

[jira] [Resolved] (SPARK-17023) Update Kafka connetor to use Kafka 0.10.0.1

2016-08-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17023. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Updated] (SPARK-16968) Allow to add additional options when creating a new table in DF's JDBC writer.

2016-08-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16968: -- Assignee: Jie Huang > Allow to add additional options when creating a new table in DF's JDBC >

[jira] [Resolved] (SPARK-16968) Allow to add additional options when creating a new table in DF's JDBC writer.

2016-08-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16968. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14559

[jira] [Resolved] (SPARK-12370) Documentation should link to examples from its own release version

2016-08-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12370. --- Resolution: Fixed Assignee: Jagadeesan A S Fix Version/s: 2.1.0

[jira] [Assigned] (SPARK-17046) prevent user using dataframe.select with empty param list

2016-08-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17046: Assignee: (was: Apache Spark) > prevent user using dataframe.select with empty param

[jira] [Assigned] (SPARK-17046) prevent user using dataframe.select with empty param list

2016-08-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17046: Assignee: Apache Spark > prevent user using dataframe.select with empty param list >

[jira] [Updated] (SPARK-17046) prevent user using dataframe.select with empty param list

2016-08-13 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-17046: --- Description: currently, we can use: dataframe.select() which select nothing. it is illegal and

[jira] [Commented] (SPARK-17046) prevent user using dataframe.select with empty param list

2016-08-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419855#comment-15419855 ] Apache Spark commented on SPARK-17046: -- User 'WeichenXu123' has created a pull request for this

[jira] [Created] (SPARK-17046) prevent user using dataframe.select with empty param list

2016-08-13 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-17046: -- Summary: prevent user using dataframe.select with empty param list Key: SPARK-17046 URL: https://issues.apache.org/jira/browse/SPARK-17046 Project: Spark Issue

[jira] [Resolved] (SPARK-17039) cannot read null dates from csv file

2016-08-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17039. --- Resolution: Duplicate Oh I understand the issue now, my fault. I agree this is a duplicate,

[jira] [Commented] (SPARK-17033) GaussianMixture should use treeAggregate to improve performance

2016-08-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419842#comment-15419842 ] Apache Spark commented on SPARK-17033: -- User 'WeichenXu123' has created a pull request for this