[jira] [Updated] (SPARK-24324) UserDefinedFunction mixes column labels

2018-05-19 Thread Cristian Consonni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristian Consonni updated SPARK-24324: -- Description: I am working on Wikipedia page views (see [task T188041 on Wikimedia's

[jira] [Updated] (SPARK-24324) UserDefinedFunction mixes column labels

2018-05-19 Thread Cristian Consonni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristian Consonni updated SPARK-24324: -- Description: I am working on Wikipedia page views (see [task T188041 on Wikimedia's

[jira] [Updated] (SPARK-24324) UserDefinedFunction mixes column labels

2018-05-19 Thread Cristian Consonni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristian Consonni updated SPARK-24324: -- Description: I am working on Wikipedia page views (see [task T188041 on Wikimedia's

[jira] [Updated] (SPARK-24324) UserDefinedFunction mixes column labels

2018-05-19 Thread Cristian Consonni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristian Consonni updated SPARK-24324: -- Description: I am working on Wikipedia page views (see [task T188041 on Wikimedia's

[jira] [Updated] (SPARK-24324) UserDefinedFunction mixes column labels

2018-05-19 Thread Cristian Consonni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristian Consonni updated SPARK-24324: -- Description: I am working on Wikipedia page views (see [task T188041 on Wikimedia's

[jira] [Created] (SPARK-24324) UserDefinedFunction mixes column labels

2018-05-19 Thread Cristian Consonni (JIRA)
Cristian Consonni created SPARK-24324: - Summary: UserDefinedFunction mixes column labels Key: SPARK-24324 URL: https://issues.apache.org/jira/browse/SPARK-24324 Project: Spark Issue

[jira] [Updated] (SPARK-24324) UserDefinedFunction mixes column labels

2018-05-19 Thread Cristian Consonni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristian Consonni updated SPARK-24324: -- Description: I am working on Wikipedia page views (see [task T188041 on Wikimedia's

[jira] [Commented] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

2018-05-19 Thread Teng Peng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481812#comment-16481812 ] Teng Peng commented on SPARK-24269: --- Does it make sense to infer nullability from JSON and CSV?  >

[jira] [Commented] (SPARK-23416) Flaky test: KafkaSourceStressForDontFailOnDataLossSuite.stress test for failOnDataLoss=false

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481809#comment-16481809 ] Dongjoon Hyun commented on SPARK-23416: --- Thank you so much, [~joseph.torres]. > Flaky test:

[jira] [Assigned] (SPARK-24323) Java lint errors

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24323: Assignee: (was: Apache Spark) > Java lint errors > > >

[jira] [Commented] (SPARK-24323) Java lint errors

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481795#comment-16481795 ] Apache Spark commented on SPARK-24323: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24323) Java lint errors

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24323: Assignee: Apache Spark > Java lint errors > > > Key:

[jira] [Created] (SPARK-24323) Java lint errors

2018-05-19 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-24323: Summary: Java lint errors Key: SPARK-24323 URL: https://issues.apache.org/jira/browse/SPARK-24323 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-24322) Upgrade Apache ORC to 1.4.4

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24322: -- Description: ORC 1.4.4 (released on May 14th) includes nine fixes like ORC-301. This issue

[jira] [Commented] (SPARK-24250) support accessing SQLConf inside tasks

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481746#comment-16481746 ] Apache Spark commented on SPARK-24250: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Commented] (SPARK-23416) Flaky test: KafkaSourceStressForDontFailOnDataLossSuite.stress test for failOnDataLoss=false

2018-05-19 Thread Jose Torres (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481740#comment-16481740 ] Jose Torres commented on SPARK-23416: - No problem. I've been working on this since last week. >

[jira] [Commented] (SPARK-23504) Flaky test: RateSourceV2Suite.basic microbatch execution

2018-05-19 Thread Jose Torres (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481739#comment-16481739 ] Jose Torres commented on SPARK-23504: - The test run posted appears to be very old - the most recent

[jira] [Commented] (SPARK-24322) Upgrade Apache ORC to 1.4.4

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481725#comment-16481725 ] Apache Spark commented on SPARK-24322: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-24322) Upgrade Apache ORC to 1.4.4

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24322: Assignee: Apache Spark > Upgrade Apache ORC to 1.4.4 > --- > >

[jira] [Assigned] (SPARK-24322) Upgrade Apache ORC to 1.4.4

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24322: Assignee: (was: Apache Spark) > Upgrade Apache ORC to 1.4.4 >

[jira] [Updated] (SPARK-24322) Upgrade Apache ORC to 1.4.4

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24322: -- Component/s: (was: SQL) Build > Upgrade Apache ORC to 1.4.4 >

[jira] [Created] (SPARK-24322) Upgrade Apache ORC to 1.4.4

2018-05-19 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-24322: - Summary: Upgrade Apache ORC to 1.4.4 Key: SPARK-24322 URL: https://issues.apache.org/jira/browse/SPARK-24322 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-24173) Flaky Test: VersionsSuite

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24173: -- Description: *BRANCH-2.2* -

[jira] [Updated] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23390: -- Description: We're seeing multiple failures in {{FileBasedDataSourceSuite}} in

[jira] [Updated] (SPARK-23390) Flaky test: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23390: -- Summary: Flaky test: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7 (was: Flaky Test Suite:

[jira] [Reopened] (SPARK-23416) Flaky test: KafkaSourceStressForDontFailOnDataLossSuite.stress test for failOnDataLoss=false

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-23416: --- Sorry. I'm reopening this due to the frequent failures > Flaky test:

[jira] [Comment Edited] (SPARK-23416) flaky test: org.apache.spark.sql.kafka010.KafkaSourceStressForDontFailOnDataLossSuite.stress test for failOnDataLoss=false

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473110#comment-16473110 ] Dongjoon Hyun edited comment on SPARK-23416 at 5/19/18 5:55 PM: FYI.

[jira] [Updated] (SPARK-23416) Flaky test: KafkaSourceStressForDontFailOnDataLossSuite.stress test for failOnDataLoss=false

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23416: -- Summary: Flaky test: KafkaSourceStressForDontFailOnDataLossSuite.stress test for

[jira] [Comment Edited] (SPARK-23416) flaky test: org.apache.spark.sql.kafka010.KafkaSourceStressForDontFailOnDataLossSuite.stress test for failOnDataLoss=false

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473110#comment-16473110 ] Dongjoon Hyun edited comment on SPARK-23416 at 5/19/18 5:54 PM: FYI.

[jira] [Updated] (SPARK-24173) Flaky Test: VersionsSuite

2018-05-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24173: -- Description: *BRANCH-2.2* -

[jira] [Commented] (SPARK-22236) CSV I/O: does not respect RFC 4180

2018-05-19 Thread Ondrej Kokes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481655#comment-16481655 ] Ondrej Kokes commented on SPARK-22236: -- There is one more setting that makes the default CSV parser

[jira] [Commented] (SPARK-24250) support accessing SQLConf inside tasks

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481628#comment-16481628 ] Apache Spark commented on SPARK-24250: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24215) Implement __repr__ and _repr_html_ for dataframes in PySpark

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24215: Assignee: Apache Spark > Implement __repr__ and _repr_html_ for dataframes in PySpark >

[jira] [Commented] (SPARK-24215) Implement __repr__ and _repr_html_ for dataframes in PySpark

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481603#comment-16481603 ] Apache Spark commented on SPARK-24215: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-24215) Implement __repr__ and _repr_html_ for dataframes in PySpark

2018-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24215: Assignee: (was: Apache Spark) > Implement __repr__ and _repr_html_ for dataframes in

[jira] [Resolved] (SPARK-24250) support accessing SQLConf inside tasks

2018-05-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24250. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21299