[jira] [Commented] (SPARK-26945) Python streaming tests flaky while cleaning temp directories after StreamingQuery.stop

2019-02-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775815#comment-16775815 ] Hyukjin Kwon commented on SPARK-26945: -- Thanks for reporting this, [~abellina] > Python streaming

[jira] [Resolved] (SPARK-26945) Python streaming tests flaky while cleaning temp directories after StreamingQuery.stop

2019-02-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26945. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23870

[jira] [Assigned] (SPARK-26945) Python streaming tests flaky while cleaning temp directories after StreamingQuery.stop

2019-02-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26945: Assignee: Hyukjin Kwon > Python streaming tests flaky while cleaning temp directories

[jira] [Commented] (SPARK-16183) Large Spark SQL commands cause StackOverflowError in parser when using sqlContext.sql

2019-02-22 Thread Matt Saunders (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775788#comment-16775788 ] Matt Saunders commented on SPARK-16183: --- It appears that this problem is still occurring as of Feb

[jira] [Commented] (SPARK-26977) Warn against subclassing scala.App doesn't work

2019-02-22 Thread Manu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775783#comment-16775783 ] Manu Zhang commented on SPARK-26977: I'd love to > Warn against subclassing scala.App doesn't work

[jira] [Resolved] (SPARK-25574) Add an option `keepQuotes` for parsing csv file

2019-02-22 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian resolved SPARK-25574. - Resolution: Invalid > Add an option `keepQuotes` for parsing csv file >

[jira] [Commented] (SPARK-26977) Warn against subclassing scala.App doesn't work

2019-02-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775776#comment-16775776 ] Sean Owen commented on SPARK-26977: --- Sure, would you like to make a pull request? > Warn against

[jira] [Comment Edited] (SPARK-26809) insert overwrite directory + concat function => error

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775772#comment-16775772 ] Alessandro Bellina edited comment on SPARK-26809 at 2/23/19 3:25 AM: -

[jira] [Comment Edited] (SPARK-26809) insert overwrite directory + concat function => error

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775772#comment-16775772 ] Alessandro Bellina edited comment on SPARK-26809 at 2/23/19 3:25 AM: -

[jira] [Comment Edited] (SPARK-26809) insert overwrite directory + concat function => error

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775772#comment-16775772 ] Alessandro Bellina edited comment on SPARK-26809 at 2/23/19 3:25 AM: -

[jira] [Created] (SPARK-26977) Warn against subclassing scala.App doesn't work

2019-02-22 Thread Manu Zhang (JIRA)
Manu Zhang created SPARK-26977: -- Summary: Warn against subclassing scala.App doesn't work Key: SPARK-26977 URL: https://issues.apache.org/jira/browse/SPARK-26977 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-26809) insert overwrite directory + concat function => error

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775772#comment-16775772 ] Alessandro Bellina commented on SPARK-26809: This does it. Didn't need the limit to

[jira] [Assigned] (SPARK-24615) Accelerator-aware task scheduling for Spark

2019-02-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-24615: - Assignee: Xingbo Jiang > Accelerator-aware task scheduling for Spark >

[jira] [Updated] (SPARK-26939) Fix some outdated comments about task schedulers

2019-02-22 Thread Chenxiao Mao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenxiao Mao updated SPARK-26939: - Description: Some comments about task schedulers are outdated. They should be fixed. *

[jira] [Assigned] (SPARK-26975) Support nested-column pruning over limit/sample/repartition

2019-02-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-26975: - Assignee: Dongjoon Hyun > Support nested-column pruning over limit/sample/repartition

[jira] [Resolved] (SPARK-26215) define reserved keywords after SQL standard

2019-02-22 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26215. -- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 3.0.0

[jira] [Created] (SPARK-26976) Forbid reserved keywords as identifiers when ANSI mode is on

2019-02-22 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-26976: Summary: Forbid reserved keywords as identifiers when ANSI mode is on Key: SPARK-26976 URL: https://issues.apache.org/jira/browse/SPARK-26976 Project: Spark

[jira] [Assigned] (SPARK-26918) All .md should have ASF license header

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26918: Assignee: (was: Apache Spark) > All .md should have ASF license header >

[jira] [Assigned] (SPARK-26918) All .md should have ASF license header

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26918: Assignee: Apache Spark > All .md should have ASF license header >

[jira] [Comment Edited] (SPARK-26918) All .md should have ASF license header

2019-02-22 Thread Mani M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775673#comment-16775673 ] Mani M edited comment on SPARK-26918 at 2/22/19 11:02 PM: -- I can take it up

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

2019-02-22 Thread Mani M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775673#comment-16775673 ] Mani M commented on SPARK-26918: I can take it up this project > All .md should have ASF license header

[jira] [Resolved] (SPARK-26651) Use Proleptic Gregorian calendar

2019-02-22 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-26651. Resolution: Done > Use Proleptic Gregorian calendar > > >

[jira] [Assigned] (SPARK-26774) Document threading concerns in TaskSchedulerImpl

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26774: Assignee: Apache Spark > Document threading concerns in TaskSchedulerImpl >

[jira] [Assigned] (SPARK-26774) Document threading concerns in TaskSchedulerImpl

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26774: Assignee: (was: Apache Spark) > Document threading concerns in TaskSchedulerImpl >

[jira] [Updated] (SPARK-26774) Document threading concerns in TaskSchedulerImpl

2019-02-22 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-26774: - Description: TaskSchedulerImpl has a couple of places threading concerns aren't clearly

[jira] [Updated] (SPARK-26950) Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values

2019-02-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26950: -- Fix Version/s: 2.3.4 > Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN

[jira] [Created] (SPARK-26975) Support nested-column pruning over limit/sample/repartition

2019-02-22 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-26975: - Summary: Support nested-column pruning over limit/sample/repartition Key: SPARK-26975 URL: https://issues.apache.org/jira/browse/SPARK-26975 Project: Spark

[jira] [Commented] (SPARK-22860) Spark workers log ssl passwords passed to the executors

2019-02-22 Thread tooptoop4 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775630#comment-16775630 ] tooptoop4 commented on SPARK-22860: --- [~kabhwan]  spark.ssl.keyStorePassword and  spark.ssl.keyPassword

[jira] [Assigned] (SPARK-26975) Support nested-column pruning over limit/sample/repartition

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26975: Assignee: Apache Spark > Support nested-column pruning over limit/sample/repartition >

[jira] [Assigned] (SPARK-26975) Support nested-column pruning over limit/sample/repartition

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26975: Assignee: (was: Apache Spark) > Support nested-column pruning over

[jira] [Assigned] (SPARK-26895) When running spark 2.3 as a proxy user (--proxy-user), SparkSubmit fails to resolve globs owned by target user

2019-02-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26895: -- Assignee: Alessandro Bellina > When running spark 2.3 as a proxy user

[jira] [Resolved] (SPARK-26895) When running spark 2.3 as a proxy user (--proxy-user), SparkSubmit fails to resolve globs owned by target user

2019-02-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26895. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23806

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Description:   I found a few discrepencies while working with inferSchema set to

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Description:   I found a few discrepencies while working with inferSchema set to

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Description:     Issue with CSV import and inferSchema set to true. I found a

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Description:     Issue with CSV import and inferSchema set to true. I found a

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Description:     Issue with CSV import and inferSchema set to true. I found a

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Description:     Issue with CSV import and inferSchema set to true. I found a

[jira] [Commented] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Erik Erlandson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775435#comment-16775435 ] Erik Erlandson commented on SPARK-26973: A couple other points: * Currently, k8s is evolving in

[jira] [Updated] (SPARK-26974) Invalid data in grouped cached dataset, formed by joining a large cached dataset with a small dataset

2019-02-22 Thread Utkarsh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Utkarsh Sharma updated SPARK-26974: --- Description: The initial datasets are derived from hive tables using the spark.table()

[jira] [Created] (SPARK-26974) Invalid data in grouped cached dataset, formed by joining a large cached dataset with a small dataset

2019-02-22 Thread Utkarsh Sharma (JIRA)
Utkarsh Sharma created SPARK-26974: -- Summary: Invalid data in grouped cached dataset, formed by joining a large cached dataset with a small dataset Key: SPARK-26974 URL:

[jira] [Commented] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775394#comment-16775394 ] shane knapp commented on SPARK-26973: - i was chatting over email w/[~eje] about this yesterday, and

[jira] [Updated] (SPARK-26974) Invalid data in grouped cached dataset, formed by joining a large cached dataset with a small dataset

2019-02-22 Thread Utkarsh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Utkarsh Sharma updated SPARK-26974: --- Description: The initial datasets are derived from hive tables using the spark.table()

[jira] [Commented] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775355#comment-16775355 ] Sean Owen commented on SPARK-26973: --- I think I'd suggest testing against one version or else this

[jira] [Updated] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-26973: Description: Kubernetes has a policy for supporting three minor releases and the

[jira] [Updated] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-26973: Description: Kubernetes has a policy for supporting three minor releases and the

[jira] [Updated] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-26973: Description: Kubernetes has a policy for supporting three minor releases and the

[jira] [Updated] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-26973: Description: Kubernetes has a policy for supporting three minor releases and the

[jira] [Updated] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-26973: Description: Kubernetes has a policy for supporting three minor releases and the

[jira] [Updated] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-26973: Description: Kubernetes has a policy for supporting three minor releases and the

[jira] [Updated] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-26973: Description: Kubernetes has a policy for supporting three minor releases and the

[jira] [Updated] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-26973: Summary: Kubernetes version support strategy on test nodes / backend (was:

[jira] [Created] (SPARK-26973) Kubernetes version support strategy on test nodes and for the backend

2019-02-22 Thread Stavros Kontopoulos (JIRA)
Stavros Kontopoulos created SPARK-26973: --- Summary: Kubernetes version support strategy on test nodes and for the backend Key: SPARK-26973 URL: https://issues.apache.org/jira/browse/SPARK-26973

[jira] [Commented] (SPARK-26973) Kubernetes version support strategy on test nodes and for the backend

2019-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775339#comment-16775339 ] Stavros Kontopoulos commented on SPARK-26973: - [~foxish] [~srowen] [~shaneknapp] [~vanzin]

[jira] [Commented] (SPARK-20597) KafkaSourceProvider falls back on path as synonym for topic

2019-02-22 Thread Valeria Vasylieva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775279#comment-16775279 ] Valeria Vasylieva commented on SPARK-20597: --- [~jlaskowski] I have added the PR for this issue,

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Attachment: ComplexCsvToDataframeApp.java > Issue with CSV import and inferSchema

[jira] [Created] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
Jean Georges Perrin created SPARK-26972: --- Summary: Issue with CSV import and inferSchema set to true Key: SPARK-26972 URL: https://issues.apache.org/jira/browse/SPARK-26972 Project: Spark

[jira] [Commented] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775218#comment-16775218 ] Jean Georges Perrin commented on SPARK-26972: - I added the code as attachments, Jira is

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Attachment: pom.xml > Issue with CSV import and inferSchema set to true >

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Attachment: books.csv > Issue with CSV import and inferSchema set to true >

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Attachment: issue.txt > Issue with CSV import and inferSchema set to true >

[jira] [Updated] (SPARK-26972) Issue with CSV import and inferSchema set to true

2019-02-22 Thread Jean Georges Perrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Georges Perrin updated SPARK-26972: Attachment: ComplexCsvToDataframeWithSchemaApp.java > Issue with CSV import and

[jira] [Commented] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple ti

2019-02-22 Thread Parth Gandhi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775188#comment-16775188 ] Parth Gandhi commented on SPARK-25250: -- [~Ngone51] I understand that you had a proposal and we were

[jira] [Created] (SPARK-26971) How to read delimiter (Cedilla) in spark RDD and Dataframes

2019-02-22 Thread Babu (JIRA)
Babu created SPARK-26971: Summary: How to read delimiter (Cedilla) in spark RDD and Dataframes Key: SPARK-26971 URL: https://issues.apache.org/jira/browse/SPARK-26971 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26945) Python streaming tests flaky while cleaning temp directories after StreamingQuery.stop

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775125#comment-16775125 ] Alessandro Bellina commented on SPARK-26945: [~hyukjin.kwon] thanks for taking a look. Seems

[jira] [Comment Edited] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775117#comment-16775117 ] Alessandro Bellina edited comment on SPARK-26944 at 2/22/19 1:07 PM: -

[jira] [Commented] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775117#comment-16775117 ] Alessandro Bellina commented on SPARK-26944: Hmm, I have a subsequent build from the same

[jira] [Updated] (SPARK-26970) Can't load PipelineModel that was created in Scala with Python due to missing Interaction transformer

2019-02-22 Thread Andrew Crosby (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Crosby updated SPARK-26970: -- Description: The Interaction transformer 

[jira] [Updated] (SPARK-26970) Can't load PipelineModel that was created in Scala with Python due to missing Interaction transformer

2019-02-22 Thread Andrew Crosby (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Crosby updated SPARK-26970: -- Description: The Interaction transformer 

[jira] [Updated] (SPARK-26970) Can't load PipelineModel that was created in Scala with Python due to missing Interaction transformer

2019-02-22 Thread Andrew Crosby (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Crosby updated SPARK-26970: -- Description: The Interaction transformer ( 

[jira] [Created] (SPARK-26970) Can't load PipelineModel that was created in Scala with Python due to missing Interaction transformer

2019-02-22 Thread Andrew Crosby (JIRA)
Andrew Crosby created SPARK-26970: - Summary: Can't load PipelineModel that was created in Scala with Python due to missing Interaction transformer Key: SPARK-26970 URL:

[jira] [Commented] (SPARK-26969) [Spark] Using ODBC not able to see the data in table when datatype is decimal

2019-02-22 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774994#comment-16774994 ] Sujith commented on SPARK-26969: i will further analyze the issue and raise a PR if required. thanks >

[jira] [Comment Edited] (SPARK-24417) Build and Run Spark on JDK11

2019-02-22 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774954#comment-16774954 ] M. Le Bihan edited comment on SPARK-24417 at 2/22/19 9:58 AM: -- It becomes

[jira] [Commented] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple ti

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774957#comment-16774957 ] Apache Spark commented on SPARK-25250: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

2019-02-22 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774954#comment-16774954 ] M. Le Bihan commented on SPARK-24417: - It becomes really troublesome to see Java 12 coming in few

[jira] [Created] (SPARK-26969) [Spark] Using ODBC not able to see the data in table when datatype is decimal

2019-02-22 Thread ABHISHEK KUMAR GUPTA (JIRA)
ABHISHEK KUMAR GUPTA created SPARK-26969: Summary: [Spark] Using ODBC not able to see the data in table when datatype is decimal Key: SPARK-26969 URL: https://issues.apache.org/jira/browse/SPARK-26969

[jira] [Created] (SPARK-26968) option("quoteMode", "NON_NUMERIC") have no effect on a CSV generation

2019-02-22 Thread M. Le Bihan (JIRA)
M. Le Bihan created SPARK-26968: --- Summary: option("quoteMode", "NON_NUMERIC") have no effect on a CSV generation Key: SPARK-26968 URL: https://issues.apache.org/jira/browse/SPARK-26968 Project: Spark

[jira] [Assigned] (SPARK-26945) Python streaming tests flaky while cleaning temp directories after StreamingQuery.stop

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26945: Assignee: Apache Spark > Python streaming tests flaky while cleaning temp directories

[jira] [Assigned] (SPARK-26945) Python streaming tests flaky while cleaning temp directories after StreamingQuery.stop

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26945: Assignee: (was: Apache Spark) > Python streaming tests flaky while cleaning temp

[jira] [Assigned] (SPARK-26967) Put MetricsSystem instance names together for clearer management

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26967: Assignee: (was: Apache Spark) > Put MetricsSystem instance names together for

[jira] [Assigned] (SPARK-26967) Put MetricsSystem instance names together for clearer management

2019-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26967: Assignee: Apache Spark > Put MetricsSystem instance names together for clearer

[jira] [Created] (SPARK-26967) Put MetricsSystem instance names together for clearer management

2019-02-22 Thread SongYadong (JIRA)
SongYadong created SPARK-26967: -- Summary: Put MetricsSystem instance names together for clearer management Key: SPARK-26967 URL: https://issues.apache.org/jira/browse/SPARK-26967 Project: Spark

[jira] [Commented] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

2019-02-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774892#comment-16774892 ] Hyukjin Kwon commented on SPARK-26944: -- Actually it's usually able to see it. It's usually included