[jira] [Assigned] (SPARK-22980) Using pandas_udf when inputs are not Pandas's Series or DataFrame

2018-01-12 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22980: Assignee: Hyukjin Kwon > Using pandas_udf when inputs are not Pandas's Series or

[jira] [Updated] (SPARK-22980) Clarify the length of each series is of each batch within scalar Pandas UDF

2018-01-12 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22980: - Summary: Clarify the length of each series is of each batch within scalar Pandas UDF (was:

[jira] [Resolved] (SPARK-22980) Using pandas_udf when inputs are not Pandas's Series or DataFrame

2018-01-12 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22980. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20237

[jira] [Updated] (SPARK-23063) Changes to publish the spark-kubernetes package

2018-01-12 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23063: --- Target Version/s: 2.3.0 Priority: Blocker (was: Major) > Changes to publish the

[jira] [Updated] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

2018-01-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23065: - Priority: Blocker (was: Major) > R API doc empty in Spark 2.3.0 RC1 >

[jira] [Created] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

2018-01-12 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-23065: Summary: R API doc empty in Spark 2.3.0 RC1 Key: SPARK-23065 URL: https://issues.apache.org/jira/browse/SPARK-23065 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-23000) Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark 2.3

2018-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23000: -- Fix Version/s: (was: 2.3.0) > Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark

[jira] [Updated] (SPARK-22908) add basic continuous kafka source

2018-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22908: -- Fix Version/s: (was: 2.3.0) (was: 3.0.0) > add basic continuous kafka

[jira] [Assigned] (SPARK-23063) Changes to publish the spark-kubernetes package

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23063: Assignee: Apache Spark > Changes to publish the spark-kubernetes package >

[jira] [Commented] (SPARK-23063) Changes to publish the spark-kubernetes package

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324929#comment-16324929 ] Apache Spark commented on SPARK-23063: -- User 'foxish' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23063) Changes to publish the spark-kubernetes package

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23063: Assignee: (was: Apache Spark) > Changes to publish the spark-kubernetes package >

[jira] [Assigned] (SPARK-23064) Add documentation for stream-stream joins

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23064: Assignee: Apache Spark (was: Tathagata Das) > Add documentation for stream-stream joins

[jira] [Assigned] (SPARK-23064) Add documentation for stream-stream joins

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23064: Assignee: Tathagata Das (was: Apache Spark) > Add documentation for stream-stream joins

[jira] [Commented] (SPARK-23064) Add documentation for stream-stream joins

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324918#comment-16324918 ] Apache Spark commented on SPARK-23064: -- User 'tdas' has created a pull request for this issue:

[jira] [Commented] (SPARK-23063) Changes to publish the spark-kubernetes package

2018-01-12 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324917#comment-16324917 ] Anirudh Ramanathan commented on SPARK-23063: This is likely something to be updated in

[jira] [Created] (SPARK-23064) Add documentation for stream-stream joins

2018-01-12 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-23064: - Summary: Add documentation for stream-stream joins Key: SPARK-23064 URL: https://issues.apache.org/jira/browse/SPARK-23064 Project: Spark Issue Type:

[jira] [Created] (SPARK-23063) Changes to publish the spark-kubernetes package

2018-01-12 Thread Anirudh Ramanathan (JIRA)
Anirudh Ramanathan created SPARK-23063: -- Summary: Changes to publish the spark-kubernetes package Key: SPARK-23063 URL: https://issues.apache.org/jira/browse/SPARK-23063 Project: Spark

[jira] [Assigned] (SPARK-23062) EXCEPT documentation should make it clear that it's EXCEPT DISTINCT

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23062: Assignee: Apache Spark > EXCEPT documentation should make it clear that it's EXCEPT

[jira] [Assigned] (SPARK-23062) EXCEPT documentation should make it clear that it's EXCEPT DISTINCT

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23062: Assignee: (was: Apache Spark) > EXCEPT documentation should make it clear that it's

[jira] [Commented] (SPARK-23062) EXCEPT documentation should make it clear that it's EXCEPT DISTINCT

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324784#comment-16324784 ] Apache Spark commented on SPARK-23062: -- User 'henryr' has created a pull request for this issue:

[jira] [Resolved] (SPARK-18540) Wholestage code-gen for ORC Hive tables

2018-01-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-18540. --- Resolution: Duplicate Fix Version/s: 2.3.0 This is resolved at 2.3.0 by SPARK-16060.

[jira] [Created] (SPARK-23062) EXCEPT documentation should make it clear that it's EXCEPT DISTINCT

2018-01-12 Thread Henry Robinson (JIRA)
Henry Robinson created SPARK-23062: -- Summary: EXCEPT documentation should make it clear that it's EXCEPT DISTINCT Key: SPARK-23062 URL: https://issues.apache.org/jira/browse/SPARK-23062 Project:

[jira] [Commented] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324747#comment-16324747 ] Tathagata Das commented on SPARK-23055: --- Thanks [~dongjoon] and [~sameerag] for handling this.

[jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

2018-01-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324745#comment-16324745 ] Steve Loughran commented on SPARK-23050: this s3n is the amazon EMR closed source impl; nothing

[jira] [Commented] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324743#comment-16324743 ] Dongjoon Hyun commented on SPARK-23055: --- Thank you, [~sameerag]. > KafkaContinuousSourceSuite

[jira] [Resolved] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-23055. Resolution: Fixed Assignee: Sameer Agarwal Fix Version/s: 2.3.0 >

[jira] [Commented] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324718#comment-16324718 ] Sameer Agarwal commented on SPARK-23055: I've reverted https://github.com/apache/spark/pull/20096

[jira] [Assigned] (SPARK-22908) add basic continuous kafka source

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22908: Assignee: Apache Spark (was: Jose Torres) > add basic continuous kafka source >

[jira] [Assigned] (SPARK-22908) add basic continuous kafka source

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22908: Assignee: Jose Torres (was: Apache Spark) > add basic continuous kafka source >

[jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

2018-01-12 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324717#comment-16324717 ] Shixiong Zhu commented on SPARK-23050: -- [~yash...@gmail.com] Spark SQL should handle it. Yeah,

[jira] [Updated] (SPARK-22908) add basic continuous kafka source

2018-01-12 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-22908: --- Target Version/s: 2.3.0 > add basic continuous kafka source >

[jira] [Reopened] (SPARK-22908) add basic continuous kafka source

2018-01-12 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reopened SPARK-22908: Re-opening this ticket as we've temporarily reverted

[jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

2018-01-12 Thread Yash Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324711#comment-16324711 ] Yash Sharma commented on SPARK-23050: - [~marmbrus], [~shixi...@databricks.com] When we say read via

[jira] [Comment Edited] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

2018-01-12 Thread Yash Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324711#comment-16324711 ] Yash Sharma edited comment on SPARK-23050 at 1/12/18 11:13 PM: ---

[jira] [Commented] (SPARK-22908) add basic continuous kafka source

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324681#comment-16324681 ] Apache Spark commented on SPARK-22908: -- User 'jose-torres' has created a pull request for this

[jira] [Updated] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23055: --- Target Version/s: 2.3.0 > KafkaContinuousSourceSuite Kafka column types test failing >

[jira] [Commented] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324637#comment-16324637 ] Dongjoon Hyun commented on SPARK-23055: --- cc [~sameerag] since he's a release manager for 2.3. >

[jira] [Updated] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23055: -- Priority: Critical (was: Blocker) > KafkaContinuousSourceSuite Kafka column types test

[jira] [Updated] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23055: -- Priority: Blocker (was: Major) > KafkaContinuousSourceSuite Kafka column types test failing >

[jira] [Commented] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324635#comment-16324635 ] Dongjoon Hyun commented on SPARK-23055: --- During investigating this, I found that the suite itself

[jira] [Updated] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23055: -- Description: KafkaContinuousSourceSuite Kafka column types test fails

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

2018-01-12 Thread Brandon Barker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324619#comment-16324619 ] Brandon Barker commented on SPARK-14220: Just wanted to note a potential performance regression

[jira] [Assigned] (SPARK-22975) MetricsReporter producing NullPointerException when there was no progress reported

2018-01-12 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-22975: Assignee: Marco Gaido > MetricsReporter producing NullPointerException when there was no

[jira] [Resolved] (SPARK-22975) MetricsReporter producing NullPointerException when there was no progress reported

2018-01-12 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-22975. -- Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull

[jira] [Commented] (SPARK-23029) Doc spark.shuffle.file.buffer units are kb when no units specified

2018-01-12 Thread Fernando Pereira (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324402#comment-16324402 ] Fernando Pereira commented on SPARK-23029: -- [~jerryshao] Thanks a lot for the info, now I

[jira] [Commented] (SPARK-23021) AnalysisBarrier should not cut off the explain output for Parsed Logical Plan

2018-01-12 Thread Kris Mok (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324318#comment-16324318 ] Kris Mok commented on SPARK-23021: -- Thank you very much for explaining the differences between

[jira] [Commented] (SPARK-23060) RDD's apply function

2018-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324292#comment-16324292 ] Sean Owen commented on SPARK-23060: --- Why not just write foo(rdd)? Is this necessary for some kind of

[jira] [Commented] (SPARK-23060) RDD's apply function

2018-01-12 Thread Gianmarco Donetti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324263#comment-16324263 ] Gianmarco Donetti commented on SPARK-23060: --- By the way, I have already forked and branched

[jira] [Commented] (SPARK-23060) RDD's apply function

2018-01-12 Thread Gianmarco Donetti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324261#comment-16324261 ] Gianmarco Donetti commented on SPARK-23060: --- See the example... It applies the function to the

[jira] [Updated] (SPARK-23051) job description in Spark UI is broken

2018-01-12 Thread Sandor Murakozi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandor Murakozi updated SPARK-23051: Attachment: in-2.2.png Spark-23051-after.png

[jira] [Created] (SPARK-23061) Support default write mode, settable via spark config

2018-01-12 Thread Stephan Sahm (JIRA)
Stephan Sahm created SPARK-23061: Summary: Support default write mode, settable via spark config Key: SPARK-23061 URL: https://issues.apache.org/jira/browse/SPARK-23061 Project: Spark Issue

[jira] [Updated] (SPARK-22982) Remove unsafe asynchronous close() call from FileDownloadChannel

2018-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22982: -- Fix Version/s: 2.2.2 > Remove unsafe asynchronous close() call from FileDownloadChannel >

[jira] [Resolved] (SPARK-23028) Bump master branch version to 2.4.0-SNAPSHOT

2018-01-12 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23028. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20222

[jira] [Commented] (SPARK-23060) RDD's apply function

2018-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324192#comment-16324192 ] Sean Owen commented on SPARK-23060: --- What does this mean? you want to add a function called apply? how

[jira] [Created] (SPARK-23060) RDD's apply function

2018-01-12 Thread Gianmarco Donetti (JIRA)
Gianmarco Donetti created SPARK-23060: - Summary: RDD's apply function Key: SPARK-23060 URL: https://issues.apache.org/jira/browse/SPARK-23060 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-23051) job description in Spark UI is broken

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23051: Assignee: Apache Spark > job description in Spark UI is broken >

[jira] [Assigned] (SPARK-23051) job description in Spark UI is broken

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23051: Assignee: (was: Apache Spark) > job description in Spark UI is broken >

[jira] [Commented] (SPARK-23051) job description in Spark UI is broken

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324177#comment-16324177 ] Apache Spark commented on SPARK-23051: -- User 'smurakozi' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-23059) Correct some improper with view related method usage

2018-01-12 Thread xubo245 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324138#comment-16324138 ] xubo245 edited comment on SPARK-23059 at 1/12/18 3:41 PM: -- split from

[jira] [Commented] (SPARK-23059) Correct some improper with view related method usage

2018-01-12 Thread xubo245 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324138#comment-16324138 ] xubo245 commented on SPARK-23059: - split from

[jira] [Assigned] (SPARK-23059) Correct some improper with view related method usage

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23059: Assignee: Apache Spark > Correct some improper with view related method usage >

[jira] [Assigned] (SPARK-23059) Correct some improper with view related method usage

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23059: Assignee: (was: Apache Spark) > Correct some improper with view related method usage

[jira] [Commented] (SPARK-23059) Correct some improper with view related method usage

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324135#comment-16324135 ] Apache Spark commented on SPARK-23059: -- User 'xubo245' has created a pull request for this issue:

[jira] [Updated] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL

2018-01-12 Thread Yash Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yash Datta updated SPARK-23056: --- Description: When using internationalized Domains in the urls like: {code:java} val url =

[jira] [Updated] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL

2018-01-12 Thread Yash Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yash Datta updated SPARK-23056: --- Description: When using internationalized Domains in the urls like: {code:java} val url =

[jira] [Updated] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL

2018-01-12 Thread Yash Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yash Datta updated SPARK-23056: --- Description: When using internationalized Domains in the urls like: {code:java} val url =

[jira] [Updated] (SPARK-23036) Add withGlobalTempView for testing

2018-01-12 Thread xubo245 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xubo245 updated SPARK-23036: Summary: Add withGlobalTempView for testing (was: Add withGlobalTempView for testing and correct some

[jira] [Created] (SPARK-23059) Correct some improper with view related method usage

2018-01-12 Thread xubo245 (JIRA)
xubo245 created SPARK-23059: --- Summary: Correct some improper with view related method usage Key: SPARK-23059 URL: https://issues.apache.org/jira/browse/SPARK-23059 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL

2018-01-12 Thread Yash Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324111#comment-16324111 ] Yash Datta edited comment on SPARK-23056 at 1/12/18 3:26 PM: - Agreed that

[jira] [Comment Edited] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL

2018-01-12 Thread Yash Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324111#comment-16324111 ] Yash Datta edited comment on SPARK-23056 at 1/12/18 3:25 PM: - Agreed that

[jira] [Commented] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL

2018-01-12 Thread Yash Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324111#comment-16324111 ] Yash Datta commented on SPARK-23056: Agreed that going strictly by standard, these are IRIs and not

[jira] [Updated] (SPARK-23036) Add withGlobalTempView for testing and correct some improper with view related method usage

2018-01-12 Thread xubo245 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xubo245 updated SPARK-23036: Description: Add withGlobalTempView when create global temp view, like withTempView and withView.

[jira] [Commented] (SPARK-23057) SET LOCATION should change the path of partition in table

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324074#comment-16324074 ] Apache Spark commented on SPARK-23057: -- User 'xubo245' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23057) SET LOCATION should change the path of partition in table

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23057: Assignee: (was: Apache Spark) > SET LOCATION should change the path of partition in

[jira] [Commented] (SPARK-19235) Enable Test Cases in DDLSuite with Hive Metastore

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324075#comment-16324075 ] Apache Spark commented on SPARK-19235: -- User 'xubo245' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23057) SET LOCATION should change the path of partition in table

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23057: Assignee: Apache Spark > SET LOCATION should change the path of partition in table >

[jira] [Commented] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL

2018-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324073#comment-16324073 ] Sean Owen commented on SPARK-23056: --- I'm not sure you're addressing the point that these aren't valid

[jira] [Updated] (SPARK-23057) SET LOCATION should change the path of partition in table

2018-01-12 Thread xubo245 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xubo245 updated SPARK-23057: Summary: SET LOCATION should change the path of partition in table (was: SET LOCATION should change the

[jira] [Comment Edited] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL

2018-01-12 Thread Yash Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324056#comment-16324056 ] Yash Datta edited comment on SPARK-23056 at 1/12/18 2:52 PM: - We have

[jira] [Commented] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL

2018-01-12 Thread Yash Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324056#comment-16324056 ] Yash Datta commented on SPARK-23056: We have production use case with many different IRIs in

[jira] [Assigned] (SPARK-23058) Show create table can't show non printable field delim

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23058: Assignee: (was: Apache Spark) > Show create table can't show non printable field

[jira] [Commented] (SPARK-23058) Show create table can't show non printable field delim

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324044#comment-16324044 ] Apache Spark commented on SPARK-23058: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23058) Show create table can't show non printable field delim

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23058: Assignee: Apache Spark > Show create table can't show non printable field delim >

[jira] [Updated] (SPARK-23058) Show create table can't show non printable field delim

2018-01-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23058: Description: # create table t1: {code:sql} CREATE EXTERNAL TABLE `t1`(`col1` bigint) ROW FORMAT

[jira] [Created] (SPARK-23058) Show create table conn't show non printable field delim

2018-01-12 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-23058: --- Summary: Show create table conn't show non printable field delim Key: SPARK-23058 URL: https://issues.apache.org/jira/browse/SPARK-23058 Project: Spark Issue

[jira] [Updated] (SPARK-23058) Show create table can't show non printable field delim

2018-01-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23058: Summary: Show create table can't show non printable field delim (was: Show create table conn't

[jira] [Commented] (SPARK-23021) AnalysisBarrier should not cut off the explain output for Parsed Logical Plan

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324034#comment-16324034 ] Apache Spark commented on SPARK-23021: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23021) AnalysisBarrier should not cut off the explain output for Parsed Logical Plan

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23021: Assignee: (was: Apache Spark) > AnalysisBarrier should not cut off the explain output

[jira] [Assigned] (SPARK-23021) AnalysisBarrier should not cut off the explain output for Parsed Logical Plan

2018-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23021: Assignee: Apache Spark > AnalysisBarrier should not cut off the explain output for Parsed

[jira] [Commented] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL

2018-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324031#comment-16324031 ] Sean Owen commented on SPARK-23056: --- [~saucam] that is not a valid URI or URL. I don't think this can

[jira] [Updated] (SPARK-23029) Doc spark.shuffle.file.buffer units are kb when no units specified

2018-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23029: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Summary: Doc

[jira] [Issue Comment Deleted] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23055: --- Comment: was deleted (was: At failure the query status is: {code:javascript}

[jira] [Updated] (SPARK-23057) SET LOCATION should change the path of partition in tabl

2018-01-12 Thread xubo245 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xubo245 updated SPARK-23057: Description: According to https://issues.apache.org/jira/browse/SPARK-19235 and

[jira] [Updated] (SPARK-23057) SET LOCATION should change the path of partition in tabl

2018-01-12 Thread xubo245 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xubo245 updated SPARK-23057: Description: According to https://issues.apache.org/jira/browse/SPARK-19235 and

[jira] [Comment Edited] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323978#comment-16323978 ] Attila Zsolt Piros edited comment on SPARK-23055 at 1/12/18 1:58 PM: -

[jira] [Commented] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

2018-01-12 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323978#comment-16323978 ] Attila Zsolt Piros commented on SPARK-23055: At failure the query status is: ``` status: {

[jira] [Created] (SPARK-23057) SET LOCATION should change the path of partition in tabl

2018-01-12 Thread xubo245 (JIRA)
xubo245 created SPARK-23057: --- Summary: SET LOCATION should change the path of partition in tabl Key: SPARK-23057 URL: https://issues.apache.org/jira/browse/SPARK-23057 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23021) AnalysisBarrier should not cut off the explain output for Parsed Logical Plan

2018-01-12 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323910#comment-16323910 ] Liang-Chi Hsieh commented on SPARK-23021: - To override {{innerChildren}} sounds good to me.

[jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

2018-01-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323883#comment-16323883 ] Michael Armbrust commented on SPARK-23050: -- [~zsxwing] is correct. While it is possible for

[jira] [Commented] (SPARK-23029) Setting spark.shuffle.file.buffer will make the shuffle fail

2018-01-12 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323872#comment-16323872 ] Saisai Shao commented on SPARK-23029: - There should be no issue unless you want to fix doc issue...

  1   2   >