[jira] [Created] (SPARK-25762) Upgrade guava version in spark dependency lists due to CVE issue

2018-10-17 Thread Debojyoti (JIRA)
Debojyoti created SPARK-25762: - Summary: Upgrade guava version in spark dependency lists due to CVE issue Key: SPARK-25762 URL: https://issues.apache.org/jira/browse/SPARK-25762 Project: Spark

[jira] [Commented] (SPARK-25761) sparksql执行sql语句的时候,sql语句已经执行成功,但是从sparkui上看该语句还是没有执行完成,还是running状态。

2018-10-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654635#comment-16654635 ] Yuming Wang commented on SPARK-25761: - Could you translate to English and provide more infos, logs

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

2018-10-17 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654627#comment-16654627 ] Jungtaek Lim edited comment on SPARK-10816 at 10/18/18 4:36 AM: Just ran

[jira] [Commented] (SPARK-10816) EventTime based sessionization

2018-10-17 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654627#comment-16654627 ] Jungtaek Lim commented on SPARK-10816: -- Just ran another performance test to check my new trial of

[jira] [Resolved] (SPARK-25003) Pyspark Does not use Spark Sql Extensions

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25003. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 21990

[jira] [Assigned] (SPARK-25003) Pyspark Does not use Spark Sql Extensions

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25003: Assignee: Russell Spitzer > Pyspark Does not use Spark Sql Extensions >

[jira] [Commented] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

2018-10-17 Thread Foster Langbein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654543#comment-16654543 ] Foster Langbein commented on SPARK-12312: - So I just ran into this issue now trying to write to

[jira] [Reopened] (SPARK-25733) The method toLocalIterator() with dataframe doesn't work

2018-10-17 Thread Bihui Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bihui Jin reopened SPARK-25733: --- This issue isn't a duplicate of SPARK-23961 In SPARK-23961, toLocalIterator() is working but throw an

[jira] [Commented] (SPARK-25733) The method toLocalIterator() with dataframe doesn't work

2018-10-17 Thread Bihui Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654535#comment-16654535 ] Bihui Jin commented on SPARK-25733: --- Hi [~bryanc], This issue isn't a duplicate of SPARK-23961 In 

[jira] [Created] (SPARK-25761) sparksql执行sql语句的时候,sql语句已经执行成功,但是从sparkui上看该语句还是没有执行完成,还是running状态。

2018-10-17 Thread hanrentong (JIRA)
hanrentong created SPARK-25761: -- Summary: sparksql执行sql语句的时候,sql语句已经执行成功,但是从sparkui上看该语句还是没有执行完成,还是running状态。 Key: SPARK-25761 URL: https://issues.apache.org/jira/browse/SPARK-25761 Project: Spark

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654493#comment-16654493 ] Wenchen Fan commented on SPARK-25588: - sounds like the problem is caused by the parquet upgrade in

[jira] [Assigned] (SPARK-25760) Set AddJarCommand return empty

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25760: Assignee: Apache Spark > Set AddJarCommand return empty > --

[jira] [Updated] (SPARK-25760) Set AddJarCommand return empty

2018-10-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25760: Description: {noformat} spark-sql> add jar

[jira] [Commented] (SPARK-25760) Set AddJarCommand return empty

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654437#comment-16654437 ] Apache Spark commented on SPARK-25760: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25760) Set AddJarCommand return empty

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25760: Assignee: (was: Apache Spark) > Set AddJarCommand return empty >

[jira] [Created] (SPARK-25760) Set AddJarCommand return empty

2018-10-17 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-25760: --- Summary: Set AddJarCommand return empty Key: SPARK-25760 URL: https://issues.apache.org/jira/browse/SPARK-25760 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654417#comment-16654417 ] Xiao Li commented on SPARK-23390: - Thanks! > Flaky test: FileBasedDataSourceSuite >

[jira] [Assigned] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23390: --- Assignee: Dongjoon Hyun (was: Wenchen Fan) > Flaky test: FileBasedDataSourceSuite >

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-17 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654413#comment-16654413 ] Dongjoon Hyun commented on SPARK-23390: --- [~zsxwing], [~cloud_fan], and [~smilegator]. Both ORC-416

[jira] [Comment Edited] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-17 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654400#comment-16654400 ] Michael Heuer edited comment on SPARK-25588 at 10/17/18 11:56 PM: --

[jira] [Comment Edited] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-17 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654400#comment-16654400 ] Michael Heuer edited comment on SPARK-25588 at 10/17/18 11:55 PM: --

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-17 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654400#comment-16654400 ] Michael Heuer commented on SPARK-25588: --- [~Gengliang.Wang] The unit test provided is only an

[jira] [Assigned] (SPARK-25751) Unit Testing for Kerberos Support for Spark on Kubernetes

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25751: Assignee: (was: Apache Spark) > Unit Testing for Kerberos Support for Spark on

[jira] [Commented] (SPARK-25751) Unit Testing for Kerberos Support for Spark on Kubernetes

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654312#comment-16654312 ] Apache Spark commented on SPARK-25751: -- User 'ifilonenko' has created a pull request for this

[jira] [Commented] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654170#comment-16654170 ] Apache Spark commented on SPARK-25332: -- User 'sujith71955' has created a pull request for this

[jira] [Assigned] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25332: Assignee: Apache Spark > Instead of broadcast hash join ,Sort merge join has selected

[jira] [Assigned] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25332: Assignee: (was: Apache Spark) > Instead of broadcast hash join ,Sort merge join has

[jira] [Commented] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654168#comment-16654168 ] Apache Spark commented on SPARK-25332: -- User 'sujith71955' has created a pull request for this

[jira] [Commented] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-10-17 Thread Bansal, Parvesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654072#comment-16654072 ] Bansal, Parvesh commented on SPARK-23015: - Hi Hugh Zabriskie I was following the issue , as I

[jira] [Commented] (SPARK-24601) Bump Jackson version to 2.9.6

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653772#comment-16653772 ] Apache Spark commented on SPARK-24601: -- User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-25759) StreamingListenerBus: Listener JavaStreamingListenerWrapper threw an exception

2018-10-17 Thread Parhy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parhy updated SPARK-25759: -- Affects Version/s: (was: 2.2.0) 2.2.1 > StreamingListenerBus: Listener

[jira] [Assigned] (SPARK-21402) Java encoders - switch fields on collectAsList

2018-10-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21402: --- Assignee: Vladimir Kuriatkov > Java encoders - switch fields on collectAsList >

[jira] [Commented] (SPARK-20327) Add CLI support for YARN custom resources, like GPUs

2018-10-17 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653750#comment-16653750 ] Imran Rashid commented on SPARK-20327: -- https://github.com/apache/spark/pull/22751 was merged as

[jira] [Resolved] (SPARK-21402) Java encoders - switch fields on collectAsList

2018-10-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21402. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22708

[jira] [Assigned] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25758: Assignee: Apache Spark > Deprecate BisectingKMeans compute cost >

[jira] [Assigned] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25758: Assignee: (was: Apache Spark) > Deprecate BisectingKMeans compute cost >

[jira] [Commented] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653709#comment-16653709 ] Apache Spark commented on SPARK-25758: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Resolved] (SPARK-25735) Improve start-thriftserver.sh: print clean usage and exit with code 1

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25735. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22727

[jira] [Assigned] (SPARK-25735) Improve start-thriftserver.sh: print clean usage and exit with code 1

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25735: - Assignee: Gengliang Wang > Improve start-thriftserver.sh: print clean usage and exit with code

[jira] [Assigned] (SPARK-25741) Long URLs are not rendered properly in web UI

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25741: - Assignee: Gengliang Wang > Long URLs are not rendered properly in web UI >

[jira] [Resolved] (SPARK-25741) Long URLs are not rendered properly in web UI

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25741. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22744

[jira] [Updated] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25758: -- Priority: Minor (was: Major) (Not major). I agree with deprecating it. It does not need to block

[jira] [Commented] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653641#comment-16653641 ] Marco Gaido commented on SPARK-25758: - cc [~cloud_fan] [~srowen] [~holdenkarau]. This is a minor

[jira] [Created] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-25758: --- Summary: Deprecate BisectingKMeans compute cost Key: SPARK-25758 URL: https://issues.apache.org/jira/browse/SPARK-25758 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Brian Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653623#comment-16653623 ] Brian Jones commented on SPARK-25739: - [~hyukjin.kwon] Yes.  I agree, that is a better solution then

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653618#comment-16653618 ] Hyukjin Kwon commented on SPARK-25739: -- If so we should identify the patch introducing that

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Brian Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653617#comment-16653617 ] Brian Jones commented on SPARK-25739: - [~hyukjin.kwon] Correct. The code I gave gives the expected

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653615#comment-16653615 ] Hyukjin Kwon commented on SPARK-25739: -- Oh you mean it does work at Spark 2.3.0 but not at Spark

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Brian Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653604#comment-16653604 ] Brian Jones commented on SPARK-25739: - [~hyukjin.kwon] Alright.  But then why is it working on 2.3

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653599#comment-16653599 ] Hyukjin Kwon commented on SPARK-25739: -- New features are not ported for maintenance version bump

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Brian Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653595#comment-16653595 ] Brian Jones commented on SPARK-25739: - [~hyukjin.kwon] Correct.  However, we are not able to upgrade

[jira] [Updated] (SPARK-25757) Upgrade netty-all from 4.1.17.Final to 4.1.30.Final

2018-10-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25757: Affects Version/s: (was: 2.3.2) 3.0.0 > Upgrade netty-all from

[jira] [Updated] (SPARK-25757) Upgrade netty-all from 4.1.17.Final to 4.1.30.Final

2018-10-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25757: Component/s: (was: Deploy) Build > Upgrade netty-all from 4.1.17.Final to

[jira] [Commented] (SPARK-25757) Upgrade netty-all from 4.1.17.Final to 4.1.30.Final

2018-10-17 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653460#comment-16653460 ] Zhu, Lipeng commented on SPARK-25757: - I am working on this. > Upgrade netty-all from 4.1.17.Final

[jira] [Created] (SPARK-25757) Upgrade netty-all from 4.1.17.Final to 4.1.30.Final

2018-10-17 Thread Zhu Lipeng (JIRA)
Zhu Lipeng created SPARK-25757: -- Summary: Upgrade netty-all from 4.1.17.Final to 4.1.30.Final Key: SPARK-25757 URL: https://issues.apache.org/jira/browse/SPARK-25757 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-25754) Change CDN for MathJax

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25754. --- Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.4.0

[jira] [Created] (SPARK-25756) pyspark pandas_udf does not respect append outputMode in structured streaming

2018-10-17 Thread Jan Bols (JIRA)
Jan Bols created SPARK-25756: Summary: pyspark pandas_udf does not respect append outputMode in structured streaming Key: SPARK-25756 URL: https://issues.apache.org/jira/browse/SPARK-25756 Project: Spark

[jira] [Updated] (SPARK-25749) Exception thrown while reading avro file with large schema

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25749: - Priority: Major (was: Blocker) > Exception thrown while reading avro file with large schema >

[jira] [Resolved] (SPARK-25749) Exception thrown while reading avro file with large schema

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25749. -- Resolution: Invalid > Exception thrown while reading avro file with large schema >

[jira] [Commented] (SPARK-25749) Exception thrown while reading avro file with large schema

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653209#comment-16653209 ] Hyukjin Kwon commented on SPARK-25749: -- Please avoid set the priority, Critical+ which is usually

[jira] [Resolved] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25739. -- Resolution: Duplicate > Double quote coming in as empty value even when emptyValue set as

[jira] [Resolved] (SPARK-25731) Spark Structured Streaming Support for Kafka 2.0

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25731. -- Resolution: Duplicate > Spark Structured Streaming Support for Kafka 2.0 >

[jira] [Resolved] (SPARK-25733) The method toLocalIterator() with dataframe doesn't work

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25733. -- Resolution: Duplicate > The method toLocalIterator() with dataframe doesn't work >

[jira] [Resolved] (SPARK-25742) Is there a way to pass the Azure blob storage credentials to the spark for k8s init-container?

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25742. -- Resolution: Invalid Questions should go to mailing list. Please see

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653203#comment-16653203 ] Hyukjin Kwon commented on SPARK-25739: -- So this is fixed in Spark 2.4, right? That option is added

[jira] [Commented] (SPARK-25731) Spark Structured Streaming Support for Kafka 2.0

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653200#comment-16653200 ] Hyukjin Kwon commented on SPARK-25731: -- duplicate of SPARK-18057 > Spark Structured Streaming

[jira] [Resolved] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

2018-10-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25680. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22674

[jira] [Commented] (SPARK-25755) Supplementation of non-CodeGen unit tested for BroadcastHashJoinExec

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653145#comment-16653145 ] Apache Spark commented on SPARK-25755: -- User 'heary-cao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25755) Supplementation of non-CodeGen unit tested for BroadcastHashJoinExec

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25755: Assignee: Apache Spark > Supplementation of non-CodeGen unit tested for

[jira] [Assigned] (SPARK-25755) Supplementation of non-CodeGen unit tested for BroadcastHashJoinExec

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25755: Assignee: (was: Apache Spark) > Supplementation of non-CodeGen unit tested for

[jira] [Created] (SPARK-25755) Supplementation of non-CodeGen unit tested for BroadcastHashJoinExec

2018-10-17 Thread caoxuewen (JIRA)
caoxuewen created SPARK-25755: - Summary: Supplementation of non-CodeGen unit tested for BroadcastHashJoinExec Key: SPARK-25755 URL: https://issues.apache.org/jira/browse/SPARK-25755 Project: Spark

[jira] [Commented] (SPARK-25754) Change CDN for MathJax

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653081#comment-16653081 ] Apache Spark commented on SPARK-25754: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-25754) Change CDN for MathJax

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25754: Assignee: (was: Apache Spark) > Change CDN for MathJax > --- >

[jira] [Assigned] (SPARK-25754) Change CDN for MathJax

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25754: Assignee: Apache Spark > Change CDN for MathJax > --- > >

[jira] [Resolved] (SPARK-25734) Literal should have a value corresponding to dataType

2018-10-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25734. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22724

[jira] [Assigned] (SPARK-25734) Literal should have a value corresponding to dataType

2018-10-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25734: --- Assignee: Takeshi Yamamuro > Literal should have a value corresponding to dataType >

[jira] [Created] (SPARK-25754) Change CDN for MathJax

2018-10-17 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-25754: -- Summary: Change CDN for MathJax Key: SPARK-25754 URL: https://issues.apache.org/jira/browse/SPARK-25754 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-24424) Support ANSI-SQL compliant syntax for GROUPING SET

2018-10-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24424: Description: Currently, our Group By clause follows Hive