[jira] [Assigned] (SPARK-27164) RDD.countApprox on empty RDDs schedules jobs which never complete

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27164: Assignee: (was: Apache Spark) > RDD.countApprox on empty RDDs schedules jobs which

[jira] [Assigned] (SPARK-27164) RDD.countApprox on empty RDDs schedules jobs which never complete

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27164: Assignee: Apache Spark > RDD.countApprox on empty RDDs schedules jobs which never

[jira] [Commented] (SPARK-27152) Column equality does not work for aliased columns.

2019-03-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793251#comment-16793251 ] Hyukjin Kwon commented on SPARK-27152: -- So, in which case is it important? > Column equality does

[jira] [Updated] (SPARK-27169) number of active tasks is negative on executors page

2019-03-14 Thread acupple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] acupple updated SPARK-27169: Attachment: QQ20190315-102215.png > number of active tasks is negative on executors page >

[jira] [Updated] (SPARK-27169) number of active tasks is negative on executors page

2019-03-14 Thread acupple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] acupple updated SPARK-27169: Description: I use spark to process some data in hdfs and hbase, and the concurrency is 16.  but when

[jira] [Created] (SPARK-27169) number of active tasks is negative on executors page

2019-03-14 Thread acupple (JIRA)
acupple created SPARK-27169: --- Summary: number of active tasks is negative on executors page Key: SPARK-27169 URL: https://issues.apache.org/jira/browse/SPARK-27169 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-27107) Spark SQL Job failing because of Kryo buffer overflow with ORC

2019-03-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27107. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0

[jira] [Updated] (SPARK-27172) CRLF Injection/HTTP response splitting on spark embedded jetty servlet.

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27172: - Description: Can we upgrade embedded jetty servlet on spark 1.6.2? Is this possible or will

[jira] [Assigned] (SPARK-27136) Remove data source option check_files_exist

2019-03-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27136: --- Assignee: Gengliang Wang > Remove data source option check_files_exist >

[jira] [Updated] (SPARK-27172) CRLF Injection/HTTP response splitting on spark embedded jetty servlet.

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27172: - Description: Can we upgrade embedded jetty servlet on spark 1.6.2? Is this possible or will

[jira] [Created] (SPARK-27171) Support Full-Partiton limit in the first scan

2019-03-14 Thread deshanxiao (JIRA)
deshanxiao created SPARK-27171: -- Summary: Support Full-Partiton limit in the first scan Key: SPARK-27171 URL: https://issues.apache.org/jira/browse/SPARK-27171 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-27165) Upgrade Apache ORC to 1.5.5

2019-03-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27165. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0

[jira] [Updated] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27167: - Description: Will there be a big impact on my system if my current

[jira] [Updated] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27167: - Description: Will there be a big impact on my system if my current

[jira] [Resolved] (SPARK-27166) Improve `printSchema` to print up to the given level

2019-03-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27166. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0 This is

[jira] [Created] (SPARK-27172) CRLF Injection/HTTP response splitting on spark embedded jetty servlet.

2019-03-14 Thread Jerry Garcia (JIRA)
Jerry Garcia created SPARK-27172: Summary: CRLF Injection/HTTP response splitting on spark embedded jetty servlet. Key: SPARK-27172 URL: https://issues.apache.org/jira/browse/SPARK-27172 Project:

[jira] [Updated] (SPARK-27172) CRLF Injection/HTTP response splitting on spark embedded jetty servlet.

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27172: - Attachment: CRLF injection - Sheet1.pdf > CRLF Injection/HTTP response splitting on spark

[jira] [Commented] (SPARK-22506) Spark thrift server can not impersonate user in kerberos

2019-03-14 Thread Wataru Yukawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793308#comment-16793308 ] Wataru Yukawa commented on SPARK-22506: --- Hi, Spark thrift server can impersonate a user in our 

[jira] [Updated] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27167: - Attachment: (was: Vulnerability Javascript library.xlsx) > What would be the possible

[jira] [Updated] (SPARK-27156) why is the "http://:18080/static" browse able?

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27156: - Issue Type: Bug (was: Question) > why is the "http://:18080/static" browse able? >

[jira] [Updated] (SPARK-27172) CRLF Injection/HTTP response splitting on spark embedded jetty servlet.

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27172: - Issue Type: Dependency upgrade (was: Question) > CRLF Injection/HTTP response splitting on

[jira] [Resolved] (SPARK-27132) Improve file source V2 framework

2019-03-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27132. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24066

[jira] [Assigned] (SPARK-27132) Improve file source V2 framework

2019-03-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27132: --- Assignee: Gengliang Wang > Improve file source V2 framework >

[jira] [Updated] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27167: - Description: Will there be a big impact on my system if my current

[jira] [Updated] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27167: - Description: Will there be a big impact on my system if my current

[jira] [Updated] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27167: - Attachment: Vulnerability Javascript library.xlsx > What would be the possible impact if I

[jira] [Updated] (SPARK-27172) CRLF Injection/HTTP response splitting on spark embedded jetty servlet.

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27172: - Attachment: (was: CRLF injection - Sheet1.pdf) > CRLF Injection/HTTP response splitting on

[jira] [Updated] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27167: - Description: Will there be a big impact on the system if current /static/jquery-1.11.1.min.js

[jira] [Updated] (SPARK-27172) CRLF Injection/HTTP response splitting on spark embedded jetty servlet.

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27172: - Description: Can we upgrade embedded jetty servlet on spark 1.6.2? Will there be any

[jira] [Created] (SPARK-27170) Better error message for syntax error with extraneous comma in the SQL parser

2019-03-14 Thread Wataru Yukawa (JIRA)
Wataru Yukawa created SPARK-27170: - Summary: Better error message for syntax error with extraneous comma in the SQL parser Key: SPARK-27170 URL: https://issues.apache.org/jira/browse/SPARK-27170

[jira] [Commented] (SPARK-27142) Provide REST API for SQL level information

2019-03-14 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793268#comment-16793268 ] Gengliang Wang commented on SPARK-27142: +1 on the proposal. > Provide REST API for SQL level

[jira] [Resolved] (SPARK-27136) Remove data source option check_files_exist

2019-03-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27136. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24069

[jira] [Updated] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27167: - Description: Will there be a big impact on my system if my current

[jira] [Updated] (SPARK-27172) CRLF Injection/HTTP response splitting on spark embedded jetty servlet.

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27172: - Description: Can we upgrade embedded jetty servlet on spark 1.6.2? As per our vulnerability

[jira] [Updated] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

2019-03-14 Thread Jerry Garcia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Garcia updated SPARK-27167: - Issue Type: Dependency upgrade (was: Question) > What would be the possible impact if I

<    1   2