[jira] [Assigned] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27010: Assignee: Apache Spark > find out the actual port number when hive.server2.thrift.port=0

[jira] [Commented] (SPARK-26943) Weird behaviour with `.cache()`

2019-02-28 Thread Will Uto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780491#comment-16780491 ] Will Uto commented on SPARK-26943: -- I think this is to do with using Spark version 2.1.0 - is it

[jira] [Updated] (SPARK-26205) Optimize InSet expression for bytes, shorts, ints, dates

2019-02-28 Thread Anton Okolnychyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-26205: - Summary: Optimize InSet expression for bytes, shorts, ints, dates (was: Optimize In

[jira] [Created] (SPARK-27011) reset command fails after cache table

2019-02-28 Thread Ajith S (JIRA)
Ajith S created SPARK-27011: --- Summary: reset command fails after cache table Key: SPARK-27011 URL: https://issues.apache.org/jira/browse/SPARK-27011 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-27012) Storage tab shows rdd details even after executor ended

2019-02-28 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780498#comment-16780498 ] Ajith S commented on SPARK-27012: - I will be working on this > Storage tab shows rdd details even after

[jira] [Commented] (SPARK-26739) Standardized Join Types for DataFrames

2019-02-28 Thread Mingcong Han (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780521#comment-16780521 ] Mingcong Han commented on SPARK-26739: -- How about just using the existing `JoinType` in

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Description: Currently, if we set *hive.server2.thrift.port=0*, it hard to find out the actual

[jira] [Created] (SPARK-27012) Storage tab shows rdd details even after executor ended

2019-02-28 Thread Ajith S (JIRA)
Ajith S created SPARK-27012: --- Summary: Storage tab shows rdd details even after executor ended Key: SPARK-27012 URL: https://issues.apache.org/jira/browse/SPARK-27012 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

2019-02-28 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780534#comment-16780534 ] Ajith S commented on SPARK-26961: - I think the root cause is

[jira] [Assigned] (SPARK-27012) Storage tab shows rdd details even after executor ended

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27012: Assignee: Apache Spark > Storage tab shows rdd details even after executor ended >

[jira] [Assigned] (SPARK-27012) Storage tab shows rdd details even after executor ended

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27012: Assignee: (was: Apache Spark) > Storage tab shows rdd details even after executor

[jira] [Updated] (SPARK-26205) Optimize InSet expression for bytes, shorts, ints, dates

2019-02-28 Thread Anton Okolnychyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-26205: - Description: {{In}} expressions are compiled into a sequence of if-else statements,

[jira] [Comment Edited] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

2019-02-28 Thread nivedita singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780365#comment-16780365 ] nivedita singh edited comment on SPARK-26388 at 2/28/19 11:08 AM: -- I

[jira] [Comment Edited] (SPARK-26961) Found Java-level deadlock in Spark Driver

2019-02-28 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780534#comment-16780534 ] Ajith S edited comment on SPARK-26961 at 2/28/19 1:54 PM: -- I think the root

[jira] [Commented] (SPARK-18580) Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream

2019-02-28 Thread Lokesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780381#comment-16780381 ] Lokesh Kumar commented on SPARK-18580: -- Hi All, Is this issue fixed in 2.4.0 ?? We need to use

[jira] [Assigned] (SPARK-26560) Repeating select on udf function throws analysis exception - function not registered

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26560: Assignee: Apache Spark > Repeating select on udf function throws analysis exception -

[jira] [Commented] (SPARK-26739) Standardized Join Types for DataFrames

2019-02-28 Thread Skyler Lehan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780594#comment-16780594 ] Skyler Lehan commented on SPARK-26739: -- [~Francis47] yes, I didn't realize

[jira] [Commented] (SPARK-25689) Move token renewal logic to driver in yarn-client mode

2019-02-28 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780609#comment-16780609 ] Yuming Wang commented on SPARK-25689: - Create PR: [https://github.com/apache/spark/pull/23922] to

[jira] [Commented] (SPARK-24130) Data Source V2: Join Push Down

2019-02-28 Thread William Wong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780735#comment-16780735 ] William Wong commented on SPARK-24130: -- Hi [~smilegator], Yes. It will be a very valuable

[jira] [Commented] (SPARK-26994) Enhance StructField to accept number format or date format

2019-02-28 Thread Murali Aakula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780572#comment-16780572 ] Murali Aakula commented on SPARK-26994: --- Sample Input: id,cpt,schedule_date,dstamp,weight,miles

[jira] [Assigned] (SPARK-26560) Repeating select on udf function throws analysis exception - function not registered

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26560: Assignee: (was: Apache Spark) > Repeating select on udf function throws analysis

[jira] [Resolved] (SPARK-19465) Support custom Boolean values in CSV

2019-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19465. --- Resolution: Won't Fix > Support custom Boolean values in CSV >

[jira] [Commented] (SPARK-26943) Weird behaviour with `.cache()`

2019-02-28 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780751#comment-16780751 ] Bryan Cutler commented on SPARK-26943: -- If you can try to reproduce locally, that would be ideal.

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

2019-02-28 Thread Rong Jialei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780771#comment-16780771 ] Rong Jialei commented on SPARK-26961: - Hi  Thanks for the response, from our current investigation,

[jira] [Commented] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

2019-02-28 Thread nivedita singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780365#comment-16780365 ] nivedita singh commented on SPARK-26388: I even got the same error on using spark 2.3.2 and hive

[jira] [Assigned] (SPARK-27011) reset command fails after cache table

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27011: Assignee: Apache Spark > reset command fails after cache table >

[jira] [Assigned] (SPARK-27011) reset command fails after cache table

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27011: Assignee: (was: Apache Spark) > reset command fails after cache table >

[jira] [Commented] (SPARK-27011) reset command fails after cache table

2019-02-28 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780397#comment-16780397 ] Ajith S commented on SPARK-27011: - Will be working on this > reset command fails after cache table >

[jira] [Created] (SPARK-27014) Support removal of jars and Spark binaries from Mesos driver and executor sandboxes

2019-02-28 Thread Martin Loncaric (JIRA)
Martin Loncaric created SPARK-27014: --- Summary: Support removal of jars and Spark binaries from Mesos driver and executor sandboxes Key: SPARK-27014 URL: https://issues.apache.org/jira/browse/SPARK-27014

[jira] [Updated] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-26192: Description: There is at least one option accessed in MesosClusterScheduler that should

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Issue Type: Bug (was: New Feature) > spark-submit does not properly escape arguments

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Created] (SPARK-27013) Add support for external encoders when resolving org.apache.spark.sql.catalyst.encoders.ExpressionEncoder's apply method

2019-02-28 Thread Frank Ottey (JIRA)
Frank Ottey created SPARK-27013: --- Summary: Add support for external encoders when resolving org.apache.spark.sql.catalyst.encoders.ExpressionEncoder's apply method Key: SPARK-27013 URL:

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Resolved] (SPARK-26774) Document threading concerns in TaskSchedulerImpl

2019-02-28 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26774. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23874

[jira] [Resolved] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

2019-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27003. --- Resolution: Not A Problem > [Spark]Message display at console is not correct for

[jira] [Updated] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-26192: Fix Version/s: 3.0.0 2.4.1 2.3.4 >

[jira] [Updated] (SPARK-27014) Support removal of jars and Spark binaries from Mesos driver and executor sandboxes

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27014: Fix Version/s: 3.0.0 2.5.0 > Support removal of jars and Spark

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Commented] (SPARK-26997) k8s integration tests failing after client upgraded to 4.1.2

2019-02-28 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780802#comment-16780802 ] shane knapp commented on SPARK-26997: - ok... everything is staged and all that remains to be done

[jira] [Assigned] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26192: Assignee: Apache Spark > MesosClusterScheduler reads options from dispatcher conf

[jira] [Assigned] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26192: Assignee: (was: Apache Spark) > MesosClusterScheduler reads options from dispatcher

[jira] [Created] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
Martin Loncaric created SPARK-27015: --- Summary: spark-submit does not properly escape arguments sent to Mesos dispatcher Key: SPARK-27015 URL: https://issues.apache.org/jira/browse/SPARK-27015

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Assigned] (SPARK-26774) Document threading concerns in TaskSchedulerImpl

2019-02-28 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26774: -- Assignee: Imran Rashid > Document threading concerns in TaskSchedulerImpl >

[jira] [Updated] (SPARK-27013) Consider adding support for external encoders when resolving org.apache.spark.sql.catalyst.encoders.ExpressionEncoder's apply method

2019-02-28 Thread Frank Ottey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Ottey updated SPARK-27013: Summary: Consider adding support for external encoders when resolving

[jira] [Updated] (SPARK-27014) Support removal of jars and Spark binaries from Mesos driver and executor sandboxes

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27014: Affects Version/s: (was: 2.4.0) 2.5.0 > Support removal of

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Updated] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

2019-02-28 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27015: Description: Arguments sent to the dispatcher must be escaped; for instance,

[jira] [Created] (SPARK-27016) Treat all antlr warnings as errors while generating parser from the sql grammar file.

2019-02-28 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-27016: Summary: Treat all antlr warnings as errors while generating parser from the sql grammar file. Key: SPARK-27016 URL: https://issues.apache.org/jira/browse/SPARK-27016

[jira] [Updated] (SPARK-26990) Difference in handling of mixed-case partition column names after SPARK-26188

2019-02-28 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-26990: -- Fix Version/s: 3.0.0 > Difference in handling of mixed-case partition column names after

[jira] [Assigned] (SPARK-27016) Treat all antlr warnings as errors while generating parser from the sql grammar file.

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27016: Assignee: Apache Spark > Treat all antlr warnings as errors while generating parser from

[jira] [Assigned] (SPARK-27016) Treat all antlr warnings as errors while generating parser from the sql grammar file.

2019-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27016: Assignee: (was: Apache Spark) > Treat all antlr warnings as errors while generating

[jira] [Assigned] (SPARK-27008) Support java.time.LocalDate as an external type of DateType

2019-02-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27008: --- Assignee: Maxim Gekk > Support java.time.LocalDate as an external type of DateType >

[jira] [Resolved] (SPARK-27008) Support java.time.LocalDate as an external type of DateType

2019-02-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27008. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23913

[jira] [Comment Edited] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

2019-02-28 Thread nivedita singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780365#comment-16780365 ] nivedita singh edited comment on SPARK-26388 at 3/1/19 3:12 AM: I even

[jira] [Updated] (SPARK-26994) Enhance StructField to accept number format or date format

2019-02-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26994: - Component/s: (was: Spark Core) > Enhance StructField to accept number format or date format

[jira] [Resolved] (SPARK-26994) Enhance StructField to accept number format or date format

2019-02-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26994. -- Resolution: Won't Fix > Enhance StructField to accept number format or date format >

[jira] [Commented] (SPARK-26994) Enhance StructField to accept number format or date format

2019-02-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781314#comment-16781314 ] Hyukjin Kwon commented on SPARK-26994: -- Can't you just define one function for this conversion? I

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Attachment: 2019-03-01_092511.png > find out the actual port number when

[jira] [Comment Edited] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781160#comment-16781160 ] zuotingbing edited comment on SPARK-27010 at 3/1/19 1:27 AM: - Currently, if

[jira] [Commented] (SPARK-26587) Deadlock between SparkUI thread and Driver thread

2019-02-28 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781213#comment-16781213 ] Ajith S commented on SPARK-26587: - Related 

[jira] [Resolved] (SPARK-26420) [kubernetes] driver service id is not random

2019-02-28 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26420. --- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 3.0.0 This is

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Attachment: (was: 2019-03-01_090847.png) > find out the actual port number when

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Attachment: 2019-03-01_090847.png > find out the actual port number when

[jira] [Commented] (SPARK-26872) Use a configurable value for final termination in the JobScheduler.stop() method

2019-02-28 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781288#comment-16781288 ] Shivu Sondur commented on SPARK-26872: -- I  am working on this issue > Use a configurable value for

[jira] [Comment Edited] (SPARK-27009) Add standard deviation to Benchmark tests

2019-02-28 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781292#comment-16781292 ] Dongjoon Hyun edited comment on SPARK-27009 at 3/1/19 5:01 AM: ---

[jira] [Resolved] (SPARK-27009) Add standard deviation to Benchmark tests

2019-02-28 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27009. --- Resolution: Fixed Assignee: Yifei Huang Fix Version/s: 3.0.0 This is

[jira] [Commented] (SPARK-27009) Add standard deviation to Benchmark tests

2019-02-28 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781292#comment-16781292 ] Dongjoon Hyun commented on SPARK-27009: --- Congratulation, [~yifeih]. You are added to Apache Spark

[jira] [Commented] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781160#comment-16781160 ] zuotingbing commented on SPARK-27010: - Currently, if we set *SPARK_MASTER_PORT=0*, we can  easily

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

2019-02-28 Thread Mani M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781205#comment-16781205 ] Mani M commented on SPARK-26918: Hi [~sowen] [~felixcheung] Let me know if the fix is required for this

[jira] [Created] (SPARK-27017) Creating orc table with special symbols in column name via spark.sql

2019-02-28 Thread Henryk Cesnolovic (JIRA)
Henryk Cesnolovic created SPARK-27017: - Summary: Creating orc table with special symbols in column name via spark.sql Key: SPARK-27017 URL: https://issues.apache.org/jira/browse/SPARK-27017

[jira] [Commented] (SPARK-27017) Creating orc table with special symbols in column name via spark.sql

2019-02-28 Thread Chakravarthi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781346#comment-16781346 ] Chakravarthi commented on SPARK-27017: -- I'm checking this issue. > Creating orc table with special

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

2019-02-28 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781353#comment-16781353 ] Maciej Bryński commented on SPARK-24432: I've just returned from Big Data Tech conference in

[jira] [Commented] (SPARK-24353) Add support for pod affinity/anti-affinity

2019-02-28 Thread Elad Dolev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780257#comment-16780257 ] Elad Dolev commented on SPARK-24353: Hi [~vanzin], You must be referring to PodPreset, and no, they

[jira] [Comment Edited] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2019-02-28 Thread Valeria Vasylieva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780274#comment-16780274 ] Valeria Vasylieva edited comment on SPARK-9135 at 2/28/19 8:57 AM: --- I

[jira] [Commented] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2019-02-28 Thread Valeria Vasylieva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780274#comment-16780274 ] Valeria Vasylieva commented on SPARK-9135: -- I have investigated this issue and here what I have

[jira] [Comment Edited] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2019-02-28 Thread Valeria Vasylieva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780274#comment-16780274 ] Valeria Vasylieva edited comment on SPARK-9135 at 2/28/19 8:58 AM: --- I

[jira] [Comment Edited] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2019-02-28 Thread Valeria Vasylieva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780274#comment-16780274 ] Valeria Vasylieva edited comment on SPARK-9135 at 2/28/19 8:58 AM: --- I

[jira] [Comment Edited] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2019-02-28 Thread Valeria Vasylieva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780274#comment-16780274 ] Valeria Vasylieva edited comment on SPARK-9135 at 2/28/19 9:01 AM: --- I

[jira] [Comment Edited] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2019-02-28 Thread Valeria Vasylieva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780274#comment-16780274 ] Valeria Vasylieva edited comment on SPARK-9135 at 2/28/19 9:00 AM: --- I

[jira] [Updated] (SPARK-24615) SPIP: Accelerator-aware task scheduling for Spark

2019-02-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24615: -- Description: (The JIRA received a major update on 2019/02/28. h2. Background and Motivation

[jira] [Updated] (SPARK-24615) SPIP: Accelerator-aware task scheduling for Spark

2019-02-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24615: -- Description: (The JIRA received a major update on 2019/02/28.) h2. Background and Motivation

[jira] [Updated] (SPARK-24615) SPIP: Accelerator-aware task scheduling for Spark

2019-02-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24615: -- Description: (The JIRA received a major update on 2019/02/28. Some comments were based on an

[jira] [Updated] (SPARK-24615) SPIP: Accelerator-aware task scheduling for Spark

2019-02-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24615: -- Description: (The JIRA received a major update on 2019/02/28. Some comments were based on an

[jira] [Comment Edited] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2019-02-28 Thread Valeria Vasylieva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780274#comment-16780274 ] Valeria Vasylieva edited comment on SPARK-9135 at 2/28/19 8:59 AM: --- I

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Summary: find out the actual port number when hive.server2.thrift.port=0 (was: display the

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Attachment: 2019-02-28_170942.png > find out the actual port number when

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Attachment: 2019-02-28_170904.png > find out the actual port number when

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Attachment: 2019-02-28_170844.png > find out the actual port number when

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Description: Currently, if we set *hive.server2.thrift.port=0*, it hard to find out the actual

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Description: Currently, if we set *hive.server2.thrift.port=0*, it hard to find out the actual

[jira] [Updated] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-27010: Description: Currently, if we set *hive.server2.thrift.port=0*, it hard to find out the actual

[jira] [Created] (SPARK-27010) display the actual port number when hive.server2.thrift.port=0

2019-02-28 Thread zuotingbing (JIRA)
zuotingbing created SPARK-27010: --- Summary: display the actual port number when hive.server2.thrift.port=0 Key: SPARK-27010 URL: https://issues.apache.org/jira/browse/SPARK-27010 Project: Spark

  1   2   >