[jira] [Commented] (SPARK-21476) RandomForest classification model not using broadcast in transform

[ https://issues.apache.org/jira/browse/SPARK-21476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154823#comment-16154823 ] Nirav Kuntar commented on SPARK-21476: -- Hi [~peng.m...@intel.com], We have made these

[jira] [Resolved] (SPARK-9104) expose network layer memory usage in shuffle part

[ https://issues.apache.org/jira/browse/SPARK-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-9104. - Resolution: Fixed Fix Version/s: 2.3.0 > expose network layer memory usage in shuffle part

[jira] [Reopened] (SPARK-9104) expose network layer memory usage in shuffle part

[ https://issues.apache.org/jira/browse/SPARK-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reopened SPARK-9104: - Assignee: Saisai Shao > expose network layer memory usage in shuffle part >

[jira] [Commented] (SPARK-21842) Support Kerberos ticket renewal and creation in Mesos

[ https://issues.apache.org/jira/browse/SPARK-21842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154785#comment-16154785 ] Arthur Rand commented on SPARK-21842: - Hello [~kalvinnchau], I apologize for the slow response.

[jira] [Updated] (SPARK-21931) add LNNVL function

[ https://issues.apache.org/jira/browse/SPARK-21931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-21931: -- Description: Purpose LNNVL provides a concise way to evaluate a condition when one or

[jira] [Updated] (SPARK-21931) add LNNVL function

[ https://issues.apache.org/jira/browse/SPARK-21931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-21931: -- Description: Purpose LNNVL provides a concise way to evaluate a condition when one or

[jira] [Updated] (SPARK-21931) add LNNVL function

[ https://issues.apache.org/jira/browse/SPARK-21931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-21931: -- Attachment: Capture1.JPG > add LNNVL function > -- > >

[jira] [Created] (SPARK-21931) add LNNVL function

Ruslan Dautkhanov created SPARK-21931: - Summary: add LNNVL function Key: SPARK-21931 URL: https://issues.apache.org/jira/browse/SPARK-21931 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154744#comment-16154744 ] Saisai Shao commented on SPARK-21917: - Thanks [~vanzin], I think your suggestion is great, this will

[jira] [Assigned] (SPARK-18061) Spark Thriftserver needs to create SPNego principal

[ https://issues.apache.org/jira/browse/SPARK-18061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-18061: --- Assignee: Saisai Shao > Spark Thriftserver needs to create SPNego principal >

[jira] [Resolved] (SPARK-18061) Spark Thriftserver needs to create SPNego principal

[ https://issues.apache.org/jira/browse/SPARK-18061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-18061. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18628

[jira] [Updated] (SPARK-21912) ORC/Parquet table should not create invalid column names

[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21912: -- Summary: ORC/Parquet table should not create invalid column names (was: ORC/Parquet table

[jira] [Updated] (SPARK-21912) ORC/Parquet table should create invalid column names

[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21912: -- Summary: ORC/Parquet table should create invalid column names (was: Creating ORC datasource

[jira] [Created] (SPARK-21930) When the number of attempting to restart receiver greater than 0,spark do nothing in 'else'

liuxianjiao created SPARK-21930: --- Summary: When the number of attempting to restart receiver greater than 0,spark do nothing in 'else' Key: SPARK-21930 URL: https://issues.apache.org/jira/browse/SPARK-21930

[jira] [Created] (SPARK-21929) Support `ALTER TABLE table_name ADD COLUMNS(..)` for ORC data source

Dongjoon Hyun created SPARK-21929: - Summary: Support `ALTER TABLE table_name ADD COLUMNS(..)` for ORC data source Key: SPARK-21929 URL: https://issues.apache.org/jira/browse/SPARK-21929 Project:

[jira] [Assigned] (SPARK-21384) Spark 2.2 + YARN without spark.yarn.jars / spark.yarn.archive fails

[ https://issues.apache.org/jira/browse/SPARK-21384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21384: Assignee: (was: Apache Spark) > Spark 2.2 + YARN without spark.yarn.jars /

[jira] [Commented] (SPARK-21384) Spark 2.2 + YARN without spark.yarn.jars / spark.yarn.archive fails

[ https://issues.apache.org/jira/browse/SPARK-21384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154627#comment-16154627 ] Apache Spark commented on SPARK-21384: -- User 'devaraj-kavali' has created a pull request for this

[jira] [Assigned] (SPARK-21384) Spark 2.2 + YARN without spark.yarn.jars / spark.yarn.archive fails

[ https://issues.apache.org/jira/browse/SPARK-21384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21384: Assignee: Apache Spark > Spark 2.2 + YARN without spark.yarn.jars / spark.yarn.archive

[jira] [Commented] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154575#comment-16154575 ] Yin Huai commented on SPARK-21927: -- My worry is that it may mask actual issues related to dependencies.

[jira] [Updated] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21927: Affects Version/s: (was: 2.2.1) 2.3.0 > Spark pom.xml's dependency management

[jira] [Updated] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21927: Issue Type: Improvement (was: Bug) > Spark pom.xml's dependency management is broken >

[jira] [Created] (SPARK-21928) ML LogisticRegression training occasionally produces java.lang.ClassNotFoundException when attempting to load custom Kryo registrator class

John Brock created SPARK-21928: -- Summary: ML LogisticRegression training occasionally produces java.lang.ClassNotFoundException when attempting to load custom Kryo registrator class Key: SPARK-21928 URL:

[jira] [Commented] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154469#comment-16154469 ] Sean Owen commented on SPARK-21927: --- It's probably the scalastyle update today but why is this filed as

[jira] [Commented] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154426#comment-16154426 ] Kris Mok commented on SPARK-21927: -- [~sowen] Could you please take a look and see if recent change to

[jira] [Created] (SPARK-21927) Spark pom.xml's dependency management is broken

Kris Mok created SPARK-21927: Summary: Spark pom.xml's dependency management is broken Key: SPARK-21927 URL: https://issues.apache.org/jira/browse/SPARK-21927 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154363#comment-16154363 ] Marcelo Vanzin commented on SPARK-18085: That should be fixed if you sync to my repo's

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154361#comment-16154361 ] Bryan Cutler commented on SPARK-21190: -- Thanks [~ueshin], I think having an optional {{kwargs}} at

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154336#comment-16154336 ] Marcelo Vanzin commented on SPARK-18085: Ok I think I was able to reproduce that locally. >

[jira] [Created] (SPARK-21926) Some transformers in spark.ml.feature fail when trying to transform steaming dataframes

Bago Amirbekian created SPARK-21926: --- Summary: Some transformers in spark.ml.feature fail when trying to transform steaming dataframes Key: SPARK-21926 URL: https://issues.apache.org/jira/browse/SPARK-21926

[jira] [Commented] (SPARK-21876) Idling Executors that never handled any tasks are not cleared from BlockManager after being removed

[ https://issues.apache.org/jira/browse/SPARK-21876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154303#comment-16154303 ] Imran Rashid commented on SPARK-21876: -- Thanks for reporting this [~julie.zhang]. I got a little

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154270#comment-16154270 ] Holger Brandl commented on SPARK-9776: -- I'm still having this issue with spark-2.2.0-bin-hadoop2.7.

[jira] [Resolved] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-21925. --- Resolution: Fixed Fix Version/s: 3.0.0 2.2.1 Issue resolved by

[jira] [Commented] (SPARK-21890) ObtainCredentials does not pass creds to addDelegationTokens

[ https://issues.apache.org/jira/browse/SPARK-21890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154190#comment-16154190 ] Apache Spark commented on SPARK-21890: -- User 'redsanket' has created a pull request for this issue:

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154132#comment-16154132 ] Timothy Hunter commented on SPARK-21866: [~yanboliang] thanks you for the comments. Regarding

[jira] [Assigned] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21925: Assignee: Apache Spark > Update trigger interval documentation in docs with behavior

[jira] [Assigned] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21925: Assignee: (was: Apache Spark) > Update trigger interval documentation in docs with

[jira] [Commented] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154106#comment-16154106 ] Apache Spark commented on SPARK-21925: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Created] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2

Burak Yavuz created SPARK-21925: --- Summary: Update trigger interval documentation in docs with behavior change in Spark 2.2 Key: SPARK-21925 URL: https://issues.apache.org/jira/browse/SPARK-21925

[jira] [Commented] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154097#comment-16154097 ] Marcelo Vanzin commented on SPARK-21917: I think the optimal way would be to try to add things to

[jira] [Commented] (SPARK-20922) Unsafe deserialization in Spark LauncherConnection

[ https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154075#comment-16154075 ] Sean Owen commented on SPARK-20922: --- This came up again today and our security folks also suggested

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154033#comment-16154033 ] Marco Gaido commented on SPARK-21918: - What do you mean by "works correctly"? Actually all the jobs

[jira] [Commented] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154006#comment-16154006 ] Thomas Graves commented on SPARK-21888: --- the client needs to get the hbase credentials for secure

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153986#comment-16153986 ] Leif Walsh commented on SPARK-21190: I think the size parameter is confusing: if a

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153978#comment-16153978 ] Takuya Ueshin commented on SPARK-21190: --- [~leif] Thank you for your proposal. I'm sorry but I

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153955#comment-16153955 ] Takuya Ueshin commented on SPARK-21190: --- [~bryanc] Thank you for your suggestion. {{**kwargs}}

[jira] [Commented] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153888#comment-16153888 ] Marco Gaido commented on SPARK-21888: - [~tgraves] Sorry, I misread. Of course, this doesn't add it to

[jira] [Updated] (SPARK-21924) Bug in Structured Streaming Documentation

[ https://issues.apache.org/jira/browse/SPARK-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riccardo Corbella updated SPARK-21924: -- Description: Under the structured streaming documentation page, more precisely in text

[jira] [Assigned] (SPARK-21924) Bug in Structured Streaming Documentation

[ https://issues.apache.org/jira/browse/SPARK-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21924: Assignee: (was: Apache Spark) > Bug in Structured Streaming Documentation >

[jira] [Assigned] (SPARK-21924) Bug in Structured Streaming Documentation

[ https://issues.apache.org/jira/browse/SPARK-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21924: Assignee: Apache Spark > Bug in Structured Streaming Documentation >

[jira] [Commented] (SPARK-21924) Bug in Structured Streaming Documentation

[ https://issues.apache.org/jira/browse/SPARK-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153856#comment-16153856 ] Apache Spark commented on SPARK-21924: -- User 'riccardocorbella' has created a pull request for this

[jira] [Commented] (SPARK-21924) Bug in Structured Streaming Documentation

[ https://issues.apache.org/jira/browse/SPARK-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153847#comment-16153847 ] Sean Owen commented on SPARK-21924: --- Agree, go ahead and make a pull request. > Bug in Structured

[jira] [Commented] (SPARK-15689) Data source API v2

[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153834#comment-16153834 ] Apache Spark commented on SPARK-15689: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15689) Data source API v2

[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15689: Assignee: (was: Apache Spark) > Data source API v2 > -- > >

[jira] [Assigned] (SPARK-15689) Data source API v2

[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15689: Assignee: Apache Spark > Data source API v2 > -- > > Key:

[jira] [Assigned] (SPARK-20978) CSV emits NPE when the number of tokens is less than given schema and corrupt column is given

[ https://issues.apache.org/jira/browse/SPARK-20978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20978: --- Assignee: Hyukjin Kwon > CSV emits NPE when the number of tokens is less than given schema

[jira] [Resolved] (SPARK-20978) CSV emits NPE when the number of tokens is less than given schema and corrupt column is given

[ https://issues.apache.org/jira/browse/SPARK-20978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20978. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19113

[jira] [Commented] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153744#comment-16153744 ] Thomas Graves commented on SPARK-21888: --- also note that you can do this in client mode by using the

[jira] [Commented] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153739#comment-16153739 ] Thomas Graves commented on SPARK-21888: --- [~mgaido] I don't think that is true unless something

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153713#comment-16153713 ] Hu Liu, commented on SPARK-21918: - [~mgaido] It seems that doAS works correctly in hiveThrift

[jira] [Commented] (SPARK-15689) Data source API v2

[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153709#comment-16153709 ] Yanbo Liang commented on SPARK-15689: - [~cloud_fan] Great doc! I like the direction this is going in,

[jira] [Comment Edited] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153672#comment-16153672 ] Marco Gaido edited comment on SPARK-21918 at 9/5/17 1:54 PM: -

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153672#comment-16153672 ] Marco Gaido commented on SPARK-21918: - hive.server2.enable.doAs=true is currently not supported in

[jira] [Comment Edited] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153647#comment-16153647 ] Yanbo Liang edited comment on SPARK-21866 at 9/5/17 1:39 PM: - I would support

[jira] [Comment Edited] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153647#comment-16153647 ] Yanbo Liang edited comment on SPARK-21866 at 9/5/17 1:38 PM: - I would support

[jira] [Comment Edited] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153647#comment-16153647 ] Yanbo Liang edited comment on SPARK-21866 at 9/5/17 1:37 PM: - I would support

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153647#comment-16153647 ] Yanbo Liang commented on SPARK-21866: - I would support this effort generally. For Spark, to provide a

[jira] [Created] (SPARK-21924) Bug in Structured Streaming Documentation

Riccardo Corbella created SPARK-21924: - Summary: Bug in Structured Streaming Documentation Key: SPARK-21924 URL: https://issues.apache.org/jira/browse/SPARK-21924 Project: Spark Issue

[jira] [Updated] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-21888: -- Description: While running Spark on Yarn in cluster mode, currently there is no way to add any

[jira] [Updated] (SPARK-21923) Avoid call reserveUnrollMemoryForThisTask every record

[ https://issues.apache.org/jira/browse/SPARK-21923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyang Liu updated SPARK-21923: - Description: When Spark persist data to Unsafe memory, we call the method

[jira] [Commented] (SPARK-21923) Avoid call reserveUnrollMemoryForThisTask every record

[ https://issues.apache.org/jira/browse/SPARK-21923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153590#comment-16153590 ] Apache Spark commented on SPARK-21923: -- User 'ConeyLiu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21923) Avoid call reserveUnrollMemoryForThisTask every record

[ https://issues.apache.org/jira/browse/SPARK-21923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21923: Assignee: Apache Spark > Avoid call reserveUnrollMemoryForThisTask every record >

[jira] [Assigned] (SPARK-21923) Avoid call reserveUnrollMemoryForThisTask every record

[ https://issues.apache.org/jira/browse/SPARK-21923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21923: Assignee: (was: Apache Spark) > Avoid call reserveUnrollMemoryForThisTask every

[jira] [Created] (SPARK-21923) Avoid call reserveUnrollMemoryForThisTask every record

Xianyang Liu created SPARK-21923: Summary: Avoid call reserveUnrollMemoryForThisTask every record Key: SPARK-21923 URL: https://issues.apache.org/jira/browse/SPARK-21923 Project: Spark Issue

[jira] [Commented] (SPARK-21893) Put Kafka 0.8 behind a profile

[ https://issues.apache.org/jira/browse/SPARK-21893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153503#comment-16153503 ] Apache Spark commented on SPARK-21893: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21893) Put Kafka 0.8 behind a profile

[ https://issues.apache.org/jira/browse/SPARK-21893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21893: Assignee: Apache Spark > Put Kafka 0.8 behind a profile > --

[jira] [Assigned] (SPARK-21893) Put Kafka 0.8 behind a profile

[ https://issues.apache.org/jira/browse/SPARK-21893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21893: Assignee: (was: Apache Spark) > Put Kafka 0.8 behind a profile >

[jira] [Updated] (SPARK-21893) Put Kafka 0.8 behind a profile

[ https://issues.apache.org/jira/browse/SPARK-21893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21893: -- Priority: Minor (was: Major) > Put Kafka 0.8 behind a profile > -- > >

[jira] [Assigned] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21902: Assignee: Apache Spark > BlockManager.doPut will hide actually exception when exception

[jira] [Commented] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153463#comment-16153463 ] Apache Spark commented on SPARK-21902: -- User 'caneGuy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21902: Assignee: (was: Apache Spark) > BlockManager.doPut will hide actually exception when

[jira] [Updated] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21902: - Description: As logging below, actually exception will be hidden when removeBlockInternal throw an

[jira] [Assigned] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21922: Assignee: (was: Apache Spark) > When executor failed and task metrics have not send

[jira] [Commented] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153455#comment-16153455 ] Apache Spark commented on SPARK-21922: -- User 'caneGuy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21922: Assignee: Apache Spark > When executor failed and task metrics have not send to

[jira] [Assigned] (SPARK-21903) Upgrade scalastyle to 1.0.0

[ https://issues.apache.org/jira/browse/SPARK-21903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21903: Assignee: Hyukjin Kwon > Upgrade scalastyle to 1.0.0 > --- > >

[jira] [Resolved] (SPARK-21903) Upgrade scalastyle to 1.0.0

[ https://issues.apache.org/jira/browse/SPARK-21903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21903. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19116

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Description: As title described,and below is an example: !notfixed01.png|Before fixed!

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Attachment: fixed01.png fixed02.png notfixed01.png

[jira] [Updated] (SPARK-21920) DataFrame Fail To Find The Column Name

[ https://issues.apache.org/jira/browse/SPARK-21920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21920: -- Flags: (was: Important) Priority: Minor (was: Critical) Questions should go to the mailing

[jira] [Resolved] (SPARK-21920) DataFrame Fail To Find The Column Name

[ https://issues.apache.org/jira/browse/SPARK-21920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21920. --- Resolution: Invalid > DataFrame Fail To Find The Column Name >

[jira] [Commented] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153367#comment-16153367 ] Sean Owen commented on SPARK-21919: --- It does look like a problem. From R's survreg I get: {code}

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Attachment: (was: duration-notfixed.png) > When executor failed and task metrics have not send to

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Attachment: (was: duration-fixed.png) > When executor failed and task metrics have not send to

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Description: As title described,and below is an example: !duration-notfixed.png|Before fixed! We can fix

[jira] [Comment Edited] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153141#comment-16153141 ] Saisai Shao edited comment on SPARK-21917 at 9/5/17 8:36 AM: - I'm inclining

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Attachment: duration-fixed.png duration-notfixed.png > When executor failed and task

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Description: As title described,and below is an example: !duration-notfixed.png|Before fixed! was:

[jira] [Created] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

zhoukang created SPARK-21922: Summary: When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime' Key: SPARK-21922 URL:

[jira] [Assigned] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21917: Assignee: (was: Apache Spark) > Remote http(s) resources is not supported in YARN

[jira] [Commented] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153260#comment-16153260 ] Apache Spark commented on SPARK-21917: -- User 'jerryshao' has created a pull request for this issue:

  1   2   >