[jira] [Assigned] (SPARK-23599) The UUID() expression is too non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23599: Assignee: Apache Spark > The UUID() expression is too non-deterministic >

[jira] [Assigned] (SPARK-23599) The UUID() expression is too non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23599: Assignee: (was: Apache Spark) > The UUID() expression is too non-deterministic >

[jira] [Commented] (SPARK-23599) The UUID() expression is too non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398121#comment-16398121 ] Apache Spark commented on SPARK-23599: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397809#comment-16397809 ] Wenchen Fan commented on SPARK-19842: - can we put the design doc to google doc so that other people

[jira] [Resolved] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23598. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 >

[jira] [Updated] (SPARK-23674) Add Spark ML Listener for Tracking ML Pipeline Status

[ https://issues.apache.org/jira/browse/SPARK-23674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Jiang updated SPARK-23674: --- Description: Currently, Spark provides status monitoring for different components of Spark, like

[jira] [Commented] (SPARK-21479) Outer join filter pushdown in null supplying table when condition is on one of the joined columns

[ https://issues.apache.org/jira/browse/SPARK-21479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397703#comment-16397703 ] Apache Spark commented on SPARK-21479: -- User 'maryannxue' has created a pull request for this issue:

[jira] [Commented] (SPARK-23674) Add Spark ML Listener for Tracking ML Pipeline Status

[ https://issues.apache.org/jira/browse/SPARK-23674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397668#comment-16397668 ] Ming Jiang commented on SPARK-23674: Hello, I will work on this and propose a pr, thanks! > Add

[jira] [Commented] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397662#comment-16397662 ] Suman Somasundar commented on SPARK-23529: -- I have a couple of use-cases for this as explained

[jira] [Created] (SPARK-23674) Add Spark ML Listener for Tracking ML Pipeline Status

Mingjie Tang created SPARK-23674: Summary: Add Spark ML Listener for Tracking ML Pipeline Status Key: SPARK-23674 URL: https://issues.apache.org/jira/browse/SPARK-23674 Project: Spark Issue

[jira] [Created] (SPARK-23673) PySpark dayofweek does not conform with ISO 8601

Ivan SPM created SPARK-23673: Summary: PySpark dayofweek does not conform with ISO 8601 Key: SPARK-23673 URL: https://issues.apache.org/jira/browse/SPARK-23673 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-23672) Support returning lists in Arrow UDFs

holdenk created SPARK-23672: --- Summary: Support returning lists in Arrow UDFs Key: SPARK-23672 URL: https://issues.apache.org/jira/browse/SPARK-23672 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-23547) Cleanup the .pipeout file when the Hive Session closed

[ https://issues.apache.org/jira/browse/SPARK-23547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23547. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20702

[jira] [Assigned] (SPARK-23547) Cleanup the .pipeout file when the Hive Session closed

[ https://issues.apache.org/jira/browse/SPARK-23547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-23547: --- Assignee: zuotingbing > Cleanup the .pipeout file when the Hive Session closed >

[jira] [Commented] (SPARK-23200) Reset configuration when restarting from checkpoints

[ https://issues.apache.org/jira/browse/SPARK-23200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397432#comment-16397432 ] Anirudh Ramanathan commented on SPARK-23200: Looks like the change was reverted.

[jira] [Assigned] (SPARK-23658) InProcessAppHandle uses the wrong class in getLogger

[ https://issues.apache.org/jira/browse/SPARK-23658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23658: Assignee: Apache Spark > InProcessAppHandle uses the wrong class in getLogger >

[jira] [Assigned] (SPARK-23658) InProcessAppHandle uses the wrong class in getLogger

[ https://issues.apache.org/jira/browse/SPARK-23658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23658: Assignee: (was: Apache Spark) > InProcessAppHandle uses the wrong class in getLogger

[jira] [Commented] (SPARK-23658) InProcessAppHandle uses the wrong class in getLogger

[ https://issues.apache.org/jira/browse/SPARK-23658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397427#comment-16397427 ] Apache Spark commented on SPARK-23658: -- User 'sahilTakiar' has created a pull request for this

[jira] [Resolved] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan resolved SPARK-18278. Resolution: Fixed Closing this. Sub-issues have been created for remaining items

[jira] [Updated] (SPARK-22865) Publish Official Apache Spark Docker images

[ https://issues.apache.org/jira/browse/SPARK-22865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22865: --- Issue Type: New Feature (was: Sub-task) Parent: (was: SPARK-18278) >

[jira] [Updated] (SPARK-23067) Allow for easier debugging of the docker container

[ https://issues.apache.org/jira/browse/SPARK-23067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-23067: --- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-18278) > Allow for

[jira] [Updated] (SPARK-23010) Add integration testing for Kubernetes backend into the apache/spark repository

[ https://issues.apache.org/jira/browse/SPARK-23010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-23010: --- Issue Type: New Feature (was: Sub-task) Parent: (was: SPARK-18278) >

[jira] [Resolved] (SPARK-23324) Announce new Kubernetes back-end for 2.3 release notes

[ https://issues.apache.org/jira/browse/SPARK-23324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan resolved SPARK-23324. Resolution: Fixed > Announce new Kubernetes back-end for 2.3 release notes >

[jira] [Assigned] (SPARK-23324) Announce new Kubernetes back-end for 2.3 release notes

[ https://issues.apache.org/jira/browse/SPARK-23324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan reassigned SPARK-23324: -- Assignee: Erik Erlandson > Announce new Kubernetes back-end for 2.3 release

[jira] [Commented] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397421#comment-16397421 ] Anirudh Ramanathan commented on SPARK-23529: Can this wait till we have local PVs? Mounting

[jira] [Commented] (SPARK-23618) docker-image-tool.sh Fails While Building Image

[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397417#comment-16397417 ] Anirudh Ramanathan commented on SPARK-23618: Thanks Felix. The mechanism appears to work, but

[jira] [Assigned] (SPARK-23618) docker-image-tool.sh Fails While Building Image

[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan reassigned SPARK-23618: -- Assignee: (was: Anirudh Ramanathan) > docker-image-tool.sh Fails While

[jira] [Assigned] (SPARK-23618) docker-image-tool.sh Fails While Building Image

[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan reassigned SPARK-23618: -- Assignee: Anirudh Ramanathan > docker-image-tool.sh Fails While Building

[jira] [Assigned] (SPARK-23136) Mark packages as experimental

[ https://issues.apache.org/jira/browse/SPARK-23136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan reassigned SPARK-23136: -- Assignee: Anirudh Ramanathan > Mark packages as experimental >

[jira] [Assigned] (SPARK-23016) Spark UI access and documentation

[ https://issues.apache.org/jira/browse/SPARK-23016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan reassigned SPARK-23016: -- Assignee: Anirudh Ramanathan > Spark UI access and documentation >

[jira] [Assigned] (SPARK-22758) New Spark Jira component for Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-22758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan reassigned SPARK-22758: -- Assignee: Marcelo Vanzin > New Spark Jira component for Kubernetes >

[jira] [Assigned] (SPARK-22647) Docker files for image creation

[ https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan reassigned SPARK-22647: -- Assignee: Yinan Li > Docker files for image creation >

[jira] [Assigned] (SPARK-22645) Add Scheduler Backend with static allocation of executors

[ https://issues.apache.org/jira/browse/SPARK-22645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan reassigned SPARK-22645: -- Assignee: Anirudh Ramanathan > Add Scheduler Backend with static allocation

[jira] [Commented] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397403#comment-16397403 ] Anirudh Ramanathan commented on SPARK-18278: I think we should close this JIRA out and move

[jira] [Assigned] (SPARK-23083) Adding Kubernetes as an option to https://spark.apache.org/

[ https://issues.apache.org/jira/browse/SPARK-23083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan reassigned SPARK-23083: -- Assignee: Anirudh Ramanathan > Adding Kubernetes as an option to

[jira] [Assigned] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan reassigned SPARK-18278: -- Assignee: Anirudh Ramanathan > SPIP: Support native submission of spark jobs

[jira] [Assigned] (SPARK-23671) SHS is ignoring number of replay threads

[ https://issues.apache.org/jira/browse/SPARK-23671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23671: Assignee: (was: Apache Spark) > SHS is ignoring number of replay threads >

[jira] [Assigned] (SPARK-23671) SHS is ignoring number of replay threads

[ https://issues.apache.org/jira/browse/SPARK-23671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23671: Assignee: Apache Spark > SHS is ignoring number of replay threads >

[jira] [Commented] (SPARK-23671) SHS is ignoring number of replay threads

[ https://issues.apache.org/jira/browse/SPARK-23671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397398#comment-16397398 ] Apache Spark commented on SPARK-23671: -- User 'vanzin' has created a pull request for this issue:

[jira] [Created] (SPARK-23671) SHS is ignoring number of replay threads

Marcelo Vanzin created SPARK-23671: -- Summary: SHS is ignoring number of replay threads Key: SPARK-23671 URL: https://issues.apache.org/jira/browse/SPARK-23671 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-23642) isZero scaladoc for LongAccumulator describes wrong method

[ https://issues.apache.org/jira/browse/SPARK-23642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23642: Assignee: Apache Spark > isZero scaladoc for LongAccumulator describes wrong method >

[jira] [Assigned] (SPARK-23642) isZero scaladoc for LongAccumulator describes wrong method

[ https://issues.apache.org/jira/browse/SPARK-23642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23642: Assignee: (was: Apache Spark) > isZero scaladoc for LongAccumulator describes wrong

[jira] [Commented] (SPARK-23642) isZero scaladoc for LongAccumulator describes wrong method

[ https://issues.apache.org/jira/browse/SPARK-23642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397349#comment-16397349 ] Apache Spark commented on SPARK-23642: -- User 'smallory' has created a pull request for this issue:

[jira] [Commented] (SPARK-23632) sparkR.session() error with spark packages - JVM is not ready after 10 seconds

[ https://issues.apache.org/jira/browse/SPARK-23632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397213#comment-16397213 ] Felix Cheung commented on SPARK-23632: -- could you explain how you think these environment variables

[jira] [Commented] (SPARK-23618) docker-image-tool.sh Fails While Building Image

[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397211#comment-16397211 ] Felix Cheung commented on SPARK-23618: -- [~foxish] - Jira has a different user role system, I've

[jira] [Assigned] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23670: Assignee: Apache Spark > Memory leak of SparkPlanGraphWrapper in sparkUI >

[jira] [Assigned] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23670: Assignee: (was: Apache Spark) > Memory leak of SparkPlanGraphWrapper in sparkUI >

[jira] [Commented] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397104#comment-16397104 ] Apache Spark commented on SPARK-23670: -- User 'myroslavlisniak' has created a pull request for this

[jira] [Assigned] (SPARK-23669) Executors fetch jars and name the jars with md5 prefix

[ https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23669: Assignee: (was: Apache Spark) > Executors fetch jars and name the jars with md5

[jira] [Assigned] (SPARK-23669) Executors fetch jars and name the jars with md5 prefix

[ https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23669: Assignee: Apache Spark > Executors fetch jars and name the jars with md5 prefix >

[jira] [Commented] (SPARK-23669) Executors fetch jars and name the jars with md5 prefix

[ https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397052#comment-16397052 ] Apache Spark commented on SPARK-23669: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Updated] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Myroslav Lisniak updated SPARK-23670: - Attachment: heap.png > Memory leak of SparkPlanGraphWrapper in sparkUI >

[jira] [Created] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

Myroslav Lisniak created SPARK-23670: Summary: Memory leak of SparkPlanGraphWrapper in sparkUI Key: SPARK-23670 URL: https://issues.apache.org/jira/browse/SPARK-23670 Project: Spark

[jira] [Updated] (SPARK-23669) Executors fetch jars and name the jars with md5 prefix

[ https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing updated SPARK-23669: - Description: In our cluster, there are lots of UDF jars, some of them have the same filename but

[jira] [Updated] (SPARK-23669) Executors fetch jars and name the jars with md5 prefix

[ https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing updated SPARK-23669: - Description: In our cluster, there are lots of UDF jars, some of them have the same filename but

[jira] [Created] (SPARK-23669) Executors fetch jars and name the jars with md5 prefix

jin xing created SPARK-23669: Summary: Executors fetch jars and name the jars with md5 prefix Key: SPARK-23669 URL: https://issues.apache.org/jira/browse/SPARK-23669 Project: Spark Issue Type:

[jira] [Updated] (SPARK-23669) Executors fetch jars and name the jars with md5 prefix

[ https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing updated SPARK-23669: - Description: In our cluster, there are lots of UDF jars, some of them have the same filename but

[jira] [Updated] (SPARK-23669) Executors fetch jars and name the jars with md5 prefix

[ https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing updated SPARK-23669: - Environment: (was: In our cluster, there are lots of UDF jars, some of them have the same filename

[jira] [Resolved] (SPARK-23656) Assertion in XXH64Suite.testKnownByteArrayInputs() is not performed on big endian platform

[ https://issues.apache.org/jira/browse/SPARK-23656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23656. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 >

[jira] [Commented] (SPARK-23668) Support for imagePullSecrets k8s option

[ https://issues.apache.org/jira/browse/SPARK-23668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396998#comment-16396998 ] Apache Spark commented on SPARK-23668: -- User 'andrusha' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23668) Support for imagePullSecrets k8s option

[ https://issues.apache.org/jira/browse/SPARK-23668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23668: Assignee: (was: Apache Spark) > Support for imagePullSecrets k8s option >

[jira] [Assigned] (SPARK-23668) Support for imagePullSecrets k8s option

[ https://issues.apache.org/jira/browse/SPARK-23668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23668: Assignee: Apache Spark > Support for imagePullSecrets k8s option >

[jira] [Created] (SPARK-23668) Support for imagePullSecrets k8s option

Andrew Korzhuev created SPARK-23668: --- Summary: Support for imagePullSecrets k8s option Key: SPARK-23668 URL: https://issues.apache.org/jira/browse/SPARK-23668 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22674) PySpark breaks serialization of namedtuple subclasses

[ https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396948#comment-16396948 ] Sergei Lebedev commented on SPARK-22674: Just out of curiosity: what is the original motivation

[jira] [Commented] (SPARK-20114) spark.ml parity for sequential pattern mining - PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396926#comment-16396926 ] Apache Spark commented on SPARK-20114: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-20114) spark.ml parity for sequential pattern mining - PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20114: Assignee: (was: Apache Spark) > spark.ml parity for sequential pattern mining -

[jira] [Assigned] (SPARK-20114) spark.ml parity for sequential pattern mining - PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20114: Assignee: Apache Spark > spark.ml parity for sequential pattern mining - PrefixSpan >

[jira] [Comment Edited] (SPARK-23650) Slow SparkR udf (dapply)

[ https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396834#comment-16396834 ] Deepansh edited comment on SPARK-23650 at 3/13/18 11:37 AM: I tried on local

[jira] [Updated] (SPARK-23650) Slow SparkR udf (dapply)

[ https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepansh updated SPARK-23650: - Attachment: sparkRlag.txt > Slow SparkR udf (dapply) > > > Key:

[jira] [Commented] (SPARK-23667) Scala version check will fail due to launcher directory doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-23667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396842#comment-16396842 ] Apache Spark commented on SPARK-23667: -- User 'gczsjdy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23667) Scala version check will fail due to launcher directory doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-23667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23667: Assignee: (was: Apache Spark) > Scala version check will fail due to launcher

[jira] [Assigned] (SPARK-23667) Scala version check will fail due to launcher directory doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-23667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23667: Assignee: Apache Spark > Scala version check will fail due to launcher directory doesn't

[jira] [Created] (SPARK-23667) Scala version check will fail due to launcher directory doesn't exist

Chenzhao Guo created SPARK-23667: Summary: Scala version check will fail due to launcher directory doesn't exist Key: SPARK-23667 URL: https://issues.apache.org/jira/browse/SPARK-23667 Project: Spark

[jira] [Comment Edited] (SPARK-23650) Slow SparkR udf (dapply)

[ https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396834#comment-16396834 ] Deepansh edited comment on SPARK-23650 at 3/13/18 11:25 AM: I tried on local

[jira] [Commented] (SPARK-23650) Slow SparkR udf (dapply)

[ https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396834#comment-16396834 ] Deepansh commented on SPARK-23650: -- I tried on local as well as yarn cluster, the result is more or less

[jira] [Commented] (SPARK-23666) Undeterministic column name with UDFs

[ https://issues.apache.org/jira/browse/SPARK-23666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396832#comment-16396832 ] Daniel Darabos commented on SPARK-23666: I've looked at the code and both {{ScalaUDF.scala}} and

[jira] [Created] (SPARK-23666) Undeterministic column name with UDFs

Daniel Darabos created SPARK-23666: -- Summary: Undeterministic column name with UDFs Key: SPARK-23666 URL: https://issues.apache.org/jira/browse/SPARK-23666 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-23665) Add adaptive algorithm to select query result collect method

zhoukang created SPARK-23665: Summary: Add adaptive algorithm to select query result collect method Key: SPARK-23665 URL: https://issues.apache.org/jira/browse/SPARK-23665 Project: Spark Issue

[jira] [Created] (SPARK-23664) Add interface to collect query result through file iterator

zhoukang created SPARK-23664: Summary: Add interface to collect query result through file iterator Key: SPARK-23664 URL: https://issues.apache.org/jira/browse/SPARK-23664 Project: Spark Issue

[jira] [Commented] (SPARK-23632) sparkR.session() error with spark packages - JVM is not ready after 10 seconds

[ https://issues.apache.org/jira/browse/SPARK-23632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396706#comment-16396706 ] Jaehyeon Kim commented on SPARK-23632: -- Spark packages are downloaded asynchronously and that is why

[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems

[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396683#comment-16396683 ] Jurgen Parker commented on SPARK-4820: -- I suggest you to use Long Path Tool. It relay helped me solve

[jira] [Commented] (SPARK-22371) dag-scheduler-event-loop thread stopped with error Attempted to access garbage collected accumulator 5605982

[ https://issues.apache.org/jira/browse/SPARK-22371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396640#comment-16396640 ] Mayank Agarwal commented on SPARK-22371: Hi, Any update on the above issue  >

[jira] [Created] (SPARK-23663) Spark Streaming Kafka 010 , fails with "java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access"

kaushik srinivas created SPARK-23663: Summary: Spark Streaming Kafka 010 , fails with "java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access" Key: SPARK-23663 URL:

[jira] [Commented] (SPARK-23650) Slow SparkR udf (dapply)

[ https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396607#comment-16396607 ] Felix Cheung commented on SPARK-23650: -- which system/platform are you running on? > Slow SparkR udf

[jira] [Commented] (SPARK-23632) sparkR.session() error with spark packages - JVM is not ready after 10 seconds

[ https://issues.apache.org/jira/browse/SPARK-23632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396606#comment-16396606 ] Felix Cheung commented on SPARK-23632: -- well, if download of packages is taking that long, then