[jira] [Created] (SPARK-28168) release-build.sh for Hadoop-3.2

2019-06-25 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28168: --- Summary: release-build.sh for Hadoop-3.2 Key: SPARK-28168 URL: https://issues.apache.org/jira/browse/SPARK-28168 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-28167) Show global temporary view in database tool

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28167: Assignee: (was: Apache Spark) > Show global temporary view in database tool > ---

[jira] [Assigned] (SPARK-28167) Show global temporary view in database tool

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28167: Assignee: Apache Spark > Show global temporary view in database tool > --

[jira] [Created] (SPARK-28167) Show global temporary view in database tool

2019-06-25 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28167: --- Summary: Show global temporary view in database tool Key: SPARK-28167 URL: https://issues.apache.org/jira/browse/SPARK-28167 Project: Spark Issue Type: Improve

[jira] [Assigned] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22340: Assignee: (was: Apache Spark) > pyspark setJobGroup doesn't match java threads >

[jira] [Assigned] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22340: Assignee: Apache Spark > pyspark setJobGroup doesn't match java threads > ---

[jira] [Reopened] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2019-06-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-22340: -- > pyspark setJobGroup doesn't match java threads > --

[jira] [Updated] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2019-06-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22340: - Labels: (was: bulk-closed) > pyspark setJobGroup doesn't match java threads >

[jira] [Commented] (SPARK-28164) usage description does not match with shell scripts

2019-06-25 Thread Hanna Kan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872873#comment-16872873 ] Hanna Kan commented on SPARK-28164: --- but if you add some options such as "{{sbin/start

[jira] [Resolved] (SPARK-27656) Safely register class for GraphX

2019-06-25 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-27656. -- Resolution: Not A Problem > Safely register class for GraphX > ---

[jira] [Updated] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-06-25 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-28159: - Description: It is a long time since ML was released. However, there are still many TODOs (like

[jira] [Commented] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2019-06-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872852#comment-16872852 ] Liang-Chi Hsieh commented on SPARK-22340: - [~hyukjin.kwon] Should we reopen this

[jira] [Resolved] (SPARK-27676) InMemoryFileIndex should hard-fail on missing files instead of logging and continuing

2019-06-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27676. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24668 [https://gi

[jira] [Commented] (SPARK-27802) SparkUI throws NoSuchElementException when inconsistency appears between `ExecutorStageSummaryWrapper`s and `ExecutorSummaryWrapper`s

2019-06-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872740#comment-16872740 ] shahid commented on SPARK-27802: Could you please provide a reproducible step for the is

[jira] [Commented] (SPARK-28152) ShortType and FloatTypes are not correctly mapped to right JDBC types when using JDBC connector

2019-06-25 Thread Shiv Prashant Sood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872739#comment-16872739 ] Shiv Prashant Sood commented on SPARK-28152: Resolved as part of https://iss

[jira] [Updated] (SPARK-28151) ByteType, ShortType and FloatTypes are not correctly mapped for read/write of SQLServer tables

2019-06-25 Thread Shiv Prashant Sood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiv Prashant Sood updated SPARK-28151: --- Description: ##ByteType issue Writing dataframe with column type BYTETYPE fails when

[jira] [Updated] (SPARK-28151) ByteType, ShortType and FloatTypes are not correctly mapped for read/write of SQLServer tables

2019-06-25 Thread Shiv Prashant Sood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiv Prashant Sood updated SPARK-28151: --- Summary: ByteType, ShortType and FloatTypes are not correctly mapped for read/write

[jira] [Updated] (SPARK-28152) ShortType and FloatTypes are not correctly mapped to right JDBC types when using JDBC connector

2019-06-25 Thread Shiv Prashant Sood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiv Prashant Sood updated SPARK-28152: --- Description: ShortType and FloatTypes are not correctly mapped to right JDBC types w

[jira] [Updated] (SPARK-28166) Query optimization for symmetric difference / disjunctive union of Datasets

2019-06-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-28166: --- Description: The *symmetric difference* (a.k.a. *disjunctive union*) of two sets is their set union

[jira] [Created] (SPARK-28166) Query optimization for symmetric difference / disjunctive union of Datasets

2019-06-25 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-28166: -- Summary: Query optimization for symmetric difference / disjunctive union of Datasets Key: SPARK-28166 URL: https://issues.apache.org/jira/browse/SPARK-28166 Project: Spar

[jira] [Commented] (SPARK-25390) data source V2 API refactoring

2019-06-25 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872684#comment-16872684 ] Lars Francke commented on SPARK-25390: -- Is there any kind of end-user documentation

[jira] [Commented] (SPARK-28135) ceil/ceiling/floor/power returns incorrect values

2019-06-25 Thread Tony Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872657#comment-16872657 ] Tony Zhang commented on SPARK-28135: As commented in the PR, to fix this overflow, w

[jira] [Resolved] (SPARK-27630) Stage retry causes totalRunningTasks calculation to be negative

2019-06-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-27630. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24497 [https://gi

[jira] [Assigned] (SPARK-27630) Stage retry causes totalRunningTasks calculation to be negative

2019-06-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-27630: Assignee: dzcxzl > Stage retry causes totalRunningTasks calculation to be negative >

[jira] [Updated] (SPARK-28157) Make SHS clear KVStore LogInfo for the blacklisted entries

2019-06-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28157: -- Summary: Make SHS clear KVStore LogInfo for the blacklisted entries (was: Make SHS check Spar

[jira] [Commented] (SPARK-28151) ByteType is not correctly mapped for read/write of SQLServer tables

2019-06-25 Thread Shiv Prashant Sood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872577#comment-16872577 ] Shiv Prashant Sood commented on SPARK-28151: Fixed by [https://github.com/ap

[jira] [Assigned] (SPARK-28151) ByteType is not correctly mapped for read/write of SQLServer tables

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28151: Assignee: Apache Spark > ByteType is not correctly mapped for read/write of SQLServer tab

[jira] [Assigned] (SPARK-28151) ByteType is not correctly mapped for read/write of SQLServer tables

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28151: Assignee: (was: Apache Spark) > ByteType is not correctly mapped for read/write of SQ

[jira] [Commented] (SPARK-28164) usage description does not match with shell scripts

2019-06-25 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872556#comment-16872556 ] Shivu Sondur commented on SPARK-28164: -- [~hannankan]  ./sbin/start-slave.sh  it

[jira] [Created] (SPARK-28165) SHS does not delete old inprogress files until cleaner.maxAge after SHS start time

2019-06-25 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-28165: Summary: SHS does not delete old inprogress files until cleaner.maxAge after SHS start time Key: SPARK-28165 URL: https://issues.apache.org/jira/browse/SPARK-28165 Pr

[jira] [Commented] (SPARK-28114) Add Jenkins job for `Hadoop-3.2` profile

2019-06-25 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872530#comment-16872530 ] shane knapp commented on SPARK-28114: - [~dongjoon] the `--force` came back because s

[jira] [Resolved] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

2019-06-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27622. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24554 [https:

[jira] [Assigned] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

2019-06-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27622: -- Assignee: Attila Zsolt Piros > Avoid the network when block manager fetches disk pers

[jira] [Updated] (SPARK-28145) Executor pods polling source can fail to replace dead executors

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28145: -- Priority: Minor (was: Major) Issue Type: Improvement (was: New Feature) > Executor pods pollin

[jira] [Resolved] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26985. --- Resolution: Fixed Assignee: ketan kunde Fix Version/s: 3.0.0 Resolved by https://git

[jira] [Resolved] (SPARK-28154) GMM fix double caching

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28154. --- Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 3.0.0 2.4.

[jira] [Resolved] (SPARK-28117) LDA and BisectingKMeans cache the input dataset if necessary

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28117. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24920 [https://github.c

[jira] [Assigned] (SPARK-28117) LDA and BisectingKMeans cache the input dataset if necessary

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28117: - Assignee: zhengruifeng > LDA and BisectingKMeans cache the input dataset if necessary > ---

[jira] [Updated] (SPARK-28117) LDA and BisectingKMeans cache the input dataset if necessary

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28117: -- Priority: Minor (was: Major) > LDA and BisectingKMeans cache the input dataset if necessary > ---

[jira] [Updated] (SPARK-28045) add missing RankingEvaluator

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28045: -- Priority: Minor (was: Major) > add missing RankingEvaluator > > >

[jira] [Assigned] (SPARK-28045) add missing RankingEvaluator

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28045: - Assignee: zhengruifeng > add missing RankingEvaluator > > >

[jira] [Resolved] (SPARK-28045) add missing RankingEvaluator

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28045. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24869 [https://github.c

[jira] [Created] (SPARK-28164) usage description does not match with shell scripts

2019-06-25 Thread Hanna Kan (JIRA)
Hanna Kan created SPARK-28164: - Summary: usage description does not match with shell scripts Key: SPARK-28164 URL: https://issues.apache.org/jira/browse/SPARK-28164 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-28163) Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and FETCH_OFFSET_RETRY_INTERVAL_MS

2019-06-25 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28163: -- Description: There are "unsafe" conversions in the Kafka connector. CaseInsensitiveStringMap c

[jira] [Assigned] (SPARK-28163) Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and FETCH_OFFSET_RETRY_INTERVAL_MS

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28163: Assignee: (was: Apache Spark) > Kafka ignores user configuration on FETCH_OFFSET_NUM_

[jira] [Assigned] (SPARK-28163) Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and FETCH_OFFSET_RETRY_INTERVAL_MS

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28163: Assignee: Apache Spark > Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and

[jira] [Updated] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28157: -- Description: At Spark 2.4.0/2.3.2/2.2.3, SPARK-24948 delegated access permission checks to th

[jira] [Created] (SPARK-28163) Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and FETCH_OFFSET_RETRY_INTERVAL_MS

2019-06-25 Thread Gabor Somogyi (JIRA)
Gabor Somogyi created SPARK-28163: - Summary: Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and FETCH_OFFSET_RETRY_INTERVAL_MS Key: SPARK-28163 URL: https://issues.apache.org/jira/browse/SPARK-28163

[jira] [Assigned] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28157: Assignee: Apache Spark > Make SHS check Spark event log file permission changes > ---

[jira] [Assigned] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28157: Assignee: (was: Apache Spark) > Make SHS check Spark event log file permission change

[jira] [Created] (SPARK-28162) approximSimilarityJoin creating a bottleneck

2019-06-25 Thread Simone Iovane (JIRA)
Simone Iovane created SPARK-28162: - Summary: approximSimilarityJoin creating a bottleneck Key: SPARK-28162 URL: https://issues.apache.org/jira/browse/SPARK-28162 Project: Spark Issue Type: Bu

[jira] [Reopened] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-28157: --- > Make SHS check Spark event log file permission changes > -

[jira] [Issue Comment Deleted] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28157: -- Comment: was deleted (was: My bad. This issue is invalid.) > Make SHS check Spark event log f

[jira] [Assigned] (SPARK-27463) Support Dataframe Cogroup via Pandas UDFs

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27463: Assignee: Apache Spark > Support Dataframe Cogroup via Pandas UDFs > ---

[jira] [Assigned] (SPARK-27463) Support Dataframe Cogroup via Pandas UDFs

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27463: Assignee: (was: Apache Spark) > Support Dataframe Cogroup via Pandas UDFs >

[jira] [Assigned] (SPARK-28160) TransportClient.sendRpcSync may hang forever

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28160: Assignee: (was: Apache Spark) > TransportClient.sendRpcSync may hang forever > --

[jira] [Assigned] (SPARK-28160) TransportClient.sendRpcSync may hang forever

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28160: Assignee: Apache Spark > TransportClient.sendRpcSync may hang forever > -

[jira] [Commented] (SPARK-28091) Extend Spark metrics system with executor plugin metrics

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872216#comment-16872216 ] Steve Loughran commented on SPARK-28091: (FWIW, I really like codahale; lines up

[jira] [Commented] (SPARK-28091) Extend Spark metrics system with executor plugin metrics

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872214#comment-16872214 ] Steve Loughran commented on SPARK-28091: thanks for the links. FWIW, if you call

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Description: Trying to build spark from source based on the Dockerfile attached locally (laun

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Description: Trying to build spark from source based on the Dockerfile attached locally (laun

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Environment: {code} # Dockerfile # Pull base image. FROM ubuntu:16.04 RUN apt update --fix-mi

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Environment: {code:docker} # Dockerfile # Pull base image. FROM ubuntu:16.04 RUN apt update

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Environment: {quote}# Dockerfile # Pull base image. FROM ubuntu:16.04 RUN apt update --fix-mi

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Environment: # Dockerfile # Pull base image. FROM ubuntu:16.04 RUN apt update --fix-missing R

[jira] [Created] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
Martin Nigsch created SPARK-28161: - Summary: Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212 Key: SPARK-28161 URL: https://issues.apache.org/jira/browse/SPARK-28161 Project: Spark

[jira] [Created] (SPARK-28160) TransportClient.sendRpcSync may hang forever

2019-06-25 Thread Lantao Jin (JIRA)
Lantao Jin created SPARK-28160: -- Summary: TransportClient.sendRpcSync may hang forever Key: SPARK-28160 URL: https://issues.apache.org/jira/browse/SPARK-28160 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-28036) Built-in udf left/right has inconsistent behavior

2019-06-25 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872045#comment-16872045 ] Shivu Sondur edited comment on SPARK-28036 at 6/25/19 8:30 AM: ---

[jira] [Assigned] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28159: Assignee: (was: Apache Spark) > Make the transform natively in ml framework to avoid

[jira] [Assigned] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28159: Assignee: Apache Spark > Make the transform natively in ml framework to avoid extra conve

[jira] [Created] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-06-25 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-28159: Summary: Make the transform natively in ml framework to avoid extra conversion Key: SPARK-28159 URL: https://issues.apache.org/jira/browse/SPARK-28159 Project: Spark