[jira] [Updated] (SPARK-23943) Improve observability of MesosRestServer

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Summary: Improve observability of MesosRestServer (was: Add more specific health check to

[jira] [Assigned] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23916: Assignee: Apache Spark > High-order function: array_join(x, delimiter, null_replacement)

[jira] [Commented] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430808#comment-16430808 ] Apache Spark commented on SPARK-23916: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23916: Assignee: (was: Apache Spark) > High-order function: array_join(x, delimiter,

[jira] [Assigned] (SPARK-23906) Add UDF trunc(numeric)

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23906: --- Assignee: Yuming Wang > Add UDF trunc(numeric) > -- > > Key:

[jira] [Commented] (SPARK-23900) format_number udf should take user specifed format as argument

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430620#comment-16430620 ] Apache Spark commented on SPARK-23900: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23900) format_number udf should take user specifed format as argument

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23900: Assignee: (was: Apache Spark) > format_number udf should take user specifed format as

[jira] [Assigned] (SPARK-23900) format_number udf should take user specifed format as argument

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23900: Assignee: Apache Spark > format_number udf should take user specifed format as argument >

[jira] [Commented] (SPARK-23906) Add UDF trunc(numeric)

2018-04-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430632#comment-16430632 ] Yuming Wang commented on SPARK-23906: - Duplicate with SPARK-20754's {{TRUNC}}? > Add UDF

[jira] [Updated] (SPARK-23943) Improve observability of MesosRestServer/MesosClusterDispatcher

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Description: Two changes: First, a more robust

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-04-09 Thread Edwina Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430765#comment-16430765 ] Edwina Lu commented on SPARK-23206: --- [~irashid], this would be quantile values for peak executor memory

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-04-09 Thread Edwina Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430922#comment-16430922 ] Edwina Lu commented on SPARK-23206: --- The doc wasn't very clear what the quantile values were for.

[jira] [Resolved] (SPARK-23881) Flaky test: JobCancellationSuite."interruptible iterator of shuffle reader"

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23881. - Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.4.0 2.3.1 >

[jira] [Updated] (SPARK-23943) Improve observability of MesosRestServer/MesosClusterDispatcher

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Summary: Improve observability of MesosRestServer/MesosClusterDispatcher (was: Improve

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430763#comment-16430763 ] Xiao Li commented on SPARK-23206: - cc [~jiangxb1987] [~Gengliang.Wang]  > Additional Memory Tuning

[jira] [Commented] (SPARK-23906) Add UDF trunc(numeric)

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430761#comment-16430761 ] Xiao Li commented on SPARK-23906: - [~q79969786] Could you link your PR to this JIRA? > Add UDF

[jira] [Commented] (SPARK-23925) High-order function: repeat(element, count) → array

2018-04-09 Thread Florent Pepin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430771#comment-16430771 ] Florent Pepin commented on SPARK-23925: --- Hi, I am new to Spark and I am interested in taking this

[jira] [Issue Comment Deleted] (SPARK-23906) Add UDF trunc(numeric)

2018-04-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23906: Comment: was deleted (was: Duplicate with SPARK-20754's {{TRUNC}}?) > Add UDF trunc(numeric) >

[jira] [Created] (SPARK-23917) High-order function: array_max(x) → x

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23917: --- Summary: High-order function: array_max(x) → x Key: SPARK-23917 URL: https://issues.apache.org/jira/browse/SPARK-23917 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23916: Summary: High-order function: array_join(x, delimiter, null_replacement) → varchar (was: array_join(x,

[jira] [Created] (SPARK-23909) High-order function: filter(array, function<T, boolean>) → array

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23909: --- Summary: High-order function: filter(array, function) → array Key: SPARK-23909 URL: https://issues.apache.org/jira/browse/SPARK-23909 Project: Spark

[jira] [Updated] (SPARK-23908) High-order function: transform(array, function<T, U>) → array

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23908: Description: Ref: https://prestodb.io/docs/current/functions/array.html Returns an array that is the

[jira] [Commented] (SPARK-23905) Add UDF weekday

2018-04-09 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430128#comment-16430128 ] yucai commented on SPARK-23905: --- I can work on this. > Add UDF weekday > --- > >

[jira] [Created] (SPARK-23910) Publish executor memory utilisation in heartbeat events

2018-04-09 Thread Gopala (JIRA)
Gopala created SPARK-23910: -- Summary: Publish executor memory utilisation in heartbeat events Key: SPARK-23910 URL: https://issues.apache.org/jira/browse/SPARK-23910 Project: Spark Issue Type:

[jira] [Created] (SPARK-23906) Add UDF trunc(numeric)

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23906: --- Summary: Add UDF trunc(numeric) Key: SPARK-23906 URL: https://issues.apache.org/jira/browse/SPARK-23906 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-23915) High-order function: array_except(x, y) → array

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23915: Summary: High-order function: array_except(x, y) → array (was: High-order function: array_except) >

[jira] [Created] (SPARK-23914) High-order function: array_union(x, y) → array

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23914: --- Summary: High-order function: array_union(x, y) → array Key: SPARK-23914 URL: https://issues.apache.org/jira/browse/SPARK-23914 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-23915) High-order function: array_except

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23915: --- Summary: High-order function: array_except Key: SPARK-23915 URL: https://issues.apache.org/jira/browse/SPARK-23915 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-23916) array_join(x, delimiter, null_replacement) → varchar

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23916: --- Summary: array_join(x, delimiter, null_replacement) → varchar Key: SPARK-23916 URL: https://issues.apache.org/jira/browse/SPARK-23916 Project: Spark Issue Type:

[jira] [Created] (SPARK-23905) Add UDF weekday

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23905: --- Summary: Add UDF weekday Key: SPARK-23905 URL: https://issues.apache.org/jira/browse/SPARK-23905 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Created] (SPARK-23908) High-order function: transform(array, function<T, U>) → array

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23908: --- Summary: High-order function: transform(array, function) → array Key: SPARK-23908 URL: https://issues.apache.org/jira/browse/SPARK-23908 Project: Spark Issue

[jira] [Created] (SPARK-23904) Big execution plan cause OOM

2018-04-09 Thread Izek Greenfield (JIRA)
Izek Greenfield created SPARK-23904: --- Summary: Big execution plan cause OOM Key: SPARK-23904 URL: https://issues.apache.org/jira/browse/SPARK-23904 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-23907) Support regr_* functions

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23907: --- Summary: Support regr_* functions Key: SPARK-23907 URL: https://issues.apache.org/jira/browse/SPARK-23907 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-23913) High-order function: array_intersect(x, y) → array

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23913: --- Summary: High-order function: array_intersect(x, y) → array Key: SPARK-23913 URL: https://issues.apache.org/jira/browse/SPARK-23913 Project: Spark Issue Type:

[jira] [Created] (SPARK-23918) High-order function: array_min(x) → x

2018-04-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23918: --- Summary: High-order function: array_min(x) → x Key: SPARK-23918 URL: https://issues.apache.org/jira/browse/SPARK-23918 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-21005) VectorIndexerModel does not prepare output column field correctly

2018-04-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431079#comment-16431079 ] Joseph K. Bradley commented on SPARK-21005: --- I don't actually see why this is a problem: If a

[jira] [Assigned] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23890: Assignee: (was: Apache Spark) > Hive ALTER TABLE CHANGE COLUMN for struct type no

[jira] [Assigned] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23890: Assignee: Apache Spark > Hive ALTER TABLE CHANGE COLUMN for struct type no longer works >

[jira] [Commented] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431082#comment-16431082 ] Apache Spark commented on SPARK-23890: -- User 'ottomata' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431099#comment-16431099 ] Andrew Otto edited comment on SPARK-23890 at 4/9/18 7:32 PM: - Hah! As a

[jira] [Comment Edited] (SPARK-23919) High-order function: array_position(x, element) → bigint

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431004#comment-16431004 ] Kazuaki Ishizaki edited comment on SPARK-23919 at 4/9/18 6:19 PM: -- I

[jira] [Comment Edited] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431099#comment-16431099 ] Andrew Otto edited comment on SPARK-23890 at 4/9/18 7:31 PM: - Hah! As a

[jira] [Comment Edited] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431099#comment-16431099 ] Andrew Otto edited comment on SPARK-23890 at 4/9/18 7:31 PM: - Hah! As a

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

2018-04-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431100#comment-16431100 ] Maciej Bryński commented on SPARK-16996: [~ste...@apache.org] Are you prepared to lot of problems

[jira] [Comment Edited] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431099#comment-16431099 ] Andrew Otto edited comment on SPARK-23890 at 4/9/18 7:31 PM: - Hah! As a

[jira] [Commented] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431099#comment-16431099 ] Andrew Otto commented on SPARK-23890: - Hah! As a temporary workaround, we are [instantiating a JDBC

[jira] [Commented] (SPARK-23923) High-order function: cardinality(x) → bigint

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431009#comment-16431009 ] Kazuaki Ishizaki commented on SPARK-23923: -- I am working for this. > High-order function:

[jira] [Assigned] (SPARK-14681) Provide label/impurity stats for spark.ml decision tree nodes

2018-04-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-14681: - Assignee: Weichen Xu > Provide label/impurity stats for spark.ml decision tree

[jira] [Resolved] (SPARK-14681) Provide label/impurity stats for spark.ml decision tree nodes

2018-04-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14681. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20786

[jira] [Commented] (SPARK-23924) High-order function: element_at

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431002#comment-16431002 ] Kazuaki Ishizaki commented on SPARK-23924: -- I will work for this. > High-order function:

[jira] [Commented] (SPARK-23919) High-order function: array_position(x, element) → bigint

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431004#comment-16431004 ] Kazuaki Ishizaki commented on SPARK-23919: -- I am working for this. > High-order function:

[jira] [Comment Edited] (SPARK-23923) High-order function: cardinality(x) → bigint

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431009#comment-16431009 ] Kazuaki Ishizaki edited comment on SPARK-23923 at 4/9/18 6:36 PM: -- I

[jira] [Commented] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431188#comment-16431188 ] Li Jin commented on SPARK-23929: I think there are pros and cons for both matching by position and by

[jira] [Created] (SPARK-23944) Add Param set functions to LSHModel types

2018-04-09 Thread Lu Wang (JIRA)
Lu Wang created SPARK-23944: --- Summary: Add Param set functions to LSHModel types Key: SPARK-23944 URL: https://issues.apache.org/jira/browse/SPARK-23944 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431188#comment-16431188 ] Li Jin edited comment on SPARK-23929 at 4/9/18 8:39 PM: I think there are pros

[jira] [Comment Edited] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431188#comment-16431188 ] Li Jin edited comment on SPARK-23929 at 4/9/18 8:39 PM: I think there are pros

[jira] [Commented] (SPARK-22919) Bump Apache httpclient versions

2018-04-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431198#comment-16431198 ] Steve Loughran commented on SPARK-22919: going to highlight this appears to break Spark &

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431287#comment-16431287 ] Apache Spark commented on SPARK-23874: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23874: Assignee: Bryan Cutler (was: Apache Spark) > Upgrade apache/arrow to 0.9.0 >

[jira] [Assigned] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23874: Assignee: Apache Spark (was: Bryan Cutler) > Upgrade apache/arrow to 0.9.0 >

[jira] [Assigned] (SPARK-23941) Mesos task failed on specific spark app name

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23941: Assignee: Apache Spark > Mesos task failed on specific spark app name >

[jira] [Commented] (SPARK-23941) Mesos task failed on specific spark app name

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431337#comment-16431337 ] Apache Spark commented on SPARK-23941: -- User 'tiboun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23941) Mesos task failed on specific spark app name

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23941: Assignee: (was: Apache Spark) > Mesos task failed on specific spark app name >

[jira] [Created] (SPARK-23945) Column.isin() should accept a single-column DataFrame as input

2018-04-09 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-23945: Summary: Column.isin() should accept a single-column DataFrame as input Key: SPARK-23945 URL: https://issues.apache.org/jira/browse/SPARK-23945 Project:

[jira] [Assigned] (SPARK-23944) Add Param set functions to LSHModel types

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23944: Assignee: (was: Apache Spark) > Add Param set functions to LSHModel types >

[jira] [Commented] (SPARK-23944) Add Param set functions to LSHModel types

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431388#comment-16431388 ] Apache Spark commented on SPARK-23944: -- User 'ludatabricks' has created a pull request for this

[jira] [Assigned] (SPARK-23944) Add Param set functions to LSHModel types

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23944: Assignee: Apache Spark > Add Param set functions to LSHModel types >

[jira] [Created] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Christopher Hoshino-Fish (JIRA)
Christopher Hoshino-Fish created SPARK-23946: Summary: 2.3.0 and Latest ScalaDocs are linked to the wrong source code Key: SPARK-23946 URL: https://issues.apache.org/jira/browse/SPARK-23946

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

2018-04-09 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431403#comment-16431403 ] Bruce Robbins commented on SPARK-23715: --- I've been convinced this is worth fixing, at least for

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Christopher Hoshino-Fish (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Hoshino-Fish updated SPARK-23946: - Description: Currently the 2.3.0 and Latest scaladocs point towards

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23946: Shepherd: (was: Sameer Agarwal) Target Version/s: 2.3.1 > 2.3.0 and Latest ScalaDocs are

[jira] [Updated] (SPARK-23945) Column.isin() should accept a single-column DataFrame as input

2018-04-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-23945: - Description: In SQL you can filter rows based on the result of a subquery: {code:java}

[jira] [Created] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

2018-04-09 Thread Kris Mok (JIRA)
Kris Mok created SPARK-23947: Summary: Add hashUTF8String convenience method to hasher classes Key: SPARK-23947 URL: https://issues.apache.org/jira/browse/SPARK-23947 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431431#comment-16431431 ] Apache Spark commented on SPARK-23947: -- User 'rednaxelafx' has created a pull request for this

[jira] [Assigned] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23947: Assignee: Apache Spark > Add hashUTF8String convenience method to hasher classes >

[jira] [Assigned] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23947: Assignee: (was: Apache Spark) > Add hashUTF8String convenience method to hasher

[jira] [Updated] (SPARK-23944) Add Param set functions to LSHModel types

2018-04-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23944: -- Fix Version/s: (was: 2.4.0) > Add Param set functions to LSHModel types >

[jira] [Commented] (SPARK-23527) Error with spark-submit and kerberos with TLS-enabled Hadoop cluster

2018-04-09 Thread Ron Gonzalez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431514#comment-16431514 ] Ron Gonzalez commented on SPARK-23527: -- My admin team has resolved it, and now I get this same

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431555#comment-16431555 ] Yuming Wang commented on SPARK-23946: - You are right. I'm working on this. > 2.3.0 and Latest

[jira] [Updated] (SPARK-23942) PySpark's collect doesn't trigger QueryExecutionListener

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23942: - Component/s: PySpark > PySpark's collect doesn't trigger QueryExecutionListener >

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431573#comment-16431573 ] Hyukjin Kwon commented on SPARK-23946: -- Don't set the target version that's usually reserved for a

[jira] [Commented] (SPARK-23732) Broken link to scala source code in Spark Scala api Scaladoc

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431575#comment-16431575 ] Hyukjin Kwon commented on SPARK-23732: -- Let's leave SPARK-23733 resolved as a duplicate. Seems the

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23946: - Target Version/s: (was: 2.3.1) > 2.3.0 and Latest ScalaDocs are linked to the wrong source

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23946: - Fix Version/s: (was: 2.3.1) > 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431576#comment-16431576 ] Hyukjin Kwon commented on SPARK-23946: -- and fix version too which is usually set when it's actually

[jira] [Resolved] (SPARK-23733) Broken link to java source code in Spark Scala api Scaladoc

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23733. -- Resolution: Duplicate > Broken link to java source code in Spark Scala api Scaladoc >

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431578#comment-16431578 ] Hyukjin Kwon commented on SPARK-23946: -- and fix version too which is usually set when it's actually

[jira] [Resolved] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23946. -- Resolution: Duplicate Let me leave this resolved as a duplicate but please let me know if I

[jira] [Resolved] (SPARK-23737) Scala API documentation leads to nonexistent pages for sources

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23737. -- Resolution: Duplicate Please don't reopen this. It's resolved as a duplicate. > Scala API

[jira] [Commented] (SPARK-23733) Broken link to java source code in Spark Scala api Scaladoc

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431582#comment-16431582 ] Hyukjin Kwon commented on SPARK-23733: -- Let me leave this resolved as a duplicate but please let me

[jira] [Commented] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431584#comment-16431584 ] Hyukjin Kwon commented on SPARK-23929: -- I think we already use positional-based approach and

[jira] [Commented] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431585#comment-16431585 ] Hyukjin Kwon commented on SPARK-23929: -- Unless there's a strong reason for going ahead with mapping

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Christopher Hoshino-Fish (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431590#comment-16431590 ] Christopher Hoshino-Fish commented on SPARK-23946: -- [~hyukjin.kwon] thanks for the

[jira] [Commented] (SPARK-23732) Broken link to scala source code in Spark Scala api Scaladoc

2018-04-09 Thread Yogesh Tewari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431599#comment-16431599 ] Yogesh Tewari commented on SPARK-23732: --- SPARK-23732 and SPARK-23733 are similar in nature. Will

[jira] [Commented] (SPARK-23733) Broken link to java source code in Spark Scala api Scaladoc

2018-04-09 Thread Yogesh Tewari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431600#comment-16431600 ] Yogesh Tewari commented on SPARK-23733: --- SPARK-23732 and SPARK-23733 are similar in nature. Will

[jira] [Commented] (SPARK-23748) Support select from temp tables

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431609#comment-16431609 ] Apache Spark commented on SPARK-23748: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23748) Support select from temp tables

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23748: Assignee: (was: Apache Spark) > Support select from temp tables >

[jira] [Assigned] (SPARK-23748) Support select from temp tables

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23748: Assignee: Apache Spark > Support select from temp tables >

[jira] [Assigned] (SPARK-23880) table cache should be lazy and don't trigger any jobs.

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23880: Assignee: Apache Spark > table cache should be lazy and don't trigger any jobs. >

[jira] [Commented] (SPARK-23880) table cache should be lazy and don't trigger any jobs.

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431638#comment-16431638 ] Apache Spark commented on SPARK-23880: -- User 'maropu' has created a pull request for this issue:

  1   2   >