[jira] [Assigned] (SPARK-20748) Built-in SQL Function Support - CH[A]R

[ https://issues.apache.org/jira/browse/SPARK-20748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20748: Assignee: (was: Apache Spark) > Built-in SQL Function Support - CH[A]R >

[jira] [Assigned] (SPARK-20748) Built-in SQL Function Support - CH[A]R

[ https://issues.apache.org/jira/browse/SPARK-20748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20748: Assignee: Apache Spark > Built-in SQL Function Support - CH[A]R >

[jira] [Commented] (SPARK-20139) Spark UI reports partial success for completed stage while log shows all tasks are finished

[ https://issues.apache.org/jira/browse/SPARK-20139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014391#comment-16014391 ] Ivan Gozali commented on SPARK-20139: - Facing a similar issue with 8 [AWS

[jira] [Commented] (SPARK-20748) Built-in SQL Function Support - CH[A]R

[ https://issues.apache.org/jira/browse/SPARK-20748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014311#comment-16014311 ] Apache Spark commented on SPARK-20748: -- User 'wangyum' has created a pull request for this issue:

[jira] [Created] (SPARK-20787) PySpark can't handle datetimes before 1900

Keith Bourgoin created SPARK-20787: -- Summary: PySpark can't handle datetimes before 1900 Key: SPARK-20787 URL: https://issues.apache.org/jira/browse/SPARK-20787 Project: Spark Issue Type:

[jira] [Updated] (SPARK-20139) Spark UI reports partial success for completed stage while log shows all tasks are finished

[ https://issues.apache.org/jira/browse/SPARK-20139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Gozali updated SPARK-20139: Attachment: screenshot-2.png Spark shows success but UI doesn't show all tasks completed. > Spark

[jira] [Issue Comment Deleted] (SPARK-20139) Spark UI reports partial success for completed stage while log shows all tasks are finished

[ https://issues.apache.org/jira/browse/SPARK-20139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Gozali updated SPARK-20139: Comment: was deleted (was: Spark shows success but UI doesn't show all tasks completed.) > Spark

[jira] [Commented] (SPARK-1503) Implement Nesterov's accelerated first-order method

[ https://issues.apache.org/jira/browse/SPARK-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014394#comment-16014394 ] Joseph K. Bradley commented on SPARK-1503: -- I'm fine with us closing it since there isn't

[jira] [Commented] (SPARK-19089) Support nested arrays/seqs in Datasets

[ https://issues.apache.org/jira/browse/SPARK-19089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014536#comment-16014536 ] Michal Šenkýř commented on SPARK-19089: --- I would like to point out that SPARK-18891 introduced a

[jira] [Updated] (SPARK-20789) Spark monitoring UI - http://spark-master:8080/api/v1/applications is not responding with json msg

[ https://issues.apache.org/jira/browse/SPARK-20789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Mettu updated SPARK-20789: -- Summary: Spark monitoring UI - http://spark-master:8080/api/v1/applications is not responding with

[jira] [Commented] (SPARK-20700) InferFiltersFromConstraints stackoverflows for query (v2)

[ https://issues.apache.org/jira/browse/SPARK-20700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014458#comment-16014458 ] Apache Spark commented on SPARK-20700: -- User 'jiangxb1987' has created a pull request for this

[jira] [Assigned] (SPARK-20700) InferFiltersFromConstraints stackoverflows for query (v2)

[ https://issues.apache.org/jira/browse/SPARK-20700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20700: Assignee: Apache Spark (was: Jiang Xingbo) > InferFiltersFromConstraints stackoverflows

[jira] [Assigned] (SPARK-20700) InferFiltersFromConstraints stackoverflows for query (v2)

[ https://issues.apache.org/jira/browse/SPARK-20700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20700: Assignee: Jiang Xingbo (was: Apache Spark) > InferFiltersFromConstraints stackoverflows

[jira] [Assigned] (SPARK-20788) Fix the Executor task reaper's false alarm warning logs

[ https://issues.apache.org/jira/browse/SPARK-20788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20788: Assignee: Shixiong Zhu (was: Apache Spark) > Fix the Executor task reaper's false alarm

[jira] [Commented] (SPARK-20788) Fix the Executor task reaper's false alarm warning logs

[ https://issues.apache.org/jira/browse/SPARK-20788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014531#comment-16014531 ] Apache Spark commented on SPARK-20788: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-20788) Fix the Executor task reaper's false alarm warning logs

Shixiong Zhu created SPARK-20788: Summary: Fix the Executor task reaper's false alarm warning logs Key: SPARK-20788 URL: https://issues.apache.org/jira/browse/SPARK-20788 Project: Spark

[jira] [Commented] (SPARK-18891) Support for specific collection types

[ https://issues.apache.org/jira/browse/SPARK-18891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014529#comment-16014529 ] Michal Šenkýř commented on SPARK-18891: --- I would also like to point out that the changes already

[jira] [Comment Edited] (SPARK-17463) Serialization of accumulators in heartbeats is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014564#comment-16014564 ] Allen George edited comment on SPARK-17463 at 5/17/17 6:31 PM: --- [~zsxwing]

[jira] [Resolved] (SPARK-19555) Improve inefficient StringUtils.escapeLikeRegex() method

[ https://issues.apache.org/jira/browse/SPARK-19555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-19555. Resolution: Fixed Fix Version/s: 2.1.1 2.2.0 Fixed by SPARK-17647 in

[jira] [Commented] (SPARK-17463) Serialization of accumulators in heartbeats is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014564#comment-16014564 ] Allen George commented on SPARK-17463: -- [~zsxwing] So, we're hitting this problem on spark 2.0.2.

[jira] [Created] (SPARK-20789) Spark monitoring UI - http://spark-master:8080/api/v1/applications is not responding json message

Ram Mettu created SPARK-20789: - Summary: Spark monitoring UI - http://spark-master:8080/api/v1/applications is not responding json message Key: SPARK-20789 URL: https://issues.apache.org/jira/browse/SPARK-20789

[jira] [Created] (SPARK-20790) ALS with implicit feedback ignores negative values

David Eis created SPARK-20790: - Summary: ALS with implicit feedback ignores negative values Key: SPARK-20790 URL: https://issues.apache.org/jira/browse/SPARK-20790 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-20788) Fix the Executor task reaper's false alarm warning logs

[ https://issues.apache.org/jira/browse/SPARK-20788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20788: Assignee: Apache Spark (was: Shixiong Zhu) > Fix the Executor task reaper's false alarm

[jira] [Resolved] (SPARK-20789) Spark monitoring UI - http://spark-master:8080/api/v1/applications is not responding with json msg

[ https://issues.apache.org/jira/browse/SPARK-20789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20789. --- Resolution: Invalid Questions should go to the mailing list. > Spark monitoring UI -

[jira] [Commented] (SPARK-14584) Improve recognition of non-nullability in Dataset transformations

[ https://issues.apache.org/jira/browse/SPARK-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014728#comment-16014728 ] Josh Rosen commented on SPARK-14584: [~maropu], yep, I think we can close it. I'll mark as fixed by

[jira] [Assigned] (SPARK-20790) ALS with implicit feedback ignores negative values

[ https://issues.apache.org/jira/browse/SPARK-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20790: Assignee: Apache Spark > ALS with implicit feedback ignores negative values >

[jira] [Commented] (SPARK-14141) Let user specify datatypes of pandas dataframe in toPandas()

[ https://issues.apache.org/jira/browse/SPARK-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014944#comment-16014944 ] Bryan Cutler commented on SPARK-14141: -- Take a look at SPARK-13534 which will make a Pandas

[jira] [Commented] (SPARK-20790) ALS with implicit feedback ignores negative values

[ https://issues.apache.org/jira/browse/SPARK-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014723#comment-16014723 ] David Eis commented on SPARK-20790: --- See

[jira] [Assigned] (SPARK-20790) ALS with implicit feedback ignores negative values

[ https://issues.apache.org/jira/browse/SPARK-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20790: Assignee: (was: Apache Spark) > ALS with implicit feedback ignores negative values >

[jira] [Resolved] (SPARK-20788) Fix the Executor task reaper's false alarm warning logs

[ https://issues.apache.org/jira/browse/SPARK-20788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-20788. -- Resolution: Fixed Fix Version/s: 2.2.0 > Fix the Executor task reaper's false alarm

[jira] [Commented] (SPARK-17463) Serialization of accumulators in heartbeats is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014799#comment-16014799 ] Shixiong Zhu commented on SPARK-17463: -- [~allengeorge] it's protected by

[jira] [Commented] (SPARK-20790) ALS with implicit feedback ignores negative values

[ https://issues.apache.org/jira/browse/SPARK-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014771#comment-16014771 ] Apache Spark commented on SPARK-20790: -- User 'davideis' has created a pull request for this issue:

[jira] [Resolved] (SPARK-14584) Improve recognition of non-nullability in Dataset transformations

[ https://issues.apache.org/jira/browse/SPARK-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14584. Resolution: Fixed Fix Version/s: 2.2.0 > Improve recognition of non-nullability in Dataset

[jira] [Commented] (SPARK-20790) ALS with implicit feedback ignores negative values

[ https://issues.apache.org/jira/browse/SPARK-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014704#comment-16014704 ] Sean Owen commented on SPARK-20790: --- This needs more detail. Where is the logic problem, what's a

[jira] [Comment Edited] (SPARK-20790) ALS with implicit feedback ignores negative values

[ https://issues.apache.org/jira/browse/SPARK-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014723#comment-16014723 ] David Eis edited comment on SPARK-20790 at 5/17/17 8:41 PM: See

[jira] [Commented] (SPARK-17463) Serialization of accumulators in heartbeats is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014930#comment-16014930 ] Allen George commented on SPARK-17463: -- [~zsxwing] You're absolutely right: my apologies for the

[jira] [Resolved] (SPARK-11597) improve performance of array and map encoder

[ https://issues.apache.org/jira/browse/SPARK-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-11597. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.1.0 > improve

[jira] [Updated] (SPARK-20504) ML 2.2 QA: API: Java compatibility, docs

[ https://issues.apache.org/jira/browse/SPARK-20504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-20504: --- Attachment: (updated)signature.diff (updated)process_script2.sh

[jira] [Commented] (SPARK-11597) improve performance of array and map encoder

[ https://issues.apache.org/jira/browse/SPARK-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015065#comment-16015065 ] Wenchen Fan commented on SPARK-11597: - Actually this is already fixed by

[jira] [Commented] (SPARK-20780) Spark Kafka10 Consumer Hangs

[ https://issues.apache.org/jira/browse/SPARK-20780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015186#comment-16015186 ] David Walsh commented on SPARK-20780: - FYI [~srowen] it appears this is the underlying cause:

[jira] [Created] (SPARK-20791) Use Apache Arrow to Improve Spark createDataFrame from Pandas.DataFrame

Bryan Cutler created SPARK-20791: Summary: Use Apache Arrow to Improve Spark createDataFrame from Pandas.DataFrame Key: SPARK-20791 URL: https://issues.apache.org/jira/browse/SPARK-20791 Project:

[jira] [Updated] (SPARK-20784) Spark hangs forever after a joinWith() and cache() in YARN client mode

[ https://issues.apache.org/jira/browse/SPARK-20784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-20784: - Summary: Spark hangs forever after a joinWith() and cache() in YARN client mode (was: Spark

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015176#comment-16015176 ] Haifeng Li commented on SPARK-10925: I tried the code with spark 2.1.1, I got same error. I added

[jira] [Updated] (SPARK-10925) Exception when joining DataFrames

[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haifeng Li updated SPARK-10925: --- Attachment: TestCase.scala > Exception when joining DataFrames > - >

[jira] [Comment Edited] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015198#comment-16015198 ] Yanbo Liang edited comment on SPARK-3181 at 5/18/17 4:49 AM: - [~mlnick] Yeah,

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015198#comment-16015198 ] Yanbo Liang commented on SPARK-3181: [~mlnick] Yeah, the Breeze bug has been fixed. I marked this JIRA

[jira] [Commented] (SPARK-12139) REGEX Column Specification for Hive Queries

[ https://issues.apache.org/jira/browse/SPARK-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014984#comment-16014984 ] jane commented on SPARK-12139: -- This feature is very important. Please review. > REGEX Column Specification

[jira] [Commented] (SPARK-12139) REGEX Column Specification for Hive Queries

[ https://issues.apache.org/jira/browse/SPARK-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014982#comment-16014982 ] Apache Spark commented on SPARK-12139: -- User 'janewangfb' has created a pull request for this issue:

[jira] [Commented] (SPARK-11597) improve performance of array and map encoder

[ https://issues.apache.org/jira/browse/SPARK-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014993#comment-16014993 ] Min Shen commented on SPARK-11597: -- Is there any further update on this ticket? We have recently seen a

[jira] [Updated] (SPARK-20786) Improve ceil and floor handle the value which is not expected

[ https://issues.apache.org/jira/browse/SPARK-20786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caoxuewen updated SPARK-20786: -- Summary: Improve ceil and floor handle the value which is not expected (was: Improve ceil handle the

[jira] [Resolved] (SPARK-20505) ML, Graph 2.2 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-20505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-20505. - Resolution: Fixed Fix Version/s: 2.2.0 > ML, Graph 2.2 QA: Update user guide for new

[jira] [Closed] (SPARK-20777) Spark Streaming NullPointerException when restoring from hdfs checkpoint

[ https://issues.apache.org/jira/browse/SPARK-20777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Moorhead closed SPARK-20777. Resolution: Won't Fix Issue was multiple rdd transformations werent checkpointed from

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-3181: --- Affects Version/s: 2.2.0 Target Version/s: 2.3.0 > Add Robust Regression Algorithm with Huber

[jira] [Commented] (SPARK-20506) ML, Graph 2.2 QA: Programming guide update and migration guide

[ https://issues.apache.org/jira/browse/SPARK-20506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015215#comment-16015215 ] Yanbo Liang commented on SPARK-20506: - +1 [~mlnick] Adding section "Highlights in this release" is

[jira] [Assigned] (SPARK-20792) Support same timeout operations in mapGroupsWithState function in batch queries as in streaming queries

[ https://issues.apache.org/jira/browse/SPARK-20792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20792: Assignee: Tathagata Das (was: Apache Spark) > Support same timeout operations in

[jira] [Commented] (SPARK-20792) Support same timeout operations in mapGroupsWithState function in batch queries as in streaming queries

[ https://issues.apache.org/jira/browse/SPARK-20792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015226#comment-16015226 ] Apache Spark commented on SPARK-20792: -- User 'tdas' has created a pull request for this issue:

[jira] [Commented] (SPARK-20791) Use Apache Arrow to Improve Spark createDataFrame from Pandas.DataFrame

[ https://issues.apache.org/jira/browse/SPARK-20791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014976#comment-16014976 ] Bryan Cutler commented on SPARK-20791: -- I will work on this pending SPARK-13534 being merged. > Use

[jira] [Created] (SPARK-20792) Support same timeout operations in mapGroupsWithState function in batch queries as in streaming queries

Tathagata Das created SPARK-20792: - Summary: Support same timeout operations in mapGroupsWithState function in batch queries as in streaming queries Key: SPARK-20792 URL:

[jira] [Resolved] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13747. -- Resolution: Fixed Fix Version/s: 2.2.0 Target Version/s: 2.1.0, 2.0.2 (was:

[jira] [Assigned] (SPARK-20792) Support same timeout operations in mapGroupsWithState function in batch queries as in streaming queries

[ https://issues.apache.org/jira/browse/SPARK-20792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20792: Assignee: Apache Spark (was: Tathagata Das) > Support same timeout operations in

[jira] [Commented] (SPARK-20779) The ASF header placed in an incorrect location in some files

[ https://issues.apache.org/jira/browse/SPARK-20779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013624#comment-16013624 ] Sean Owen commented on SPARK-20779: --- You don't need a JIRA for this. There's not even a 'right' place

[jira] [Commented] (SPARK-20780) Spark Kafka10 Consumer Hangs

[ https://issues.apache.org/jira/browse/SPARK-20780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013654#comment-16013654 ] jayadeepj commented on SPARK-20780: --- Thanks for the reply. I am unable ascertain that from the Spark

[jira] [Commented] (SPARK-20778) Implement array_intersect function

[ https://issues.apache.org/jira/browse/SPARK-20778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013617#comment-16013617 ] Sean Owen commented on SPARK-20778: --- This should just be a UDF. What's the argument that it needs to be

[jira] [Commented] (SPARK-20772) Add support for query parameters in redirects on Yarn

[ https://issues.apache.org/jira/browse/SPARK-20772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013618#comment-16013618 ] Wilfred Spiegelenburg commented on SPARK-20772: --- correct, opening up a yarn issue and

[jira] [Closed] (SPARK-20772) Add support for query parameters in redirects on Yarn

[ https://issues.apache.org/jira/browse/SPARK-20772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjorn Jonsson closed SPARK-20772. - Resolution: Not A Problem > Add support for query parameters in redirects on Yarn >

[jira] [Created] (SPARK-20782) Dataset's isCached operator

Jacek Laskowski created SPARK-20782: --- Summary: Dataset's isCached operator Key: SPARK-20782 URL: https://issues.apache.org/jira/browse/SPARK-20782 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-20780) Spark Kafka10 Consumer Hangs

[ https://issues.apache.org/jira/browse/SPARK-20780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013633#comment-16013633 ] Sean Owen commented on SPARK-20780: --- This doesn't sound like a Spark problem though. You're timing out

[jira] [Commented] (SPARK-20779) The ASF header placed in an incorrect location in some files

[ https://issues.apache.org/jira/browse/SPARK-20779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013669#comment-16013669 ] zuotingbing commented on SPARK-20779: - Sorry I'm not an expert on this, but it seems conventional to

[jira] [Commented] (SPARK-20779) The ASF header placed in an incorrect location in some files

[ https://issues.apache.org/jira/browse/SPARK-20779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013680#comment-16013680 ] Sean Owen commented on SPARK-20779: --- It is conventional. It is not required for the license to have

[jira] [Commented] (SPARK-20784) Spark hangs forever

[ https://issues.apache.org/jira/browse/SPARK-20784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013784#comment-16013784 ] Mathieu D commented on SPARK-20784: --- Well, Spark is blocked, though. I had a couple of occurrences of

[jira] [Commented] (SPARK-20779) The ASF header placed in an incorrect location in some files

[ https://issues.apache.org/jira/browse/SPARK-20779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013694#comment-16013694 ] zuotingbing commented on SPARK-20779: - Ok i got it, thanks. > The ASF header placed in an incorrect

[jira] [Assigned] (SPARK-20783) Enhance ColumnVector to keep UnsafeArrayData for array

[ https://issues.apache.org/jira/browse/SPARK-20783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20783: Assignee: Apache Spark > Enhance ColumnVector to keep UnsafeArrayData for array >

[jira] [Assigned] (SPARK-20769) Incorrect documentation for using Jupyter notebook

[ https://issues.apache.org/jira/browse/SPARK-20769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20769: - Assignee: Andrew Ray > Incorrect documentation for using Jupyter notebook >

[jira] [Resolved] (SPARK-20769) Incorrect documentation for using Jupyter notebook

[ https://issues.apache.org/jira/browse/SPARK-20769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20769. --- Resolution: Fixed Fix Version/s: 2.1.2 2.2.0 Issue resolved by pull

[jira] [Created] (SPARK-20783) Enhance ColumnVector to keep UnsafeArrayData for array

Kazuaki Ishizaki created SPARK-20783: Summary: Enhance ColumnVector to keep UnsafeArrayData for array Key: SPARK-20783 URL: https://issues.apache.org/jira/browse/SPARK-20783 Project: Spark

[jira] [Comment Edited] (SPARK-20780) Spark Kafka10 Consumer Hangs

[ https://issues.apache.org/jira/browse/SPARK-20780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013654#comment-16013654 ] jayadeepj edited comment on SPARK-20780 at 5/17/17 7:41 AM: Thanks for the

[jira] [Comment Edited] (SPARK-20779) The ASF header placed in an incorrect location in some files

[ https://issues.apache.org/jira/browse/SPARK-20779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013669#comment-16013669 ] zuotingbing edited comment on SPARK-20779 at 5/17/17 8:08 AM: -- Sorry I'm not

[jira] [Assigned] (SPARK-20783) Enhance ColumnVector to keep UnsafeArrayData for array

[ https://issues.apache.org/jira/browse/SPARK-20783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20783: Assignee: (was: Apache Spark) > Enhance ColumnVector to keep UnsafeArrayData for

[jira] [Commented] (SPARK-20783) Enhance ColumnVector to keep UnsafeArrayData for array

[ https://issues.apache.org/jira/browse/SPARK-20783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013755#comment-16013755 ] Apache Spark commented on SPARK-20783: -- User 'kiszk' has created a pull request for this issue:

[jira] [Created] (SPARK-20785) Spark should provide jump links and add (count) in the SQL web ui.

guoxiaolongzte created SPARK-20785: -- Summary: Spark should provide jump links and add (count) in the SQL web ui. Key: SPARK-20785 URL: https://issues.apache.org/jira/browse/SPARK-20785 Project:

[jira] [Updated] (SPARK-20785) Spark should provide jump links and add (count) in the SQL web ui.

[ https://issues.apache.org/jira/browse/SPARK-20785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20785: --- Component/s: SQL > Spark should provide jump links and add (count) in the SQL web ui. >

[jira] [Resolved] (SPARK-20780) Spark Kafka10 Consumer Hangs

[ https://issues.apache.org/jira/browse/SPARK-20780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20780. --- Resolution: Not A Problem Maybe, maybe not. It's not yet clear what's going on, so JIRA isn't the

[jira] [Commented] (SPARK-20780) Spark Kafka10 Consumer Hangs

[ https://issues.apache.org/jira/browse/SPARK-20780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013689#comment-16013689 ] jayadeepj commented on SPARK-20780: --- Yes .. I have varied the timeout e.g 50s to 40s & the

[jira] [Created] (SPARK-20784) Spark hangs forever / potential deadlock ?

Mathieu D created SPARK-20784: - Summary: Spark hangs forever / potential deadlock ? Key: SPARK-20784 URL: https://issues.apache.org/jira/browse/SPARK-20784 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-20784) Spark hangs forever / potential deadlock ?

[ https://issues.apache.org/jira/browse/SPARK-20784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu D updated SPARK-20784: -- Description: Spark hangs and stop executing any job or task. Web UI shows 0 active task on executors.

[jira] [Updated] (SPARK-20784) Spark hangs forever

[ https://issues.apache.org/jira/browse/SPARK-20784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu D updated SPARK-20784: -- Summary: Spark hangs forever (was: Spark hangs forever / potential deadlock ?) > Spark hangs forever

[jira] [Commented] (SPARK-20784) Spark hangs forever

[ https://issues.apache.org/jira/browse/SPARK-20784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013748#comment-16013748 ] Sean Owen commented on SPARK-20784: --- There is no reproduction here or evidence of a deadlock > Spark

[jira] [Assigned] (SPARK-20737) Mechanism for cleanup hooks, for structured-streaming sinks on executor shutdown.

[ https://issues.apache.org/jira/browse/SPARK-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20737: Assignee: Apache Spark > Mechanism for cleanup hooks, for structured-streaming sinks on

[jira] [Commented] (SPARK-20737) Mechanism for cleanup hooks, for structured-streaming sinks on executor shutdown.

[ https://issues.apache.org/jira/browse/SPARK-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013770#comment-16013770 ] Apache Spark commented on SPARK-20737: -- User 'ScrapCodes' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20737) Mechanism for cleanup hooks, for structured-streaming sinks on executor shutdown.

[ https://issues.apache.org/jira/browse/SPARK-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20737: Assignee: (was: Apache Spark) > Mechanism for cleanup hooks, for structured-streaming

[jira] [Commented] (SPARK-20784) Spark hangs forever

[ https://issues.apache.org/jira/browse/SPARK-20784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013901#comment-16013901 ] Hyukjin Kwon commented on SPARK-20784: -- Could you update the JIRA title? it sounds Spark always

[jira] [Comment Edited] (SPARK-20784) Spark hangs forever

[ https://issues.apache.org/jira/browse/SPARK-20784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013901#comment-16013901 ] Hyukjin Kwon edited comment on SPARK-20784 at 5/17/17 12:05 PM: Could you

[jira] [Updated] (SPARK-20784) Spark hangs forever after a joinWith() and cache()

[ https://issues.apache.org/jira/browse/SPARK-20784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu D updated SPARK-20784: -- Summary: Spark hangs forever after a joinWith() and cache() (was: Spark hangs forever) > Spark hangs

[jira] [Commented] (SPARK-20786) Improve ceil handle the value which is not expected

[ https://issues.apache.org/jira/browse/SPARK-20786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013836#comment-16013836 ] Apache Spark commented on SPARK-20786: -- User 'heary-cao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20786) Improve ceil handle the value which is not expected

[ https://issues.apache.org/jira/browse/SPARK-20786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20786: Assignee: Apache Spark > Improve ceil handle the value which is not expected >

[jira] [Created] (SPARK-20786) Improve ceil handle the value which is not expected

caoxuewen created SPARK-20786: - Summary: Improve ceil handle the value which is not expected Key: SPARK-20786 URL: https://issues.apache.org/jira/browse/SPARK-20786 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-20786) Improve ceil handle the value which is not expected

[ https://issues.apache.org/jira/browse/SPARK-20786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20786: Assignee: (was: Apache Spark) > Improve ceil handle the value which is not expected >

[jira] [Commented] (SPARK-20784) Spark hangs forever after a joinWith() and cache()

[ https://issues.apache.org/jira/browse/SPARK-20784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013911#comment-16013911 ] Mathieu D commented on SPARK-20784: --- Changed the title. It's noted for the self reproducer, although

[jira] [Updated] (SPARK-20784) Spark hangs forever

[ https://issues.apache.org/jira/browse/SPARK-20784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu D updated SPARK-20784: -- Description: Spark hangs and stop executing any job or task. Web UI shows *0 active stages* and *0

[jira] [Commented] (SPARK-12686) Support group-by push down into data sources

[ https://issues.apache.org/jira/browse/SPARK-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013983#comment-16013983 ] Apache Spark commented on SPARK-12686: -- User 'kisimple' has created a pull request for this issue:

  1   2   >