[jira] [Comment Edited] (SPARK-25467) Python date/datetime objects in dataframes increment by 1 day when converted to JSON

2018-09-25 Thread Aleksandr Koriagin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626902#comment-16626902 ] Aleksandr Koriagin edited comment on SPARK-25467 at 9/25/18 11:46 AM:

[jira] [Assigned] (SPARK-25525) Do not update conf for existing SparkContext in SparkSession.getOrCreate.

2018-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25525: Assignee: Apache Spark > Do not update conf for existing SparkContext in

[jira] [Commented] (SPARK-25525) Do not update conf for existing SparkContext in SparkSession.getOrCreate.

2018-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627193#comment-16627193 ] Apache Spark commented on SPARK-25525: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25525) Do not update conf for existing SparkContext in SparkSession.getOrCreate.

2018-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25525: Assignee: (was: Apache Spark) > Do not update conf for existing SparkContext in

[jira] [Created] (SPARK-25525) Do not update conf for existing SparkContext in SparkSession.getOrCreate.

2018-09-25 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-25525: - Summary: Do not update conf for existing SparkContext in SparkSession.getOrCreate. Key: SPARK-25525 URL: https://issues.apache.org/jira/browse/SPARK-25525 Project:

[jira] [Created] (SPARK-25526) SparkSQL over REST API not JDBC

2018-09-25 Thread t oo (JIRA)
t oo created SPARK-25526: Summary: SparkSQL over REST API not JDBC Key: SPARK-25526 URL: https://issues.apache.org/jira/browse/SPARK-25526 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-23762) UTF8StringBuilder uses MemoryBlock

2018-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627173#comment-16627173 ] Apache Spark commented on SPARK-23762: -- User 'gatorsmile' has created a pull request for this

[jira] [Updated] (SPARK-25411) Implement range partition in Spark

2018-09-25 Thread Wang, Gang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang, Gang updated SPARK-25411: --- Attachment: range partition design doc.pdf > Implement range partition in Spark >

[jira] [Commented] (SPARK-25411) Implement range partition in Spark

2018-09-25 Thread Wang, Gang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627145#comment-16627145 ] Wang, Gang commented on SPARK-25411: Add a design doc, please help to review. > Implement range

[jira] [Updated] (SPARK-25524) Spark datasource for image/libsvm user guide

2018-09-25 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-25524: --- Summary: Spark datasource for image/libsvm user guide (was: Spark datasource for image/libsvm

[jira] [Updated] (SPARK-25524) Spark datasource for image/libsvm user guide

2018-09-25 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-25524: --- Description: Add Spark datasource for image/libsvm user guide. (was: Add Spark datasource for

[jira] [Created] (SPARK-25524) Spark datasource for image/libsvm document

2018-09-25 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-25524: -- Summary: Spark datasource for image/libsvm document Key: SPARK-25524 URL: https://issues.apache.org/jira/browse/SPARK-25524 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-25 Thread ABHISHEK KUMAR GUPTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA resolved SPARK-25448. -- Resolution: Fixed > [Spark Job History] Job Staged page shows 1000 Jobs only

[jira] [Commented] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-25 Thread ABHISHEK KUMAR GUPTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627101#comment-16627101 ] ABHISHEK KUMAR GUPTA commented on SPARK-25448: -- Problem with configuration. It is working.

[jira] [Commented] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask.

2018-09-25 Thread ABHISHEK KUMAR GUPTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627099#comment-16627099 ] ABHISHEK KUMAR GUPTA commented on SPARK-25504: -- [~shahid] Then it should be mention in the

[jira] [Created] (SPARK-25523) Multithreading executive sparkSession.read().jdbc(url, table, properties) problem

2018-09-25 Thread huanghuai (JIRA)
huanghuai created SPARK-25523: - Summary: Multithreading executive sparkSession.read().jdbc(url, table, properties) problem Key: SPARK-25523 URL: https://issues.apache.org/jira/browse/SPARK-25523 Project:

[jira] [Assigned] (SPARK-25522) Improve type promotion for input arguments of elementAt function

2018-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25522: Assignee: Dilip Biswal (was: Apache Spark) > Improve type promotion for input

[jira] [Commented] (SPARK-25522) Improve type promotion for input arguments of elementAt function

2018-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627031#comment-16627031 ] Apache Spark commented on SPARK-25522: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-25522) Improve type promotion for input arguments of elementAt function

2018-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25522: Assignee: Apache Spark (was: Dilip Biswal) > Improve type promotion for input

[jira] [Commented] (SPARK-25467) Python date/datetime objects in dataframes increment by 1 day when converted to JSON

2018-09-25 Thread Aleksandr Koriagin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627024#comment-16627024 ] Aleksandr Koriagin commented on SPARK-25467: Just in case this could help, seems to be that

[jira] [Updated] (SPARK-25522) Improve type promotion for input arguments of elementAt function

2018-09-25 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-25522: - Description: In ElementAt, when first argument is MapType, we should coerce the key type and

[jira] [Updated] (SPARK-25522) Improve type promotion for input arguments of elementAt function

2018-09-25 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-25522: - Description: In ElementAt, when first argument is MapType, we should coerce the key type and

[jira] [Created] (SPARK-25522) Improve type promotion for input arguments of elementAt function

2018-09-25 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-25522: Summary: Improve type promotion for input arguments of elementAt function Key: SPARK-25522 URL: https://issues.apache.org/jira/browse/SPARK-25522 Project: Spark

[jira] [Updated] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

2018-09-25 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-25206: Labels: Parquet correctness known_issue (was: Parquet correctness) > wrong records are returned

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

2018-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626926#comment-16626926 ] Apache Spark commented on SPARK-23715: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

2018-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626927#comment-16626927 ] Apache Spark commented on SPARK-23715: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-25467) Python date/datetime objects in dataframes increment by 1 day when converted to JSON

2018-09-25 Thread Aleksandr Koriagin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626902#comment-16626902 ] Aleksandr Koriagin edited comment on SPARK-25467 at 9/25/18 7:15 AM: -

[jira] [Commented] (SPARK-25467) Python date/datetime objects in dataframes increment by 1 day when converted to JSON

2018-09-25 Thread Aleksandr Koriagin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626902#comment-16626902 ] Aleksandr Koriagin commented on SPARK-25467: Can be reproduced with HDP (2.6.5.0-292) with

[jira] [Updated] (SPARK-25521) Job id showing null when insert into command Job is finished.

2018-09-25 Thread Babulal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-25521: Summary: Job id showing null when insert into command Job is finished. (was: Job id showing null when

[jira] [Comment Edited] (SPARK-25521) Job id showing null when Job is finished.

2018-09-25 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626849#comment-16626849 ] Sujith edited comment on SPARK-25521 at 9/25/18 6:39 AM: - [~Bjangir] I could see

[jira] [Updated] (SPARK-25521) Job id showing null when Job is finished.

2018-09-25 Thread Babulal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-25521: Attachment: (was: null.JPG) > Job id showing null when Job is finished. >

[jira] [Commented] (SPARK-25521) Job id showing null when Job is finished.

2018-09-25 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626849#comment-16626849 ] Sujith commented on SPARK-25521: [~Bjangir] I could see the jobcontext doesn't have jobID when the flow

[jira] [Updated] (SPARK-25521) Job id showing null when Job is finished.

2018-09-25 Thread Babulal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-25521: Attachment: null.JPG > Job id showing null when Job is finished. >

[jira] [Updated] (SPARK-25521) Job id showing null when Job is finished.

2018-09-25 Thread Babulal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-25521: Description: scala> spark.sql("create table x1(name string,age int) stored as parquet") scala>

[jira] [Updated] (SPARK-25521) Job id showing null when Job is finished.

2018-09-25 Thread Babulal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-25521: Attachment: image-2018-09-25-12-01-31-871.png > Job id showing null when Job is finished. >

[jira] [Created] (SPARK-25521) Job id showing null when Job is finished.

2018-09-25 Thread Babulal (JIRA)
Babulal created SPARK-25521: --- Summary: Job id showing null when Job is finished. Key: SPARK-25521 URL: https://issues.apache.org/jira/browse/SPARK-25521 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-25520) The state of executors is KILLED on standalone

2018-09-25 Thread AKSonic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AKSonic updated SPARK-25520: Description: I create spark standalone cluster (4 servers) by using spark 2.3.1. The job can be finished

[jira] [Commented] (SPARK-25520) The state of executors is KILLED on standalone

2018-09-25 Thread AKSonic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626831#comment-16626831 ] AKSonic commented on SPARK-25520: - You can see the snapshot in the attached Spark.zip > The state of

[jira] [Created] (SPARK-25520) The state of executors is KILLED on standalone

2018-09-25 Thread AKSonic (JIRA)
AKSonic created SPARK-25520: --- Summary: The state of executors is KILLED on standalone Key: SPARK-25520 URL: https://issues.apache.org/jira/browse/SPARK-25520 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-25520) The state of executors is KILLED on standalone

2018-09-25 Thread AKSonic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AKSonic updated SPARK-25520: Attachment: Spark.zip > The state of executors is KILLED on standalone >

<    1   2