[jira] [Commented] (SPARK-28450) When scan hive data of a not existed partition, it return an error

2019-07-22 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890713#comment-16890713 ] angerszhu commented on SPARK-28450: --- [~shivuson...@gmail.com] Just select a partition

[jira] [Commented] (SPARK-28450) When scan hive data of a not existed partition, it return an error

2019-07-22 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890710#comment-16890710 ] Shivu Sondur commented on SPARK-28450: -- [~angerszhuuu] i want to check this issue.

[jira] [Commented] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result

2019-07-22 Thread Ivan Tsukanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890694#comment-16890694 ] Ivan Tsukanov commented on SPARK-28480: --- ok, let's close the ticket. [~shivuson...

[jira] [Updated] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result

2019-07-22 Thread Ivan Tsukanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Tsukanov updated SPARK-28480: -- Fix Version/s: 2.4.3 > Types of input parameters of a UDF affect the ability to cache the resu

[jira] [Commented] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result

2019-07-22 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890685#comment-16890685 ] Shivu Sondur commented on SPARK-28480: -- [~itsukanov] In the latest master branch i

[jira] [Updated] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result

2019-07-22 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivu Sondur updated SPARK-28480: - Attachment: image-2019-07-23-10-58-45-768.png > Types of input parameters of a UDF affect the ab

[jira] [Commented] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result

2019-07-22 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890674#comment-16890674 ] Shivu Sondur commented on SPARK-28480: -- i am checking this issue > Types of input

[jira] [Updated] (SPARK-27282) Spark incorrect results when using UNION with GROUP BY clause

2019-07-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-27282: --- Labels: correctness (was: ) > Spark incorrect results when using UNION with GROUP BY clause > -

[jira] [Commented] (SPARK-24079) Update the nullability of Join output based on inferred predicates

2019-07-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890672#comment-16890672 ] Josh Rosen commented on SPARK-24079: Update: I just realized that SPARK-27915 is act

[jira] [Updated] (SPARK-28481) More expressions should extend NullIntolerant

2019-07-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-28481: --- Description: SPARK-13995 introduced the {{NullIntolerant}} trait to generalize the logic for inferr

[jira] [Updated] (SPARK-28481) More expressions should extend NullIntolerant

2019-07-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-28481: --- Description: SPARK-13995 introduced the {{NullIntolerant}} trait to generalize the logic for inferr

[jira] [Updated] (SPARK-28481) More expressions should extend NullIntolerant

2019-07-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-28481: --- Description: SPARK-13995 introduced the {{NullIntolerant}} trait to generalize the logic for inferr

[jira] [Created] (SPARK-28481) More expressions should extend NullIntolerant

2019-07-22 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-28481: -- Summary: More expressions should extend NullIntolerant Key: SPARK-28481 URL: https://issues.apache.org/jira/browse/SPARK-28481 Project: Spark Issue Type: Improve

[jira] [Resolved] (SPARK-28469) Change CalendarIntervalType's readable string representation from calendarinterval to interval

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28469. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is resolve

[jira] [Commented] (SPARK-28451) substr returns different values

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890652#comment-16890652 ] Dongjoon Hyun commented on SPARK-28451: --- Thank you for the explanation, [~maropu].

[jira] [Created] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result

2019-07-22 Thread Ivan Tsukanov (JIRA)
Ivan Tsukanov created SPARK-28480: - Summary: Types of input parameters of a UDF affect the ability to cache the result Key: SPARK-28480 URL: https://issues.apache.org/jira/browse/SPARK-28480 Project:

[jira] [Updated] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result

2019-07-22 Thread Ivan Tsukanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Tsukanov updated SPARK-28480: -- Description: When I define a parameter in a UDF as Boolean or Int the result DataFrame can't

[jira] [Created] (SPARK-28479) Parser error when enabling ANSI mode

2019-07-22 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28479: --- Summary: Parser error when enabling ANSI mode Key: SPARK-28479 URL: https://issues.apache.org/jira/browse/SPARK-28479 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-25349) Support sample pushdown in Data Source V2

2019-07-22 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890623#comment-16890623 ] Weichen Xu commented on SPARK-25349: I will work on this. Thanks! > Support sample

[jira] [Created] (SPARK-28478) Optimizer rule to remove unnecessary explicit null checks for null-intolerant expressions (e.g. if(x is null, x, f(x)))

2019-07-22 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-28478: -- Summary: Optimizer rule to remove unnecessary explicit null checks for null-intolerant expressions (e.g. if(x is null, x, f(x))) Key: SPARK-28478 URL: https://issues.apache.org/jira/b

[jira] [Created] (SPARK-28477) Rewrite `CASE WHEN cond THEN ifTrue OTHERWISE ifFalse` END into `IF(cond, ifTrue, ifFalse`

2019-07-22 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-28477: -- Summary: Rewrite `CASE WHEN cond THEN ifTrue OTHERWISE ifFalse` END into `IF(cond, ifTrue, ifFalse` Key: SPARK-28477 URL: https://issues.apache.org/jira/browse/SPARK-28477

[jira] [Updated] (SPARK-28477) Rewrite `CASE WHEN cond THEN ifTrue OTHERWISE ifFalse` END into `IF(cond, ifTrue, ifFalse)`

2019-07-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-28477: --- Summary: Rewrite `CASE WHEN cond THEN ifTrue OTHERWISE ifFalse` END into `IF(cond, ifTrue, ifFalse)`

[jira] [Resolved] (SPARK-28431) CSV datasource throw com.univocity.parsers.common.TextParsingException with large size message

2019-07-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28431. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25184 [https://gi

[jira] [Assigned] (SPARK-28431) CSV datasource throw com.univocity.parsers.common.TextParsingException with large size message

2019-07-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28431: Assignee: Weichen Xu > CSV datasource throw com.univocity.parsers.common.TextParsingExcep

[jira] [Commented] (SPARK-28085) Spark Scala API documentation URLs not working properly in Chrome

2019-07-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890564#comment-16890564 ] Hyukjin Kwon commented on SPARK-28085: -- My Chrome is 75 and I am seeing this issue

[jira] [Commented] (SPARK-28451) substr returns different values

2019-07-22 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890558#comment-16890558 ] Takeshi Yamamuro commented on SPARK-28451: -- I don't have any standard reference

[jira] [Commented] (SPARK-28451) substr returns different values

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890552#comment-16890552 ] Dongjoon Hyun commented on SPARK-28451: --- We already have `ansi` mode and default(n

[jira] [Commented] (SPARK-28474) Lower JDBC client cannot read binary type

2019-07-22 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890549#comment-16890549 ] Yuming Wang commented on SPARK-28474: - I'm working on. > Lower JDBC client cannot r

[jira] [Resolved] (SPARK-28432) Date/Time Functions: make_date

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28432. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25210 [https://

[jira] [Updated] (SPARK-28432) Add `make_date` function

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28432: -- Summary: Add `make_date` function (was: Date/Time Functions: make_date) > Add `make_date` fun

[jira] [Assigned] (SPARK-28432) Date/Time Functions: make_date

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28432: - Assignee: Maxim Gekk > Date/Time Functions: make_date > --

[jira] [Updated] (SPARK-28469) Change CalendarIntervalType's readable string representation from calendarinterval to interval

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28469: -- Summary: Change CalendarIntervalType's readable string representation from calendarinterval to

[jira] [Assigned] (SPARK-28455) Executor may be timed out too soon because of overflow in tracking code

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28455: - Assignee: Marcelo Vanzin > Executor may be timed out too soon because of overflow in tr

[jira] [Resolved] (SPARK-28455) Executor may be timed out too soon because of overflow in tracking code

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28455. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25208 [https://

[jira] [Updated] (SPARK-28476) Support ALTER DATABASE SET LOCATION

2019-07-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28476: Target Version/s: 3.0.0 > Support ALTER DATABASE SET LOCATION > --- > >

[jira] [Created] (SPARK-28476) Support ALTER DATABASE SET LOCATION

2019-07-22 Thread Xiao Li (JIRA)
Xiao Li created SPARK-28476: --- Summary: Support ALTER DATABASE SET LOCATION Key: SPARK-28476 URL: https://issues.apache.org/jira/browse/SPARK-28476 Project: Spark Issue Type: Improvement C

[jira] [Resolved] (SPARK-28468) `do-release-docker.sh` fails at `sphinx` installation to `Python 2.7`

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28468. --- Resolution: Fixed Fix Version/s: 2.4.4 This is resolved via https://github.com/apache

[jira] [Updated] (SPARK-28468) Upgrade pip to fix `sphinx` install error

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28468: -- Summary: Upgrade pip to fix `sphinx` install error (was: `do-release-docker.sh` fails at `sph

[jira] [Created] (SPARK-28475) Add regex MetricFilter to GraphiteSink

2019-07-22 Thread Nick Karpov (JIRA)
Nick Karpov created SPARK-28475: --- Summary: Add regex MetricFilter to GraphiteSink Key: SPARK-28475 URL: https://issues.apache.org/jira/browse/SPARK-28475 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28085) Spark Scala API documentation URLs not working properly in Chrome

2019-07-22 Thread Andrew Leverentz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890314#comment-16890314 ] Andrew Leverentz commented on SPARK-28085: -- This issue still remains, more than

[jira] [Resolved] (SPARK-28225) Unexpected behavior for Window functions

2019-07-22 Thread Andrew Leverentz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Leverentz resolved SPARK-28225. -- Resolution: Not A Problem > Unexpected behavior for Window functions > ---

[jira] [Commented] (SPARK-28225) Unexpected behavior for Window functions

2019-07-22 Thread Andrew Leverentz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890310#comment-16890310 ] Andrew Leverentz commented on SPARK-28225: -- Marco, thanks for the explanation. 

[jira] [Comment Edited] (SPARK-28225) Unexpected behavior for Window functions

2019-07-22 Thread Andrew Leverentz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890310#comment-16890310 ] Andrew Leverentz edited comment on SPARK-28225 at 7/22/19 4:54 PM: ---

[jira] [Updated] (SPARK-28474) Lower JDBC client cannot read binary type

2019-07-22 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28474: Summary: Lower JDBC client cannot read binary type (was: Lower JDBC client version cannot read bi

[jira] [Commented] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890281#comment-16890281 ] Xiao Li commented on SPARK-28457: - [~shaneknapp] Thanks for fixing it!  > curl: (60) SS

[jira] [Assigned] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp reassigned SPARK-28457: --- Assignee: shane knapp > curl: (60) SSL certificate problem: unable to get local issuer cert

[jira] [Resolved] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp resolved SPARK-28457. - Resolution: Fixed > curl: (60) SSL certificate problem: unable to get local issuer certificate

[jira] [Commented] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890279#comment-16890279 ] shane knapp commented on SPARK-28457: - ok, the error i'm seeing in the lint job is m

[jira] [Commented] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890275#comment-16890275 ] shane knapp commented on SPARK-28457: - ok, curl was unhappy w/the old the cacert.pem

[jira] [Updated] (SPARK-28474) Lower JDBC client version cannot read binary type

2019-07-22 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28474: Summary: Lower JDBC client version cannot read binary type (was: Hive 0.12's JDBC client cannot r

[jira] [Commented] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890255#comment-16890255 ] shane knapp commented on SPARK-28457: - looking in to it now. > curl: (60) SSL certi

[jira] [Created] (SPARK-28474) Hive 0.12's JDBC client cannot read binary type

2019-07-22 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28474: --- Summary: Hive 0.12's JDBC client cannot read binary type Key: SPARK-28474 URL: https://issues.apache.org/jira/browse/SPARK-28474 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-28473) Build command in README should start with ./

2019-07-22 Thread Douglas Colkitt (JIRA)
Douglas Colkitt created SPARK-28473: --- Summary: Build command in README should start with ./ Key: SPARK-28473 URL: https://issues.apache.org/jira/browse/SPARK-28473 Project: Spark Issue Type

[jira] [Resolved] (SPARK-28280) Convert and port 'group-by.sql' into UDF test base

2019-07-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28280. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25098 [https://gi

[jira] [Assigned] (SPARK-28280) Convert and port 'group-by.sql' into UDF test base

2019-07-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28280: Assignee: Stavros Kontopoulos > Convert and port 'group-by.sql' into UDF test base >

[jira] [Comment Edited] (SPARK-28451) substr returns different values

2019-07-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890099#comment-16890099 ] Hyukjin Kwon edited comment on SPARK-28451 at 7/22/19 11:32 AM: --

[jira] [Commented] (SPARK-28451) substr returns different values

2019-07-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890099#comment-16890099 ] Hyukjin Kwon commented on SPARK-28451: -- Personally I don't think it'w worth but let

[jira] [Commented] (SPARK-28451) substr returns different values

2019-07-22 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890084#comment-16890084 ] Shivu Sondur commented on SPARK-28451: -- [~hyukjin.kwon], [~dongjoon] Here one more

[jira] [Commented] (SPARK-22213) Spark to detect slow executors on nodes with problematic hardware

2019-07-22 Thread Yuri Ronin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890081#comment-16890081 ] Yuri Ronin commented on SPARK-22213: [~hyukjin.kwon] thanks > Spark to detect slow

[jira] [Created] (SPARK-28472) Add a test for testing different protocol versions

2019-07-22 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28472: --- Summary: Add a test for testing different protocol versions Key: SPARK-28472 URL: https://issues.apache.org/jira/browse/SPARK-28472 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22213) Spark to detect slow executors on nodes with problematic hardware

2019-07-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890079#comment-16890079 ] Hyukjin Kwon commented on SPARK-22213: -- It was closed because affected version indi

[jira] [Commented] (SPARK-22213) Spark to detect slow executors on nodes with problematic hardware

2019-07-22 Thread Yuri Ronin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890048#comment-16890048 ] Yuri Ronin commented on SPARK-22213: [~hyukjin.kwon], why did you close it? Is it re

[jira] [Commented] (SPARK-28451) substr returns different values

2019-07-22 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890026#comment-16890026 ] Shivu Sondur commented on SPARK-28451: -- i will check this issue   > substr return

[jira] [Commented] (SPARK-28471) Formatting dates with negative years

2019-07-22 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890024#comment-16890024 ] Shivu Sondur commented on SPARK-28471: -- [~maxgekk] According to your discussion li

[jira] [Updated] (SPARK-28467) Tests failed if there are not enough executors up before running

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28467: -- Component/s: (was: Spark Core) Tests > Tests failed if there are not enou

[jira] [Commented] (SPARK-28467) Tests failed if there are not enough executors up before running

2019-07-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889995#comment-16889995 ] Dongjoon Hyun commented on SPARK-28467: --- I tested in `a1.4xlarge` and I cannot rep

[jira] [Commented] (SPARK-28471) Formatting dates with negative years

2019-07-22 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889981#comment-16889981 ] Maxim Gekk commented on SPARK-28471: Here is my explanation of difference in years b

[jira] [Commented] (SPARK-28470) Honor spark.sql.decimalOperations.nullOnOverflow in Cast

2019-07-22 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889979#comment-16889979 ] Marco Gaido commented on SPARK-28470: - Thanks for checking this Wenchen! I will work

[jira] [Created] (SPARK-28471) Formatting dates with negative years

2019-07-22 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28471: -- Summary: Formatting dates with negative years Key: SPARK-28471 URL: https://issues.apache.org/jira/browse/SPARK-28471 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28470) Honor spark.sql.decimalOperations.nullOnOverflow in Cast

2019-07-22 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-28470: --- Summary: Honor spark.sql.decimalOperations.nullOnOverflow in Cast Key: SPARK-28470 URL: https://issues.apache.org/jira/browse/SPARK-28470 Project: Spark Issue

[jira] [Updated] (SPARK-28470) Honor spark.sql.decimalOperations.nullOnOverflow in Cast

2019-07-22 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28470: Description: cast long to decimal or decimal to decimal can overflow, we should respect the new co

[jira] [Commented] (SPARK-28470) Honor spark.sql.decimalOperations.nullOnOverflow in Cast

2019-07-22 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889975#comment-16889975 ] Wenchen Fan commented on SPARK-28470: - cc [~mgaido] > Honor spark.sql.decimalOperat