[jira] [Assigned] (SPARK-30644) Remove query index from the golden files of SQLQueryTestSuite

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30644: - Assignee: Xiao Li > Remove query index from the golden files of SQLQueryTestSuite > ---

[jira] [Resolved] (SPARK-30644) Remove query index from the golden files of SQLQueryTestSuite

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30644. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27361 [https://

[jira] [Commented] (SPARK-30643) Add support for embedding Hive 3

2020-01-25 Thread Igor Dvorzhak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023726#comment-17023726 ] Igor Dvorzhak commented on SPARK-30643: --- Hi, [~dongjoon]. Thank you for fixing up

[jira] [Commented] (SPARK-25496) Deprecate from_utc_timestamp and to_utc_timestamp

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023722#comment-17023722 ] Dongjoon Hyun commented on SPARK-25496: --- This is reverted via https://github.com/a

[jira] [Reopened] (SPARK-25496) Deprecate from_utc_timestamp and to_utc_timestamp

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-25496: --- > Deprecate from_utc_timestamp and to_utc_timestamp > --

[jira] [Updated] (SPARK-25496) Deprecate from_utc_timestamp and to_utc_timestamp

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25496: -- Fix Version/s: (was: 3.0.0) > Deprecate from_utc_timestamp and to_utc_timestamp >

[jira] [Updated] (SPARK-29777) SparkR::cleanClosure aggressively removes a function required by user function

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29777: -- Affects Version/s: 2.0.2 > SparkR::cleanClosure aggressively removes a function required by us

[jira] [Updated] (SPARK-29777) SparkR::cleanClosure aggressively removes a function required by user function

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29777: -- Affects Version/s: 2.1.3 > SparkR::cleanClosure aggressively removes a function required by us

[jira] [Updated] (SPARK-29777) SparkR::cleanClosure aggressively removes a function required by user function

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29777: -- Affects Version/s: 2.2.3 > SparkR::cleanClosure aggressively removes a function required by us

[jira] [Updated] (SPARK-29777) SparkR::cleanClosure aggressively removes a function required by user function

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29777: -- Affects Version/s: 2.3.4 > SparkR::cleanClosure aggressively removes a function required by us

[jira] [Resolved] (SPARK-30645) collect() support Unicode charactes tests fails on Windows

2020-01-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30645. -- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-30645) collect() support Unicode charactes tests fails on Windows

2020-01-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30645: Assignee: Maciej Szymkiewicz > collect() support Unicode charactes tests fails on Windows

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023717#comment-17023717 ] Maciej Szymkiewicz commented on SPARK-30629: Makes sense. I guess if we have

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Hossein Falaki (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023715#comment-17023715 ] Hossein Falaki commented on SPARK-30629: Yes, this is a good example. There must

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023714#comment-17023714 ] Maciej Szymkiewicz commented on SPARK-30629: Although I still have some doub

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023713#comment-17023713 ] Maciej Szymkiewicz commented on SPARK-30629: Thanks for clarification, I'll

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Hossein Falaki (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023712#comment-17023712 ] Hossein Falaki commented on SPARK-30629: Oh yes. I think we can disable that spe

[jira] [Comment Edited] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023711#comment-17023711 ] Maciej Szymkiewicz edited comment on SPARK-30629 at 1/26/20 2:46 AM: -

[jira] [Comment Edited] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023711#comment-17023711 ] Maciej Szymkiewicz edited comment on SPARK-30629 at 1/26/20 2:42 AM: -

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023711#comment-17023711 ] Maciej Szymkiewicz commented on SPARK-30629: [~falaki] Fair enough, but the

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Hossein Falaki (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023710#comment-17023710 ] Hossein Falaki commented on SPARK-30629: [~zero323] that indefinite recursive ca

[jira] [Updated] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30629: --- Description: This problem surfaced while handling SPARK-22817. In theory there are t

[jira] [Updated] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30629: --- Description: This problem surfaced while handling SPARK-22817. In theory there are t

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023708#comment-17023708 ] Maciej Szymkiewicz commented on SPARK-30629: CC [~mengxr] [~falaki] > clean

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023706#comment-17023706 ] Maciej Szymkiewicz commented on SPARK-30629: OK, so I checked and it looks l

[jira] [Commented] (SPARK-30637) upgrade testthat on jenkins workers to 2.0.0

2020-01-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023705#comment-17023705 ] Hyukjin Kwon commented on SPARK-30637: -- Thanks [~shaneknapp] always for taking care

[jira] [Closed] (SPARK-30634) Delta Merge and Arbitrary Stateful Processing in Structured streaming (foreachBatch)

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-30634. - > Delta Merge and Arbitrary Stateful Processing in Structured streaming > (foreachBatch) > ---

[jira] [Resolved] (SPARK-30634) Delta Merge and Arbitrary Stateful Processing in Structured streaming (foreachBatch)

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30634. --- Resolution: Invalid Hi, [~yurkao]. Sorry, but JIRA is not for Q&A. Please send to dev mailin

[jira] [Commented] (SPARK-28375) Enforce idempotence on the PullupCorrelatedPredicates optimizer rule

2020-01-25 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023701#comment-17023701 ] Takeshi Yamamuro commented on SPARK-28375: -- The same comment here, too: https:

[jira] [Commented] (SPARK-28375) Enforce idempotence on the PullupCorrelatedPredicates optimizer rule

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023700#comment-17023700 ] Dongjoon Hyun commented on SPARK-28375: --- [~maropu]. So, this doesn't have any effe

[jira] [Commented] (SPARK-30643) Add support for embedding Hive 3

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023699#comment-17023699 ] Dongjoon Hyun commented on SPARK-30643: --- Hi, [~medb]. Thank you for filing a JIRA.

[jira] [Updated] (SPARK-30643) Add support for embedding Hive 3

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30643: -- Target Version/s: (was: 3.1.0) > Add support for embedding Hive 3 >

[jira] [Updated] (SPARK-30643) Add support for embedding Hive 3

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30643: -- Issue Type: Improvement (was: Bug) > Add support for embedding Hive 3 > -

[jira] [Created] (SPARK-30645) collect() support Unicode charactes tests fails on Windows

2020-01-25 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30645: -- Summary: collect() support Unicode charactes tests fails on Windows Key: SPARK-30645 URL: https://issues.apache.org/jira/browse/SPARK-30645 Project: Spark

[jira] [Commented] (SPARK-28375) Enforce idempotence on the PullupCorrelatedPredicates optimizer rule

2020-01-25 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023695#comment-17023695 ] Takeshi Yamamuro commented on SPARK-28375: -- IMO PullupCorrelatedPredicates is i

[jira] [Updated] (SPARK-30639) Upgrade Jersey to 2.30

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30639: -- Description: For better JDK11 support, this issue aims to upgrade **Jersey** and **javassist*

[jira] [Resolved] (SPARK-30639) Upgrade Jersey to 2.30

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30639. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27357 [https://

[jira] [Assigned] (SPARK-30639) Upgrade Jersey to 2.30

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30639: - Assignee: Dongjoon Hyun > Upgrade Jersey to 2.30 > -- > >

[jira] [Created] (SPARK-30644) Remove query index from the golden files of SQLQueryTestSuite

2020-01-25 Thread Xiao Li (Jira)
Xiao Li created SPARK-30644: --- Summary: Remove query index from the golden files of SQLQueryTestSuite Key: SPARK-30644 URL: https://issues.apache.org/jira/browse/SPARK-30644 Project: Spark Issue Ty

[jira] [Created] (SPARK-30643) Add support for embedded Hive 3

2020-01-25 Thread Igor Dvorzhak (Jira)
Igor Dvorzhak created SPARK-30643: - Summary: Add support for embedded Hive 3 Key: SPARK-30643 URL: https://issues.apache.org/jira/browse/SPARK-30643 Project: Spark Issue Type: Bug C

[jira] [Updated] (SPARK-30643) Add support for embedding Hive 3

2020-01-25 Thread Igor Dvorzhak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Dvorzhak updated SPARK-30643: -- Summary: Add support for embedding Hive 3 (was: Add support for embedded Hive 3) > Add suppo

[jira] [Created] (SPARK-30642) LinearSVC blockify input vectors

2020-01-25 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30642: Summary: LinearSVC blockify input vectors Key: SPARK-30642 URL: https://issues.apache.org/jira/browse/SPARK-30642 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-30641) ML algs blockify input vectors

2020-01-25 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30641: Summary: ML algs blockify input vectors Key: SPARK-30641 URL: https://issues.apache.org/jira/browse/SPARK-30641 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023502#comment-17023502 ] Dongjoon Hyun commented on SPARK-28921: --- Of course, I agree with you. I was just w

[jira] [Reopened] (SPARK-10892) Join with Data Frame returns wrong results

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-10892: --- > Join with Data Frame returns wrong results > -- > >

[jira] [Commented] (SPARK-10892) Join with Data Frame returns wrong results

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023493#comment-17023493 ] Dongjoon Hyun commented on SPARK-10892: --- Since this is fixed as SPARK-28344 , I wi

[jira] [Closed] (SPARK-10892) Join with Data Frame returns wrong results

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-10892. - > Join with Data Frame returns wrong results > -- > >

[jira] [Resolved] (SPARK-10892) Join with Data Frame returns wrong results

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-10892. --- Fix Version/s: (was: 3.0.0) Resolution: Duplicate > Join with Data Frame returns

[jira] [Commented] (SPARK-26002) SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023489#comment-17023489 ] Dongjoon Hyun commented on SPARK-26002: --- Hi, All. I set `Target Version` to `3.0.0

[jira] [Updated] (SPARK-26002) SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26002: -- Target Version/s: 3.0.0 > SQL date operators calculates with incorrect dayOfYears for dates be

[jira] [Commented] (SPARK-26021) -0.0 and 0.0 not treated consistently, doesn't match Hive

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023486#comment-17023486 ] Dongjoon Hyun commented on SPARK-26021: --- According to the above decision (revertin

[jira] [Updated] (SPARK-26021) -0.0 and 0.0 not treated consistently, doesn't match Hive

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26021: -- Target Version/s: 3.0.0 > -0.0 and 0.0 not treated consistently, doesn't match Hive >

[jira] [Commented] (SPARK-29906) Reading of csv file fails with adaptive execution turned on

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023484#comment-17023484 ] Dongjoon Hyun commented on SPARK-29906: --- Hi, All. I set `Target Version` to `3.0.0

[jira] [Updated] (SPARK-28344) fail the query if detect ambiguous self join

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28344: -- Target Version/s: 2.4.5, 3.0.0 > fail the query if detect ambiguous self join > --

[jira] [Updated] (SPARK-29906) Reading of csv file fails with adaptive execution turned on

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29906: -- Target Version/s: 3.0.0 > Reading of csv file fails with adaptive execution turned on > --

[jira] [Updated] (SPARK-26154) Stream-stream joins - left outer join gives inconsistent output

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26154: -- Target Version/s: 3.0.0 > Stream-stream joins - left outer join gives inconsistent output > --

[jira] [Commented] (SPARK-26154) Stream-stream joins - left outer join gives inconsistent output

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023483#comment-17023483 ] Dongjoon Hyun commented on SPARK-26154: --- Hi, All. According to the above decision,

[jira] [Commented] (SPARK-27612) Creating a DataFrame in PySpark with ArrayType produces some Rows with Arrays of None

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023481#comment-17023481 ] Dongjoon Hyun commented on SPARK-27612: --- I also did double-check that this is not

[jira] [Updated] (SPARK-27612) Creating a DataFrame in PySpark with ArrayType produces some Rows with Arrays of None

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27612: -- Target Version/s: 3.0.0 > Creating a DataFrame in PySpark with ArrayType produces some Rows wi

[jira] [Commented] (SPARK-28375) Enforce idempotence on the PullupCorrelatedPredicates optimizer rule

2020-01-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023475#comment-17023475 ] Dongjoon Hyun commented on SPARK-28375: --- Hi, [~joshrosen] and [~smilegator]. This

[jira] [Commented] (SPARK-27696) kubernetes driver pod not deleted after finish.

2020-01-25 Thread Jiaxin Shan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023458#comment-17023458 ] Jiaxin Shan commented on SPARK-27696: - I think this is by design. If the driver job