[jira] [Resolved] (SPARK-29761) do not output leading 'interval' in CalendarInterval.toString

[ https://issues.apache.org/jira/browse/SPARK-29761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29761. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26401

[jira] [Commented] (SPARK-29625) Spark Structure Streaming Kafka Wrong Reset Offset twice

[ https://issues.apache.org/jira/browse/SPARK-29625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968987#comment-16968987 ] Hyukjin Kwon commented on SPARK-29625: -- [~sanysand...@gmail.com] can you at least make a minimized

[jira] [Resolved] (SPARK-27763) Port test cases from PostgreSQL to Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-27763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27763. -- Resolution: Done I am leaving this resolved for now. Thanks [~maropu] for finalizing this >

[jira] [Created] (SPARK-29786) Fix MetaException when dropping a partition not exists on HDFS.

Deegue created SPARK-29786: -- Summary: Fix MetaException when dropping a partition not exists on HDFS. Key: SPARK-29786 URL: https://issues.apache.org/jira/browse/SPARK-29786 Project: Spark Issue

[jira] [Resolved] (SPARK-29709) structured streaming The offset in the checkpoint is suddenly reset to the earliest

[ https://issues.apache.org/jira/browse/SPARK-29709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29709. -- Resolution: Incomplete > structured streaming The offset in the checkpoint is suddenly reset

[jira] [Created] (SPARK-29785) Optimize opening a new session of Spark Thrift Server

Deegue created SPARK-29785: -- Summary: Optimize opening a new session of Spark Thrift Server Key: SPARK-29785 URL: https://issues.apache.org/jira/browse/SPARK-29785 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29784) Built in function trim is not compatible in 3.0 with previous version

[ https://issues.apache.org/jira/browse/SPARK-29784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968949#comment-16968949 ] pavithra ramachandran commented on SPARK-29784: --- i shall work on this > Built in function

[jira] [Created] (SPARK-29784) Built in function trim is not compatible in 3.0 with previous version

ABHISHEK KUMAR GUPTA created SPARK-29784: Summary: Built in function trim is not compatible in 3.0 with previous version Key: SPARK-29784 URL: https://issues.apache.org/jira/browse/SPARK-29784

[jira] [Comment Edited] (SPARK-29771) Limit executor max failures before failing the application

[ https://issues.apache.org/jira/browse/SPARK-29771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968933#comment-16968933 ] Jackey Lee edited comment on SPARK-29771 at 11/7/19 5:12 AM: - This patch is

[jira] [Commented] (SPARK-29771) Limit executor max failures before failing the application

[ https://issues.apache.org/jira/browse/SPARK-29771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968933#comment-16968933 ] Jackey Lee commented on SPARK-29771: This patch is mainly used in the scenario where the executor

[jira] [Updated] (SPARK-27986) Support Aggregate Expressions with filter

[ https://issues.apache.org/jira/browse/SPARK-27986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-27986: --- Description: An aggregate expression represents the application of an aggregate function across

[jira] [Assigned] (SPARK-29605) Optimize string to interval casting

[ https://issues.apache.org/jira/browse/SPARK-29605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29605: --- Assignee: Maxim Gekk > Optimize string to interval casting >

[jira] [Resolved] (SPARK-29605) Optimize string to interval casting

[ https://issues.apache.org/jira/browse/SPARK-29605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29605. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26256

[jira] [Commented] (SPARK-29600) array_contains built in function is not backward compatible in 3.0

[ https://issues.apache.org/jira/browse/SPARK-29600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968909#comment-16968909 ] ABHISHEK KUMAR GUPTA commented on SPARK-29600: -- [~Udbhav Agrawal]: I gone through the

[jira] [Comment Edited] (SPARK-29625) Spark Structure Streaming Kafka Wrong Reset Offset twice

[ https://issues.apache.org/jira/browse/SPARK-29625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968907#comment-16968907 ] Sandish Kumar HN edited comment on SPARK-29625 at 11/7/19 4:04 AM: ---

[jira] [Reopened] (SPARK-29625) Spark Structure Streaming Kafka Wrong Reset Offset twice

[ https://issues.apache.org/jira/browse/SPARK-29625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandish Kumar HN reopened SPARK-29625: -- It happened again, As I can't share the code here, I will just post the flow of the

[jira] [Comment Edited] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968895#comment-16968895 ] Udit Mehrotra edited comment on SPARK-29767 at 11/7/19 3:41 AM:

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Attachment: coredump.zip > Core dump happening on executors while doing simple union of Data

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968895#comment-16968895 ] Udit Mehrotra commented on SPARK-29767: --- [~hyukjin.kwon] was finally able to get the core dump of

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Attachment: hs_err_pid13885.log > Core dump happening on executors while doing simple union

[jira] [Comment Edited] (SPARK-28794) Document CREATE TABLE in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966433#comment-16966433 ] pavithra ramachandran edited comment on SPARK-28794 at 11/7/19 3:08 AM:

[jira] [Created] (SPARK-29783) Support SQL Standard output style for interval type

Kent Yao created SPARK-29783: Summary: Support SQL Standard output style for interval type Key: SPARK-29783 URL: https://issues.apache.org/jira/browse/SPARK-29783 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29778) saveAsTable append mode is not passing writer options

[ https://issues.apache.org/jira/browse/SPARK-29778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968881#comment-16968881 ] yueqi commented on SPARK-29778: --- Does v1 table support append? just checking > saveAsTable append mode is

[jira] [Updated] (SPARK-29782) spark broadcast can not be destoryed in some versions

[ https://issues.apache.org/jira/browse/SPARK-29782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tzxxh updated SPARK-29782: -- Description: In spark version (2.3.3 , 2.4.1 , 2.4.2 , 2.4.3 , 2.4.4) use Broadcast.destroy() method can not

[jira] [Commented] (SPARK-29760) Document VALUES statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-29760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968853#comment-16968853 ] Sean R. Owen commented on SPARK-29760: -- I mean, what would you add where? you could open a PR to

[jira] [Commented] (SPARK-29760) Document VALUES statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-29760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968850#comment-16968850 ] jobit mathew commented on SPARK-29760: -- [~srowen],it can be added as a part of Build a SQL

[jira] [Updated] (SPARK-29782) spark broadcast can not be destoryed in some versions

[ https://issues.apache.org/jira/browse/SPARK-29782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tzxxh updated SPARK-29782: -- Attachment: problem versions.png > spark broadcast can not be destoryed in some versions >

[jira] [Updated] (SPARK-29782) spark broadcast can not be destoryed in some versions

[ https://issues.apache.org/jira/browse/SPARK-29782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tzxxh updated SPARK-29782: -- Attachment: correct version.png > spark broadcast can not be destoryed in some versions >

[jira] [Updated] (SPARK-29782) spark broadcast can not be destoryed in some versions

[ https://issues.apache.org/jira/browse/SPARK-29782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tzxxh updated SPARK-29782: -- Attachment: (was: 33.png) > spark broadcast can not be destoryed in some versions >

[jira] [Updated] (SPARK-29782) spark broadcast can not be destoryed in some versions

[ https://issues.apache.org/jira/browse/SPARK-29782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tzxxh updated SPARK-29782: -- Attachment: (was: 44.png) > spark broadcast can not be destoryed in some versions >

[jira] [Updated] (SPARK-29782) spark broadcast can not be destoryed in some versions

[ https://issues.apache.org/jira/browse/SPARK-29782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tzxxh updated SPARK-29782: -- Description: In spark version (2.3.3 , 2.4.1 , 2.4.2 , 2.4.3 , 2.4.4) use Broadcast.destroy() method can not

[jira] [Updated] (SPARK-29782) spark broadcast can not be destoryed in some versions

[ https://issues.apache.org/jira/browse/SPARK-29782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tzxxh updated SPARK-29782: -- Attachment: 44.png > spark broadcast can not be destoryed in some versions >

[jira] [Updated] (SPARK-29782) spark broadcast can not be destoryed in some versions

[ https://issues.apache.org/jira/browse/SPARK-29782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tzxxh updated SPARK-29782: -- Attachment: 33.png > spark broadcast can not be destoryed in some versions >

[jira] [Created] (SPARK-29782) spark broadcast can not be destoryed in some versions

tzxxh created SPARK-29782: - Summary: spark broadcast can not be destoryed in some versions Key: SPARK-29782 URL: https://issues.apache.org/jira/browse/SPARK-29782 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29782) spark broadcast can not be destoryed in some versions

[ https://issues.apache.org/jira/browse/SPARK-29782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tzxxh updated SPARK-29782: -- Attachment: 1.png > spark broadcast can not be destoryed in some versions >

[jira] [Updated] (SPARK-29782) spark broadcast can not be destoryed in some versions

[ https://issues.apache.org/jira/browse/SPARK-29782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tzxxh updated SPARK-29782: -- Attachment: (was: 1.png) > spark broadcast can not be destoryed in some versions >

[jira] [Resolved] (SPARK-29635) Deduplicate test suites between Kafka micro-batch sink and Kafka continuous sink

[ https://issues.apache.org/jira/browse/SPARK-29635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29635. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-29635) Deduplicate test suites between Kafka micro-batch sink and Kafka continuous sink

[ https://issues.apache.org/jira/browse/SPARK-29635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-29635: -- Assignee: Jungtaek Lim > Deduplicate test suites between Kafka

[jira] [Resolved] (SPARK-29720) Add linux condition to make ProcfsMetricsGetter more complete

[ https://issues.apache.org/jira/browse/SPARK-29720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29720. -- Resolution: Not A Problem > Add linux condition to make ProcfsMetricsGetter more complete >

[jira] [Commented] (SPARK-17814) spark submit arguments are truncated in yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-17814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968816#comment-16968816 ] Juan Ramos Fuentes commented on SPARK-17814: Looks like I'm about 3 years too late, but I

[jira] [Updated] (SPARK-29781) Override SBT Jackson-databind dependency like Maven

[ https://issues.apache.org/jira/browse/SPARK-29781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29781: -- Summary: Override SBT Jackson-databind dependency like Maven (was: Override SBT Jackson

[jira] [Created] (SPARK-29781) Override SBT Jackson dependency like Maven

Dongjoon Hyun created SPARK-29781: - Summary: Override SBT Jackson dependency like Maven Key: SPARK-29781 URL: https://issues.apache.org/jira/browse/SPARK-29781 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29781) Override SBT Jackson dependency like Maven

[ https://issues.apache.org/jira/browse/SPARK-29781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29781: -- Component/s: (was: Spark Core) > Override SBT Jackson dependency like Maven >

[jira] [Created] (SPARK-29780) The UI can access into the ResourceAllocator, whose data structures are being updated from scheduler threads

Alessandro Bellina created SPARK-29780: -- Summary: The UI can access into the ResourceAllocator, whose data structures are being updated from scheduler threads Key: SPARK-29780 URL:

[jira] [Resolved] (SPARK-29759) LocalShuffleReaderExec.outputPartitioning should use the corrected attributes

[ https://issues.apache.org/jira/browse/SPARK-29759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29759. - Fix Version/s: 3.0.0 Resolution: Fixed > LocalShuffleReaderExec.outputPartitioning should use

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968760#comment-16968760 ] shahid commented on SPARK-29765: Event drop can also happen that if we don't provide sufficient memory.

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968757#comment-16968757 ] Udit Mehrotra commented on SPARK-29767: --- [~hyukjin.kwon] As I have mentioned in the description

[jira] [Updated] (SPARK-29777) SparkR::cleanClosure aggressively removes a function required by user function

[ https://issues.apache.org/jira/browse/SPARK-29777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-29777: --- Description: Following code block reproduces the issue: {code} df <-

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968753#comment-16968753 ] Viacheslav Tradunsky commented on SPARK-29765: -- What's in particularly interesting, that

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968751#comment-16968751 ] Viacheslav Tradunsky commented on SPARK-29765: -- Increased the capacity to 2 as pointed

[jira] [Commented] (SPARK-28502) Error with struct conversion while using pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968744#comment-16968744 ] Bryan Cutler commented on SPARK-28502: -- Ahh, so Arrow 0.15.0+ had a change in the IPC format that

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968739#comment-16968739 ] Viacheslav Tradunsky commented on SPARK-29765: -- I think it is capacity after code review ;)

[jira] [Updated] (SPARK-29779) Compact old event log files and clean up

[ https://issues.apache.org/jira/browse/SPARK-29779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29779: - Parent: SPARK-28594 Issue Type: Sub-task (was: Task) > Compact old event log files and

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968737#comment-16968737 ] shahid commented on SPARK-29765: Thanks. Yes, you can try increasing

[jira] [Created] (SPARK-29779) Compact old event log files and clean up

Jungtaek Lim created SPARK-29779: Summary: Compact old event log files and clean up Key: SPARK-29779 URL: https://issues.apache.org/jira/browse/SPARK-29779 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-29777) SparkR::cleanClosure aggressively removes a function required by user function

[ https://issues.apache.org/jira/browse/SPARK-29777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-29777: --- Description: Following code block reproduces the issue: {code:java} library(SparkR)

[jira] [Updated] (SPARK-29777) SparkR::cleanClosure aggressively removes a function required by user function

[ https://issues.apache.org/jira/browse/SPARK-29777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-29777: --- Description: Following code block reproduces the issue: {code:java} library(SparkR)

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968720#comment-16968720 ] Viacheslav Tradunsky commented on SPARK-29765: -- Exactly as you said: {code:java} ERROR

[jira] [Comment Edited] (SPARK-28502) Error with struct conversion while using pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968703#comment-16968703 ] Nasir Ali edited comment on SPARK-28502 at 11/6/19 9:17 PM: [~bryanc] If I

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968707#comment-16968707 ] shahid commented on SPARK-29765: Yes, then it seems some event drop has happened. Could you check the

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968704#comment-16968704 ] Viacheslav Tradunsky commented on SPARK-29765: -- [~shahid] Reproduced. An interesting

[jira] [Commented] (SPARK-28502) Error with struct conversion while using pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968703#comment-16968703 ] Nasir Ali commented on SPARK-28502: --- [~bryanc] If I perform any agg (e.g., avg) on grouped data,

[jira] [Commented] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968657#comment-16968657 ] L. C. Hsieh commented on SPARK-17495: - This looks should be resolved now? Last comments from

[jira] [Created] (SPARK-29778) saveAsTable append mode is not passing writer options

Burak Yavuz created SPARK-29778: --- Summary: saveAsTable append mode is not passing writer options Key: SPARK-29778 URL: https://issues.apache.org/jira/browse/SPARK-29778 Project: Spark Issue

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968652#comment-16968652 ] shahid commented on SPARK-29765: I still not sure about the root cause, as I am not able to reproduce

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968649#comment-16968649 ] Viacheslav Tradunsky commented on SPARK-29765: -- [~shahid]  sure, in case we have more than

[jira] [Created] (SPARK-29777) SparkR::cleanClosure aggressively removes a function required by user function

Hossein Falaki created SPARK-29777: -- Summary: SparkR::cleanClosure aggressively removes a function required by user function Key: SPARK-29777 URL: https://issues.apache.org/jira/browse/SPARK-29777

[jira] [Comment Edited] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968642#comment-16968642 ] shahid edited comment on SPARK-29765 at 11/6/19 7:39 PM: - Just to narrow down

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968642#comment-16968642 ] shahid commented on SPARK-29765: Just to narrow down the problem, can you please increase

[jira] [Assigned] (SPARK-29642) ContinuousMemoryStream throws error on String type

[ https://issues.apache.org/jira/browse/SPARK-29642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-29642: -- Assignee: Jungtaek Lim > ContinuousMemoryStream throws error on

[jira] [Resolved] (SPARK-29642) ContinuousMemoryStream throws error on String type

[ https://issues.apache.org/jira/browse/SPARK-29642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29642. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Closed] (SPARK-29571) Fix UT in AllExecutionsPageSuite class

[ https://issues.apache.org/jira/browse/SPARK-29571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Raj Boudh closed SPARK-29571. --- Issue got fixed. > Fix UT in AllExecutionsPageSuite class >

[jira] [Resolved] (SPARK-29752) make AdaptiveQueryExecSuite more robust

[ https://issues.apache.org/jira/browse/SPARK-29752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29752. - Fix Version/s: 3.0.0 Resolution: Fixed > make AdaptiveQueryExecSuite more robust >

[jira] [Assigned] (SPARK-29603) Support application priority for spark on yarn

[ https://issues.apache.org/jira/browse/SPARK-29603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-29603: -- Assignee: Kent Yao > Support application priority for spark on yarn

[jira] [Resolved] (SPARK-29603) Support application priority for spark on yarn

[ https://issues.apache.org/jira/browse/SPARK-29603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29603. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-29588) Improvements in WebUI JDBC/ODBC server page

[ https://issues.apache.org/jira/browse/SPARK-29588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-29588: --- Priority: Major (was: Minor) > Improvements in WebUI JDBC/ODBC server page >

[jira] [Commented] (SPARK-25466) Documentation does not specify how to set Kafka consumer cache capacity for SS

[ https://issues.apache.org/jira/browse/SPARK-25466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968435#comment-16968435 ] Shyam commented on SPARK-25466: --- [~gsomogyi] I am still facing the same issue how to fix it ? I tried

[jira] [Resolved] (SPARK-28725) Spark ML not able to de-serialize Logistic Regression model saved in previous version of Spark

[ https://issues.apache.org/jira/browse/SPARK-28725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28725. -- Resolution: Invalid > Spark ML not able to de-serialize Logistic Regression model saved in

[jira] [Resolved] (SPARK-29325) approxQuantile() results are incorrect and vary significantly for small changes in relativeError

[ https://issues.apache.org/jira/browse/SPARK-29325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29325. -- Resolution: Duplicate > approxQuantile() results are incorrect and vary significantly for

[jira] [Resolved] (SPARK-25880) user set some hadoop configurations can not work

[ https://issues.apache.org/jira/browse/SPARK-25880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-25880. -- Resolution: Not A Problem > user set some hadoop configurations can not work >

[jira] [Resolved] (SPARK-29453) Improve tooltip information for SQL tab

[ https://issues.apache.org/jira/browse/SPARK-29453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29453. -- Resolution: Not A Problem > Improve tooltip information for SQL tab >

[jira] [Resolved] (SPARK-29585) Duration in stagePage does not match Duration in Summary Metrics for Completed Tasks

[ https://issues.apache.org/jira/browse/SPARK-29585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29585. -- Resolution: Not A Problem > Duration in stagePage does not match Duration in Summary Metrics

[jira] [Resolved] (SPARK-29548) Redirect system print stream to log4j and improve robustness

[ https://issues.apache.org/jira/browse/SPARK-29548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29548. -- Resolution: Won't Fix > Redirect system print stream to log4j and improve robustness >

[jira] [Assigned] (SPARK-29751) Scalers use Summarizer instead of MultivariateOnlineSummarizer

[ https://issues.apache.org/jira/browse/SPARK-29751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29751: Assignee: zhengruifeng > Scalers use Summarizer instead of MultivariateOnlineSummarizer

[jira] [Resolved] (SPARK-29751) Scalers use Summarizer instead of MultivariateOnlineSummarizer

[ https://issues.apache.org/jira/browse/SPARK-29751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29751. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26393

[jira] [Comment Edited] (SPARK-29764) Error on Serializing POJO with java datetime property to a Parquet file

[ https://issues.apache.org/jira/browse/SPARK-29764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968411#comment-16968411 ] Felix Kizhakkel Jose edited comment on SPARK-29764 at 11/6/19 2:46 PM:

[jira] [Comment Edited] (SPARK-29764) Error on Serializing POJO with java datetime property to a Parquet file

[ https://issues.apache.org/jira/browse/SPARK-29764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968411#comment-16968411 ] Felix Kizhakkel Jose edited comment on SPARK-29764 at 11/6/19 2:45 PM:

[jira] [Updated] (SPARK-29764) Error on Serializing POJO with java datetime property to a Parquet file

[ https://issues.apache.org/jira/browse/SPARK-29764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Kizhakkel Jose updated SPARK-29764: - Attachment: SparkParquetSampleCode.docx > Error on Serializing POJO with java

[jira] [Commented] (SPARK-29764) Error on Serializing POJO with java datetime property to a Parquet file

[ https://issues.apache.org/jira/browse/SPARK-29764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968411#comment-16968411 ] Felix Kizhakkel Jose commented on SPARK-29764: -- [~hyukjin.kwon] Sorry, I didn't know

[jira] [Commented] (SPARK-29776) rpad returning invalid value when parameter is empty

[ https://issues.apache.org/jira/browse/SPARK-29776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968406#comment-16968406 ] Ankit raj boudh commented on SPARK-29776: - i will start checking this issue. > rpad returning

[jira] [Created] (SPARK-29776) rpad returning invalid value when parameter is empty

ABHISHEK KUMAR GUPTA created SPARK-29776: Summary: rpad returning invalid value when parameter is empty Key: SPARK-29776 URL: https://issues.apache.org/jira/browse/SPARK-29776 Project: Spark

[jira] [Commented] (SPARK-29760) Document VALUES statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-29760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968403#comment-16968403 ] Sean R. Owen commented on SPARK-29760: -- That's standard SQL, no? and it works. I don't know if it

[jira] [Created] (SPARK-29775) Support truncate multiple tables

jobit mathew created SPARK-29775: Summary: Support truncate multiple tables Key: SPARK-29775 URL: https://issues.apache.org/jira/browse/SPARK-29775 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-29760) Document VALUES statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-29760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967500#comment-16967500 ] jobit mathew edited comment on SPARK-29760 at 11/6/19 1:43 PM: --- [~LI,Xiao]

[jira] [Resolved] (SPARK-29746) implement validateInputType in Normalizer

[ https://issues.apache.org/jira/browse/SPARK-29746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29746. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26388

[jira] [Assigned] (SPARK-29746) implement validateInputType in Normalizer

[ https://issues.apache.org/jira/browse/SPARK-29746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29746: Assignee: Huaxin Gao > implement validateInputType in Normalizer >

[jira] [Commented] (SPARK-27763) Port test cases from PostgreSQL to Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-27763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968346#comment-16968346 ] Takeshi Yamamuro commented on SPARK-27763: -- I've finished checking `create_table.sql` and

[jira] [Commented] (SPARK-28296) Improved VALUES support

[ https://issues.apache.org/jira/browse/SPARK-28296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968332#comment-16968332 ] jobit mathew commented on SPARK-28296: -- [~petertoth] there are some more valid commands supporting

[jira] [Commented] (SPARK-29773) Unable to process empty ORC files in Hive Table using Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-29773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968329#comment-16968329 ] Alexander Ermakov commented on SPARK-29773: --- We will try on 2.4.4 > Unable to process empty

[jira] [Updated] (SPARK-16872) Impl Gaussian Naive Bayes Classifier

[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-16872: - Summary: Impl Gaussian Naive Bayes Classifier (was: Include Gaussian Naive Bayes Classifier)

  1   2   >