Kris Mok created SPARK-20482:
Summary: Resolving Casts is too strict on having time zone set
Key: SPARK-20482
URL: https://issues.apache.org/jira/browse/SPARK-20482
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-21041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kris Mok updated SPARK-21041:
-
Description:
When whole-stage codegen is enabled, in face of integer overflow,
SparkSession.range()'s
Kris Mok created SPARK-21041:
Summary: With whole-stage codegen, SparkSession.range()'s behavior
is inconsistent with SparkContext.range()
Key: SPARK-21041
URL: https://issues.apache.org/jira/browse/SPARK-21041
Kris Mok created SPARK-20872:
Summary: ShuffleExchange.nodeName should handle null coordinator
Key: SPARK-20872
URL: https://issues.apache.org/jira/browse/SPARK-20872
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-20872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023421#comment-16023421
]
Kris Mok commented on SPARK-20872:
--
The said matching logic in ShuffleExchange.nodeName() is introduced
Kris Mok created SPARK-21038:
Summary: Reduce redundant generated init code in Catalyst codegen
Key: SPARK-21038
URL: https://issues.apache.org/jira/browse/SPARK-21038
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-20872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kris Mok updated SPARK-20872:
-
Description:
A ShuffleExchange's coordinator can be null sometimes, and when we need to do a
toString()
Kris Mok created SPARK-21927:
Summary: Spark pom.xml's dependency management is broken
Key: SPARK-21927
URL: https://issues.apache.org/jira/browse/SPARK-21927
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154426#comment-16154426
]
Kris Mok commented on SPARK-21927:
--
[~sowen] Could you please take a look and see if recent change to
Kris Mok created SPARK-24321:
Summary: Extract common code from Divide/Remainder to a base trait
Key: SPARK-24321
URL: https://issues.apache.org/jira/browse/SPARK-24321
Project: Spark
Issue
Kris Mok created SPARK-24659:
Summary: GenericArrayData.equals should respect element type
differences
Key: SPARK-24659
URL: https://issues.apache.org/jira/browse/SPARK-24659
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kris Mok updated SPARK-22966:
-
Description:
Currently, in Spark SQL, if a Python UDF returns a {{datetime.date}} (which
should
Kris Mok created SPARK-22966:
Summary: Spark SQL should handle Python UDFs that return a
datetime.date or datetime.datetime
Key: SPARK-22966
URL: https://issues.apache.org/jira/browse/SPARK-22966
Kris Mok created SPARK-23021:
Summary: AnalysisBarrier should not cut off the explain output for
Parsed Logical Plan
Key: SPARK-23021
URL: https://issues.apache.org/jira/browse/SPARK-23021
Project: Spark
Kris Mok created SPARK-23032:
Summary: Add a per-query codegenStageId to WholeStageCodegenExec
Key: SPARK-23032
URL: https://issues.apache.org/jira/browse/SPARK-23032
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-23032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kris Mok updated SPARK-23032:
-
Description:
Proposing to add a per-query ID to the codegen stages as represented by
[
https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324318#comment-16324318
]
Kris Mok commented on SPARK-23021:
--
Thank you very much for explaining the differences between
[
https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323612#comment-16323612
]
Kris Mok commented on SPARK-23021:
--
Hi [~maropu]-san,
Thanks for looking at it! No, I only noticed this
[
https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323672#comment-16323672
]
Kris Mok commented on SPARK-23021:
--
Hi [~maropu]-san,
Thanks! I'm not familiar with this part of the
Kris Mok created SPARK-23447:
Summary: Cleanup codegen template for Literal
Key: SPARK-23447
URL: https://issues.apache.org/jira/browse/SPARK-23447
Project: Spark
Issue Type: Improvement
Kris Mok created SPARK-25113:
Summary: Add logging to CodeGenerator when any generated method's
bytecode size goes above HugeMethodLimit
Key: SPARK-25113
URL: https://issues.apache.org/jira/browse/SPARK-25113
Kris Mok created SPARK-25138:
Summary: Spark Shell should show the Scala prompt after
initialization is complete
Key: SPARK-25138
URL: https://issues.apache.org/jira/browse/SPARK-25138
Project: Spark
Kris Mok created SPARK-25140:
Summary: Add optional logging to UnsafeProjection.create when it
falls back to interpreted mode
Key: SPARK-25140
URL: https://issues.apache.org/jira/browse/SPARK-25140
[
https://issues.apache.org/jira/browse/SPARK-25140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kris Mok updated SPARK-25140:
-
Description:
SPARK-23711 implemented a nice graceful handling of allowing UnsafeProjection
to fall
[
https://issues.apache.org/jira/browse/SPARK-25140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583486#comment-16583486
]
Kris Mok commented on SPARK-25140:
--
Thanks maropu-san! No, I'm not working on this ticket; I'm
Kris Mok created SPARK-25178:
Summary: Use dummy name for xxxHashMapGenerator key/value schema
field
Key: SPARK-25178
URL: https://issues.apache.org/jira/browse/SPARK-25178
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587820#comment-16587820
]
Kris Mok commented on SPARK-25178:
--
FYI: I've just come across this behavior and raised a ticket so
Kris Mok created SPARK-23960:
Summary: Mark HashAggregateExec.bufVars as transient
Key: SPARK-23960
URL: https://issues.apache.org/jira/browse/SPARK-23960
Project: Spark
Issue Type: Improvement
Kris Mok created SPARK-23947:
Summary: Add hashUTF8String convenience method to hasher classes
Key: SPARK-23947
URL: https://issues.apache.org/jira/browse/SPARK-23947
Project: Spark
Issue Type:
Kris Mok created SPARK-23760:
Summary: CodegenContext.withSubExprEliminationExprs should
save/restore CSE state correctly
Key: SPARK-23760
URL: https://issues.apache.org/jira/browse/SPARK-23760
Project:
[
https://issues.apache.org/jira/browse/SPARK-25961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680152#comment-16680152
]
Kris Mok commented on SPARK-25961:
--
It looks like the current restriction makes sense, because the
Kris Mok created SPARK-26061:
Summary: Reduce the number of unused UnsafeRowWriters created in
whole-stage codegen
Key: SPARK-26061
URL: https://issues.apache.org/jira/browse/SPARK-26061
Project: Spark
Kris Mok created SPARK-25494:
Summary: Upgrade Spark's use of Janino to 3.0.10
Key: SPARK-25494
URL: https://issues.apache.org/jira/browse/SPARK-25494
Project: Spark
Issue Type: Improvement
Kris Mok created SPARK-26107:
Summary: Extend ReplaceNullWithFalseInPredicate to support
higher-order functions: ArrayExists, ArrayFilter, MapFilter
Key: SPARK-26107
URL:
Kris Mok created SPARK-26545:
Summary: Fix typo in EqualNullSafe's truth table comment
Key: SPARK-26545
URL: https://issues.apache.org/jira/browse/SPARK-26545
Project: Spark
Issue Type: Bug
Kris Mok created SPARK-26664:
Summary: Make DecimalType's minimum adjusted scale configurable
Key: SPARK-26664
URL: https://issues.apache.org/jira/browse/SPARK-26664
Project: Spark
Issue Type:
Kris Mok created SPARK-26633:
Summary: Add ExecutorClassLoader.getResourceAsStream
Key: SPARK-26633
URL: https://issues.apache.org/jira/browse/SPARK-26633
Project: Spark
Issue Type: Improvement
Kris Mok created SPARK-26659:
Summary: Duplicate cmd.nodeName in the explain output of
DataWritingCommandExec
Key: SPARK-26659
URL: https://issues.apache.org/jira/browse/SPARK-26659
Project: Spark
Kris Mok created SPARK-26661:
Summary: Show actual class name of the writing command in CTAS
explain
Key: SPARK-26661
URL: https://issues.apache.org/jira/browse/SPARK-26661
Project: Spark
Issue
Kris Mok created SPARK-26352:
Summary: ReorderJoin should not change the order of columns
Key: SPARK-26352
URL: https://issues.apache.org/jira/browse/SPARK-26352
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-26352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kris Mok updated SPARK-26352:
-
Summary: join reordering should not change the order of output attributes
(was: ReorderJoin should not
Kris Mok created SPARK-26741:
Summary: Analyzer incorrectly resolves aggregate function outside
of Aggregate operators
Key: SPARK-26741
URL: https://issues.apache.org/jira/browse/SPARK-26741
Project:
[
https://issues.apache.org/jira/browse/SPARK-26741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753310#comment-16753310
]
Kris Mok commented on SPARK-26741:
--
Note that there's a similar issue with non-aggregate functions.
Kris Mok created SPARK-26735:
Summary: Verify plan integrity for special expressions
Key: SPARK-26735
URL: https://issues.apache.org/jira/browse/SPARK-26735
Project: Spark
Issue Type:
Kris Mok created SPARK-30795:
Summary: Spark SQL codegen's code() interpolator should treat
escapes like Scala's StringContext.s()
Key: SPARK-30795
URL: https://issues.apache.org/jira/browse/SPARK-30795
[
https://issues.apache.org/jira/browse/SPARK-31099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056549#comment-17056549
]
Kris Mok commented on SPARK-31099:
--
Just documenting the fact that users may encounter migration issues
[
https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096191#comment-17096191
]
Kris Mok commented on SPARK-31399:
--
Hi [~dongjoon], I've been working on a fix of this issue and will
[
https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096191#comment-17096191
]
Kris Mok edited comment on SPARK-31399 at 4/30/20, 6:32 AM:
Hi [~dongjoon],
Kris Mok created SPARK-31187:
Summary: Sort the whole-stage codegen debug output by
codegenStageId
Key: SPARK-31187
URL: https://issues.apache.org/jira/browse/SPARK-31187
Project: Spark
Issue
Kris Mok created SPARK-31240:
Summary: Constant fold deterministic Scala UDFs with foldable
arguments
Key: SPARK-31240
URL: https://issues.apache.org/jira/browse/SPARK-31240
Project: Spark
Kris Mok created SPARK-32999:
Summary: TreeNode.nodeName should not throw malformed class name
error
Key: SPARK-32999
URL: https://issues.apache.org/jira/browse/SPARK-32999
Project: Spark
Issue
Kris Mok created SPARK-34596:
Summary: NewInstance.doGenCode should not throw malformed class
name error
Key: SPARK-34596
URL: https://issues.apache.org/jira/browse/SPARK-34596
Project: Spark
Kris Mok created SPARK-34607:
Summary: NewInstance.resolved should not throw malformed class
name error
Key: SPARK-34607
URL: https://issues.apache.org/jira/browse/SPARK-34607
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kris Mok updated SPARK-34607:
-
Description:
I'd like to seek for community help on fixing this issue:
Related to SPARK-34596, one of
[
https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kris Mok updated SPARK-34607:
-
Description:
I'd like to seek for community help on fixing this issue:
Related to SPARK-34596, one of
Kris Mok created SPARK-39839:
Summary: Handle special case of null variable-length Decimal with
non-zero offsetAndSize in UnsafeRow structural integrity check
Key: SPARK-39839
URL:
[
https://issues.apache.org/jira/browse/SPARK-39140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534633#comment-17534633
]
Kris Mok commented on SPARK-39140:
--
This isn't a "bug" in Spark's {{JavaSerializer}} per-se, but a
[
https://issues.apache.org/jira/browse/SPARK-40303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599302#comment-17599302
]
Kris Mok commented on SPARK-40303:
--
Interesting, thanks for posting your findings, [~LuciferYang]!
In
Kris Mok created SPARK-40380:
Summary: Constant-folding of InvokeLike should not result in
non-serializable result
Key: SPARK-40380
URL: https://issues.apache.org/jira/browse/SPARK-40380
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599616#comment-17599616
]
Kris Mok commented on SPARK-40303:
--
Nice findings [~LuciferYang]!
{quote}
After some experiments, I
Kris Mok created SPARK-42851:
Summary: EquivalentExpressions methods need to be consistently
guarded by supportedExpression
Key: SPARK-42851
URL: https://issues.apache.org/jira/browse/SPARK-42851
Kris Mok created SPARK-43973:
Summary: Structured Streaming UI should display failed queries
correctly
Key: SPARK-43973
URL: https://issues.apache.org/jira/browse/SPARK-43973
Project: Spark
62 matches
Mail list logo
