[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
Problem:
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but
yucai created SPARK-12196:
-
Summary: Store blocks in storage devices with hierarchy way
Key: SPARK-12196
URL: https://issues.apache.org/jira/browse/SPARK-12196
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*:
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*:
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*:
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Comment: was deleted
(was: Sorry, I have to delete this PR because of my wrong github operation, I
will send
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048574#comment-15048574
]
yucai commented on SPARK-12196:
---
Sorry, I have to delete this PR because of my wrong github operation, I
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048579#comment-15048579
]
yucai commented on SPARK-12196:
---
Sorry, I have to delete this PR because of my wrong github operation, I
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048572#comment-15048572
]
yucai commented on SPARK-12196:
---
Sorry, I have to delete this PR because of my wrong github operation, I
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048576#comment-15048576
]
yucai commented on SPARK-12196:
---
Sorry, I have to delete this PR because of my wrong github operation, I
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048571#comment-15048571
]
yucai commented on SPARK-12196:
---
Sorry, I have to delete this PR because of my wrong github operation, I
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048577#comment-15048577
]
yucai commented on SPARK-12196:
---
Sorry, I have to delete this PR because of my wrong github operation, I
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048570#comment-15048570
]
yucai commented on SPARK-12196:
---
Sorry, I have to delete this PR because of my wrong github operation, I
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048575#comment-15048575
]
yucai commented on SPARK-12196:
---
Sorry, I have to delete this PR because of my wrong github operation, I
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048573#comment-15048573
]
yucai commented on SPARK-12196:
---
Sorry, I have to delete this PR because of my wrong github operation, I
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048578#comment-15048578
]
yucai commented on SPARK-12196:
---
Sorry, I have to delete this PR because of my wrong github operation, I
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Comment: was deleted
(was: Sorry, I have to delete this PR because of my wrong github operation, I
will send
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Comment: was deleted
(was: Sorry, I have to delete this PR because of my wrong github operation, I
will send
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Comment: was deleted
(was: Sorry, I have to delete this PR because of my wrong github operation, I
will send
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Comment: was deleted
(was: Sorry, I have to delete this PR because of my wrong github operation, I
will send
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Comment: was deleted
(was: Sorry, I have to delete this PR because of my wrong github operation, I
will send
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Comment: was deleted
(was: Sorry, I have to delete this PR because of my wrong github operation, I
will send
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Comment: was deleted
(was: Sorry, I have to delete this PR because of my wrong github operation, I
will send
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Comment: was deleted
(was: Sorry, I have to delete this PR because of my wrong github operation, I
will send
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12275:
--
Description:
*Summary*
No plan for BroadcastHint is generated in some condition.
*Test Case*
{code}
val
[
https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052916#comment-15052916
]
yucai commented on SPARK-12275:
---
*Root Cause*
When BasicOperators's "case BroadcastHint(child)" is hit (in
[
https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai closed SPARK-12275.
-
I verified the PR has fixed this issue.
> No plan for BroadcastHint in some condition
>
[
https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12275:
--
Description:
*Summary*
No plan for BroadcastHint is generated in some condition.
*Test Case*
{code}
val
yucai created SPARK-12275:
-
Summary: No plan for BroadcastHint in some condition
Key: SPARK-12275
URL: https://issues.apache.org/jira/browse/SPARK-12275
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082237#comment-15082237
]
yucai commented on SPARK-12196:
---
Hi wei, I think maybe both item could be implemented in separate PR, as
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Summary: Store/retrieve blocks in different speed storage devices by
hierarchy way (was: Store blocks in
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Motivation*
Nowadays, customers have both SSDs(SATA SSD/PCIe SSD) and HDDs.
SSDs have great
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075783#comment-15075783
]
yucai commented on SPARK-12196:
---
Hi Wei,
We have updated the PR. I feel your RDD API change could possible
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs(SATA SSD/PCIe SSD) and HDDs.
SSDs have great
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Motivation*
Nowadays, customers have both SSDs(SATA SSD/PCIe SSD) and HDDs.
SSDs have great
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Motivation*
Nowadays, customers have both SSDs(SATA SSD/PCIe SSD) and HDDs.
SSDs have great
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Summary: Store blocks in different speed storage devices by hierarchy way
(was: Store blocks in storage
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073573#comment-15073573
]
yucai commented on SPARK-12196:
---
Hello Wei, nice to know you :). Some explanation about our implementation:
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073573#comment-15073573
]
yucai edited comment on SPARK-12196 at 12/29/15 7:31 AM:
-
Hello Wei, nice to know
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Problem*
Nowadays, users have both SSDs and HDDs.
SSDs have great performance, but capacity is
yucai created SPARK-12582:
-
Summary: IndexShuffleBlockResolverSuite fails in windows
Key: SPARK-12582
URL: https://issues.apache.org/jira/browse/SPARK-12582
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122684#comment-15122684
]
yucai commented on SPARK-12196:
---
Thanks Holden. Usually, customers have 7-11 HDDs installed in server
yucai created SPARK-13332:
-
Summary: Decimal datatype support for SQL pow
Key: SPARK-13332
URL: https://issues.apache.org/jira/browse/SPARK-13332
Project: Spark
Issue Type: Bug
Components:
yucai created SPARK-16732:
-
Summary: Remove unused codes in
subexpressionEliminationForWholeStageCodegen
Key: SPARK-16732
URL: https://issues.apache.org/jira/browse/SPARK-16732
Project: Spark
Issue
yucai created SPARK-16844:
-
Summary: Generate code for sort based aggregation
Key: SPARK-16844
URL: https://issues.apache.org/jira/browse/SPARK-16844
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-16844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403202#comment-15403202
]
yucai commented on SPARK-16844:
---
We are working on the whole stage code gen for the sort based aggregation.
yucai created SPARK-17635:
-
Summary: Remove hardcode "agg_plan" in HashAggregateExec
Key: SPARK-17635
URL: https://issues.apache.org/jira/browse/SPARK-17635
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-11702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654077#comment-15654077
]
yucai commented on SPARK-11702:
---
Has this issue been fixed already? Seem like I don't meet it in 2.0 branch
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Motivation*
Our customers want to use SSD to speed up machine learning and SQL workload,
but
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-12196:
--
Description:
*Motivation*
Our customers want to use SSD to speed up machine learning and SQL workload,
but
[
https://issues.apache.org/jira/browse/SPARK-19180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819400#comment-15819400
]
yucai commented on SPARK-19180:
---
Hi Owen,
Thanks a lot for comments, it is using unsafe API for
yucai created SPARK-19180:
-
Summary: the offset of short is 4 in OffHeapColumnVector's
putShorts
Key: SPARK-19180
URL: https://issues.apache.org/jira/browse/SPARK-19180
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-12704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956285#comment-15956285
]
yucai commented on SPARK-12704:
---
When sort-merge-join and shuffled-hash-join, the sparkPlan looks like
yucai created SPARK-20381:
-
Summary: ObjectHashAggregateExec is missing numOutputRows
Key: SPARK-20381
URL: https://issues.apache.org/jira/browse/SPARK-20381
Project: Spark
Issue Type: Bug
yucai created SPARK-22540:
-
Summary: HighlyCompressedMapStatus's avgSize is incorrect
Key: SPARK-22540
URL: https://issues.apache.org/jira/browse/SPARK-22540
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-22540:
--
Description:
The calculation of HighlyCompressedMapStatus's avgSize is incorrect.
Currently, it looks like
[
https://issues.apache.org/jira/browse/SPARK-24343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-24343:
--
Description:
When shuffle.partition > bucket number, Spark needs to shuffle the bucket table
as per the
[
https://issues.apache.org/jira/browse/SPARK-24343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-24343:
--
Description:
When shuffle.partition > bucket number, Spark needs to shuffle the bucket table
as per the
yucai created SPARK-24343:
-
Summary: Avoid shuffle for the bucketed table when
shuffle.partition > bucket number
Key: SPARK-24343
URL: https://issues.apache.org/jira/browse/SPARK-24343
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-24343:
--
Description:
When shuffle.partition > bucket number, Spark needs to shuffle the bucket table
as per the
yucai created SPARK-24556:
-
Summary: ReusedExchange should rewrite output partitioning also
when child's partitioning is RangePartitioning
Key: SPARK-24556
URL: https://issues.apache.org/jira/browse/SPARK-24556
[
https://issues.apache.org/jira/browse/SPARK-24556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-24556:
--
Description:
Currently, ReusedExchange would rewrite output partitioning if child's
partitioning is
[
https://issues.apache.org/jira/browse/SPARK-24556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-24556:
--
Description:
Currently, ReusedExchange would rewrite output partitioning if child's
partitioning is
[
https://issues.apache.org/jira/browse/SPARK-24925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556818#comment-16556818
]
yucai commented on SPARK-24925:
---
I think there could be two issues.
In FileScanRDD
1. ColumnarBatch's
yucai created SPARK-24925:
-
Summary: input bytesRead metrics fluctuate from time to time
Key: SPARK-24925
URL: https://issues.apache.org/jira/browse/SPARK-24925
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-24925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-24925:
--
Description:
input bytesRead metrics fluctuate from time to time, it is worse when pushdown
enabled.
Query
[
https://issues.apache.org/jira/browse/SPARK-24925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-24925:
--
Attachment: bytesRead.gif
> input bytesRead metrics fluctuate from time to time
>
[
https://issues.apache.org/jira/browse/SPARK-24832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-24832:
--
Summary: Improve inputMetrics's bytesRead update for ColumnarBatch (was:
When pushdown enabled, input
[
https://issues.apache.org/jira/browse/SPARK-24832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-24832:
--
Summary: When pushdown enabled, input bytesRead metrics is easy to
fluctuate from time to time (was: Improve
[
https://issues.apache.org/jira/browse/SPARK-24925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556820#comment-16556820
]
yucai commented on SPARK-24925:
---
[~cloud_fan], [~xiaoli] , [~kiszk] , any comments?
> input bytesRead
[
https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576417#comment-16576417
]
yucai edited comment on SPARK-25084 at 8/10/18 3:17 PM:
[~smilegator],
[
https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576417#comment-16576417
]
yucai commented on SPARK-25084:
---
[~smilegator][~jerryshao]
Thanks a lot for marking it blocker.
A lot of
[
https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582667#comment-16582667
]
yucai commented on SPARK-25132:
---
If Spark allows data source case insensitive, query t2 should return
[
https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583145#comment-16583145
]
yucai commented on SPARK-25132:
---
[~cloud_fan] [~smilegator] [~budde] [~ekhliang], do you have any insight?
yucai created SPARK-25084:
-
Summary: "distribute by" on multiple columns may lead to codegen
issue
Key: SPARK-25084
URL: https://issues.apache.org/jira/browse/SPARK-25084
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-25084:
--
Description:
Test Query:
{code:java}
select * from store_sales distribute by (ss_sold_time_sk, ss_item_sk,
[
https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575808#comment-16575808
]
yucai commented on SPARK-25084:
---
It is a regression, when the generated codes size is more than 1024,
[
https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-25206:
--
Attachment: image-2018-08-24-18-05-23-485.png
> Wrong data may be returned when enable pushdown
>
[
https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591756#comment-16591756
]
yucai commented on SPARK-25206:
---
[~cloud_fan] , we need both [https://github.com/apache/spark/pull/21696]
[
https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-25206:
--
Attachment: image-2018-08-24-22-33-03-231.png
> Wrong data may be returned when enable pushdown
>
[
https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-25206:
--
Attachment: image-2018-08-24-22-46-05-346.png
> Wrong data may be returned when enable pushdown
>
[
https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-25206:
--
Attachment: image-2018-08-24-22-34-11-539.png
> Wrong data may be returned when enable pushdown
>
[
https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-25206:
--
Attachment: pr22183.png
> Wrong data may be returned when enable pushdown
>
[
https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592392#comment-16592392
]
yucai commented on SPARK-25206:
---
[~dongjoon] , the reason you see `null` without predicate pushdown, it is
[
https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-25206:
--
Attachment: image-2018-08-25-10-04-21-901.png
> Wrong data may be returned for Parquet
>
[
https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592384#comment-16592384
]
yucai commented on SPARK-25206:
---
[~dongjoon], I still think this bug is related to pushdown, but
[
https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yucai updated SPARK-25206:
--
Attachment: image-2018-08-25-09-54-53-219.png
> Wrong data may be returned for Parquet
>
1 - 100 of 171 matches
Mail list logo
