[
https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120813#comment-17120813
]
zhoukang commented on SPARK-24432:
--
looking forward for this feature come true +1
by the way,
[
https://issues.apache.org/jira/browse/SPARK-29564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028327#comment-17028327
]
zhoukang commented on SPARK-29564:
--
Any progress? [~cltlfcjin] We also support yarn cluster mode in our
zhoukang created SPARK-29880:
Summary: Handle submit exception when target hadoop cluster is
Federation
Key: SPARK-29880
URL: https://issues.apache.org/jira/browse/SPARK-29880
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928204#comment-16928204
]
zhoukang commented on SPARK-21492:
--
Any progress of this issue? [~jiangxb1987]
We also encountered this
[
https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861780#comment-16861780
]
zhoukang commented on SPARK-27068:
--
Sorry [~dongjoon] i am not familiar with Hive.But i think this is
[
https://issues.apache.org/jira/browse/SPARK-27827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857297#comment-16857297
]
zhoukang commented on SPARK-27827:
--
I just test this in 2.3 cluster [~dongjoon]
> File does not exist
[
https://issues.apache.org/jira/browse/SPARK-27827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-27827:
-
Affects Version/s: (was: 2.4.3)
> File does not exist notice is misleading in FileScanRDD
>
[
https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857291#comment-16857291
]
zhoukang commented on SPARK-27068:
--
[~srowen] Here is a use case in our cluster.
We have a long running
[
https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-27068:
-
Attachment: 屏幕快照 2019-06-06 下午1.12.04.png
> Support failed jobs ui and completed jobs ui use different
zhoukang created SPARK-27827:
Summary: File does not exist notice is misleading in FileScanRDD
Key: SPARK-27827
URL: https://issues.apache.org/jira/browse/SPARK-27827
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823613#comment-16823613
]
zhoukang commented on SPARK-25299:
--
nice work!
Really looking forward thanks [~yifeih]
> Use remote
[
https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822997#comment-16822997
]
zhoukang commented on SPARK-25299:
--
is there any progress of this task? [~yifeih] [~mcheah]
> Use
[
https://issues.apache.org/jira/browse/SPARK-26568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815016#comment-16815016
]
zhoukang commented on SPARK-26568:
--
It is hive client we used in spark cause this problem [~srowen]
>
[
https://issues.apache.org/jira/browse/SPARK-26703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815017#comment-16815017
]
zhoukang commented on SPARK-26703:
--
I can make a pr for this [~hyukjin.kwon]
> Hive record writer will
[
https://issues.apache.org/jira/browse/SPARK-26533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815015#comment-16815015
]
zhoukang commented on SPARK-26533:
--
I will work on this
> Support query auto cancel on thriftserver
>
[
https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815005#comment-16815005
]
zhoukang commented on SPARK-27068:
--
For long-running application like spark sql,showing failed jobs in
zhoukang created SPARK-27068:
Summary: Support failed jobs ui and completed jobs ui use
different queue
Key: SPARK-27068
URL: https://issues.apache.org/jira/browse/SPARK-27068
Project: Spark
zhoukang created SPARK-26951:
Summary: Should not throw KryoException when root cause is
IOexception
Key: SPARK-26951
URL: https://issues.apache.org/jira/browse/SPARK-26951
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26914:
-
Attachment: 26914-03.png
26914-02.png
26914-01.png
> ThriftServer
[
https://issues.apache.org/jira/browse/SPARK-26914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26914:
-
Description:
When using fair scheduler mode for thrift server, we may have unpredictable
result.
zhoukang created SPARK-26914:
Summary: ThriftServer scheduler pool may be unpredictably when
using fair schedule mode
Key: SPARK-26914
URL: https://issues.apache.org/jira/browse/SPARK-26914
Project:
[
https://issues.apache.org/jira/browse/SPARK-26703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766682#comment-16766682
]
zhoukang commented on SPARK-26703:
--
As far as i know [~hyukjin.kwon] hive is still depend on twitter
[
https://issues.apache.org/jira/browse/SPARK-26756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26756:
-
Description:
We can add support for session conf.like:
{code:java}
set spark.sql.xxx.xxx=xxx
{code}
zhoukang created SPARK-26756:
Summary: Support session conf for thriftserver
Key: SPARK-26756
URL: https://issues.apache.org/jira/browse/SPARK-26756
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26751:
-
Description:
When we run in background and we get exception which is not HiveSQLException,
we may
[
https://issues.apache.org/jira/browse/SPARK-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26751:
-
Description:
When we run in background and we get exception which is not HiveSQLException,
we may
[
https://issues.apache.org/jira/browse/SPARK-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26751:
-
Attachment: 26751.png
> HiveSessionImpl might have memory leak since Operation do not close properly
>
zhoukang created SPARK-26751:
Summary: HiveSessionImpl might have memory leak since Operation do
not close properly
Key: SPARK-26751
URL: https://issues.apache.org/jira/browse/SPARK-26751
Project: Spark
zhoukang created SPARK-26703:
Summary: Hive record writer will always depends on parquet-1.6
writer should fix it
Key: SPARK-26703
URL: https://issues.apache.org/jira/browse/SPARK-26703
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26601:
-
Summary: Make broadcast-exchange thread pool keepalivetime and
maxThreadNumber configurable (was: Make
[
https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26601:
-
Attachment: 选区_002 (1).png
选区_002.png
选区_001.png
> Make
[
https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26601:
-
Description:
Currently,thread number of broadcast-exchange thread pool is fixed and
keepAliveSeconds
[
https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26601:
-
Description:
Currently,thread number of broadcast-exchange thread pool is fixed and
keepAliveSeconds
[
https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26601:
-
Attachment: (was: 选区_002.png)
> Make broadcast-exchange thread pool keepalivetime and
[
https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26601:
-
Attachment: 26601-path2gcroot.png
26601-occupy.png
26601-largeobject.png
[
https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26601:
-
Attachment: (was: 选区_001.png)
> Make broadcast-exchange thread pool keepalivetime and
[
https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26601:
-
Attachment: (was: 选区_002 (1).png)
> Make broadcast-exchange thread pool keepalivetime and
zhoukang created SPARK-26601:
Summary: Make broadcast-exchange thread pool keepalivetime
configurable
Key: SPARK-26601
URL: https://issues.apache.org/jira/browse/SPARK-26601
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-26568:
-
Description:
The reason is that:
first we have a table with many partitions(may be several
zhoukang created SPARK-26568:
Summary: Too many partitions may cause thriftServer frequently
Full GC
Key: SPARK-26568
URL: https://issues.apache.org/jira/browse/SPARK-26568
Project: Spark
Issue
zhoukang created SPARK-26533:
Summary: Support query auto cancel on thriftserver
Key: SPARK-26533
URL: https://issues.apache.org/jira/browse/SPARK-26533
Project: Spark
Issue Type: Improvement
zhoukang created SPARK-26514:
Summary: Introduce a new conf to improve the task parallelism
Key: SPARK-26514
URL: https://issues.apache.org/jira/browse/SPARK-26514
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-24687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-24687:
-
Description:
When below exception thrown:
{code:java}
Exception in thread "dag-scheduler-event-loop"
zhoukang created SPARK-24687:
Summary: When NoClassDefError thrown during task serialization
will cause job hang
Key: SPARK-24687
URL: https://issues.apache.org/jira/browse/SPARK-24687
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-24687:
-
Description:
When below exception thrown:
{code:java}
Exception in thread "dag-scheduler-event-loop"
[
https://issues.apache.org/jira/browse/SPARK-24687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-24687:
-
Attachment: hanging-960.png
> When NoClassDefError thrown during task serialization will cause job hang
zhoukang created SPARK-24544:
Summary: Print actual failure cause when look up function failed
Key: SPARK-24544
URL: https://issues.apache.org/jira/browse/SPARK-24544
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-24515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-24515:
-
Description:
No need to warning user when output commit coordination enabled
{code:java}
// When
[
https://issues.apache.org/jira/browse/SPARK-24515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-24515:
-
Description:
{code:java}
{code}
No need to warning user when output commit coordination enabled
zhoukang created SPARK-24515:
Summary: No need to warning user when output commit coordination
enabled
Key: SPARK-24515
URL: https://issues.apache.org/jira/browse/SPARK-24515
Project: Spark
zhoukang created SPARK-24440:
Summary: When use constant as column we may get wrong answer
versus impala
Key: SPARK-24440
URL: https://issues.apache.org/jira/browse/SPARK-24440
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-24084:
-
Description: For spark-sql we can add job group id for the same statement.
(was: For thrift server we
[
https://issues.apache.org/jira/browse/SPARK-24084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-24084:
-
Summary: Add job group id for query through spark-sql (was: Add job group
id for query through Thrift
zhoukang created SPARK-24084:
Summary: Add job group id for query through Thrift Server
Key: SPARK-24084
URL: https://issues.apache.org/jira/browse/SPARK-24084
Project: Spark
Issue Type:
zhoukang created SPARK-24083:
Summary: Diagnostics message for uncaught exceptions should
include the stacktrace
Key: SPARK-24083
URL: https://issues.apache.org/jira/browse/SPARK-24083
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449254#comment-16449254
]
zhoukang commented on SPARK-24059:
--
When we set multiple local dir on different disk.
Retry will make
[
https://issues.apache.org/jira/browse/SPARK-24059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449175#comment-16449175
]
zhoukang commented on SPARK-24059:
--
cc [~vanzin] [~srowen]
If we add retry make sense?
I will work on
zhoukang created SPARK-24059:
Summary: When blacklist disable always hash to a bad local
directory may cause job failure
Key: SPARK-24059
URL: https://issues.apache.org/jira/browse/SPARK-24059
Project:
zhoukang created SPARK-24053:
Summary: Support add subdirectory named as user name on staging
directory
Key: SPARK-24053
URL: https://issues.apache.org/jira/browse/SPARK-24053
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447917#comment-16447917
]
zhoukang commented on SPARK-24052:
--
[~jiangxb] Cloud you help review this?Thanks too much!
> Support
[
https://issues.apache.org/jira/browse/SPARK-24052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-24052:
-
Description:
Since we may have multiple version in production cluster,we can showing some
information
[
https://issues.apache.org/jira/browse/SPARK-24052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-24052:
-
Attachment: environment-page.png
> Support spark version showing on environment page
>
zhoukang created SPARK-24052:
Summary: Support spark version showing on environment page
Key: SPARK-24052
URL: https://issues.apache.org/jira/browse/SPARK-24052
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-23692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang resolved SPARK-23692.
--
Resolution: Won't Fix
> Print metadata of files when infer schema failed
>
[
https://issues.apache.org/jira/browse/SPARK-23665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang resolved SPARK-23665.
--
Resolution: Won't Fix
> Add adaptive algorithm to select query result collect method
>
[
https://issues.apache.org/jira/browse/SPARK-23708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23708:
-
Issue Type: Improvement (was: Bug)
> Comment of ShutdownHookManager.addShutdownHook is error
>
[
https://issues.apache.org/jira/browse/SPARK-23708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23708:
-
Issue Type: Bug (was: Improvement)
> Comment of ShutdownHookManager.addShutdownHook is error
>
zhoukang created SPARK-23708:
Summary: Comment of ShutdownHookManager.addShutdownHook is error
Key: SPARK-23708
URL: https://issues.apache.org/jira/browse/SPARK-23708
Project: Spark
Issue Type:
zhoukang created SPARK-23692:
Summary: Print metadata of files when infer schema failed
Key: SPARK-23692
URL: https://issues.apache.org/jira/browse/SPARK-23692
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-23665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398706#comment-16398706
]
zhoukang commented on SPARK-23665:
--
Add this logic so that users do not need to choose whether to set
zhoukang created SPARK-23665:
Summary: Add adaptive algorithm to select query result collect
method
Key: SPARK-23665
URL: https://issues.apache.org/jira/browse/SPARK-23665
Project: Spark
Issue
zhoukang created SPARK-23664:
Summary: Add interface to collect query result through file
iterator
Key: SPARK-23664
URL: https://issues.apache.org/jira/browse/SPARK-23664
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-23513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391293#comment-16391293
]
zhoukang commented on SPARK-23513:
--
Could you please post some more details?[~Fray]
>
[
https://issues.apache.org/jira/browse/SPARK-23549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391282#comment-16391282
]
zhoukang edited comment on SPARK-23549 at 3/8/18 2:07 PM:
--
I think this is a
[
https://issues.apache.org/jira/browse/SPARK-23549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391282#comment-16391282
]
zhoukang commented on SPARK-23549:
--
I think this is a bug.Which may caused by rule below:
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-23335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang resolved SPARK-23335.
--
Resolution: Won't Fix
> expression 'select conv('',16,10) % 2' return 0
>
[
https://issues.apache.org/jira/browse/SPARK-23335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381827#comment-16381827
]
zhoukang commented on SPARK-23335:
--
Actually hive return the same result
{code:java}
0:
[
https://issues.apache.org/jira/browse/SPARK-23335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381827#comment-16381827
]
zhoukang edited comment on SPARK-23335 at 3/1/18 10:56 AM:
---
Actually hive
[
https://issues.apache.org/jira/browse/SPARK-23335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381824#comment-16381824
]
zhoukang commented on SPARK-23335:
--
Agree with you!
[~cloud_fan] I will search into hive.
> expression
[
https://issues.apache.org/jira/browse/SPARK-23335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381800#comment-16381800
]
zhoukang commented on SPARK-23335:
--
[~jiangxb1987]
[~cloud_fan] Any suggestion?Thanks!
> expression
[
https://issues.apache.org/jira/browse/SPARK-23508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23508:
-
Description:
blockManagerIdCache in BlockManagerId will not remove old values which may
cause oom
[
https://issues.apache.org/jira/browse/SPARK-23508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23508:
-
Description:
blockManagerIdCache in BlockManagerId will not remove old values which may
cause oom
[
https://issues.apache.org/jira/browse/SPARK-23508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23508:
-
Attachment: elephant-oom.png
elepahnt-oom1.png
> blockManagerIdCache in BlockManagerId
zhoukang created SPARK-23508:
Summary: blockManagerIdCache in BlockManagerId may cause oom
Key: SPARK-23508
URL: https://issues.apache.org/jira/browse/SPARK-23508
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-23335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23335:
-
Description:
For below expression:
{code:java}
select conv('',16,10) % 2;
{code}
it
[
https://issues.apache.org/jira/browse/SPARK-23335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23335:
-
Description:
For below expression:
{code:java}
select conv('',16,10) % 2;
{code}
it
zhoukang created SPARK-23335:
Summary: expression 'select conv('',16,10) % 2'
return 0
Key: SPARK-23335
URL: https://issues.apache.org/jira/browse/SPARK-23335
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23129:
-
Description:
Currently,the deserializeStream in ExternalAppendOnlyMap#DiskMapIterator init
when
[
https://issues.apache.org/jira/browse/SPARK-23129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23129:
-
Summary: Lazy init DiskMapIterator#deserializeStream to reduce memory usage
when ExternalAppendOnlyMap
zhoukang created SPARK-23129:
Summary: Lazy init DiskMapIterator#deserializeStream to reduce
memory usage when ExternalAppendOnlyMap spill too much times
Key: SPARK-23129
URL:
[
https://issues.apache.org/jira/browse/SPARK-23076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326685#comment-16326685
]
zhoukang commented on SPARK-23076:
--
Yes,may it should be an improvement?Since i suppose some other may
[
https://issues.apache.org/jira/browse/SPARK-23076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23076:
-
Issue Type: Improvement (was: Bug)
> When we call cache() on RDD which depends on ShuffleRowRDD, we
[
https://issues.apache.org/jira/browse/SPARK-23076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23076:
-
Summary: When we call cache() on RDD which depends on ShuffleRowRDD, we
will get an error result (was:
[
https://issues.apache.org/jira/browse/SPARK-23076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326242#comment-16326242
]
zhoukang edited comment on SPARK-23076 at 1/15/18 1:34 PM:
---
As the picture i
[
https://issues.apache.org/jira/browse/SPARK-23076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326242#comment-16326242
]
zhoukang commented on SPARK-23076:
--
As the picture i posted, i cached MapPartitionsRDD which depends on
[
https://issues.apache.org/jira/browse/SPARK-23076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23076:
-
Description:
For query below:
{code:java}
select * from csv_demo limit 3;
{code}
The correct result
[
https://issues.apache.org/jira/browse/SPARK-23076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23076:
-
Description:
For query below:
{code:java}
select * from csv_demo limit 3;
{code}
The correct result
[
https://issues.apache.org/jira/browse/SPARK-23076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23076:
-
Description:
For query below:
{code:java}
select * from csv_demo limit 3;
{code}
The correct
[
https://issues.apache.org/jira/browse/SPARK-23076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23076:
-
Description:
For query below:
{code:java}
select * from csv_demo limit 3;
{code}
The correct result
[
https://issues.apache.org/jira/browse/SPARK-23076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-23076:
-
Attachment: shufflerowrdd-cache.png
> When we call cache() on ShuffleRowRDD, we will get an error result
1 - 100 of 208 matches
Mail list logo
