[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422529#comment-16422529
]
Rui Li commented on HIVE-18955:
---
The failures don't seem related since they've been failing in previous
[
https://issues.apache.org/jira/browse/HIVE-18831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420253#comment-16420253
]
Rui Li commented on HIVE-18831:
---
[~stakiar], yeah I agree sending a Throwable makes it easier to retrieve
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420062#comment-16420062
]
Rui Li commented on HIVE-18955:
---
Re-upload the patch for another ptest run.
[~stakiar], do you think we can
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18955:
--
Attachment: HIVE-18955.1.patch
> HoS: Unable to create Channel from class NioServerSocketChannel
>
[
https://issues.apache.org/jira/browse/HIVE-18831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418971#comment-16418971
]
Rui Li commented on HIVE-18831:
---
Besides, I think the {{JobResultSerializer}} has some problems:
# It
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418871#comment-16418871
]
Rui Li commented on HIVE-18955:
---
Hi [~jcamachorodriguez], [~bslim], do you have further comments about the
[
https://issues.apache.org/jira/browse/HIVE-18831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418463#comment-16418463
]
Rui Li commented on HIVE-18831:
---
[~stakiar], I think the right way to register the serializer is to call
[
https://issues.apache.org/jira/browse/HIVE-18831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416858#comment-16416858
]
Rui Li commented on HIVE-18831:
---
How about we register a custom serializer for {{JobResult}}, which can try
[
https://issues.apache.org/jira/browse/HIVE-18831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415746#comment-16415746
]
Rui Li commented on HIVE-18831:
---
Hi [~stakiar], thanks for the explanation. I agree differentiating task
[
https://issues.apache.org/jira/browse/HIVE-18925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413785#comment-16413785
]
Rui Li commented on HIVE-18925:
---
BTW, the patch should be named {{HIVE-18925.2.patch}}. [~findepi] please
[
https://issues.apache.org/jira/browse/HIVE-18925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413779#comment-16413779
]
Rui Li commented on HIVE-18925:
---
Thanks [~findepi] for the update. Currently we don't have a way to prevent
[
https://issues.apache.org/jira/browse/HIVE-18831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413610#comment-16413610
]
Rui Li commented on HIVE-18831:
---
Hey [~stakiar], I'm not sure about the benefit of this refactor. It seems
[
https://issues.apache.org/jira/browse/HIVE-18925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411192#comment-16411192
]
Rui Li commented on HIVE-18925:
---
I tried TestTimestampParser#testPattern2. We parsed {{05:06:07 (of pattern
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411122#comment-16411122
]
Rui Li commented on HIVE-18955:
---
Hi [~bslim], we have these dependency chains to {{async-http-client}}:
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18955:
--
Status: Patch Available (was: Open)
> HoS: Unable to create Channel from class NioServerSocketChannel
>
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18955:
--
Attachment: HIVE-18955.1.patch
> HoS: Unable to create Channel from class NioServerSocketChannel
>
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-18955:
-
Assignee: Rui Li
> HoS: Unable to create Channel from class NioServerSocketChannel
>
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18955:
--
Priority: Blocker (was: Major)
> HoS: Unable to create Channel from class NioServerSocketChannel
>
[
https://issues.apache.org/jira/browse/HIVE-18974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405762#comment-16405762
]
Rui Li commented on HIVE-18974:
---
Could be the same issue as HIVE-14305. Does the machine's system timezone
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401364#comment-16401364
]
Rui Li commented on HIVE-18955:
---
Hi [~bslim], both {{netty-all-4.1.17.Final.jar}} and
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400408#comment-16400408
]
Rui Li commented on HIVE-18955:
---
Found a similar issue here
[
https://issues.apache.org/jira/browse/HIVE-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398614#comment-16398614
]
Rui Li commented on HIVE-18955:
---
Maybe related to HIVE-18436.
> HoS: Unable to create Channel from class
[
https://issues.apache.org/jira/browse/HIVE-18925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398313#comment-16398313
]
Rui Li commented on HIVE-18925:
---
Hi [~findepi], the patch looks good to me. You need to press submit patch
[
https://issues.apache.org/jira/browse/HIVE-18034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396827#comment-16396827
]
Rui Li commented on HIVE-18034:
---
+1
> Improving logging with HoS executors spend lots of time in GC
>
[
https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395269#comment-16395269
]
Rui Li commented on HIVE-18916:
---
[~stakiar], is this issue easy to reproduce? When the thread monitoring
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-17178:
--
Resolution: Fixed
Fix Version/s: 3.0.0
Status: Resolved (was: Patch Available)
Pushed to
[
https://issues.apache.org/jira/browse/HIVE-18436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392316#comment-16392316
]
Rui Li commented on HIVE-18436:
---
Got it. Thanks for explaining. +1
> Upgrade to Spark 2.3.0
>
[
https://issues.apache.org/jira/browse/HIVE-18436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391072#comment-16391072
]
Rui Li commented on HIVE-18436:
---
Thanks [~stakiar] for tracking this. Why do we need the changes in tests?
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-17178:
--
Attachment: HIVE-17178.6.patch
> Spark Partition Pruning Sink Operator can't target multiple Works
>
[
https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388915#comment-16388915
]
Rui Li commented on HIVE-15104:
---
[~stakiar], thanks for trying this out.
bq. The HiveKryoRegistrator still
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387444#comment-16387444
]
Rui Li commented on HIVE-17178:
---
[~stakiar], let me know if you have any further comments on the latest
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-17178:
--
Attachment: HIVE-17178.5.patch
> Spark Partition Pruning Sink Operator can't target multiple Works
>
[
https://issues.apache.org/jira/browse/HIVE-18645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18645:
--
Resolution: Fixed
Fix Version/s: 3.0.0
Status: Resolved (was: Patch Available)
Pushed to
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368740#comment-16368740
]
Rui Li commented on HIVE-17178:
---
Latest failures are not related. [~stakiar], please take another look.
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368421#comment-16368421
]
Rui Li commented on HIVE-17178:
---
Update test to give table different sizes, so that query plan should be
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-17178:
--
Attachment: HIVE-17178.4.patch
> Spark Partition Pruning Sink Operator can't target multiple Works
>
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18442:
--
Resolution: Fixed
Fix Version/s: 3.0.0
Status: Resolved (was: Patch Available)
Pushed to
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18442:
--
Attachment: (was: HIVE-18442.2.patch)
> HoS: No FileSystem for scheme: nullscan
>
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361912#comment-16361912
]
Rui Li commented on HIVE-17178:
---
Update to address RB comments.
> Spark Partition Pruning Sink Operator
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-17178:
--
Attachment: HIVE-17178.3.patch
> Spark Partition Pruning Sink Operator can't target multiple Works
>
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361645#comment-16361645
]
Rui Li commented on HIVE-18442:
---
[~xuefuz], it doesn't change the class path, but it adds the binding to the
[
https://issues.apache.org/jira/browse/HIVE-18350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359812#comment-16359812
]
Rui Li commented on HIVE-18350:
---
Thanks [~djaiswal], it works now.
> load data should rename files
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359802#comment-16359802
]
Rui Li commented on HIVE-18442:
---
[~xuefuz], my concern about {{spark.yarn.user.classpath.first}} is it's not
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358336#comment-16358336
]
Rui Li commented on HIVE-17178:
---
[~xuefuz], could you also take a look? Thanks.
> Spark Partition Pruning
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358335#comment-16358335
]
Rui Li commented on HIVE-18442:
---
Hi [~xuefuz], I still can't find a way to add hive-exec to system class
[
https://issues.apache.org/jira/browse/HIVE-17837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358284#comment-16358284
]
Rui Li commented on HIVE-17837:
---
+1, thanks [~stakiar] for the clarifications
> Explicitly check if the HoS
[
https://issues.apache.org/jira/browse/HIVE-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356778#comment-16356778
]
Rui Li commented on HIVE-18647:
---
Seems related to HIVE-18350
> Cannot create table: Unknown column
>
[
https://issues.apache.org/jira/browse/HIVE-18350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356776#comment-16356776
]
Rui Li commented on HIVE-18350:
---
Hi [~djaiswal], with this change, I hit [this
[
https://issues.apache.org/jira/browse/HIVE-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356761#comment-16356761
]
Rui Li edited comment on HIVE-18647 at 2/8/18 10:18 AM:
Hi [~jcamachorodriguez],
[
https://issues.apache.org/jira/browse/HIVE-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356761#comment-16356761
]
Rui Li commented on HIVE-18647:
---
Hi [~jcamachorodriguez], with the latest code, I hit a different issue:
[
https://issues.apache.org/jira/browse/HIVE-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18647:
--
Description:
I'm using latest master branch code and mysql as metastore.
Creating table hits this error:
[
https://issues.apache.org/jira/browse/HIVE-18368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355472#comment-16355472
]
Rui Li commented on HIVE-18368:
---
+1. Thanks [~stakiar] for the update.
> Improve Spark Debug RDD Graph
>
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354088#comment-16354088
]
Rui Li commented on HIVE-18442:
---
I made a mistake about spark.driver.extraClassPath: it can only contain
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18442:
--
Attachment: HIVE-18442.2.patch
> HoS: No FileSystem for scheme: nullscan
>
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348266#comment-16348266
]
Rui Li commented on HIVE-18442:
---
[~xuefuz], the two options achieve the same purpose: add hive-exec.jar to
[
https://issues.apache.org/jira/browse/HIVE-18301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346196#comment-16346196
]
Rui Li commented on HIVE-18301:
---
Hi [~kellyzly], is the input path the only thing we need to store with
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345025#comment-16345025
]
Rui Li commented on HIVE-17178:
---
[~stakiar], could you take a look? Thanks.
> Spark Partition Pruning Sink
[
https://issues.apache.org/jira/browse/HIVE-18368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340806#comment-16340806
]
Rui Li commented on HIVE-18368:
---
Looks good to me overall. Left some minor comments on RB.
> Improve Spark
[
https://issues.apache.org/jira/browse/HIVE-18301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337632#comment-16337632
]
Rui Li commented on HIVE-18301:
---
Hi [~kellyzly], does the proposed solution mean we need to cache the input
[
https://issues.apache.org/jira/browse/HIVE-18301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336898#comment-16336898
]
Rui Li commented on HIVE-18301:
---
{quote}We need not to call MapOperator#cleanUpInputFileChanged because
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334274#comment-16334274
]
Rui Li commented on HIVE-17178:
---
Update with some refactor and a new test. A brief summary of the change:
#
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-17178:
--
Attachment: HIVE-17178.2.patch
> Spark Partition Pruning Sink Operator can't target multiple Works
>
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-17178:
--
Status: Patch Available (was: Open)
> Spark Partition Pruning Sink Operator can't target multiple Works
>
[
https://issues.apache.org/jira/browse/HIVE-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-17178:
--
Attachment: HIVE-17178.1.patch
> Spark Partition Pruning Sink Operator can't target multiple Works
>
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329909#comment-16329909
]
Rui Li commented on HIVE-18442:
---
Hi [~xuefuz], I believe it's related to how hive-exec.jar is added to
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328530#comment-16328530
]
Rui Li commented on HIVE-18442:
---
The failures are not related.
[~stakiar] [~xuefuz] could you take a look?
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326133#comment-16326133
]
Rui Li commented on HIVE-18442:
---
I didn't add a qtest for this because we have hive-exec.jar in driver's
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18442:
--
Status: Patch Available (was: Open)
> HoS: No FileSystem for scheme: nullscan
>
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18442:
--
Attachment: HIVE-18442.1.patch
> HoS: No FileSystem for scheme: nullscan
>
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323967#comment-16323967
]
Rui Li commented on HIVE-18442:
---
The issue seems to related to class loading. FileSystem uses ServiceLoader
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18442:
--
Description:
Hit the issue when I run following query in yarn-cluster mode:
{code}
select * from (select key
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18148:
--
Resolution: Fixed
Fix Version/s: 3.0.0
Status: Resolved (was: Patch Available)
Pushed to
[
https://issues.apache.org/jira/browse/HIVE-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-18442:
-
> HoS: No FileSystem for scheme: nullscan
> ---
>
> Key:
[
https://issues.apache.org/jira/browse/HIVE-18441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16322182#comment-16322182
]
Rui Li commented on HIVE-18441:
---
Hi [~hengyu.dai], do you know why the path has no scheme? I suppose we
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18148:
--
Attachment: HIVE-18148.4.patch
Moved the code into SparkUtilities
> NPE in
[
https://issues.apache.org/jira/browse/HIVE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321859#comment-16321859
]
Rui Li commented on HIVE-12338:
---
Hey [~jxiang], [~szehon], is there any way to programmatically retrieve the
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319959#comment-16319959
]
Rui Li edited comment on HIVE-18148 at 1/10/18 9:45 AM:
Hi [~stakiar],
bq. Is
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319959#comment-16319959
]
Rui Li commented on HIVE-18148:
---
Hi [~stakiar],
bq. Is there any way to move the code changes into
[
https://issues.apache.org/jira/browse/HIVE-18368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319913#comment-16319913
]
Rui Li commented on HIVE-18368:
---
Hi [~stakiar], two questions regarding the screenshot:
# Why the num of
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318338#comment-16318338
]
Rui Li commented on HIVE-18148:
---
[~xuefuz], [~stakiar], could you also take a look? This is somewhat
[
https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317692#comment-16317692
]
Rui Li commented on HIVE-16484:
---
bq. Hive wouldn't need a separate Spark installation to be able to launch
[
https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316130#comment-16316130
]
Rui Li commented on HIVE-16484:
---
Hi [~stakiar], got a higher level question: what's the main advantage of
[
https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313162#comment-16313162
]
Rui Li commented on HIVE-16484:
---
Thanks [~stakiar] for the work! I had a quick glance at the code and left
[
https://issues.apache.org/jira/browse/HIVE-17929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309247#comment-16309247
]
Rui Li commented on HIVE-17929:
---
+1
> Use sessionId for HoS Remote Driver Client id
>
[
https://issues.apache.org/jira/browse/HIVE-18301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306218#comment-16306218
]
Rui Li commented on HIVE-18301:
---
I think SMB map join is one case where the "input file change" event is
[
https://issues.apache.org/jira/browse/HIVE-18301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16304383#comment-16304383
]
Rui Li commented on HIVE-18301:
---
My understanding is if the HadoopRDD is cached, the records are not
[
https://issues.apache.org/jira/browse/HIVE-18301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303680#comment-16303680
]
Rui Li commented on HIVE-18301:
---
I think we need to investigate how the input path is used, and what the
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18148:
--
Attachment: HIVE-18148.3.patch
Fix the check style.
> NPE in SparkDynamicPartitionPruningResolver
>
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297994#comment-16297994
]
Rui Li commented on HIVE-18148:
---
Both the target table size and the DPP sink output size (smaller output
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297915#comment-16297915
]
Rui Li commented on HIVE-18148:
---
[~kellyzly], we can remove either DPP1 or DPP2 to fix the NPE. I keep the
[
https://issues.apache.org/jira/browse/HIVE-18301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297894#comment-16297894
]
Rui Li commented on HIVE-18301:
---
If we can cache MapInput, will it be simpler to dynamically identify same
[
https://issues.apache.org/jira/browse/HIVE-18289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297893#comment-16297893
]
Rui Li commented on HIVE-18289:
---
It seems the reason is OrcStruct doesn't have an empty constructor.
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297883#comment-16297883
]
Rui Li commented on HIVE-18148:
---
bq. If first tranverses JOIN, then remove DPP2.
No, it only collects DPP
[
https://issues.apache.org/jira/browse/HIVE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297869#comment-16297869
]
Rui Li commented on HIVE-18282:
---
Thanks [~stakiar] for uploading the file. Do you think we can make the code
[
https://issues.apache.org/jira/browse/HIVE-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297832#comment-16297832
]
Rui Li commented on HIVE-18304:
---
I can't reproduce the issue on my side - the two queries return the same
[
https://issues.apache.org/jira/browse/HIVE-18111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18111:
--
Resolution: Fixed
Fix Version/s: 3.0.0
Status: Resolved (was: Patch Available)
Pushed to
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18148:
--
Attachment: HIVE-18148.2.patch
Update patch v2 to fix a bug: we shouldn't stop searching at MJ operator.
[
https://issues.apache.org/jira/browse/HIVE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18282:
--
Status: Patch Available (was: Open)
> Spark tar is downloaded every time for itest
>
[
https://issues.apache.org/jira/browse/HIVE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-18282:
--
Attachment: HIVE-18282.1.patch
Meanwhile, I think it's better to avoid the re-download when we can't download
[
https://issues.apache.org/jira/browse/HIVE-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288933#comment-16288933
]
Rui Li commented on HIVE-18148:
---
[~kellyzly], that's OK. I didn't add it because it's already default.
>
101 - 200 of 1457 matches
Mail list logo
