[
https://issues.apache.org/jira/browse/HIVE-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-14139:
--
Resolution: Fixed
Fix Version/s: 2.2.0
Status: Resolved (was: Patch Available)
Committed to
[
https://issues.apache.org/jira/browse/HIVE-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-14139:
--
Attachment: HIVE-14139.4.patch
Patch v4 adds safe check to avoid the NPE.
[~sershe], could you take a look and
[
https://issues.apache.org/jira/browse/HIVE-14156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365954#comment-15365954
]
Rui Li commented on HIVE-14156:
---
According to wiki, the minimum supported MySQL version is 5.6.17.
>
[
https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365550#comment-15365550
]
Rui Li commented on HIVE-13278:
---
[~stakiar] - it seems not worth the extra complexity to just avoid annoying
[
https://issues.apache.org/jira/browse/HIVE-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365509#comment-15365509
]
Rui Li commented on HIVE-14139:
---
Hi [~sershe], sorry the code in my last comment is the patched version.
[
https://issues.apache.org/jira/browse/HIVE-14156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365480#comment-15365480
]
Rui Li commented on HIVE-14156:
---
[~Ferd] - my understanding is that when Hive creates database and tables,
[
https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363656#comment-15363656
]
Rui Li commented on HIVE-13278:
---
My understanding is {{HiveOutputFormatImpl.checkOutputSpecs}} only looks
[
https://issues.apache.org/jira/browse/HIVE-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363624#comment-15363624
]
Rui Li commented on HIVE-14139:
---
[~sershe] - do you mean we should just return if {{refCount}} is null?
[
https://issues.apache.org/jira/browse/HIVE-14156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363618#comment-15363618
]
Rui Li commented on HIVE-14156:
---
Thanks [~xuefuz] and [~niklaus.xiao] for your inputs.
Besides configuring
[
https://issues.apache.org/jira/browse/HIVE-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-14139:
--
Attachment: HIVE-14139.3.patch
Just realised I missed some update to the new test. Upload patch v3 for that.
>
[
https://issues.apache.org/jira/browse/HIVE-14156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362278#comment-15362278
]
Rui Li commented on HIVE-14156:
---
Hi [~xuefuz], do you have any idea on this one? Is user allowed to use
[
https://issues.apache.org/jira/browse/HIVE-14156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362010#comment-15362010
]
Rui Li commented on HIVE-14156:
---
[~libing], is this issue specific to MySQL?
> Problem with Chinese
[
https://issues.apache.org/jira/browse/HIVE-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-14139:
--
Attachment: HIVE-14139.2.patch
Patch v2 makes the persistent map of className -> refCount. This way, we don't
[
https://issues.apache.org/jira/browse/HIVE-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359888#comment-15359888
]
Rui Li commented on HIVE-14139:
---
Thanks [~sershe] for the explanations. I agree performance is a valid
[
https://issues.apache.org/jira/browse/HIVE-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-14139:
--
Attachment: HIVE-14139.1.patch
The v1 patch registers function to session when loading them. Verified it fixes
[
https://issues.apache.org/jira/browse/HIVE-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-14139:
--
Status: Patch Available (was: Open)
> NPE dropping permanent function
> ---
>
>
[
https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15358317#comment-15358317
]
Rui Li commented on HIVE-13278:
---
Thanks [~stakiar] for the explanation. Then my question is can we avoid
[
https://issues.apache.org/jira/browse/HIVE-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15358251#comment-15358251
]
Rui Li commented on HIVE-14139:
---
The problem is that we failed to register the function with
[
https://issues.apache.org/jira/browse/HIVE-14092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356830#comment-15356830
]
Rui Li commented on HIVE-14092:
---
I guess this fixes HIVE-13277 and HIVE-12677? The root cause should be with
[
https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13278:
--
Description:
Many redundant 'File not found' messages appeared in container log during query
execution with
[
https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356634#comment-15356634
]
Rui Li commented on HIVE-13278:
---
HIVE-11243 changes the log level. Is it possible to avoid such log?
> Many
[
https://issues.apache.org/jira/browse/HIVE-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352229#comment-15352229
]
Rui Li commented on HIVE-13997:
---
Thanks for the review Ashutosh :)
> Insert overwrite directory doesn't
[
https://issues.apache.org/jira/browse/HIVE-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13997:
--
Attachment: HIVE-13997.2.patch
Try again.
> Insert overwrite directory doesn't overwrite existing files
>
[
https://issues.apache.org/jira/browse/HIVE-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349952#comment-15349952
]
Rui Li commented on HIVE-13997:
---
V2 patch moved the delete logic to moveFileInDfs. If Hive.moveFile is
[
https://issues.apache.org/jira/browse/HIVE-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13997:
--
Attachment: HIVE-13997.2.patch
> Insert overwrite directory doesn't overwrite existing files
>
[
https://issues.apache.org/jira/browse/HIVE-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337687#comment-15337687
]
Rui Li commented on HIVE-13997:
---
Hi [~ashutoshc], since we are inserting into directory, we don't need to
[
https://issues.apache.org/jira/browse/HIVE-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327354#comment-15327354
]
Rui Li commented on HIVE-13997:
---
{{ppd_multi_insert}} is related. I'll look into it.
> Insert overwrite
[
https://issues.apache.org/jira/browse/HIVE-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327150#comment-15327150
]
Rui Li commented on HIVE-13997:
---
[~ashutoshc], would you take a look? Thanks!
> Insert overwrite directory
[
https://issues.apache.org/jira/browse/HIVE-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327149#comment-15327149
]
Rui Li commented on HIVE-13997:
---
The patch deletes all existing files in dest dir if we're told to overwrite
[
https://issues.apache.org/jira/browse/HIVE-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13997:
--
Attachment: HIVE-13997.1.patch
> Insert overwrite directory doesn't overwrite existing files
>
[
https://issues.apache.org/jira/browse/HIVE-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13997:
--
Status: Patch Available (was: Open)
> Insert overwrite directory doesn't overwrite existing files
>
[
https://issues.apache.org/jira/browse/HIVE-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13921:
--
Resolution: Fixed
Fix Version/s: 2.2.0
Status: Resolved (was: Patch Available)
Committed to
[
https://issues.apache.org/jira/browse/HIVE-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13921:
--
Description:
{{index_bitmap3}} and {{constprog_partitioner}} have been failing. Let's fix
them here.
EDIT:
[
https://issues.apache.org/jira/browse/HIVE-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13921:
--
Summary: Fix constprog_partitioner for HoS (was: Fix spark on yarn tests
for HoS)
> Fix constprog_partitioner
[
https://issues.apache.org/jira/browse/HIVE-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13921:
--
Attachment: HIVE-13921.2.patch
OK. Upload a patch that only updates the golden file. And filed HIVE-13997 to
[
https://issues.apache.org/jira/browse/HIVE-13968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13968:
--
Fix Version/s: 2.2.0
> CombineHiveInputFormat does not honor InputFormat that implements
>
[
https://issues.apache.org/jira/browse/HIVE-13968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326136#comment-15326136
]
Rui Li commented on HIVE-13968:
---
Committed to master. Thanks [~prasanna@gmail.com] for the contribution.
[
https://issues.apache.org/jira/browse/HIVE-13968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324340#comment-15324340
]
Rui Li commented on HIVE-13968:
---
+1
> CombineHiveInputFormat does not honor InputFormat that implements
>
[
https://issues.apache.org/jira/browse/HIVE-13968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321768#comment-15321768
]
Rui Li commented on HIVE-13968:
---
Thanks [~prasanna@gmail.com] for adding the test. Just one minor
[
https://issues.apache.org/jira/browse/HIVE-13968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319842#comment-15319842
]
Rui Li commented on HIVE-13968:
---
Thanks [~prasanna@gmail.com] for fixing it. The patch looks good to me.
[
https://issues.apache.org/jira/browse/HIVE-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317859#comment-15317859
]
Rui Li commented on HIVE-13921:
---
For {{constprog_partitioner}}, the patch updates the golden file for HoS.
[
https://issues.apache.org/jira/browse/HIVE-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13921:
--
Attachment: HIVE-13921.1.patch
> Fix spark on yarn tests for HoS
> ---
>
>
[
https://issues.apache.org/jira/browse/HIVE-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13921:
--
Status: Patch Available (was: Open)
> Fix spark on yarn tests for HoS
> ---
>
>
[
https://issues.apache.org/jira/browse/HIVE-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13895:
--
Resolution: Fixed
Fix Version/s: 2.2.0
Status: Resolved (was: Patch Available)
Committed to
[
https://issues.apache.org/jira/browse/HIVE-13918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311657#comment-15311657
]
Rui Li commented on HIVE-13918:
---
I'll fix TestMiniSparkOnYarnCliDriver failures in HIVE-13921.
> Towards a
[
https://issues.apache.org/jira/browse/HIVE-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311652#comment-15311652
]
Rui Li commented on HIVE-13895:
---
Test failures are not related. I'll fix {{constprog_partitioner}} and
[
https://issues.apache.org/jira/browse/HIVE-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306373#comment-15306373
]
Rui Li commented on HIVE-13895:
---
Pinging [~xuefuz] and [~szehon]
> HoS start-up overhead in yarn-client
[
https://issues.apache.org/jira/browse/HIVE-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13895:
--
Status: Patch Available (was: Open)
> HoS start-up overhead in yarn-client mode
>
[
https://issues.apache.org/jira/browse/HIVE-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13895:
--
Attachment: HIVE-13895.1.patch
> HoS start-up overhead in yarn-client mode
>
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303379#comment-15303379
]
Rui Li commented on HIVE-13376:
---
[~xuefuz], [~szehon] - I just did more tests about this and want to correct
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301613#comment-15301613
]
Rui Li commented on HIVE-13376:
---
Hi [~xuefuz], I just briefly looked at the code. Although there're switches
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300260#comment-15300260
]
Rui Li commented on HIVE-13376:
---
Spark checks the app state and then (optionally) logs the state report. No
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299669#comment-15299669
]
Rui Li commented on HIVE-13376:
---
I think the default 60s interval is a little too long. Spark will at least
[
https://issues.apache.org/jira/browse/HIVE-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13789:
--
Resolution: Fixed
Fix Version/s: 2.1.0
Status: Resolved (was: Patch Available)
Committed to
[
https://issues.apache.org/jira/browse/HIVE-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296039#comment-15296039
]
Rui Li commented on HIVE-13789:
---
Test failures cannot be reproduced locally.
> Repeatedly checking
[
https://issues.apache.org/jira/browse/HIVE-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15290621#comment-15290621
]
Rui Li commented on HIVE-13789:
---
Also pinging the original author [~namit]
> Repeatedly checking
[
https://issues.apache.org/jira/browse/HIVE-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15290614#comment-15290614
]
Rui Li commented on HIVE-13789:
---
[~xuefuz] could you take a look at this? Thanks.
> Repeatedly checking
[
https://issues.apache.org/jira/browse/HIVE-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13789:
--
Attachment: HIVE-13789.1.patch
> Repeatedly checking configuration in TextRecordWriter/Reader hurts performance
[
https://issues.apache.org/jira/browse/HIVE-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13789:
--
Status: Patch Available (was: Open)
> Repeatedly checking configuration in TextRecordWriter/Reader hurts
[
https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13293:
--
Resolution: Fixed
Fix Version/s: 2.1.0
Status: Resolved (was: Patch Available)
Committed to
[
https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285944#comment-15285944
]
Rui Li commented on HIVE-13293:
---
Hi [~xuefuz], any further comments on this one?
> Query occurs performance
[
https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284369#comment-15284369
]
Rui Li commented on HIVE-13293:
---
None of the failures can be reproduced locally. Seems the test framework
[
https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13293:
--
Attachment: HIVE-13293.3.patch
> Query occurs performance degradation after enabling parallel order by for
>
[
https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13293:
--
Attachment: HIVE-13293.3.patch
[~xuefuz] - yeah sampling is needed only if we have more than 1 partitions. So
[
https://issues.apache.org/jira/browse/HIVE-13662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282534#comment-15282534
]
Rui Li commented on HIVE-13662:
---
Sure [~pxiong], thanks for working on it.
> Set file permission and ACL in
[
https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13293:
--
Attachment: HIVE-13293.3.patch
Just thought of a better way to check whether an RDD has been cached.
> Query
[
https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13293:
--
Attachment: (was: HIVE-13293.1.patch)
> Query occurs performance degradation after enabling parallel order
[
https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13293:
--
Attachment: HIVE-13293.2.patch
Update patch to fix test: we only cache the RDD when numPartitions > 1 and the
[
https://issues.apache.org/jira/browse/HIVE-13726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281245#comment-15281245
]
Rui Li commented on HIVE-13726:
---
That sounds good.
Do you think any failures might be related?
> Improve
[
https://issues.apache.org/jira/browse/HIVE-13726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281228#comment-15281228
]
Rui Li commented on HIVE-13726:
---
Thanks [~ashutoshc], patch looks good to me. Only left some minor comments
[
https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281147#comment-15281147
]
Rui Li commented on HIVE-13308:
---
Thanks very much [~vanzin] for your inputs. Like [~wenli] said,
[
https://issues.apache.org/jira/browse/HIVE-13716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15280424#comment-15280424
]
Rui Li commented on HIVE-13716:
---
Thanks for the update, +1.
> Improve dynamic partition loading V
>
[
https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15280347#comment-15280347
]
Rui Li commented on HIVE-13293:
---
Hi [~xuefuz], yeah order by is mostly at the end of stages. But that
[
https://issues.apache.org/jira/browse/HIVE-13716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279755#comment-15279755
]
Rui Li commented on HIVE-13716:
---
Thanks [~ashutoshc] for the patch. I left some comments on the RB.
>
[
https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279638#comment-15279638
]
Rui Li commented on HIVE-13308:
---
I think we can remove the synchronization if {{RpcServer}} is thread safe,
[
https://issues.apache.org/jira/browse/HIVE-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13293:
--
Attachment: HIVE-13293.1.patch
Upload same patch to trigger tests again. Our benchmark results show that the
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13525:
--
Resolution: Fixed
Fix Version/s: 2.1.0
Status: Resolved (was: Patch Available)
Committed to
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15275463#comment-15275463
]
Rui Li commented on HIVE-13525:
---
Thanks [~szehon] and [~xuefuz] for the review.
What triggers the
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273476#comment-15273476
]
Rui Li commented on HIVE-13525:
---
Test failures are not related.
[~xuefuz] and [~szehon], could you help
[
https://issues.apache.org/jira/browse/HIVE-13634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271760#comment-15271760
]
Rui Li commented on HIVE-13634:
---
I'll look into this one.
> Hive-on-Spark performed worse than Hive-on-MR,
[
https://issues.apache.org/jira/browse/HIVE-13634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-13634:
-
Assignee: Rui Li
> Hive-on-Spark performed worse than Hive-on-MR, for queries with external
> scripts
>
[
https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15265584#comment-15265584
]
Rui Li commented on HIVE-13572:
---
Hi [~ashutoshc], I just logged HIVE-13662 to track that.
> Redundant
[
https://issues.apache.org/jira/browse/HIVE-13662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13662:
--
Description: As suggested
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13525:
--
Attachment: HIVE-13525.3.patch
Update patch to solve the metrics lost problem.
Due to SPARK-14958, it's still
[
https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263427#comment-15263427
]
Rui Li commented on HIVE-13572:
---
Thanks [~ashutoshc] for the review.
> Redundant setting full file status
[
https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263390#comment-15263390
]
Rui Li commented on HIVE-13572:
---
[~ashutoshc] - Yeah I think we can check this one in. Test failures either
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15260193#comment-15260193
]
Rui Li commented on HIVE-13525:
---
Did more debug and found some hanging cases are related to spark not being
[
https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259412#comment-15259412
]
Rui Li commented on HIVE-13572:
---
Here's the time (in seconds) spent of copying 183 files in my local test:
[
https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259306#comment-15259306
]
Rui Li commented on HIVE-13572:
---
Just created RS for v2 patch. Changes to sessionstate and shim are trying
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258256#comment-15258256
]
Rui Li commented on HIVE-13525:
---
{{TestSparkClient.testMetricsCollection}} failure is related. The problem
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13525:
--
Attachment: (was: HIVE-13525.2.patch)
> HoS hangs when job is empty
> ---
>
>
[
https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15257765#comment-15257765
]
Rui Li commented on HIVE-13572:
---
Thanks [~ashutoshc] for the suggestion. The v2 patch sets status using
[
https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13572:
--
Status: Patch Available (was: Open)
> Redundant setting full file status in Hive::copyFiles
>
[
https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13572:
--
Status: Open (was: Patch Available)
> Redundant setting full file status in Hive::copyFiles
>
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13525:
--
Attachment: HIVE-13525.2.patch
Upload same patch to run tests.
> HoS hangs when job is empty
>
[
https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251214#comment-15251214
]
Rui Li commented on HIVE-13572:
---
[~ashutoshc] would you mind take a look at this? Thanks.
> Redundant
[
https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13572:
--
Description:
We set full file status in each copy-file thread. I think it's redundant and
hurts performance
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246965#comment-15246965
]
Rui Li commented on HIVE-13525:
---
Thanks Xuefu. I guess there's something wrong with our jenkins job?
> HoS
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-13525:
--
Attachment: HIVE-13525.2.patch
Thanks [~vanzin] and [~xuefuz] for the review! And update patch to address the
[
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243998#comment-15243998
]
Rui Li commented on HIVE-13525:
---
Sorry I didn't notice HIVE-13223 when creating the JIRA. [~szehon] do you
1101 - 1200 of 1457 matches
Mail list logo
