Hi Zhihua,
Thanks for driving the next release. We are actively testing 4.0.0 and
would like to give some suggestions.
# HIVE-27847: Prevent query Failures on Numeric <-> Timestamp
We hit the issue when we ran Hive 4 with the option. I believe it is
worth resolving for those who want to try Hive
ally appreciate it, it means a lot to me :)
>>>>>>> The Apache Hive project and its community have truly inspired me .
>>>>>>> I'm grateful for the chance to contribute to such a remarkable project.
>>>>>>>
>>>>>>
rkable project.
>>>>>>
>>>>>> Thanks!
>>>>>> Simhadri Govindappa
>>>>>>
>>>>>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>>>>> wrote:
>>>>>>
>>>&
>>>>> grateful for the chance to contribute to such a remarkable project.
>>>>>
>>>>> Thanks!
>>>>> Simhadri Govindappa
>>>>>
>>>>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>>>
gt;>
>>>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>>> wrote:
>>>>
>>>>> Congrats Simhadri!
>>>>>
>>>>>
>>>>>
>>>>> -Sankar
>>>>>
>>>>>
>
.
>>>
>>> Thanks!
>>> Simhadri Govindappa
>>>
>>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>> wrote:
>>>
>>>> Congrats Simhadri!
>>>>
>>>>
>>>>
>>>> -Sankar
>
;
>>> Congrats Simhadri!
>>>
>>>
>>>
>>> -Sankar
>>>
>>>
>>>
>>> *From:* Butao Zhang
>>> *Sent:* Thursday, April 18, 2024 5:39 PM
>>> *To:* user@hive.apache.org; dev
>>> *
a remarkable project.
>
> Thanks!
> Simhadri Govindappa
>
> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
> wrote:
>
>> Congrats Simhadri!
>>
>>
>>
>> -Sankar
>>
>>
>>
>> *From:* Butao Zhang
>> *Sent:* Thursday, Apri
Congratulations Simhadri!
Regards,
Krisztian
On Thu, Apr 18, 2024 at 3:25 PM kokila narayanan <
kokilanarayana...@gmail.com> wrote:
> Congratulations Simhadri
>
> On Thu, 18 Apr, 2024, 17:22 Ayush Saxena, wrote:
>
>> Hi All,
>> Apache Hive's Project Management Committee (PMC) has invited
:
> Congrats Simhadri!
>
>
>
> -Sankar
>
>
>
> *From:* Butao Zhang
> *Sent:* Thursday, April 18, 2024 5:39 PM
> *To:* user@hive.apache.org; dev
> *Subject:* [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri Govindappa
>
>
>
> You don't oft
Congrats Simhadri!
-Sankar
From: Butao Zhang
Sent: Thursday, April 18, 2024 5:39 PM
To: user@hive.apache.org; dev
Subject: [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri Govindappa
You don't often get email from butaozha...@163.com<mailto:butaozha...@163.com>.
Learn why this is imp
Congratulations Simhadri !!!
Thanks.
发件人: user-return-28075-butaozhang1=163@hive.apache.org 代表 Ayush Saxena 发送时间: 星期四, 四月 18, 2024 7:50 下午收件人: dev ; user@hive.apache.org 主题: [ANNOUNCE] New Committer: Simhadri Govindappa Hi All,Apache Hive's Project Management
Congratulations and huge thanks to Apache Hive team and contributors for
releasing Hive 4. We have been watching the development of Hive 4 since the
release of Hive 3.1, and it's truly satisfying to witness the resolution of
all the critical issues at last after 5 years. Hive 4 comes with a lot of
I'm really excited to see the news! I can easily imagine the
difficulty of testing and shipping Hive 4.0.0 with more than 5k
commits. I'm proud to have witnessed this moment here.
Thank you!
On Wed, Apr 3, 2024 at 3:07 AM Naveen Gangam wrote:
>
> Thank you for the tremendous amount of work put
Thank you for the tremendous amount of work put in by many many folks to
make this release happen, including projects hive is dependent upon like
tez.
Thank you to all the PMC members, committers and contributors for all the
work over the past 5+ years in shaping this release.
THANK YOU!!!
On
Absolutely exciting news! Congrats to the entire Hive community for making this
release happen!
-Sankar
From: Pau Tallada
Sent: Tuesday, April 2, 2024 2:31 PM
To: user@hive.apache.org
Cc: d...@hive.apache.org
Subject: [EXTERNAL] Re: [ANNOUNCE] Apache Hive 4.0.0 Released
You don't often get
>
>
> Thanks,
> Butao Zhang
>
>
> Replied Message
> From Stamatis Zampetakis
> Date 4/2/2024 16:39
> To
> Cc user@hive.apache.org
> Subject Re: [ANNOUNCE] Apache Hive 4.0.0 Released
> The new Apache Hive 4.0.0 release brings roughly 5K new commits (s
@hive.apache.org |
| Subject | Re: [ANNOUNCE] Apache Hive 4.0.0 Released |
The new Apache Hive 4.0.0 release brings roughly 5K new commits (since
Apache Hive 3.1.3) and it's probably the biggest release so far in the
history of the project. The numbers clearly show that this is a
collective effort that wouldn't
The new Apache Hive 4.0.0 release brings roughly 5K new commits (since
Apache Hive 3.1.3) and it's probably the biggest release so far in the
history of the project. The numbers clearly show that this is a
collective effort that wouldn't be possible without a strong community
and many volunteers
Thank you for your hard work and dedication in releasing Apache Hive version
4.0.0.
Congratulations to the entire team on this achievement. Keep up the great work!
Does this consider as GA.?
And Looks we need to update in the following location also.?
https://hive.apache.org/general/downloads/
I should have mentioned earlier, but we encountered our problem with
queries between Trino and Hive3 MetaStore.
The tests I reported were also querying Hive1/3 MetaStore using Trino. The
problem might only exist between Trino and Hive3 MetaStore.
- Takanobu
2024年3月1日(金) 14:53 Takanobu Asanuma :
Yes, for now, we believe that HIVE-14187 has caused performance degradation
in Hive3 MetaStore.
We also use HiveServer2, but our HiveServer2 directly accesses the backend
DB without going through the Hive MetaStore, because it enhances
performance to directly access the DB in a heavily loaded
Thank you for sharing the result. (Does your result imply that HIVE-14187
is introducing an intended bug?)
Another issue that could be of your interest is the connection leak problem
reported in HIVE-20600. Do you see the connection leak problem, or is it
not relevant to your environment (e.g.,
Hi Pau and Sungwoo,
Thanks for sharing the information.
We tested a set of simple queries which just referenced the Hive table and
didn't execute any Hive jobs. The result is below.
No. Version rawstore.impl connectionPoolingType HIVE-14187 QueryTime
We didn't make any other attempt to fix the problem and just decided not to
use CachedStore. However, I think our installation of Metastore based on
Hive 3.1.3 is running without any serious problems.
Could you share how long it takes to compile typical queries in your
environment (with Hive 1
Hi,
We also had to disable CachedStore as it was producing wrong results in our
queries.
I'm sorry I cannot provide more detailed info.
Cheers,
Pau.
Missatge de Takanobu Asanuma del dia dc., 28 de febr.
2024 a les 13:59:
> Thanks for your detailed answer!
>
> In the original email, you
Thanks for your detailed answer!
In the original email, you reported "the query compilation takes long" in
Hive 3.0, but has this issue been resolved in your fork of Hive 3.1.3?
Thank you for sharing the issue with CachedStore and the JIRA tickets.
I will also try out
Hello Takanobu,
We did not test with vanilla Hive 3.1.3 and Metastore databases can be
different, so I don't know why Metastore responses are very slow. I can
only share some results of testing CachedStore in Metastore. Please note
that we did not use vanilla Hive 3.1.3 and instead used our own
Hi Sungwoo Park,
I'm sorry for the late reply to this old email.
We are attempting to upgrade Hive MetaStore from Hive1 to Hive3, and
noticed that the response of the Hive3 MetaStore is very slow.
We suspect that HIVE-14187 might be causing this slowness.
Could you tell me if you have resolved
Hi ,
No HIVE-21075 was not planned as of now in the 3.2.0 release. But will check
the feasibility and implications of the same and add it to the parent JIRA.
Its difficult to quote an exact date for the release since we are working on
backporting some important tickets (linked to parent JIRA)
re-try your use-case with the latest Apache Hive 4.0.0-beta-1
release [1] and report back if you still observe unexpected behavior.
Best,
Stamatis
[1] https://hive.apache.org/general/downloads/
On Mon, Jan 29, 2024 at 5:52 AM chang.wd wrote:
>
> Dear Hive Support Team,
>
> I hope y
nevermind, I have to set these properties on hive metastore to resolve
issue.I was setting these in HIveServer2
On Wed, Jan 17, 2024 at 11:38 PM Sanjay Gupta wrote:
>
> Hi,
> I get exactly same issue as described here in Docker container which
> is running Hive Metastore and HS2.
>
> Using Hive
Hi Henri,
I gave you the necessary permissions to the wiki. Please check and if
you encounter any issues let us know.
Best,
Stamatus
On Fri, Jan 12, 2024 at 10:56 AM Henri Biestro wrote:
>
>
> My Apache Id is hen...@apache.org.
> Cheers
>
> On 2024/01/12 09:52:20 Henri Biestro wrote:
> >
My Apache Id is hen...@apache.org.
Cheers
On 2024/01/12 09:52:20 Henri Biestro wrote:
> Hello;
> I'd like to contribute some documentation on Hive 4 - (
> https://issues.apache.org/jira/browse/HIVE-27186 for instance)
> May I get write access to the Wiki ( ie
>
For the benefit of anyone who comes across this error in future, it was solved
by adding hive.metastore.sasl.enabled and hive.metastore.kerberos.principal to
hive-site.xml on the client side, e.g. $SPARK_HOME/conf
> On 8 Jan 2024, at 16:18, Austin Hackett wrote:
>
> Hi List
>
> I'm having
Thanks Attila & Ayush,
I don't have permission to open Jira ticket yet but I have initiated process.
I have tried with Tez 9.1 and also version 10.2 and same issue.
I have noticed that when I change default hive.execution.engine=mr in
hive-site.xml ( restart hive service ) and after that start
Agree with Ayush.
Back to the original issue, is it not related to the latest Tez fix? As I
remember there was an incompatibility issue, which the next tez release
will fix. Maybe this is related to that. Sanjay could you please create a
JIRA around it for the tracking, and the community or
Hi,
I am not sure if the official built docker contains TEZ, but if you try to
build it by yourself, you can have a look at here:
https://github.com/apache/hive/blob/master/packaging/src/docker/Dockerfile#L41
To use TEZ you need to place it inside the docker container and configure
it:
Download
Hive on MR3 isn’t an official Apache Hive thing, not even an Apache OS thing, so, it is a vendor product just being tried to advertised in the ‘Apache’ Hive spaceSo, it can be all mess, filled with security issues or bugs & we Apache Hive for the record aren’t responsible for that neither do we
As far as I know, Hive-Tez supports local mode, but does not standalone
mode (like Spark). Hive-MR3 supports standalone mode, so you can run it in
any type of cluster.
--- Sungwoo
On Wed, Jan 10, 2024 at 4:22 PM Sanjay Gupta wrote:
> I can run hive with mr engine in local mode. Does Hive + Tez
I can run hive with mr engine in local mode. Does Hive + Tez also
works in standalone mode ?
On Tue, Jan 9, 2024 at 11:08 PM Sungwoo Park wrote:
>
> Hello,
>
> I don't have an answer to your problem, but if your goal is to quickly test
> Hive 3 using Docker, there is an alternative way which
Hello,
I don't have an answer to your problem, but if your goal is to quickly test
Hive 3 using Docker, there is an alternative way which uses Hive on MR3.
https://mr3docs.datamonad.com/docs/quick/docker/
You can also run Hive on MR3 on Kubernetes.
Thanks,
--- Sungwoo
On Wed, Jan 10, 2024
From | Attila Turoczy |
>> | Date | 1/2/2024 00:06 |
>> | To | |
>> | Cc | |
>> | Subject | Re: [DISCUSS] Tez 0.10.3 Release Planning |
>> +1 (non-binding)
>> Thank you for the effort and happy new year!
>> -Attila
>>
>> On Mon, 1 Jan 2024 at 14:22, Ayush Sax
, not a bug.)
Butao Zhang ezt írta (időpont: 2024. jan. 2., K,
7:13):
> +1 (non-binding) Thanks Laszlo !
> Replied Message
> | From | Attila Turoczy |
> | Date | 1/2/2024 00:06 |
> | To | |
> | Cc | |
> | Subject | Re: [DISCUSS] Tez 0.10.3 Release Planning
+1 (non-binding) Thanks Laszlo !
Replied Message
| From | Attila Turoczy |
| Date | 1/2/2024 00:06 |
| To | |
| Cc | |
| Subject | Re: [DISCUSS] Tez 0.10.3 Release Planning |
+1 (non-binding)
Thank you for the effort and happy new year!
-Attila
On Mon, 1 Jan 2024 at 14:22, Ayush
+1 (non-binding)
Thank you for the effort and happy new year!
-Attila
On Mon, 1 Jan 2024 at 14:22, Ayush Saxena wrote:
> +1 (non-binding),
> Thanx Laszlo for starting the thread.
>
> -Ayush
>
> On Mon, 1 Jan 2024 at 18:30, László Bodor
> wrote:
> >
> > Hi Everyone!
> >
> > Happy New Year!
> >
+1 (non-binding),
Thanx Laszlo for starting the thread.
-Ayush
On Mon, 1 Jan 2024 at 18:30, László Bodor wrote:
>
> Hi Everyone!
>
> Happy New Year!
>
> I think it's time to create a new Tez release.
> It's not a secret: Hive 4.0 GA would benefit from the latest bug fixes since
> 0.10.2, which
BigTop supports a specific version stack with some patches in place. It
should be helpful for you.
- Currently, the master branch consists of Hadoop-3.3.6, Hive-3.1.3,
Tez-0.10.2.
- https://github.com/apache/bigtop/blob/master/bigtop.bom
- Hive patches:
Replied Message
| From | Sungwoo Park |
| Date | 12/24/2023 00:06 |
| To | user@hive.apache.org |
| Cc | |
| Subject | Blog article 'Performance Tuning for Single-table Queries' |
Hello Hive users,
I have published a new blog article 'Performance Tuning for Single-table
Thanks, it solves issue. Much appreciated.
Thanks
Sanjay Gupta
From: Akshat m
Sent: Friday, December 22, 2023 5:55:38 AM
To: user@hive.apache.org
Subject: Re: How to use SKIP_SCHEMA_INIT=TRUE from command line
Hi Sanjay,
Instead of using --env
Many thanks for clarifying Ayush - much appreciated
> On 22 Dec 2023, at 08:41, Ayush Saxena wrote:
>
> Ideally the hadoop should be on 3.1.0 only, that is what we support,
> rest if there are no incompatibilities it might or might not work with
> higher versions of hadoop, we at "hive" don't
Hi Sanjay,
Instead of using --env SKIP_SCHEMA_INIT=TRUE,
Please use --env IS_RESUME="true" while running,
docker run -it -d -p 9083:9083 --env SERVICE_NAME=metastore
--add-host=host.docker.internal:host-gateway \
--env IS_RESUME="true" \
--env DB_DRIVER=mysql \
--env
Ideally the hadoop should be on 3.1.0 only, that is what we support,
rest if there are no incompatibilities it might or might not work with
higher versions of hadoop, we at "hive" don't claim that it can work,
mostly it will create issues with hadoop-3.3.x line due to thirdparty
libs and stuff
Hi Ayush
Many thanks for your response.
I’d really appreciate a clarification if that’s OK?
Does this just mean that the Hadoop 3.1.0 libraries need to be deployed with
Hive, or does it also mean the Hadoop cluster itself cannot be on a version
later than 3.1.0 (if using Hive 3.1.3).
For
Hi Austin,
Hive 3.1.3 & 4.0.0-alpha-1 works with Hadoop-3.1.0
HIve 4.0.0-alpha-2 & 4.0.0-beta-1 works with Hadoop-3.3.1
The upcoming Hive 4.0 GA release would be compatible with Hadoop-3.3.6
-Ayush
On Thu, 21 Dec 2023 at 17:39, Austin Hackett wrote:
>
> Hi List
>
> I was hoping that someone
Hi,
You can download it from here:
https://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.29/mysql-connector-java-8.0.29.jar
Regards,
Akshat
On Thu, Dec 21, 2023 at 1:40 AM Sanjay Gupta wrote:
> There is no mysql driver file in following repo
> https://repo1.maven.org/maven2/org
>
> On
There is no mysql driver file in following repo
https://repo1.maven.org/maven2/org
On Mon, Dec 18, 2023 at 3:10 AM Simhadri G wrote:
>
> We can modify the Dockerfile to wget the necessary driver and copy it to
> /opt/hive/lib/ . This should make it work. The diff is attached below:
>
>
> diff
We can modify the Dockerfile to wget the necessary driver and copy it to
/opt/hive/lib/ . This should make it work. The diff is attached below:
diff --git a/packaging/src/docker/Dockerfile
b/packaging/src/docker/Dockerfile
--- a/packaging/src/docker/Dockerfile (revision
I think the similar problem is being chased as part of
https://github.com/apache/hive/pull/4948
On Mon, 18 Dec 2023 at 09:48, Sanjay Gupta wrote:
>
>
>
>
> Issue with Docker container using mysql RDBMS ( Failed to load driver)
>
> https://hub.docker.com/r/apache/hive
>
> According to readme
>
>
For Chinese users, MR3 1.8 is now shipped in HiDataPlus (along with
Celeborn).
https://mp.weixin.qq.com/s/65bgrnFpXtORlb4FjlPMWA
--- Sungwoo
On Sat, Dec 9, 2023 at 9:08 PM Sungwoo Park wrote:
> MR3 1.8 released
>
> On behalf of the MR3 team, I am pleased to announce the release of MR3 1.8.
>
Hi lisoda,
Thank you for trying the Hive4-beta and reporting this issue. Based
on the current information you provided, i can not reproduce this issue. Could
you please give more clues? e.g.
1) Which Tez version are you using? Hive4-beta uses Tez 0.10.2 by
default.
Congratulations Butao Zhang, Very well deserved. Your contributions to the
Data connector feature are very impressive and much appreciated. Looking
forward to much more!!
Thanks,
Sai.
On Tue, Nov 21, 2023 at 1:06 PM Stamatis Zampetakis
wrote:
> Congratulations Butao, well deserved! Very glad
Congratulations Butao, well deserved! Very glad to see another Iceberg
expert joining the team.
Best,
Stamatis
On Tue, Nov 21, 2023, 4:47 PM Butao Zhang wrote:
> Thank you to the Hive community for this honor. I will continue to
> contribute to the community with my efforts.
> Thanks all!
>
>
Thank you to the Hive community for this honor. I will continue to contribute
to the community with my efforts.
Thanks all!
Thanks,
Butao Zhang
Replied Message
| From | Ayush Saxena |
| Date | 11/21/2023 15:02 |
| To | dev ,
,
Butao Zhang |
| Subject | [ANNOUNCE] New committer:
Hi Eugene,
Hive has a feature called automatic query rewrite [1]. This feature needs
up-to-date information about the materialized views available. [2]
The feature can be disable by the
setting: hive.materializedview.rewriting [3]
Hope this helps.
regards,
Krisztian
[1]
Sorry, I'm not sure of the final released time, but I think it will be soon. :)
Maybe some other folks of Hive community know more about the GA release.
Thanks,
Butao Zhang
Replied Message
| From | lisoda |
| Date | 11/17/2023 12:31 |
| To | user |
| Subject | Re: [EXTERNAL] Re
Hi, maybe you can check this ticket
https://issues.apache.org/jira/browse/HIVE-26227
Thanks,
Butao Zhang
Replied Message
| From | Flavio Junqueira |
| Date | 11/15/2023 17:26 |
| To | |
| Subject | Question on Hive Metastore catalog support |
Hello there,
I'm interested in
May I ask when hive4 can be released?
Replied Message
| From | Butao Zhang |
| Date | 11/17/2023 12:24 |
| To | user@hive.apache.org |
| Cc | |
| Subject | Re: [EXTERNAL] Re: Slow Hive query with a lot of
'get_materialized_views_for_rewriting' |
Thanks for the info. I checked
Iceberg integration, enhanced materialized view, etc.
Thanks,
Butao Zhang
Replied Message
| From | Eugene Miretsky |
| Date | 11/17/2023 09:06 |
| To | |
| Subject | Re: [EXTERNAL] Re: Slow Hive query with a lot of
'get_materialized_views_for_rewriting' |
Hey!
Hive version is 3.1.3
Hey!
Hive version is 3.1.3
On Wed, Nov 15, 2023 at 9:23 PM Butao Zhang wrote:
> Hi, which version of hms are you using now? I have checked the master
> branch and beta-1 branch source code, but I can't find the place where
> this method *get_materialized_views_for_rewriting* is called by
Hi, which version of hms are you using now? I have checked the master branch
and beta-1 branch source code, but I can't find the place where this method
get_materialized_views_for_rewriting is called by mistake.
Thanks,
Butao Zhang
Replied Message
| From | Eugene Miretsky |
|
Please ensure hive.stats.autogather is enabled as well.
On Fri, Nov 10, 2023, 2:57 PM Denys Kuzmenko wrote:
> `hive.iceberg.stats.source` controls where the stats should be sourced
> from. When it's set to iceberg (default), we should go directly to iceberg
> and bypass HMS.
>
`hive.iceberg.stats.source` controls where the stats should be sourced from.
When it's set to iceberg (default), we should go directly to iceberg and bypass
HMS.
ount(*) this location_based_table table in hive. Does it also launch the tez
task to scan table?
Thanks,
Butao Zhang
Replied Message
| From | lisoda |
| Date | 11/9/2023 15:50 |
| To | |
| Subject | Re:Re: Re: Hive's performance for querying the Iceberg table is
very poor. |
STEP1:
CREATE TABLE USING S
plied Message
| From | lisoda |
| Date | 11/9/2023 14:25 |
| To | |
| Subject | Re:Re: Re: Hive's performance for querying the Iceberg table is
very poor. |
Incidentally, I'm using a COW table, so there is no DELETE_FILE.
在 2023-11-09 10:57:35，"Butao Zhang" 写道：
Hi lisoda. Yo
Could you please provide detailed steps to reproduce this issue? e.g. how do
you create the table?
Thanks,
Butao Zhang
Replied Message
| From | lisoda |
| Date | 11/9/2023 14:25 |
| To | |
| Subject | Re:Re: Re: Hive's performance for querying the Iceberg table is
very poor
ake effect if having delete
files.
Thanks,
Butao Zhang
Replied Message
| From | lisoda |
| Date | 11/9/2023 10:43 |
| To | |
| Subject | Re:Re: Re: Hive's performance for querying the Iceberg table is
very poor. |
HI.
I am testing with HIVE-4.0.0-BETA-1 version and
|
| To | |
| Subject | Re:Re: Re: Hive's performance for querying the Iceberg table is
very poor. |
HI.
I am testing with HIVE-4.0.0-BETA-1 version and I am using location_based_table.
So far I found that HIVE still can't push some queries down to METADATA, e.g.
COUNT(*).
Is HIVE 4.0.0-BETA-1
cks.
mpp architecture databases have natural limitations, and starrocks does not
necessarily perform better than hive llap.
Replied Message
| From | Albert Wong |
| Date | 10/24/2023 01:39 |
| To | user@hive.apache.org |
| Cc | |
| Subject | Re: Hive's performance for querying the Ice
Celeborn and Uniffle can also be seen as a move to separate local storage
from compute nodes.
1. In the old days, Hadoop was based on the idea of collocating compute and
storage.
2. Later a new paradigm of separating compute and storage emerged and got
popularized.
3. Now people want to not just
I think both Celeborn and Uniffle are good alternatives as a general shuffle
service.
I recommend that you try them : ). For any question about Celeborn, we're very
glad
to discuss in Celeborn's mail lists[1][2] or slack[3].
[1] u...@celeborn.apache.org
[2] d...@celeborn.apache.org
[3]
On Thu, Nov 2, 2023 at 1:43 PM Sungwoo Park wrote:
> Have you done comparison between uniffle and celeborn..?
>>
>
> We did not compare the performance of Uniffle and Celeborn (because
> Hive-MR3-Celeborn has been released but Hive-MR3-Uniffle is not complete
> yet). Much of the code in
>
> Have you done comparison between uniffle and celeborn..?
>
We did not compare the performance of Uniffle and Celeborn (because
Hive-MR3-Celeborn has been released but Hive-MR3-Uniffle is not complete
yet). Much of the code in Hive-MR3-Celeborn is currently reused in
Hive-MR3-Uniffle, so we
Thanks for bringing up this. Good to see that it supports spark and flink.
Have you done comparison between uniffle and celeborn..?
On 30/10/23, 8:01 AM, "Keyong Zhou" mailto:zho...@apache.org>> wrote:
Great to hear this! It's encouraging that Celeborn helps MR3.
Celeborn is a general
Great to hear this! It's encouraging that Celeborn helps MR3.
Celeborn is a general purpose remote shuffle service that stores and serves
shuffle data (and other intermediate data in the future) to help compute
engines
better use disaggregated architecture, as well as become more efficient and
Hi Eugene,
HMS depends on DataNucleus for the identity value generation for the HMS
tables. It is generated by DataNucleus when an object is made persistent.
DataNucleus value generator will generate values uniquely across different
JVMs. As Zoltan said, DataNucleus tracks with the SEQUENCE_TABLE
Hi Eugene,
the TBL_ID in TBLS table is handled by Datanucleus, so AUTO_INCREMENT won't
help, since the TBL_ID is not defined as AUTO_INCREMENT.
Datanucleus uses SEQUENCE_TABLE to store the actual value for primary keys.
In this table this two rows is what you need to modify:
Thanks. I will try.
Replied Message
| From | Sungwoo Park |
| Date | 10/24/2023 20:08 |
| To | user@hive.apache.org |
| Cc | |
| Subject | Announce: Hive-MR3 with Celeborn, |
Hi Hive users,
Before the impending release of MR3 1.8, we would like to announce the release
of Hive-MR3
ing/tencent-games-inside-scoop-the-road-to-cloud-native-with-starrocks-d7dcb2438e25.
>>
>>
>> On Mon, Oct 23, 2023 at 10:55 AM lisoda wrote:
>>
>>> We are not going to use starrocks.
>>> mpp architecture databases have natural limitations, and starroc
--
>> From Albert Wong
>> Date 10/24/2023 01:39
>> To user@hive.apache.org
>> Cc
>> Subject Re: Hive's performance for querying the Iceberg table is very
>> poor.
>> I would try http://starrocks.io. StarRocks is an MPP OLAP database
>> that ca
cks.
> mpp architecture databases have natural limitations, and starrocks does
> not necessarily perform better than hive llap.
>
>
> Replied Message
> From Albert Wong
> Date 10/24/2023 01:39
> To user@hive.apache.org
> Cc
> Subject Re: Hive's performance for q
We are not going to use starrocks.
mpp architecture databases have natural limitations, and starrocks does not
necessarily perform better than hive llap.
Replied Message
| From | Albert Wong |
| Date | 10/24/2023 01:39 |
| To | user@hive.apache.org |
| Cc | |
| Subject | Re: Hive's
I would try http://starrocks.io. StarRocks is an MPP OLAP database that
can query Apache Iceberg and we can cache the data for faster performance.
We also have additional features like building materialized views that span
across Apache Iceberg, Apache Hudi and Apache Hive. Here is a video of
Oh, I forget to add the email subject, apologize for that.
On Thu, Oct 12, 2023 at 5:19 PM luckydog xf wrote:
> Hi, listAccording to this link
> https://cwiki.apache.org/confluence/display/Hive/AdminManual+Metastore+3.0+AdministrationJump
> to Section unning the Metastore Without Hive
> In
Hi Wojtek,
I've not checked but I think your hive-site.xml has ``. Does it
still happen if you put all parameters directly in hive-site.xml? If that
resolves the issue, do you have a reason to use `include`?
Congratulations! Sourabh Badhya
发件人: user-return-27928-butaozhang1=163@hive.apache.org 代表 Ayush Saxena 发送时间: 星期三, 十月 4, 2023 12:10 下午收件人: d...@hive.apache.org 抄送: user@hive.apache.org 主题: Re: [EXTERNAL] Re: [ANNOUNCE] New committer: Sourabh Badhya
dhya
> Sent: Wednesday, October 4, 2023 9:19 AM
> To: d...@hive.apache.org; user@hive.apache.org
> Subject: [EXTERNAL] Re: [ANNOUNCE] New committer: Sourabh Badhya
>
>
>
> [You don't often get email from
> sbad...@cloudera.com.invalid<mailto:sbad...
Congratulations Sourabh! Welcome to the Hive committers club!
Thanks,
Sankar
-Original Message-
From: Sourabh Badhya
Sent: Wednesday, October 4, 2023 9:19 AM
To: d...@hive.apache.org; user@hive.apache.org
Subject: [EXTERNAL] Re: [ANNOUNCE] New committer: Sourabh Badhya
[You
In https://cwiki.apache.org/confluence/display/Hive/ on "user
documentation", I'd like to add "StarRocks Integration". StarRocks is an
OLAP database that can query data in Apache Hive (
https://docs.starrocks.io/en-us/latest/data_source/catalog/hive_catalog).
On Thu, Sep 21, 2023 at 12:23 PM
Hi Albert,Can you share some more details like which page you want to modify and details around the content -AyushOn 22-Sep-2023, at 12:43 AM, Albert Wong wrote:username is albertatcelerdata.com-- Albert WongCommunity, Developer Relations, Technology Partnerships for StarRocks | CelerData949 689
1 - 100 of 13473 matches
Mail list logo
