[ANNOUNCE] Hive 2.x EOL

[Ayush Saxena]

Hi All,
The Apache Hive Community has voted to declare the 2.x release line as End of 
Life. This means no further updates or releases will be made for this release 
line.

We urge all Hive 2.x users to upgrade to the latest versions promptly to 
benefit from new features and ongoing support.

-Ayush Saxena
(On Behalf of Apache Hive PMC)

[ANNOUNCE] New Committer: Simhadri Govindappa

[Ayush Saxena]

Hi All,
Apache Hive's Project Management Committee (PMC) has invited Simhadri
Govindappa to become a committer, and we are pleased to announce that he
has accepted.

Please join me in congratulating him, Congratulations Simhadri, Welcome
aboard!!!

-Ayush Saxena
(On behalf of Apache Hive PMC)

[ANNOUNCE] Hive 1.x EOL

[Ayush Saxena]

Hi All,
The Apache Hive Community has voted to declare the 1.x release line as End of 
Life (EOL). This means no further updates or releases will be made for this 
series.

We urge all Hive 1.x users to upgrade to the latest versions promptly to 
benefit from new features and ongoing support.

-Ayush Saxena
(On Behalf of Apache Hive PMC)

Re: Docker Hive using tez without hdfs

[Ayush Saxena]

Hive on MR3 isn’t an official Apache Hive thing, not even an Apache OS thing, so, it is a vendor product just being tried to advertised in the ‘Apache’ Hive spaceSo, it can be all mess, filled with security issues or bugs & we Apache Hive for the record aren’t responsible for that neither do we endorse usage of that or anything outside the scope of Apache-AyushOn 10-Jan-2024, at 1:09 PM, Sungwoo Park  wrote:As far as I know, Hive-Tez supports local mode, but does not standalone mode (like Spark). Hive-MR3 supports standalone mode, so you can run it in any type of cluster.--- SungwooOn Wed, Jan 10, 2024 at 4:22 PM Sanjay Gupta  wrote:I can run hive with mr engine in local mode. Does Hive + Tez also
works in standalone mode ?

On Tue, Jan 9, 2024 at 11:08 PM Sungwoo Park  wrote:
>
> Hello,
>
> I don't have an answer to your problem, but if your goal is to quickly test Hive 3 using Docker, there is an alternative way which uses Hive on MR3.
>
> https://mr3docs.datamonad.com/docs/quick/docker/
>
> You can also run Hive on MR3 on Kubernetes.
>
> Thanks,
>
> --- Sungwoo
>
>
>
> On Wed, Jan 10, 2024 at 3:25 PM Sanjay Gupta  wrote:
>>
>> Hi,
>> Using following docker container to run meta , hiveserver2
>>
>> https://hub.docker.com/r/apache/hive
>> https://github.com/apache/hive/blob/master/packaging/src/docker/
>>
>> I have configured hive-site.xml to se S3
>> When I set in hive.execution.engine to mr hive-site.xml, hive is
>> running fine and I can perform queries but setting to tez fails with
>> error.
>> There is no hdfs but it is running in local mode.
>>
>>     
>>         hive.execution.engine
>>         tez
>>     
>>
>> Any idea how to fix this issue ?
>>
>> hive
>> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
>> Hive Session ID = 03368207-1904-4c4c-b63e-b29dd28e0a71
>>
>> Logging initialized using configuration in
>> jar:file:/opt/hive/lib/hive-common-3.1.3.jar!/hive-log4j2.properties
>> Async: true
>> Exception in thread "main" java.lang.NoClassDefFoundError:
>> org/apache/tez/dag/api/TezConfiguration
>> at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:661)
>> at org.apache.hadoop.hive.ql.session.SessionState.beginStart(SessionState.java:591)
>> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:747)
>> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:498)
>> at org.apache.hadoop.util.RunJar.run(RunJar.java:308)
>> at org.apache.hadoop.util.RunJar.main(RunJar.java:222)
>> Caused by: java.lang.ClassNotFoundException:
>> org.apache.tez.dag.api.TezConfiguration
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
>>
>>
>> --
>>
>> Thanks
>> Sanjay Gupta



-- 

Thanks
Sanjay Gupta

Re: [DISCUSS] Tez 0.10.3 Release Planning

[Ayush Saxena]

Thanx Laszlo,
I faced some issue here [1], maybe if it is not just me, maybe we can
either drop this ticket or maybe reduce the log level to debug

-Ayush

[1] 
https://issues.apache.org/jira/browse/TEZ-4039?focusedCommentId=17800336=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17800336

On Thu, 4 Jan 2024 at 21:10, László Bodor  wrote:
>
> Thanks for the feedback so far, I believe it's time to make the release.
> Please let me know about blockers if any, otherwise, I'm happy to volunteer 
> to start making the release next week.
>
> (Just added user@tez now, as I added user@hive originally, 
> accidentally...that was a feature in this context, not a bug.)
>
> Butao Zhang  ezt írta (időpont: 2024. jan. 2., K, 7:13):
>>
>> +1  (non-binding) Thanks Laszlo !
>>  Replied Message 
>> | From | Attila Turoczy |
>> | Date | 1/2/2024 00:06 |
>> | To |  |
>> | Cc |  |
>> | Subject | Re: [DISCUSS] Tez 0.10.3 Release Planning |
>> +1  (non-binding)
>> Thank you for the effort and happy new year!
>> -Attila
>>
>> On Mon, 1 Jan 2024 at 14:22, Ayush Saxena  wrote:
>>
>> +1 (non-binding),
>> Thanx Laszlo for starting the thread.
>>
>> -Ayush
>>
>> On Mon, 1 Jan 2024 at 18:30, László Bodor 
>> wrote:
>>
>> Hi Everyone!
>>
>> Happy New Year!
>>
>> I think it's time to create a new Tez release.
>> It's not a secret: Hive 4.0 GA would benefit from the latest bug fixes
>> since 0.10.2, which are:
>> https://issues.apache.org/jira/issues?jql=project%20%3D%20TEZ%20AND%20resolution%20!%3D%20null%20and%20fixVersion%20in%20(0.10.3)
>> .
>>
>> Please let me know your opinions.
>>
>> Regards,
>> Laszlo Bodor
>> Tez PMC Chair
>>
>>

Re: [DISCUSS] Tez 0.10.3 Release Planning

[Ayush Saxena]

+1 (non-binding),
Thanx Laszlo for starting the thread.

-Ayush

On Mon, 1 Jan 2024 at 18:30, László Bodor  wrote:
>
> Hi Everyone!
>
> Happy New Year!
>
> I think it's time to create a new Tez release.
> It's not a secret: Hive 4.0 GA would benefit from the latest bug fixes since 
> 0.10.2, which are: 
> https://issues.apache.org/jira/issues?jql=project%20%3D%20TEZ%20AND%20resolution%20!%3D%20null%20and%20fixVersion%20in%20(0.10.3).
>
> Please let me know your opinions.
>
> Regards,
> Laszlo Bodor
> Tez PMC Chair
>

Re: Hive 3.1.3 Hadoop Compatability

[Ayush Saxena]

Ideally the hadoop should be on 3.1.0 only, that is what we support,
rest if there are no incompatibilities it might or might not work with
higher versions of hadoop, we at "hive" don't claim that it can work,
mostly it will create issues with hadoop-3.3.x line due to thirdparty
libs and stuff like that, Guava IIRC does create some mess.

So, short answer: we officially only support the above said hadoop
versions only for a particular hive release.

-Ayush

On Fri, 22 Dec 2023 at 03:03, Austin Hackett  wrote:
>
> Hi Ayush
>
> Many thanks for your response.
>
> I’d really appreciate a clarification if that’s OK?
>
> Does this just mean that the Hadoop 3.1.0 libraries need to be deployed with 
> Hive, or does it also mean the Hadoop cluster itself cannot be on a version 
> later than 3.1.0 (if using Hive 3.1.3).
>
> For example, if running the Hive 3.1.3 Metastore in standalone mode, can the 
> HMS work with a 3.3.6 HDFS cluster providing the Hadoop 3.1.0 libraries are 
> deployed alongside the HMS?
>
> Any help is much appreciated
>
> Thank you
>
>
>
> > On 21 Dec 2023, at 12:18, Ayush Saxena  wrote:
> >
> > Hi Austin,
> > Hive 3.1.3 & 4.0.0-alpha-1 works with Hadoop-3.1.0
> >
> > HIve 4.0.0-alpha-2 & 4.0.0-beta-1 works with Hadoop-3.3.1
> >
> > The upcoming Hive 4.0 GA release would be compatible with Hadoop-3.3.6
> >
> > -Ayush
> >
> > On Thu, 21 Dec 2023 at 17:39, Austin Hackett  wrote:
> >>
> >> Hi List
> >>
> >> I was hoping that someone might be able to clarify which Hadoop versions 
> >> Hive 3.1.3 is compatible with?
> >>
> >> https://hive.apache.org/general/downloads/ says that Hive release 3.1.3 
> >> works with Hadoop 3.x.y which is straightforward enough.
> >>
> >> However, I notice the 4.0.0 releases only work with Hadoop 3.3.1, which 
> >> makes we wonder if 3.1.3 doesn’t work actually work with 3.3.1.
> >>
> >> Similarly, I see that HIVE-27757 upgrades Hadoop to 3.3.6 in Hive 4.0.0, 
> >> which makes me wonder if Hive 4.0.0 actually works with 3.3.6 and not 
> >> 3.3.1 as mentioned on the releases page.
> >>
> >> In summary: does Hive 3.1.3 work with Hadoop 3.3.6, and if not, which 
> >> Hadoop 3.x.x versions are known to work?
> >>
> >> Any pointers would be greatly appreciated
> >>
> >> Thank you
>

Re: Hive 3.1.3 Hadoop Compatability

[Ayush Saxena]

Hi Austin,
Hive 3.1.3 & 4.0.0-alpha-1 works with Hadoop-3.1.0

HIve 4.0.0-alpha-2 & 4.0.0-beta-1 works with Hadoop-3.3.1

The upcoming Hive 4.0 GA release would be compatible with Hadoop-3.3.6

-Ayush

On Thu, 21 Dec 2023 at 17:39, Austin Hackett  wrote:
>
> Hi List
>
> I was hoping that someone might be able to clarify which Hadoop versions Hive 
> 3.1.3 is compatible with?
>
> https://hive.apache.org/general/downloads/ says that Hive release 3.1.3 works 
> with Hadoop 3.x.y which is straightforward enough.
>
> However, I notice the 4.0.0 releases only work with Hadoop 3.3.1, which makes 
> we wonder if 3.1.3 doesn’t work actually work with 3.3.1.
>
> Similarly, I see that HIVE-27757 upgrades Hadoop to 3.3.6 in Hive 4.0.0, 
> which makes me wonder if Hive 4.0.0 actually works with 3.3.6 and not 3.3.1 
> as mentioned on the releases page.
>
> In summary: does Hive 3.1.3 work with Hadoop 3.3.6, and if not, which Hadoop 
> 3.x.x versions are known to work?
>
> Any pointers would be greatly appreciated
>
> Thank you

Re: Help with Docker Apache/Hive metastore using mysql remote database

[Ayush Saxena]

I think the similar problem is being chased as part of
https://github.com/apache/hive/pull/4948

On Mon, 18 Dec 2023 at 09:48, Sanjay Gupta  wrote:
>
>
>
>
> Issue with Docker container using mysql RDBMS ( Failed to load driver)
>
> https://hub.docker.com/r/apache/hive
>
> According to readme
>
> Launch Standalone Metastore With External RDBMS (Postgres/Oracle/MySql/MsSql)
>
> I want to use MySQL
>
> I tried com.mysql.jdbc.Driver or com.mysql.cj.jdbc.Driver
>
> docker run -it -d -p 9083:9083 --env SERVICE_NAME=metastore 
> --add-host=host.docker.internal:host-gateway \
>  --env DB_DRIVER=mysql \
>  --env 
> SERVICE_OPTS="-Djavax.jdo.option.ConnectionDriverName=com.mysql.jdbc.Driver 
> -Djavax.jdo.option.ConnectionURL=jdbc:mysql://host.docker.internal:3306/hive?createDatabaseIfNotExist=true
>  -Djavax.jdo.option.ConnectionUserName=hive 
> -Djavax.jdo.option.ConnectionPassword=password" \
>  --mount source=warehouse,target=/opt/hive/data/warehouse \
>  --name metastore-standalone apache/hive:${HIVE_VERSION}
>
>
> docker run -it -d -p 9083:9083 --env SERVICE_NAME=metastore 
> --add-host=host.docker.internal:host-gateway \
>  --env DB_DRIVER=mysql \
>  --env 
> SERVICE_OPTS="-Djavax.jdo.option.ConnectionDriverName=com.mysql.cj.jdbc.Driver
>   
> -Djavax.jdo.option.ConnectionURL=jdbc:mysql://host.docker.internal:3306/hive?createDatabaseIfNotExist=true
>  -Djavax.jdo.option.ConnectionUserName=hive 
> -Djavax.jdo.option.ConnectionPassword=password" \
>  --mount source=warehouse,target=/opt/hive/data/warehouse \
>  --name metastore-standalone apache/hive:${HIVE_VERSION}
>
> Docker logs shows this for both drivers ( same error )
>
> docker logs f3
> + : mysql
> + SKIP_SCHEMA_INIT=false
> + export HIVE_CONF_DIR=/opt/hive/conf
> + HIVE_CONF_DIR=/opt/hive/conf
> + '[' -d '' ']'
> + export 'HADOOP_CLIENT_OPTS= -Xmx1G 
> -Djavax.jdo.option.ConnectionDriverName=com.mysql.cj.jdbc.Driver  
> -Djavax.jdo.option.ConnectionURL=jdbc:mysql://host.docker.internal:3306/hive?createDatabaseIfNotExist=true
>  -Djavax.jdo.option.ConnectionUserName=hive 
> -Djavax.jdo.option.ConnectionPassword=hive'
> + HADOOP_CLIENT_OPTS=' -Xmx1G 
> -Djavax.jdo.option.ConnectionDriverName=com.mysql.cj.jdbc.Driver  
> -Djavax.jdo.option.ConnectionURL=jdbc:mysql://host.docker.internal:3306/hive?createDatabaseIfNotExist=true
>  -Djavax.jdo.option.ConnectionUserName=hive 
> -Djavax.jdo.option.ConnectionPassword=hive'
> + [[ false == \f\a\l\s\e ]]
> + initialize_hive
> + /opt/hive/bin/schematool -dbType mysql -initSchema
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in 
> [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in 
> [jar:file:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
> explanation.
> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
> Metastore connection URL: 
> jdbc:mysql://host.docker.internal:3306/hive?createDatabaseIfNotExist=true
> Metastore Connection Driver : com.mysql.cj.jdbc.Driver
> Metastore connection User: hive
> org.apache.hadoop.hive.metastore.HiveMetaException: Failed to load driver
> Underlying cause: java.lang.ClassNotFoundException : com.mysql.cj.jdbc.Driver
> Use --verbose for detailed stacktrace.
> *** schemaTool failed ***
> + '[' 1 -eq 0 ']'
> + echo 'Schema initialization failed!'
> Schema initialization failed!
> + exit 1
>
> Any idea, why I am getting failed to load driver for MySQL DB.
>
> Isn't docker container comes with MySQL Driver ?
>
> Docker container exits so I can't check whether driver is already installed.
>
> Let me know, what I can do to make it work.
>
> --
>
>
> Thanks
> Sanjay Gupta
>
>
>
> --
>
> Thanks
> Sanjay Gupta
>
>
>
> --
>
> Thanks
> Sanjay Gupta
>

[ANNOUNCE] New committer: Butao Zhang (zhangbutao)

[Ayush Saxena]

Hi All,
Apache Hive's Project Management Committee (PMC) has invited Butao
Zhang  to become a committer, and we are pleased to announce that he
has accepted.

Butao Zhang welcome, thank you for your contributions, and we look
forward to your further interactions with the community!

Ayush Saxena
(On behalf of Apache Hive PMC)

Re: Re: Hive's performance for querying the Iceberg table is very poor.

[Ayush Saxena]

HIVE-27734 is in progress, as I see we have a POC attached to the ticket,
we should have it in 2-3 week I believe.

> Also, after the release of 4.0.0, will we be able to do all TPCDS queries
on ICEBERG except for normal HIVE tables?

Yep, I believe most of the TPCDS queries would be supported even today on
Hive master, but 4.0.0 would have them running for sure.

-Ayush

On Tue, 24 Oct 2023 at 14:51, lisoda  wrote:

> Thanks.
> I would like to know if hive currently supports push to ICEBERG table
> partition under JOIN condition.
> Because I see HIVE-27734 is not yet complete, what is its progress so
> far?
> Also, after the release of 4.0.0, will we be able to do all TPCDS queries
> on ICEBERG except for normal HIVE tables?
>
>
>
>
>
> 在 2023-10-24 11:03:07，"Ayush Saxena"  写道：
>
> Hi Lisoda,
>
> The iceberg jar for hive 3.1.3 doesn't have a lot of changes, We did a
> bunch of improvements on the 4.x line for Hive-Iceberg. You can give
> iceberg a try on the 4.0.0-beta-1 release mentioned here [1], we have a
> bunch of improvements like vecotrization and stuff like that. If you wanna
> give it a quick try on docker, we have docker image published for that here
> [2] & Iceberg works out of the box there.
>
> Rest feel free to create tickets, if you find some specific queries or
> scenarios which are problematic, we will be happy to chase them & get them
> sorted.
>
> PS. Not sure about StarRocks, FWIW. That is something we don't develop as
> part of Apache Hive nor as part of Apache Software Foundation to best of my
> knowledge, so would refrain from or commenting about that on "Apache Hive"
> ML
>
> -Ayush
>
>
> [1] https://hive.apache.org/general/downloads/
> [2] https://hub.docker.com/r/apache/hive/tags
>
> On Tue, 24 Oct 2023 at 05:28, Albert Wong 
> wrote:
>
>> Too bad.   Tencent Games used StarRocks with Apache Iceberg to power
>> their analytics.
>> https://medium.com/starrocks-engineering/tencent-games-inside-scoop-the-road-to-cloud-native-with-starrocks-d7dcb2438e25.
>>
>>
>> On Mon, Oct 23, 2023 at 10:55 AM lisoda  wrote:
>>
>>> We are not going to use starrocks.
>>> mpp architecture databases have natural limitations, and starrocks does
>>> not necessarily perform better than hive llap.
>>>
>>>
>>>  Replied Message 
>>> From Albert Wong 
>>> Date 10/24/2023 01:39
>>> To user@hive.apache.org
>>> Cc
>>> Subject Re: Hive's performance for querying the Iceberg table is very
>>> poor.
>>> I would try http://starrocks.io.   StarRocks is an MPP OLAP database
>>> that can query Apache Iceberg and we can cache the data for faster
>>> performance.  We also have additional features like building materialized
>>> views that span across Apache Iceberg, Apache Hudi and Apache Hive.   Here
>>> is a video of connecting the 2 products through a webinar StarRocks did
>>> with Tabular (authors of Apache Iceberg).
>>> https://www.youtube.com/watch?v=bAmcTrX7hCI=10s
>>>
>>> On Mon, Oct 23, 2023 at 7:18 AM lisoda  wrote:
>>>
>>>> Hi Team.
>>>>   I recently was testing Hive query Iceberg table , I found that
>>>> Hive query Iceberg table performance is very very poor . Almost impossible
>>>> to use in the production environment . And Join conditions can not be
>>>> pushed down to the Iceberg partition.
>>>>   I'm using the 1.3.1 Hive Runtime Jar from the Iceberg community.
>>>>   Currently I'm using Hive 3.1.3, Iceberg 1.3.1.
>>>>   Now I'm very frustrated because the performance is so bad that I
>>>> can't deliver to my customers. How can I solve this problem?
>>>>  Details:
>>>> https://apache-iceberg.slack.com/archives/C025PH0G1D4/p1695050248606629
>>>> I would be grateful if someone could guide me.
>>>>
>>>

Re: Hive's performance for querying the Iceberg table is very poor.

[Ayush Saxena]

Hi Lisoda,

The iceberg jar for hive 3.1.3 doesn't have a lot of changes, We did a
bunch of improvements on the 4.x line for Hive-Iceberg. You can give
iceberg a try on the 4.0.0-beta-1 release mentioned here [1], we have a
bunch of improvements like vecotrization and stuff like that. If you wanna
give it a quick try on docker, we have docker image published for that here
[2] & Iceberg works out of the box there.

Rest feel free to create tickets, if you find some specific queries or
scenarios which are problematic, we will be happy to chase them & get them
sorted.

PS. Not sure about StarRocks, FWIW. That is something we don't develop as
part of Apache Hive nor as part of Apache Software Foundation to best of my
knowledge, so would refrain from or commenting about that on "Apache Hive"
ML

-Ayush


[1] https://hive.apache.org/general/downloads/
[2] https://hub.docker.com/r/apache/hive/tags

On Tue, 24 Oct 2023 at 05:28, Albert Wong  wrote:

> Too bad.   Tencent Games used StarRocks with Apache Iceberg to power their
> analytics.
> https://medium.com/starrocks-engineering/tencent-games-inside-scoop-the-road-to-cloud-native-with-starrocks-d7dcb2438e25.
>
>
> On Mon, Oct 23, 2023 at 10:55 AM lisoda  wrote:
>
>> We are not going to use starrocks.
>> mpp architecture databases have natural limitations, and starrocks does
>> not necessarily perform better than hive llap.
>>
>>
>>  Replied Message 
>> From Albert Wong 
>> Date 10/24/2023 01:39
>> To user@hive.apache.org
>> Cc
>> Subject Re: Hive's performance for querying the Iceberg table is very
>> poor.
>> I would try http://starrocks.io.   StarRocks is an MPP OLAP database
>> that can query Apache Iceberg and we can cache the data for faster
>> performance.  We also have additional features like building materialized
>> views that span across Apache Iceberg, Apache Hudi and Apache Hive.   Here
>> is a video of connecting the 2 products through a webinar StarRocks did
>> with Tabular (authors of Apache Iceberg).
>> https://www.youtube.com/watch?v=bAmcTrX7hCI=10s
>>
>> On Mon, Oct 23, 2023 at 7:18 AM lisoda  wrote:
>>
>>> Hi Team.
>>>   I recently was testing Hive query Iceberg table , I found that
>>> Hive query Iceberg table performance is very very poor . Almost impossible
>>> to use in the production environment . And Join conditions can not be
>>> pushed down to the Iceberg partition.
>>>   I'm using the 1.3.1 Hive Runtime Jar from the Iceberg community.
>>>   Currently I'm using Hive 3.1.3, Iceberg 1.3.1.
>>>   Now I'm very frustrated because the performance is so bad that I
>>> can't deliver to my customers. How can I solve this problem?
>>>  Details:
>>> https://apache-iceberg.slack.com/archives/C025PH0G1D4/p1695050248606629
>>> I would be grateful if someone could guide me.
>>>
>>

Re: [EXTERNAL] Re: [ANNOUNCE] New committer: Sourabh Badhya

[Ayush Saxena]

Congratulations Sourabh!!!

-Ayush

> On 04-Oct-2023, at 9:28 AM, Sankar Hariappan 
>  wrote:
> 
> Congratulations Sourabh! Welcome to the Hive committers club! 
> 
> 
> 
> Thanks,
> 
> Sankar
> 
> 
> 
> -Original Message-
> From: Sourabh Badhya 
> Sent: Wednesday, October 4, 2023 9:19 AM
> To: d...@hive.apache.org; user@hive.apache.org
> Subject: [EXTERNAL] Re: [ANNOUNCE] New committer: Sourabh Badhya
> 
> 
> 
> [You don't often get email from 
> sbad...@cloudera.com.invalid. Learn why 
> this is important at https://aka.ms/LearnAboutSenderIdentification ]
> 
> 
> 
> Thank you to the PMC members, committers and everyone who have helped me with 
> their advice and reviews. It's been a pleasure working on Hive over the past 
> couple of years. I hope to contribute and collaborate more for the project in 
> the future.
> 
> 
> 
> About me: I am working at Cloudera for the past 2 years, mainly engaged in 
> Apache Hive and related products. My current focus is on Iceberg support, 
> however I have had the opportunity to work on other areas of Hive such as 
> ACID compaction, optimising writes and related improvements.
> 
> 
> 
> Regards,
> 
> Sourabh Badhya
> 
> 
> 
>> On Tue, Oct 3, 2023 at 2:22 PM Stamatis Zampetakis 
>> mailto:zabe...@gmail.com>>
>> 
>> wrote:
>> 
>> 
>> 
>> Apache Hive's Project Management Committee (PMC) has invited Sourabh
> 
>> Badhya to become a committer, and we are pleased to announce that he
> 
>> has accepted.
> 
>> 
> 
>> Sourabh has been doing some great work for the project. He has landed
> 
>> important fixes in critical parts of Hive and made significant
> 
>> contributions to the stabilization of ACID compactions, Direct Write
> 
>> functionality, and Iceberg support. Apart from code contributions,
> 
>> Sourabh has been regularly reviewing others' work and providing
> 
>> valuable feedback as well as testing and validating releases.
> 
>> 
> 
>> Sourabh, welcome, thank you for your contributions, and we look
> 
>> forward to your further interactions with the community! If you wish,
> 
>> please feel free to tell us more about yourself and what you are
> 
>> working on.
> 
>> 
> 
>> Stamatis (on behalf of the Apache Hive PMC)
> 
>> 

Re: Request write access to the Hive wiki.

[Ayush Saxena]

Hi Albert,Can you share some more details like which page you want to modify and details around the content -AyushOn 22-Sep-2023, at 12:43 AM, Albert Wong  wrote:username is albertatcelerdata.com-- Albert WongCommunity, Developer Relations, Technology Partnerships for StarRocks | CelerData949 689 6412albert.w...@celerdata.com

Re: Inquiry about Stable Release Timeline for Hive-Serde 4.X

[Ayush Saxena]

Hi,

The GA release is in planning stage. We have some blockers, once we
get them sorted, we will be pushing for a new release.

At best it would take a minimum of 3 months, though that ain't a
strict timeline...

Thanx

-Ayush

On Thu, 21 Sept 2023 at 17:39, Mergu Ravi
 wrote:
>
> I'm currently using the hive-serde and its dependent libraries in my
> project. I'm interested in utilizing the feature introduced in version
> 4.0.0-beta1, specifically, the feature where INT64 Parquet timestamp maps
> to numeric types.
>
> In our project, we typically rely on stable versions of libraries. Do you
> have any information on when this feature might be released in a stable 4.x
> version?
>
>
> --
>
> Thanks & Regards,
>
>
> 
> Ravi Mergu
> SMTS-2
> o:  +91 40 64535355
> m: +91 9959618687
> w: www.gaiansolutions.com
>
> 
> 
> 
>
> *Please consider the environment before printing this email.* This message
> contains confidential information and is intended only for the individual
> named. If you are not the named addressee you should not disseminate,
> distribute or copy this e-mail

Re: Problem encountered when following hive docker quickstart.

[Ayush Saxena]

Hi Away Hua,
Thanx for the report. I think that is indeed a bug in the docker image.

Here it is calling initOrUpgrade schema here [1]
Where as initOrUpgrade is introduced in HIVE-20357 which is there post
4.0.0-alpha-1 [2]

You can raise a hive ticket for this & the fix most probably should be
to use initSchema directly rather than initOrUpgradeSchema.

you can try locally as well by changing it in line [1] and then

cd packaging/src/docker/

./build.sh -hive 3.1.3 -hadoop 3.1.0 -tez 0.9.1

This should build an image locally with the change & you can retry, it
should work. If it does, feel free to create a PR with the fix, if it
doesn't work, let me know. I tried locally and it works for me.

I have pushed the updated image as well

-Ayush


[1] 
https://github.com/apache/hive/blob/master/packaging/src/docker/entrypoint.sh#L27
[2] https://issues.apache.org/jira/browse/HIVE-20357

On Tue, 5 Sept 2023 at 09:10, Away Hua  wrote:
>
> I followed the QuickStart section of hive quickstart to start hiveserver2 
> with version 3.1.3 in docker container. However, I can't start hiveserver2 
> container successfully.  This failed container outputs the following content,
>
> + : derby
> + SKIP_SCHEMA_INIT=false
> + export HIVE_CONF_DIR=/opt/hive/conf
> + HIVE_CONF_DIR=/opt/hive/conf
> + '[' -d '' ']'
> + export 'HADOOP_CLIENT_OPTS= -Xmx1G '
> + HADOOP_CLIENT_OPTS=' -Xmx1G '
> + [[ false == \f\a\l\s\e ]]
> + initialize_hive
> + /opt/hive/bin/schematool -dbType derby -initOrUpgradeSchema
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in 
> [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in 
> [jar:file:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
> explanation.
> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
> HiveSchemaTool:Parsing failed.  Reason: Missing required option: [-help print 
> this message, -alterCatalog Alter a catalog, requires --catalogLocation 
> and/or --catalogDescription parameter as well, -initSchemaTo Schema 
> initialization to a version, -upgradeSchemaFrom Schema upgrade from a 
> version, -moveDatabase Move a database between catalogs.  Argument is the 
> database name. Requires --fromCatalog and --toCatalog parameters as well, 
> -moveTable Move a table to a different database.  Argument is the table name. 
> Requires --fromCatalog, --toCatalog, --fromDatabase, and --toDatabase  
> parameters as well., -initSchema Schema initialization, -createCatalog Create 
> a catalog, requires --catalogLocation parameter as well, -upgradeSchema 
> Schema upgrade, -info Show config and schema details, -validate Validate the 
> database]
> usage: schemaTool
>  -alterCatalog Alter a catalog, requires
> --catalogLocation and/or
> --catalogDescription parameter as well
>  -catalogDescription   Description of new catalog
>  -catalogLocation  Location of new catalog, required when
> adding a catalog
>  -createCatalogCreate a catalog, requires
> --catalogLocation parameter as well
>  -dbOpts  Backend DB specific options
>  -dbType  Metastore database type
>  -driverdriver name for connection
>  -dryRunlist SQL scripts (no execute)
>  -fromCatalog  Catalog a moving database or table is
> coming from.  This is required if you
> are moving a database or table.
>  -fromDatabase Database a moving table is coming
> from.  This is required if you are
> moving a table.
>  -help  print this message
>  -ifNotExists   If passed then it is not an error to
> create an existing catalog
>  -info  Show config and schema details
>  -initSchemaSchema initialization
>  -initSchemaTo  Schema initialization to a version
>  -metaDbType  Used only if upgrading the system
> catalog for hive
>  -moveDatabase Move a database between catalogs.
> Argument is the database name.
> Requires --fromCatalog and --toCatalog
> parameters as well
>  -moveTableMove a table to a different database.
> Argument is the table name. Requires
> --fromCatalog, 

Re: hive.query.reexecution.stats.persist.scope

[Ayush Saxena]

Hi Sungwoo,

I know one issue: if that config is set to Metastore in that case it does
create some issues, those entries are persisted in the *RUNTIME_STATS *table
and if you drop a table the entry still stays, so if you have some drop
table and you recreate the table and shoot a query before
*RuntimeStatsCleanerTask
*can clean the stale entry, your plans for the newer table will be screwed
till then.

There is a ticket for that here [1], most probably we need to find a way to
drop those stats on drop table or make sure the newer tables can figure out
the stats are stale, the catch is the *RUNTIME_STATS *doesn't have table
name mapping so to do a drop that should be a good effort, I haven't spent
much time investigating so there might be better ways as well.

-Ayush

[1] https://issues.apache.org/jira/browse/HIVE-26978

On Wed, 24 May 2023 at 19:53, Sungwoo Park  wrote:

> Hi Hive users,
>
> Hive can persist runtime statistics by setting
> hive.query.reexecution.stats.persist.scope to 'hiveserver' or 'metastore'
> (instead of the default value 'query'). If you have an experience of using
> this configuration key in production, could you share it here? (Like the
> stability of query execution, speed improvement, etc.)
>
> Thanks,
>
> --- Sungwoo
>
>

Re: I will subscript to this

[Ayush Saxena]

Send mail to: user-subscr...@hive.apache.org-AyushOn 28-Apr-2023, at 9:53 AM, Carlos Guerrero  wrote:

Re: Issue related to apache hive 3.1.3

[Ayush Saxena]

Hi Omkar,

If Impala has some issues, you should reach to Impala mailing lists

-Ayush

> On 29-Mar-2023, at 1:13 PM, Omkar Rohadkar  
> wrote:
> 
> 
> Hi team,
> 
> We are using apache hive 3.1.3 and we are using Mapreduce execution engine 
> and it worked fine , but while launching the impala service we get an error 
> that MR execution engine is not supported .
> 
> 
> 
> Is there any way that we can still proceed with Mapreduce execution engine 
> and launch Impala service.
> 
> Thanks and regards,
> Omkar Rohadkar
> 
> Privileged/Confidential information may be contained in this message and may 
> be subject to legal privilege. Access to this e-mail by anyone other than the 
> intended is unauthorized. If you are not the intended recipient (or 
> responsible for delivery of the message to such person), you may not use, 
> copy, distribute or deliver to anyone this message (or any part of its 
> contents ) or take any action in reliance on it. In such case, you should 
> destroy this message, and notify us immediately. If you have received this 
> email in error, please notify us immediately by e-mail or telephone and 
> delete the e-mail from any computer. If you or your employer does not consent 
> to internet e-mail messages of this kind, please notify us immediately by 
> e-mail. All reasonable precautions have been taken to ensure no viruses are 
> present in this e-mail. As our company cannot accept responsibility for any 
> loss or damage arising from the use of this e-mail or attachments we 
> recommend that you subject these to your virus checking procedures prior to 
> use. The views, opinions, conclusions and other information expressed in this 
> electronic mail are not given or endorsed by the company unless otherwise 
> indicated by an authorized representative independent of this message.

Fwd: TAC supporting Berlin Buzzwords

[Ayush Saxena]

Forwarded as Received.

-Ayush

-- Forwarded message -
From: Gavin McDonald 
Date: Fri, 24 Mar 2023 at 15:27
Subject: TAC supporting Berlin Buzzwords
To: 


PMCs,

Please forward to your dev and user lists.

Hi All,

The ASF Travel Assistance Committee is supporting taking up to six (6)
people
to attend Berlin Buzzwords In June this year.

This includes Conference passes, and travel & accommodation as needed.

Please see our website at https://tac.apache.org for more information and
how to apply.

Applications close on 15th April.

Good luck to those that apply.

Gavin McDonald (VP TAC)

Re: [DISCUSS] Jira Public Signup Disabled

[Ayush Saxena]

Folks,
New stuff now, INFRA has introduced a new Utility which can be used for
Jira id creation[1], It is mentioned over here as well in the
announcement[2] from Infra team.

Guess we should update our contributor docs[3] to reflect that and ask
folks to route their request via this util.

-Ayush

[1] https://selfserve.apache.org/jira-account.html
[2] https://infra.apache.org/blog/brand-new-selfserve-page.html
[3]
https://cwiki.apache.org/confluence/display/Hive/HowToContribute#HowToContribute-JIRA

On Thu, 17 Nov 2022 at 16:43, Stamatis Zampetakis  wrote:

> The jira-reque...@hive.apache.org has been created and I added relevant
> instructions on how to request a JIRA account in the wiki [1]. Feel free to
> improve as you see fit!
>
> Best,
> Stamatis
>
> [1]
> https://cwiki.apache.org/confluence/display/Hive/HowToContribute#HowToContribute-JIRA
>
> On Tue, Nov 15, 2022 at 9:59 PM Stamatis Zampetakis 
> wrote:
>
>> Logged https://issues.apache.org/jira/browse/INFRA-23905 for the
>> creation of the new mailing list.
>>
>> On Tue, Nov 15, 2022 at 9:57 PM Abhay Chennagiri <
>> achennag...@cloudera.com> wrote:
>>
>>> +1, Thank you, Stamatis.
>>>
>>> On Tue, Nov 15, 2022 at 12:42 PM Pravin Sinha 
>>> wrote:
>>>
 +1, Thanks, Stamatis.

 -Pravin

 On Tue, Nov 15, 2022 at 5:57 PM Stamatis Zampetakis 
 wrote:

> Hi everyone,
>
> Due to the large amount of spam account creation the ASF INFRA team
> has disabled the JIRA account creation [1].
>
> From the 11th of November, contributors who wish to have a JIRA
> account (to create, assign, watch, etc issues) will need to request an
> account through an ASF PMC.
>
> Other projects, such as Calcite, have already taken the necessary
> actions to streamline the process for new contributors [2].
>
> I would suggest drawing inspiration from Calcite and take similar
> actions in Hive.
>
> If you all agree we can start by creating a dedicated (private)
> mailing lists for such requests:
> jira-reque...@hive.apache.org
>
> and then proceed with a brief documentation of the process in the wiki
> or website.
>
> What do you think?
>
> Best,
> Stamatis
>
> [1] https://blogs.apache.org/infra/entry/jira-public-signup-disabled
> [2] https://lists.apache.org/thread/5odg6wyvwfkryk96ls2w3vxnrkftw50s
>

Re: [ANNOUNCE] New committer for Apache Hive: Alessandro Solimando

[Ayush Saxena]

Congratulations Alessandro!!!

-Ayush

> On 09-Feb-2023, at 1:30 AM, Naveen Gangam  wrote:
> 
> The Project Management Committee (PMC) for Apache Hive has invited
> Alessandro Solimando (asolimando) to become a committer and is pleased
> to announce that he has accepted.
> 
> Contributions from Alessandro:
> He has authored 30 patches for Hive, 18 for Apache Calcite and has
> done many code reviews for other contributors. Vast experience and
> knowledge in SQL Compiler and Optimization. His most recent work was
> added support for histogram-based column stats in Hive.
> 
> https://issues.apache.org/jira/issues/?filter=12352498
> 
> Being a committer enables easier contribution to the project since
> there is no need to go via the patch submission process. This should
> enable better productivity.A PMC member helps manage and guide the
> direction of the project.
> 
> Congratulations
> Hive PMC

Re: [ANNOUNCE] New PMC Member: Laszlo Bodor

[Ayush Saxena]

Congratulations Laszlo -AyushOn 28-Jan-2023, at 7:17 AM, Butao Zhang  wrote:







Congratulations Laszlo Bodor !!!








 

Thanks,Butao Zhang


 

  
 Replied Message 
  
  

  

 From 


Alessandro Solimando


  
  

 Date 


1/28/2023 06:23

  
  

 To 


 
  


  

  
  

 Cc 


  

,
  
  


  

  
  

 Subject 


  Re: [ANNOUNCE] New PMC Member: Laszlo Bodor

  

  
  Congratulations Laszlo, very well deserved, thanks for all your hard work.Best regards,AlessandroOn Fri, 27 Jan 2023 at 22:33, Naveen Gangam wrote: Hello Hive Community, Apache Hive PMC is pleased to announce that Laszlo Bodor (username:abstractdog) has accepted the Apache Hive PMC's invitation to become PMC Member, and is now our newest PMC member. Please join me in congratulating Laszlo !!! He has been an active member in the hive community across many aspects of the project. Many thanks to Laszlo for all the contributions he has made and looking forward to many more future contributions in the expanded role. https://github.com/apache/hive/commits?author=abstractdog * 96 commits in master [2] * 66 reviews in master [3] * Reported 163 JIRAS [6] Cheers, Naveen (on behalf of Hive PMC)

Re: Unsubscribe

[Ayush Saxena]

It won't work like that send a mail to
 user-unsubscr...@hive.apache.org

-Ayush

On Wed, 18 Jan 2023 at 19:18, S T  wrote:

> Please unsubscribe.
>

Re: [EXTERNAL] [ANNOUNCE] New PMC Member: Stamatis Zampetakis

[Ayush Saxena]

Congratulations Stamatis-Ayush On 14-Jan-2023, at 1:41 AM, Alessandro Solimando  wrote:Congratulations Stamatis,very well deserved!Best regards,AlessandroOn Fri 13 Jan 2023, 19:57 Chris Nauroth,  wrote:Congratulations, Stamatis!

Chris Nauroth


On Fri, Jan 13, 2023 at 10:46 AM Simhadri G  wrote:

> Congratulations Stamatis!
>
> On Sat, 14 Jan 2023, 00:12 Sankar Hariappan via user, <
> user@hive.apache.org>
> wrote:
>
> > Congrats Stamatis! Well deserved one 
> >
> >
> >
> > Thanks,
> >
> > Sankar
> >
> >
> >
> > *From:* Naveen Gangam 
> > *Sent:* Saturday, January 14, 2023 12:03 AM
> > *To:* dev ; user@hive.apache.org
> > *Cc:* zabe...@apache.org
> > *Subject:* [EXTERNAL] [ANNOUNCE] New PMC Member: Stamatis Zampetakis
> >
> >
> >
> > Hello Hive Community,
> >
> > Apache Hive PMC is pleased to announce that Stamatis Zampetakis has
> > accepted the Apache Hive PMC's invitation to become PMC Member, and is
> now
> > our newest PMC member. Please join me in congratulating Stamatis !!!
> >
> >
> >
> > He has been an active member in the hive community across many aspects of
> > the project. Many thanks to Stamatis for all the contributions he has
> made
> > and looking forward to many more future contributions in the expanded
> role.
> >
> >
> >
> > Cheers,
> >
> > Naveen (on behalf of Hive PMC)
> >
>

Re: Make Hive 3.1 and Hadoop 3.3 work in the same node

[Ayush Saxena]

>
> While most other Hadoop ecosystem including Hadoop 3.3, Spark 3.3, Kafka
> 3.3 seem require java 11.


Hadoop 3.3.x line just supports Java-11 runtime support, the default
supported JDK is still 8, atleast for hadoop, if it wasn't working with
JDK-8, some issue with your hadoop installation or some bug there in the
hadoop code, which you need to fix or reach out to hadoop ML/Jira

-Ayush

On Sat, 24 Dec 2022 at 11:26, yp...@t-online.de  wrote:

>
>
> Hello,
>
> Hive 3.1 requires java 8 to work.
> While most other Hadoop ecosystem including Hadoop 3.3, Spark 3.3, Kafka
> 3.3 seem require java 11.
> I have all of them installed in the same system to work together.
> This is how I did,
>
> https://blog.crypt.pw/How-to-run-Hadoop-3.3-and-Hive-3.1-in-same-node
>
> Hope it also helps to you too.
>
> Thanks.
>

Re: [DISCUSS] Jira Public Signup Disabled

[Ayush Saxena]

+1-AyushOn 15-Nov-2022, at 5:57 PM, Stamatis Zampetakis  wrote:Hi everyone,Due to the large amount of spam account creation the ASF INFRA team has disabled the JIRA account creation [1].From the 11th of November, contributors who wish to have a JIRA account (to create, assign, watch, etc issues) will need to request an account through an ASF PMC.Other projects, such as Calcite, have already taken the necessary actions to streamline the process for new contributors [2].I would suggest drawing inspiration from Calcite and take similar actions in Hive.If you all agree we can start by creating a dedicated (private) mailing lists for such requests:jira-reque...@hive.apache.organd then proceed with a brief documentation of the process in the wiki or website.What do you think?Best,Stamatis[1] https://blogs.apache.org/infra/entry/jira-public-signup-disabled[2] https://lists.apache.org/thread/5odg6wyvwfkryk96ls2w3vxnrkftw50s

Re: Proposal: Revamp Apache Hive website.

[Ayush Saxena]

;>> Now regarding the current process for modifying and updating the website 
>>>> there is some info in this relatively recent thread [1].
>>>> 
>>>> Moving forward, I would really like to have the source code of the website 
>>>> (markdown etc) in the main repo of the project [2], and use GitHub actions 
>>>> to automatically build and push the content to the site repo [3] per 
>>>> commit basis.
>>>> This workflow is used in Apache Calcite and I find it extremely convenient.
>>>> 
>>>> Best,
>>>> Stamatis
>>>> 
>>>> [1] https://lists.apache.org/thread/4b6x4d6z4tgnv4mo0ycg30y4dlt0msbd
>>>> [2] https://github.com/apache/hive
>>>> [3] https://github.com/apache/hive-site
>>>> 
>>>>> On Thu, Sep 15, 2022 at 10:50 PM Ayush Saxena  wrote:
>>>>> Owen,
>>>>> I am not sure if I am catching you right, But now the repository for the 
>>>>> website has changed, we no longer use our main hive.git repository for 
>>>>> the website, We are using the hive-site repository for the website, The 
>>>>> migration happened this year January I suppose.
>>>>> 
>>>>> Can give a check to the set of commit here from: gmcdonald and Humbedooh
>>>>> https://github.com/apache/hive-site/commits/main
>>>>> 
>>>>> Now whatever you push to main branch of 
>>>>> hive-site(https://github.com/apache/hive-site) it gets published on the 
>>>>> asf-site branch by the 
>>>>> buildbot(https://github.com/apache/hive-site/commits/asf-site)
>>>>> 
>>>>> Simhadri's changes will be directed to the main branch of the hive-site 
>>>>> repo and they will get auto published on the asf-site branch, I tried 
>>>>> this a couple of months back and it indeed worked that way. Let me know 
>>>>> if we are missing anything on this, I tried to find threads around this 
>>>>> but not sure if it is in private@ or so, couldn't find, I will try again 
>>>>> and if there is something around that what needs to be done, I will have 
>>>>> a word with the Infra folks and get that sorted, if it isn't already.
>>>>> 
>>>>> -Ayush
>>>>> 
>>>>>> On Fri, 16 Sept 2022 at 01:49, Owen O'Malley  
>>>>>> wrote:
>>>>>> Look at the threads and talk to Apache Infra. They couldn't make it work 
>>>>>> before. We would have needed to manually publish to the asf-site branch.
>>>>>> 
>>>>>>> On Thu, Sep 15, 2022 at 7:54 PM Simhadri G  
>>>>>>> wrote:
>>>>>>> Thanks Ayush, Pau Tallada and Owen O'Malley for the feedback!
>>>>>>> 
>>>>>>> @Owen , This website revamp indeed replaces the website with markdown 
>>>>>>> as you have mentioned. I have referred to your PR for some of the 
>>>>>>> content for the site.
>>>>>>> The actual code for the website is here: 
>>>>>>> https://github.com/simhadri-g/hive-site/tree/new-site 
>>>>>>> 
>>>>>>> Once we add markdown files to the source code under /content/ , hugo 
>>>>>>> will rebuild the files and generate the static html files in ./public/ 
>>>>>>> directory.
>>>>>>> I have copied over these static files to a separate repo and 
>>>>>>> temporarily hosted it with gh-pages to start the mail chain.
>>>>>>> 
>>>>>>>  For the final site, I am already trying to automate this with github 
>>>>>>> actions. So, as soon as any new changes are made to the site branch, 
>>>>>>> the github actions will automatically tigger and update the site.
>>>>>>> 
>>>>>>> Thanks!
>>>>>>> 
>>>>>>>> On Fri, Sep 16, 2022 at 12:17 AM Owen O'Malley 
>>>>>>>>  wrote:
>>>>>>>> I found it - https://github.com/apache/hive/pull/1410
>>>>>>>> 
>>>>>>>>> On Thu, Sep 15, 2022 at 6:42 PM Owen O'Malley 
>>>>>>>>>  wrote:
>>>>>>>>> I had a PR to replace the website with markdown. Apache Infra was 
>>>>>>>>> supposed to make it autopublish. *sigh*
>>>>>>>>> 
>>&

Re: Proposal: Revamp Apache Hive website.

[Ayush Saxena]

Owen,
I am not sure if I am catching you right, But now the repository for the
website has changed, we no longer use our main *hive.git* repository for
the website, We are using the* hive-site *repository for the website, The
migration happened this year January I suppose.

Can give a check to the set of commit here from: gmcdonald
<https://github.com/apache/hive-site/commits?author=gmcdonald> and Humbedooh
<https://github.com/apache/hive-site/commits?author=Humbedooh>
https://github.com/apache/hive-site/commits/main

Now whatever you push to main branch of hive-site(
https://github.com/apache/hive-site) it gets published on the *asf-site*
branch by the buildbot(https://github.com/apache/hive-site/commits/asf-site)

Simhadri's changes will be directed to the main branch of the hive-site
repo and they will get auto published on the asf-site branch, I tried this
a couple of months back and it indeed worked that way. Let me know if we
are missing anything on this, I tried to find threads around this but not
sure if it is in private@ or so, couldn't find, I will try again and if
there is something around that what needs to be done, I will have a word
with the Infra folks and get that sorted, if it isn't already.

-Ayush

On Fri, 16 Sept 2022 at 01:49, Owen O'Malley  wrote:

> Look at the threads and talk to Apache Infra. They couldn't make it work
> before. We would have needed to manually publish to the asf-site branch.
>
> On Thu, Sep 15, 2022 at 7:54 PM Simhadri G  wrote:
>
>> Thanks Ayush, Pau Tallada and Owen O'Malley for the feedback!
>>
>> @Owen , This website revamp indeed replaces the website with markdown as
>> you have mentioned. I have referred to your PR for some of the content for
>> the site.
>> The actual code for the website is here:
>> https://github.com/simhadri-g/hive-site/tree/new-site
>>
>> Once we add markdown files to the source code under /content/ , hugo will
>> rebuild the files and generate the static html files in ./public/
>> directory.
>> I have copied over these static files to a separate repo and temporarily
>> hosted it with gh-pages to start the mail chain.
>>
>>  For the final site, I am already trying to automate this with github
>> actions. So, as soon as any new changes are made to the site branch, the
>> github actions will automatically tigger and update the site.
>>
>> Thanks!
>>
>> On Fri, Sep 16, 2022 at 12:17 AM Owen O'Malley 
>> wrote:
>>
>>> I found it - https://github.com/apache/hive/pull/1410
>>>
>>> On Thu, Sep 15, 2022 at 6:42 PM Owen O'Malley 
>>> wrote:
>>>
>>>> I had a PR to replace the website with markdown. Apache Infra was
>>>> supposed to make it autopublish. *sigh*
>>>>
>>>> .. Owen
>>>>
>>>> On Thu, Sep 15, 2022 at 4:23 PM Pau Tallada  wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> Great work!
>>>>> +1 on updating it as well
>>>>>
>>>>> Missatge de Ayush Saxena  del dia dj., 15 de set.
>>>>> 2022 a les 17:40:
>>>>>
>>>>>> Hi Simhadri,
>>>>>> Thanx for the initiative, +1 on updating our current website.
>>>>>> The new website looks way better than the existing one.
>>>>>> Can create a Jira and link this to that after a couple of days if
>>>>>> there aren’t any objections to the move, so as people can drop further
>>>>>> suggestions over there.
>>>>>>
>>>>>> -Ayush
>>>>>>
>>>>>> > On 15-Sep-2022, at 8:33 PM, SG  wrote:
>>>>>> >
>>>>>> > Hi Everyone,
>>>>>> >
>>>>>> > The existing apache hive website https://hive.apache.org/ hasn't
>>>>>> been
>>>>>> > updated for a very long time. Additionally, I was not able to build
>>>>>> the
>>>>>> > docker image associated with the site to test out new changes as
>>>>>> well.
>>>>>> > https://github.com/apache/hive-site
>>>>>> >
>>>>>> > Since the website is the front page of the project, I believe it
>>>>>> would be
>>>>>> > good to revamp the apache hive website with the latest features and
>>>>>> > releases.
>>>>>> >
>>>>>> > As a result, I have spent some time setting up an initial draft of
>>>>>> the
>>>>>> > website. There are still quite a few things that still need to be
>>>>>> > added/updated in the draft.  Here is the prototype site that I put
>>>>>> together
>>>>>> > so everyone could check it out:
>>>>>> https://simhadri-g.github.io/hive-site-hugo/
>>>>>> >
>>>>>> > The new website is based on Hugo. Hugo, is one of the most popular
>>>>>> > open-source static site generators. I was able to get a hugo
>>>>>> version of the
>>>>>> > site up very quickly with a landing page and docs and hugo also
>>>>>> makes
>>>>>> > maintaining the site very simple.
>>>>>> >
>>>>>> > Please have a look. Any feedback is much appreciated.
>>>>>> >
>>>>>> > Existing website: https://hive.apache.org/
>>>>>> > New website: https://simhadri-g.github.io/hive-site-hugo/
>>>>>> >
>>>>>> > Thanks!
>>>>>> > Simhadri G
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> --
>>>>> Pau Tallada Crespí
>>>>> Departament de Serveis
>>>>> Port d'Informació Científica (PIC)
>>>>> Tel: +34 93 170 2729
>>>>> --
>>>>>
>>>>>

Re: Proposal: Revamp Apache Hive website.

[Ayush Saxena]

Hi Simhadri,
Thanx for the initiative, +1 on updating our current website.
The new website looks way better than the existing one.
Can create a Jira and link this to that after a couple of days if there aren’t 
any objections to the move, so as people can drop further suggestions over 
there.

-Ayush

> On 15-Sep-2022, at 8:33 PM, SG  wrote:
> 
> Hi Everyone,
> 
> The existing apache hive website https://hive.apache.org/ hasn't been
> updated for a very long time. Additionally, I was not able to build the
> docker image associated with the site to test out new changes as well.
> https://github.com/apache/hive-site
> 
> Since the website is the front page of the project, I believe it would be
> good to revamp the apache hive website with the latest features and
> releases.
> 
> As a result, I have spent some time setting up an initial draft of the
> website. There are still quite a few things that still need to be
> added/updated in the draft.  Here is the prototype site that I put together
> so everyone could check it out: https://simhadri-g.github.io/hive-site-hugo/
> 
> The new website is based on Hugo. Hugo, is one of the most popular
> open-source static site generators. I was able to get a hugo version of the
> site up very quickly with a landing page and docs and hugo also makes
> maintaining the site very simple.
> 
> Please have a look. Any feedback is much appreciated.
> 
> Existing website: https://hive.apache.org/
> New website: https://simhadri-g.github.io/hive-site-hugo/
> 
> Thanks!
> Simhadri G