+1 (binding)
I agree that shaded hive-exec should be the proper way to go, however, ATM it's
a show-stopper for many downstream projects to upgrade.
Also based on the mail threads, they clearly understand the risks of using an
unshaded jar but still insist on keeping it.
If we'd like to improve the project
Just found out that Amoro project is also using hive-exec:jar:core
+1 to restore
Would we fix the problem by relocating just guava and joda-time?
Here is how it's done in Impala:
https://github.com/apache/impala/blob/master/java/shaded-deps/hive-exec/pom.xml#L70-L77
as much as I can :)
>
> Best,
> Stamatis
>
> On Thu, Apr 18, 2024 at 11:53 AM Denys Kuzmenko wrote:
> >
> > Hi Stamatis,
> >
> > That is the standard practice to create minor version release for bugfixes.
> > Many upstream projects follow that
; would be 4.1.0 and that it would be cut from master. I would like to
> >> understand how 4.0.1 is different and if it is, what is the
> >> contribution pattern that contributors and committers should follow?
> >> If the idea is to maintain and commit in two (or mor
Hi Ravi,
hive-exec is the uber jar, the same thing is done in Hive-3.x. We are
considering restoring the hive-core jar that only has classes from ql
On 2024/04/16 06:24:20 Mergu Ravi wrote:
> Hi Hive Team,
>
> I'm currently using the Hive 4.0.0 libraries and facing an issue with the
>
We might need it sooner as identified some critical issues in the recent code:
1. HIVE-28166: Truncate on Iceberg table disregards the branch name and
operates on a main;
2. HIVE-28190: Materialized view rebuild lock heart-beating is broken;
Looks great, thanks Ayush!
Hi Henri,
The idea to provide a simple, open standard interface to enable integration of
3rd party compute engines and tools is great, however, there are concerns about
the suggested design.
-1 on the current implementation (+1 more Jetty server on HMS instance)
The Apache Hive team is proud to announce the release of Apache Hive
version 4.0.0.
The Apache Hive (TM) data warehouse software facilitates querying and
managing large datasets residing in distributed storage. Built on top
of Apache Hadoop (TM), it provides, among others:
* Tools to enable easy
Thanks to everyone who verified the release candidate and gave their
comments and votes.
Voting has closed and the results are as follows:
4 binding +1s:
* Ayush Saxena
* Denys Kuzmenko
* Marta Kuczora
* Krisztian Kasa
1 +0
* Stamatis Zampetakis
7 non-binding +1s:
* Butao Zhang
+1 (binding)
* Executed functional test suite against Postgres DB
Hi Everyone,
We would like to thank everyone who has contributed to the project and request
the Hive PMC members to review and vote on this new release candidate.
Apache Hive 4.0.0 RC-0 artifacts are available here:*
https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/
The checksums are
Hi Pravin,
TPC-DS tracking Jira: HIVE-27929.
The functional test run is completed, waiting for the TPC-DS execution. There
were some glitches with the infra last week, expecting results in the next 2-3
days. After that, we should be ready with RC.
Regards,
Denys
| Attila Turoczy |
> > | Date | 11/23/2023 22:29 |
> > | To | |
> > | Subject | Re: Release of Hive 4 and TPC-DS benchmark |
> > Excellent new Denys! Hive 4 is here! Can't wait :)
> >
> > -Attila
> >
> >
> > On Thu, Nov 23, 2023 at 3:20 PM D
Hi Ravi,
ATM we have 3 items to resolve before the release [1].
1. HIVE-27924 will be merged in a couple of days;
2. HIVE-27775 is under review;
3. HIVE-27858 is under investigation, however, we might exclude it from 4.0
release;
In parallel, we are running TPC-DS benchmarks.
+1
+1 (binding)
+1 for marking Hive 1.x EOL
Assuming no volunteers willing to take ownership of branch-2 maintenance, +1 to
declare it EOL as well.
Regards,
Denys
Hi All,
Hive 4.0.0 release branch cut is happening today.
Best,
Denys
Update:
1. Query 2, 71: Resolved in HIVE-27006 [1];
2. Query 97: Under review in HIVE-27269 [2];
Thanks, Seonggon for providing a reproduce qfile.
3. Query 14: Reported in HIVE-24167 [3];
set hive.optimize.cte.materialize.threshold to -1 by default in Hive 4 and fix
it in the next versions
Congrats, very well deserved!
Hi Sungwoo,
Thank you for bringing this up again.
Based on HIVE-26654, it looks like we have 3 PR pending review:
1. HIVE-26986 - Query 71
2. HIVE-27006 - Query 2
3. HIVE-27269 - Query 97 (is that ready to be reviewed?)
We'll prioritize those.
For query 14, as you suggested, we might set
Instead of adding the dependencies, can't we add the possibility to include
jdbc jars in the classpath?
something like this:
org.apache.maven.plugins
maven-failsafe-plugin
integration-test
verify
${itest.jdbc.jars}
+1
* Verified signatures and checksum;
* Checked binary content and successfully built from the source;
* Skimmed through the release notes;
* Initialized backend DB schema and launched HMS & HS2 locally;
* Conducted basic checks via beeline:
- Created a few ACID & Iceberg tables and loaded
I’ll second the above. We already have a number of flaky tests that would go
undetected and just increase the build time.
Nice, tnx Ayush!
great, this is the current list of release managers:
4.0.0 Stamatis Zampetakis
4.1.0 Denys Kuzmenko
4.2.0 Sai Hemanth Gantasala
Should we keep the same RM order and just shift the releases or find a
volunteer for the 4.0.0-beta release, WDYT?
Hi folks,
The master branch has many new features, bug fixes, and performance
improvements since alpha-2. However, we still have several correctness bugs
[HIVE-26654] and performance issues that should be eliminated before the GA.
Could we consider doing a beta release to keep at least a
Thanks, Sungwoo for running the TPC-DS benchmark. Do we know if the same level
of performance degradation was present in 4.0.0-alpha1?
All: please use the `hive-4.0.0-must` label in a ticket if you think it's a
show-stopper for the release.
Hi, I can take the following one: 4.1.0
Sorry for being late to the party. I think what Kirti proposes would be good
for the project and end-users. As mentioned, we could start with 2-3 releases
per year, and once we improve on the process and automation (CI/CD) we could
reevaluate.
Denys Kuzmenko created HIVE-27160:
-
Summary: Iceberg: Optimise delete (entire) data from table
Key: HIVE-27160
URL: https://issues.apache.org/jira/browse/HIVE-27160
Project: Hive
Issue Type
Denys Kuzmenko created HIVE-27155:
-
Summary: Iceberg: Vectorize virtual columns
Key: HIVE-27155
URL: https://issues.apache.org/jira/browse/HIVE-27155
Project: Hive
Issue Type: Task
Denys Kuzmenko created HIVE-26995:
-
Summary: Iceberg: Enhance time travel syntax with expressions
Key: HIVE-26995
URL: https://issues.apache.org/jira/browse/HIVE-26995
Project: Hive
Issue
Denys Kuzmenko created HIVE-26873:
-
Summary: Whiltelist iceberg configs for sql std authorization
Key: HIVE-26873
URL: https://issues.apache.org/jira/browse/HIVE-26873
Project: Hive
Issue
Denys Kuzmenko created HIVE-26811:
-
Summary: SharedWorkOptimizer: take the union of virtual columns in
mergeable TableScan
Key: HIVE-26811
URL: https://issues.apache.org/jira/browse/HIVE-26811
Hi Cameron,
That's fine, however, I usually contribute to the original PR.
You could download github cli and checkout the branch via the following
command:
`gh pr checkout `, in your case it was 3534.
Unfortunately, Epic is not on the list of supported issue types for the Hive
project. I
Hi Cameron, Rohan,
Are you still planning to contribute or need some help/support in terms of code
review/etc.
I've checked Rohan's PR, it looks good, but requires a rebase.
Please let us know how we could help.
Kind regards,
Denys
The Apache Hive team is proud to announce the release of Apache Hive
version 4.0.0-alpha-2
The Apache Hive (TM) data warehouse software facilitates querying and
managing large datasets residing in distributed storage. Built on top
of Apache Hadoop (TM), it provides, among others:
* Tools to
Hi Stamatis,
Thanks for bringing it up! +1 to implement the same process
>> $ gpg --verify apache-hive-4.0.0-alpha-2-bin.tar.gz.asc
> > >> apache-hive-4.0.0-alpha-2-bin.tar.gz
> > >> gpg: Signature made Mon 7 Nov 19:04:05 2022 CET
> > >> gpg:using RSA key
> 50606DE1BDBD5CF862A595A907C5682DAFC73125
> > >>
UPD: Voting will conclude in 1 week (Monday 14th).
On Mon, Nov 7, 2022 at 7:57 PM Denys Kuzmenko
wrote:
> Hi team,
>
> Let's give it 1 more chance.
>
> Apache Hive 4.0.0-alpha-2 Release Candidate 1 is available
> here:https://people.apache.org/~dkuzmenko/release
Hi team,
Let's give it 1 more chance.
Apache Hive 4.0.0-alpha-2 Release Candidate 1 is available
here:https://people.apache.org/~dkuzmenko/release-4.0.0-alpha-2-rc1/
Change log:
- Updated copyright notices (year of distribution was taken from
`project.build.outputTimestamp` defined in apache
Denys Kuzmenko created HIVE-26704:
-
Summary: Cleaner shouldn't be blocked by global min open txnId
Key: HIVE-26704
URL: https://issues.apache.org/jira/browse/HIVE-26704
Project: Hive
Issue
Hi team,
Thank you for taking time to verify this RC!
Unfortunately, we didn't get enough votes to go ahead with the release.
Closing this vote as unsuccessful.
Kind regards,
Denys
updated in alpha-1 is most likely an
> oversight.
>
> Having said that the final decision is up to the release manager.
>
> Best,
> Stamatis
>
> On Fri, Oct 28, 2022 at 1:57 PM Denys Kuzmenko
> wrote:
>
> > Hi Stamatis,
> >
> > My bad, s
migrated to Hive 3.x, Then how did you face
> > this problem? Some patched version of Hive, or some missing FixVersion in
> > the Jira?
> >
> > Good to mention the version post which the change in prefix happens in
> the
> > wiki as well, to avoid future conf
2 at 10:32 AM Ayush Saxena wrote:
>
> > +1 (non-binding)
> > * Built from source.
> > * Verified Checksums.
> > * Verified Signatures
> > * Ran some basic unit tests.
> > * Ran some basic ACID & Iceberg related queries with Tez.
> > * Skimmed throug
Hi Chris,
Please try now
On Fri, Oct 28, 2022 at 12:43 PM Stamatis Zampetakis
wrote:
> Hive PMC members can provide edit rights to the wiki.
>
> @Naveen, Dennys, Adam: Can someone please give write privileges to Chris?
>
> Best,
> Stamatis
>
> On Fri, Oct 28, 2022 at 8:41 AM Chris Nauroth
>
> > > > unfortunately my vote is -1 (although non-binding) due to a classpath
> > > error
> > > > which prevents queries involving Tez to complete (all the details at
> > the
> > > > end of the email, apologies for the length
; Alessandro
>
> On Thu, 27 Oct 2022 at 15:22, Denys Kuzmenko .invalid>
> wrote:
>
> > Hi Adam,
> >
> > Thanks for pointing that out! Upstream release guide is outdated. Once I
> > receive the edit rights, I'll amend the instructions.
> > Updated the re
ing
> during build, can you please rebuild?
>
> Thanks,
> Adam
>
> On 2022/10/25 11:20:23 Denys Kuzmenko wrote:
> > Hi team,
> >
> >
> > Apache Hive 4.0.0-alpha-2 Release Candidate 0 is available
> > here:https://people.apache.org/~dk
Hi team,
Apache Hive 4.0.0-alpha-2 Release Candidate 0 is available
here:https://people.apache.org/~dkuzmenko/release-4.0.0-alpha-2-rc0/
The checksums are these:
- 7d4c54ecfe2b04cabc283a84defcc1e8a02eed0e13baba2a2c91ae882b6bfaf7
apache-hive-4.0.0-alpha-2-bin.tar.gz
-
ra to avoid issues with building Release
> > Notes for our next 4.0.0 release
> >
> > A simple INFRA ticket or anyone with Hive Jira Admin rights should be
> able
> > to do so.
> >
> > [1]
> >
> https://issues.apache.org/jira/issues/?jql=project%20%
Hi Team,
Branching for Hive *4.0.0-alpha-2* was done today:
https://github.com/apache/hive/tree/branch-4.0.0-alpha-2
The next development version is *4.0.0-SNAPSHOT*
*alpha-2 *branch would be open for commits until Monday. If you would like
to include something major in it, but need more time,
Denys Kuzmenko created HIVE-26645:
-
Summary: Preparing for 4.0.0-GA development
Key: HIVE-26645
URL: https://issues.apache.org/jira/browse/HIVE-26645
Project: Hive
Issue Type: Task
Denys Kuzmenko created HIVE-26487:
-
Summary: Auto-compaction may hang or skip some of the eligible
items
Key: HIVE-26487
URL: https://issues.apache.org/jira/browse/HIVE-26487
Project: Hive
Denys Kuzmenko created HIVE-26433:
-
Summary: HivePrivilegeObject's objectName is NULL when
JdbcStorageHandler is used with METASTORE type
Key: HIVE-26433
URL: https://issues.apache.org/jira/browse/HIVE-26433
Denys Kuzmenko created HIVE-26416:
-
Summary: AcidUtils$MetaDataFile.isRawFormatFile() throws
InvalidProtocolBufferException for non-ORC file
Key: HIVE-26416
URL: https://issues.apache.org/jira/browse/HIVE-26416
Denys Kuzmenko created HIVE-26293:
-
Summary: Migrate remaining exclusive DDL operations to EXCL_WRITE
lock & bug fixes
Key: HIVE-26293
URL: https://issues.apache.org/jira/browse/HIVE-26293
Pro
Denys Kuzmenko created HIVE-26252:
-
Summary: Missing locks in case of MERGE with multiple branches
Key: HIVE-26252
URL: https://issues.apache.org/jira/browse/HIVE-26252
Project: Hive
Issue
Denys Kuzmenko created HIVE-26165:
-
Summary: Remove READ locks for ACID tables with SoftDelete enabled
Key: HIVE-26165
URL: https://issues.apache.org/jira/browse/HIVE-26165
Project: Hive
Denys Kuzmenko created HIVE-26149:
-
Summary: Non blocking DROP DATABASE implementation
Key: HIVE-26149
URL: https://issues.apache.org/jira/browse/HIVE-26149
Project: Hive
Issue Type: Task
Denys Kuzmenko created HIVE-26129:
-
Summary: Non blocking DROP CONNECTOR
Key: HIVE-26129
URL: https://issues.apache.org/jira/browse/HIVE-26129
Project: Hive
Issue Type: Task
Denys Kuzmenko created HIVE-26121:
-
Summary: Hive transaction rollback should be thread-safe
Key: HIVE-26121
URL: https://issues.apache.org/jira/browse/HIVE-26121
Project: Hive
Issue Type
Denys Kuzmenko created HIVE-26106:
-
Summary: Non blocking ADD, DROP CONSTRAINT
Key: HIVE-26106
URL: https://issues.apache.org/jira/browse/HIVE-26106
Project: Hive
Issue Type: Task
+1
* Downloaded the release candidate artifacts and verified the signatures
and checksums;
* Built from the release sources;
* Initialized schema using schematool and launched hiveserver2 locally;
* Used beeline to connect:
- Created a few tables and loaded data into them.
- Executed some
Denys Kuzmenko created HIVE-26076:
-
Summary: Non blocking ADD PARTITION if not exists
Key: HIVE-26076
URL: https://issues.apache.org/jira/browse/HIVE-26076
Project: Hive
Issue Type: Task
Denys Kuzmenko created HIVE-26053:
-
Summary: Non blocking DROP VIEW
Key: HIVE-26053
URL: https://issues.apache.org/jira/browse/HIVE-26053
Project: Hive
Issue Type: Task
Reporter
Denys Kuzmenko created HIVE-26052:
-
Summary: Non-blocking DROP MATERIALIZED VIEW implementation
Key: HIVE-26052
URL: https://issues.apache.org/jira/browse/HIVE-26052
Project: Hive
Issue Type
Denys Kuzmenko created HIVE-26051:
-
Summary: Non blocking Alter Materialized View Rewrite
Key: HIVE-26051
URL: https://issues.apache.org/jira/browse/HIVE-26051
Project: Hive
Issue Type: Task
Denys Kuzmenko created HIVE-26023:
-
Summary: Non blocking REPLACE, RENAME COLUMNS implementation
Key: HIVE-26023
URL: https://issues.apache.org/jira/browse/HIVE-26023
Project: Hive
Issue
Denys Kuzmenko created HIVE-25956:
-
Summary: Non blocking RENAME TABLE implementation
Key: HIVE-25956
URL: https://issues.apache.org/jira/browse/HIVE-25956
Project: Hive
Issue Type: Task
Congrats Ayush!
On Tue, Feb 8, 2022 at 5:51 AM Sankar Hariappan
wrote:
> Congrats Ayush!
>
> --
> Sankar
>
> -Original Message-
> From: László Bodor
> Sent: 07 February 2022 21:20
> To: dev@hive.apache.org
> Subject: [EXTERNAL] Re: [ANNOUNCE] New committer: Ayush Saxena
>
> Welcome
Thank you! I am truly honored.
On Tue, Feb 8, 2022 at 5:51 AM Sankar Hariappan
wrote:
> Congrats Denys!
>
> --
> Sankar
>
> -Original Message-
> From: Ashutosh Chauhan
> Sent: 07 February 2022 22:10
> To: dev@hive.apache.org
> Subject: [EXTERNAL] [ANNOU
Denys Kuzmenko created HIVE-25934:
-
Summary: Non blocking RENAME PARTITION implementation
Key: HIVE-25934
URL: https://issues.apache.org/jira/browse/HIVE-25934
Project: Hive
Issue Type: Task
Denys Kuzmenko created HIVE-25904:
-
Summary: ObjectStore's updateTableColumnStatistics is not
ThreadSafe
Key: HIVE-25904
URL: https://issues.apache.org/jira/browse/HIVE-25904
Project: Hive
Denys Kuzmenko created HIVE-25881:
-
Summary: isEligibleForCompaction runs under the
ForkJoinPool.commonPool
Key: HIVE-25881
URL: https://issues.apache.org/jira/browse/HIVE-25881
Project: Hive
Denys Kuzmenko created HIVE-25781:
-
Summary: Restore multi-threaded support in Cleaner
Key: HIVE-25781
URL: https://issues.apache.org/jira/browse/HIVE-25781
Project: Hive
Issue Type: Sub
Denys Kuzmenko created HIVE-25755:
-
Summary: TestTxnCommands classes refactor
Key: HIVE-25755
URL: https://issues.apache.org/jira/browse/HIVE-25755
Project: Hive
Issue Type: Test
Denys Kuzmenko created HIVE-25710:
-
Summary: Config used to enable non-blocking TRUNCATE is not
properly propagated
Key: HIVE-25710
URL: https://issues.apache.org/jira/browse/HIVE-25710
Project: Hive
Denys Kuzmenko created HIVE-25688:
-
Summary: Non blocking DROP PARTITION implementation
Key: HIVE-25688
URL: https://issues.apache.org/jira/browse/HIVE-25688
Project: Hive
Issue Type: Task
Denys Kuzmenko created HIVE-25645:
-
Summary: Query-based compaction doesn't work when partition column
type is boolean
Key: HIVE-25645
URL: https://issues.apache.org/jira/browse/HIVE-25645
Project
Denys Kuzmenko created HIVE-25631:
-
Summary: Initiator speed-up: only read compaction history once per
loop
Key: HIVE-25631
URL: https://issues.apache.org/jira/browse/HIVE-25631
Project: Hive
Denys Kuzmenko created HIVE-25623:
-
Summary: Create a parametrized test to check against the disabled
MIN_HISTORY config
Key: HIVE-25623
URL: https://issues.apache.org/jira/browse/HIVE-25623
Project
Denys Kuzmenko created HIVE-25603:
-
Summary: Restore original method signature in
VectorizedOrcAcidRowBatchReader.getDeleteDeltaDirsFromSplit
Key: HIVE-25603
URL: https://issues.apache.org/jira/browse/HIVE-25603
Denys Kuzmenko created HIVE-25516:
-
Summary: ITestDbTxnManager is broken after HIVE-24120
Key: HIVE-25516
URL: https://issues.apache.org/jira/browse/HIVE-25516
Project: Hive
Issue Type: Task
Denys Kuzmenko created HIVE-25503:
-
Summary: Add cleanup for the duplicate COMPLETED_TXN_COMPONENTS
entries
Key: HIVE-25503
URL: https://issues.apache.org/jira/browse/HIVE-25503
Project: Hive
Denys Kuzmenko created HIVE-25502:
-
Summary: Cleaner causes data loss when processing aborted txn with
DP
Key: HIVE-25502
URL: https://issues.apache.org/jira/browse/HIVE-25502
Project: Hive
Denys Kuzmenko created HIVE-25441:
-
Summary: Incorrect deltas split for sub-compactions when using
`hive.compactor.max.num.delta`
Key: HIVE-25441
URL: https://issues.apache.org/jira/browse/HIVE-25441
Denys Kuzmenko created HIVE-25393:
-
Summary: Prevent concurrent compaction and DDL operations
Key: HIVE-25393
URL: https://issues.apache.org/jira/browse/HIVE-25393
Project: Hive
Issue Type
Denys Kuzmenko created HIVE-25259:
-
Summary: Tweak delta metrics with custom MBean for Prometheus
Key: HIVE-25259
URL: https://issues.apache.org/jira/browse/HIVE-25259
Project: Hive
Issue
Denys Kuzmenko created HIVE-25217:
-
Summary: Move isEligibleForCompaction evaluation under the
Initiator thread pool
Key: HIVE-25217
URL: https://issues.apache.org/jira/browse/HIVE-25217
Project
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73380/#review223064
---
We have switched to GitHub PRs nowadays.
- Denys Kuzmenko
Denys Kuzmenko created HIVE-25050:
-
Summary: Disable 'hive.metastore.acid.truncate.usebase' config as
it's introducing backward incompatible change
Key: HIVE-25050
URL: https://issues.apache.org/jira/browse/HIVE
Denys Kuzmenko created HIVE-24985:
-
Summary: Create metrics about locks
Key: HIVE-24985
URL: https://issues.apache.org/jira/browse/HIVE-24985
Project: Hive
Issue Type: Sub-task
Denys Kuzmenko created HIVE-24974:
-
Summary: Create new metrics about the number of delta files in the
ACID table
Key: HIVE-24974
URL: https://issues.apache.org/jira/browse/HIVE-24974
Project: Hive
Denys Kuzmenko created HIVE-24932:
-
Summary: Create new metric about Initiator / Worker hosts
Key: HIVE-24932
URL: https://issues.apache.org/jira/browse/HIVE-24932
Project: Hive
Issue Type
1 - 100 of 326 matches
Mail list logo
