[jira] [Created] (HIVE-25071) Number of reducers limited to fixed 1 when updating/deleting
Krisztian Kasa created HIVE-25071:
-
Summary: Number of reducers limited to fixed 1 when
updating/deleting
Key: HIVE-25071
URL: https://issues.apache.org/jira/browse/HIVE-25071
Project: Hive
Issue Type: Bug
Reporter: Krisztian Kasa
Assignee: Krisztian Kasa
When updating/deleting bucketed tables an extra ReduceSink operator is created
to enforce bucketing. After HIVE-22538 number of reducers limited to fixed 1 in
these RS operators.
This can lead to performance degradation.
Prior HIVE-22538 multiple reducers was available such cases. The reason for
limiting the number of reducers is to ensure RowId ascending order in delete
delta files produced by the update/delete statements.
This is the plan of delete statement like:
{code}
DELETE FROM t1 WHERE a = 1;
{code}
{code}
TS[0]-FIL[8]-SEL[2]-RS[3]-SEL[4]-RS[5]-SEL[6]-FS[7]
{code}
RowId order is ensured by RS[3] and bucketing is enforced by RS[5]: number of
reducers were limited to bucket number in the table or hive.exec.reducers.max.
However RS[5] does not provide any ordering so above plan may generate unsorted
deleted deltas which leads to corrupted data reads.
Prior HIVE-22538 these RS operators were merged by ReduceSinkDeduplication and
the resulting RS kept the ordering and enabled multiple reducers. It could do
because ReduceSinkDeduplication was prepared for ACID writes. This was removed
by HIVE-22538 to get a more generic ReduceSinkDeduplication.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-25070) SessionHiveMetaStoreClient.getValidWriteIdList should handle "Retrying" exceptions
Steve Carlin created HIVE-25070: --- Summary: SessionHiveMetaStoreClient.getValidWriteIdList should handle "Retrying" exceptions Key: HIVE-25070 URL: https://issues.apache.org/jira/browse/HIVE-25070 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Steve Carlin The method SessionHiveMetaStoreClient.getValidWriteIdList() current catches all exceptions and rethrows a RuntimeException. This bypasses the logic that is in RetryingMetaStoreClient. Instead, this method should rethrow whatever Exceptions the Retrying class can handle (and get in line with the other methods in SessionHiveMetaStoreClient) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25069) Hive Distributed Tracing
Matt McCline created HIVE-25069: --- Summary: Hive Distributed Tracing Key: HIVE-25069 URL: https://issues.apache.org/jira/browse/HIVE-25069 Project: Hive Issue Type: New Feature Reporter: Matt McCline Instrument Hive code to gather distributed traces and export trace data to a configurable collector. Distributed tracing is a revolutionary tool for debugging issues. We will use new OpenTelemetry open-source standard that our industry has aligned on. OpenTelemetry is the merger of two earlier distributed tracing projects OpenTracing and OpenCensus. Next step: Add design document that goes into distributed tracing in more detail and describes how Hive will enhanced. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25068) I need Hive access please
Cassie Moorhead created HIVE-25068: -- Summary: I need Hive access please Key: HIVE-25068 URL: https://issues.apache.org/jira/browse/HIVE-25068 Project: Hive Issue Type: Bug Components: Authorization Reporter: Cassie Moorhead Attachments: Screen Shot 2021-04-28 at 10.41.36 AM.png I am a TIP employee and just got an Upwork email and now can't access Hive when I try to sign in using SSO. I keep getting the message: Sorry, you can't access Hive because you are not assigned this app in Okta. If you're wondering why this is happening, please [contact your administrator|https://upworkcorp.okta.com/app/hive/exk1hrcixpqXq7XMv1d8/sso/saml?SAMLRequest=nVPBjtowEP2VyHcSEsIutYAVBbVFhTaCtFr1Uhl7UiwSO3gcNtuvrxNIy6HLgVOkmef3Zt68jJ%2FqIvdOYFBqNSGh3ydP0zGyIi%2FprLJ7tYFjBWg9B1NI28aEVEZRzVAiVawApJbT7Wy9opHfp6XRVnOdE2%2B5mJCfw4eHON6JSHBgUSSG2WCXEe97J%2BheOCBiBUuFlinrSv0o7PXjXjRKw5jGIY2G%2Frtw8IN4yYX6vVRCql%2B359idQUg%2FpWnSS75uU%2BIt3CZSMdtK760tkQZBVb5oc%2BDalL4%2BWOZzXQSsLIO9PEEA9SHcGy7r8vh8fHxen0IxChB10DhBvBkimIZurhVWBZgtmJPk8G2z%2BifgyPyGrGXu3gbx4xoy8Zri748wGK0%2BS3L2nbZumCvDb%2B%2FJuhHItBPsxMbBFWF31S%2BOYblIdC756z1X%2FaBNwezb6NAP24oUvayFUiiYzGdCGEB0luW5fpkbYBYmxJoKSNCNdskaiDZ5zlIL9V3Jm%2BuiZEZic2aoGbedt9fE89xZt4HsHqdvwjjlDbUrJ%2B7jwiWa4AJ3i6WGKSy1sZfT%2FG%2Be6bn3hh1%2Fu9d%2F5%2FQP&fromLoginToken=gUn50o3guHvFgPlA61EWMY6VoOiblF6z8nykJjPSkG3d0G6k6-QMsdCQhKbB3J0n4Ck8p5gMAdr9XeBCixKwSDPN-7dZjvA0F94g3yl9Mat5naZbhJBrbM99wm0j-hXJ9wTk6GJ-tKRRztC2RFo9w8uJwnQCouEnsoVOCIovxKsGNHZrxY5QUVew3WRqIJi7PU9otffzXVacvCHvQ1kLbupjZahgY2zhutaqZGJdMlytSoEQM2oY0zRAkuBjajZE14nfOcCT9VDWHq8iq6D6xPWxkHQ175NucEMmgyNIKkZlcVDb_-kpA9SJSOMELgc4KnYzF-Dqwu3DSGLBid6SMg#]. If it's any consolation, we can take you to [your Okta home page|https://upworkcorp.okta.com/]. I believe my email needs access. Thanks! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25067) Add more tests to Iceberg partition pruning
Peter Vary created HIVE-25067: - Summary: Add more tests to Iceberg partition pruning Key: HIVE-25067 URL: https://issues.apache.org/jira/browse/HIVE-25067 Project: Hive Issue Type: Test Reporter: Peter Vary Assignee: Peter Vary As we have qtest for Iceberg now, it would be good to add some partition pruning qtest to have better coverage -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-25066) Show whether a materialized view supports incremental review or not
Krisztian Kasa created HIVE-25066:
-
Summary: Show whether a materialized view supports incremental
review or not
Key: HIVE-25066
URL: https://issues.apache.org/jira/browse/HIVE-25066
Project: Hive
Issue Type: Improvement
Components: Materialized views
Reporter: Krisztian Kasa
Assignee: Krisztian Kasa
Fix For: 4.0.0
Add information about whether a materialized view supports incremental rebuild
or not in an additional column in
{code:java}
SHOW MATERIALIZED VIEWS
{code}
statement.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-25065) Implement ALTER TABLE for setting iceberg table properties
László Pintér created HIVE-25065:
Summary: Implement ALTER TABLE for setting iceberg table properties
Key: HIVE-25065
URL: https://issues.apache.org/jira/browse/HIVE-25065
Project: Hive
Issue Type: Improvement
Reporter: László Pintér
Assignee: László Pintér
Currently, only the Iceberg -> HMS table property synchronization is
implemented.
We would like to make sure that {{ALTER TABLE SET TBLPROPERTIES()}} will update
the Iceberg table properties as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
