[jira] [Commented] (HIVE-28241) beeline does not connect to hive in kerberos environment hadoop3.3.6 hive3.1.3
[
https://issues.apache.org/jira/browse/HIVE-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842834#comment-17842834
]
manoj kumar commented on HIVE-28241:
hive-site.xml
---
system:java.io.tmpdir
/tmp/hive/java
system:user.name
${user.name}
hive.exec.scratchdir
/tmp/hive
hive.querylog.location
/tmp/hive
hive.downloaded.resources.dir
/tmp/hive
hive.exec.local.scratchdir
/tmp/hive/${system:user.name}
hive.downloaded.resources.dir
/tmp/${user.name}_resources
hive.zookeeper.quorum
mk1.example.com:2181,mk3.example.com:2181,mk5.example.com:2181
hive.zookeeper.client.port
2181
hive.zookeeper.namespace
hive_zookeeper_namespace
datanucleus.autoCreateSchema
false
datanucleus.cache.level2.type
none
datanucleus.fixedDatastore
true
hive.server2.thrift.port
1
javax.jdo.option.ConnectionDriverName
com.mysql.cj.jdbc.Driver
javax.jdo.option.ConnectionURL
jdbc:mysql://mk5.example.com/hive
javax.jdo.option.ConnectionUserName
hive
javax.jdo.option.ConnectionPassword
hive@123
hive.metastore.try.direct.sql.ddl
true
hive.metastore.try.direct.sql
true
hive.metastore.warehouse.dir
/user/hive/warehouse
hive.metastore.uris
thrift://mk5.example.com:9083,thrift://mk1.example.com:9083,thrift://mk3.example.com:9083,thrift://mk4.example.com:9083
hive.metastore.schema.verification
false
datanucleus.autoStartMechanism
SchemaTable
datanucleus.schema.autoCreateAll
false
hive.server2.logging.operation.enabled
true
hive.server2.logging.operation.log.location
/app/hadoop/logs/hive
hive.metastore.server.min.threads
200
hive.metastore.server.max.threads
10
datanucleus.connectionPool.maxPoolSize
50
hive.auto.convert.join
true
hive.auto.convert.join.noconditionaltask
true
hive.auto.convert.join.noconditionaltask.size
1145324612
hive.auto.convert.sortmerge.join
true
hive.auto.convert.sortmerge.join.to.mapjoin
false
hive.cbo.enable
true
hive.cli.print.header
false
hive.cluster.delegation.token.store.class
org.apache.hadoop.hive.thrift.MemoryTokenStore
hive.cluster.delegation.token.store.zookeeper.connectString
mk1.example.com:2181,mk3.example.com:2181,mk5.example.com:2181
hive.cluster.delegation.token.store.zookeeper.znode
/hive/cluster/delegation/
hive.compactor.abortedtxn.threshold
1000
hive.compactor.check.interval
300L
hive.server2.thrift.min.worker.threads
5
hive.conf.restricted.list
hive.security.authenticator.manager,hive.security.authorization.manager,hive.users.in.admin.role
hive.security.authenticator.manager
org.apache.hadoop.hive.ql.security.ProxyUserAuthenticator
hive.default.fileformat
TextFile
hive.enforce.bucketing
true
hive.exec.dynamic.partition
true
hive.exec.dynamic.partition.mode
strict
hive.exec.failure.hooks
org.apache.hadoop.hive.ql.hooks.ATSHook
hive.metastore.pre.event.listeners
org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener
hive.security.authorization.manager
org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdConfOnlyAuthorizerFactory
hive.security.authorization.sqlstd.confwhitelist.append
mapred\.max\.split\.size|tez\.grouping\.min-size|tez\.grouping\.max-size|hive\.optimize\.ppd|hive\.optimize\.ppd\.storage|hive\.vect
orized\.execution\.enabled|hive\.vectorized\.execution\.reduce\.enabled|hive\.vectorized\.execution\.reduce\.groupby\.enabled|hive\.cbo\.enable
|hive\.compute\.query\.using\.stats|hive\.stats\.fetch\.column\.stats|hive\.stats\.fetch\.partition\.stats|hive\.tez\.auto\.reducer\.parallelis
m|hive\.tez\.max\.partition\.factor|hive\.exec\.reducers\.bytes\.per\.reducer|tez\.grouping\.split-waves|hive\.explain\.user|hive\.merge\.tezfi
les|hive\.merge\.smallfiles\.avgsize|hive\.merge\.size\.per\.task|hive\.auto\.convert\.join\.noconditionaltask|hive\.auto\.convert\.join\.nocon
ditionaltask\.size|hive\.exec\.parallel|hive\.exec\.parallel\.thread\.number|hive\.execution\.engine|hive\.support\.concurrency|hive\.exec\.dyn
amic\.partition\.mode|hive\.compactor\.initiator\.on|hive\.compactor\.worker\.threads|tez\.grouping\.split-waves|tez\.grouping\.min-size|tez\.g
[jira] [Created] (HIVE-28242) Using SEQUENCE instead of NOTIFICATION_SEQUENCE table
Smruti Biswal created HIVE-28242: Summary: Using SEQUENCE instead of NOTIFICATION_SEQUENCE table Key: HIVE-28242 URL: https://issues.apache.org/jira/browse/HIVE-28242 Project: Hive Issue Type: Improvement Components: Hive Affects Versions: 4.0.0 Reporter: Smruti Biswal NOTIFICATION_SEQUENCE table currently holds 1 record and is accessed by Hive using select for update. Will it be better to use a sequence instead? This is because sequences can cache values in memory for each session and reduce the number of changes in the background table (as well as the frequency of related locking and serialization). refer https://mariadb.com/kb/en/sequence-overview/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HIVE-28241) beeline does not connect to hive in kerberos environment hadoop3.3.6 hive3.1.3
[ https://issues.apache.org/jira/browse/HIVE-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842616#comment-17842616 ] manoj kumar commented on HIVE-28241: same result with Hive-4. it is working without kerberos in hive 3.1.3 or hive-4. If i connect with jdbc:hive2:// its is working with kerberos. zookeeper discovery mode also not working with kerberos though znode exists. > beeline does not connect to hive in kerberos environment hadoop3.3.6 > hive3.1.3 > --- > > Key: HIVE-28241 > URL: https://issues.apache.org/jira/browse/HIVE-28241 > Project: Hive > Issue Type: Bug > Components: Beeline >Affects Versions: 3.1.3 >Reporter: manoj kumar >Priority: Major > > 24/04/30 12:52:03 [main]: DEBUG security.HadoopThriftAuthBridge: Current > authMethod = KERBEROS > 24/04/30 12:52:03 [main]: DEBUG security.HadoopThriftAuthBridge: Not setting > UGI conf as passed-in authMethod of kerberos = current. > 24/04/30 12:52:03 [main]: DEBUG security.UserGroupInformation: > PrivilegedAction [as: hive/mk2.example@jio.com (auth:KERBEROS)][action: > org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Client$1@61a1ea2c] > java.lang.Exception: null > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1896) > [hadoop-common-3.3.6.jar:?] > at > org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Client.createClientTransport(HadoopThriftAuthBridge.java:234) > [hive-exec-3.1.3.jar:3.1.3] > at > org.apache.hive.service.auth.KerberosSaslHelper.getKerberosTransport(KerberosSaslHelper.java:56) > [hive-service-3.1.3.jar:3.1.3] > at > org.apache.hive.jdbc.HiveConnection.createBinaryTransport(HiveConnection.java:601) > [hive-jdbc-3.1.3.jar:3.1.3] > at > org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:341) > [hive-jdbc-3.1.3.jar:3.1.3] > at > org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:228) > [hive-jdbc-3.1.3.jar:3.1.3] > at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) > [hive-jdbc-3.1.3.jar:3.1.3] > at java.sql.DriverManager.getConnection(DriverManager.java:664) > [?:1.8.0_371] > at java.sql.DriverManager.getConnection(DriverManager.java:208) > [?:1.8.0_371] > at > org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:145) > [hive-beeline-3.1.3.jar:3.1.3] > at > org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:209) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.Commands.connect(Commands.java:1641) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.Commands.connect(Commands.java:1536) > [hive-beeline-3.1.3.jar:3.1.3] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ~[?:1.8.0_371] > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > ~[?:1.8.0_371] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[?:1.8.0_371] > at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371] > at > org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:56) > [hive-beeline-3.1.3.jar:3.1.3] > at > org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1384) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1423) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1287) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1071) > [hive-beeline-3.1.3.jar:3.1.3] > at > org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:538) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.BeeLine.main(BeeLine.java:520) > [hive-beeline-3.1.3.jar:3.1.3] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ~[?:1.8.0_371] > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > ~[?:1.8.0_371] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[?:1.8.0_371] > at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371] > at org.apache.hadoop.util.RunJar.run(RunJar.java:328) > [hadoop-common-3.3.6.jar:?] > at org.apache.hadoop.util.RunJar.main(RunJar.java:241) > [hadoop-common-3.3.6.jar:?] > 24/04/30 12:52:03 [main]: DEBUG security.UserGroupInformation: > PrivilegedAction [as: hive/mk2.example@jio.com (auth:KERBEROS)][action: >
[jira] [Commented] (HIVE-28161) Incorrect Copyright years in META-INF/NOTICE files
[
https://issues.apache.org/jira/browse/HIVE-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842613#comment-17842613
]
Zhihua Deng commented on HIVE-28161:
Fix has been merged. Thank you for the PR [~zabetak]!
> Incorrect Copyright years in META-INF/NOTICE files
> --
>
> Key: HIVE-28161
> URL: https://issues.apache.org/jira/browse/HIVE-28161
> Project: Hive
> Issue Type: Bug
>Affects Versions: 4.0.0-beta-1
>Reporter: Stamatis Zampetakis
>Assignee: Stamatis Zampetakis
>Priority: Major
> Labels: hive-4.0.1-must, pull-request-available
> Fix For: 4.1.0
>
>
> The generated META-INF/NOTICE file which resides inside each jar produced by
> Hive has incorrect copyright years.
> Inside all jars the NOTICE file has the following incorrect content:
> {noformat}
> Copyright 2020 The Apache Software Foundation
> {noformat}
> The Copyright statement should include the timespan from the inception of the
> project to now.
> {noformat}
> Copyright 2008-2024 The Apache Software Foundation
> {noformat}
> The problem can be easily seen by inspecting the jar content after building
> the module or checking the previously published jars in Maven central.
> {noformat}
> mvn clean install -DskipTests -pl common/
> jar xf common/target/hive-common-4.1.0-SNAPSHOT.jar META-INF
> cat META-INF/NOTICE
> Hive Common
> Copyright 2020 The Apache Software Foundation
> This product includes software developed at
> The Apache Software Foundation (http://www.apache.org/).
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Resolved] (HIVE-28161) Incorrect Copyright years in META-INF/NOTICE files
[
https://issues.apache.org/jira/browse/HIVE-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhihua Deng resolved HIVE-28161.
Fix Version/s: 4.1.0
Resolution: Fixed
> Incorrect Copyright years in META-INF/NOTICE files
> --
>
> Key: HIVE-28161
> URL: https://issues.apache.org/jira/browse/HIVE-28161
> Project: Hive
> Issue Type: Bug
>Affects Versions: 4.0.0-beta-1
>Reporter: Stamatis Zampetakis
>Assignee: Stamatis Zampetakis
>Priority: Major
> Labels: hive-4.0.1-must, pull-request-available
> Fix For: 4.1.0
>
>
> The generated META-INF/NOTICE file which resides inside each jar produced by
> Hive has incorrect copyright years.
> Inside all jars the NOTICE file has the following incorrect content:
> {noformat}
> Copyright 2020 The Apache Software Foundation
> {noformat}
> The Copyright statement should include the timespan from the inception of the
> project to now.
> {noformat}
> Copyright 2008-2024 The Apache Software Foundation
> {noformat}
> The problem can be easily seen by inspecting the jar content after building
> the module or checking the previously published jars in Maven central.
> {noformat}
> mvn clean install -DskipTests -pl common/
> jar xf common/target/hive-common-4.1.0-SNAPSHOT.jar META-INF
> cat META-INF/NOTICE
> Hive Common
> Copyright 2020 The Apache Software Foundation
> This product includes software developed at
> The Apache Software Foundation (http://www.apache.org/).
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842608#comment-17842608
]
Ayush Saxena commented on HIVE-28225:
-
Discussed with Denys, and figured out we didn't deprecate in 4.0.0 but in
4.1.0(current), so removal needs to go for 4.2.0, I will create a ticket for it
as a placeholder.
In Hive-4, it isn't deprecated and the default is false, so I have put the
label for 4.0.1, so it has NPE in default conditions as well
https://github.com/apache/hive/blob/rel/release-4.0.0/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L2695
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: hive-4.0.0-must, pull-request-available
> Fix For: 4.1.0
>
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ayush Saxena updated HIVE-28225:
Labels: hive-4.0.0-must pull-request-available (was:
pull-request-available)
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: hive-4.0.0-must, pull-request-available
> Fix For: 4.1.0
>
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ayush Saxena updated HIVE-28225:
Labels: pull-request-available (was: hive-4.0.1-must
pull-request-available)
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.1.0
>
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842596#comment-17842596
]
Ayush Saxena commented on HIVE-28225:
-
We can explore a removal in the next release for sure, but we can't in 4.0.1,
irrespective of default I believe the code shouldn't throw NPE, I will discuss
with Sourabh tmrw on the removal.
Though I feel {{CopyOnWriteDeleteRewriter}} by code in its own should handle
the case of empty where clause, rather than relying everyone will pass a where
clause, if there is such an assumption & we plan to remove the check. in 4.1.0,
maybe we can let that stay from code point of view or at worst can add a
PreConditions check for where clause to avoid anything as such in future.
I need to explore if this config effect iceberg only or for ACID also or other
storage handler? if even others as well, need to see if truncate everywhere is
cheap or not
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: hive-4.0.1-must, pull-request-available
> Fix For: 4.1.0
>
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Comment Edited] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842594#comment-17842594
]
Denys Kuzmenko edited comment on HIVE-28225 at 5/1/24 9:45 AM:
---
[~ayushtkn], we should always go with truncate if delete the entire table.
instead of this, we should have removed the deprecated config (btw, it's on by
default).
cc [~sbadhya]
was (Author: dkuzmenko):
[~ayushtkn], we should always go with truncate if delete the entire table.
instead of this, we should have removed the deprecated config.
cc [~sbadhya]
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: hive-4.0.1-must, pull-request-available
> Fix For: 4.1.0
>
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Comment Edited] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842594#comment-17842594
]
Denys Kuzmenko edited comment on HIVE-28225 at 5/1/24 9:43 AM:
---
[~ayushtkn], we should always go with truncate if delete the entire table.
instead of this, we should have removed the deprecated config.
cc [~sbadhya]
was (Author: dkuzmenko):
[~ayushtkn], we should always go with truncate if delete the entire table.
instead of this, we should have removed the deprecated config.
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: hive-4.0.1-must, pull-request-available
> Fix For: 4.1.0
>
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842594#comment-17842594
]
Denys Kuzmenko commented on HIVE-28225:
---
[~ayushtkn], we should always go with truncate if delete the entire table.
instead of this, we should have removed the deprecated config.
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: hive-4.0.1-must, pull-request-available
> Fix For: 4.1.0
>
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HIVE-28241) beeline does not connect to hive in kerberos environment hadoop3.3.6 hive3.1.3
[ https://issues.apache.org/jira/browse/HIVE-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842579#comment-17842579 ] Ayush Saxena commented on HIVE-28241: - The supported hadoop version for hive 3.1.3 is 3.1.0 https://github.com/apache/hive/blob/rel/release-3.1.3/pom.xml#L150 Try with that, if you want to use Hadoop-3.3.6, the use Hive-4 release, that supports 3.3.6 hadoop > beeline does not connect to hive in kerberos environment hadoop3.3.6 > hive3.1.3 > --- > > Key: HIVE-28241 > URL: https://issues.apache.org/jira/browse/HIVE-28241 > Project: Hive > Issue Type: Bug > Components: Beeline >Affects Versions: 3.1.3 >Reporter: manoj kumar >Priority: Major > > 24/04/30 12:52:03 [main]: DEBUG security.HadoopThriftAuthBridge: Current > authMethod = KERBEROS > 24/04/30 12:52:03 [main]: DEBUG security.HadoopThriftAuthBridge: Not setting > UGI conf as passed-in authMethod of kerberos = current. > 24/04/30 12:52:03 [main]: DEBUG security.UserGroupInformation: > PrivilegedAction [as: hive/mk2.example@jio.com (auth:KERBEROS)][action: > org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Client$1@61a1ea2c] > java.lang.Exception: null > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1896) > [hadoop-common-3.3.6.jar:?] > at > org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Client.createClientTransport(HadoopThriftAuthBridge.java:234) > [hive-exec-3.1.3.jar:3.1.3] > at > org.apache.hive.service.auth.KerberosSaslHelper.getKerberosTransport(KerberosSaslHelper.java:56) > [hive-service-3.1.3.jar:3.1.3] > at > org.apache.hive.jdbc.HiveConnection.createBinaryTransport(HiveConnection.java:601) > [hive-jdbc-3.1.3.jar:3.1.3] > at > org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:341) > [hive-jdbc-3.1.3.jar:3.1.3] > at > org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:228) > [hive-jdbc-3.1.3.jar:3.1.3] > at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) > [hive-jdbc-3.1.3.jar:3.1.3] > at java.sql.DriverManager.getConnection(DriverManager.java:664) > [?:1.8.0_371] > at java.sql.DriverManager.getConnection(DriverManager.java:208) > [?:1.8.0_371] > at > org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:145) > [hive-beeline-3.1.3.jar:3.1.3] > at > org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:209) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.Commands.connect(Commands.java:1641) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.Commands.connect(Commands.java:1536) > [hive-beeline-3.1.3.jar:3.1.3] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ~[?:1.8.0_371] > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > ~[?:1.8.0_371] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[?:1.8.0_371] > at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371] > at > org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:56) > [hive-beeline-3.1.3.jar:3.1.3] > at > org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1384) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1423) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1287) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1071) > [hive-beeline-3.1.3.jar:3.1.3] > at > org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:538) > [hive-beeline-3.1.3.jar:3.1.3] > at org.apache.hive.beeline.BeeLine.main(BeeLine.java:520) > [hive-beeline-3.1.3.jar:3.1.3] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ~[?:1.8.0_371] > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > ~[?:1.8.0_371] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[?:1.8.0_371] > at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371] > at org.apache.hadoop.util.RunJar.run(RunJar.java:328) > [hadoop-common-3.3.6.jar:?] > at org.apache.hadoop.util.RunJar.main(RunJar.java:241) > [hadoop-common-3.3.6.jar:?] > 24/04/30 12:52:03 [main]: DEBUG security.UserGroupInformation: > PrivilegedAction [as: hive/mk2.example@jio.com (auth:KERBEROS)][action: >
[jira] [Created] (HIVE-28241) beeline does not connect to hive in kerberos environment hadoop3.3.6 hive3.1.3
manoj kumar created HIVE-28241: -- Summary: beeline does not connect to hive in kerberos environment hadoop3.3.6 hive3.1.3 Key: HIVE-28241 URL: https://issues.apache.org/jira/browse/HIVE-28241 Project: Hive Issue Type: Bug Components: Beeline Affects Versions: 3.1.3 Reporter: manoj kumar 24/04/30 12:52:03 [main]: DEBUG security.HadoopThriftAuthBridge: Current authMethod = KERBEROS 24/04/30 12:52:03 [main]: DEBUG security.HadoopThriftAuthBridge: Not setting UGI conf as passed-in authMethod of kerberos = current. 24/04/30 12:52:03 [main]: DEBUG security.UserGroupInformation: PrivilegedAction [as: hive/mk2.example@jio.com (auth:KERBEROS)][action: org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Client$1@61a1ea2c] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1896) [hadoop-common-3.3.6.jar:?] at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Client.createClientTransport(HadoopThriftAuthBridge.java:234) [hive-exec-3.1.3.jar:3.1.3] at org.apache.hive.service.auth.KerberosSaslHelper.getKerberosTransport(KerberosSaslHelper.java:56) [hive-service-3.1.3.jar:3.1.3] at org.apache.hive.jdbc.HiveConnection.createBinaryTransport(HiveConnection.java:601) [hive-jdbc-3.1.3.jar:3.1.3] at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:341) [hive-jdbc-3.1.3.jar:3.1.3] at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:228) [hive-jdbc-3.1.3.jar:3.1.3] at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) [hive-jdbc-3.1.3.jar:3.1.3] at java.sql.DriverManager.getConnection(DriverManager.java:664) [?:1.8.0_371] at java.sql.DriverManager.getConnection(DriverManager.java:208) [?:1.8.0_371] at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:145) [hive-beeline-3.1.3.jar:3.1.3] at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:209) [hive-beeline-3.1.3.jar:3.1.3] at org.apache.hive.beeline.Commands.connect(Commands.java:1641) [hive-beeline-3.1.3.jar:3.1.3] at org.apache.hive.beeline.Commands.connect(Commands.java:1536) [hive-beeline-3.1.3.jar:3.1.3] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_371] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_371] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_371] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371] at org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:56) [hive-beeline-3.1.3.jar:3.1.3] at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1384) [hive-beeline-3.1.3.jar:3.1.3] at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1423) [hive-beeline-3.1.3.jar:3.1.3] at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1287) [hive-beeline-3.1.3.jar:3.1.3] at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1071) [hive-beeline-3.1.3.jar:3.1.3] at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:538) [hive-beeline-3.1.3.jar:3.1.3] at org.apache.hive.beeline.BeeLine.main(BeeLine.java:520) [hive-beeline-3.1.3.jar:3.1.3] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_371] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_371] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_371] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371] at org.apache.hadoop.util.RunJar.run(RunJar.java:328) [hadoop-common-3.3.6.jar:?] at org.apache.hadoop.util.RunJar.main(RunJar.java:241) [hadoop-common-3.3.6.jar:?] 24/04/30 12:52:03 [main]: DEBUG security.UserGroupInformation: PrivilegedAction [as: hive/mk2.example@jio.com (auth:KERBEROS)][action: org.apache.hadoop.hive.metastore.security.TUGIAssumingTransport$1@149debbb] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1896) [hadoop-common-3.3.6.jar:?] at org.apache.hadoop.hive.metastore.security.TUGIAssumingTransport.open(TUGIAssumingTransport.java:48) [hive-exec-3.1.3.jar:3.1.3] at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:343) [hive-jdbc-3.1.3.jar:3.1.3] at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:228) [hive-jdbc-3.1.3.jar:3.1.3] at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107)
[jira] [Updated] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ayush Saxena updated HIVE-28225:
Labels: hive-4.0.1-must pull-request-available (was: 4.0.1_Candidate
pull-request-available)
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: hive-4.0.1-must, pull-request-available
> Fix For: 4.1.0
>
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ayush Saxena updated HIVE-28225:
Labels: 4.0.1_Candidate pull-request-available (was:
pull-request-available)
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: 4.0.1_Candidate, pull-request-available
> Fix For: 4.1.0
>
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842566#comment-17842566
]
Ayush Saxena commented on HIVE-28225:
-
Committed to master.
Thanx [~zabetak] for the review!!!
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: pull-request-available
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Resolved] (HIVE-28225) Iceberg: Delete on entire table fails on COW mode
[
https://issues.apache.org/jira/browse/HIVE-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ayush Saxena resolved HIVE-28225.
-
Fix Version/s: 4.1.0
Resolution: Fixed
> Iceberg: Delete on entire table fails on COW mode
> -
>
> Key: HIVE-28225
> URL: https://issues.apache.org/jira/browse/HIVE-28225
> Project: Hive
> Issue Type: Bug
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.1.0
>
>
> If truncate is disabled, the delete on the entire table fails with NPE
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:47)
> at
> org.apache.hadoop.hive.ql.parse.rewrite.CopyOnWriteDeleteRewriter.rewrite(CopyOnWriteDeleteRewriter.java:31)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.rewriteAndAnalyze(RewriteSemanticAnalyzer.java:93)
> at
> org.apache.hadoop.hive.ql.parse.DeleteSemanticAnalyzer.analyze(DeleteSemanticAnalyzer.java:78)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyze(RewriteSemanticAnalyzer.java:84)
> at
> org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:224)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:107)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:519)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:471)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:436)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:430)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:121)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:229){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
