[jira] [Created] (HIVE-24418) there is an error "java.lang.IllegalArgumentException: No columns to insert" when the result data is empty

2020-11-24 Thread HuiyuZhou (Jira)
HuiyuZhou created HIVE-24418:


 Summary: there is an error "java.lang.IllegalArgumentException: No 
columns to insert" when the result data is empty
 Key: HIVE-24418
 URL: https://issues.apache.org/jira/browse/HIVE-24418
 Project: Hive
  Issue Type: Bug
  Components: HBase Handler
Affects Versions: 1.1.1
Reporter: HuiyuZhou


i created the external hive table to link hbase, when i use hsql to insert data 
into hbase,there is an error "java.lang.IllegalArgumentException: No columns to 
insert", i search for the reason and found hbase client does not allow all 
empty column to insert hbase.

i also try to use "set hyperbase.fill.null.enable=true" to skip the error for 
my hsql, but it doest't work, how to avoid the error?

is it a bug for this?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24424) Use PreparedStatements in DbNotificationListener getNextNLId

2020-11-24 Thread David Mollitor (Jira)
David Mollitor created HIVE-24424:
-

 Summary: Use PreparedStatements in DbNotificationListener 
getNextNLId
 Key: HIVE-24424
 URL: https://issues.apache.org/jira/browse/HIVE-24424
 Project: Hive
  Issue Type: Improvement
Reporter: David Mollitor
Assignee: David Mollitor


Simplify the code, remove debug logging concatenation, and make it more 
readable,



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Need privilege to create a new release version in Hive JIRA

2020-11-24 Thread Chao Sun
Hi all,

As mentioned in a separate email, I'm preparing for the new 2.3.8 release.
However, currently in JIRA there is no release version for 2.3.8 yet, and I
don't seem to have the privilege to create it. Can someone grant me the
permission? Thanks!

Best,
Chao


[jira] [Created] (HIVE-24425) Create table in REMOTE db should fail

2020-11-24 Thread Naveen Gangam (Jira)
Naveen Gangam created HIVE-24425:


 Summary: Create table in REMOTE db should fail
 Key: HIVE-24425
 URL: https://issues.apache.org/jira/browse/HIVE-24425
 Project: Hive
  Issue Type: Sub-task
Reporter: Naveen Gangam
Assignee: Naveen Gangam


Currently it creates the table in that DB but show tables does not show 
anything. Preventing the creation of table will resolve this inconsistency too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24423) Improve DbNotificationListener Thread

2020-11-24 Thread David Mollitor (Jira)
David Mollitor created HIVE-24423:
-

 Summary: Improve DbNotificationListener Thread
 Key: HIVE-24423
 URL: https://issues.apache.org/jira/browse/HIVE-24423
 Project: Hive
  Issue Type: Improvement
Affects Versions: 3.1.0
Reporter: David Mollitor
Assignee: David Mollitor


Clean up and simplify {{DbNotificationListener}} thread class.

Most importantly, stop the thread and wait for it to finish before launching a 
new thread.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24420) Druid test failures

2020-11-24 Thread Nishant Bangarwa (Jira)
Nishant Bangarwa created HIVE-24420:
---

 Summary: Druid test failures 
 Key: HIVE-24420
 URL: https://issues.apache.org/jira/browse/HIVE-24420
 Project: Hive
  Issue Type: Bug
  Components: Druid integration
Reporter: Nishant Bangarwa
Assignee: Nishant Bangarwa


Test Result (11 failures / ±0)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druid_timestamptz2]
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_dynamic_partition]
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_expressions]
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_extractTime]
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_floorTime]
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_mv]
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_semijoin_reduction_all_types]
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_test1]
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_test_alter]
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_test_insert]
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_test_ts]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24422) Throw SemanticException when CTE alias is conflicted with table name

2020-11-24 Thread Zhihua Deng (Jira)
Zhihua Deng created HIVE-24422:
--

 Summary: Throw SemanticException when CTE alias is conflicted with 
table name
 Key: HIVE-24422
 URL: https://issues.apache.org/jira/browse/HIVE-24422
 Project: Hive
  Issue Type: Improvement
  Components: Parser
Reporter: Zhihua Deng


If the alias of CTE is conflicted with the table name, we use the alias 
fetching the table other than replacing it with the ASTNode tree, this may 
cause some confusing problems. For example:

{noformat}
create table game_info (game_name string);

with game_info as (
select distinct ext_id, dev_app_id, game_name
from game_info_extend )
select count(game_name) from game_info;{noformat}
The query will return the number of rows of the table game_info, instead of the 
game_info_extend. Maybe we should better throw an exception to avoid such cases.
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24419) Refactor junit database rules to exploit testcontainers

2020-11-24 Thread Stamatis Zampetakis (Jira)
Stamatis Zampetakis created HIVE-24419:
--

 Summary: Refactor junit database rules to exploit testcontainers
 Key: HIVE-24419
 URL: https://issues.apache.org/jira/browse/HIVE-24419
 Project: Hive
  Issue Type: Task
Reporter: Stamatis Zampetakis
Assignee: Stamatis Zampetakis


The 
[DatabaseRule|https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/test/java/org/apache/hadoop/hive/metastore/dbinstall/rules/DatabaseRule.java]
 and its subclasses allow tests to run over dockerized metastores using 
different database backends. Essentially some part of the code manages 
containers by invoking explicitly docker commands.

The [testcontainers|https://www.testcontainers.org/modules/databases/] project 
provides the necessary modules for managing dockerized databases in an easy and 
intuitive way.

The goal of this issue is to refactor the {{DatabaseRule}} hierarchy to take 
advantage of testcontainers in order to delegate the burden of managing 
containers outside of Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24421) DruidOutputFormat and DruidStorageHandler use different filesystem causing issues in data loading

2020-11-24 Thread Nishant Bangarwa (Jira)
Nishant Bangarwa created HIVE-24421:
---

 Summary: DruidOutputFormat and DruidStorageHandler use different 
filesystem causing issues in data loading
 Key: HIVE-24421
 URL: https://issues.apache.org/jira/browse/HIVE-24421
 Project: Hive
  Issue Type: Bug
  Components: Druid integration
Reporter: Nishant Bangarwa
Assignee: Nishant Bangarwa






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Need privilege to create a new release version in Hive JIRA

2020-11-24 Thread Owen O'Malley
I created the 2.3.8 release for you. It isn't clear which authorization is
required to create a new release.

.. Owen

On Tue, Nov 24, 2020 at 7:20 PM Chao Sun  wrote:

> Hi all,
>
> As mentioned in a separate email, I'm preparing for the new 2.3.8 release.
> However, currently in JIRA there is no release version for 2.3.8 yet, and I
> don't seem to have the privilege to create it. Can someone grant me the
> permission? Thanks!
>
> Best,
> Chao
>


Re: Need privilege to create a new release version in Hive JIRA

2020-11-24 Thread Chao Sun
Thanks Owen!

On Tue, Nov 24, 2020 at 2:12 PM Owen O'Malley 
wrote:

> I created the 2.3.8 release for you. It isn't clear which authorization is
> required to create a new release.
>
> .. Owen
>
> On Tue, Nov 24, 2020 at 7:20 PM Chao Sun  wrote:
>
> > Hi all,
> >
> > As mentioned in a separate email, I'm preparing for the new 2.3.8
> release.
> > However, currently in JIRA there is no release version for 2.3.8 yet,
> and I
> > don't seem to have the privilege to create it. Can someone grant me the
> > permission? Thanks!
> >
> > Best,
> > Chao
> >
>


[jira] [Created] (HIVE-24426) Spark job fails with fixed umbilical server port

2020-11-24 Thread Ayush Saxena (Jira)
Ayush Saxena created HIVE-24426:
---

 Summary: Spark job fails with fixed umbilical server port
 Key: HIVE-24426
 URL: https://issues.apache.org/jira/browse/HIVE-24426
 Project: Hive
  Issue Type: Bug
Reporter: Ayush Saxena
Assignee: Ayush Saxena


In case of cloud deployments, multiple executors are launched on name node, and 
incase a fixed umbilical port is specified using 
{{spark.hadoop.hive.llap.daemon.umbilical.port=30006}}

The job fails with BindException.
{noformat}
Caused by: java.net.BindException: Problem binding to [0.0.0.0:30006] 
java.net.BindException: Address already in use; For more details see:  
http://wiki.apache.org/hadoop/BindException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:840)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:741)
at org.apache.hadoop.ipc.Server.bind(Server.java:605)
at org.apache.hadoop.ipc.Server$Listener.(Server.java:1169)
at org.apache.hadoop.ipc.Server.(Server.java:3032)
at org.apache.hadoop.ipc.RPC$Server.(RPC.java:1039)
at 
org.apache.hadoop.ipc.WritableRpcEngine$Server.(WritableRpcEngine.java:438)
at 
org.apache.hadoop.ipc.WritableRpcEngine.getServer(WritableRpcEngine.java:332)
at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:848)
at 
org.apache.hadoop.hive.llap.tezplugins.helpers.LlapTaskUmbilicalServer.(LlapTaskUmbilicalServer.java:67)
at 
org.apache.hadoop.hive.llap.ext.LlapTaskUmbilicalExternalClient$SharedUmbilicalServer.(LlapTaskUmbilicalExternalClient.java:122)
... 26 more
Caused by: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at 
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:220)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85)
at org.apache.hadoop.ipc.Server.bind(Server.java:588)
... 34 more{noformat}
To counter this, better to provide a range of ports



--
This message was sent by Atlassian Jira
(v8.3.4#803005)