[jira] [Created] (HIVE-25479) Browser SSO auth may fail intermittently on chrome browser in virtual environments

2021-08-24 Thread Vihang Karajgaonkar (Jira) 
Vihang Karajgaonkar created HIVE-25479:
--

 Summary: Browser SSO auth may fail intermittently on chrome 
browser in virtual environments
 Key: HIVE-25479
 URL: https://issues.apache.org/jira/browse/HIVE-25479
 Project: Hive
  Issue Type: Bug
  Components: JDBC
Reporter: Vihang Karajgaonkar
Assignee: Vihang Karajgaonkar


When browser based SSO is enabled the Hive JDBC driver might miss the POST 
requests coming from the browser which provide the one-time token issued by 
HS2s after the SAML flow completes. The issue was observed mostly in virtual 
environments on Windows.

The issue seems to be that when the driver binds to a port even though the port 
is in LISTEN state, if the browser issues posts request on the port before it 
goes into ACCEPT state the result is non-deterministic. On native OSes we 
observed that the connection is buffered and is received by the driver when it 
begins accepting the connections. In case of VMs it is observed that even 
though the connection is buffered and presented when the port goes into ACCEPT 
mode, the payload of the request or the connection itself is lost. This race 
condition causes the driver to wait for the browser until it timesout and the 
browser keeps waiting for a response from the driver.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HIVE-25478) Temp file left over after ANALYZE TABLE .. COMPUTE STATISTICS FOR COLUMNS

2021-08-24 Thread Matt McCline (Jira) 
Matt McCline created HIVE-25478:
---

 Summary: Temp file left over after ANALYZE TABLE .. COMPUTE 
STATISTICS FOR COLUMNS
 Key: HIVE-25478
 URL: https://issues.apache.org/jira/browse/HIVE-25478
 Project: Hive
  Issue Type: Bug
Affects Versions: 3.1.0
Reporter: Matt McCline
Assignee: Matt McCline


The dot staging file (".hive-staging") file is not removed at the end of the 
ANALYZE TABLE .. COMPUTE STATISTICS FOR COLUMNS operation as it is for say an 
INSERT that does automatic statistics collection. I expected it would be 
deleted after the Stats Work stage.

Any ideas where in the code to add automatic deletion (hook)?

hdfs dfs -ls /hive/warehouse/managed/table_orc
Found 2 items
drwxr-xr-x   - hive supergroup  0 2021-08-24 17:19 
/hive/warehouse/managed/table_orc/.hive-staging_hive_2021-08-24_17-19-17_228_4856027533912221506-7
drwxr-xr-x   - hive supergroup  0 2021-08-24 07:17 
/hive/warehouse/managed/table_orc/delta_001_001_



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HIVE-25477) Clean Up JDBC Code

2021-08-24 Thread David Mollitor (Jira) 
David Mollitor created HIVE-25477:
-

 Summary: Clean Up JDBC Code
 Key: HIVE-25477
 URL: https://issues.apache.org/jira/browse/HIVE-25477
 Project: Hive
  Issue Type: Improvement
Reporter: David Mollitor
Assignee: David Mollitor


* Remove unused imports
 * Remove unused code



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HIVE-25476) Remove Unused Dependencies for JDBC Driver

2021-08-24 Thread David Mollitor (Jira) 
David Mollitor created HIVE-25476:
-

 Summary: Remove Unused Dependencies for JDBC Driver
 Key: HIVE-25476
 URL: https://issues.apache.org/jira/browse/HIVE-25476
 Project: Hive
  Issue Type: Improvement
Reporter: David Mollitor
Assignee: David Mollitor


I am using JDBC driver in a project and was very surprised by the number of 
dependencies it has.  Remove some unnecessary dependencies to make it a little 
easier to work with.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HIVE-25475) TestStatsReplicationScenarios.testForParallelBootstrapLoad is unstable

2021-08-24 Thread Krisztian Kasa (Jira) 
Krisztian Kasa created HIVE-25475:
-

 Summary: 
TestStatsReplicationScenarios.testForParallelBootstrapLoad is unstable
 Key: HIVE-25475
 URL: https://issues.apache.org/jira/browse/HIVE-25475
 Project: Hive
  Issue Type: Bug
Reporter: Krisztian Kasa


http://ci.hive.apache.org/job/hive-flaky-check/389/

{code}
16:19:18  [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 141.73 s <<< FAILURE! - in 
org.apache.hadoop.hive.ql.parse.TestStatsReplicationScenarios
16:19:18  [ERROR] 
org.apache.hadoop.hive.ql.parse.TestStatsReplicationScenarios.testForParallelBootstrapLoad
  Time elapsed: 122.979 s  <<< ERROR!
16:19:18  org.apache.hadoop.hive.ql.metadata.HiveException
16:19:18at 
org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:5032)
16:19:18at 
org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:3348)
16:19:18at 
org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:429)
16:19:18at 
org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212)
16:19:18at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105)
16:19:18at 
org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:361)
16:19:18at 
org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:334)
16:19:18at 
org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:245)
16:19:18at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:108)
16:19:18at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:348)
16:19:18at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:204)
16:19:18at org.apache.hadoop.hive.ql.Driver.run(Driver.java:153)
16:19:18at org.apache.hadoop.hive.ql.Driver.run(Driver.java:148)
16:19:18at 
org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:164)
16:19:18at 
org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:230)
16:19:18at 
org.apache.hadoop.hive.ql.parse.WarehouseInstance.run(WarehouseInstance.java:235)
16:19:18at 
org.apache.hadoop.hive.ql.parse.WarehouseInstance.load(WarehouseInstance.java:309)
16:19:18at 
org.apache.hadoop.hive.ql.parse.TestStatsReplicationScenarios.dumpLoadVerify(TestStatsReplicationScenarios.java:359)
16:19:18at 
org.apache.hadoop.hive.ql.parse.TestStatsReplicationScenarios.testStatsReplicationCommon(TestStatsReplicationScenarios.java:663)
16:19:18at 
org.apache.hadoop.hive.ql.parse.TestStatsReplicationScenarios.testForParallelBootstrapLoad(TestStatsReplicationScenarios.java:688)
16:19:18at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
16:19:18at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
16:19:18at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
16:19:18at java.lang.reflect.Method.invoke(Method.java:498)
16:19:18at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
16:19:18at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
16:19:18at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
16:19:18at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
16:19:18at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
16:19:18at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
16:19:18at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
16:19:18at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
16:19:18at 
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
16:19:18at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
16:19:18at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
16:19:18at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
16:19:18at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
16:19:18at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
16:19:18at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
16:19:18at 
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
16:19:18at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
16:19:18at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
16:19:18at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
16:19:18at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
16:19:18at org.junit.runners.ParentRunner.run(ParentRunner.java:413)