[
https://issues.apache.org/jira/browse/FLINK-28795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17579475#comment-17579475
]
Huang Xingbo commented on FLINK-28795:
--------------------------------------
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=39941&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461
Different failed case HiveDialectQueryITCase.testBoolComparison, but the stack
is looks like same:
{code:java}
2022-08-13T01:29:51.5076876Z Aug 13 01:29:51
org.apache.flink.connectors.hive.FlinkHiveException: java.io.IOException: Fail
to create input splits.
2022-08-13T01:29:51.5084747Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.HiveParallelismInference.infer(HiveParallelismInference.java:98)
2022-08-13T01:29:51.5086194Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.HiveTableSource.getDataStream(HiveTableSource.java:174)
2022-08-13T01:29:51.5087528Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.HiveTableSource$1.produceDataStream(HiveTableSource.java:140)
2022-08-13T01:29:51.5088973Z Aug 13 01:29:51 at
org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecTableSourceScan.translateToPlanInternal(CommonExecTableSourceScan.java:141)
2022-08-13T01:29:51.5090646Z Aug 13 01:29:51 at
org.apache.flink.table.planner.plan.nodes.exec.batch.BatchExecTableSourceScan.translateToPlanInternal(BatchExecTableSourceScan.java:101)
2022-08-13T01:29:51.5092431Z Aug 13 01:29:51 at
org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase.translateToPlan(ExecNodeBase.java:148)
2022-08-13T01:29:51.5093827Z Aug 13 01:29:51 at
org.apache.flink.table.planner.plan.nodes.exec.ExecEdge.translateToPlan(ExecEdge.java:257)
2022-08-13T01:29:51.5095525Z Aug 13 01:29:51 at
org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecCalc.translateToPlanInternal(CommonExecCalc.java:94)
2022-08-13T01:29:51.5096916Z Aug 13 01:29:51 at
org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase.translateToPlan(ExecNodeBase.java:148)
2022-08-13T01:29:51.5098430Z Aug 13 01:29:51 at
org.apache.flink.table.planner.plan.nodes.exec.ExecEdge.translateToPlan(ExecEdge.java:257)
2022-08-13T01:29:51.5099909Z Aug 13 01:29:51 at
org.apache.flink.table.planner.plan.nodes.exec.batch.BatchExecSink.translateToPlanInternal(BatchExecSink.java:65)
2022-08-13T01:29:51.5101362Z Aug 13 01:29:51 at
org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase.translateToPlan(ExecNodeBase.java:148)
2022-08-13T01:29:51.5103082Z Aug 13 01:29:51 at
org.apache.flink.table.planner.delegation.BatchPlanner.$anonfun$translateToPlan$1(BatchPlanner.scala:93)
2022-08-13T01:29:51.5104386Z Aug 13 01:29:51 at
scala.collection.TraversableLike.$anonfun$map$1(TraversableLike.scala:233)
2022-08-13T01:29:51.5105516Z Aug 13 01:29:51 at
scala.collection.Iterator.foreach(Iterator.scala:937)
2022-08-13T01:29:51.5106544Z Aug 13 01:29:51 at
scala.collection.Iterator.foreach$(Iterator.scala:937)
2022-08-13T01:29:51.5107651Z Aug 13 01:29:51 at
scala.collection.AbstractIterator.foreach(Iterator.scala:1425)
2022-08-13T01:29:51.5108783Z Aug 13 01:29:51 at
scala.collection.IterableLike.foreach(IterableLike.scala:70)
2022-08-13T01:29:51.5109907Z Aug 13 01:29:51 at
scala.collection.IterableLike.foreach$(IterableLike.scala:69)
2022-08-13T01:29:51.5111008Z Aug 13 01:29:51 at
scala.collection.AbstractIterable.foreach(Iterable.scala:54)
2022-08-13T01:29:51.5112618Z Aug 13 01:29:51 at
scala.collection.TraversableLike.map(TraversableLike.scala:233)
2022-08-13T01:29:51.5113726Z Aug 13 01:29:51 at
scala.collection.TraversableLike.map$(TraversableLike.scala:226)
2022-08-13T01:29:51.5114888Z Aug 13 01:29:51 at
scala.collection.AbstractTraversable.map(Traversable.scala:104)
2022-08-13T01:29:51.5116119Z Aug 13 01:29:51 at
org.apache.flink.table.planner.delegation.BatchPlanner.translateToPlan(BatchPlanner.scala:92)
2022-08-13T01:29:51.5117429Z Aug 13 01:29:51 at
org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:197)
2022-08-13T01:29:51.5118842Z Aug 13 01:29:51 at
org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1730)
2022-08-13T01:29:51.5120271Z Aug 13 01:29:51 at
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeQueryOperation(TableEnvironmentImpl.java:865)
2022-08-13T01:29:51.5122896Z Aug 13 01:29:51 at
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:1375)
2022-08-13T01:29:51.5124442Z Aug 13 01:29:51 at
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:733)
2022-08-13T01:29:51.5125932Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.HiveDialectQueryITCase.testBoolComparison(HiveDialectQueryITCase.java:737)
2022-08-13T01:29:51.5127189Z Aug 13 01:29:51 at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2022-08-13T01:29:51.5128360Z Aug 13 01:29:51 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2022-08-13T01:29:51.5129674Z Aug 13 01:29:51 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2022-08-13T01:29:51.5130773Z Aug 13 01:29:51 at
java.lang.reflect.Method.invoke(Method.java:498)
2022-08-13T01:29:51.5132093Z Aug 13 01:29:51 at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
2022-08-13T01:29:51.5133411Z Aug 13 01:29:51 at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2022-08-13T01:29:51.5134642Z Aug 13 01:29:51 at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
2022-08-13T01:29:51.5135847Z Aug 13 01:29:51 at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2022-08-13T01:29:51.5137276Z Aug 13 01:29:51 at
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
2022-08-13T01:29:51.5138524Z Aug 13 01:29:51 at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
2022-08-13T01:29:51.5139886Z Aug 13 01:29:51 at
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
2022-08-13T01:29:51.5141112Z Aug 13 01:29:51 at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
2022-08-13T01:29:51.5142586Z Aug 13 01:29:51 at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
2022-08-13T01:29:51.5143709Z Aug 13 01:29:51 at
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
2022-08-13T01:29:51.5144859Z Aug 13 01:29:51 at
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
2022-08-13T01:29:51.5145912Z Aug 13 01:29:51 at
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
2022-08-13T01:29:51.5147026Z Aug 13 01:29:51 at
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
2022-08-13T01:29:51.5148157Z Aug 13 01:29:51 at
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
2022-08-13T01:29:51.5149260Z Aug 13 01:29:51 at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2022-08-13T01:29:51.5150528Z Aug 13 01:29:51 at
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
2022-08-13T01:29:51.5151516Z Aug 13 01:29:51 at
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
2022-08-13T01:29:51.5152655Z Aug 13 01:29:51 at
org.junit.runner.JUnitCore.run(JUnitCore.java:137)
2022-08-13T01:29:51.5153642Z Aug 13 01:29:51 at
org.junit.runner.JUnitCore.run(JUnitCore.java:115)
2022-08-13T01:29:51.5154710Z Aug 13 01:29:51 at
org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42)
2022-08-13T01:29:51.5155983Z Aug 13 01:29:51 at
org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80)
2022-08-13T01:29:51.5157176Z Aug 13 01:29:51 at
org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72)
2022-08-13T01:29:51.5158402Z Aug 13 01:29:51 at
org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107)
2022-08-13T01:29:51.5159780Z Aug 13 01:29:51 at
org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88)
2022-08-13T01:29:51.5161226Z Aug 13 01:29:51 at
org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54)
2022-08-13T01:29:51.5162982Z Aug 13 01:29:51 at
org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67)
2022-08-13T01:29:51.5164495Z Aug 13 01:29:51 at
org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52)
2022-08-13T01:29:51.5165816Z Aug 13 01:29:51 at
org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:114)
2022-08-13T01:29:51.5167072Z Aug 13 01:29:51 at
org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:86)
2022-08-13T01:29:51.5168449Z Aug 13 01:29:51 at
org.junit.platform.launcher.core.DefaultLauncherSession$DelegatingLauncher.execute(DefaultLauncherSession.java:86)
2022-08-13T01:29:51.5169857Z Aug 13 01:29:51 at
org.junit.platform.launcher.core.SessionPerRequestLauncher.execute(SessionPerRequestLauncher.java:53)
2022-08-13T01:29:51.5171273Z Aug 13 01:29:51 at
org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:188)
2022-08-13T01:29:51.5174304Z Aug 13 01:29:51 at
org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:154)
2022-08-13T01:29:51.5175677Z Aug 13 01:29:51 at
org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124)
2022-08-13T01:29:51.5176937Z Aug 13 01:29:51 at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428)
2022-08-13T01:29:51.5178382Z Aug 13 01:29:51 at
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162)
2022-08-13T01:29:51.5179568Z Aug 13 01:29:51 at
org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:562)
2022-08-13T01:29:51.5180846Z Aug 13 01:29:51 at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:548)
2022-08-13T01:29:51.5181990Z Aug 13 01:29:51 Caused by: java.io.IOException:
Fail to create input splits.
2022-08-13T01:29:51.5183187Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.MRSplitsGetter.getHiveTablePartitionMRSplits(MRSplitsGetter.java:84)
2022-08-13T01:29:51.5184564Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.HiveSourceFileEnumerator.createInputSplits(HiveSourceFileEnumerator.java:91)
2022-08-13T01:29:51.5185825Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.HiveTableSource.lambda$getDataStream$1(HiveTableSource.java:179)
2022-08-13T01:29:51.5187083Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.HiveParallelismInference.logRunningTime(HiveParallelismInference.java:107)
2022-08-13T01:29:51.5188427Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.HiveParallelismInference.infer(HiveParallelismInference.java:95)
2022-08-13T01:29:51.5189395Z Aug 13 01:29:51 ... 71 more
2022-08-13T01:29:51.5192250Z Aug 13 01:29:51 Caused by:
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error
while running command to get file permissions : ExitCodeException exitCode=2:
/bin/ls: cannot access
'/tmp/junit2768738167464506810/hive_warehouse/tbool/.staging_1660353747721': No
such file or directory
2022-08-13T01:29:51.5193692Z Aug 13 01:29:51
2022-08-13T01:29:51.5194437Z Aug 13 01:29:51 at
org.apache.hadoop.util.Shell.runCommand(Shell.java:585)
2022-08-13T01:29:51.5195378Z Aug 13 01:29:51 at
org.apache.hadoop.util.Shell.run(Shell.java:482)
2022-08-13T01:29:51.5196379Z Aug 13 01:29:51 at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776)
2022-08-13T01:29:51.5197392Z Aug 13 01:29:51 at
org.apache.hadoop.util.Shell.execCommand(Shell.java:869)
2022-08-13T01:29:51.5198326Z Aug 13 01:29:51 at
org.apache.hadoop.util.Shell.execCommand(Shell.java:852)
2022-08-13T01:29:51.5199250Z Aug 13 01:29:51 at
org.apache.hadoop.fs.FileUtil.execCommand(FileUtil.java:1097)
2022-08-13T01:29:51.5200401Z Aug 13 01:29:51 at
org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:659)
2022-08-13T01:29:51.5201738Z Aug 13 01:29:51 at
org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:634)
2022-08-13T01:29:51.5203113Z Aug 13 01:29:51 at
org.apache.hadoop.fs.LocatedFileStatus.<init>(LocatedFileStatus.java:49)
2022-08-13T01:29:51.5204108Z Aug 13 01:29:51 at
org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1732)
2022-08-13T01:29:51.5205029Z Aug 13 01:29:51 at
org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1712)
2022-08-13T01:29:51.5206102Z Aug 13 01:29:51 at
org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:270)
2022-08-13T01:29:51.5207168Z Aug 13 01:29:51 at
org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:229)
2022-08-13T01:29:51.5208228Z Aug 13 01:29:51 at
org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:315)
2022-08-13T01:29:51.5209334Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.MRSplitsGetter$MRSplitter.call(MRSplitsGetter.java:134)
2022-08-13T01:29:51.5210467Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.MRSplitsGetter$MRSplitter.call(MRSplitsGetter.java:96)
2022-08-13T01:29:51.5211483Z Aug 13 01:29:51 at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
2022-08-13T01:29:51.5212737Z Aug 13 01:29:51 at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2022-08-13T01:29:51.5213768Z Aug 13 01:29:51 at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2022-08-13T01:29:51.5214947Z Aug 13 01:29:51 at
java.lang.Thread.run(Thread.java:748)
2022-08-13T01:29:51.5215549Z Aug 13 01:29:51
2022-08-13T01:29:51.5216245Z Aug 13 01:29:51 at
java.util.concurrent.FutureTask.report(FutureTask.java:122)
2022-08-13T01:29:51.5217136Z Aug 13 01:29:51 at
java.util.concurrent.FutureTask.get(FutureTask.java:192)
2022-08-13T01:29:51.5218306Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.MRSplitsGetter.getHiveTablePartitionMRSplits(MRSplitsGetter.java:79)
2022-08-13T01:29:51.5219143Z Aug 13 01:29:51 ... 75 more
2022-08-13T01:29:51.5221273Z Aug 13 01:29:51 Caused by:
java.lang.RuntimeException: Error while running command to get file permissions
: ExitCodeException exitCode=2: /bin/ls: cannot access
'/tmp/junit2768738167464506810/hive_warehouse/tbool/.staging_1660353747721': No
such file or directory
2022-08-13T01:29:51.5222712Z Aug 13 01:29:51
2022-08-13T01:29:51.5223401Z Aug 13 01:29:51 at
org.apache.hadoop.util.Shell.runCommand(Shell.java:585)
2022-08-13T01:29:51.5224297Z Aug 13 01:29:51 at
org.apache.hadoop.util.Shell.run(Shell.java:482)
2022-08-13T01:29:51.5225223Z Aug 13 01:29:51 at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776)
2022-08-13T01:29:51.5226163Z Aug 13 01:29:51 at
org.apache.hadoop.util.Shell.execCommand(Shell.java:869)
2022-08-13T01:29:51.5227017Z Aug 13 01:29:51 at
org.apache.hadoop.util.Shell.execCommand(Shell.java:852)
2022-08-13T01:29:51.5227854Z Aug 13 01:29:51 at
org.apache.hadoop.fs.FileUtil.execCommand(FileUtil.java:1097)
2022-08-13T01:29:51.5228897Z Aug 13 01:29:51 at
org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:659)
2022-08-13T01:29:51.5230278Z Aug 13 01:29:51 at
org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:634)
2022-08-13T01:29:51.5231349Z Aug 13 01:29:51 at
org.apache.hadoop.fs.LocatedFileStatus.<init>(LocatedFileStatus.java:49)
2022-08-13T01:29:51.5232455Z Aug 13 01:29:51 at
org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1732)
2022-08-13T01:29:51.5233314Z Aug 13 01:29:51 at
org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1712)
2022-08-13T01:29:51.5234312Z Aug 13 01:29:51 at
org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:270)
2022-08-13T01:29:51.5235451Z Aug 13 01:29:51 at
org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:229)
2022-08-13T01:29:51.5236537Z Aug 13 01:29:51 at
org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:315)
2022-08-13T01:29:51.5237636Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.MRSplitsGetter$MRSplitter.call(MRSplitsGetter.java:134)
2022-08-13T01:29:51.5238665Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.MRSplitsGetter$MRSplitter.call(MRSplitsGetter.java:96)
2022-08-13T01:29:51.5239613Z Aug 13 01:29:51 at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
2022-08-13T01:29:51.5240709Z Aug 13 01:29:51 at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2022-08-13T01:29:51.5242167Z Aug 13 01:29:51 at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2022-08-13T01:29:51.5243205Z Aug 13 01:29:51 at
java.lang.Thread.run(Thread.java:748)
2022-08-13T01:29:51.5243905Z Aug 13 01:29:51
2022-08-13T01:29:51.5244958Z Aug 13 01:29:51 at
org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:699)
2022-08-13T01:29:51.5246461Z Aug 13 01:29:51 at
org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:634)
2022-08-13T01:29:51.5247749Z Aug 13 01:29:51 at
org.apache.hadoop.fs.LocatedFileStatus.<init>(LocatedFileStatus.java:49)
2022-08-13T01:29:51.5248814Z Aug 13 01:29:51 at
org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1732)
2022-08-13T01:29:51.5249773Z Aug 13 01:29:51 at
org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1712)
2022-08-13T01:29:51.5251083Z Aug 13 01:29:51 at
org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:270)
2022-08-13T01:29:51.5252423Z Aug 13 01:29:51 at
org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:229)
2022-08-13T01:29:51.5253513Z Aug 13 01:29:51 at
org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:315)
2022-08-13T01:29:51.5254822Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.MRSplitsGetter$MRSplitter.call(MRSplitsGetter.java:134)
2022-08-13T01:29:51.5256129Z Aug 13 01:29:51 at
org.apache.flink.connectors.hive.MRSplitsGetter$MRSplitter.call(MRSplitsGetter.java:96)
2022-08-13T01:29:51.5257367Z Aug 13 01:29:51 at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
2022-08-13T01:29:51.5258501Z Aug 13 01:29:51 at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2022-08-13T01:29:51.5259618Z Aug 13 01:29:51 at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2022-08-13T01:29:51.5260578Z Aug 13 01:29:51 at
java.lang.Thread.run(Thread.java:748)
2022-08-13T01:29:51.5261222Z Aug 13 01:29:51
2022-08-13T01:29:53.8083054Z Aug 13 01:29:53 [ERROR] Picked up
JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
2022-08-13T01:29:55.9454104Z Aug 13 01:29:55 [INFO] Running
org.apache.flink.connectors.hive.read.HiveInputFormatPartitionReaderITCase
2022-08-13T01:30:39.9002693Z Aug 13 01:30:39 [INFO] Tests run: 1, Failures: 0,
Errors: 0, Skipped: 0, Time elapsed: 43.859 s - in
org.apache.flink.connectors.hive.read.HiveInputFormatPartitionReaderITCase
2022-08-13T01:34:21.8856413Z Aug 13 01:34:21 == Abstract Syntax Tree ==
2022-08-13T01:34:21.8860211Z Aug 13 01:34:21 LogicalSort(sort0=[$0],
dir0=[ASC-nulls-first])
2022-08-13T01:34:21.8862493Z Aug 13 01:34:21 +- LogicalProject(a=[$0], b=[$1],
c=[$2], p=[$3], x=[$4], y=[$5])
2022-08-13T01:34:21.8864021Z Aug 13 01:34:21 +-
LogicalFilter(condition=[AND(=($4, $3), =($6, 1))])
2022-08-13T01:34:21.8865411Z Aug 13 01:34:21 +-
LogicalJoin(condition=[true], joinType=[inner])
2022-08-13T01:34:21.8866858Z Aug 13 01:34:21 :-
LogicalTableScan(table=[[test-catalog, default, fact]])
2022-08-13T01:34:21.8868511Z Aug 13 01:34:21 +-
LogicalTableScan(table=[[test-catalog, default, dim]])
2022-08-13T01:34:21.8869569Z Aug 13 01:34:21
2022-08-13T01:34:21.8870398Z Aug 13 01:34:21 == Optimized Physical Plan ==
2022-08-13T01:34:21.8871284Z Aug 13 01:34:21 Sort(orderBy=[a ASC])
2022-08-13T01:34:21.8872787Z Aug 13 01:34:21 +- Exchange(distribution=[single])
2022-08-13T01:34:21.8874290Z Aug 13 01:34:21 +-
HashJoin(joinType=[InnerJoin], where=[=(x, p)], select=[a, b, c, p, x, y],
build=[right])
2022-08-13T01:34:21.8875683Z Aug 13 01:34:21 :-
Exchange(distribution=[hash[p]])
2022-08-13T01:34:21.8877169Z Aug 13 01:34:21 : +-
DynamicFilteringTableSourceScan(table=[[test-catalog, default, fact]],
fields=[a, b, c, p])
2022-08-13T01:34:21.8878630Z Aug 13 01:34:21 : +-
DynamicFilteringDataCollector(fields=[x])
2022-08-13T01:34:21.8879936Z Aug 13 01:34:21 : +- Calc(select=[x,
y], where=[=(z, 1)])
2022-08-13T01:34:21.8881333Z Aug 13 01:34:21 : +-
TableSourceScan(table=[[test-catalog, default, dim]], fields=[x, y, z])
2022-08-13T01:34:21.8883005Z Aug 13 01:34:21 +-
Exchange(distribution=[hash[x]])
2022-08-13T01:34:21.8885064Z Aug 13 01:34:21 +- Calc(select=[x, y],
where=[=(z, 1)])
2022-08-13T01:34:21.8886532Z Aug 13 01:34:21 +-
TableSourceScan(table=[[test-catalog, default, dim]], fields=[x, y, z])
2022-08-13T01:34:21.8887394Z Aug 13 01:34:21
2022-08-13T01:34:21.8888901Z Aug 13 01:34:21 == Optimized Execution Plan ==
2022-08-13T01:34:21.8889775Z Aug 13 01:34:21 Sort(orderBy=[a ASC])
2022-08-13T01:34:21.8891058Z Aug 13 01:34:21 +- Exchange(distribution=[single])
2022-08-13T01:34:21.8892592Z Aug 13 01:34:21 +-
HashJoin(joinType=[InnerJoin], where=[(x = p)], select=[a, b, c, p, x, y],
build=[right])
2022-08-13T01:34:21.8893794Z Aug 13 01:34:21 :-
Exchange(distribution=[hash[p]])
2022-08-13T01:34:21.8895346Z Aug 13 01:34:21 : +-
DynamicFilteringTableSourceScan(table=[[test-catalog, default, fact]],
fields=[a, b, c, p])
2022-08-13T01:34:21.8896728Z Aug 13 01:34:21 : +-
DynamicFilteringDataCollector(fields=[x])
2022-08-13T01:34:21.8897969Z Aug 13 01:34:21 : +- Calc(select=[x,
y], where=[(z = 1)])(reuse_id=[1])
2022-08-13T01:34:21.8899462Z Aug 13 01:34:21 : +-
TableSourceScan(table=[[test-catalog, default, dim]], fields=[x, y, z])
2022-08-13T01:34:21.8900691Z Aug 13 01:34:21 +-
Exchange(distribution=[hash[x]])
2022-08-13T01:34:21.8901761Z Aug 13 01:34:21 +-
Reused(reference_id=[1])
{code}
> Unstable test for HiveDialectQueryITCase#testInsertDirectory
> ------------------------------------------------------------
>
> Key: FLINK-28795
> URL: https://issues.apache.org/jira/browse/FLINK-28795
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
> Reporter: luoyuxia
> Assignee: luoyuxia
> Priority: Critical
> Labels: pull-request-available
> Fix For: 1.16.0
>
>
> The HiveDialectQueryITCase#testInsertDirectory is unstable. The failure link
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=39233&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461]
> we need to wait the insert to finish before select from the table
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
