[
https://issues.apache.org/jira/browse/HIVE-18091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265260#comment-16265260
]
Daniel Voros commented on HIVE-18091:
-------------------------------------
All these 10 failures are failing without the patch when run locally. (This
patch is only necessary when running via ptest executor.)
[~sershe] since this ended up being a backport of HIVE-11887, could you please
take a look?
> Failing tests of itests/qtest-spark and itests/hive-unit on branch-1
> --------------------------------------------------------------------
>
> Key: HIVE-18091
> URL: https://issues.apache.org/jira/browse/HIVE-18091
> Project: Hive
> Issue Type: Bug
> Components: Test, Testing Infrastructure
> Reporter: Daniel Voros
> Assignee: Daniel Voros
> Attachments: HIVE-18091.1-branch-1.patch, HIVE-18091.2-branch-1.patch
>
>
> Seen this while looking at ptest results for HIVE-17947 but is probably an
> older issue.
> Tests under itests/qtest-spark and itests/hive-unit fail when trying to
> execute the download-spark plugin with:
> {code}
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building Hive Integration - Unit Tests 1.3.0-SNAPSHOT
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @
> hive-it-unit ---
> [INFO]
> [INFO] --- maven-antrun-plugin:1.7:run (download-spark) @ hive-it-unit ---
> [INFO] Executing tasks
> main:
> [exec] + /bin/pwd
> [exec] + BASE_DIR=./target
> [exec] + HIVE_ROOT=./target/../../../
> [exec] + DOWNLOAD_DIR=./../thirdparty
> [exec] + mkdir -p ./../thirdparty
> [exec]
> /home/hiveptest/35.192.99.254-hiveptest-0/apache-github-branch-1-source/itests/hive-unit
> [exec] + download
> http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-1.5.0-bin-hadoop2-without-hive.tgz
> spark
> [exec] +
> url=http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-1.5.0-bin-hadoop2-without-hive.tgz
> [exec] + finalName=spark
> [exec] ++ basename
> http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-1.5.0-bin-hadoop2-without-hive.tgz
> [exec] + tarName=spark-1.5.0-bin-hadoop2-without-hive.tgz
> [exec] + rm -rf ./target/spark
> [exec] + [[ ! -f
> ./../thirdparty/spark-1.5.0-bin-hadoop2-without-hive.tgz ]]
> [exec] + tar -zxf
> ./../thirdparty/spark-1.5.0-bin-hadoop2-without-hive.tgz -C ./target
> [exec] + mv ./target/spark-1.5.0-bin-hadoop2-without-hive ./target/spark
> [exec] + cp -f ./target/../../..//data/conf/spark/log4j.properties
> ./target/spark/conf/
> [exec] + sed '/package /d'
> /data/hiveptest/working/apache-github-branch-1-source/itests/../contrib/src/java/org/apache/hadoop/hive/contrib/udf/example/UDFExampleAdd.java
> [exec] sed: can't read
> /data/hiveptest/working/apache-github-branch-1-source/itests/../contrib/src/java/org/apache/hadoop/hive/contrib/udf/example/UDFExampleAdd.java:
> No such file or directory
> [exec] + javac -cp
> /data/hiveptest/working/maven/org/apache/hive/hive-exec/1.3.0-SNAPSHOT/hive-exec-1.3.0-SNAPSHOT.jar
> /tmp/UDFExampleAdd.java -d /tmp
> [exec] + jar -cf /tmp/udfexampleadd-1.0.jar -C /tmp UDFExampleAdd.class
> [exec] /tmp/UDFExampleAdd.class : no such file or directory
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 8.376s
> [INFO] Finished at: Mon Nov 06 22:29:39 UTC 2017
> [INFO] Final Memory: 18M/241M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-antrun-plugin:1.7:run (download-spark) on
> project hive-it-unit: An Ant BuildException has occured: exec returned: 1
> [ERROR] around Ant part ...<exec
> dir="/home/hiveptest/35.192.99.254-hiveptest-0/apache-github-branch-1-source/itests/hive-unit"
> executable="bash" failonerror="true">... @ 4:141 in
> /home/hiveptest/35.192.99.254-hiveptest-0/apache-github-branch-1-source/itests/hive-unit/target/antrun/build-main.xml
> {code}
> {{mvn antrun:run@download-spark}} passes when run locally, so I guess it
> might be an issue with the way wer're executing ptests.
> Full list of classes with the same error:
> {code}
> TestAcidOnTez
> TestAdminUser
> TestAuthorizationPreEventListener
> TestAuthzApiEmbedAuthorizerInEmbed
> TestAuthzApiEmbedAuthorizerInRemote
> TestBeeLineWithArgs
> TestCLIAuthzSessionContext
> TestClearDanglingScratchDir
> TestClientSideAuthorizationProvider
> TestCompactor
> TestCreateUdfEntities
> TestCustomAuthentication
> TestDBTokenStore
> TestDDLWithRemoteMetastoreSecondNamenode
> TestDynamicSerDe
> TestEmbeddedHiveMetaStore
> TestEmbeddedThriftBinaryCLIService
> TestFilterHooks
> TestFolderPermissions
> TestHS2AuthzContext
> TestHS2AuthzSessionContext
> TestHS2ClearDanglingScratchDir
> TestHS2ImpersonationWithRemoteMS
> TestHiveAuthorizerCheckInvocation
> TestHiveAuthorizerShowFilters
> TestHiveHistory
> TestHiveMetaStoreTxns
> TestHiveMetaStoreWithEnvironmentContext
> TestHiveMetaTool
> TestHiveServer2
> TestHiveServer2SessionTimeout
> TestHiveSessionImpl
> TestHs2Hooks
> TestJdbcDriver2
> TestJdbcMetadataApiAuth
> TestJdbcWithLocalClusterSpark
> TestJdbcWithMiniHS2
> TestJdbcWithMiniMr
> TestJdbcWithSQLAuthUDFBlacklist
> TestJdbcWithSQLAuthorization
> TestLocationQueries
> TestMTQueries
> TestMarkPartition
> TestMarkPartitionRemote
> TestMetaStoreAuthorization
> TestMetaStoreConnectionUrlHook
> TestMetaStoreEndFunctionListener
> TestMetaStoreEventListener
> TestMetaStoreEventListenerOnlyOnCommit
> TestMetaStoreInitListener
> TestMetaStoreListenersError
> TestMetaStoreMetrics
> TestMetaStoreUtils
> TestMetastoreAuthorizationProvider
> TestMetastoreVersion
> TestMiniHS2
> TestMiniSparkOnYarnCliDriver
> TestMultiAuthorizationPreEventListener
> TestMultiSessionsHS2WithLocalClusterSpark
> TestNoSaslAuth
> TestOperationLoggingAPIWithMr
> TestOperationLoggingAPIWithTez
> TestPartitionNameWhitelistValidation
> TestPasswordWithConfig
> TestRemoteHiveMetaStore
> TestRemoteHiveMetaStoreIpAddress
> TestRemoteUGIHiveMetaStoreIpAddress
> TestRetryingHMSHandler
> TestSSL
> TestSchemaTool
> TestSemanticAnalyzerHookLoading
> TestSerdeWithFieldComments
> TestServerSpecificConfig
> TestServiceDiscovery
> TestSetUGIOnBothClientServer
> TestSetUGIOnOnlyClient
> TestSetUGIOnOnlyServer
> TestSparkCliDriver
> TestSparkNegativeCliDriver
> TestStorageBasedClientSideAuthorizationProvider
> TestStorageBasedMetastoreAuthorizationDrops
> TestStorageBasedMetastoreAuthorizationProvider
> TestStorageBasedMetastoreAuthorizationReads
> TestThriftBinaryCLIService
> TestThriftHttpCLIService
> TestZooKeeperTokenStore
> {code}
> These are all the test classes of the two modules with the exception of
> TestHiveMetastore.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
