[ https://issues.apache.org/jira/browse/HIVE-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14080748#comment-14080748 ]
Hive QA commented on HIVE-7330: ------------------------------- {color:red}Overall{color}: -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12658902/HIVE-7330.1-spark.patch Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/6/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/6/console Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-6/ Messages: {noformat} **** This message was trimmed, see log for full details **** U ql/src/java/org/apache/hadoop/hive/ql/Driver.java U ql/src/java/org/apache/hadoop/hive/ql/udf/generic/UDFCurrentDB.java U ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFComputeStats.java U ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFToBinary.java U ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFFormatNumber.java U ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFEvaluator.java U ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFInFile.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/ColumnPrunerProcFactory.java A ql/src/java/org/apache/hadoop/hive/ql/optimizer/ConstantPropagateProcFactory.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/Vectorizer.java A ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/NullScanTaskDispatcher.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/PhysicalOptimizer.java A ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/NullScanOptimizer.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/MetadataOnlyOptimizer.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/SortedMergeJoinProc.java A ql/src/java/org/apache/hadoop/hive/ql/optimizer/ConstantPropagate.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/IntraQueryCorrelation.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/QueryPlanTreeTransformation.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/StatsOptimizer.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/SimpleFetchOptimizer.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/StatsRulesProcFactory.java A ql/src/java/org/apache/hadoop/hive/ql/optimizer/ConstantPropagateProcCtx.java U ql/src/java/org/apache/hadoop/hive/ql/ppd/PredicatePushDown.java U ql/src/java/org/apache/hadoop/hive/ql/ppd/OpProcFactory.java U ql/src/java/org/apache/hadoop/hive/ql/plan/MapWork.java U ql/src/java/org/apache/hadoop/hive/ql/plan/GroupByDesc.java A ql/src/java/org/apache/hadoop/hive/ql/plan/ShowConfDesc.java U ql/src/java/org/apache/hadoop/hive/ql/plan/RevokeDesc.java U ql/src/java/org/apache/hadoop/hive/ql/plan/ReduceSinkDesc.java U ql/src/java/org/apache/hadoop/hive/ql/plan/TezEdgeProperty.java U ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableLikeDesc.java U ql/src/java/org/apache/hadoop/hive/ql/plan/DDLWork.java U ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java U ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeConstantDesc.java U ql/src/java/org/apache/hadoop/hive/ql/plan/HiveOperation.java U ql/src/java/org/apache/hadoop/hive/ql/lockmgr/zookeeper/ZooKeeperHiveLockManager.java U ql/src/java/org/apache/hadoop/hive/ql/lockmgr/HiveLockObject.java U ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g U ql/src/java/org/apache/hadoop/hive/ql/parse/authorization/HiveAuthorizationTaskFactoryImpl.java U ql/src/java/org/apache/hadoop/hive/ql/parse/VariableSubstitution.java U ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g U ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java U ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java U ql/src/java/org/apache/hadoop/hive/ql/parse/TezCompiler.java U ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzerFactory.java U ql/src/java/org/apache/hadoop/hive/ql/parse/FunctionSemanticAnalyzer.java U ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java U ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java U ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g U ql/src/java/org/apache/hadoop/hive/ql/parse/ColumnStatsSemanticAnalyzer.java U ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java A ql/src/java/org/apache/hadoop/hive/ql/parse/StorageFormat.java U ql/src/java/org/apache/hadoop/hive/ql/parse/ParseUtils.java U ql/src/java/org/apache/hadoop/hive/ql/metadata/Partition.java A ql/src/java/org/apache/hadoop/hive/ql/metadata/SessionHiveMetaStoreClient.java U ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java U ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java U ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java U ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java U ql/src/java/org/apache/hadoop/hive/ql/hooks/WriteEntity.java U ql/src/java/org/apache/hadoop/hive/ql/hooks/ATSHook.java U ql/src/java/org/apache/hadoop/hive/ql/hooks/Entity.java U ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorExpressionDescriptor.java U ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizationContext.java U ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorColumnAssignFactory.java U ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/VectorExpressionWriterFactory.java A ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/VectorElt.java U ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/ConstantVectorExpression.java U ql/src/java/org/apache/hadoop/hive/ql/exec/ReduceSinkOperator.java U ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java U ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezTask.java U ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java U ql/src/java/org/apache/hadoop/hive/ql/exec/spark/KryoSerializer.java U ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkClient.java A ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkShuffler.java A ql/src/java/org/apache/hadoop/hive/ql/exec/spark/ChainedTran.java A ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SortByShuffler.java U ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveVoidFunction.java A ql/src/java/org/apache/hadoop/hive/ql/exec/spark/GroupByShuffler.java U ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkCollector.java U ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveReduceFunction.java A ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkPlan.java A ql/src/java/org/apache/hadoop/hive/ql/exec/spark/ReduceTran.java U ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveMapFunction.java A ql/src/java/org/apache/hadoop/hive/ql/exec/spark/MapTran.java A ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkPlanGenerator.java U ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTask.java A ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTran.java U ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionInfo.java U ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java U ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluator.java U ql/src/java/org/apache/hadoop/hive/ql/exec/ColumnInfo.java U ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java U ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinOperator.java U ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java U ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapRedTask.java U ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java U ql/src/java/org/apache/hadoop/hive/ql/exec/ColumnStatsTask.java U ql/src/java/org/apache/hadoop/hive/ql/exec/WindowFunctionInfo.java U ql/src/java/org/apache/hadoop/hive/ql/exec/ExplainTask.java U ql/src/java/org/apache/hadoop/hive/ql/exec/SelectOperator.java A ql/src/main/resources/META-INF A ql/src/main/resources/META-INF/services A ql/src/main/resources/META-INF/services/org.apache.hadoop.hive.ql.io.StorageFormatDescriptor U ql/pom.xml U conf/hive-default.xml.template A service/src/test/org/apache/hive/service/cli/session/TestSessionGlobalInitFile.java U service/src/java/org/apache/hive/service/server/HiveServer2.java U service/src/java/org/apache/hive/service/cli/thrift/EmbeddedThriftBinaryCLIService.java U service/src/java/org/apache/hive/service/cli/CLIService.java U service/src/java/org/apache/hive/service/cli/session/HiveSessionBase.java U service/src/java/org/apache/hive/service/cli/session/SessionManager.java U service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java U service/src/java/org/apache/hive/service/cli/session/HiveSessionImplwithUGI.java U contrib/src/test/results/clientnegative/udtf_explode2.q.out U contrib/src/test/results/clientnegative/case_with_row_sequence.q.out U contrib/src/test/results/clientnegative/invalid_row_sequence.q.out U contrib/src/test/results/clientpositive/udaf_example_avg.q.out U contrib/src/test/results/clientpositive/udf_example_arraymapstruct.q.out U contrib/src/test/results/clientpositive/udaf_example_group_concat.q.out U contrib/src/test/results/clientpositive/udaf_example_min.q.out U contrib/src/test/results/clientpositive/udf_row_sequence.q.out U contrib/src/test/results/clientpositive/udaf_example_max.q.out U contrib/src/test/results/clientpositive/udf_example_add.q.out U contrib/src/test/results/clientpositive/udf_example_format.q.out U contrib/src/test/results/clientpositive/udtf_output_on_close.q.out U contrib/src/test/results/clientpositive/udtf_explode2.q.out U contrib/src/test/results/clientpositive/dboutput.q.out U contrib/src/test/results/clientpositive/udaf_example_min_n.q.out U contrib/src/test/results/clientpositive/udaf_example_max_n.q.out U contrib/src/test/results/clientpositive/lateral_view_explode2.q.out A serde/src/test/org/apache/hadoop/hive/serde2/avro/TestTypeInfoToSchema.java A serde/src/test/resources A serde/src/test/resources/avro-nested-struct.avsc A serde/src/test/resources/avro-struct.avsc U serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroDeserializer.java U serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerDe.java U serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java A serde/src/java/org/apache/hadoop/hive/serde2/avro/TypeInfoToSchema.java U jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java U jdbc/pom.xml U beeline/src/test/org/apache/hive/beeline/TestBeelineArgParsing.java U beeline/src/java/org/apache/hive/beeline/DatabaseConnection.java U beeline/src/java/org/apache/hive/beeline/TableOutputFormat.java U beeline/src/java/org/apache/hive/beeline/BeeLine.java U beeline/src/java/org/apache/hive/beeline/BeeLineOpts.java U beeline/src/main/resources/BeeLine.properties A data/files/in_file.dat A data/conf/hiveserver2-site.xml U data/conf/hive-site.xml A data/conf/hivemetastore-site.xml U itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/security/FolderPermissionBase.java U itests/hive-unit/src/test/java/org/apache/hadoop/hive/jdbc/TestJdbcDriver.java A itests/hive-unit/src/test/java/org/apache/hadoop/hive/metastore/TestServerSpecificConfig.java U itests/hive-unit/src/test/java/org/apache/hadoop/hive/metastore/TestAuthorizationApiAuthorizer.java U itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestJdbcDriver2.java A itests/hive-unit/src/test/java/org/apache/hive/jdbc/authorization/TestHS2AuthzContext.java U itests/hive-unit/src/test/java/org/apache/hive/jdbc/authorization/TestJdbcWithSQLAuthorization.java U itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestJdbcWithMiniMr.java A itests/custom-serde/src/main/java/org/apache/hadoop/hive/serde2/CustomTextStorageFormatDescriptor.java A itests/custom-serde/src/main/java/org/apache/hadoop/hive/serde2/CustomTextSerDe.java A itests/custom-serde/src/main/resources A itests/custom-serde/src/main/resources/META-INF A itests/custom-serde/src/main/resources/META-INF/services A itests/custom-serde/src/main/resources/META-INF/services/org.apache.hadoop.hive.ql.io.StorageFormatDescriptor U itests/util/src/main/java/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/SQLStdHiveAuthorizerFactoryForTest.java U itests/util/src/main/java/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/SQLStdHiveAccessControllerForTest.java A itests/util/src/main/java/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/SQLStdHiveAuthorizationValidatorForTest.java U itests/qtest/testconfiguration.properties U hcatalog/core/src/main/java/org/apache/hive/hcatalog/cli/SemanticAnalysis/CreateTableHook.java U shims/common-secure/src/main/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java A common/src/java/org/apache/hadoop/hive/ant A common/src/java/org/apache/hadoop/hive/ant/GenHiveTemplate.java A common/src/java/org/apache/hadoop/hive/conf/SystemVariables.java A common/src/java/org/apache/hadoop/hive/conf/HiveConfUtil.java U common/src/java/org/apache/hadoop/hive/conf/HiveConf.java A common/src/java/org/apache/hadoop/hive/conf/Validator.java A common/src/java/org/apache/hadoop/hive/common/cli/HiveFileProcessor.java A common/src/java/org/apache/hadoop/hive/common/cli/IHiveFileProcessor.java A common/src/java/org/apache/hive/common/util/AnnotationUtils.java U common/src/test/org/apache/hadoop/hive/conf/TestHiveConf.java U common/src/test/org/apache/hadoop/hive/conf/TestHiveLogging.java U common/src/test/org/apache/hadoop/hive/conf/TestHiveConfRestrictList.java U common/pom.xml U pom.xml U . Fetching external item into 'hcatalog/src/test/e2e/harness' Updated external to revision 1614857. Updated to revision 1614857. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0, p1, or p2 + exit 1 ' {noformat} This message is automatically generated. ATTACHMENT ID: 12658902 > Create SparkTask > ---------------- > > Key: HIVE-7330 > URL: https://issues.apache.org/jira/browse/HIVE-7330 > Project: Hive > Issue Type: Sub-task > Components: Spark > Reporter: Xuefu Zhang > Assignee: Chinna Rao Lalam > Attachments: HIVE-7330-spark.patch, HIVE-7330.1-spark.patch > > > SparkTask handles the execution of SparkWork. It will execute a graph of map > and reduce work using a SparkClient instance. -- This message was sent by Atlassian JIRA (v6.2#6252)