[
https://issues.apache.org/jira/browse/HIVE-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238569#comment-14238569
]
Hive QA commented on HIVE-9040:
-------------------------------
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12685847/HIVE-9040.2-spark.patch
{color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 7229 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_cast_constant
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join22
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan
org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
org.apache.hive.hcatalog.streaming.TestStreaming.testInterleavedTransactionBatchCommits
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchEmptyCommit
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/495/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/495/console
Test logs:
http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-495/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 7 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12685847 - PreCommit-HIVE-SPARK-Build
> Spark Memory can be formatted string
> ------------------------------------
>
> Key: HIVE-9040
> URL: https://issues.apache.org/jira/browse/HIVE-9040
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Brock Noland
> Assignee: Jimmy Xiang
> Fix For: spark-branch
>
> Attachments: HIVE-9040.1-spark.patch, HIVE-9040.2-spark.patch
>
>
> Here:
> https://github.com/apache/hive/blob/spark/ql/src/java/org/apache/hadoop/hive/ql/exec/spark/session/SparkSessionImpl.java#L72
> we call {{getInt}} on {{spark.executor.memory}} but this is a formatted
> string, example here: http://spark.apache.org/docs/1.0.1/configuration.html
> as such, I get:
> {noformat}
> 2014-12-08 03:04:48,114 WARN [HiveServer2-Handler-Pool: Thread-34]:
> spark.SetSparkReducerParallelism
> (SetSparkReducerParallelism.java:process(141)) - Failed to create spark
> client.
> java.lang.NumberFormatException: For input string: "23000m"
> at
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Integer.parseInt(Integer.java:492)
> at java.lang.Integer.parseInt(Integer.java:527)
> at
> scala.collection.immutable.StringLike$class.toInt(StringLike.scala:229)
> at scala.collection.immutable.StringOps.toInt(StringOps.scala:31)
> at
> org.apache.spark.SparkConf$$anonfun$getInt$2.apply(SparkConf.scala:184)
> at
> org.apache.spark.SparkConf$$anonfun$getInt$2.apply(SparkConf.scala:184)
> at scala.Option.map(Option.scala:145)
> at org.apache.spark.SparkConf.getInt(SparkConf.scala:184)
> at
> org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionImpl.getMemoryAndCores(SparkSessionImpl.java:72)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
