marymwu created SPARK-16833:
-------------------------------
Summary: [Spark2.0]when creating temporary function,command "add
jar" doesn't work unless restart spark
Key: SPARK-16833
URL: https://issues.apache.org/jira/browse/SPARK-16833
Project: Spark
Issue Type: Bug
Affects Versions: 2.0.0
Reporter: marymwu
[Spark2.0]when creating temporary function,command "add jar" doesn't work
unless restart spark
Steps:
1. add jar /tmp/GeoIP-0.6.8.jar;
2. create temporary function GeoIP2 as
'com.lenovo.lps.device.hive.udf.UDFGeoIP';
3. select GeoIP2('tdy');
Error: org.apache.spark.SparkException: Job aborted due to stage failure: Task
0 in stage 527.0 failed 8 times, most recent failure: Lost task 0.7 in stage
527.0 (TID 140171, smokeslave2.avatar.lenovomm.com):
java.lang.RuntimeException: Stream '/jars/GeoIP-0.6.8.jar'' was not found.
Note: After restart spark,it works.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]