[
https://issues.apache.org/jira/browse/SPARK-19966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927688#comment-15927688
]
吴志龙 commented on SPARK-19966:
-----------------------------
I use spark-sql submit sql : E.g
./spark-sql --master=yarn --spark.submit.deployMode cluster --queue queue3
--driver-memory 4g --driver-java-options -XX:MaxPermSize=1g --num-executors 8
--executor-memory 3g --conf spark.yarn.am.memory=2048m --hiveconf
hive.cli.print.header=false -S -e " CREATE TABLE dp_tmp.tmp_88413_20170316
ROW FORMAT DELIMITED FIELDS TERMINATED BY '|'
STORED AS TEXTFILE
LOCATION '/data/tmp/tmp_88413_20170316'
AS
select
pd.Fparam_name,
pd.Fparam_value,
pd.Fday_lr_ratio,
pd.Fweek_lr_ratio,
pd.Fmonth_lr_ratio
from
dp_mart.zbfx_fact_daily_push_detail pd
where
f_p_date = '2017-03-16'
and Ftype = '4'
and Fbusiness_type_id = '4'
;
USE dp_tmp;ALTER TABLE tmp_88413_20170316 SET
SERDEPROPERTIES('serialization.null.format' = ''); drop table
dp_tmp.tmp_88413_20170316;"
This exception occurs and This is an exception in my ETL script, and this
exception occasionally appears in our task：
ERROR|2017-03-16 10:20:39|LiveListenerBus|SparkListenerBus has already
stopped! Dropping event SparkListenerExecutorMetricsUpdate(6,WrappedArray())
I think this is an error judgment or an exception in sparkcontext
LiveListenerBus
> SparkListenerBus has already stopped! Dropping event
> SparkListenerExecutorMetricsUpdate
> ---------------------------------------------------------------------------------------
>
> Key: SPARK-19966
> URL: https://issues.apache.org/jira/browse/SPARK-19966
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.1.0
> Environment: redhot
> spark on yarn client
> Reporter: 吴志龙
>
> 2017-03-16 10:17:47|GET_HIVE_DATA|delete table |drop table
> dp_tmp.tmp_20783_20170316;
> ERROR|2017-03-16 10:17:44|LiveListenerBus|SparkListenerBus has already
> stopped! Dropping event SparkListenerExecutorMetricsUpdate(3,WrappedArray())
> ====>FAILED|GET_HIVE_DATA|[[[0]]] ,has execption
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
