[
https://issues.apache.org/jira/browse/FLINK-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17074610#comment-17074610
]
Piotr Nowojski commented on FLINK-16907:
----------------------------------------
[~xinyitong] unfortunately logs are not giving any more information, your stack
traces seem cut in half. You can try to use other tools I mentioned before to
analyse the problem, like capturing threads dump.
Also make sure that the code is not stuck/blocked in your code
{code:java}
JSONObject alterTable = KafkaOnHDFSAsHiveShell.alterTableorCount(this.doday,
this.shellPath, this.logPath + "/" + this.tableName + "_" + this.doday +
".log", this.dbName, this.tableName, this.part, true);
JSONObject count = KafkaOnHDFSAsHiveShell.alterTableorCount(this.doday,
this.shellPath, this.logPath + "/" + this.tableName + "_" + this.doday +
".log", this.dbName, this.tableName, this.part, false);
{code}
If those calls are blocking or even worse deadlocking, that could explain your
problems.
> did not react to cancelling signal for 30 seconds, but is stuck in method:
> --------------------------------------------------------------------------
>
> Key: FLINK-16907
> URL: https://issues.apache.org/jira/browse/FLINK-16907
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Task
> Affects Versions: 1.9.1
> Environment: Hadoop version: 3.1.1.3.1.0.0-78
> flink-1.9.1
> hdp-3.1.0.0-78-kafka
> Reporter: 辛羿彤
> Priority: Major
> Labels: test
> Attachments: flink-root-standalonesession-0-dqapp121003.log,
> flink-root-taskexecutor-1-dqapp121002.log
>
>
> public UserInfo map(String s) throws Exception {
> if (StringUtils.isBlank(s)){
> return null;
> }
> JSONObject alterTable = KafkaOnHDFSAsHiveShell.alterTableorCount(this.doday,
> this.shellPath, this.logPath + "/" + this.tableName + "_" + this.doday +
> ".log", this.dbName, this.tableName, this.part, true);
> JSONObject count = KafkaOnHDFSAsHiveShell.alterTableorCount(this.doday,
> this.shellPath, this.logPath + "/" + this.tableName + "_" + this.doday +
> ".log", this.dbName, this.tableName, this.part, false);
> {color:#FF0000}//There is no response at this point{color}
> {color:#FF0000}//alterTableorCount() is Methods to
> {color}{color:#FF0000}Execute the Linux shell command{color}
> if (!alterTable.isEmpty()) {
> if (alterTable.containsKey("msg") && alterTable.containsKey("value")) {
> System.out.println(alterTable.getString("msg"));
> }
> }
> if (!count.isEmpty()) {
> if (count.containsKey("msg") && count.containsKey("value")) {
> System.out.println(count.getString("msg"));
> System.out.println(count.getString("value"));
> }
> }
> //将传入的Json格式转为实体类
> return JSONObject.parseObject(s, UserInfo.class);
> }
> }
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
