brighteast created FLINK-7592:
---------------------------------
Summary: How to close the output log like "Connected to JobManager
at Actor" and "Job execution switched to status RUNNING."?
Key: FLINK-7592
URL: https://issues.apache.org/jira/browse/FLINK-7592
Project: Flink
Issue Type: Wish
Components: Configuration
Affects Versions: 1.3.2
Environment: jdk 1.8
Reporter: brighteast
Fix For: 1.3.2
Connected to JobManager at Actor[akka://flink/user/jobmanager_1#1060959513]
with leader session id 59ff044a-ab2b-4518-b7b8-8352da361511.
09/06/2017 15:06:35 Job execution switched to status RUNNING.
09/06/2017 15:06:35 CHAIN DataSource (at
org.apache.flink.api.scala.ExecutionEnvironment.fromElements(ExecutionEnvironment.scala:601)
(org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at
flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:10)) -> Map (Map at
flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:11)) ->
Combine(SUM(1))(1/1) switched to SCHEDULED
09/06/2017 15:06:35 CHAIN DataSource (at
org.apache.flink.api.scala.ExecutionEnvironment.fromElements(ExecutionEnvironment.scala:601)
(org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at
flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:10)) -> Map (Map at
flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:11)) ->
Combine(SUM(1))(1/1) switched to DEPLOYING
09/06/2017 15:06:35 CHAIN DataSource (at
org.apache.flink.api.scala.ExecutionEnvironment.fromElements(ExecutionEnvironment.scala:601)
(org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at
flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:10)) -> Map (Map at
flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:11)) ->
Combine(SUM(1))(1/1) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(2/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(1/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(3/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(4/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(5/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(6/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(7/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(8/8) switched to SCHEDULED
09/06/2017 15:06:35 Reduce (SUM(1))(4/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(8/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(7/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(6/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(3/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(1/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(5/8) switched to DEPLOYING
09/06/2017 15:06:35 CHAIN DataSource (at
org.apache.flink.api.scala.ExecutionEnvironment.fromElements(ExecutionEnvironment.scala:601)
(org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at
flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:10)) -> Map (Map at
flinkTest$.delayedEndpoint$flinkTest$1(flinkTest.scala:11)) ->
Combine(SUM(1))(1/1) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(2/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(5/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(8/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(7/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(2/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(3/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(6/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(4/8) switched to RUNNING
09/06/2017 15:06:35 Reduce (SUM(1))(1/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(1/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(8/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(8/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(1/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(4/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(4/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(1/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(8/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(4/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(5/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(5/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(2/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(2/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(5/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(2/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(3/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(3/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(3/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(6/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(6/8) switched to DEPLOYING
09/06/2017 15:06:35 DataSink (collect())(6/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(7/8) switched to SCHEDULED
09/06/2017 15:06:35 DataSink (collect())(7/8) switched to DEPLOYING
09/06/2017 15:06:35 Reduce (SUM(1))(5/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(5/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(4/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(1/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(8/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(4/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(1/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(7/8) switched to RUNNING
09/06/2017 15:06:35 DataSink (collect())(6/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(8/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(2/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(2/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(6/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(3/8) switched to FINISHED
09/06/2017 15:06:35 Reduce (SUM(1))(7/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(3/8) switched to FINISHED
09/06/2017 15:06:35 DataSink (collect())(7/8) switched to FINISHED
09/06/2017 15:06:35 Job execution switched to status FINISHED.
(is,1)
(a,1)
(in,1)
(mind,1)
(or,2)
(against,1)
(arms,1)
(not,1)
(sea,1)
(the,3)
(troubles,1)
('tis,1)
(fortune,1)
(take,1)
(to,4)
(and,1)
(arrows,1)
(nobler,1)
(of,2)
(be,,1)
(slings,1)
(suffer,1)
(outrageous,1)
(whether,1)
(be,--that,1)
(question:--,1)
The above are the output of these run:
import org.apache.flink.api.scala._
object flinkTest extends App {
val flink=ExecutionEnvironment.getExecutionEnvironment
val text = flink.fromElements("To be, or not to be,--that is the question:--",
"Whether 'tis nobler in the mind to suffer", "The slings and arrows of
outrageous fortune",
"Or to take arms against a sea of troubles")
val counts = text.flatMap { _.toLowerCase.split("\\s+") }
.map { (_, 1) }
.groupBy(0)
.sum(1)
// execute and print result
counts.print()
}
how to close the log like "Reduce (SUM(1))(3/8) switched to FINISHED"? I attemp
to set off those logging output by configure akka's log, but in vain. If the
log were closed, many disk space could be saved a lot.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
