Basically I have added input and outputfiles to HDFS.
But how to specify access the input file in commandline to run wordcount
program?
bin/flink run ./examples/streaming/WordCount.jar --input
*hdfs:///user/wordcount_input.txt* --output
*hdfs:///user/wordcount_output.txt *
On Tue, Aug 8, 2017 at
Yes Felix,
I have created input and output files in HDFS.
http://localhost:50070/explorer.html#/user
But how we can access it ?
bin/flink run ./examples/streaming/WordCount.jar --input
*hdfs:///user/wordcount_input.txt* --output
*hdfs:///user/wordcount_output.txt *
On Tue, Aug 8, 2017 at 2:5
Hi,
like Timo said e.g. you need a distributed filesystem like HDFS.
Best regards,
Felix
On Aug 8, 2017 09:01, "P. Ramanjaneya Reddy" wrote:
Hi Timo,
How to make access the files across TM?
Thanks & Regards,
Ramanji.
On Mon, Aug 7, 2017 at 7:45 PM, Timo Walther wrote:
> Flink is a distrib
Hi Timo,
How to make access the files across TM?
Thanks & Regards,
Ramanji.
On Mon, Aug 7, 2017 at 7:45 PM, Timo Walther wrote:
> Flink is a distributed software for clusters. You need something like a
> distributed file system. So that input file and output files can be
> accessed from all no
Flink is a distributed software for clusters. You need something like a
distributed file system. So that input file and output files can be
accessed from all nodes.
Each TM has a log directory where the execution logs are stored.
You can set additional properties to your output format by impor
Hi Timo,
Problem is resolved after copy input file to all tasks managers.
and where should generate outputfile? Is it in jobmanager or task manager?
Where can i see the execution logs to understand how word count done each
task manager?
By the way any option to overwride...?
08/07/2017 19:27:0
Make sure that the file exists and is accessible from all Flink tasks
managers.
Am 07.08.17 um 14:35 schrieb P. Ramanjaneya Reddy:
Thank you Timo.
root1@root1-HP-EliteBook-840-G2:~/NAI/Tools/BEAM/Flink_Cluster/rama/flink$
*./bin/flink
run ./examples/streaming/WordCount.jar --input
file:///ho
Thank you Timo.
root1@root1-HP-EliteBook-840-G2:~/NAI/Tools/BEAM/Flink_Cluster/rama/flink$
*./bin/flink
run ./examples/streaming/WordCount.jar --input
file:///home/root1/hamlet.txt --output file:///home/root1/wordcount_out*
Execution of worcountjar gives error...
08/07/2017 18:03:16 Source: Cu
Hi Ramanji,
you can find the source code of the examples here:
https://github.com/apache/flink/blob/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/wordcount/WordCount.java
A general introduction how the cluster execution works can be found here:
