Re: Hadoop is not in the classpath/dependencies

2021-03-30 Thread Matthias Seiler
e the classpath contains hadoop libraries, but not the HDFS > libraries? The "DistributedFileSystem" class needs to be accessible to > the classloader. Can you check if that class is available? > > Best, > Robert > > On Thu, Mar 25, 2021 at 11:10 AM Matthias Seiler

Hadoop is not in the classpath/dependencies

2021-03-25 Thread Matthias Seiler
Hello everybody, I set up a a Flink (1.12.1) and Hadoop (3.2.1) cluster on two machines. The job should store the checkpoints on HDFS like so: ```java StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); env.enableCheckpointing(15000, CheckpointingMode.EXACTLY_ONC

Re: Netty LocalTransportException: Sending the partition request to 'null' failed

2021-03-22 Thread Matthias Seiler
ce?: > https://serverfault.com/a/363098 <https://serverfault.com/a/363098> > > > > On Mon, Mar 15, 2021 at 11:13 AM Matthias Seiler > <mailto:matthias.sei...@campus.tu-berlin.de>> wrote: > > Hi Arvid, > > I listened to ports with netcat and connected vi

Re: Netty LocalTransportException: Sending the partition request to 'null' failed

2021-03-15 Thread Matthias Seiler
ving up. > > localhost is usually 127.0.0.1. Can you double check that you connect > from all machines to all machines (including themselves) by opening > trivial text sockets on random ports? > > On Fri, Feb 19, 2021 at 10:59 AM Matthias Seiler > <mailto:matthias.sei...@campus.

Netty LocalTransportException: Sending the partition request to 'null' failed

2021-02-16 Thread Matthias Seiler
Hi Everyone, I'm trying to setup a Flink cluster in standealone mode with two machines. However, running a job throws the following exception: `org.apache.flink.runtime.io.network.netty.exception.LocalTransportException: Sending the partition request to 'null' failed` Here is some background: Ma