Re: History Server Not Showing Any Jobs - File Not Found?

2020-07-12 Thread Chesnay Schepler
e future J *// *ah** *From:*Chesnay Schepler *Sent:* Tuesday, June 2, 2020 3:55 AM *To:* Hailu, Andreas [Engineering] ; user@flink.apache.org *Subject:* Re: History Server Not Showing Any Jobs - File Not Found? 1) It downloads all archives and stores them on disk; the only thing stored in memory

RE: History Server Not Showing Any Jobs - File Not Found?

2020-07-11 Thread Hailu, Andreas
(ala Spark) would ease the burden on the dev + ops side. Perhaps a feature for the future :) // ah From: Chesnay Schepler Sent: Tuesday, June 2, 2020 3:55 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? 1) It dow

Re: History Server Not Showing Any Jobs - File Not Found?

2020-06-02 Thread Chesnay Schepler
keep the latest X archives in the dir - or is this something we need to manage ourselves? Thanks. *// *ah** *From:*Hailu, Andreas [Engineering] *Sent:* Friday, May 29, 2020 8:46 AM *To:* 'Chesnay Schepler' ; user@flink.apache.org *Subject:* RE: History Server Not Showing Any Jobs - File Not Found

RE: History Server Not Showing Any Jobs - File Not Found?

2020-06-01 Thread Hailu, Andreas
eering] mailto:andreas.ha...@ny.email.gs.com>>; user@flink.apache.org<mailto:user@flink.apache.org> Subject: Re: History Server Not Showing Any Jobs - File Not Found? oh I'm not using the HistoryServer; I just wrote it ;) Are these archives all in the same location? So we're rough

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-29 Thread Hailu, Andreas
me kind of resource problem. // ah From: Hailu, Andreas [Engineering] Sent: Thursday, May 28, 2020 12:18 PM To: 'Chesnay Schepler' <mailto:ches...@apache.org>; user@flink.apache.org<mailto:user@flink.apache.org> Subject: RE: History Server Not Showing Any Jobs - File Not Found?

Re: History Server Not Showing Any Jobs - File Not Found?

2020-05-29 Thread Chesnay Schepler
*ah** *From:*Hailu, Andreas [Engineering] *Sent:* Thursday, May 28, 2020 12:18 PM *To:* 'Chesnay Schepler' ; user@flink.apache.org *Subject:* RE: History Server Not Showing Any Jobs - File Not Found? Okay, I will look further to see if we’re mistakenly using a version that’s pre-2.6.0. Howeve

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-28 Thread Hailu, Andreas
] Sent: Thursday, May 28, 2020 12:18 PM To: 'Chesnay Schepler' ; user@flink.apache.org Subject: RE: History Server Not Showing Any Jobs - File Not Found? Okay, I will look further to see if we're mistakenly using a version that's pre-2.6.0. However, I don't see flink-shaded-hadoop in my /lib directory

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-28 Thread Hailu, Andreas
Are the files within /lib. // ah From: Chesnay Schepler Sent: Thursday, May 28, 2020 11:00 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? Looks like it is indeed stuck on downloading the archive. I searched a bit

Re: History Server Not Showing Any Jobs - File Not Found?

2020-05-28 Thread Chesnay Schepler
being included introduce? *// *ah** *From:*Chesnay Schepler *Sent:* Thursday, May 28, 2020 9:26 AM *To:* Hailu, Andreas [Engineering] ; user@flink.apache.org *Subject:* Re: History Server Not Showing Any Jobs - File Not Found? If it were a class-loading issue I would think that we'd see an e

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-28 Thread Hailu, Andreas
dPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) What problems could the flink-shaded-hadoop jar being included introduce? // ah From: Chesnay Schepler Sent: Thursday, May 28, 2020 9:26 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re:

Re: History Server Not Showing Any Jobs - File Not Found?

2020-05-28 Thread Chesnay Schepler
] ; user@flink.apache.org *Subject:* Re: History Server Not Showing Any Jobs - File Not Found? yes, exactly; I want to rule out that (somehow) HDFS is the problem. I couldn't reproduce the issue locally myself so far. On 01/05/2020 22:31, Hailu, Andreas wrote: Hi Chesnay, yes – they were

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-27 Thread Hailu, Andreas
, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? yes, exactly; I want to rule out that (somehow) HDFS is the problem. I couldn't reproduce the issue locally myself so far. On 01/05/2020 22:31, Hailu, Andreas wrote: Hi Chesnay, yes

Re: History Server Not Showing Any Jobs - File Not Found?

2020-05-03 Thread Chesnay Schepler
@flink.apache.org *Subject:* Re: History Server Not Showing Any Jobs - File Not Found? hmm...let's see if I can reproduce the issue locally. Are the archives from the same version the history server runs on? (Which I supposed would be 1.9.1?) Just for the sake of narrowing things down, it would also

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-01 Thread Hailu, Andreas
? // ah From: Chesnay Schepler Sent: Wednesday, April 29, 2020 8:26 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? hmm...let's see if I can reproduce the issue locally. Are the archives from the same version the history

Re: History Server Not Showing Any Jobs - File Not Found?

2020-04-29 Thread Chesnay Schepler
/0004be6ce01ba9677d1eb619ad0fa757 ... *// *ah** *From:*Chesnay Schepler *Sent:* Monday, April 27, 2020 10:28 AM *To:* Hailu, Andreas [Engineering] ; user@flink.apache.org *Subject:* Re: History Server Not Showing Any Jobs - File Not Found? If historyserver.web.tmpdir is not set then java.io.tmpdir is used, so

RE: History Server Not Showing Any Jobs - File Not Found?

2020-04-27 Thread Hailu, Andreas
10:28 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? If historyserver.web.tmpdir is not set then java.io.tmpdir is used, so that should be fine. What are the contents of /local/scratch/flink_historyserver_tmpdir? I

Re: History Server Not Showing Any Jobs - File Not Found?

2020-04-27 Thread Chesnay Schepler
:32 PM *To:* 'Chesnay Schepler' <mailto:ches...@apache.org>; Hailu, Andreas [Engineering] <mailto:andreas.ha...@ny.email.gs.com>; user@flink.apache.org <mailto:user@flink.apache.org> *Subject:* RE: History Server Not Showing Any Jobs - File Not Found?

RE: History Server Not Showing Any Jobs - File Not Found?

2020-04-27 Thread Hailu, Andreas
: Re: History Server Not Showing Any Jobs - File Not Found? overview.json is a generated file that is placed in the local directory controlled by historyserver.web.tmpdir. Have you configured this option to point to some non-local filesystem? (Or if not, is the java.io.tmpdir property pointing

Re: History Server Not Showing Any Jobs - File Not Found?

2020-04-27 Thread Chesnay Schepler
[Engineering] ; user@flink.apache.org *Subject:* RE: History Server Not Showing Any Jobs - File Not Found? Hi Chesnay, thanks for responding. We’re using Flink 1.9.1. I enabled DEBUG level logging and this is something relevant I see: 2020-04-22 13:25:52,566 [Flink-HistoryServer-ArchiveFetcher

RE: History Server Not Showing Any Jobs - File Not Found?

2020-04-24 Thread Hailu, Andreas
] ; user@flink.apache.org Subject: RE: History Server Not Showing Any Jobs - File Not Found? Hi Chesnay, thanks for responding. We're using Flink 1.9.1. I enabled DEBUG level logging and this is something relevant I see: 2020-04-22 13:25:52,566 [Flink-HistoryServer-ArchiveFetcher-thread-1] DEBUG

RE: History Server Not Showing Any Jobs - File Not Found?

2020-04-22 Thread Hailu, Andreas
, April 22, 2020 2:16 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? Which Flink version are you using? Have you checked the history server logs after enabling debug logging? On 21/04/2020 17:16, Hailu, Andreas

Re: History Server Not Showing Any Jobs - File Not Found?

2020-04-22 Thread Chesnay Schepler
Which Flink version are you using? Have you checked the history server logs after enabling debug logging? On 21/04/2020 17:16, Hailu, Andreas [Engineering] wrote: Hi, I’m trying to set up the History Server, but none of my applications are showing up in the Web UI. Looking at the console, I

History Server Not Showing Any Jobs - File Not Found?

2020-04-21 Thread Hailu, Andreas [Engineering]
Hi, I'm trying to set up the History Server, but none of my applications are showing up in the Web UI. Looking at the console, I see that all of the calls to /overview return the following 404 response: {"errors":["File not found."]}. I've set up my configuration as follows: JobManager