Re: Upgrading spark history server, no logs showing.

2018-11-27 Thread bbarks
I finally circled back and tinkered with this, eventually finding the solution. It turned out to be HDFS permissions on the history files. For whatever reason, our HDFS perms worked fine with spark 2.0.2 and 2.1.2, but when we ran spark 2.3.0 it wouldn't load any history in the UI. I found out

Upgrading spark history server, no logs showing.

2018-07-12 Thread bbarks
Hi, We have multiple installations of spark installed on our clusters. They reside in different directories which the jobs point to when they run. For a couple of years now, we've run our history server off spark 2.0.2. We have 2.1.2, 2.2.1 and 2.3.0 installed as well. I've tried upgrading to