...@cloudera.com]
Sent: 07 January 2015 18:10
To: England, Michael (IT/UK)
Cc: user@spark.apache.org
Subject: Re: Spark History Server can't read event logs
The Spark code generates the log directory with 770 permissions. On top
of that you need to make sure of two things:
- all directories up
, Michael (IT/UK)
Cc: user@spark.apache.org
Subject: Re: Spark History Server can't read event logs
The Spark code generates the log directory with 770 permissions. On top of
that you need to make sure of two things:
- all directories up to /apps/spark/historyserver/logs/ are readable by the
user
)
Cc: user@spark.apache.org
Subject: Re: Spark History Server can't read event logs
The Spark code generates the log directory with 770 permissions. On top of
that you need to make sure of two things:
- all directories up to /apps/spark/historyserver/logs/ are readable by the
user running
.
Thanks,
Michael
-Original Message-
From: Marcelo Vanzin [mailto:van...@cloudera.com]
Sent: 07 January 2015 18:10
To: England, Michael (IT/UK)
Cc: user@spark.apache.org
Subject: Re: Spark History Server can't read event logs
The Spark code generates the log directory with 770
]
Sent: 07 January 2015 18:10
To: England, Michael (IT/UK)
Cc: user@spark.apache.org
Subject: Re: Spark History Server can't read event logs
The Spark code generates the log directory with 770 permissions. On top
of that you need to make sure of two things:
- all directories up to /apps/spark
Hi,
When I run jobs and save the event logs, they are saved with the permissions of
the unix user and group that ran the spark job. The history server is run as a
service account and therefore can’t read the files:
Extract from the History server logs:
2015-01-07 15:37:24,3021 ERROR Client
The Spark code generates the log directory with 770 permissions. On
top of that you need to make sure of two things:
- all directories up to /apps/spark/historyserver/logs/ are readable
by the user running the history server
- the user running the history server belongs to the group that owns
