Not quiet sure, but try pointing the spark.history.fs.logDirectory to your s3
Thanks Best Regards On Tue, Jun 16, 2015 at 6:26 PM, Gianluca Privitera < [email protected]> wrote: > In Spark website it’s stated in the View After the Fact section ( > https://spark.apache.org/docs/latest/monitoring.html) that you can point > the start-history-server.sh script to a directory in order do view the Web > UI using the logs as data source. > > Is it possible to point that script to S3? Maybe from a EC2 instance? > > Thanks, > > Gianluca > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
