I think internally Ambari Search is really Solr, so you guess you could use it directly
On 22 February 2018 at 22:19, Lian Jiang <[email protected]> wrote: > Thanks. I want a log search UI like splunk/solr/kabana. It is interesting > to see how to feed my application logs to log search. > > On Thu, Feb 22, 2018 at 2:02 PM, Gonzalo Herreros <[email protected]> > wrote: > >> The logs are available through the Spark UI (which is the Application >> Master link in YARN UI) on the Executors tab (stderr and stdout) >> AFAIK, the log search can only index local files but you could have a >> cronjob downloading then directly from hdfs. >> >> Gonzalo >> >> >> On 22 February 2018 at 21:27, Lian Jiang <[email protected]> wrote: >> >>> Thanks for any help. What's the best way to get spark application logs? >>> yarn command line is not ideal for spark streaming applications. >>> >>> On Wed, Feb 21, 2018 at 10:41 AM, Lian Jiang <[email protected]> >>> wrote: >>> >>>> Can I make my spark application log available for ambari log search so >>>> that I can search them on log search UI? Or I have to setup another >>>> solr/elastic search cluster for my application logs? Thanks for any hints. >>>> >>> >>> >> >
