Re: Metrics of a streaming job

[Lionel Liu]

Hi Vikram,

Seems you're following the guide for streaming mode:
https://github.com/apache/incubator-griffin/blob/master/griffin-doc/docker/griffin-docker-guide.md#how-to-use-griffin-docker-images-in-streaming-mode
At current, UI and service doesn't support streaming measure create and
submit. You can only submit the spark application manually via shell, as
the step in the previous guide.
By tracing the log, you can get the status of calculation, when the result
of each mini-batch printed in log, it should also be posted to
elasticsearch, after then you can be able to retrieve the metrics from ES.

Thanks,
Lionel


On Fri, Aug 10, 2018 at 5:52 PM Vikram Jain  wrote:

> Hello,
> I’m trying my hands on Griffin and able to successfully deploy it on
> Docker.
> The UI and REST APIs seems to work smoothly for the batch jobs but I’m
> facing issues running streaming jobs.
> As per my understanding, metrics of streaming jobs are also stored in
> ElasticSearch. However, when I look at ES after streaming job execution
> starts, I don’t see any metrics being stored there.
>
> Please help me understand where the metrics of streaming job are stored
> and how to retrive them. I am using the sample database and instructions as
> present in Apache Griffin Docker guide :
> https://github.com/apache/incubator-griffin/blob/master/griffin-doc/docker/griffin-docker-guide.md
>
>
> Thanks & Regards,
> Vikram Jain
>
>
> Sent from Mail for
> Windows 10
>
>

[GitHub] incubator-griffin pull request #394: set the fields in configuration classes...

[grant-xuexu]

GitHub user grant-xuexu opened a pull request:

https://github.com/apache/incubator-griffin/pull/394

set the fields in configuration classes private

in configuration case classes, get*** functions are defined to access to 
the fields, so for consistency, make the fields private 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/grant-xuexu/incubator-griffin 
feature/configuration

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-griffin/pull/394.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #394


commit 86cd21dd4ea02bed52cf37a5d5b3ff33cda0ecf0
Author: Grant Xuexu 
Date:   2018-07-18T13:27:46Z

replace Manifest with ClassTag

commit 67a3e05bbeb96abec6e99746b2eb4aede5f19957
Author: Grant <39704702+grant-xuexu@...>
Date:   2018-07-18T13:29:48Z

Merge pull request #1 from 
grant-xuexu/feature/replace-manifest-with-classtag

replace Manifest with ClassTag

commit 301dc599d6a6d6f713d5fbecb772f2a8376f7f24
Author: Grant Xuexu 
Date:   2018-07-18T13:40:52Z

sync with griffin/master

commit 13e47f8509806e27a024b758c5bf4f23d49285a7
Author: grant-xuexu 
Date:   2018-08-13T01:42:44Z

set the fields in configuration classes private




---