Re: [DISCUSS] about extend jackson

2018-08-14 Thread wjm wjm
1.fork jackson-dataformats-binary to https://github.com/huaweicse
2.PR from huaweicse to jackson
3.deploy a special version jackson-dataformat-protobuf from huaweicse to
huawei cse maven repository
4.before our features set be stable, we will
depend jackson-dataformat-protobuf from huawei cse maven repository
   after be stable, we will depend on official
jackson-dataformat-protobuf directly

2018-08-15 8:51 GMT+08:00 Willem Jiang :

> PMC means the ServiceComb PPMC, not the Jackson PMC.
> So please share your plan and modification with us, and we will find out
> the best way then.
>
>
> Willem Jiang
>
> Twitter: willemjiang
> Weibo: 姜宁willem
>
> On Wed, Aug 15, 2018 at 8:37 AM, wjm wjm  wrote:
>
> > seems that:
> > 1.base code not change license
> > 2.new class "  should be dealt with on a case-by-case basis by the PMC ",
> > the PMC is jackson PMC or us?
> >
> > 2018-08-15 8:33 GMT+08:00 Willem Jiang :
> >
> > > If we write the code from scratch, we should apply the ASF license
> > header.
> > >
> > > If there are third party code was add to the repo, we need to keep the
> > old
> > > license header.
> > > Please go through this document[1] for more information.
> > >
> > > [1] https://www.apache.org/legal/src-headers.html#3party
> > >
> > >
> > > Willem Jiang
> > >
> > > Twitter: willemjiang
> > > Weibo: 姜宁willem
> > >
> > > On Wed, Aug 15, 2018 at 8:27 AM, wjm wjm  wrote:
> > >
> > > > if create a module in our repo, then how to process the license?
> > > > follow jackson or us?
> > > > is it different between base code and new code.
> > > >
> > > > 2018-08-15 6:06 GMT+08:00 Willem Jiang :
> > > >
> > > > > The best way is we send the PR jackson master branch, it can
> benefit
> > > all
> > > > of
> > > > > us.
> > > > >
> > > > > It depends on the release time schedule. If we cannot wait for the
> > > > release
> > > > > of jackson, we may have to create a module in our repo. And we
> change
> > > to
> > > > > use the jackson once the change is merged.
> > > > >
> > > > > Is there any other reason to hold us back for upgrading the jackson
> > > > > version?
> > > > >
> > > > >
> > > > >
> > > > > Willem Jiang
> > > > >
> > > > > Twitter: willemjiang
> > > > > Weibo: 姜宁willem
> > > > >
> > > > > On Wed, Aug 15, 2018 at 4:06 AM, wjm wjm  wrote:
> > > > >
> > > > > > another information:
> > > > > > jackson master version is 3.x
> > > > > > modification for 2.9.6 is different to 3.x, many jackson base
> class
> > > > > changed
> > > > > >
> > > > > > 2018-08-15 2:33 GMT+08:00 wjm wjm :
> > > > > >
> > > > > > > i had already extend jackson protobuf to support protobuf3 map
> > > > feature.
> > > > > > >
> > > > > > > based on jackson 2.9.6, because we are using 2.9.6
> > > > > > > but jackson 2.9.6 already released.
> > > > > > > even i raise a PR for this and jackson will merge it, we can
> not
> > > use
> > > > it
> > > > > > > directly or must wait for next release.
> > > > > > >
> > > > > > > but we must start new task based on this feature right now.
> > > > > > >
> > > > > > > so how to resolve the confliction?
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>


Re: Support dotnet sniffer for incubator-servicecomb-saga

2018-08-14 Thread Willem Jiang
Hi Lin

I pinged Skywalking guy, they have a separated git group which is not part
of Apache to host the agent code.
Can you share the status of the porting with us in the mailing list?


Willem Jiang

Twitter: willemjiang
Weibo: 姜宁willem

On Sat, Aug 4, 2018 at 12:00 AM, With Lin  wrote:

> ok, wait for your good news.
>
> 2018-08-03 22:42 GMT+08:00 Willem Jiang :
>
> > I think you can start it as your personal project, then we can go through
> > with donate process.
> > I will ping skywalking this weekend to see if they have some other better
> > idea about it.
> >
> >
> >
> > Willem Jiang
> >
> > Twitter: willemjiang
> > Weibo: 姜宁willem
> >
> > On Fri, Aug 3, 2018 at 9:47 PM, WithLin <1393151...@qq.com> wrote:
> >
> > > Hi,
> > > How should I contribute to this repository(incubator-
> servicecomb-saga)?
> > I
> > > directly fork this repository, or create an organization?
> > >
> > >
> > >
> > >
> > > -- 原始邮件 --
> > > 发件人: "Willem Jiang";
> > > 发送时间: 2018年8月3日(星期五) 晚上9:23
> > > 收件人: "dev";
> > > 主题: Re: Support dotnet sniffer for incubator-servicecomb-saga
> > >
> > >
> > >
> > > Hi Lin,
> > >
> > > It's great that you provide a .net version of Omega.
> > > In this way, the .net programer can leverage AlphaServer to do the
> > > coordinate work.
> > >
> > > I think you may need to start the work in your repo first (as current
> > saga
> > > repo only for java project), then you can decide if you want to donate
> it
> > > to ServiceComb.
> > >
> > >
> > >
> > > Willem Jiang
> > >
> > > Twitter: willemjiang
> > > Weibo: 姜宁willem
> > >
> > > On Fri, Aug 3, 2018 at 5:00 PM, WithLin <1393151...@qq.com> wrote:
> > >
> > > > Hi,
> > > >just like an agent, abstracted into alpha and omega, omega is like
> > an
> > > > agent, so we make multi-language omega, such as java and net, use
> grpc
> > > and
> > > > alpha to interact.
> > > >
> > > >
> > > > -- 原始邮件 --
> > > > 发件人: "Zheng Feng";
> > > > 发送时间: 2018年8月3日(星期五) 下午4:03
> > > > 收件人: "dev";
> > > >
> > > > 主题: Re: Support dotnet sniffer for incubator-servicecomb-saga
> > > >
> > > >
> > > >
> > > > Hi,
> > > >
> > > > what is the sniffer ? is it running like an agent to delegate the
> sage
> > > > events to communicate with the coordinator ?
> > > >
> > > > Thanks,
> > > > Amos
> > > >
> > > > 2018-08-03 15:39 GMT+08:00 WithLin <1393151...@qq.com>:
> > > >
> > > > > I want to provide a dotnet sniffer, do you have any good ideas?
> > > >
> > >
> >
>


Re: [DISCUSS] about extend jackson

2018-08-14 Thread Willem Jiang
PMC means the ServiceComb PPMC, not the Jackson PMC.
So please share your plan and modification with us, and we will find out
the best way then.


Willem Jiang

Twitter: willemjiang
Weibo: 姜宁willem

On Wed, Aug 15, 2018 at 8:37 AM, wjm wjm  wrote:

> seems that:
> 1.base code not change license
> 2.new class "  should be dealt with on a case-by-case basis by the PMC ",
> the PMC is jackson PMC or us?
>
> 2018-08-15 8:33 GMT+08:00 Willem Jiang :
>
> > If we write the code from scratch, we should apply the ASF license
> header.
> >
> > If there are third party code was add to the repo, we need to keep the
> old
> > license header.
> > Please go through this document[1] for more information.
> >
> > [1] https://www.apache.org/legal/src-headers.html#3party
> >
> >
> > Willem Jiang
> >
> > Twitter: willemjiang
> > Weibo: 姜宁willem
> >
> > On Wed, Aug 15, 2018 at 8:27 AM, wjm wjm  wrote:
> >
> > > if create a module in our repo, then how to process the license?
> > > follow jackson or us?
> > > is it different between base code and new code.
> > >
> > > 2018-08-15 6:06 GMT+08:00 Willem Jiang :
> > >
> > > > The best way is we send the PR jackson master branch, it can benefit
> > all
> > > of
> > > > us.
> > > >
> > > > It depends on the release time schedule. If we cannot wait for the
> > > release
> > > > of jackson, we may have to create a module in our repo. And we change
> > to
> > > > use the jackson once the change is merged.
> > > >
> > > > Is there any other reason to hold us back for upgrading the jackson
> > > > version?
> > > >
> > > >
> > > >
> > > > Willem Jiang
> > > >
> > > > Twitter: willemjiang
> > > > Weibo: 姜宁willem
> > > >
> > > > On Wed, Aug 15, 2018 at 4:06 AM, wjm wjm  wrote:
> > > >
> > > > > another information:
> > > > > jackson master version is 3.x
> > > > > modification for 2.9.6 is different to 3.x, many jackson base class
> > > > changed
> > > > >
> > > > > 2018-08-15 2:33 GMT+08:00 wjm wjm :
> > > > >
> > > > > > i had already extend jackson protobuf to support protobuf3 map
> > > feature.
> > > > > >
> > > > > > based on jackson 2.9.6, because we are using 2.9.6
> > > > > > but jackson 2.9.6 already released.
> > > > > > even i raise a PR for this and jackson will merge it, we can not
> > use
> > > it
> > > > > > directly or must wait for next release.
> > > > > >
> > > > > > but we must start new task based on this feature right now.
> > > > > >
> > > > > > so how to resolve the confliction?
> > > > > >
> > > > >
> > > >
> > >
> >
>


Performance tuning of ServiceComb Saga Pack

2018-08-14 Thread Willem Jiang
Hi,

With the help of JuZheng[1][2], we managed to deploy the saga-spring-demo
into K8s and start the Jmeter tests for it. By running the test for a
while, the DB CPU usage is very high and the response time is up 2~3
seconds per call.

It looks like all the event are stored into the database in the same table
and never cleaned.
Now we are thinking use redis to store the hot data (the saga transaction
which is not closed), and put the cold data (which is used for auditing)
into database.  In this way it could keep the event data smaller and the
event sanner[4] can just go through the unfinished the Saga transactions to
fire the timeout event or the compensation event.

Any thought?

[1]https://github.com/apache/incubator-servicecomb-saga/pull/250
[2]https://github.com/apache/incubator-servicecomb-saga/pull/252
[3]
https://github.com/apache/incubator-servicecomb-saga/tree/master/saga-demo/saga-spring-demo
[4]
https://github.com/apache/incubator-servicecomb-saga/blob/44491f1dcbb9353792cb44d0be60946e0e4d7a1a/alpha/alpha-core/src/main/java/org/apache/servicecomb/saga/alpha/core/EventScanner.java

Willem Jiang

Twitter: willemjiang
Weibo: 姜宁willem


Re: [DISCUSS] about extend jackson

2018-08-14 Thread Willem Jiang
If we write the code from scratch, we should apply the ASF license header.

If there are third party code was add to the repo, we need to keep the old
license header.
Please go through this document[1] for more information.

[1] https://www.apache.org/legal/src-headers.html#3party


Willem Jiang

Twitter: willemjiang
Weibo: 姜宁willem

On Wed, Aug 15, 2018 at 8:27 AM, wjm wjm  wrote:

> if create a module in our repo, then how to process the license?
> follow jackson or us?
> is it different between base code and new code.
>
> 2018-08-15 6:06 GMT+08:00 Willem Jiang :
>
> > The best way is we send the PR jackson master branch, it can benefit all
> of
> > us.
> >
> > It depends on the release time schedule. If we cannot wait for the
> release
> > of jackson, we may have to create a module in our repo. And we change to
> > use the jackson once the change is merged.
> >
> > Is there any other reason to hold us back for upgrading the jackson
> > version?
> >
> >
> >
> > Willem Jiang
> >
> > Twitter: willemjiang
> > Weibo: 姜宁willem
> >
> > On Wed, Aug 15, 2018 at 4:06 AM, wjm wjm  wrote:
> >
> > > another information:
> > > jackson master version is 3.x
> > > modification for 2.9.6 is different to 3.x, many jackson base class
> > changed
> > >
> > > 2018-08-15 2:33 GMT+08:00 wjm wjm :
> > >
> > > > i had already extend jackson protobuf to support protobuf3 map
> feature.
> > > >
> > > > based on jackson 2.9.6, because we are using 2.9.6
> > > > but jackson 2.9.6 already released.
> > > > even i raise a PR for this and jackson will merge it, we can not use
> it
> > > > directly or must wait for next release.
> > > >
> > > > but we must start new task based on this feature right now.
> > > >
> > > > so how to resolve the confliction?
> > > >
> > >
> >
>


Re: [DISCUSS] about extend jackson

2018-08-14 Thread wjm wjm
if create a module in our repo, then how to process the license?
follow jackson or us?
is it different between base code and new code.

2018-08-15 6:06 GMT+08:00 Willem Jiang :

> The best way is we send the PR jackson master branch, it can benefit all of
> us.
>
> It depends on the release time schedule. If we cannot wait for the release
> of jackson, we may have to create a module in our repo. And we change to
> use the jackson once the change is merged.
>
> Is there any other reason to hold us back for upgrading the jackson
> version?
>
>
>
> Willem Jiang
>
> Twitter: willemjiang
> Weibo: 姜宁willem
>
> On Wed, Aug 15, 2018 at 4:06 AM, wjm wjm  wrote:
>
> > another information:
> > jackson master version is 3.x
> > modification for 2.9.6 is different to 3.x, many jackson base class
> changed
> >
> > 2018-08-15 2:33 GMT+08:00 wjm wjm :
> >
> > > i had already extend jackson protobuf to support protobuf3 map feature.
> > >
> > > based on jackson 2.9.6, because we are using 2.9.6
> > > but jackson 2.9.6 already released.
> > > even i raise a PR for this and jackson will merge it, we can not use it
> > > directly or must wait for next release.
> > >
> > > but we must start new task based on this feature right now.
> > >
> > > so how to resolve the confliction?
> > >
> >
>


Re: [DISCUSS] about extend jackson

2018-08-14 Thread wjm wjm
another information:
jackson master version is 3.x
modification for 2.9.6 is different to 3.x, many jackson base class changed

2018-08-15 2:33 GMT+08:00 wjm wjm :

> i had already extend jackson protobuf to support protobuf3 map feature.
>
> based on jackson 2.9.6, because we are using 2.9.6
> but jackson 2.9.6 already released.
> even i raise a PR for this and jackson will merge it, we can not use it
> directly or must wait for next release.
>
> but we must start new task based on this feature right now.
>
> so how to resolve the confliction?
>


[DISCUSS] about extend jackson

2018-08-14 Thread wjm wjm
i had already extend jackson protobuf to support protobuf3 map feature.

based on jackson 2.9.6, because we are using 2.9.6
but jackson 2.9.6 already released.
even i raise a PR for this and jackson will merge it, we can not use it
directly or must wait for next release.

but we must start new task based on this feature right now.

so how to resolve the confliction?