Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread benjobs
Hi Justin,

> How will the existing web site and domain be managed?

1) this website projects will be donated to apache, it has been stated that
in Proposal [1]
2)  I applied for this domain, and I manage and control it, Currently used
to provide official websites and documents, I will cooperate with all
handover procedures
3)  When the project is donated, the website will be planned to go offline,
and will not be provided as the official website and documentation of
StreamPark


[1]
https://cwiki.apache.org/confluence/display/INCUBATOR/StreamPark+Proposal#git-repositories

Best,
benjobs.


Justin Mclean  于2022年8月26日周五 07:22写道:

> HI,
>
> How will the existing web site and domain be managed? [1]
>
> Kind Regards,
> Justin
>
> 1. http://www.streamxhub.com
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Justin Mclean
HI,

How will the existing web site and domain be managed? [1]

Kind Regards,
Justin

1. http://www.streamxhub.com

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread benjobs
Hi Justin,

we already know that some category-X class dependencies in StreamPark has
risk. We had create an issue[1] to track this.
and category-X dependencies list have been updated in Proposal [2],

this issue planned to be solved in future releases, until the requirements
are fully met.


[1] https://github.com/streamxhub/streampark/issues/1447
[2]
https://cwiki.apache.org/confluence/display/INCUBATOR/StreamPark+Proposal#external-dependencies


Best,
benjobs.

Justin Mclean  于2022年8月25日周四 19:12写道:

> HI,
>
> To be clear, this doesn’t need to be solved right now, but the project
> needs a plan to resolve these issues. i.e. replace the dependencies or some
> other action. What is decided may also impact your first ASF release and
> how long it takes to do that.
>
> Kind Regards,
> Justin
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Justin Mclean
HI,

To be clear, this doesn’t need to be solved right now, but the project needs a 
plan to resolve these issues. i.e. replace the dependencies or some other 
action. What is decided may also impact your first ASF release and how long it 
takes to do that.

Kind Regards,
Justin
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Cheng Pan
> Please note that Cheng Pan's comment is their own question, which isn't
> associated with StreamPark's situation.

@tison, I just make the mysql connector license issue clear, it helps the
StreamPark team to make decisions about how to resolve the issue.

> 1) in kafka connector of streampark spark module, MySQL use to store kafka
> offsets. The connector also provides HBase, Redis for users to choose.
> MySQL is an optional dependency.

it's case 2

> 2. some optional functionalities of the project require
> mysql-connector, w/o mysql-connector, the project still works.


> 2) in streampark platform module, MySQL use to store backend metadata .
> Currently, planning to remove the mysql-connector dependency, Issues[1]
> have been created on github, It is planned to be completed within the next
> month

it's case 1 (IMO)

> 1. the project hardly depends on mysql-connector, w/o mysql-connector,
> the project can not work totally.

And I don't know why you think it's not StreamPark's situation.

Thanks,
Cheng Pan

On Thu, Aug 25, 2022 at 5:16 PM Justin Mclean  wrote:
>
> Hi,
>
> > As @benjobs replied in
> > https://lists.apache.org/thread/ql5k7j72p2s6hrw6clgpbwp4kmznj1b8, is the
> > category X issue resolved? I can see that MySQL isn't a hard dependency to
> > deliver the platform.
>
> No it has not, just because it’s not a hard dependancy doesn’t resolve the 
> issue. And also there are other Category X license dependancies.
>
> Kind Regards,
> Justin
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Justin Mclean
Hi,

> As @benjobs replied in
> https://lists.apache.org/thread/ql5k7j72p2s6hrw6clgpbwp4kmznj1b8, is the
> category X issue resolved? I can see that MySQL isn't a hard dependency to
> deliver the platform.

No it has not, just because it’s not a hard dependancy doesn’t resolve the 
issue. And also there are other Category X license dependancies.

Kind Regards,
Justin
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread tison
> How about simply changing to Postgres?

There is an ongoing issue as mentioned above
https://github.com/streamxhub/streampark/issues/1447.

@Cheng Pan
If you'd like to discuss more on dependencies policy, you can start a
dedicated thread.

@Justin & @Calvin
Please note that Cheng Pan's comment is their own question, which isn't
associated with StreamPark's situation.

As @benjobs replied in
https://lists.apache.org/thread/ql5k7j72p2s6hrw6clgpbwp4kmznj1b8, is the
category X issue resolved? I can see that MySQL isn't a hard dependency to
deliver the platform.


Best,
tison.


Christofer Dutz  于2022年8月25日周四 16:40写道:

> How about simply changing to Postgres?
> I wouldn't expect StreamPark to depend on some MySQL special features.
> Simply changing to Postgres should probably resolve the problem, right?
>
> Chris
>
> On 25.08.22, 08:43, "Calvin Kirs"  wrote:
>
> Yes, this is consistent with what Justin said. If he is optional, then
> OK. I misunderstood what you meant by 1 :(
> But if the software does not work without mysql, even if you remove it
> (mysql) when you distribute it, and then leave it to users to add it
> themselves.
> that's not okay either
>
> Cheng Pan  于2022年8月25日周四 14:33写道:
> >
> > > 1. the project hardly depends on mysql-connector, w/o
> mysql-connector,
> > > the project can not work totally.
> > > 2. some optional functionalities of the project require
> > > mysql-connector, w/o mysql-connector, the project still works.
> > > 3. the project use mysql-connector for testing-only purpose,
> > > mysql-connector is not required in runtime at all, e.g. the project
> > > implements MySQL transport protocol, it uses mysql-connector for
> > > testing to ensure compatibility.
> >
> > Thanks Calvin, from my understanding of [1], 2 and 3 are allowed,
> but 1 is not.
> >
> > [1] https://apache.org/legal/resolved.html#optional
> >
> > Thanks,
> > Cheng Pan
> >
> > On Thu, Aug 25, 2022 at 2:04 PM tison  wrote:
> > >
> > > Hi JB,
> > >
> > > With Beam: Beam provides a unified programming model (dataflow),
> while
> > > StreamPark is a platform to package, deploy and operate streaming
> > > applications.
> > >
> > > I'm not quite familiar with Wayang and NiFi, though.
> > >
> > > Best,
> > > tison.
> > >
> > >
> > > Jean-Baptiste Onofré  于2022年8月25日周四 13:26写道:
> > >
> > > > Hi,
> > > >
> > > > Interesting proposal. How do you compare StreamPark with Apache
> Beam,
> > > > Wayang, NiFI ?
> > > >
> > > > Thanks
> > > >
> > > > Regards
> > > > JB
> > > >
> > > > On Wed, Aug 17, 2022 at 3:13 AM tison 
> wrote:
> > > > >
> > > > > Hi all,
> > > > >
> > > > > I would like to propose StreamPark[1] as a new apache
> incubator project,
> > > > > you can find the proposal[2] of StreamPark for more detail.
> > > > >
> > > > > StreamPark is a streaming application development platform.
> Aimed at ease
> > > > > building and managing streaming applications, StreamPark
> provides
> > > > > scaffolding for writing streaming process logic with Apache
> Flink and
> > > > > Apache Spark. Also, StreamPark provides a dashboard for
> controlling and
> > > > > monitoring streaming tasks. It was initially known as StreamX
> and renamed
> > > > > to StreamPark in August 2022.
> > > > >
> > > > > StreamPark abstracts the environment and program parameters of
> task
> > > > > development and deployment in a convention over configuration
> manner for
> > > > > low code development. It initializes a runtime environment and
> context
> > > > and
> > > > > combines it with a series of connectors to simplify
> development. From the
> > > > > aspect of a task management platform, StreamPark is a
> streaming data
> > > > > management platform based on the JVM platform.
> > > > >
> > > > > So far, StreamPark has accumulated a few users, and the
> accrued download
> > > > > time is over 5,000. The representative users are Baidu, China
> Unicom,
> > > > > Ziroom, Yonghui Supermarket, InMobi, YTO Express, and so on.
> StreamPark
> > > > has
> > > > > built an open-source community with 52 developers and released
> over ten
> > > > > versions in the past year.
> > > > >
> > > > > The proposed initial committers are interested in joining ASF
> to increase
> > > > > the connections in the open-source world. Based on extensive
> > > > collaboration,
> > > > > it is possible to build a community of developers and
> committers that
> > > > live
> > > > > longer than the founder. Also, the Apache Brand can help
> encourage more
> > > > > organizations to use StreamPark more confidently.
> > > > >
> > > > > We believe that the StreamPark project will provide diversity
> value for
> > > > the
> 

Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Christofer Dutz
How about simply changing to Postgres?
I wouldn't expect StreamPark to depend on some MySQL special features.
Simply changing to Postgres should probably resolve the problem, right?

Chris

On 25.08.22, 08:43, "Calvin Kirs"  wrote:

Yes, this is consistent with what Justin said. If he is optional, then
OK. I misunderstood what you meant by 1 :(
But if the software does not work without mysql, even if you remove it
(mysql) when you distribute it, and then leave it to users to add it
themselves.
that's not okay either

Cheng Pan  于2022年8月25日周四 14:33写道:
>
> > 1. the project hardly depends on mysql-connector, w/o mysql-connector,
> > the project can not work totally.
> > 2. some optional functionalities of the project require
> > mysql-connector, w/o mysql-connector, the project still works.
> > 3. the project use mysql-connector for testing-only purpose,
> > mysql-connector is not required in runtime at all, e.g. the project
> > implements MySQL transport protocol, it uses mysql-connector for
> > testing to ensure compatibility.
>
> Thanks Calvin, from my understanding of [1], 2 and 3 are allowed, but 1 
is not.
>
> [1] https://apache.org/legal/resolved.html#optional
>
> Thanks,
> Cheng Pan
>
> On Thu, Aug 25, 2022 at 2:04 PM tison  wrote:
> >
> > Hi JB,
> >
> > With Beam: Beam provides a unified programming model (dataflow), while
> > StreamPark is a platform to package, deploy and operate streaming
> > applications.
> >
> > I'm not quite familiar with Wayang and NiFi, though.
> >
> > Best,
> > tison.
> >
> >
> > Jean-Baptiste Onofré  于2022年8月25日周四 13:26写道:
> >
> > > Hi,
> > >
> > > Interesting proposal. How do you compare StreamPark with Apache Beam,
> > > Wayang, NiFI ?
> > >
> > > Thanks
> > >
> > > Regards
> > > JB
> > >
> > > On Wed, Aug 17, 2022 at 3:13 AM tison  wrote:
> > > >
> > > > Hi all,
> > > >
> > > > I would like to propose StreamPark[1] as a new apache incubator 
project,
> > > > you can find the proposal[2] of StreamPark for more detail.
> > > >
> > > > StreamPark is a streaming application development platform. Aimed 
at ease
> > > > building and managing streaming applications, StreamPark provides
> > > > scaffolding for writing streaming process logic with Apache Flink 
and
> > > > Apache Spark. Also, StreamPark provides a dashboard for controlling 
and
> > > > monitoring streaming tasks. It was initially known as StreamX and 
renamed
> > > > to StreamPark in August 2022.
> > > >
> > > > StreamPark abstracts the environment and program parameters of task
> > > > development and deployment in a convention over configuration 
manner for
> > > > low code development. It initializes a runtime environment and 
context
> > > and
> > > > combines it with a series of connectors to simplify development. 
From the
> > > > aspect of a task management platform, StreamPark is a streaming data
> > > > management platform based on the JVM platform.
> > > >
> > > > So far, StreamPark has accumulated a few users, and the accrued 
download
> > > > time is over 5,000. The representative users are Baidu, China 
Unicom,
> > > > Ziroom, Yonghui Supermarket, InMobi, YTO Express, and so on. 
StreamPark
> > > has
> > > > built an open-source community with 52 developers and released over 
ten
> > > > versions in the past year.
> > > >
> > > > The proposed initial committers are interested in joining ASF to 
increase
> > > > the connections in the open-source world. Based on extensive
> > > collaboration,
> > > > it is possible to build a community of developers and committers 
that
> > > live
> > > > longer than the founder. Also, the Apache Brand can help encourage 
more
> > > > organizations to use StreamPark more confidently.
> > > >
> > > > We believe that the StreamPark project will provide diversity value 
for
> > > the
> > > > community if StreamPark is introduced into the Apache incubator.
> > > >
> > > > I (@tison) will help this project as the champion and many thanks 
to four
> > > > other mentors:
> > > >
> > > > * Willem Ning Jiang [ningji...@apache.org]
> > > > * Stephan Ewen [se...@apache.org]
> > > > * Thomas Weise [t...@apache.org]
> > > > * Duo Zhang [zhang...@apache.org]
> > > >
> > > > Best,
> > > > tison.
> > > >
> > > > [1] https://github.com/streamxhub/streamx
> > > > [2]
> > > >
> > > 
https://cwiki.apache.org/confluence/display/INCUBATOR/StreamPark+Proposal
> > >
> > > -
> > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > > For additional commands, e-mail: 

Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Cheng Pan
Thanks for the clarification.

Thanks,
Cheng Pan

On Thu, Aug 25, 2022 at 4:27 PM Justin Mclean  wrote:
>
> Hi,
>
> > 1. the project hardly depends on mysql-connector, w/o mysql-connector,
> > the project can not work totally.
>
> This would not be allowed (IMO).
>
> > 2. some optional functionalities of the project require
> > mysql-connector, w/o mysql-connector, the project still works.
>
> This might be OK, but would not be if the majority of users used the 
> mysql-connector.
>
> > 3. the project use mysql-connector for testing-only purpose,
> > mysql-connector is not required in runtime at all, e.g. the project
> > implements MySQL transport protocol, it uses mysql-connector for
> > testing to ensure compatibility.
>
> This is likely to be treated as optional, so would be allowed.
>
> Kind Regards,
> Justin
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Justin Mclean
Hi,

> 1. the project hardly depends on mysql-connector, w/o mysql-connector,
> the project can not work totally.

This would not be allowed (IMO).

> 2. some optional functionalities of the project require
> mysql-connector, w/o mysql-connector, the project still works.

This might be OK, but would not be if the majority of users used the 
mysql-connector.

> 3. the project use mysql-connector for testing-only purpose,
> mysql-connector is not required in runtime at all, e.g. the project
> implements MySQL transport protocol, it uses mysql-connector for
> testing to ensure compatibility.

This is likely to be treated as optional, so would be allowed.

Kind Regards,
Justin
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Justin Mclean
Hi,

> I would like to learn why mysql-connector is not compatible with the Apache 
> license? 

Short version it’s GPL and the “FOSS exception”  license is no longer valid. 
Even it it was it (from my reading) it places a restriction on software that it 
can only be used with open source software. It seems to be a weak copy left 
style license and that would be a restriction on top of what the Apache license 
allows. The Apache license allows non open source software to use Apache 
licensed software.

It is also not in Apache's Category A,B or X lists.[1]  you’ll need to ask 
legal-discuss to take a look at it and determine if it is allowed or not. Note 
that Category X includes GPL with special exceptions.

Kind Regards,
Justin

1. https://apache.org/legal/resolved.html


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Calvin Kirs
Yes, this is consistent with what Justin said. If he is optional, then
OK. I misunderstood what you meant by 1 :(
But if the software does not work without mysql, even if you remove it
(mysql) when you distribute it, and then leave it to users to add it
themselves.
that's not okay either

Cheng Pan  于2022年8月25日周四 14:33写道:
>
> > 1. the project hardly depends on mysql-connector, w/o mysql-connector,
> > the project can not work totally.
> > 2. some optional functionalities of the project require
> > mysql-connector, w/o mysql-connector, the project still works.
> > 3. the project use mysql-connector for testing-only purpose,
> > mysql-connector is not required in runtime at all, e.g. the project
> > implements MySQL transport protocol, it uses mysql-connector for
> > testing to ensure compatibility.
>
> Thanks Calvin, from my understanding of [1], 2 and 3 are allowed, but 1 is 
> not.
>
> [1] https://apache.org/legal/resolved.html#optional
>
> Thanks,
> Cheng Pan
>
> On Thu, Aug 25, 2022 at 2:04 PM tison  wrote:
> >
> > Hi JB,
> >
> > With Beam: Beam provides a unified programming model (dataflow), while
> > StreamPark is a platform to package, deploy and operate streaming
> > applications.
> >
> > I'm not quite familiar with Wayang and NiFi, though.
> >
> > Best,
> > tison.
> >
> >
> > Jean-Baptiste Onofré  于2022年8月25日周四 13:26写道:
> >
> > > Hi,
> > >
> > > Interesting proposal. How do you compare StreamPark with Apache Beam,
> > > Wayang, NiFI ?
> > >
> > > Thanks
> > >
> > > Regards
> > > JB
> > >
> > > On Wed, Aug 17, 2022 at 3:13 AM tison  wrote:
> > > >
> > > > Hi all,
> > > >
> > > > I would like to propose StreamPark[1] as a new apache incubator project,
> > > > you can find the proposal[2] of StreamPark for more detail.
> > > >
> > > > StreamPark is a streaming application development platform. Aimed at 
> > > > ease
> > > > building and managing streaming applications, StreamPark provides
> > > > scaffolding for writing streaming process logic with Apache Flink and
> > > > Apache Spark. Also, StreamPark provides a dashboard for controlling and
> > > > monitoring streaming tasks. It was initially known as StreamX and 
> > > > renamed
> > > > to StreamPark in August 2022.
> > > >
> > > > StreamPark abstracts the environment and program parameters of task
> > > > development and deployment in a convention over configuration manner for
> > > > low code development. It initializes a runtime environment and context
> > > and
> > > > combines it with a series of connectors to simplify development. From 
> > > > the
> > > > aspect of a task management platform, StreamPark is a streaming data
> > > > management platform based on the JVM platform.
> > > >
> > > > So far, StreamPark has accumulated a few users, and the accrued download
> > > > time is over 5,000. The representative users are Baidu, China Unicom,
> > > > Ziroom, Yonghui Supermarket, InMobi, YTO Express, and so on. StreamPark
> > > has
> > > > built an open-source community with 52 developers and released over ten
> > > > versions in the past year.
> > > >
> > > > The proposed initial committers are interested in joining ASF to 
> > > > increase
> > > > the connections in the open-source world. Based on extensive
> > > collaboration,
> > > > it is possible to build a community of developers and committers that
> > > live
> > > > longer than the founder. Also, the Apache Brand can help encourage more
> > > > organizations to use StreamPark more confidently.
> > > >
> > > > We believe that the StreamPark project will provide diversity value for
> > > the
> > > > community if StreamPark is introduced into the Apache incubator.
> > > >
> > > > I (@tison) will help this project as the champion and many thanks to 
> > > > four
> > > > other mentors:
> > > >
> > > > * Willem Ning Jiang [ningji...@apache.org]
> > > > * Stephan Ewen [se...@apache.org]
> > > > * Thomas Weise [t...@apache.org]
> > > > * Duo Zhang [zhang...@apache.org]
> > > >
> > > > Best,
> > > > tison.
> > > >
> > > > [1] https://github.com/streamxhub/streamx
> > > > [2]
> > > >
> > > https://cwiki.apache.org/confluence/display/INCUBATOR/StreamPark+Proposal
> > >
> > > -
> > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > > For additional commands, e-mail: general-h...@incubator.apache.org
> > >
> > >
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>


-- 
Best wishes!
CalvinKirs

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Cheng Pan
> 1. the project hardly depends on mysql-connector, w/o mysql-connector,
> the project can not work totally.
> 2. some optional functionalities of the project require
> mysql-connector, w/o mysql-connector, the project still works.
> 3. the project use mysql-connector for testing-only purpose,
> mysql-connector is not required in runtime at all, e.g. the project
> implements MySQL transport protocol, it uses mysql-connector for
> testing to ensure compatibility.

Thanks Calvin, from my understanding of [1], 2 and 3 are allowed, but 1 is not.

[1] https://apache.org/legal/resolved.html#optional

Thanks,
Cheng Pan

On Thu, Aug 25, 2022 at 2:04 PM tison  wrote:
>
> Hi JB,
>
> With Beam: Beam provides a unified programming model (dataflow), while
> StreamPark is a platform to package, deploy and operate streaming
> applications.
>
> I'm not quite familiar with Wayang and NiFi, though.
>
> Best,
> tison.
>
>
> Jean-Baptiste Onofré  于2022年8月25日周四 13:26写道:
>
> > Hi,
> >
> > Interesting proposal. How do you compare StreamPark with Apache Beam,
> > Wayang, NiFI ?
> >
> > Thanks
> >
> > Regards
> > JB
> >
> > On Wed, Aug 17, 2022 at 3:13 AM tison  wrote:
> > >
> > > Hi all,
> > >
> > > I would like to propose StreamPark[1] as a new apache incubator project,
> > > you can find the proposal[2] of StreamPark for more detail.
> > >
> > > StreamPark is a streaming application development platform. Aimed at ease
> > > building and managing streaming applications, StreamPark provides
> > > scaffolding for writing streaming process logic with Apache Flink and
> > > Apache Spark. Also, StreamPark provides a dashboard for controlling and
> > > monitoring streaming tasks. It was initially known as StreamX and renamed
> > > to StreamPark in August 2022.
> > >
> > > StreamPark abstracts the environment and program parameters of task
> > > development and deployment in a convention over configuration manner for
> > > low code development. It initializes a runtime environment and context
> > and
> > > combines it with a series of connectors to simplify development. From the
> > > aspect of a task management platform, StreamPark is a streaming data
> > > management platform based on the JVM platform.
> > >
> > > So far, StreamPark has accumulated a few users, and the accrued download
> > > time is over 5,000. The representative users are Baidu, China Unicom,
> > > Ziroom, Yonghui Supermarket, InMobi, YTO Express, and so on. StreamPark
> > has
> > > built an open-source community with 52 developers and released over ten
> > > versions in the past year.
> > >
> > > The proposed initial committers are interested in joining ASF to increase
> > > the connections in the open-source world. Based on extensive
> > collaboration,
> > > it is possible to build a community of developers and committers that
> > live
> > > longer than the founder. Also, the Apache Brand can help encourage more
> > > organizations to use StreamPark more confidently.
> > >
> > > We believe that the StreamPark project will provide diversity value for
> > the
> > > community if StreamPark is introduced into the Apache incubator.
> > >
> > > I (@tison) will help this project as the champion and many thanks to four
> > > other mentors:
> > >
> > > * Willem Ning Jiang [ningji...@apache.org]
> > > * Stephan Ewen [se...@apache.org]
> > > * Thomas Weise [t...@apache.org]
> > > * Duo Zhang [zhang...@apache.org]
> > >
> > > Best,
> > > tison.
> > >
> > > [1] https://github.com/streamxhub/streamx
> > > [2]
> > >
> > https://cwiki.apache.org/confluence/display/INCUBATOR/StreamPark+Proposal
> >
> > -
> > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > For additional commands, e-mail: general-h...@incubator.apache.org
> >
> >

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread tison
Hi JB,

With Beam: Beam provides a unified programming model (dataflow), while
StreamPark is a platform to package, deploy and operate streaming
applications.

I'm not quite familiar with Wayang and NiFi, though.

Best,
tison.


Jean-Baptiste Onofré  于2022年8月25日周四 13:26写道:

> Hi,
>
> Interesting proposal. How do you compare StreamPark with Apache Beam,
> Wayang, NiFI ?
>
> Thanks
>
> Regards
> JB
>
> On Wed, Aug 17, 2022 at 3:13 AM tison  wrote:
> >
> > Hi all,
> >
> > I would like to propose StreamPark[1] as a new apache incubator project,
> > you can find the proposal[2] of StreamPark for more detail.
> >
> > StreamPark is a streaming application development platform. Aimed at ease
> > building and managing streaming applications, StreamPark provides
> > scaffolding for writing streaming process logic with Apache Flink and
> > Apache Spark. Also, StreamPark provides a dashboard for controlling and
> > monitoring streaming tasks. It was initially known as StreamX and renamed
> > to StreamPark in August 2022.
> >
> > StreamPark abstracts the environment and program parameters of task
> > development and deployment in a convention over configuration manner for
> > low code development. It initializes a runtime environment and context
> and
> > combines it with a series of connectors to simplify development. From the
> > aspect of a task management platform, StreamPark is a streaming data
> > management platform based on the JVM platform.
> >
> > So far, StreamPark has accumulated a few users, and the accrued download
> > time is over 5,000. The representative users are Baidu, China Unicom,
> > Ziroom, Yonghui Supermarket, InMobi, YTO Express, and so on. StreamPark
> has
> > built an open-source community with 52 developers and released over ten
> > versions in the past year.
> >
> > The proposed initial committers are interested in joining ASF to increase
> > the connections in the open-source world. Based on extensive
> collaboration,
> > it is possible to build a community of developers and committers that
> live
> > longer than the founder. Also, the Apache Brand can help encourage more
> > organizations to use StreamPark more confidently.
> >
> > We believe that the StreamPark project will provide diversity value for
> the
> > community if StreamPark is introduced into the Apache incubator.
> >
> > I (@tison) will help this project as the champion and many thanks to four
> > other mentors:
> >
> > * Willem Ning Jiang [ningji...@apache.org]
> > * Stephan Ewen [se...@apache.org]
> > * Thomas Weise [t...@apache.org]
> > * Duo Zhang [zhang...@apache.org]
> >
> > Best,
> > tison.
> >
> > [1] https://github.com/streamxhub/streamx
> > [2]
> >
> https://cwiki.apache.org/confluence/display/INCUBATOR/StreamPark+Proposal
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: [DISCUSS] Incubating Proposal for StreamPark

2022-08-25 Thread Calvin Kirs
Cheng Pan  于2022年8月25日周四 13:31写道:
>
> Hi Justin,
>
> > The issue is not if it in the release package or not, it cannot be a 
> > dependency.
>
> Could you please elaborate more about "dependency"? I can imagine the
> following use cases:
>
> 1. the project hardly depends on mysql-connector, w/o mysql-connector,
> the project can not work totally.
> 2. some optional functionalities of the project require
> mysql-connector, w/o mysql-connector, the project still works.
> 3. the project use mysql-connector for testing-only purpose,
> mysql-connector is not required in runtime at all, e.g. the project
> implements MySQL transport protocol, it uses mysql-connector for
> testing to ensure compatibility.
>
> Are the above use cases allowed/forbidden by the apache project?

Yes. You could have. for more details, you can refer to [1].

[1] https://apache.org/legal/resolved.html#optional

>
> Thanks,
> Cheng Pan
>
> On Thu, Aug 25, 2022 at 12:18 PM benjobs  wrote:
> >
> > Hi Justin,
> >
> > Add Usage of MySQL:
> >
> > 1) in kafka connector of streampark spark module, MySQL use to store kafka
> > offsets. The connector also provides HBase, Redis for users to choose.
> > MySQL is an optional dependency.
> >
> > 2) in streampark platform module, MySQL use to store backend metadata .
> > Currently, planning to remove the mysql-connector dependency, Issues[1]
> > have been created on github, It is planned to be completed within the next
> > month
> >
> > Also we're working on issue of Category X license dependancies.
> >
> > [1] https://github.com/streamxhub/streampark/issues/1447
> >
> > Justin Mclean  于2022年8月25日周四 10:42写道:
> >
> > > Hi,
> > >
> > > > Thanks for your feedback! I checked all modules of the project and
> > > > reconfirmed it again, the maven scope of mysql-connector is "provided" 
> > > > or
> > > > "test", and will not be provided in the release package,
> > >
> > > The issue is not if it in the release package or not, it cannot be a
> > > dependancy. Now if you have a plan to remove it as a dependancy then that
> > > is fine, but a project would be unlikely to graduate from the incubator
> > > with a dependancy like this.
> > >
> > > Also this is not the only bit of software with a Category X license in
> > > your dependancy list. How are those going to be handled?
> > >
> > > Kind Regards,
> > > Justin
> > > -
> > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > > For additional commands, e-mail: general-h...@incubator.apache.org
> > >
> > >
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>


-- 
Best wishes!
CalvinKirs

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org