Re: [DISCUSS] Proposal for Ignite Extensions as a separate Apache Bahir module
Hi Saikat, It makes sense and it's the Bahir propose to host such extensions. Regards JB On 22/10/2019 02:48, Saikat Maitra wrote: > Hello, > > I am Saikat and I am committer in Apache Ignite project. I am interested in > joining the Apache Bahir community and contribute to following Apache > Ignite Extensions. > > https://apacheignite.readme.io/docs/integrations > > The reason we wanted to contribute our Apache Ignite integration as > separate Extensions is this will help us to manage and maintain separate > lifecycle for Apache Ignite integrations. > > All the integrations will continue to be part of ASF and we will keep > supporting and developing in accordance with ASF vision and practices. Our > inspiration for the move is very similar to as mentioned in Apache Flink. > > https://flink.apache.org/ecosystem.html#third-party-projects > > I would be very grateful if you please review and share your thoughts on > the proposal. > > Warm Regards, > Saikat > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.3.4 (RC1)
+1 (binding) Regards JB On 21/09/2019 15:52, Ted Yu wrote: > +1 > > On Fri, Sep 20, 2019 at 12:37 PM Luciano Resende > wrote: > >> Off course, my +1 >> I know a lot of us are just between travels (returning from ApacheCon) >> but are any other volunteers available to review the release? >> >> On Wed, Sep 11, 2019 at 5:42 PM Luciano Resende >> wrote: >>> >>> Dear community member, >>> >>> Please vote to approve the release of Apache Bahir 2.3.4 (RC1) based on >>> Apache Spark 2.3.4. >>> >>> Tag: v2.3.4-rc1 (716107f420ac3e0afd76e61b74069e551d9a7e15) >>> >>> https://github.com/apache/bahir/tree/v2.3.4-rc1 >>> >>> Release files: >>> >>> https://repository.apache.org/content/repositories/orgapachebahir-1030 >>> >>> Source distribution: >>> >>> https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.4-rc1/ >>> >>> Also, here is a list of changes between v2.3.3 and v2.3.4-rc1 tags, >>> which summarize in updating Apache Spark to 2.3.4 and release build >>> preparation. >>> >>> https://github.com/apache/bahir/compare/v2.3.3...v2.3.4-rc1 >>> >>> The vote is open for at least 72 hours and passes if a majority of at >> least >>> 3 +1 PMC votes are cast. >>> >>> [ ] +1 Release this package as Apache Bahir 2.3.4 >>> [ ] -1 Do not release this package because ... >>> >>> >>> Thanks for your vote! >>> >>> -- >>> Luciano Resende >>> http://twitter.com/lresende1975 >>> http://lresende.blogspot.com/ >> >> >> >> -- >> Luciano Resende >> http://twitter.com/lresende1975 >> http://lresende.blogspot.com/ >> > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.3.3 (RC1)
+1 (binding) Regards JB On 19/05/2019 18:15, Luciano Resende wrote: > Dear community member, > > Please vote to approve the release of Apache Bahir 2.3.3 (RC1) based on > Apache Spark 2.3.3. > > Tag: v2.3.3-rc1 (e29034cad9bec11da1b81324b1f67118772861d2) > > https://github.com/apache/bahir/tree/v2.3.3-rc1 > > Release files: > > https://repository.apache.org/content/repositories/orgapachebahir-1029 > > Source distribution: > > https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.3-rc1/ > > > The vote is open for at least 72 hours and passes if a majority of at least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Bahir 2.3.3 > [ ] -1 Do not release this package because ... > > > Thanks for your vote! > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
[PROPOSAL] Move to gitbox.apache.org
Hi all, our repositories are currently located on git-wip-us.apache.org. This service will be decommissioned in the coming months. I propose to move to gitbox.apache.org. I can start a formal vote and if it's OK, I'm volunteer to deal with infra. Thoughts ? Regards JB -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.3.1 (RC1)
+1 (binding) Regards JB On 30/11/2018 17:11, Luciano Resende wrote: > Dear community member, > > Please vote to approve the release of Apache Bahir 2.3.1 (RC1) based on > Apache Spark 2.3.1. > > Tag: v2.3.1-rc1 (6c4d67e0a99bcbbad199b7d1d26f3624491070b4) > > https://github.com/apache/bahir/tree/v2.3.1-rc1 > > Release files: > > https://repository.apache.org/content/repositories/orgapachebahir-1026 > > Source distribution: > > https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.1-rc1/ > > > The vote is open for at least 72 hours and passes if a majority of at least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Bahir 2.3.1 > [ ] -1 Do not release this package because ... > > > Thanks for your vote! > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.3.0 (RC1)
+1 (binding) Regards JB On 30/11/2018 15:43, Luciano Resende wrote: > Dear community member, > > Please vote to approve the release of Apache Bahir 2.3.0 (RC1) based on > Apache Spark 2.3.0. > > Tag: v2.3.0-rc1 (e2d138bd2a927d0ab42e45739d8938eefafca352) > > https://github.com/apache/bahir/tree/v2.3.0-rc1 > > Release files: > > https://repository.apache.org/content/repositories/orgapachebahir-1025 > > Source distribution: > > https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.0-rc1/ > > > The vote is open for at least 72 hours and passes if a majority of at least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Bahir 2.3.0 > [ ] -1 Do not release this package because ... > > > Thanks for your vote! > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.3.2 (RC1)
+1 (binding) Regards JB On 30/11/2018 21:57, Luciano Resende wrote: > Dear community member, > > Please vote to approve the release of Apache Bahir 2.3.2 (RC1) based on > Apache Spark 2.3.2. > > Tag: v2.3.2-rc1 (6d24b270fd713352faf1c93f08f835e39e496489) > > https://github.com/apache/bahir/tree/v2.3.2-rc1 > > Release files: > > https://repository.apache.org/content/repositories/orgapachebahir-1027 > > Source distribution: > > https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.2-rc1/ > > > The vote is open for at least 72 hours and passes if a majority of at least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Bahir 2.3.2 > [ ] -1 Do not release this package because ... > > > Thanks for your vote! > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: Release 2.3.x
Nothing from my side. +1 for the release. Regards JB On 29/11/2018 10:40, Luciano Resende wrote: > I am planning to start working on getting the 2.3.x releases soon, any > jiras or prs that I should wait for ? > > Thanks > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.2.2 (RC1)
+1 (binding) Regards JB On 09/11/2018 15:59, Luciano Resende wrote: > Off course, my +1 > On Wed, Nov 7, 2018 at 6:50 PM Luciano Resende wrote: >> >> Dear community member, >> >> Please vote to approve the release of Apache Bahir 2.2.2 (RC1) based on >> Apache Spark 2.2.2. >> >> Tag: v2.2.2-rc1 (821a8c67c21f4f4ab4a7caa8e2f85a2c396683d4) >> >> https://github.com/apache/bahir/tree/v2.2.2-rc1 >> >> Release files: >> >> https://repository.apache.org/content/repositories/orgapachebahir-1024 >> >> Source distribution: >> >> https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.2.2-rc1/ >> >> >> The vote is open for at least 72 hours and passes if a majority of at least >> 3 +1 PMC votes are cast. >> >> [ ] +1 Release this package as Apache Bahir 2.2.2 >> [ ] -1 Do not release this package because ... >> >> >> Thanks for your vote! >> >> -- >> Luciano Resende >> http://twitter.com/lresende1975 >> http://lresende.blogspot.com/ > > > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.1.3 (RC1)
+1 (binding) Regards JB On 09/11/2018 15:59, Luciano Resende wrote: > Off course, my +1 > > On Wed, Nov 7, 2018 at 5:41 PM Luciano Resende wrote: >> >> Dear community member, >> >> Please vote to approve the release of Apache Bahir 2.1.3 (RC1) based on >> Apache Spark 2.1.3. >> >> Tag: v2.1.3-rc1 (697d222ced91feae2d21cbc0dfa85d18e7f14b92) >> >> https://github.com/apache/bahir/tree/v2.1.3-rc1 >> >> Release files: >> >> https://repository.apache.org/content/repositories/orgapachebahir-1023 >> >> Source distribution: >> >> https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.1.3-rc1/ >> >> >> The vote is open for at least 72 hours and passes if a majority of at least >> 3 +1 PMC votes are cast. >> >> [ ] +1 Release this package as Apache Bahir 2.1.3 >> [ ] -1 Do not release this package because ... >> >> >> Thanks for your vote! >> >> -- >> Luciano Resende >> http://twitter.com/lresende1975 >> http://lresende.blogspot.com/ > > > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.1.2 (RC1)
+1 (binding) Built from tag. LGTM. Regards JB On 01/06/2018 07:13, Luciano Resende wrote: > Dear community member, > > Please vote to approve the release of Apache Bahir 2.1.2 (RC1) based on > Apache Spark 2.1.2. > > Tag: v2.1.2-rc1 (6aa6d19582d86704861cd050d9763e29435ea27a) > > https://github.com/apache/bahir/tree/v2.1.2-rc1 > > Release files: > > https://repository.apache.org/content/repositories/orgapachebahir-1021 > > Source distribution: > > https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.1.2-rc1/ > > > The vote is open for at least 72 hours and passes if a majority of at least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Bahir 2.1.2 > [ ] -1 Do not release this package because ... > > > Thanks for your vote! > -- -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [DISCUSS][bahir-flink] Drop Java 7 support
+1 Regards JB On 09/16/2017 02:58 PM, Ted Yu wrote: +1 on dropping Java 7 support. Original message From: Robert Metzger Date: 9/16/17 2:04 AM (GMT-08:00) To: dev@bahir.apache.org Subject: [DISCUSS][bahir-flink] Drop Java 7 support Hi, In the Flink InfluxDB Sink PR [1], there is a little discussion regarding Java 7 support in bahir-flink. I'm proposing to drop Java 7 support in bahir-flink. As of the upcoming Flink 1.4 release, Flink will also drop Java 7 support. Let me know if somebody has any concerns, otherwise, we'll probably drop the Java7 travis checks in the mentioned PR. Regards, Robert [1] https://github.com/apache/bahir-flink/pull/21 -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.2.0 (RC1)
+1 (binding) Regards JB On Aug 19, 2017, 23:44, at 23:44, Christian Kadner wrote: >+1 (binding) > >unit tests run fine, files and signatures check out okay > >Thanks Luciano! > >~ Christian > > >On Wed, Aug 16, 2017 at 10:17 PM, Luciano Resende wrote: >> Dear community member, >> >> Please vote to approve the release of Apache Bahir 2.2.0 (RC1) based >on >> Apache Spark 2.2.0. >> >> Tag: v2.2.0-rc1 (d927289fdad0e66953606869639fe2f153c37b05) >> >> https://github.com/apache/bahir/tree/v2.2.0-rc1 >> >> Release files: >> >> >https://repository.apache.org/content/repositories/orgapachebahir-1020 >> >> Source distribution: >> >> https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.2.0-rc1/ >> >> >> The vote is open for at least 72 hours and passes if a majority of at >least >> 3 +1 PMC votes are cast. >> >> [ ] +1 Release this package as Apache Bahir 2.2.0 >> [ ] -1 Do not release this package because ... >> >> >> Thanks for your vote! >> >> -- >> Luciano Resende >> http://twitter.com/lresende1975 >> http://lresende.blogspot.com/
Re: Releasing Apache Bahir for Spark 2.2.0
It sounds good to me. Thanks ! Regards JB On 07/26/2017 07:47 PM, Luciano Resende wrote: I am planning to create an RC with Spark 2.2.0 in the next couple days. Any important jiras/pr we should wait before cutting the RC? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.1.1 (RC2)
+1 (binding)
Regards
JB
On Jul 11, 2017, 10:30, at 10:30, Robert Metzger wrote:
>+1 (binding)
>
>- the staging repo looks good
>- src archive looks good (no binaries, no snapshot dependencies)
>- mvn clean install -DskipTests (including rat license check) passed on
>src
>contents
>
>
>
>
>On Fri, Jun 30, 2017 at 4:03 PM, Luciano Resende
>wrote:
>
>> We are still short one vote, any PMC volunteers to review the release
>?
>>
>> On Sat, Jun 17, 2017 at 5:29 PM, Christian Kadner
>
>> wrote:
>>
>> > *+1* (binding)
>> >
>> > The distribution files look good and install build runs
>successfully.
>> >
>> > *Thanks Luciano!*
>> >
>> >
>> > - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
>> >
>> > A few suggestions for future releases:
>> >
>> >
>> > *1)* We may want to enhance the release-build.sh script to update
>the
>> > *library dependencies* in the module *README.md* files the
>> anticipated
>> > release version (not "2.2.0-SNAPSHOT" or "2.1.0-SNAPSHOT").
>> >
>> > Currently none of the README.md files show versions that work,
>i.e.
>> ...
>> >
>> > ./sql-streaming-akka/README.md:
>> >
>> > libraryDependencies += "org.apache.bahir" %%
>> "spark-sql-streaming-akka"
>> > % "2.2.0-SNAPSHOT"
>> >
>> > $ bin/spark-shell --packages
>> > org.apache.bahir:spark-sql-streaming-akka_2.11:2.2.0-SNAPSHOT
>> >
>> > ./sql-streaming-mqtt/README.md:
>> >
>> > libraryDependencies += "org.apache.bahir" %%
>> "spark-sql-streaming-mqtt"
>> > % "2.1.0-SNAPSHOT"
>> >
>> > $ bin/spark-shell --packages
>> > org.apache.bahir:spark-sql-streaming-mqtt_2.11:2.1.0-SNAPSHOT
>> >
>> > ...
>> >
>> >
>> > *2) *There are *new* *deprecation warnings* we may want to address:
>> >
>> >
>> > [WARNING] CloudantStreaming.scala:67: method registerTempTable in
>class
>> > Dataset is deprecated: Use createOrReplaceTempView(viewName)
>instead.
>> > [WARNING] changesDataFrame.registerTempTable("
>> > airportcodemapping")
>> > [WARNING]^
>> > [WARNING] PubsubStreamSuite.scala:106: postfix operator
>milliseconds
>> should
>> > be enabled
>> > [WARNING] eventually(timeout(1 milliseconds), interval(100
>> > milliseconds)) {
>> > [WARNING] ^
>> > [WARNING] PubsubStreamSuite.scala:106: postfix operator
>milliseconds
>> should
>> > be enabled
>> > [WARNING] eventually(timeout(1 milliseconds), interval(100
>> > milliseconds)) {
>> > [WARNING]
>^
>> > [WARNING] PubsubStreamSuite.scala:130: postfix operator
>milliseconds
>> should
>> > be enabled
>> > [WARNING] eventually(timeout(1 milliseconds), interval(100
>> > milliseconds)) {
>> > [WARNING] ^
>> > [WARNING] PubsubStreamSuite.scala:130: postfix operator
>milliseconds
>> should
>> > be enabled
>> > [WARNING] eventually(timeout(1 milliseconds), interval(100
>> > milliseconds)) {
>> > [WARNING]
>^
>> >
>> > ... and some *older* ones ...
>> >
>> > [WARNING] MQTTStreamSourceSuite.scala:57: constructor SQLContext in
>> class
>> > SQLContext is deprecated: Use SparkSession.builder instead
>> > [WARNING] val sqlContext: SQLContext = new SQLContext(sc)
>> > [WARNING] ^
>> > [WARNING] MQTTStreamSourceSuite.scala:128: constructor SQLContext
>in
>> class
>> > SQLContext is deprecated: Use SparkSession.builder instead
>> > [WARNING] val sqlContext: SQLContext = new SQLContext(sc)
>> > [WARNING] ^
>> > [WARNING] MQTTStreamSourceSuite.scala:138: constructor SQLContext
>in
>> class
>> > SQLContext is deprecated: Use SparkSession.builder instead
>> > [WARNING] val sqlContext: SQLContext = new SQLContext(sc)
>> > [WARNING] ^
>> >
>> >
>> > - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
>> >
>> > Best regards,
>> > Christian
>> >
>> >
>> >
>> >
>> > On Thu, Jun 8, 2017 at 8:24 AM, Luciano Resende wrote:
>> >
>> > > Dear community member,
>> > >
>> > > Please vote to approve the release of Apache Bahir 2.1.1 (RC2)
>based on
>> > > Apache Spark 2.1.1.
>> > >
>> > > New Extensions:
>> > > * CounchDB/Cloudant
>> > > * Google Pub/Sub
>> > >
>> > > Tag: v2.1.1-rc2 (26bdee0bacb9c922abda09314036e9df0e97d88f)
>> > >
>> > > https://github.com/apache/bahir/tree/v2.1.1-rc2
>> > >
>> > > Release files:
>> > >
>> > >
>https://repository.apache.org/content/repositories/orgapachebahir-1019
>> > >
>> > > Source distribution:
>> > >
>> > >
>https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.1.1-rc2/
>> > >
Re: [VOTE] Apache Bahir Flink extensions 1.0 (RC5)
+1 (binding) Regards JB On May 17, 2017, 16:12, at 16:12, Luciano Resende wrote: >Please vote to approve the release of the following candidate as Apache >Bahir Flink extensions 1.0 based on Apache Flink 1.2.0. > >The tag to be voted on is v1.0-rc4 >(9350cb5f2871df2b2e03f33c5fa1239ca044505a) > >https://github.com/apache/ >bahir-flink/commit/9350cb5f2871df2b2e03f33c5fa1239ca044505a > >The release files, including signatures, digests, etc. can be found at: > >https://repository.apache.org/content/repositories/orgapachebahir-1017/ > >The source distribution is also available at: > >https://dist.apache.org/repos/dist/dev/bahir/bahir-flink/1.0-rc5/ > >The vote is open for at least 72 hours and passes if a majority of at >least >3 +1 PMC votes are cast. > >[ ] +1 Release this package as Apache Bahir Flink extensions 1.0 >[ ] -1 Do not release this package because ... > >-- >Luciano Resende >http://twitter.com/lresende1975 >http://lresende.blogspot.com/
Re: Apache Bahir @ Apachecon Miami this week
Cool ! I'm there ! See you. Regards JB On May 16, 2017, 10:49, at 10:49, Luciano Resende wrote: >If you are around at Apachecon, please come to see us talking about >Apache >Bahir today > > >Writing Apache Spark applications using Apache Bahir - Tuesday, May 16 >2:30 >http://events.linuxfoundation.org/events/apache-big-data-north-america/program/schedule > >or just to say hi and meet face to face > >-- >Luciano Resende >http://twitter.com/lresende1975 >http://lresende.blogspot.com/
Re: [VOTE] Apache Bahir 2.1.0 (RC1)
+1 (binding) I did a very very quick check as I'm in vacation up to tomorrow. Regards JB On Feb 14, 2017, 18:57, at 18:57, Christian Kadner wrote: >We are still short one +1 vote from a PMC member. Current tally ... > >PMC members: > [+1] Luciano Resende > [+1] Mridul Muralidharan > >Committers: > [+1] Ted Yu > [+1] Christian Kadner > >@Steve @Jean-Baptiste - any chance to check out the 2.1.0 >release candidate? > >Thank you! > >On Sat, Feb 4, 2017 at 2:21 AM, Christian Kadner >wrote: > >> Dear community member, >> >> please vote to approve the release of Apache Bahir 2.1.0 (RC1) based >on >> Apache Spark 2.1.0. >> >> Changes: >> >> https://github.com/apache/bahir/compare/v2.0.2-rc3...v2.1.0-rc1 >> >> Tag: v2.1.0-rc1 (e61cc3d) >> >> https://github.com/apache/bahir/tree/v2.1.0-rc1 >> >> Release files: >> >> >https://repository.apache.org/content/repositories/orgapachebahir-1012 >> >> Source distribution: >> >> https://dist.apache.org/repos/dist/dev/bahir/2.1.0-rc1/ >> >> >> The vote is open for at least 72 hours and passes if a majority of at >least >> 3 +1 PMC votes are cast. >> >> [ ] +1 Release this package as Apache Bahir 2.1.0 >> [ ] -1 Do not release this package because ... >> >> >> Thanks for you vote! >>
Re: Release 2.1.0
+1 Regards JB On Feb 3, 2017, 18:29, at 18:29, Christian Kadner wrote: >+1 > >I can prepare the release over the weekend and start a new vote > >Best regards, >Christian Kadner > >> >> >- >> From:Ted Yu >> To: dev@bahir.apache.org >> Date:02/03/2017 10:20 AM >> Subject: Re: Release 2.1.0 >> >- >> >> +1 >> >> On Fri, Feb 3, 2017 at 8:48 AM, Luciano Resende > >> wrote: >> >> > Now that we are done with the Bahir release to support Spark 2.0.2, >should >> > we move to the new release supporting 2.1.0 ? >> > >> > -- >> > Luciano Resende >> > http://twitter.com/lresende1975 >> > http://lresende.blogspot.com/ >> > >>
Re: [VOTE] Apache Bahir 2.0.2 (RC3)
+1 Regards JB On 01/21/2017 03:31 AM, Christian Kadner wrote: Please vote to approve the third release candidate for Apache Bahir version 2.0.2 based on Apache Spark 2.0.2. The difference between 2.0.1 and 2.0.2 RC3 can be visualized at: https://github.com/apache/bahir/compare/v2.0.1-rc1...v2.0.2-rc3 The tag to be voted on is v2.0.2-rc3 (477ca1b556d2486b8c9ddbfb7a327ed8245066c4) https://github.com/apache/bahir/tree/477ca1b556d2486b8c9ddbfb7a327ed8245066c4 The release files, including signatures, digests, etc. can be found at: https://repository.apache.org/content/repositories/orgapachebahir-1011 The source distribution is also available at: https://dist.apache.org/repos/dist/dev/bahir/2.0.2-rc3/ The vote is open for at least 72 hours and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Bahir 2.0.2 [ ] -1 Do not release this package because ... Thanks for you vote! -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.0.1 (RC1)
+1 (binding) Regards JB On 2016-10-15 20:16 (+0200), Luciano Resende wrote: > Please vote to approve the release of the following candidate as Apache> > Bahir version 2.0.1 based on Apache Spark 2.0.1.> > > The tag to be voted on is v2.0.1-rc1> > (bd00d2e4aa8c4cc8837bcaa1d0d95d3e8997ac8c)> > > https://github.com/apache/bahir/tree/> > bd00d2e4aa8c4cc8837bcaa1d0d95d3e8997ac8c> > > The release files, including signatures, digests, etc. can be found at:> > > https://repository.apache.org/content/repositories/orgapachebahir-1004> > > The source distribution is also available at:> > > https://dist.apache.org/repos/dist/dev/bahir/2.0.1-rc1/> > > The vote is open for at least 72 hours and passes if a majority of at least> > 3 +1 PMC votes are cast.> > > [ ] +1 Release this package as Apache Bahir 2.0.1> > [ ] -1 Do not release this package because ...> > > > -- > > Luciano Resende> > http://twitter.com/lresende1975> > http://lresende.blogspot.com/> >
Re: Next Releases
+1 Regards JB On 09/26/2016 08:32 PM, Luciano Resende wrote: Looks like Spark is working on 2.0.1 release (RC3 being voted now), and I was wondering if we should use this opportunity to create a Bahir for Spark 2.0.1 release and also a Bahir for Flink 1.0 release. Thoughts ? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: Documentation for Bahir Flink extensions
+1 Regards JB On 08/26/2016 09:13 PM, Luciano Resende wrote: For the Spark extensions we currently have a README.md on each extension project which helps users accessing github to easily find out how to use the extension, and we also use that to "copy" to the website and add some style to it, so it can also be used as the website documentation. Here is a readme.md https://github.com/apache/bahir/tree/master/sql-streaming-mqtt And then it gets copied to the website as http://bahir.apache.org/docs/spark/current/spark-sql-streaming-mqtt/ I would like to propose a similar approach for creating documentation for the Bahir flink extensions. Thoughts ? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [DISCUSS] Bahir-flink versioning and releasing
Hi Robert, +1 to using "major.minor" format. Regards JB On 08/25/2016 02:31 PM, Robert Metzger wrote: Hi, I was wondering how we want to version the modules in the "bahir-flink" repository. I would actually like to do the versions independent of Flink. One of the motivations to move the connectors to Bahir was to allow faster releases. How about just "major.minor" versions, starting from 1.0. Bugfix releases would be 1.1, 1.2, and so on. I would also prefer to do frequent major releases (for example when a new connector is added) and do bugfix releases only if needed. Also, there's the ActiveMQ connector PR pending, and a HBase streaming connector incoming. Once they are both merged, I'd like to create the first Bahir-flink release to get the whole infrastructure in place. What do you think? Regards, Robert -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.0.0 (RC1)
+1 (binding) Checked the build, legal files and signatures. Regards JB On Aug 6, 2016, 12:12, at 12:12, Luciano Resende wrote: >Please vote to approve the release of the following candidate as Apache >Bahir version 2.0.0 based on Apache Spark 2.0.0. > >The tag to be voted on is v2.0.0-rc1 >(368c436ae2ad34b3ca64d11801aee69e478555f7) > >https://github.com/apache/bahir/tree/368c436ae2ad34b3ca64d11801aee69e478555f7 > >The release files, including signatures, digests, etc. can be found at: > >https://repository.apache.org/content/repositories/orgapachebahir-1001 > >The source distribution is also available at: > >https://dist.apache.org/repos/dist/dev/bahir/2.0.0-rc1/ > >The vote is open for at least 72 hours and passes if a majority of at >least >3 +1 PMC votes are cast. > >[ ] +1 Release this package as Apache Bahir 2.0.0-preview >[ ] -1 Do not release this package because ... > >-- >Luciano Resende >http://twitter.com/lresende1975 >http://lresende.blogspot.com/
Re: Importing source code from Apache Spark
Good point. It's also an alternative. Regards JB On 06/07/2016 04:24 PM, Luciano Resende wrote: An alternative would be to have a git repository for each runtime (e.g a new git repo for flink, etc) On Tuesday, June 7, 2016, Jean-Baptiste Onofré wrote: Thanks for the update Christian. I would go for option 1 but with spark modules. As Bahir can contain extensions for different projects, we should add a project top level module: - spark -- streaming-akka -- streaming-mqtt My $0.01 Regards JB On 06/07/2016 08:41 AM, Christian R Kadner wrote: Following Steve's second suggestion I created an initial Bahir repository from a Spark snapshot (8301fad) and purged the unwanted code using git filter-branch magic to preserve commit history for files like examples that needed to be moved. Adding build configuration, license file, etc would need to be done in a first commit on top of this. Regarding Luciano's question about possible folder structure, I prepared 3 alternatives but better suggestions are welcome. OPTION 1 (https://github.com/ckadner/bahir_from_spark_8301fad) has the examples folder and src folder at module root level, i.e.: - streaming-akka - examples/src/main/... - src/main/... - streaming-mqtt - examples/src/main/... - src/main/... - python/.. - ... OPTION 2 ( https://github.com/ckadner/bahir_with_folders_core_examples_test) has core, examples, test folder at module root level, i.e.: - streaming-akka: - core - src - examples - src - test - src OPTION 3 (https://github.com/ckadner/bahir_with_single_src_folder) has one src folder at module root, containing examples, main, test sources, i.e.: - streaming-akka - src - examples/java/... - main/scala/... - test/scala/... Any other suggestions or comments ...please comment on issue https://issues.apache.org/jira/browse/BAHIR-1 Thanks! ~ Regards, Christian ~ On Wed, Jun 1, 2016 at 2:21 AM, Steve Loughran wrote: (first post, hope the apache@org email gets in) two opts spring to mind -pure source, making a note of origin repo & commit -snapshot spark repo, purge most and then move to folders you want Now, what kind of code layout do we want, so as to encourage a contrib/ tree? On 1 June 2016 at 07:27, Mridul Muralidharan wrote: I agree with importing just the source Regards Mridul On Tuesday, May 31, 2016, Mattmann, Chris A (3980) < chris.a.mattm...@jpl.nasa.gov> wrote: I think source is fine by me for the first import - is there a specific reason to have all the artifacts? ++ Chris Mattmann, Ph.D. Chief Architect Instrument Software and Science Data Systems Section (398) NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 168-519, Mailstop: 168-527 Email: chris.a.mattm...@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++ Director, Information Retrieval and Data Science Group (IRDS) Adjunct Associate Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA WWW: http://irds.usc.edu/ ++ On 5/31/16, 5:42 PM, "Luciano Resende" > wrote: I was thinking about how to import the initial extensions from spark and had some initial thoughts : - Import history as much as possible - Create a folder structure where all artifacts for a given extension would be in that folder, including source, example, doc, etc Thoughts ? Any suggestions for the folder structure ? -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/ -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: Importing source code from Apache Spark
Thanks for the update Christian. I would go for option 1 but with spark modules. As Bahir can contain extensions for different projects, we should add a project top level module: - spark -- streaming-akka -- streaming-mqtt My $0.01 Regards JB On 06/07/2016 08:41 AM, Christian R Kadner wrote: Following Steve's second suggestion I created an initial Bahir repository from a Spark snapshot (8301fad) and purged the unwanted code using git filter-branch magic to preserve commit history for files like examples that needed to be moved. Adding build configuration, license file, etc would need to be done in a first commit on top of this. Regarding Luciano's question about possible folder structure, I prepared 3 alternatives but better suggestions are welcome. OPTION 1 (https://github.com/ckadner/bahir_from_spark_8301fad) has the examples folder and src folder at module root level, i.e.: - streaming-akka - examples/src/main/... - src/main/... - streaming-mqtt - examples/src/main/... - src/main/... - python/.. - ... OPTION 2 (https://github.com/ckadner/bahir_with_folders_core_examples_test) has core, examples, test folder at module root level, i.e.: - streaming-akka: - core - src - examples - src - test - src OPTION 3 (https://github.com/ckadner/bahir_with_single_src_folder) has one src folder at module root, containing examples, main, test sources, i.e.: - streaming-akka - src - examples/java/... - main/scala/... - test/scala/... Any other suggestions or comments ...please comment on issue https://issues.apache.org/jira/browse/BAHIR-1 Thanks! ~ Regards, Christian ~ On Wed, Jun 1, 2016 at 2:21 AM, Steve Loughran wrote: (first post, hope the apache@org email gets in) two opts spring to mind -pure source, making a note of origin repo & commit -snapshot spark repo, purge most and then move to folders you want Now, what kind of code layout do we want, so as to encourage a contrib/ tree? On 1 June 2016 at 07:27, Mridul Muralidharan wrote: I agree with importing just the source Regards Mridul On Tuesday, May 31, 2016, Mattmann, Chris A (3980) < chris.a.mattm...@jpl.nasa.gov> wrote: I think source is fine by me for the first import - is there a specific reason to have all the artifacts? ++ Chris Mattmann, Ph.D. Chief Architect Instrument Software and Science Data Systems Section (398) NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 168-519, Mailstop: 168-527 Email: chris.a.mattm...@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++ Director, Information Retrieval and Data Science Group (IRDS) Adjunct Associate Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA WWW: http://irds.usc.edu/ ++ On 5/31/16, 5:42 PM, "Luciano Resende" > wrote: I was thinking about how to import the initial extensions from spark and had some initial thoughts : - Import history as much as possible - Create a folder structure where all artifacts for a given extension would be in that folder, including source, example, doc, etc Thoughts ? Any suggestions for the folder structure ? -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/ -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: Project Roadmap
+1 It sounds good to me. Regards JB On 06/04/2016 01:01 AM, Luciano Resende wrote: As we are mostly setup on the infrastructure side, I would like to get the community raising some jiras around possible areas/extensions that we would like to see in Apache Bahir as Apache Spark Extensions, or other runtime extensions as well. Things that come to mind are : Kafka 0.10 connector with enhanced security support ObjectStore / Swift data source etc Thoughts ? Let's start raising jiras for each of these and hopefully get the community to start engaging with the prohect ? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: Guideline for contributing new extensions
Hi Luciano, it looks good to me. The challenge could be when accepting extensions for different projects (Spark, Flink, Beam for instance), not necessary sharing the same dependencies/technologies. We will have to provide kind of BoM for the dependencies. Regards JB On 06/01/2016 01:40 AM, Luciano Resende wrote: I have drafted a very basic guideline for contributing new extensions for Apache Bahir. My main goal is to use that as the start point to a community discussion that can flush out some details and make the process for proposing, accepting and retiring a extension very transparent. Please review the initial draft at : http://bahir.apache.org/contributing-extensions/ And let's use this thread for any question, comments, feedback, etc. -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: Blog announcing Apache Bahir
+1 Regards JB On 06/01/2016 02:53 AM, Luciano Resende wrote: Hi All, Now that we are finishing up the bootstrapping of Apache Bahir, I was wondering if we could engage with the Apache Press team to create a "announce" blog similar to the one done for Zeppelin recently : https://s.apache.org/YqqP Thoughts ? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: Importing source code from Apache Spark
Hi Luciano, I would say that just source import is enough (with git you can preserve history). The sources include the example for me. Regards JB On 06/01/2016 02:42 AM, Luciano Resende wrote: I was thinking about how to import the initial extensions from spark and had some initial thoughts : - Import history as much as possible - Create a folder structure where all artifacts for a given extension would be in that folder, including source, example, doc, etc Thoughts ? Any suggestions for the folder structure ? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
