ing.
https://beam.apache.org/contribute/contribution-guide/
#create-a-pull-request
Thanks,
Cham
On Sun, Apr 30, 2017 at 12:41 PM Jean-Baptiste Onofré
wrote:
Hi,
IMHO, it's very rare. That's true we did couple of "fast" commit to fix
issues
(I remember at the beginning of the
) of the above is present.
My two cents.
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
ing/TestStream.java>
?
On Sat, Apr 29, 2017 at 10:03 PM Jean-Baptiste Onofré
wrote:
Hi,
In addition of Eugene and Jesse's answers, for testing purpose, it's
possible to
use CreateStream in some runners. It allows us to test streaming.
Regards
JB
On 04/29/2017 09:50 PM, Shen Li wrote
convenient way to read from an unbounded Iterable object without writing
application code to wrap it into an UnboundedSource object?
Thanks,
Shen
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
ar) future.
I'm excited that we finally managed to unify our CI tooling, and can make
efforts on improving and maintaining one system as opposed to two. That
said, please comment if you have any worries about this or ideas for
further CI improvements ;-)
Davor
--
Jean-Baptiste On
Thanks for the update !
Regards
JB
On Apr 26, 2017, 05:51, at 05:51, Jason Kuster
wrote:
>Hey folks,
>
>There have been a couple of different issues over the last couple of
>days
>related to some necessary updates Infra has been working on. We've
>tracked
>down the last couple of issues, and th
Beam, your help and suggestions will be
appreciated.
Madhu Borkar
[1]
https://docs.google.com/a/etouch.net/document/d/161_7y0A3kgLxmp6-TSNUVZgFgzCH1knwSWtNDwSQj7w/edit?usp=sharing
[2] https://issues.apache.org/jira/browse/BEAM-1158
<https://issues.apache.org/jira/browse/BEAM-1158>
--
Je
03 AM, Jean-Baptiste Onofré
wrote:
Got it. By experience on other Apache projects, it's really hard to
maintain ;)
Regards
JB
On 04/24/2017 02:56 PM, Etienne Chauchot wrote:
Hi JB,
I was proposing a FAQ (or another form), not something about IDE setup.
The FAQ
could group in the same plac
;what is a source, how do I
use it to implement an IO"
Etienne
Le 24/04/2017 à 14:19, Jean-Baptiste Onofré a écrit :
Hi Etienne,
What about the contribution guide ? I think it's covered in the IntelliJ and
Eclipse setup sections.
Regards
JB
On 04/24/2017 02:12 PM, Etienne Chaucho
maybe having key points
in a common place (like FAQ for sdk/runner/io/... writers, for example) would be
interesting.
Best,
Etienne
Le 24/04/2017 à 09:14, Jean-Baptiste Onofré a écrit :
Hi,
I think we already tag the newbie jira ("low hanging fruit" ;)).
Good idea for domain of i
close them and if there is still interest well they will be
re-opened in that case.
The ‘good news’ is that we have 350 unassigned unresolved issues that
anyone can take this is a good improvement but I agree that we can do
better.
Ismaël
On Sun, Apr 23, 2017 at 6:32 AM, Jean-Baptiste Onofré
different time zones
participating at the time of their choosing.
Thoughts?
Davor
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
er per-person load, I think we'd be more effective.
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
wse/INFRA-13949
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
ply (2) to currently open issues (over 800). Perhaps
some can be closed.
Thoughts? Ideas?
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
.com/search?l=Java&q=KeyedCombineFn&ref=advsearch&type=Code&utf8=%E2%9C%93
[5] https://www.google.com/search?q=KeyedCombineFn
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
t 10:47 PM Jean-Baptiste Onofré
wrote:
Cool, I gonna take a look on PubSub later today (I would like to finish
CassandraIO, HDFS refactoring and Spark 2 support first ;)).
Regards
JB
On 04/21/2017 06:03 AM, tarush grover wrote:
Hi,
I can take kinesis one.
Regards,
Tarush
On Thu, 20 Apr 2017 a
Cool, I gonna take a look on PubSub later today (I would like to finish
CassandraIO, HDFS refactoring and Spark 2 support first ;)).
Regards
JB
On 04/21/2017 06:03 AM, tarush grover wrote:
Hi,
I can take kinesis one.
Regards,
Tarush
On Thu, 20 Apr 2017 at 11:18 AM, Jean-Baptiste Onofré
ing coders from KafkaIO
Kinesis and PubsubIO remain; of these, Kinesis is the easier one.
Any takers?
On Fri, Apr 7, 2017 at 10:47 PM Jean-Baptiste Onofré
wrote:
Hi Eugene,
thanks for the update. I'm volunteer to tackle some those IOs (and make
them
conform with PTransform style guide).
ache/beam.git
+refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
--prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86
(origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout
to think of *splitIntoBundles *as *generate*Initial*Splits?
*
(strikethrough due to "initial" not being applicable in the case of
bounded
sources)
Regards,
Stas
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
more mature now so my absence won't be
noticed :-) but I still asked JB to formally take my place with anything
concerning the Spark runner and he kindly agreed.
Thanks,
Amit
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
live?
-Tyler
On Sun, Apr 9, 2017 at 12:39 PM Mingmin Xu wrote:
Thanks @JB, will come out the initial PR soon.
On Sun, Apr 9, 2017 at 12:28 PM, Jean-Baptiste Onofré <
j...@nanthrax.net
wrote:
As discussed, I created the DSL_SQL branch with the skeleton.
Mingmin
is
rebasing on this b
OChannelFactory (or the new name FileSystem). All
others, e.g., HTTP, TCP, KV-store, DB, message-queue, should be source/sink
transforms?
Thanks,
Shen
On Tue, Apr 11, 2017 at 10:29 AM, Jean-Baptiste Onofré
wrote:
Hi Shen,
We are doing a refactoring of the file IO (IOChannelFactory). Thanks to
t
connector, how can I determine whether it should be
implemented as a source transform or as a scheme for the TextIO?
Thanks,
Shen
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
need
>> to be okay if it goes out.) Can you give some reasons why you think
>it's
>> better than the other options? I put it on the list, but I'm strongly
>not a
>> fan.
>>
>> S
>>
>> On Sat, Apr 8, 2017 at 5:31 AM Ted Yu wrote:
>>
>&
0:26 AM Kenneth Knowles
wrote:
Very cool! I'm really excited about this integration.
On Thu, Apr 6, 2017 at 9:39 AM, Jean-Baptiste Onofré <
j...@nanthrax.net>
wrote:
Hi,
Mingmin and I prepared a new branch to have the SQL DSL in dsls/sql
location.
Any help is welcome !
Thanks,
R
That explains ;)
Thanks,
Regards
JB
On 04/09/2017 07:34 PM, Pramod Immaneni wrote:
There was a respin done of that particular version of netlet. It is not a
usual practice and it was an exception.
On Sun, Apr 9, 2017 at 10:32 AM, Jean-Baptiste Onofré
wrote:
I found the cause.
All tests
t the test
listed and the Apex tests pass when I run them.
Thomas
On Sat, Apr 8, 2017 at 11:15 PM, Jean-Baptiste Onofré
wrote:
Hii huys,
FYI, the build is failing on the Apex runner tests (due to
NullPointerException):
ParDoTranslatorTest.testSerialization:225 » N
homas Weise wrote:
I'm not sure what the issue is, but that commit shouldn't affect the test
listed and the Apex tests pass when I run them.
Thomas
On Sat, Apr 8, 2017 at 11:15 PM, Jean-Baptiste Onofré
wrote:
Hii huys,
FYI, the build is failing on the Apex runner tests (due to
NullP
pass when I run them.
Thomas
On Sat, Apr 8, 2017 at 11:15 PM, Jean-Baptiste Onofré
wrote:
Hii huys,
FYI, the build is failing on the Apex runner tests (due to
NullPointerException):
ParDoTranslatorTest.testSerialization:225 » NullPointer
ApexStateInternalsTest.initStateInternals:8
ApexStateInternalsTest.initStateInternals:83 » NullPointer
ApexStateInternalsTest.initStateInternals:83 » NullPointer
ApexStateInternalsTest.initStateInternals:83 » NullPointer
I gonna submit a PR to fix that (it's due to commit
42f63342be667649eff5ea65dd9714c8b2f75cff).
Regards
JB
--
Jean-Bap
IOs.
I've written this up as a proposal found here:
https://s.apache.org/standard-io-metrics
As usual, this document is commentable, please go over it and make comments
where appropriate.
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
changes are backwards-incompatible (though with only minor
changes in pipelines required). I'll make a separate announcement about
that on the users list now.
Call for help with the other sub-issues still stands! They are pretty
simple work items but pretty important since this is a blocker for
dec
96
[2] set of available charts - https://github.com/kubernetes/charts
[3] kubernetes helm introduction -
https://deis.com/blog/2015/introducing-helm-for-kubernetes/
[4] kubernetes charts instructions -
https://github.com/kubernetes/helm/blob/master/docs/charts.md
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
hanges myself.
Thanks!
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
--
Mingmin
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
[1] https://issues.apache.org/jira/browse/BEAM-1825
On 3/22/17, 5:46 AM, "Aviem Zur" wrote:
+1 to what JB said.
Will just have to be documented well as if we provide no binding
there
will
be no logging out of the box unless the user adds a binding.
On Wed, Mar 22, 2
to something like
GroupingState and probably just moving to runners-core (as a trivial
wrapper, since it won't be able to remain a superclass) since it is not
useful for users.
Kenn
On Thu, Mar 30, 2017 at 9:32 AM, Jean-Baptiste Onofré
wrote:
+0
as the StateSpec takes AccumularCombining
Thanks Tibor,
Ready to help ! (I also started the ParquetIO).
Regards
JB
On 04/03/2017 02:11 PM, Tibor Kiss wrote:
Thanks for your replies, I've created
https://issues.apache.org/jira/browse/BEAM-1861 to track this effort.
On Sun, Apr 2, 2017 at 7:40 AM, Jean-Baptiste Onofré
wrote:
+
exciting journey.
Please guide me to where and how to start so that I can quickly pace with
the active development and it would be great if you can assign something to
me to start.
Regards,
Tarush
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
.
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
ing moment in a window's lifecycle is @EndOfWindow. This is
not critical for correctness, though.
Thoughts?
Kenn
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
ain a JIRA contributor role in order to assign
the following issue (https://issues.apache.org/jira/browse/BEAM-1684) to
myself? My full name is Rahul Sabbineni and my Apache JIRA profile can be
found in that issue.
Thanks,
Rahul
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Tal
would be a better name?
The same goes for StateSpecs.*CombiningValue methods that all return
AccumulatorCombiningState but maybe the name would be too long.
WDYT?
Etienne
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
rofile for the Spark dependencies and run the
tests -
you'll have a very definitive answer ;-) .
If this passes, try on a cluster running Spark 2 as well.
Let me know of I can assist.
On Thu, Mar 23, 2017 at 6:55 AM Jean-Baptiste Onofré <
j...@nanthrax.net>
wrote:
Hi guys,
Ismaël su
run the tests -
you'll have a very definitive answer ;-) .
If this passes, try on a cluster running Spark 2 as well.
Let me know of I can assist.
On Thu, Mar 23, 2017 at 6:55 AM Jean-Baptiste Onofré
wrote:
Hi guys,
Ismaël summarize well what I have in mind.
I'm a bit late on
Tue, Mar 28, 2017, at 07:40, Jean-Baptiste Onofré wrote:
I add myself on the Spark runner.
Regards
JB
On 03/27/2017 08:18 PM, Eugene Kirpichov wrote:
Hi all,
Let's continue the ~bi-weekly sync-ups about state of SDF support in
Spark/Flink/Apex runners.
Spark:
Amit, Aviem, Ismaël - when
e:
Thomas - yes, 9:30 works, shall we do that?
JB - excellent! You can start experimenting already, using direct runner!
On Mon, Mar 20, 2017, 2:26 AM Jean-Baptiste Onofré
wrote:
Hi Eugene,
Thanks for the meeting notes !
I will be in the next call and Ismaël also provided to me some updates.
I
ed to work on migrating from the 1.X
terms to 2.X terms (We may other incompatibilities that we will find out
during the work).
Regards
Kobi
2017-03-23 6:55 GMT+02:00 Jean-Baptiste Onofré :
Hi guys,
Ismaël summarize well what I have in mind.
I'm a bit late on the PoC around that (I starte
eated to isolate changes in Spark 2.x API so that code in hbase-spark
module can be reused.
FYI
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
o add
documentation on logging in Beam to the website.
[1] https://issues.apache.org/jira/browse/BEAM-1757
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
rmanceTests_JDBC/
[2]
https://apache-beam-testing.appspot.com/explore?dashboard=5714163003293696
[3]
https://docs.google.com/document/d/1PsjGPSN6FuorEEPrKEP3u3m16tyOzph5FnL2DhaRDz0/edit?ts=58a78e73
--
---
Jason Kuster
Apache Beam / Google Cloud Dataflow
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
nterested in contributing, or have more ideas, you are welcome :)
Etienne
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
ld make sense to allow the validate method to throw
Exception.
On Mon, Mar 20, 2017, 11:21 PM Jean-Baptiste Onofré
wrote:
Hi Ted,
validate() is supposed to throw runtime exception (IllegalStateException,
RuntimeException, ...) to "traverse" the executor.
Regards
JB
On 03/21/2017 01:56
ogged BEAM-1773
FYI
On Mon, Mar 20, 2017 at 11:26 PM, Eugene Kirpichov <
kirpic...@google.com.invalid> wrote:
I think it would make sense to allow the validate method to throw
Exception.
On Mon, Mar 20, 2017, 11:21 PM Jean-Baptiste Onofré
wrote:
Hi Ted,
validate() is supposed to throw r
} catch (IOException | InterruptedException e) {
throw new RuntimeException(e);
}
Why is validate() not declared to throw any exception ?
If validation doesn't pass, there is nothing to clean up ?
Thanks
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.ne
11, 2017 at 4:30 PM, Jean-Baptiste Onofré wrote:
Hi Eugene and Stas,
Just back from couple of days off and jump on this discussion.
I agree with Stas: it's worth to create a Jira about that. The only
"semantic" difference is unbounded vs bounded source, but the behavior is
the sa
t
quite
clear to me how to implement the GBKIntoKeyedWorkItems
transform,
e.g.
Spark runner currently doesn't use KeyedWorkItem at all -
but
it
seems
definitely possible.
Thanks!
--
Data Artisans GmbH | Stresemannstr. 121A | 10963 Berlin
i...@data-artisans.com
+49-(0)30-55599146
b/v0.6.0/sdks/python/apache_beam/io/iobase.py#L561
[4] https://s.apache.org/splittable-do-fn
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Agree.
We could also include Release Notes as text in release (it's what I do in Karaf
for instance). It's pretty convenient for user when they download a
distribution.
Regards
JB
On Mar 20, 2017, 05:27, at 05:27, Davor Bonaci wrote:
>Yes, I think we should do this -- primarily to increase th
nd 2.x translator which translates into DataSets.
On Thu, Mar 16, 2017 at 9:33 AM, Jean-Baptiste Onofré
wrote:
Hi guys,
sorry, due to the time zone shift, I answer a bit late ;)
I think we can have the same runner dealing with the two major Spark
version, introducing some adapters. For inst
catching this. As a side
note, I did not have enough permissions do this and asked Davor to do. I
will add this to the release notes.
Ahmet
On Wed, Mar 15, 2017 at 7:16 AM, Jesse Anderson
wrote:
Excellent!
On Wed, Mar 15, 2017, 6:13 AM Jean-Baptiste Onofré
wrote:
Hi Ahmet,
it seems Ji
he DataSet API
won't be there but with this common canvas the community can iterate
to create a DataSet based translator at the same time. In particular
I
consider the most important thing is that the spark 2 branch should
not live for long time, this should be merged into master really
fa
, Jesse Anderson
wrote:
Excellent!
On Wed, Mar 15, 2017, 6:13 AM Jean-Baptiste Onofré
wrote:
Hi Ahmet,
it seems Jira is not up to date: 0.6.0 version is not flagged as
"Released".
Can you fix that please ?
Thanks !
Regards
JB
On 03/15/2017 05:22 AM, Ahmet Altay wrote:
I'm ha
4 of which are binding:
* Aljoscha Krettek
* Davor Bonaci
* Ismaël Mejía
* Jean-Baptiste Onofré
* Robert Bradshaw
* Ted Yu
* Tibor Kiss
There are no disapproving votes.
Thanks everyone!
Ahmet
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
terfaces
introduced
in Flink 1.2 and implement support for both the user facing
state
and
timer
APIs. This should make implementation of SDF easier.
On Wed, Feb 8, 2017 at 7:06 PM, Eugene Kirpichov <
kirpic...@google.com
wrote:
Thanks! Looking forward to this work.
On Wed, Feb 8, 2017
017 at 9:07 AM Cody Innowhere wrote:
Hi guys,
Is there anybody who's currently working on Spark 2.x runner? A old PR for
spark 2.x runner was closed a few days ago, so I wonder what's the status
now, and is there a roadmap for this?
Thanks~
--
Jean-Baptiste Onofré
jbono.
different elasticsearch
images - I'd like to use only one image. I'll follow up on that -
https://issues.apache.org/jira/browse/BEAM-1644
S
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
beam/pull/2221
[16] https://github.com/apache/beam/pull/
[17] https://github.com/apache/beam/pull/2224
[18] https://github.com/apache/beam/pull/2225
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
some artifcats - I'd appreciate their help.
Thanks,
Amit
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
ariants which, if violated, lead to data loss: e.g.
that if parameters foo and bar are mutually exclusive, verify that if the
user specifies both, they get an error, instead of one of them being
silently ignored.
Thoughts?
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
es.apache.org/jira/browse/BEAM-1674
[15] https://github.com/apache/beam/pull/2197
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
think.
On Thu, Mar 9, 2017 at 8:39 AM, Amit Sela wrote:
Well, for now at least. We have to use something for fixed issues..
On Thu, Mar 9, 2017 at 6:32 PM Jean-Baptiste Onofré
wrote:
By the way, waiting the end of this discussion, we can use "First stable
release" as version in Jir
By the way, waiting the end of this discussion, we can use "First stable
release" as version in Jira.
Regards
JB
On 03/09/2017 07:21 AM, Jean-Baptiste Onofré wrote:
Hi all,
Release branch for 0.6.0 has been created but the next cycle version has
not been created in Jira.
I propose
a-science,
data-analysis, data-mining, data-processing
[1] https://github.com/blog/2309-introducing-topics
[2] https://github.com/GoogleCloudPlatform/DataflowJavaSDK
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
By the way, it would make sense to use 2.0.0-SNAPSHOT version in pom.xml
instead of 0.7.0-SNAPSHOT.
Thoughts ?
Regards
JB
On 03/09/2017 07:21 AM, Jean-Baptiste Onofré wrote:
Hi all,
Release branch for 0.6.0 has been created but the next cycle version has
not been created in Jira.
I propose
Hi all,
Release branch for 0.6.0 has been created but the next cycle version has
not been created in Jira.
I propose to create 2.0.0 version in Jira (it's always possible to
rename the version later).
No objection ?
Thanks
Regards
JB
--
Jean-Baptiste Onofré
jbono...@apache.org
orresponding email id is "chin...@apache.org".
Thanks,
Chinmay.
On Fri, Mar 3, 2017 at 6:07 PM, Jean-Baptiste Onofré
wrote:
Hi Chinmay,
Welcome aboard !
I tried to add you in the contributor group, but I don't find chinmay
Jira
ID (and there are several Chinmay ;)). What&#
esult).
I will start a PoC of this metric-extension and gonna test with the
different runners.
Thoughts ?
Regards
JB
On 02/22/2017 09:14 PM, Jean-Baptiste Onofré wrote:
Hi Ismaël,
You did a great summary and you put the emphasis on the valid point.
I full agree with you about the fact we s
ll... :)
Thanks,
Chinmay.
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
he release on it. It should be
available ahead of the release's existing schedule, and can easily be
cherry-picked.
Kenn
On Wed, Mar 1, 2017 at 10:50 PM, Jean-Baptiste Onofré
wrote:
Thanks Ahmet !
Regards
JB
On 03/02/2017 07:42 AM, Ahmet Altay wrote:
Sure, I can wait. To be clear, Th
quests and JIRA
issues you've sent me, but I know the community will be happy to help with
urgent issues in the rest.
(I also will not be able to vote on the 0.6.0 release, or attend the
virtual meetup next week. Sorry, and good luck!)
Have fun!
Dan
--
Jean-Baptiste Onofré
jbono...@
By the way Stephen, when BEAM-59 will be done, hadoop IO will only
contains the hadoop format support (no HdfsFileSource or HdfsSink
required as it will use the "regular" FileIO).
Agree ?
Regards
JB
On 03/02/2017 03:27 PM, Jean-Baptiste Onofré wrote:
Hi Stephen,
I agree
you have received this communication in
error, please notify the sender and delete all copies of this message.
Persistent Systems Ltd. does not accept any liability for virus infected
mails.
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
a Kafka topic partition until it
receives a "poison pill" message. This seems handy.
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Thanks Ahmet !
Regards
JB
On 03/02/2017 07:42 AM, Ahmet Altay wrote:
Sure, I can wait. To be clear, Thursday night in which time zone?
Thank you,
Ahmet
On Wed, Mar 1, 2017 at 10:38 PM, Jean-Baptiste Onofré
wrote:
Hi Ahmet,
Can you wait up to Thursday night ? Trying to merge BEAM-649
Pacific time is fine.
Regards
JB
On 03/02/2017 07:42 AM, Ahmet Altay wrote:
Sure, I can wait. To be clear, Thursday night in which time zone?
Thank you,
Ahmet
On Wed, Mar 1, 2017 at 10:38 PM, Jean-Baptiste Onofré
wrote:
Hi Ahmet,
Can you wait up to Thursday night ? Trying to merge BEAM
hts and preferences -- names are
important and well correlated with success. Thanks!
Davor
[1] https://lists.apache.org/thread.html/c35067071aec9029d9100ae973c629
9aa919c31d0de623ac367128e2@%3Cdev.beam.apache.org%3E
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
whether it is a blocker.
There is already an open PR for this now.
[1] https://issues.apache.org/jira/browse/BEAM-1517
On Tue, 28 Feb 2017 at 18:21 Jean-Baptiste Onofré
wrote:
Regarding BEAM-649, it's not a release blocker, it's a good to have.
As I'm pretty close to the
t be useful here:
https://github.com/apache/beam/blob/master/sdks/python/
apache_beam/utils/annotations.py
- Cham
Perhaps an explicit @public annotation would fit. I could imagine
easily
generating a spec to check against from such annotations, though
tooling
is
secondary to documentatio
27;s not a
regression from 0.5.0 where we simply didn't have this feature but I'm
still somewhat uneasy about this.
On Tue, 28 Feb 2017 at 09:44 Jean-Baptiste Onofré wrote:
Fair enough.
I also try to merge https://github.com/apache/beam/pull/1739 asap.
Regards
JB
On 02/28/2017 09:34 AM, A
RDER%20BY%20due%20ASC%2C%
20priority%20DESC%2C%20created%20ASC
--
Sergio Fernández
Partner Technology Manager
Redlink GmbH
m: +43 6602747925 <+43%20660%202747925>
e: sergio.fernan...@redlink.co
w: http://redlink.co
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanth
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
le to describe how it works
with Calcite. --A little different from BEAM-301, that I choose a CLI
interactive way, not SQL DSL.
Doc link:
https://docs.google.com/document/d/1Uc5xYTpO9qsLXtT38OfuoqSLimH_0a1Bz5BsCROMzCU/edit?usp=sharing
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthra
rd to work with all of you!
Kind Regards,
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
r, it should be possible to use java8 code as well. Maybe it goes in
a profile? Maybe it goes into a separate module, maybe just a separate
profile?
Can you investigate?
On Mon, Feb 27, 2017 at 9:23 AM, Jean-Baptiste Onofré
wrote:
Hi Dipti,
I had the same "issue" on CassandraIO.
If y
all copies of this message. Persistent Systems
Ltd. does not accept any liability for virus infected mails.
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Done
Regards
JB
On 02/27/2017 06:17 PM, Neelesh Salian wrote:
Thanks JB.
On Mon, Feb 27, 2017 at 9:14 AM, Jean-Baptiste Onofré
wrote:
Hi Neelesh,
sure, I will update.
Regards
JB
On 02/27/2017 06:08 PM, Neelesh Salian wrote:
Hi,
Had to change my username due to email issues.
Could
901 - 1000 of 1118 matches
Mail list logo
