Re: Community hackathon

2017-04-26 Thread Tibor Kiss
I've created a meetup in Budapest for this event: https://www.meetup.com/futureofdata-budapest/events/239504356/ We (folks from the Hortonworks office @ Budapest) will try to prep a demo for the event and if time allows we'll jump into open issues. On Tue, Apr 25, 2017 at 7:54 AM, Davor Bonaci

Re: [PROPOSAL] ORC support

2017-04-03 Thread Tibor Kiss
> support (http://carbondata.apache.org/). > > Regards > JB > > > On 04/01/2017 05:31 PM, Tibor Kiss wrote: > >> Hello, >> >> Recently the Optimized Row Columnar (ORC) file format was spin off from >> Hive >> and became a top level Apache Project: https://o

Re: Update of Pei in Alibaba

2017-04-01 Thread Tibor Kiss
Exciting times, looking forward to try it out! I shall mention that Taylor Goetz also started creating a BEAM runner using Storm. His work is available in the storm repo: https://github.com/apache/storm/commits/beam-runner Maybe it's worth while to take a peek and see if something is reusable

Re: [DISCUSSION] Consistent use of loggers

2017-03-22 Thread Tibor Kiss
This is a great idea! I believe Python-SDK's logging could also be enhanced (a bit differently): Currently we are not instantiating the logger, just using the class what logging package provides. Shortcoming of this approach is that the user cannot set the log level on a per module basis as all

Release notes snapshotting to website

2017-03-19 Thread Tibor Kiss
Hello, I’d like to propose to put the ‘Release notes’ as a separate document into the website. Currently we are providing the notes through JIRA search. If someone (accidentally) sets a ticket’s fix version to an already released version it will pop-up in the linked search later. Snapshotting

Re: [ANNOUNCEMENT] New committers, March 2017 edition!

2017-03-19 Thread Tibor Kiss
Congratulations / gratulalok! ;) > On Mar 19, 2017, at 7:42 AM, Aljoscha Krettek wrote: > > Congrats, everyone! :-) > > On Sat, Mar 18, 2017, at 16:09, Stas Levin wrote: >> Congrats to the new committers! >> >> On Sat, Mar 18, 2017 at 3:44 PM Aviem Zur

Re: Beam File System in the Python SDK

2017-03-19 Thread Tibor Kiss
Thanks for putting this together, Sourabh! I made two comments in the document (error handling, with statement). Are there any plans to support permissions (mode bits or acls) in the FS API? I believe most (if not all) of the underlying filesystems support (some sort of) permission enforcement.

Re: [VOTE] Release 0.6.0, release candidate #2

2017-03-12 Thread Tibor Kiss
+1 Details: - Built locally with 'mvn clean install –Prelease' - Needed to change pip2 to pip2.7. This issue is known on OS X and shall not block the release in my opinion. - Sanity check on Python-SDK: - apache-beam-0.6.0.tar.gz has the same content as apache-beam-0.6.0.zip - ran