RE: [Discuss graph source/sink design proposal]

2016-06-30 Thread Saikat Kanjilal
So I've started the coding efforts on this, here's some details: 1) I've cloned the hbase sink for now and am refactoring all of that code to work with neo4j as a start2) I'm only focusing on creating a sink that will perform basic CRUD streaming operations into neo4j3) I've sent an email to the

[jira] [Commented] (FLUME-2940) File channel - delete old events making queue available for new events

2016-06-30 Thread Mike Percy (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15358091#comment-15358091 ] Mike Percy commented on FLUME-2940: --- You can check out the metrics to monitor the number of events in

[jira] [Commented] (FLUME-2940) File channel - delete old events making queue available for new events

2016-06-30 Thread Yogesh BG (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15357936#comment-15357936 ] Yogesh BG commented on FLUME-2940: -- I would agree with you to add it as a plugin. Can you guide me to

Build failed in Jenkins: Flume-trunk-hbase-1 #171

2016-06-30 Thread Apache Jenkins Server
See Changes: [mpercy] Minor README tweaks -- [...truncated 8646 lines...] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217) at

Re: Review Request 49458: FLUME-2921 Support Elasticsearch 2.0+

2016-06-30 Thread Lior Zeno
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/49458/ --- (Updated June 30, 2016, 7:05 p.m.) Review request for Flume. Bugs:

Re: Review Request 49458: FLUME-2921 Support Elasticsearch 2.0+

2016-06-30 Thread Lior Zeno
> On June 30, 2016, 6:48 p.m., Mike Percy wrote: > > pom.xml, line 872 > > > > > > Is this really the minimum Guava version required? Flume has to work > > with Hadoop and a lot of other components so this huge

Re: Review Request 49458: FLUME-2921 Support Elasticsearch 2.0+

2016-06-30 Thread Mike Percy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/49458/#review140215 --- pom.xml (line 872)

Review Request 49458: FLUME-2921 Support Elasticsearch 2.0+

2016-06-30 Thread Lior Zeno
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/49458/ --- Review request for Flume. Bugs: FLUME-2921

Re: [DISCUSS] Checkstyle maven plugin

2016-06-30 Thread Lior Zeno
Great, thank you for your fast reply. On Thu, Jun 30, 2016 at 8:29 PM, Mike Percy wrote: > That worked. GItHub is updated now. > > ASF infra had some issues yesterday, I'm assuming that's why that mirroring > didn't get triggered. Good catch. > > Mike > > On Thu, Jun 30,

[jira] [Commented] (FLUME-2940) File channel - delete old events making queue available for new events

2016-06-30 Thread Mike Percy (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15357518#comment-15357518 ] Mike Percy commented on FLUME-2940: --- Yeah I suppose it depends on how you interpret that: 1. We could

Re: [DISCUSS] Checkstyle maven plugin

2016-06-30 Thread Mike Percy
That worked. GItHub is updated now. ASF infra had some issues yesterday, I'm assuming that's why that mirroring didn't get triggered. Good catch. Mike On Thu, Jun 30, 2016 at 10:25 AM, Mike Percy wrote: > Thanks for the heads-up, Lior. Sounds like an ASF infra bug because

Re: [DISCUSS] Checkstyle maven plugin

2016-06-30 Thread Mike Percy
Thanks for the heads-up, Lior. Sounds like an ASF infra bug because it was committed upstream: https://git-wip-us.apache.org/repos/asf?p=flume.git I will try committing a small change to trunk and see if GItHub picks it up. If that doesn't work, I'll file an INFRA ticket. Mike On Thu, Jun 30,

[jira] [Updated] (FLUME-2943) Integrate checkstyle - second pass

2016-06-30 Thread Lior Zeno (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lior Zeno updated FLUME-2943: - Attachment: google_checks.xml > Integrate checkstyle - second pass > -- >

[jira] [Created] (FLUME-2943) Integrate checkstyle - second pass

2016-06-30 Thread Lior Zeno (JIRA)
Lior Zeno created FLUME-2943: Summary: Integrate checkstyle - second pass Key: FLUME-2943 URL: https://issues.apache.org/jira/browse/FLUME-2943 Project: Flume Issue Type: Improvement Affects

Re: [DISCUSS] Checkstyle maven plugin

2016-06-30 Thread Lior Zeno
Hi Mike, for some reason your commit is not available on github. Are you aware of that? On Thu, Jun 30, 2016 at 7:37 AM, Lior Zeno wrote: > Thank you for this contribution, it is greatly appreciated! > > I'll create a new issue for a second pass, scheduled to 1.8.0. > On Jun

[jira] [Commented] (FLUME-2458) Separate hdfs tmp directory for flume hdfs sink

2016-06-30 Thread Mike Percy (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15357465#comment-15357465 ] Mike Percy commented on FLUME-2458: --- Hi Neerja, using hdfs.inUsePrefix=. should solve the problems you

Re: Review Request 47098: FLUME-2620 File channel throws NullPointerException if a header value is null

2016-06-30 Thread Mike Percy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47098/#review140181 --- This doesn't look like it changes the file channel at all. Isn't

[jira] [Commented] (FLUME-2620) File channel throws NullPointerException if a header value is null

2016-06-30 Thread Neerja Khattar (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15357396#comment-15357396 ] Neerja Khattar commented on FLUME-2620: --- [~jarcec] any update? > File channel throws

[jira] [Created] (FLUME-2942) AvroEventDeserializer ignores header from spool source

2016-06-30 Thread Sebastian Alfers (JIRA)
Sebastian Alfers created FLUME-2942: --- Summary: AvroEventDeserializer ignores header from spool source Key: FLUME-2942 URL: https://issues.apache.org/jira/browse/FLUME-2942 Project: Flume

[jira] [Commented] (FLUME-2938) JDBC Source

2016-06-30 Thread Lior Zeno (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15357104#comment-15357104 ] Lior Zeno commented on FLUME-2938: -- Right, my bad. However, my point is that it is much less versatile

[jira] [Commented] (FLUME-2938) JDBC Source

2016-06-30 Thread Attila Simon (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356850#comment-15356850 ] Attila Simon commented on FLUME-2938: - I'm clearly not familiar with sqoop (I never used in prod

[jira] [Commented] (FLUME-2940) File channel - delete old events making queue available for new events

2016-06-30 Thread Attila Simon (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356833#comment-15356833 ] Attila Simon commented on FLUME-2940: - I believe [~yogeshbelur] only want to drop messages when

[jira] [Commented] (FLUME-2940) File channel - delete old events making queue available for new events

2016-06-30 Thread Mike Percy (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356772#comment-15356772 ] Mike Percy commented on FLUME-2940: --- See https://flume.apache.org/FlumeUserGuide.html#null-sink > File

[jira] [Commented] (FLUME-2940) File channel - delete old events making queue available for new events

2016-06-30 Thread Mike Percy (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356769#comment-15356769 ] Mike Percy commented on FLUME-2940: --- There is a "null" sink in Flume that will throw away events from a

[jira] [Commented] (FLUME-2940) File channel - delete old events making queue available for new events

2016-06-30 Thread Attila Simon (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356753#comment-15356753 ] Attila Simon commented on FLUME-2940: - Hi [~yogeshbelur], Please correct me if I'm wrong but seems to

[jira] [Commented] (FLUME-2870) Flume agent throw NULLPOINTEXCEPTION when use kakfa-source

2016-06-30 Thread Denes Arvay (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356714#comment-15356714 ] Denes Arvay commented on FLUME-2870: This one seems to be a duplicate of FLUME-2672, so if there are

[jira] [Assigned] (FLUME-2870) Flume agent throw NULLPOINTEXCEPTION when use kakfa-source

2016-06-30 Thread Denes Arvay (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denes Arvay reassigned FLUME-2870: -- Assignee: Denes Arvay > Flume agent throw NULLPOINTEXCEPTION when use kakfa-source >

[jira] [Assigned] (FLUME-2725) HDFS Sink does not use configured timezone for rounding

2016-06-30 Thread Denes Arvay (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denes Arvay reassigned FLUME-2725: -- Assignee: Denes Arvay > HDFS Sink does not use configured timezone for rounding >