Re: Review Request: Intital version of the Flume web site.

2012-07-08 Thread Ralph Goers
- Diff: https://reviews.apache.org/r/5765/diff/ Testing --- Thanks, Ralph Goers

Re: [DISCUSS] Git as primary source control for Flume

2012-07-11 Thread Ralph Goers
On Jul 11, 2012, at 5:24 PM, Mike Percy wrote: +1! Thanks for proposing this Hari. Regarding review tools, I know some projects use Gerrit https://code.google.com/p/gerrit/ which integrates well with Git. I'd like to try out how the GitHub pull request flow works before making it

Re: Waiting for TLP web site before 1.2.0 release

2012-07-16 Thread Ralph Goers
I see no mention of the maven artifacts in the list below. Ralph On Jul 15, 2012, at 10:42 PM, Mike Percy mpe...@apache.org wrote: Hi folks, Although the release vote is closed, I feel it would be good for the project to announce our first TLP release from our TLP web site

OSCON

2012-07-18 Thread Ralph Goers
Is anyone from Flume at OSCon? If you are here I would love to say Hi! Ralph

Re: Waiting for TLP web site before 1.2.0 release

2012-07-18 Thread Ralph Goers
the next couple of days. Regards, Mike On Mon, Jul 16, 2012 at 6:20 AM, Ralph Goers rgo...@apache.org wrote: I see no mention of the maven artifacts in the list below. Ralph On Jul 15, 2012, at 10:42 PM, Mike Percy mpe...@apache.org wrote: Hi folks, Although the release vote

Re: Waiting for TLP web site before 1.2.0 release

2012-07-18 Thread Ralph Goers
with the unreadable text - I looked on Firefox on Mac and it seems OK. Can you provide a link? If we can fix that or if it's not a blocker than I will complete the release and send the ANNOUNCE email this evening. Regards, Mike On Wed, Jul 18, 2012 at 1:17 PM, Ralph Goers ralph.go

Re: Waiting for TLP web site before 1.2.0 release

2012-07-18 Thread Ralph Goers
PM, Ralph Goers ralph.go...@dslextreme.comwrote: The Flume site is live at http://flume.apache.org/, however I've noticed at least one problem - the text for releases on the release page is white on a white background so it looks like there is nothing there. If you actually click on them

Flume 1.2.0 documentation

2012-07-23 Thread Ralph Goers
I have updated the web site with the 1.2.0 documentation at http://flume.apache.org/releases/1.2.0.html.

Review Request: Removes the documentation from Flume trunk since it is now in the web site.

2012-07-29 Thread Ralph Goers
://reviews.apache.org/r/6197/diff/ Testing --- Thanks, Ralph Goers

Re: svn commit: r1367198 - /flume/trunk/flume-ng-doc/sphinx/FlumeUserGuide.rst

2012-07-30 Thread Ralph Goers
verify that I do have sufficient privileges to commit to site? Jarcec On Mon, Jul 30, 2012 at 11:16:42AM -0700, Ralph Goers wrote: Please update the documentation on the web site as it is now out of date. Ralph On Jul 30, 2012, at 11:06 AM, jar...@apache.org wrote: Author: jarcec

Re: svn commit: r1367198 - /flume/trunk/flume-ng-doc/sphinx/FlumeUserGuide.rst

2012-07-30 Thread Ralph Goers
30, 2012 at 11:44:33AM -0700, Ralph Goers wrote: You tried to checkout and commit to https://svn.apache.org/repos/asf/flume/site/trunk? Ralph On Jul 30, 2012, at 11:38 AM, Jarek Jarcec Cecho wrote: Hi Ralph, thanks for reminding that. I've tried to commit the change also to site

Re: svn commit: r1367198 - /flume/trunk/flume-ng-doc/sphinx/FlumeUserGuide.rst

2012-07-30 Thread Ralph Goers
-0700, Ralph Goers wrote: No, that is correct. It is just surprising as it means that your access is somehow limited below the flume directory, which shouldn't be the case. Ralph On Jul 30, 2012, at 11:50 AM, Jarek Jarcec Cecho wrote: Yes I did. Is that incorrect way how to upgrade

Re: [jira] [Commented] (FLUME-1424) File Channel should support encryption

2012-08-10 Thread Ralph Goers
It would be great for you to pick this up. We need this at Intuit asap and we are planning on having one of our engineers work on it next week if no one here can do it first. What I had suggested was to have add a FlumeEventFactory that could be configurable. We could then use an

Re: [DISCUSS] Annotating interface scope/stability in Flume

2012-08-14 Thread Ralph Goers
I have a slightly different take on this. I've been trying to embed Flume within the Log4j 2 client and have found that things that look like they are extendable actually aren't and that Flume configuration is actually pretty brittle (the properties don't seem to be isolated to one place but

Re: [DISCUSS] Annotating interface scope/stability in Flume

2012-08-14 Thread Ralph Goers
On Aug 14, 2012, at 9:47 AM, Will McQueen wrote: Something to consider: Eclipse uses the string 'internal' in their package path to denote packages (public or otherwise) that are not intended to be used as a public API: All packages that are part of the platform implementation but contain

Re: [jira] [Commented] (FLUME-1424) File Channel should support encryption

2012-08-20 Thread Ralph Goers
below but not based on input/output streams. My findings are that it is possible to use built in JCE supported algorithms such as PBEWithMD5AndDES but have not yet done a performance impact analysis. Regards, Arvind Prabhakar On Fri, Aug 10, 2012 at 3:31 PM, Ralph Goers ralph.go

Re: Duplicate on failover

2012-08-27 Thread Ralph Goers
Does anyone have any thoughts on this? Is it possibly related to any of the issues already being fixed on the FileChannel? Ralph On Aug 26, 2012, at 4:05 PM, Ralph Goers wrote: I have successfully embedded Flume into the Log4j 2 Appender. However, I have a unit test that has Flume fail over

Re: Duplicate on failover

2012-08-30 Thread Ralph Goers
that there will be duplicates. And no, this is not related to any of the FileChannel issues we have been fixing. Thanks, Hari -- Hari Shreedharan On Thursday, August 30, 2012 at 7:50 AM, Ralph Goers wrote: I'm going to try again. Does this problem sound familiar to anyone? Ralph

Re: Duplicate on failover

2012-08-31 Thread Ralph Goers
? Hari -- Hari Shreedharan On Thursday, August 30, 2012 at 9:44 AM, Ralph Goers wrote: Thanks Hari, First, remember that the Flume agent is embedded in the Appender. So the Log4j EventSource is passing the event to the FileChannel. The Avro Sink then reads from the channel

Re: API Docs and PDFs on the website

2012-12-04 Thread Ralph Goers
On Dec 4, 2012, at 8:16 AM, Brock Noland wrote: Hi, I assume the PDFs and API Docs on the release page http://flume.apache.org/releases/1.3.0.html are just manually generated and then committed directly to the prod website? Yes - it looks like you did it correctly. Unfortunately, the

Re: [DISCUSS] Wiki vs Website

2012-12-06 Thread Ralph Goers
On Dec 6, 2012, at 4:27 AM, Brock Noland wrote: Hi, At present I feel like our documentation is split half way between the wiki and the website. What are the guidelines as to what goes on the wiki vs the website? FWIW, I am fan of the MRUnit website(http://mrunit.apache.org/). Note

Re: HTML guides on Flume web site

2012-12-06 Thread Ralph Goers
This stems from the discussion a while back on where the guides should live. I built the site with the intention that they would move there. You simply need to copy what is in the code branch and check it in to the site branch. I got tired of reminding people to keep them in synch and stopped

Re: Flume cassandra data model

2013-02-11 Thread Ralph Goers
We have a Cassandra sink that writes to different column families based on the event type (a header attribute). Each type has its own handler. Right now the handlers are hard-coded, but I think your idea of using a configuration file would allow it to be generic. We also write to multiple

Re: Returns 127.0.0.1 at HostInterceptor

2013-02-11 Thread Ralph Goers
Sorry to jump on this thread so late but you should be aware that getLocalHost() seems to have a nasty habit of throwing a HostNotFoundException on Java 7. I ran into this in Log4j 2 and had to write some code to deal with that when it happens. See

Re: Unique row key

2013-02-13 Thread Ralph Goers
See https://svn.apache.org/repos/asf/logging/log4j/log4j2/trunk/flume-ng/src/main/java/org/apache/logging/log4j/flume/appender/FlumeEvent.java and then look at the addGuid method. Ralph On Feb 13, 2013, at 8:35 PM, Sri Ramya wrote: hi, How to generate a unique row key for every event in

Re: Unique row key

2013-02-14 Thread Ralph Goers
Only on a single machine with a single cpu. Multiple machines could still generate the same value. Multiple threads on the same machine could generate the same value. The uuid log4j 2 uses accounts for this. The Cassandra FAQ wiki page discusses using a uuid but the project it references is

Re: [DISCUSS] Flume 1.4 release plan

2013-05-29 Thread Ralph Goers
to be straightforward to provide backward compatibility with the previous APIs, but I'm willing to be proven wrong... Regards, Mike On Sun, May 26, 2013 at 7:58 AM, Ralph Goers ralph.go...@dslextreme.comwrote: The one concern I have is that when adding support for embedded agents some classes were

Re: Log42 embedded Flume agent fails to rollback (log4j2-278)

2013-06-11 Thread Ralph Goers
I am a bit confused. At line 566 Log calls SLF4J so you will only end up back in Log4j 2 if you have made Log4j 2 the SLF4J implementation. That shouldn't cause any problems. Having Flume (or any other code such as Hibernate) attempt to log from inside an Appender is expected and would be

Re: [DISCUSSION] Flume-Kafka 0.9 Support

2015-12-22 Thread Ralph Goers
Why not simply move the “old” kafka components to their own maven module? Then you can keep them as part of the distribution for the next release or two. Ralph > On Dec 22, 2015, at 8:10 AM, Jarek Jarcec Cecho wrote: > > It’s unfortunate that in order to support the new

Reviews

2016-02-08 Thread Ralph Goers
I submitted a review for Flume 2875 a week ago. I have updated it a few times since then, the last being on Feb 5. No one has apparently looked at the Review. As you might know, I am not a fan of RTC for the exact reason that it slows everything down with no assurance of any value being

Re: Review Request 43231: Review request to support size based rolling for RoleFileSink

2016-02-05 Thread Ralph Goers
requiring a filename be specified where it wasn't required before, so anyone upgrading will be required to modify their configuration. - Ralph Goers On Feb. 5, 2016, 12:30 a.m., Pushkar Raste wrote: > > --- > This is an auto

Re: [jira] [Updated] (FLUME-2875) Allow RollingFileSink to specify a file prefix and a file extension.

2016-02-08 Thread Ralph Goers
r? > > On Fri, Feb 5, 2016 at 2:41 PM, Ralph Goers (JIRA) <j...@apache.org> wrote: > >> >> [ >> https://issues.apache.org/jira/browse/FLUME-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel >> ] >> >> Ralph Goers update

Re: Reviews

2016-02-08 Thread Ralph Goers
delay - I have been out for a bit and will look at bunch of > pending reviews this week. I am looking at yours right now. > > On Mon, Feb 8, 2016 at 8:00 AM Ralph Goers <ralph.go...@dslextreme.com> > wrote: > >> I submitted a review for Flume 2875 a week ago. I have updated it

Re: Review Request 43100: Patch for FLUME-2875

2016-02-04 Thread Ralph Goers
> -- Pushkar Raste > Out of curiosity, is there a 72hr rule that says if no one bothers to look > at the review I can just go ahead and commit it? > > Ralph > >> On Feb 2, 2016, at 11:01 PM, Ralph Goers <rgo...@apache.org> wrote: >> >> >> ---

Re: Review Request 43100: Patch for FLUME-2875

2016-02-04 Thread Ralph Goers
on around it. How can I create > s review request? > > -- Pushkar Raste > On Feb 4, 2016 9:08 AM, "Ralph Goers" <ralph.go...@dslextreme.com> wrote: > >> Did you create a review request in ReviewBoard? >> >> Ralph >> >

Re: Flume build hangs and fails in Kafka channel

2016-02-01 Thread Ralph Goers
reedha...@apache.org> wrote: > > Looks like the test is just waiting for something to happen - looks > like the test is not working as expected. I don't see this, but this > indicates the test is flakey. > > On Mon, Feb 1, 2016 at 8:22 AM, Ralph Goers <ralph.go...@dslextreme.com>

Re: Review Request 43100: Patch for FLUME-2875

2016-02-02 Thread Ralph Goers
/r/43100/diff/ Testing --- Thanks, Ralph Goers

Flume build hangs and fails in Kafka channel

2016-02-01 Thread Ralph Goers
I am trying to run the Flume build on my MacBook Pro and it is hanging running the tests for the Kafka file channel. A portion of the stack trace is below. After 15 minutes of waiting the build just terminates with no errors - it just emits [ERROR] Failed to execute goal

Re: Review Request 43100: Patch for FLUME-2875

2016-02-03 Thread Ralph Goers
Out of curiosity, is there a 72hr rule that says if no one bothers to look at the review I can just go ahead and commit it? Ralph > On Feb 2, 2016, at 11:01 PM, Ralph Goers <rgo...@apache.org> wrote: > > > --- > Thi

Review Request 43100: Patch for FLUME-2875

2016-02-02 Thread Ralph Goers
/sink/RollingFileSink.java 9cb3370 flume-ng-core/src/test/java/org/apache/flume/sink/TestRollingFileSink.java 07fa644 Diff: https://reviews.apache.org/r/43100/diff/ Testing --- Thanks, Ralph Goers

Re: Github integration

2016-03-24 Thread Ralph Goers
The ASF allows github to be the primary scm? That is news to me. My understanding is that projects have to use the ASFs git repo but you can pull changes from the github mirror. Ralph > On Mar 19, 2016, at 12:14 PM, Hari Shreedharan > wrote: > > Hi, > > I have

Re: Question about flume 1.6.0 source code

2016-03-02 Thread Ralph Goers
If I am not mistaken the “missing” classes are generated during the build by Avro. Ralph > On Mar 2, 2016, at 12:53 AM, Jason wrote: > > Hi guys, > > I'm going to use flume 1.6.0 in my project, and I checked out the source > code from git. I found some errors in my

Re: [DISCUSS] Flume 1.7 release plan

2016-09-30 Thread Ralph Goers
FWIW, missing the train wouldn’t be that big a deal if you knew the next release wouldn’t be too far out. A release a quarter would be a nice target. Ralph > On Sep 30, 2016, at 8:36 AM, Mike Percy wrote: > > On Fri, Sep 30, 2016 at 2:13 PM, Denes Arvay

Re: Migrate to Log4j 2

2016-10-21 Thread Ralph Goers
FYI, I have been using Log4j 2 in my Flume deployments for over a year, despite whatever Flume or its dependencies are using for an API. Having Flume come preconfigured for Log4j 2 would be nice. It will take some work to convert the code to use the Log4j 2 API. At a minimum all the log4j

Re: Migrate to Log4j 2

2016-10-21 Thread Ralph Goers
I should point out that Log4j 2 has shipped a Flume Appender since before it went GA. The Flume Log4j Appender is for users who use Log4j 1.x to connect to Flume. There really is no reason to drop that even if Flume itself starts using Log4j 2. Since Flume is a standalone app there really isn’t

Re: Writing custom metrics service to send flume metric data to a outside running application

2017-03-27 Thread Ralph Goers
id. Can you just give me > information of about how can we use rest API call or JMX functionality to get > the flume metrics. > > Regards > Naveenkumar > >> On 28-Mar-2017, at 7:09 AM, Ralph Goers <ralph.go...@dslextreme.com> wrote: >> >> I’m not really sure wh

Re: Writing custom metrics service to send flume metric data to a outside running application

2017-03-27 Thread Ralph Goers
> Regards > Naveenkumar > >> On 28-Mar-2017, at 8:11 AM, Ralph Goers <ralph.go...@dslextreme.com> wrote: >> >> See http://flume.apache.org/FlumeUserGuide.html#monitoring >> <http://flume.apache.org/FlumeUserGuide.html#monitoring> >> >>

Re: Writing custom metrics service to send flume metric data to a outside running application

2017-03-27 Thread Ralph Goers
I’m not really sure what you are after. Flume already has metrics available via JMX or REST API calls. I am using the REST request to get the data into Splunk. From there I can graph all of that historically. What are you trying to do that is different than that? Ralph > On Mar 27, 2017, at

Re: [DISCUSS] Flume 1.8 release proposal

2017-09-12 Thread Ralph Goers
> On Sep 12, 2017, at 7:46 AM, Tristan Stevens wrote: > > FWIW: > I’m not overly in favour of rushing a release out when we have many JIRAs > with patches submitted, especially when some of those are +1’d by multiple > reviewers. Rushing a release? It has been a year

Re: Message Lists

2017-12-19 Thread Ralph Goers
I’ll give this another day and if there are no objections I will go ahead and create Infra issues to do this. Ralph > On Dec 12, 2017, at 9:46 PM, Ralph Goers <ralph.go...@dslextreme.com> wrote: > > I am proposing that we create a new list for automated messages. I am >

Message Lists

2017-11-11 Thread Ralph Goers
Currently all the messages from Jenkins, Jira and GitHub land in this mailing list. That makes this mailing list very cluttered and it is easy to miss discussions. Other projects use a “notifications” list to accept emails from those sources so the dev list can be left for person-to-person

Re: Migrate to Log4j 2

2017-11-03 Thread Ralph Goers
I have submitted https://github.com/apache/flume/pull/181 <https://github.com/apache/flume/pull/181> to implement this. The only component still dependent on log4j 1.x is Flume’s Log4j Appender. Ralph > On Oct 21, 2016, at 3:23 PM, Ralph Goers <ralph.go...@dslextreme.com> wrote

Re: Migrate to Log4j 2

2017-11-06 Thread Ralph Goers
FWIW, the pull request was modified to remove the extraneous files. Please review. Ralph > On Nov 3, 2017, at 8:58 AM, Ralph Goers <ralph.go...@dslextreme.com> wrote: > > I have submitted https://github.com/apache/flume/pull/181 > <https://github.com/apache/flume/p

Re: Migrate to Log4j 2

2017-11-09 Thread Ralph Goers
u > when I am done with it. > > On Thu, Nov 9, 2017 at 7:24 PM, Ralph Goers <ralph.go...@dslextreme.com> > wrote: > >> The patch was modified to address the review comments. If there are no >> other comments I will merge the branch this weekend. >> >> R

Re: Migrate to Log4j 2

2017-11-09 Thread Ralph Goers
The patch was modified to address the review comments. If there are no other comments I will merge the branch this weekend. Ralph > On Nov 6, 2017, at 10:09 PM, Ralph Goers <ralph.go...@dslextreme.com> wrote: > > FWIW, the pull request was modified to remove the extraneou

Logging article

2017-10-30 Thread Ralph Goers
I thought you all might like this since it mentions Flume - https://github.com/jvz/jvz.github.io/blob/logging/_posts/2017-10-30-logging.md . Ralph

Re: Message Lists

2018-01-05 Thread Ralph Goers
Infra says that Jira emails should now be going to iss...@flume.apache.org <mailto:iss...@flume.apache.org>. Ralph > On Dec 27, 2017, at 10:25 PM, Ralph Goers <ralph.go...@dslextreme.com> wrote: > > Ping > > Ralph > >> On Dec 22, 2017, at 1:23 PM, Ral

Re: Squash commits on trunk

2018-01-26 Thread Ralph Goers
This looks correct to me. Ralph > On Jan 26, 2018, at 8:45 AM, Denes Arvay wrote: > > Hi Flume Community, > > I have squashed the previously mentioned commits on my fork, I'd be happy > if you could have a look on it: >

Re: Merging to trunk?

2018-01-26 Thread Ralph Goers
The “right” way to deal with this from a Maven perspective is to declare the version you want in the dependencyManagement section of the parent pom and to not specify any versions in child poms. Then use the Maven enforcer plugin to make sure everything required has a declaration in the

Re: Message Lists

2017-12-22 Thread Ralph Goers
ut it seems like overkill for a project > with the volume of pull requests that Flume has right now. > > My 2 cents, > Mike > > On Tue, Dec 19, 2017 at 7:48 AM, Ralph Goers <ralph.go...@dslextreme.com> > wrote: > >> I’ll give this another day and if there are no

Re: Message Lists

2017-12-27 Thread Ralph Goers
Ping Ralph > On Dec 22, 2017, at 1:23 PM, Ralph Goers <ralph.go...@dslextreme.com> wrote: > > I created https://issues.apache.org/jira/browse/INFRA-15710 > <https://issues.apache.org/jira/browse/INFRA-15710>. It seems that creating > mailing lists is now self servi

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-30 Thread Ralph Goers
. > > Mike > >> On Nov 30, 2018, at 2:20 PM, Ralph Goers wrote: >> >> Mike, >> >> This response confuses me. Are you saying that because the customers are >> good with the config change Flume 1.9 can go out with Log4j 2 or are you >> saying you

Re: [DISCUSS] Flume 1.9 release proposal

2018-12-04 Thread Ralph Goers
I am noticing that the release notes on the 1.9 branch have not been updated to say changes to the logging configuration will be required in the next release as it will be upgraded to Log4j 2. Ralph > On Nov 30, 2018, at 8:33 PM, Ralph Goers wrote: > > Ok, I’m fine with that. &

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-30 Thread Ralph Goers
ike Percy wrote: > > After speaking with a couple of large users of Flume, because log4j2 is ABI > compatible with log4j1 It sounds like the config change will be acceptable to > them at upgrade time and so I am +1 on this proposal. > > Regards, > Mike > >> On Nov

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-23 Thread Ralph Goers
Also, please put details in the Jira issues. It is much easier to find out why something was done by searching Jira later on then searching the mailing list. Ralph > On Nov 23, 2018, at 9:47 AM, Ralph Goers wrote: > > I do not understand this at all. Log4j 2 provides runtime comp

Re: What do we do with Integrations with no maintainer?

2018-11-23 Thread Ralph Goers
Log4j 2 has implemented a plugin system that you could copy. I will tell you the one obstacle we had to overcome was that locating plugins via ClassLoader scanning at runtime is very slow and was noticeably impacting startup times. That is why Log4j 2 uses an annotation processor at compile

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-23 Thread Ralph Goers
I should also note that since today is a semi-holiday in the US please do not commit anything with regards to this until this is cleared up as I may or may not be able to respond immediately. Ralph > On Nov 23, 2018, at 9:47 AM, Ralph Goers wrote: > > I do not understand this at a

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-23 Thread Ralph Goers
I do not understand this at all. Log4j 2 provides runtime compatibility with Log4j 1. What is the problem that requires a revert? I have been running Flume with Log4j 2 since 1.6 so I don’t understand what the problem could possibly be. Ralph > On Nov 23, 2018, at 8:50 AM, Ferenc Szabo

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-23 Thread Ralph Goers
he upgrade without changing it. > > Or am I missing a feature that would solve this case? > > On Fri, Nov 23, 2018 at 5:49 PM Ralph Goers > wrote: > >> Also, please put details in the Jira issues. It is much easier to find out >> why something was done by searching Jira

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-24 Thread Ralph Goers
al way wasn’t possible. Ralph > > Mike > > On Fri, Nov 23, 2018 at 9:39 AM Ralph Goers > wrote: > >> No, you are correct. However, requiring a change to logging configuration >> has never been considered a binary compatibility break in any project I >> have

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-24 Thread Ralph Goers
ting to know how to make something they were doing in Log4j 1 work in >> Log4j 2. >> >> As you can imagine, since Log4j 2 has been GA now for 4 1/2 years and >> Log4j 1 has been EOL for over 3, making the configuration compatible with >> Log4j 1 is not a high priori

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-24 Thread Ralph Goers
t this migration pain on Flume users -- something that > simply can't be tolerated, even in a minor release, like a new and highly > dangerous security bug. Without such a motivation, I don't see how this > incompatible dependency change can be justified. > > Mike >

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-27 Thread Ralph Goers
19:54:01, Mike Percy (mpe...@apache.org) wrote: > > Yeah, I agree with this, especially classloader isolation would be great to > have as well on the plugin side. > > Mike > > On Mon, Nov 26, 2018 at 11:50 AM Ralph Goers > wrote: > >> I think people want to do mo

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-26 Thread Ralph Goers
nge to a future release where incompatible changes are >>> expected, such as Flume 2.0. >>> >>> Also, maybe there are other options I haven't thought of...? >>> >>> I would like to get some input from more people on this matter. How do >>> others f

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-28 Thread Ralph Goers
9 > > So, Ferenc, I think you are good to go with the proposed plan, unless > anybody vetoes. > > Regards, > Denes > > On Tue, Nov 27, 2018 at 4:37 PM Ralph Goers > wrote: > >> While Log4j 2 supports using properties files for configuration it is not >

Re: [DISCUSS] Flume 1.9 release proposal

2018-11-26 Thread Ralph Goers
;> I have directed it to the community, the PMC members. >>> I am looking for a decision from the PMC members (including You) on whether >>> we should continue as planned or not removing log4j2 form the minor release >>> branch. >>> >>&g

Re: [VOTE] Release Apache Flume version 1.9.0 RC3

2018-12-28 Thread Ralph Goers
Thanks, I appreciate the consideration. I did review the change to the release notes right after I saw the commit and am fine with the wording used. I have not had a chance to physically verify the release contents but am fine with everything I have seen. Ralph > On Dec 28, 2018, at 12:50 PM,

Re: Updating 3rd party dependencies

2019-05-09 Thread Ralph Goers
flume/compare/trunk...szaboferee:j11?expand=1 > > > > > On Fri, May 3, 2019 at 6:58 PM Ralph Goers > wrote: > >> I don’t think a major version change should be necessary just because the >> JDK dependency changed. Changing the major version number should ti

Re: Updating 3rd party dependencies

2019-05-03 Thread Ralph Goers
I don’t think a major version change should be necessary just because the JDK dependency changed. Changing the major version number should tied to major changes in the project itself. I am curious to know what dependencies now only run on Java 11. Ralph > On May 3, 2019, at 5:02 AM, Ferenc

Configuration

2019-04-28 Thread Ralph Goers
Just a bit of forewarning. I have a need to use centralized configuration for Flume using Spring Cloud Config. As such I will be making changes to Flume’s configuration which will include: Support for accessing the configuration via HTTP with Last-Modified checks Support for detecting

Re: Better Marketing

2019-04-28 Thread Ralph Goers
C? The memory > channel tends to allocate and reclaim a lot of memory in a short period of > time. > > Mike > > Sent from my iPhone > >> On Apr 28, 2019, at 11:35 AM, Ralph Goers wrote: >> >> What I am seeing is that people go to the home page and cut the fir

Better Marketing

2019-04-28 Thread Ralph Goers
When I read sites like https://www.slant.co/versus/959/960/~fluentd_vs_flume I get a bit discouraged at how people misunderstand Flume. Even a site like https://www.predictiveanalyticstoday.com/data-ingestion-tools/

Re: Better Marketing

2019-04-28 Thread Ralph Goers
gt; you please elaborate, Ralph? > > > Thank you, > > Donat > > On Sun, Apr 28, 2019 at 6:19 PM Ralph Goers > wrote: >> >> When I read sites like https://www.slant.co/versus/959/960/~fluentd_vs_flume >> <https://www.slant.co/versus/959/960/~fluentd_vs

Re: Better Marketing

2019-04-28 Thread Ralph Goers
; > Donat > > On Sun, Apr 28, 2019 at 8:36 PM Ralph Goers > wrote: >> >> What I am seeing is that people go to the home page and cut the first >> paragraph as a description of Flume. All I am really proposing is that we >> change that to more effectivel

Re: The Flume website

2020-08-30 Thread Ralph Goers
I worked this weekend on the Log4j site but still have not gotten it completely working. The Flume site is much simpler so I expect it to go fairly quickly once I get started. Ralph > On Aug 19, 2020, at 8:27 AM, Ralph Goers wrote: > > They pinged Logging last week. I imagine I w

Re: The Flume website

2020-08-19 Thread Ralph Goers
They pinged Logging last week. I imagine I will start looking into that over the weekend. Once I have figured out how to deal with that I could look at Flume, unless someone else wants to do it. As I recall Flume’s website is a bit simpler than the Logging site. Ralph > On Aug 18, 2020, at

Re: The Flume website

2020-09-21 Thread Ralph Goers
OK. I have updated the live web site. I still need to update the confluence instructions. Ralph > On Sep 20, 2020, at 12:52 PM, Ralph Goers wrote: > > I have created the flume web site in https://github.com/apache/flume-site > <https://github.com/apache/flume-site>. The

Re: The Flume website

2020-09-20 Thread Ralph Goers
ed to update the Performing a Release page in Confluence. Ralph > On Aug 30, 2020, at 10:22 PM, Ralph Goers wrote: > > I worked this weekend on the Log4j site but still have not gotten it > completely working. The Flume site is much simpler so I expect it to go > fairly quickly onc

Re: Any news/plans about a new release?

2021-06-29 Thread Ralph Goers
Yes, there are plans but nothing definitive. Ralph > On Jun 29, 2021, at 8:43 AM, Кон�тантин Кракович > wrote: > > Hi Team, > > We started to use Apache Flume 1.9. WhiteSource found vulnerabilities in > libraries related to Flume. Do you have plans to fix it? Any news

Re: The Flume website

2021-03-01 Thread Ralph Goers
rew Wetmore wrote: > > Hi, all, and Happy New Year! > > Any further progress on finishing up the site migration? > > Andrew > > On 2020/09/21 18:47:37, Ralph Goers wrote: >> OK. I have updated the live web site. I still need to update the confluence >> in

Re: [DISCUSS] Introduce a new configuration based on flinksql

2021-12-03 Thread Ralph Goers
I’m afraid I just don’t grasp the idea of using something SQL-like to configure Flume. It might be helpful to show a configuration using the current properties syntax vs how it would be done with flinksql. I am also curious if this is something you have already gotten working. When I was

Release work

2021-11-15 Thread Ralph Goers
Someone raised a Jira issue to ask about the next release. I closed it as that is not the proper place to ask about releases. This list is the correct place to discuss it. I recently committed an enhancement to Flume Configuration to allow it to get it’s configuration via URI(s) as I have a

PR #347 - Configuration via HTTP

2021-10-27 Thread Ralph Goers
As I have been promising for quite some time I finally finished the work to support configuration using a URI. I know almost no one has been active in a long time and this is a fairly large PR but I would appreciate you giving it a look over before I merge it. Once this PR is applied I plan

Re: The Flume website-leaving the Apache CMS

2021-07-15 Thread Ralph Goers
Yes, you have the status correct. I don’t see any documentation on updating the CMS so I guess I will need to create a new wiki page to document publishing the site. I guess I had forgotten to submit a Jira ticket to shut down Flume on the CMS. I should be able to do both of these in the next

Morphlines-solr-sink

2022-01-13 Thread Ralph Goers
While I am not having any trouble building the morphline-solr-sink component, it is dependent on the abandoned kite-sdk, which makes its life very limited. In addition, the kite-sdk has a dependency on parquet-avro which, according to https://issues.apache.org/jira/browse/FLUME-3403, has

Re: Flume release that includes the log4j patches.

2022-01-12 Thread Ralph Goers
Given that the Kite Dataset Sink is documented as being experimental and since Kite appears to have been abandoned I am making the decisions to remove the Kite Dataset Sink from Flume. Ralph > On Jan 12, 2022, at 9:14 AM, Ralph Goers wrote: > > I am working o

Re: Flume release that includes the log4j patches.

2022-01-12 Thread Ralph Goers
I am working on exactly that. But there are quite a few dependencies that need to be updated besides Log4j. That update was pretty easy. I am currently trying to update the Avro dependency as it also has security issues. Unfortunately, Avro’s upgrade is not completely binary compatible, which

Re: Flume release that includes the log4j patches.

2022-01-12 Thread Ralph Goers
e a good enough > justification. > > > Donat > > On Wed, Jan 12, 2022 at 6:22 PM Ralph Goers > wrote: >> >> Given that the Kite Dataset Sink is documented as being experimental and >> since Kite appears to have been abandoned I am making the decisions to &g

Re: [DISCUSS] release planning

2022-03-08 Thread Ralph Goers
Answers inline below. FWIW, these are my opinions. I don’t know that the PMC has ever made declarations to these. > On Mar 8, 2022, at 8:34 AM, Sean Busbey wrote: > > > Hi folks! > > Apologies if I missed this discussion; I’ve read back through the dev list > through 2021. I wanted to make

Re: [DISCUSS] consolidating and documenting contributor guidelinees

2022-03-08 Thread Ralph Goers
> On Mar 8, 2022, at 8:55 AM, Sean Busbey wrote: > > > Hi folks! > > Right now we have contributor guidelines in a couple of places: > > * source tree as CONTRIBUTING.md and DEVNOTES, visible on GitHub > * confluence on a HOW TO CONTRIBUTE and Developer Section pages, linked from > the

  1   2   3   >