Re: [VOTE] Release Apache Flume version 1.7.0 RC2

2016-10-16 Thread Brock Noland
+1 (binding) Checked sigs and hashes, manual inspection of various other aspects. On Thu, Oct 13, 2016 at 12:54 PM, Hari Shreedharan wrote: > +1 (binding) > > Signatures and checksums look good > Top level files are all good. > Build runs fine, simple agent with Seq

Re: [DISCUSSION] Flume-Kafka 0.9 Support

2015-12-22 Thread Brock Noland
There are many ways to approach this problem and I think I have worked on a at least one project which has tried them all: Apache MRUnit => Kept versions in maven modules and eventually separate source trees Apache Hive (and Parquet ) => Used an extensive "shim" layer to allow Hive to work with

[jira] [Commented] (FLUME-1734) Create a Hive Sink based on the new Hive Streaming support

2014-12-18 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252203#comment-14252203 ] Brock Noland commented on FLUME-1734: - That sounds fine to me. +1 on the statement

Re: Review Request 18544: Hive Streaming sink

2014-10-14 Thread Brock Noland
commented code - Brock Noland On Sept. 3, 2014, 3:19 a.m., Roshan Naik wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18544

[jira] [Commented] (FLUME-2450) Improve replay index insertion speed.

2014-09-01 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14117824#comment-14117824 ] Brock Noland commented on FLUME-2450: - bq. I had 45gigs of data parked in the file

[jira] [Commented] (FLUME-2425) FileChannel should trim data and checkpoint directories

2014-08-22 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107310#comment-14107310 ] Brock Noland commented on FLUME-2425: - +1 FileChannel should trim data

[jira] [Created] (FLUME-2425) FileChannel should trim data and checkpoint directories

2014-07-16 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2425: --- Summary: FileChannel should trim data and checkpoint directories Key: FLUME-2425 URL: https://issues.apache.org/jira/browse/FLUME-2425 Project: Flume Issue

[jira] [Created] (FLUME-2418) Log4J Appender should have batching option

2014-07-07 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2418: --- Summary: Log4J Appender should have batching option Key: FLUME-2418 URL: https://issues.apache.org/jira/browse/FLUME-2418 Project: Flume Issue Type

[jira] [Updated] (FLUME-2245) HDFS files with errors unable to close

2014-05-15 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2245: Attachment: FLUME-2245.patch Attached is the patch which fixed the issue for me. HDFS files

[jira] [Commented] (FLUME-2245) HDFS files with errors unable to close

2014-05-14 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997254#comment-13997254 ] Brock Noland commented on FLUME-2245: - Hi, Yes, I was able to test

[jira] [Created] (FLUME-2383) Add option to enable agent exit if a component fails to start

2014-05-14 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2383: --- Summary: Add option to enable agent exit if a component fails to start Key: FLUME-2383 URL: https://issues.apache.org/jira/browse/FLUME-2383 Project: Flume

[jira] [Commented] (FLUME-2245) HDFS files with errors unable to close

2014-05-13 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997278#comment-13997278 ] Brock Noland commented on FLUME-2245: - Note that it's just the try and catch

[jira] [Commented] (FLUME-2351) Ability to override any parameter from the configuration file

2014-05-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995352#comment-13995352 ] Brock Noland commented on FLUME-2351: - Generally I think this is ok. I don't see

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2014-05-01 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986650#comment-13986650 ] Brock Noland commented on FLUME-2181: - +1 Thank you Hari! I will run tests

[jira] [Updated] (FLUME-2181) Optionally disable File Channel fsyncs

2014-04-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2181: Attachment: FLUME-2181-2.patch [~hshreedharan] I had some spare time so I rebased the patch

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2014-04-03 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959591#comment-13959591 ] Brock Noland commented on FLUME-2181: - [~hshreedharan] can you post an updated patch

[jira] [Resolved] (FLUME-2078) FileChannel periodic fsync should be supported

2014-04-03 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland resolved FLUME-2078. - Resolution: Duplicate FileChannel periodic fsync should be supported

[jira] [Created] (FLUME-2347) Add FLUME_JAVA_OPTS which allows users to inject java properties from cmd line

2014-03-20 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2347: --- Summary: Add FLUME_JAVA_OPTS which allows users to inject java properties from cmd line Key: FLUME-2347 URL: https://issues.apache.org/jira/browse/FLUME-2347 Project

[jira] [Updated] (FLUME-2347) Add FLUME_JAVA_OPTS which allows users to inject java properties from cmd line

2014-03-20 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2347: Attachment: FLUME-2347.patch Add FLUME_JAVA_OPTS which allows users to inject java properties

[jira] [Commented] (FLUME-2346) idLogFileMap in Log can lose track of file ids

2014-03-17 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938060#comment-13938060 ] Brock Noland commented on FLUME-2346: - Good catch! FYI [~hshreedharan] idLogFileMap

[jira] [Created] (FLUME-2342) Document FLUME-2311 - Use standard way of finding queue/topic

2014-03-05 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2342: --- Summary: Document FLUME-2311 - Use standard way of finding queue/topic Key: FLUME-2342 URL: https://issues.apache.org/jira/browse/FLUME-2342 Project: Flume

[jira] [Commented] (FLUME-2307) Remove Log writetimeout

2014-02-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13896990#comment-13896990 ] Brock Noland commented on FLUME-2307: - +1 I cannot test/commit as I am on an airplane

[jira] [Updated] (FLUME-2311) Use standard way of finding queue/topic

2014-02-07 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2311: Fix Version/s: v1.5.0 Assignee: Hugo Lassiège I committed this to trunk and 1.5! Thank

[jira] [Commented] (FLUME-2311) Use standard way of finding queue/topic

2014-02-06 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13893456#comment-13893456 ] Brock Noland commented on FLUME-2311: - Nice! This patch generally looks great

[jira] [Commented] (FLUME-2311) Use standard way of finding queue/topic

2014-02-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13892641#comment-13892641 ] Brock Noland commented on FLUME-2311: - Thank you!! Use standard way of finding queue

[jira] [Commented] (FLUME-2277) Improve FileChannel documentation to address commons support issues

2014-02-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13892647#comment-13892647 ] Brock Noland commented on FLUME-2277: - [~roshan_naik] Why do we feel 10 seconds

[jira] [Commented] (FLUME-2307) Old log data is not cleaned up

2014-02-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13892648#comment-13892648 ] Brock Noland commented on FLUME-2307: - Can we eliminate the write timeout? I have

[jira] [Commented] (FLUME-2307) Old log data is not cleaned up

2014-02-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13892893#comment-13892893 ] Brock Noland commented on FLUME-2307: - bq. I have wondered for some time what purpose

[jira] [Created] (FLUME-2311) Use standard way of finding queue/topic

2014-02-04 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2311: --- Summary: Use standard way of finding queue/topic Key: FLUME-2311 URL: https://issues.apache.org/jira/browse/FLUME-2311 Project: Flume Issue Type: Bug

[jira] [Commented] (FLUME-924) Implement a JMS source for Flume NG

2014-02-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13890899#comment-13890899 ] Brock Noland commented on FLUME-924: Hi, There is no particular reason...I created

[jira] [Commented] (FLUME-2311) Use standard way of finding queue/topic

2014-02-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13890901#comment-13890901 ] Brock Noland commented on FLUME-2311: - [~hlassiege], would you be in a position

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2014-01-28 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13884367#comment-13884367 ] Brock Noland commented on FLUME-2181: - bq. The first one you mentioned is what I

[jira] [Resolved] (FLUME-1503) TestFileChannel needs to write to tmp folder inside target directory

2014-01-27 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland resolved FLUME-1503. - Resolution: Won't Fix Thank you Ashish! Since no one else has reported let's close for now

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2014-01-24 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13881421#comment-13881421 ] Brock Noland commented on FLUME-2181: - Thank you very much of the new exception types

[jira] [Commented] (FLUME-2277) Improve FileChannel documentation to address commons support issues

2014-01-09 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866691#comment-13866691 ] Brock Noland commented on FLUME-2277: - Thanks Roshan! Should we commit

[jira] [Commented] (FLUME-2285) FileChannel Erroneously Reports Usable Space Exhausted

2013-12-30 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13858882#comment-13858882 ] Brock Noland commented on FLUME-2285: - bq. The drive that the checkpoint and data

[jira] [Commented] (FLUME-1227) Introduce some sort of SpillableChannel

2013-12-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13857070#comment-13857070 ] Brock Noland commented on FLUME-1227: - Thank you for addressing the feedback! I am OK

[jira] [Commented] (FLUME-1491) Dynamic configuration from Zookeeper watcher

2013-12-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852921#comment-13852921 ] Brock Noland commented on FLUME-1491: - Hi Ashish, Great work!! Thank you very much

[jira] [Commented] (FLUME-1227) Introduce some sort of SpillableChannel

2013-12-18 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851768#comment-13851768 ] Brock Noland commented on FLUME-1227: - Hey, I have not participated in the review til

[jira] [Created] (FLUME-2277) Improve FileChannel documentation to address commons upport issues

2013-12-18 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2277: --- Summary: Improve FileChannel documentation to address commons upport issues Key: FLUME-2277 URL: https://issues.apache.org/jira/browse/FLUME-2277 Project: Flume

[jira] [Updated] (FLUME-2277) Improve FileChannel documentation to address commons upport issues

2013-12-18 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2277: Attachment: FLUME-2277.patch Improve FileChannel documentation to address commons upport issues

[jira] [Commented] (FLUME-2277) Improve FileChannel documentation to address commons upport issues

2013-12-18 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851959#comment-13851959 ] Brock Noland commented on FLUME-2277: - [~hshreedharan], attached is a doc update

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2013-12-17 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850563#comment-13850563 ] Brock Noland commented on FLUME-2181: - bq. ignoring bad data essentially means

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2013-12-16 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850079#comment-13850079 ] Brock Noland commented on FLUME-2181: - Ideally I'd only like to implement this if we

[jira] [Resolved] (FLUME-2118) Occasional multi-hour pauses in file channel replay

2013-12-15 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland resolved FLUME-2118. - Resolution: Duplicate This is a duplicate of FLUME-2155 which is now resolved. Occasional

[jira] [Updated] (FLUME-2155) Improve replay time

2013-12-15 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2155: Fix Version/s: v1.5.0 Improve replay time --- Key: FLUME-2155

[jira] [Commented] (FLUME-2268) Increase default transactionCapacity for MemoryChannel from 100 to 10000

2013-12-14 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13848385#comment-13848385 ] Brock Noland commented on FLUME-2268: - I agree that we should remove that check from

Re: Review Request 16107: FLUME-2155: Improve replay time

2013-12-13 Thread Brock Noland
/TestFlumeEventQueue.java 203cbf2 pom.xml 267925f Diff: https://reviews.apache.org/r/16107/diff/ Testing --- Unit tests pass Thanks, Brock Noland

[jira] [Updated] (FLUME-2155) Improve replay time

2013-12-13 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2155: Attachment: FLUME-2155.5.patch Improve replay time --- Key

[jira] [Commented] (FLUME-1860) Remove transaction capacity from Memory and File channels

2013-12-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13846941#comment-13846941 ] Brock Noland commented on FLUME-1860: - Seems like we had an agreement on on setting

[jira] [Created] (FLUME-2264) Log4j Appender + Avro Reflection on string results in an invalid avro schema

2013-12-10 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2264: --- Summary: Log4j Appender + Avro Reflection on string results in an invalid avro schema Key: FLUME-2264 URL: https://issues.apache.org/jira/browse/FLUME-2264 Project

[jira] [Comment Edited] (FLUME-2264) Log4j Appender + Avro Reflection on string results in an invalid avro schema

2013-12-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13844322#comment-13844322 ] Brock Noland edited comment on FLUME-2264 at 12/10/13 2:53 PM

Re: Review Request 16107: FLUME-2155: Improve replay time

2013-12-10 Thread Brock Noland
/TestEventQueueBackingStoreFactory.java dfb3bf9 flume-ng-channels/flume-file-channel/src/test/java/org/apache/flume/channel/file/TestFlumeEventQueue.java 203cbf2 pom.xml 267925f Diff: https://reviews.apache.org/r/16107/diff/ Testing --- Unit tests pass Thanks, Brock Noland

[jira] [Updated] (FLUME-2155) Improve replay time

2013-12-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2155: Attachment: FLUME-2155.4.patch Improve replay time --- Key

[jira] [Created] (FLUME-2262) Log4j Appender should use timeStamp field not getTimestamp

2013-12-09 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2262: --- Summary: Log4j Appender should use timeStamp field not getTimestamp Key: FLUME-2262 URL: https://issues.apache.org/jira/browse/FLUME-2262 Project: Flume Issue

[jira] [Updated] (FLUME-2262) Log4j Appender should use timeStamp field not getTimestamp

2013-12-09 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2262: Attachment: FLUME-2262.patch Log4j Appender should use timeStamp field not getTimestamp

[jira] [Assigned] (FLUME-2262) Log4j Appender should use timeStamp field not getTimestamp

2013-12-09 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland reassigned FLUME-2262: --- Assignee: Brock Noland Log4j Appender should use timeStamp field not getTimestamp

[jira] [Commented] (FLUME-2262) Log4j Appender should use timeStamp field not getTimestamp

2013-12-09 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13843886#comment-13843886 ] Brock Noland commented on FLUME-2262: - Thank you! Log4j Appender should use

[jira] [Updated] (FLUME-2262) Log4j Appender should use timeStamp field not getTimestamp

2013-12-09 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2262: Description: getTimestamp was added in log4j 1.2.15, we should use the timestamp field instead

[jira] [Updated] (FLUME-2155) Improve replay time

2013-12-08 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2155: Attachment: FLUME-2155.2.patch Improve replay time --- Key

Review Request 16107: FLUME-2155: Improve replay time

2013-12-08 Thread Brock Noland
/flume/channel/file/TestFlumeEventQueue.java 203cbf2 pom.xml 267925f Diff: https://reviews.apache.org/r/16107/diff/ Testing --- Unit tests pass Thanks, Brock Noland

[jira] [Commented] (FLUME-2155) Improve replay time

2013-12-08 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842557#comment-13842557 ] Brock Noland commented on FLUME-2155: - RB item https://reviews.apache.org/r/16107

[jira] [Commented] (FLUME-2118) Occasional multi-hour pauses in file channel replay

2013-12-06 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841375#comment-13841375 ] Brock Noland commented on FLUME-2118: - Nevermind my last comment. I do think

[jira] [Commented] (FLUME-2260) Recommend Dual Checkpoints in file channel documentation

2013-12-06 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841380#comment-13841380 ] Brock Noland commented on FLUME-2260: - [~hshreedharan] thoughts on this? Recommend

[jira] [Created] (FLUME-2260) Recommend Dual Checkpoints in file channel documentation

2013-12-06 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2260: --- Summary: Recommend Dual Checkpoints in file channel documentation Key: FLUME-2260 URL: https://issues.apache.org/jira/browse/FLUME-2260 Project: Flume Issue

[jira] [Updated] (FLUME-2155) Improve replay time

2013-12-06 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2155: Attachment: FLUME-FC-SLOW-REPLAY-FIX-1.patch FLUME-FC-SLOW-REPLAY-1.patch Improve

[jira] [Commented] (FLUME-2155) Improve replay time

2013-12-06 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841465#comment-13841465 ] Brock Noland commented on FLUME-2155: - Hi Hari, In my testing this patch does look

[jira] [Commented] (FLUME-2155) Improve replay time

2013-12-06 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841519#comment-13841519 ] Brock Noland commented on FLUME-2155: - Yes, we could use it to store indexes. However

[jira] [Comment Edited] (FLUME-2155) Improve replay time

2013-12-06 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841519#comment-13841519 ] Brock Noland edited comment on FLUME-2155 at 12/6/13 6:29 PM

[jira] [Commented] (FLUME-2155) Improve replay time

2013-12-06 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841565#comment-13841565 ] Brock Noland commented on FLUME-2155: - Sounds good, I am updating it a bit as I think

[jira] [Commented] (FLUME-2118) Occasional multi-hour pauses in file channel replay

2013-12-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840041#comment-13840041 ] Brock Noland commented on FLUME-2118: - I wonder if this issue can be considered

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2013-12-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840246#comment-13840246 ] Brock Noland commented on FLUME-2181: - Hari, Two review items: syncExecutor can

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2013-12-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840421#comment-13840421 ] Brock Noland commented on FLUME-2181: - 1) the close won't occur if the process

[jira] [Comment Edited] (FLUME-2181) Optionally disable File Channel fsyncs

2013-12-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840421#comment-13840421 ] Brock Noland edited comment on FLUME-2181 at 12/5/13 7:04 PM

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2013-12-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840458#comment-13840458 ] Brock Noland commented on FLUME-2181: - bq. We actually have exactly one sequential

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2013-12-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840492#comment-13840492 ] Brock Noland commented on FLUME-2181: - bq. We'd use the checksum for this right

[jira] [Comment Edited] (FLUME-2181) Optionally disable File Channel fsyncs

2013-12-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840518#comment-13840518 ] Brock Noland edited comment on FLUME-2181 at 12/5/13 8:16 PM

[jira] [Commented] (FLUME-2181) Optionally disable File Channel fsyncs

2013-12-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840518#comment-13840518 ] Brock Noland commented on FLUME-2181: - 0. read header - bad event and bad file

[jira] [Commented] (FLUME-2199) Flume builds with new version require mvn install before site can be generated

2013-10-16 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797519#comment-13797519 ] Brock Noland commented on FLUME-2199: - [~abayer] could you post a full patch? I am

[jira] [Commented] (FLUME-2155) Improve replay time

2013-08-13 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13738660#comment-13738660 ] Brock Noland commented on FLUME-2155: - Hari, Thanks for the numbers! I do agree

[jira] [Created] (FLUME-2115) FileChannel tool to truncate files at first sign of corruption

2013-06-27 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2115: --- Summary: FileChannel tool to truncate files at first sign of corruption Key: FLUME-2115 URL: https://issues.apache.org/jira/browse/FLUME-2115 Project: Flume

[jira] [Created] (FLUME-2114) flume-ng script should handle common options such as -verbose:gc

2013-06-26 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2114: --- Summary: flume-ng script should handle common options such as -verbose:gc Key: FLUME-2114 URL: https://issues.apache.org/jira/browse/FLUME-2114 Project: Flume

[jira] [Commented] (FLUME-1285) FileChannel has a dependency on Hadoop IO classes

2013-06-23 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691559#comment-13691559 ] Brock Noland commented on FLUME-1285: - This looks pretty good. Anyone think we

[jira] [Commented] (FLUME-1917) FileChannel group commit (coalesce fsync)

2013-06-23 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691561#comment-13691561 ] Brock Noland commented on FLUME-1917: - Hey Hari, Yeah, I should have noted

[jira] [Commented] (FLUME-1917) FileChannel group commit (coalesce fsync)

2013-06-23 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691572#comment-13691572 ] Brock Noland commented on FLUME-1917: - Thanks Hari! I committed this to trunk and 1.4

[jira] [Commented] (FLUME-1285) FileChannel has a dependency on Hadoop IO classes

2013-06-23 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691574#comment-13691574 ] Brock Noland commented on FLUME-1285: - Running tests. FileChannel

[jira] [Commented] (FLUME-1917) FileChannel group commit (coalesce fsync)

2013-06-22 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691161#comment-13691161 ] Brock Noland commented on FLUME-1917: - Hey Hari, Thanks for the patch! I think

[jira] [Resolved] (FLUME-1586) File Channel should support verifying integrity of individual events.

2013-06-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland resolved FLUME-1586. - Resolution: Fixed Fix Version/s: v1.4.0 Committed! Thanks Hari! File

[jira] [Commented] (FLUME-1586) File Channel should support verifying integrity of individual events.

2013-06-11 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13680486#comment-13680486 ] Brock Noland commented on FLUME-1586: - [~hshreedharan] can you post the patch

[jira] [Created] (FLUME-2077) Umbrella JIRA to track file channel improvments

2013-06-11 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2077: --- Summary: Umbrella JIRA to track file channel improvments Key: FLUME-2077 URL: https://issues.apache.org/jira/browse/FLUME-2077 Project: Flume Issue Type

[jira] [Created] (FLUME-2078) FileChannel periodic fsync should be supported

2013-06-11 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2078: --- Summary: FileChannel periodic fsync should be supported Key: FLUME-2078 URL: https://issues.apache.org/jira/browse/FLUME-2078 Project: Flume Issue Type: New

[jira] [Updated] (FLUME-2077) Umbrella JIRA to track file channel improvments

2013-06-11 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2077: Description: The scope of this JIRA is: 1) FLUME-1968 - New format in support of 2) FLUME-2078

[jira] [Created] (FLUME-2079) Create filechannel v2

2013-06-11 Thread Brock Noland (JIRA)
Brock Noland created FLUME-2079: --- Summary: Create filechannel v2 Key: FLUME-2079 URL: https://issues.apache.org/jira/browse/FLUME-2079 Project: Flume Issue Type: Sub-task Reporter

[jira] [Updated] (FLUME-2063) Add Configurable charset to RegexHbaseEventSerializer

2013-06-02 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated FLUME-2063: Summary: Add Configurable charset to RegexHbaseEventSerializer (was: add a charset setting

[jira] [Commented] (FLUME-2063) add a charset setting to RegexHbaseEventSerializer

2013-06-01 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13672134#comment-13672134 ] Brock Noland commented on FLUME-2063: - Looks good to me. I'd run tests and commits

Re: Review Request: Fix to get version info working on windows

2013-05-29 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11509/#review21154 --- Ship it! Ship It! - Brock Noland On May 29, 2013, 6:59 a.m

[jira] [Commented] (FLUME-2054) Support Version Info on Windows and fix failure of TestVersionInfo

2013-05-29 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669368#comment-13669368 ] Brock Noland commented on FLUME-2054: - Thanks Roshan! I committed to trunk and 1.4

[jira] [Commented] (FLUME-2047) Doc issue with Spooling directory source

2013-05-29 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669706#comment-13669706 ] Brock Noland commented on FLUME-2047: - Good call, it does look to be fixed

[jira] [Resolved] (FLUME-2047) Doc issue with Spooling directory source

2013-05-29 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland resolved FLUME-2047. - Resolution: Duplicate Fix Version/s: (was: v1.4.0) Doc issue with Spooling

Re: Review Request: FLUME-1586. File Channel should support verifying integrity of individual events.

2013-05-23 Thread Brock Noland
https://reviews.apache.org/r/10944/#comment43262 Curious as to what case would make eventPosition == -1? - Brock Noland On May 23, 2013, 8:54 p.m., Hari Shreedharan wrote: --- This is an automatically generated e-mail. To reply, visit

  1   2   3   4   5   6   7   8   9   10   >