[jira] [Commented] (STORM-1971) HDFS Timed Synchronous Policy

2016-07-22 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390106#comment-15390106 ] Aaron Dossett commented on STORM-1971: -- I did not create that approach (although I did carry it over

[jira] [Commented] (STORM-1971) HDFS Timed Synchronous Policy

2016-07-22 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389537#comment-15389537 ] Aaron Dossett commented on STORM-1971: -- Writing each tuple doesn't necessarily result in higher

[jira] [Commented] (STORM-1971) HDFS Timed Synchronous Policy

2016-07-18 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382300#comment-15382300 ] Aaron Dossett commented on STORM-1971: -- [~darion] There is a default value for the tick tuples, 15

[jira] [Updated] (STORM-1917) Storm Redis TTL Control

2016-07-18 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-1917: - Component/s: storm-hdfs > Storm Redis TTL Cont

[jira] [Updated] (STORM-1917) Storm Redis TTL Control

2016-07-18 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-1917: - Component/s: (was: storm-hdfs) > Storm Redis TTL Cont

[jira] [Resolved] (STORM-1909) Fix errors in HDFS Spout documentation

2016-07-18 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-1909. -- Resolution: Fixed Fix Version/s: 1.0.2 > Fix errors in HDFS Spout documentat

[jira] [Commented] (STORM-1971) HDFS Timed Synchronous Policy

2016-07-14 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376905#comment-15376905 ] Aaron Dossett commented on STORM-1971: -- HDFS bolt does support tick tuples to periodically flush data

Storm's use of ASF Parent POM (FW: [ANN] Apache Software Foundation Parent POM Version 18 Released)

2016-05-20 Thread Aaron . Dossett
I see that Storm is using version 10 of this parent pom (https://github.com/apache/storm/blob/master/pom.xml#L21-L25). I will try upgrading to 18, mostly as a learning exercise since I¹m unfamiliar with what this does, unless anyone is aware of an obvious not to bother. Thanks! -Aaron On

Re: Merging to Multiple Branches

2016-05-20 Thread Aaron . Dossett
Is there a best practice for merging a PR to multiple branches? I have struggled with that in the past, probably due to shortcomings in my knowledge of git. I¹d be happy to aggregate suggestions and put them on the Developer page. Thanks! On 5/20/16, 12:08 PM, "P. Taylor Goetz"

Re: Revisiting forgotten discussions regarding more convenience way to maintain project

2016-05-13 Thread Aaron . Dossett
I like the idea of squashing to a single commit and tagging that commit and PR with the JIRA ID. Agree that limiting duplicate emails would be good. On 5/13/16, 6:17 AM, "Abhishek Agarwal" wrote: >1* - Squashing commits is more of a guideline. Committers, specifically,

[jira] [Resolved] (STORM-1464) storm-hdfs should support writing to multiple files

2016-05-13 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-1464. -- Resolution: Fixed > storm-hdfs should support writing to multiple fi

[jira] [Updated] (STORM-1464) storm-hdfs should support writing to multiple files

2016-05-13 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-1464: - Fix Version/s: 2.0.0 > storm-hdfs should support writing to multiple fi

Re: 答复: [DISCUSSION] Version lines of 1.x

2016-05-09 Thread Aaron . Dossett
+1. Same here. On 5/9/16, 5:47 AM, "John Fang" wrote: >I'm also think we shouldn't maintain 0.10.x branch > >-邮件原件- >发件人: Cody Innowhere [mailto:e.neve...@gmail.com] >发送时间: 2016年5月9日 19:42 >收件人: dev@storm.apache.org >主题: Re: [DISCUSSION] Version lines of

Re: [VOTE] Release Apache Storm 1.0.0 (rc1)

2016-04-04 Thread Aaron . Dossett
I am -0 on releasing with a failing test, especially with a fix in hand. On 4/4/16, 10:50 AM, "P. Taylor Goetz" wrote: >The question at this point is whether we want to cancel the release vote >and cut a new RC, or move forward with this one. > >I don’t see the test issue as

[jira] [Resolved] (STORM-602) HdfsBolt dies when the hadoop node is not available

2016-02-09 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-602. - Resolution: Not A Problem > HdfsBolt dies when the hadoop node is not availa

[jira] [Created] (STORM-1536) Eliminate or minimize use of deprecated TimeCacheMap

2016-02-09 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-1536: Summary: Eliminate or minimize use of deprecated TimeCacheMap Key: STORM-1536 URL: https://issues.apache.org/jira/browse/STORM-1536 Project: Apache Storm

[jira] [Resolved] (STORM-1531) Junit and mockito dependencies need to have correct scope defined in storm-elasticsearch pom.xml

2016-02-08 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-1531. -- Resolution: Fixed > Junit and mockito dependencies need to have correct scope defi

[jira] [Commented] (STORM-1531) Junit and mockito dependencies need to have correct scope defined in storm-elasticsearch pom.xml

2016-02-08 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138244#comment-15138244 ] Aaron Dossett commented on STORM-1531: -- Merged. > Junit and mockito dependencies need to h

[jira] [Commented] (STORM-602) HdfsBolt dies when the hadoop node is not available

2016-02-05 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134975#comment-15134975 ] Aaron Dossett commented on STORM-602: - If nobody objects, I will close this ticket as "not a pr

[jira] [Resolved] (STORM-1504) AvroGenericRecordBolt will not work in a topology with multiple workers

2016-02-03 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-1504. -- Resolution: Fixed Fix Version/s: 1.0.0 > AvroGenericRecordBolt will not w

[jira] [Resolved] (STORM-1518) Backport STORM-1504 to 1.0 branch

2016-02-03 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-1518. -- Resolution: Fixed > Backport STORM-1504 to 1.0 bra

Re: [DISCUSS] 1.0 Release/Clojure-Java Migration

2016-02-02 Thread Aaron . Dossett
Should back porting fixes from master to 1.0 be included as tasks under that epic? From: "P. Taylor Goetz" > Reply-To: > Date: Monday, February 1, 2016 at 7:23 PM To:

[jira] [Assigned] (STORM-1518) Backport STORM-1504 to 1.0 branch

2016-02-02 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-1518: Assignee: Aaron Dossett > Backport STORM-1504 to 1.0 bra

[jira] [Created] (STORM-1518) Backport STORM-1504 to 1.0 branch

2016-02-02 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-1518: Summary: Backport STORM-1504 to 1.0 branch Key: STORM-1518 URL: https://issues.apache.org/jira/browse/STORM-1518 Project: Apache Storm Issue Type: Sub-task

[jira] [Created] (STORM-1504) AvroGenericRecordBolt will not work in a topology with multiple workers

2016-01-26 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-1504: Summary: AvroGenericRecordBolt will not work in a topology with multiple workers Key: STORM-1504 URL: https://issues.apache.org/jira/browse/STORM-1504 Project

[jira] [Updated] (STORM-1504) AvroGenericRecordBolt will not work in a topology with multiple workers

2016-01-26 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-1504: - Description: It receives Avro GenericRecord objects, which leads to serialization errors

[jira] [Assigned] (STORM-1504) AvroGenericRecordBolt will not work in a topology with multiple workers

2016-01-26 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-1504: Assignee: Aaron Dossett > AvroGenericRecordBolt will not work in a topology with multi

[jira] [Updated] (STORM-1464) storm-hdfs should support writing to multiple files

2016-01-25 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-1464: - Description: Examples of when this is needed include: - One avro bolt writing multiple schemas

[jira] [Updated] (STORM-1464) storm-hdfs should support writing to multiple files

2016-01-25 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-1464: - Summary: storm-hdfs should support writing to multiple files (was: storm-hdfs should allow

[jira] [Commented] (STORM-1475) storm-elasticsearch should support ES 2.X

2016-01-15 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101820#comment-15101820 ] Aaron Dossett commented on STORM-1475: -- The code changes to support ES 2.0.1 were fairly minor. Does

[jira] [Created] (STORM-1475) storm-elasticsearch should support ES 2.X

2016-01-14 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-1475: Summary: storm-elasticsearch should support ES 2.X Key: STORM-1475 URL: https://issues.apache.org/jira/browse/STORM-1475 Project: Apache Storm Issue Type

[jira] [Assigned] (STORM-1475) storm-elasticsearch should support ES 2.X

2016-01-14 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-1475: Assignee: Aaron Dossett > storm-elasticsearch should support ES

[jira] [Created] (STORM-1464) storm-hdfs should allow for changing avro schemas

2016-01-12 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-1464: Summary: storm-hdfs should allow for changing avro schemas Key: STORM-1464 URL: https://issues.apache.org/jira/browse/STORM-1464 Project: Apache Storm Issue

HDFS Bolts -- partitioning output

2015-12-29 Thread Aaron . Dossett
Hi, My team was exploring changes to the HDFS bolts that would allow for partitioning the output, for example into directories corresponding to day. This is different that the existing functionality to rotate files based on a set length of time. For unrelated reasons, we are probably not

Re: Welcome new Apache Storm Committers/PMC Members

2015-12-08 Thread Aaron . Dossett
or Goetz <ptgo...@gmail.com> wrote: > >> I’m pleased to announce that the following individuals have joined as >> Apache Storm Committers/PMC Members: >> >> - Longda Feng >> - Arun Mahadevan >> - Boyang Jerry Peng >> - Matthias J. Sax >> - A

Re: Segfault building master w/JDK 1.7 on OS X

2015-11-18 Thread Aaron . Dossett
`mvn clean install -DskipTests=true` I mean... On 11/18/15, 4:55 PM, "Aaron.Dossett" wrote: >A fresh clone and `mvn clean install` works fine for me: > >java -version >java version "1.7.0_75" >Java(TM) SE Runtime Environment (build 1.7.0_75-b13) >Java HotSpot(TM)

[jira] [Commented] (STORM-1161) Several source files lack an Apache License

2015-11-09 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996794#comment-14996794 ] Aaron Dossett commented on STORM-1161: -- We could also try adding *.patch to the rat ignore

[jira] [Commented] (STORM-1161) Several source files lack an Apache License

2015-11-06 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14993855#comment-14993855 ] Aaron Dossett commented on STORM-1161: -- Thank you, [~revans2]! We are doing great things with Storm

[jira] [Created] (STORM-1161) Several source files lack an Apache License

2015-11-03 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-1161: Summary: Several source files lack an Apache License Key: STORM-1161 URL: https://issues.apache.org/jira/browse/STORM-1161 Project: Apache Storm Issue Type

[jira] [Assigned] (STORM-1161) Several source files lack an Apache License

2015-11-03 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-1161: Assignee: Aaron Dossett > Several source files lack an Apache Lice

[jira] [Commented] (STORM-1162) Add tick tuples to HDFSBolt for time-based flushing

2015-11-03 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987774#comment-14987774 ] Aaron Dossett commented on STORM-1162: -- Hi, this feature was included in STORM-969. > Add t

[jira] [Created] (STORM-1154) SequenceFileBolt needs unit tests

2015-11-02 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-1154: Summary: SequenceFileBolt needs unit tests Key: STORM-1154 URL: https://issues.apache.org/jira/browse/STORM-1154 Project: Apache Storm Issue Type

[jira] [Updated] (STORM-1138) Storm-hdfs README should be updated with Avro Bolt information

2015-11-02 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-1138: - Issue Type: Improvement (was: Bug) > Storm-hdfs README should be updated with Avro B

[jira] [Closed] (STORM-1139) Issues regarding storm-postgresql interface

2015-10-29 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett closed STORM-1139. Resolution: Invalid > Issues regarding storm-postgresql interf

[jira] [Commented] (STORM-1139) Issues regarding storm-postgresql interface

2015-10-29 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980364#comment-14980364 ] Aaron Dossett commented on STORM-1139: -- Please stop opening JIRAs and take these questions to email

[jira] [Updated] (STORM-1073) SequenceFileBolt can end up in an unrecoverable state

2015-10-28 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-1073: - Fix Version/s: 0.11.0 > SequenceFileBolt can end up in an unrecoverable st

[jira] [Resolved] (STORM-1074) Storm should include a bolt that writes Avro data to HDFS

2015-10-28 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-1074. -- Resolution: Fixed Fix Version/s: 0.11.0 > Storm should include a bolt that writes A

[jira] [Resolved] (STORM-1073) SequenceFileBolt can end up in an unrecoverable state

2015-10-28 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-1073. -- Resolution: Fixed > SequenceFileBolt can end up in an unrecoverable st

[jira] [Created] (STORM-1138) Storm-hdfs README should be updated with Avro Bolt information

2015-10-28 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-1138: Summary: Storm-hdfs README should be updated with Avro Bolt information Key: STORM-1138 URL: https://issues.apache.org/jira/browse/STORM-1138 Project: Apache Storm

[jira] [Commented] (STORM-1131) Kafka Spout can get into a loop of refreshing offset when there are failed messages

2015-10-27 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976330#comment-14976330 ] Aaron Dossett commented on STORM-1131: -- Those links are to private repos. > Kafka Spout can

[jira] [Created] (STORM-1102) HiveBolt should have a default flush interval

2015-10-09 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-1102: Summary: HiveBolt should have a default flush interval Key: STORM-1102 URL: https://issues.apache.org/jira/browse/STORM-1102 Project: Apache Storm Issue

[jira] [Created] (STORM-1091) Add unit test for tick tuples to HiveBolt and HdfsBolt

2015-10-06 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-1091: Summary: Add unit test for tick tuples to HiveBolt and HdfsBolt Key: STORM-1091 URL: https://issues.apache.org/jira/browse/STORM-1091 Project: Apache Storm

[jira] [Assigned] (STORM-1091) Add unit test for tick tuples to HiveBolt and HdfsBolt

2015-10-06 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-1091: Assignee: Aaron Dossett > Add unit test for tick tuples to HiveBolt and HdfsB

[jira] [Commented] (STORM-602) HdfsBolt dies when the hadoop node is not available

2015-10-05 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943408#comment-14943408 ] Aaron Dossett commented on STORM-602: - My tentative conclusion is that the first error is not a defect

[jira] [Updated] (STORM-969) HDFS Bolt can end up in an unrecoverable state

2015-10-05 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-969: Fix Version/s: 0.11.0 > HDFS Bolt can end up in an unrecoverable st

[jira] [Resolved] (STORM-969) HDFS Bolt can end up in an unrecoverable state

2015-10-05 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-969. - Resolution: Fixed > HDFS Bolt can end up in an unrecoverable st

[jira] [Assigned] (STORM-1074) Storm should include a bolt that writes Avro data to HDFS

2015-09-28 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-1074: Assignee: Aaron Dossett > Storm should include a bolt that writes Avro data to H

Re: storm-hdfs JIRAs

2015-09-28 Thread Aaron . Dossett
Immediately after sending this I saw that Harsha had given a +1 to STORM-969 about two minutes earlier. Thank you! From: Aaron Dossett <aaron.doss...@target.com<mailto:aaron.doss...@target.com>> Date: Monday, September 28, 2015 at 4:56 PM To: "dev@storm.apache.org<mailto:

[jira] [Updated] (STORM-1073) SequenceFileBolt can end up in an unrecoverable state

2015-09-28 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-1073: - Description: SequenceFileBolt has the same issues that HdfsBolt has in STORM-969. This is also

[jira] [Commented] (STORM-602) HdfsBolt dies when the hadoop node is not available

2015-09-28 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934535#comment-14934535 ] Aaron Dossett commented on STORM-602: - The second problem ("When hadoop nodes become avai

[jira] [Resolved] (STORM-804) HdfsBolt doesn't work after a period of time which caused by network problems

2015-09-28 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-804. - Resolution: Duplicate This is a duplicate of STORM-969, which has been resolved. > HdfsB

[jira] [Commented] (STORM-994) Connection leak between nimbus and supervisors

2015-08-27 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716830#comment-14716830 ] Aaron Dossett commented on STORM-994: - Could this manifest itself by nimbus failing due

[jira] [Resolved] (STORM-938) storm-hive add a time interval to flush tuples to hive

2015-08-19 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-938. - Resolution: Fixed storm-hive add a time interval to flush tuples to hive

[jira] [Updated] (STORM-938) storm-hive add a time interval to flush tuples to hive

2015-08-19 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-938: Fix Version/s: 0.11.0 storm-hive add a time interval to flush tuples to hive

[jira] [Updated] (STORM-960) Hive-Bolt can lose tuples when flushing data

2015-08-19 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett updated STORM-960: Fix Version/s: 0.11.0 Hive-Bolt can lose tuples when flushing data

Sync'ing HDFS bolts

2015-08-06 Thread Aaron . Dossett
Hello, I see that when HDFSBolt syncs it takes advantage of the fact that it has a direct handle to an HdfsDataOutputStream with the following code: if (this.out instanceof HdfsDataOutputStream) { ((HdfsDataOutputStream) this.out).hsync(EnumSet.of(SyncFlag.UPDATE_LENGTH)); } else {

Re: Sync'ing HDFS bolts

2015-08-06 Thread Aaron . Dossett
Reviewing the specification of Sequence File in more detail, it contains Œsync markers¹ that denote block boundaries. A sync operation that writes a partial block is probably not sensible. Closing/reopening would write the data to the file system, but still with a performance cost. On 8/6/15,

[jira] [Assigned] (STORM-944) storm-hive pom.xml has a dependency conflict with calcite

2015-08-04 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-944: --- Assignee: Aaron Dossett (was: Aaron Dossett) storm-hive pom.xml has a dependency conflict

[jira] [Assigned] (STORM-969) HDFS Bolt can end up in an unrecoverable state

2015-08-04 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-969: --- Assignee: Aaron Dossett (was: Aaron Dossett) HDFS Bolt can end up in an unrecoverable state

[jira] [Assigned] (STORM-943) In TestHiveBolt make the collector mock slightly more precise

2015-08-04 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-943: --- Assignee: Aaron Dossett (was: Aaron Dossett) In TestHiveBolt make the collector mock

[jira] [Assigned] (STORM-960) Hive-Bolt can lose tuples when flushing data

2015-08-04 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-960: --- Assignee: Aaron Dossett (was: Aaron Dossett) Hive-Bolt can lose tuples when flushing data

[jira] [Commented] (STORM-969) HDFS Bolt can end up in an unrecoverable state

2015-08-02 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651166#comment-14651166 ] Aaron Dossett commented on STORM-969: - I should have a PR for this shortly. HDFS Bolt

[jira] [Created] (STORM-969) HDFS Bolt can end up in an unrecoverable state

2015-08-02 Thread Aaron Dossett (JIRA)
Aaron Dossett created STORM-969: --- Summary: HDFS Bolt can end up in an unrecoverable state Key: STORM-969 URL: https://issues.apache.org/jira/browse/STORM-969 Project: Apache Storm Issue Type

[jira] [Commented] (STORM-960) Hive-Bolt can lose tuples when flushing data

2015-07-31 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649374#comment-14649374 ] Aaron Dossett commented on STORM-960: - Thank you! One other observation: this change

[jira] [Commented] (STORM-938) storm-hive add a time interval to flush tuples to hive

2015-07-30 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647603#comment-14647603 ] Aaron Dossett commented on STORM-938: - Thanks [~ptgoetz], PR is attached to this ticket

[jira] [Commented] (STORM-938) storm-hive add a time interval to flush tuples to hive

2015-07-27 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642826#comment-14642826 ] Aaron Dossett commented on STORM-938: - Would supporting tick tuples be a good way

[jira] [Comment Edited] (STORM-938) storm-hive add a time interval to flush tuples to hive

2015-07-27 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642826#comment-14642826 ] Aaron Dossett edited comment on STORM-938 at 7/27/15 5:42 PM

[jira] [Commented] (STORM-938) storm-hive add a time interval to flush tuples to hive

2015-07-27 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643723#comment-14643723 ] Aaron Dossett commented on STORM-938: - I took a stab at a tick tuple implementation

[jira] [Commented] (STORM-960) Hive-Bolt can lose tuples when flushing data

2015-07-24 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640740#comment-14640740 ] Aaron Dossett commented on STORM-960: - [~sriharsha] PR updated to reflect only my

[jira] [Commented] (STORM-959) remove unnecessary dependency from storm-hive/pom.xml

2015-07-23 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638743#comment-14638743 ] Aaron Dossett commented on STORM-959: - This is a duplicate of STORM-944, which has

[jira] [Assigned] (STORM-960) Hive-Bolt can lose tuples when flushing data

2015-07-23 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-960: --- Assignee: Aaron Dossett Hive-Bolt can lose tuples when flushing data

[jira] [Commented] (STORM-960) Hive-Bolt can lose tuples when flushing data

2015-07-23 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638755#comment-14638755 ] Aaron Dossett commented on STORM-960: - I realize this PR also contains the commit

[jira] [Assigned] (STORM-944) storm-hive pom.xml has a dependency conflict with calcite

2015-07-16 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reassigned STORM-944: --- Assignee: Aaron Dossett storm-hive pom.xml has a dependency conflict with calcite

[jira] [Reopened] (STORM-943) In TestHiveBolt make the collector mock slightly more precise

2015-07-16 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett reopened STORM-943: - Reopening since the pull request is not yet merged In TestHiveBolt make the collector mock slightly

[jira] [Commented] (STORM-944) storm-hive pom.xml has a dependency conflict with calcite

2015-07-16 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630624#comment-14630624 ] Aaron Dossett commented on STORM-944: - Pull request available here: https://github.com

[jira] [Resolved] (STORM-943) In TestHiveBolt make the collector mock slightly more precise

2015-07-16 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Dossett resolved STORM-943. - Resolution: Fixed In TestHiveBolt make the collector mock slightly more precise

[jira] [Commented] (STORM-546) Local hostname configuration ignored by executor

2015-06-30 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608395#comment-14608395 ] Aaron Dossett commented on STORM-546: - Should be resolved and closed? The PR

[jira] [Commented] (STORM-799) Consolidate IErrorReporter and reportError methods

2015-06-30 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/STORM-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608387#comment-14608387 ] Aaron Dossett commented on STORM-799: - I agree with the first suggestion of using

A few recent pull requests for Hive Bolt

2015-06-30 Thread Aaron . Dossett
Hello, I am beginning to use storm and also hope to contribute back to the project. Storm - Hive is a primary use case for me, so I have been reading that source code quite a bit. I’ve made a few small pull requests based on what I’ve seen so far, I hope the community finds them helpful.