[
https://issues.apache.org/jira/browse/STORM-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390106#comment-15390106
]
Aaron Dossett commented on STORM-1971:
--
I did not create that approach (although I did carry it over
[
https://issues.apache.org/jira/browse/STORM-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389537#comment-15389537
]
Aaron Dossett commented on STORM-1971:
--
Writing each tuple doesn't necessarily result in higher
[
https://issues.apache.org/jira/browse/STORM-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382300#comment-15382300
]
Aaron Dossett commented on STORM-1971:
--
[~darion] There is a default value for the tick tuples, 15
[
https://issues.apache.org/jira/browse/STORM-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-1917:
-
Component/s: storm-hdfs
> Storm Redis TTL Cont
[
https://issues.apache.org/jira/browse/STORM-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-1917:
-
Component/s: (was: storm-hdfs)
> Storm Redis TTL Cont
[
https://issues.apache.org/jira/browse/STORM-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-1909.
--
Resolution: Fixed
Fix Version/s: 1.0.2
> Fix errors in HDFS Spout documentat
[
https://issues.apache.org/jira/browse/STORM-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376905#comment-15376905
]
Aaron Dossett commented on STORM-1971:
--
HDFS bolt does support tick tuples to periodically flush data
I see that Storm is using version 10 of this parent pom
(https://github.com/apache/storm/blob/master/pom.xml#L21-L25). I will try
upgrading to 18, mostly as a learning exercise since I¹m unfamiliar with
what this does, unless anyone is aware of an obvious not to bother.
Thanks! -Aaron
On
Is there a best practice for merging a PR to multiple branches? I have
struggled with that in the past, probably due to shortcomings in my
knowledge of git. I¹d be happy to aggregate suggestions and put them on
the Developer page. Thanks!
On 5/20/16, 12:08 PM, "P. Taylor Goetz"
I like the idea of squashing to a single commit and tagging that commit
and PR with the JIRA ID. Agree that limiting duplicate emails would be
good.
On 5/13/16, 6:17 AM, "Abhishek Agarwal" wrote:
>1* - Squashing commits is more of a guideline. Committers, specifically,
[
https://issues.apache.org/jira/browse/STORM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-1464.
--
Resolution: Fixed
> storm-hdfs should support writing to multiple fi
[
https://issues.apache.org/jira/browse/STORM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-1464:
-
Fix Version/s: 2.0.0
> storm-hdfs should support writing to multiple fi
+1. Same here.
On 5/9/16, 5:47 AM, "John Fang" wrote:
>I'm also think we shouldn't maintain 0.10.x branch
>
>-邮件原件-
>发件人: Cody Innowhere [mailto:e.neve...@gmail.com]
>发送时间: 2016年5月9日 19:42
>收件人: dev@storm.apache.org
>主题: Re: [DISCUSSION] Version lines of
I am -0 on releasing with a failing test, especially with a fix in hand.
On 4/4/16, 10:50 AM, "P. Taylor Goetz" wrote:
>The question at this point is whether we want to cancel the release vote
>and cut a new RC, or move forward with this one.
>
>I don’t see the test issue as
[
https://issues.apache.org/jira/browse/STORM-602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-602.
-
Resolution: Not A Problem
> HdfsBolt dies when the hadoop node is not availa
Aaron Dossett created STORM-1536:
Summary: Eliminate or minimize use of deprecated TimeCacheMap
Key: STORM-1536
URL: https://issues.apache.org/jira/browse/STORM-1536
Project: Apache Storm
[
https://issues.apache.org/jira/browse/STORM-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-1531.
--
Resolution: Fixed
> Junit and mockito dependencies need to have correct scope defi
[
https://issues.apache.org/jira/browse/STORM-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138244#comment-15138244
]
Aaron Dossett commented on STORM-1531:
--
Merged.
> Junit and mockito dependencies need to h
[
https://issues.apache.org/jira/browse/STORM-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134975#comment-15134975
]
Aaron Dossett commented on STORM-602:
-
If nobody objects, I will close this ticket as "not a pr
[
https://issues.apache.org/jira/browse/STORM-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-1504.
--
Resolution: Fixed
Fix Version/s: 1.0.0
> AvroGenericRecordBolt will not w
[
https://issues.apache.org/jira/browse/STORM-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-1518.
--
Resolution: Fixed
> Backport STORM-1504 to 1.0 bra
Should back porting fixes from master to 1.0 be included as tasks under that
epic?
From: "P. Taylor Goetz" >
Reply-To: >
Date: Monday, February 1, 2016 at 7:23 PM
To:
[
https://issues.apache.org/jira/browse/STORM-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-1518:
Assignee: Aaron Dossett
> Backport STORM-1504 to 1.0 bra
Aaron Dossett created STORM-1518:
Summary: Backport STORM-1504 to 1.0 branch
Key: STORM-1518
URL: https://issues.apache.org/jira/browse/STORM-1518
Project: Apache Storm
Issue Type: Sub-task
Aaron Dossett created STORM-1504:
Summary: AvroGenericRecordBolt will not work in a topology with
multiple workers
Key: STORM-1504
URL: https://issues.apache.org/jira/browse/STORM-1504
Project
[
https://issues.apache.org/jira/browse/STORM-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-1504:
-
Description:
It receives Avro GenericRecord objects, which leads to serialization errors
[
https://issues.apache.org/jira/browse/STORM-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-1504:
Assignee: Aaron Dossett
> AvroGenericRecordBolt will not work in a topology with multi
[
https://issues.apache.org/jira/browse/STORM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-1464:
-
Description:
Examples of when this is needed include:
- One avro bolt writing multiple schemas
[
https://issues.apache.org/jira/browse/STORM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-1464:
-
Summary: storm-hdfs should support writing to multiple files (was:
storm-hdfs should allow
[
https://issues.apache.org/jira/browse/STORM-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101820#comment-15101820
]
Aaron Dossett commented on STORM-1475:
--
The code changes to support ES 2.0.1 were fairly minor. Does
Aaron Dossett created STORM-1475:
Summary: storm-elasticsearch should support ES 2.X
Key: STORM-1475
URL: https://issues.apache.org/jira/browse/STORM-1475
Project: Apache Storm
Issue Type
[
https://issues.apache.org/jira/browse/STORM-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-1475:
Assignee: Aaron Dossett
> storm-elasticsearch should support ES
Aaron Dossett created STORM-1464:
Summary: storm-hdfs should allow for changing avro schemas
Key: STORM-1464
URL: https://issues.apache.org/jira/browse/STORM-1464
Project: Apache Storm
Issue
Hi,
My team was exploring changes to the HDFS bolts that would allow for
partitioning the output, for example into directories corresponding to day.
This is different that the existing functionality to rotate files based on a
set length of time. For unrelated reasons, we are probably not
or Goetz <ptgo...@gmail.com> wrote:
>
>> I’m pleased to announce that the following individuals have joined as
>> Apache Storm Committers/PMC Members:
>>
>> - Longda Feng
>> - Arun Mahadevan
>> - Boyang Jerry Peng
>> - Matthias J. Sax
>> - A
`mvn clean install -DskipTests=true` I mean...
On 11/18/15, 4:55 PM, "Aaron.Dossett" wrote:
>A fresh clone and `mvn clean install` works fine for me:
>
>java -version
>java version "1.7.0_75"
>Java(TM) SE Runtime Environment (build 1.7.0_75-b13)
>Java HotSpot(TM)
[
https://issues.apache.org/jira/browse/STORM-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996794#comment-14996794
]
Aaron Dossett commented on STORM-1161:
--
We could also try adding *.patch to the rat ignore
[
https://issues.apache.org/jira/browse/STORM-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14993855#comment-14993855
]
Aaron Dossett commented on STORM-1161:
--
Thank you, [~revans2]! We are doing great things with Storm
Aaron Dossett created STORM-1161:
Summary: Several source files lack an Apache License
Key: STORM-1161
URL: https://issues.apache.org/jira/browse/STORM-1161
Project: Apache Storm
Issue Type
[
https://issues.apache.org/jira/browse/STORM-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-1161:
Assignee: Aaron Dossett
> Several source files lack an Apache Lice
[
https://issues.apache.org/jira/browse/STORM-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987774#comment-14987774
]
Aaron Dossett commented on STORM-1162:
--
Hi, this feature was included in STORM-969.
> Add t
Aaron Dossett created STORM-1154:
Summary: SequenceFileBolt needs unit tests
Key: STORM-1154
URL: https://issues.apache.org/jira/browse/STORM-1154
Project: Apache Storm
Issue Type
[
https://issues.apache.org/jira/browse/STORM-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-1138:
-
Issue Type: Improvement (was: Bug)
> Storm-hdfs README should be updated with Avro B
[
https://issues.apache.org/jira/browse/STORM-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett closed STORM-1139.
Resolution: Invalid
> Issues regarding storm-postgresql interf
[
https://issues.apache.org/jira/browse/STORM-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980364#comment-14980364
]
Aaron Dossett commented on STORM-1139:
--
Please stop opening JIRAs and take these questions to email
[
https://issues.apache.org/jira/browse/STORM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-1073:
-
Fix Version/s: 0.11.0
> SequenceFileBolt can end up in an unrecoverable st
[
https://issues.apache.org/jira/browse/STORM-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-1074.
--
Resolution: Fixed
Fix Version/s: 0.11.0
> Storm should include a bolt that writes A
[
https://issues.apache.org/jira/browse/STORM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-1073.
--
Resolution: Fixed
> SequenceFileBolt can end up in an unrecoverable st
Aaron Dossett created STORM-1138:
Summary: Storm-hdfs README should be updated with Avro Bolt
information
Key: STORM-1138
URL: https://issues.apache.org/jira/browse/STORM-1138
Project: Apache Storm
[
https://issues.apache.org/jira/browse/STORM-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976330#comment-14976330
]
Aaron Dossett commented on STORM-1131:
--
Those links are to private repos.
> Kafka Spout can
Aaron Dossett created STORM-1102:
Summary: HiveBolt should have a default flush interval
Key: STORM-1102
URL: https://issues.apache.org/jira/browse/STORM-1102
Project: Apache Storm
Issue
Aaron Dossett created STORM-1091:
Summary: Add unit test for tick tuples to HiveBolt and HdfsBolt
Key: STORM-1091
URL: https://issues.apache.org/jira/browse/STORM-1091
Project: Apache Storm
[
https://issues.apache.org/jira/browse/STORM-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-1091:
Assignee: Aaron Dossett
> Add unit test for tick tuples to HiveBolt and HdfsB
[
https://issues.apache.org/jira/browse/STORM-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943408#comment-14943408
]
Aaron Dossett commented on STORM-602:
-
My tentative conclusion is that the first error is not a defect
[
https://issues.apache.org/jira/browse/STORM-969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-969:
Fix Version/s: 0.11.0
> HDFS Bolt can end up in an unrecoverable st
[
https://issues.apache.org/jira/browse/STORM-969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-969.
-
Resolution: Fixed
> HDFS Bolt can end up in an unrecoverable st
[
https://issues.apache.org/jira/browse/STORM-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-1074:
Assignee: Aaron Dossett
> Storm should include a bolt that writes Avro data to H
Immediately after sending this I saw that Harsha had given a +1 to STORM-969
about two minutes earlier. Thank you!
From: Aaron Dossett <aaron.doss...@target.com<mailto:aaron.doss...@target.com>>
Date: Monday, September 28, 2015 at 4:56 PM
To: "dev@storm.apache.org<mailto:
[
https://issues.apache.org/jira/browse/STORM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-1073:
-
Description:
SequenceFileBolt has the same issues that HdfsBolt has in STORM-969. This is
also
[
https://issues.apache.org/jira/browse/STORM-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934535#comment-14934535
]
Aaron Dossett commented on STORM-602:
-
The second problem ("When hadoop nodes become avai
[
https://issues.apache.org/jira/browse/STORM-804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-804.
-
Resolution: Duplicate
This is a duplicate of STORM-969, which has been resolved.
> HdfsB
[
https://issues.apache.org/jira/browse/STORM-994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716830#comment-14716830
]
Aaron Dossett commented on STORM-994:
-
Could this manifest itself by nimbus failing due
[
https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-938.
-
Resolution: Fixed
storm-hive add a time interval to flush tuples to hive
[
https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-938:
Fix Version/s: 0.11.0
storm-hive add a time interval to flush tuples to hive
[
https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett updated STORM-960:
Fix Version/s: 0.11.0
Hive-Bolt can lose tuples when flushing data
Hello,
I see that when HDFSBolt syncs it takes advantage of the fact that it has a
direct handle to an HdfsDataOutputStream with the following code:
if (this.out instanceof HdfsDataOutputStream) {
((HdfsDataOutputStream) this.out).hsync(EnumSet.of(SyncFlag.UPDATE_LENGTH));
} else {
Reviewing the specification of Sequence File in more detail, it contains
Œsync markers¹ that denote block boundaries. A sync operation that writes
a partial block is probably not sensible. Closing/reopening would write
the data to the file system, but still with a performance cost.
On 8/6/15,
[
https://issues.apache.org/jira/browse/STORM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-944:
---
Assignee: Aaron Dossett (was: Aaron Dossett)
storm-hive pom.xml has a dependency conflict
[
https://issues.apache.org/jira/browse/STORM-969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-969:
---
Assignee: Aaron Dossett (was: Aaron Dossett)
HDFS Bolt can end up in an unrecoverable state
[
https://issues.apache.org/jira/browse/STORM-943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-943:
---
Assignee: Aaron Dossett (was: Aaron Dossett)
In TestHiveBolt make the collector mock
[
https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-960:
---
Assignee: Aaron Dossett (was: Aaron Dossett)
Hive-Bolt can lose tuples when flushing data
[
https://issues.apache.org/jira/browse/STORM-969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651166#comment-14651166
]
Aaron Dossett commented on STORM-969:
-
I should have a PR for this shortly.
HDFS Bolt
Aaron Dossett created STORM-969:
---
Summary: HDFS Bolt can end up in an unrecoverable state
Key: STORM-969
URL: https://issues.apache.org/jira/browse/STORM-969
Project: Apache Storm
Issue Type
[
https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649374#comment-14649374
]
Aaron Dossett commented on STORM-960:
-
Thank you! One other observation: this change
[
https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647603#comment-14647603
]
Aaron Dossett commented on STORM-938:
-
Thanks [~ptgoetz], PR is attached to this ticket
[
https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642826#comment-14642826
]
Aaron Dossett commented on STORM-938:
-
Would supporting tick tuples be a good way
[
https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642826#comment-14642826
]
Aaron Dossett edited comment on STORM-938 at 7/27/15 5:42 PM
[
https://issues.apache.org/jira/browse/STORM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643723#comment-14643723
]
Aaron Dossett commented on STORM-938:
-
I took a stab at a tick tuple implementation
[
https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640740#comment-14640740
]
Aaron Dossett commented on STORM-960:
-
[~sriharsha] PR updated to reflect only my
[
https://issues.apache.org/jira/browse/STORM-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638743#comment-14638743
]
Aaron Dossett commented on STORM-959:
-
This is a duplicate of STORM-944, which has
[
https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-960:
---
Assignee: Aaron Dossett
Hive-Bolt can lose tuples when flushing data
[
https://issues.apache.org/jira/browse/STORM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638755#comment-14638755
]
Aaron Dossett commented on STORM-960:
-
I realize this PR also contains the commit
[
https://issues.apache.org/jira/browse/STORM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reassigned STORM-944:
---
Assignee: Aaron Dossett
storm-hive pom.xml has a dependency conflict with calcite
[
https://issues.apache.org/jira/browse/STORM-943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett reopened STORM-943:
-
Reopening since the pull request is not yet merged
In TestHiveBolt make the collector mock slightly
[
https://issues.apache.org/jira/browse/STORM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630624#comment-14630624
]
Aaron Dossett commented on STORM-944:
-
Pull request available here:
https://github.com
[
https://issues.apache.org/jira/browse/STORM-943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Dossett resolved STORM-943.
-
Resolution: Fixed
In TestHiveBolt make the collector mock slightly more precise
[
https://issues.apache.org/jira/browse/STORM-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608395#comment-14608395
]
Aaron Dossett commented on STORM-546:
-
Should be resolved and closed? The PR
[
https://issues.apache.org/jira/browse/STORM-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608387#comment-14608387
]
Aaron Dossett commented on STORM-799:
-
I agree with the first suggestion of using
Hello,
I am beginning to use storm and also hope to contribute back to the project.
Storm - Hive is a primary use case for me, so I have been reading that source
code quite a bit. I’ve made a few small pull requests based on what I’ve seen
so far, I hope the community finds them helpful.
89 matches
Mail list logo