Re: [VOTE] Graduate Streams to TLP

+1 On Fri, Jun 23, 2017 at 2:00 PM, Matt Franklin wrote: > +1 (binding) > > On Thu, Jun 22, 2017 at 6:53 PM Trevor Grant > wrote: > > > +1 > > > > On Thu, Jun 22, 2017 at 12:01 PM, Joey Frazee > > wrote: > > > > > +1

Re: Source and Resource generation from jsonschemas

I think being able to generate case classes from json schema is valuable. However there are already projects that attempt to do this. See this stack overflow question/answer. http://stackoverflow.com/questions/23531065/scala-parse-json-directly-into-a-case-class What will streams do that will be

Re: [VOTE] New mailing list - com...@streams.incubator.apache.org

+1 On Tue, Jan 5, 2016 at 2:53 PM, Steve Blackmon wrote: > Please vote on creation of a new mailing list to which email notifications > from supporting services such as JIRA, github, jenkins, and travis will be > routed. > > +1 from me. > > Vote will be open for 72 hours.

Re: [VODE] Release Apache Streams (streams-project) version 0.2-incubating (rc3)

+1 Also, as far as test data goes, we should consider using log-snyth, https://github.com/tdunning/log-synth, to generate test data. If we generate test data that conformed to the private data providers schema, that should be sufficient for unit tests and be permissible. On Tue, Apr 21, 2015 at

[jira] [Created] (STREAMS-279) Create Youtube User/Channel provider

Ryan Ebanks created STREAMS-279: --- Summary: Create Youtube User/Channel provider Key: STREAMS-279 URL: https://issues.apache.org/jira/browse/STREAMS-279 Project: Streams Issue Type: Improvement

[jira] [Closed] (STREAMS-81) Monitor thread pool never fully shuts down tasks in LocalStreamBuilder

[ https://issues.apache.org/jira/browse/STREAMS-81?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks closed STREAMS-81. -- Resolution: Fixed Monitor thread pool never fully shuts down tasks in LocalStreamBuilder

[jira] [Resolved] (STREAMS-70) Generic Json Processors

[ https://issues.apache.org/jira/browse/STREAMS-70?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-70. Resolution: Done Generic Json Processors --- Key: STREAMS

[jira] [Closed] (STREAMS-105) Improve Datasift mapping to activity format

[ https://issues.apache.org/jira/browse/STREAMS-105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks closed STREAMS-105. --- Resolution: Done Improve Datasift mapping to activity format

[jira] [Resolved] (STREAMS-101) ComponentUtils.offerUntilSuccess locks incorrectly

[ https://issues.apache.org/jira/browse/STREAMS-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-101. - Resolution: Won't Fix Not needed any more ComponentUtils.offerUntilSuccess locks incorrectly

[jira] [Resolved] (STREAMS-152) Add a flag that forces use of Elasticsearch Configuration

[ https://issues.apache.org/jira/browse/STREAMS-152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-152. - Resolution: Done Add a flag that forces use of Elasticsearch Configuration

[jira] [Resolved] (STREAMS-157) ElasticsearchPersistWriter needs to be able to accept null activity IDs

[ https://issues.apache.org/jira/browse/STREAMS-157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-157. - Resolution: Fixed ElasticsearchPersistWriter needs to be able to accept null activity IDs

[jira] [Resolved] (STREAMS-162) Classes from package org.apache.streams.core.test have been moved to org.apache.streams.local.test

[ https://issues.apache.org/jira/browse/STREAMS-162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-162. - Resolution: Fixed Classes from package org.apache.streams.core.test have been moved

[jira] [Resolved] (STREAMS-166) S3PersistReader does not correctly handle directory listing

[ https://issues.apache.org/jira/browse/STREAMS-166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-166. - Resolution: Fixed S3PersistReader does not correctly handle directory listing

[jira] [Closed] (STREAMS-173) RssStreamsProvider attempts to cast a LinkedConcurrentQueue to a StreamsResultSet

[ https://issues.apache.org/jira/browse/STREAMS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks closed STREAMS-173. --- Resolution: Won't Fix RssStreamsProvider attempts to cast a LinkedConcurrentQueue

[jira] [Resolved] (STREAMS-178) LinkResolverProcessor should return a set of unwound links

[ https://issues.apache.org/jira/browse/STREAMS-178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-178. - Resolution: Fixed LinkResolverProcessor should return a set of unwound links

[jira] [Resolved] (STREAMS-192) The Instagram serializer should include a user's post count

[ https://issues.apache.org/jira/browse/STREAMS-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-192. - Resolution: Done The Instagram serializer should include a user's post count

[jira] [Created] (STREAMS-201) Util function to remove all MXBeans for tests

Ryan Ebanks created STREAMS-201: --- Summary: Util function to remove all MXBeans for tests Key: STREAMS-201 URL: https://issues.apache.org/jira/browse/STREAMS-201 Project: Streams Issue Type

[jira] [Created] (STREAMS-197) Implement New Counting Classes

Ryan Ebanks created STREAMS-197: --- Summary: Implement New Counting Classes Key: STREAMS-197 URL: https://issues.apache.org/jira/browse/STREAMS-197 Project: Streams Issue Type: Sub-task

[jira] [Created] (STREAMS-198) Deprecate DatumCountable

Ryan Ebanks created STREAMS-198: --- Summary: Deprecate DatumCountable Key: STREAMS-198 URL: https://issues.apache.org/jira/browse/STREAMS-198 Project: Streams Issue Type: Sub-task

[jira] [Created] (STREAMS-199) Implement new Changes to StreamTasks

Ryan Ebanks created STREAMS-199: --- Summary: Implement new Changes to StreamTasks Key: STREAMS-199 URL: https://issues.apache.org/jira/browse/STREAMS-199 Project: Streams Issue Type: Sub-task

[jira] [Created] (STREAMS-196) Implement Datum Monitoring through JMX

Ryan Ebanks created STREAMS-196: --- Summary: Implement Datum Monitoring through JMX Key: STREAMS-196 URL: https://issues.apache.org/jira/browse/STREAMS-196 Project: Streams Issue Type

[jira] [Resolved] (STREAMS-33) Implement pig UDF wrappers for activityserializer and processor

[ https://issues.apache.org/jira/browse/STREAMS-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-33. Resolution: Done Implement pig UDF wrappers for activityserializer and processor

Re: LocalStreamBuilder#stop()

:31 AM, Ryan Ebanks ryaneba...@gmail.com wrote: I've been added tests and fixing some issues in the local stream builder class. I need some input on how the stop() method should work so I can write the appropriate tests. Option 1.) Gentle Shutdown Immediately stop the providers from

[jira] [Created] (STREAMS-191) Streams implement use of throughput queues

Ryan Ebanks created STREAMS-191: --- Summary: Streams implement use of throughput queues Key: STREAMS-191 URL: https://issues.apache.org/jira/browse/STREAMS-191 Project: Streams Issue Type

Re: LocalStreamBuilder#stop()

and then calling shutdownNow if the tasks hadn't terminated at the end of the timeout. -Ryan Ebanks On Wed, Oct 8, 2014 at 10:34 AM, Matthew Hager [W2O Group] mha...@w2ogroup.com wrote: Terminating threads is never a good idea. Shutdown the providers, give user an option to set a wait-out time

Improvements to local stream builder

if there is any feed back on adding JMX functionality. I will create JIRA tickets and would love help in creating these improvements. -Ryan Ebanks

Re: Proposed Community Report for October

The report is now on wiki, ready for approval. Jus so the community is aware, our next report is due at the beginning of December. -Ryan Ebanks On Wed, Oct 1, 2014 at 2:57 AM, Ate Douma a...@douma.nu wrote: On 26-09-14 00:55, Matt Franklin wrote: The formatting is a bit off, but I think

CMS diff: Getting the Source Code

Clone URL (Committers only): https://cms.apache.org/redirect?new=anonymous;action=diff;uri=http://streams.apache.org/source-repository.mdtext Ryan Ebanks Index: trunk/content/source-repository.mdtext === --- trunk/content/source

Re: CMS diff: Getting the Source Code

found at https://git-wip-us.apache.org/repos/asf/incubator-streams.git. In other words, you should list both repos and point to a page about making contributions that lays out the working process for submitting patches via github. On Fri, Sep 26, 2014 at 11:50 AM, Ryan Ebanks anonym

STREAMS-181 RSS Provider update

not hog resources as previous version and includes tests. There is small change to the constructor that may break code for some people. If you are interested in or use the RSS provider please comment on the pull request and the proposed changes. https://github.com/apache/incubator-streams/pull/95 -Ryan

[jira] [Resolved] (STREAMS-179) Shutdown stream when threads exit due to errors

[ https://issues.apache.org/jira/browse/STREAMS-179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-179. - Resolution: Done Shutdown stream when threads exit due to errors

[jira] [Closed] (STREAMS-179) Shutdown stream when threads exit due to errors

[ https://issues.apache.org/jira/browse/STREAMS-179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks closed STREAMS-179. --- Shutdown stream when threads exit due to errors

[jira] [Created] (STREAMS-181) Refactor RSSProvider

Ryan Ebanks created STREAMS-181: --- Summary: Refactor RSSProvider Key: STREAMS-181 URL: https://issues.apache.org/jira/browse/STREAMS-181 Project: Streams Issue Type: Task Reporter

[jira] [Created] (STREAMS-179) Shutdown stream when threads exit due to errors

Ryan Ebanks created STREAMS-179: --- Summary: Shutdown stream when threads exit due to errors Key: STREAMS-179 URL: https://issues.apache.org/jira/browse/STREAMS-179 Project: Streams Issue Type

Exposing Bugs

providers, processors, and writers have to launch their own threads means we should work on the local frame work to remove those needs push almost all thread management responsibility to the framework so we can ensure consistent monitoring/error handling of threads. Thanks, Ryan Ebanks

[jira] [Created] (STREAMS-173) RssStreamsProvider attempts to cast a LinkedConcurrentQueue to a StreamsResultSet

Ryan Ebanks created STREAMS-173: --- Summary: RssStreamsProvider attempts to cast a LinkedConcurrentQueue to a StreamsResultSet Key: STREAMS-173 URL: https://issues.apache.org/jira/browse/STREAMS-173

Re: Documentation Testing

Renato, I don't think we have really established a method for patching the website. That is something that we do need to discuss though, as we should be generating documentation in the near term for the website. I think what you have proposed is great for making changes to it now. -Ryan Ebanks

Re: September report

Here is a draft of a report. Hopefully I did this correctly. Please let me know what I need to correct and/or add. StreamsApache Streams is a lightweight processing engine for Activity Streams objects that can be export to multiple runtimes/frameworks.Streams has been incubating since

Re: Documentation Testing

is correct/works as expected. At a minimum all public methods/functions should have tests. I also agree we need a users guide written. The documentation as a whole for this project is lacking, but I do feel that we will drastically be improving in this area shortly. -Ryan Ebanks On Wed, Sep 3, 2014

Documentation Testing

it easier for the project to gain new contributors. Sincerely, Ryan Ebanks

[jira] [Created] (STREAMS-159) Add facebook page feed provider

Ryan Ebanks created STREAMS-159: --- Summary: Add facebook page feed provider Key: STREAMS-159 URL: https://issues.apache.org/jira/browse/STREAMS-159 Project: Streams Issue Type: Bug

[jira] [Created] (STREAMS-151) Refactor Facebook Provider to have continuous AND finite mode

Ryan Ebanks created STREAMS-151: --- Summary: Refactor Facebook Provider to have continuous AND finite mode Key: STREAMS-151 URL: https://issues.apache.org/jira/browse/STREAMS-151 Project: Streams

[jira] [Resolved] (STREAMS-144) Refactor Instagram Provider to do more than toy example

[ https://issues.apache.org/jira/browse/STREAMS-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-144. - Resolution: Fixed Refactor Instagram Provider to do more than toy example

[jira] [Created] (STREAMS-144) Refactor Instagram Provider to do more than toy example

Ryan Ebanks created STREAMS-144: --- Summary: Refactor Instagram Provider to do more than toy example Key: STREAMS-144 URL: https://issues.apache.org/jira/browse/STREAMS-144 Project: Streams

[jira] [Created] (STREAMS-127) JsonSchema Replication in Datasift provider

Ryan Ebanks created STREAMS-127: --- Summary: JsonSchema Replication in Datasift provider Key: STREAMS-127 URL: https://issues.apache.org/jira/browse/STREAMS-127 Project: Streams Issue Type

[jira] [Created] (STREAMS-123) Add twitter specific link handling for datasift

Ryan Ebanks created STREAMS-123: --- Summary: Add twitter specific link handling for datasift Key: STREAMS-123 URL: https://issues.apache.org/jira/browse/STREAMS-123 Project: Streams Issue Type

[jira] [Created] (STREAMS-124) Fix DatumCountable Interface

Ryan Ebanks created STREAMS-124: --- Summary: Fix DatumCountable Interface Key: STREAMS-124 URL: https://issues.apache.org/jira/browse/STREAMS-124 Project: Streams Issue Type: Bug

[jira] [Resolved] (STREAMS-41) Complete, test, and document datasift provider

[ https://issues.apache.org/jira/browse/STREAMS-41?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-41. Resolution: Fixed Complete, test, and document datasift provider

[jira] [Created] (STREAMS-102) Datasift Event Processor needs to be re-named and fix NPE bug

Ryan Ebanks created STREAMS-102: --- Summary: Datasift Event Processor needs to be re-named and fix NPE bug Key: STREAMS-102 URL: https://issues.apache.org/jira/browse/STREAMS-102 Project: Streams

[jira] [Commented] (STREAMS-90) Provider Task Timeout no longer counts number of zeros

[ https://issues.apache.org/jira/browse/STREAMS-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14004749#comment-14004749 ] Ryan Ebanks commented on STREAMS-90: I believe counting zeros is a poor way to do

Re: Proposing Changes to the StreamsProvider interface and StreamsProviderTask

tuple to tie it to. Since I come from a Storm background, this is a big concern for me. But whatever we do, we need to do something soon because current design needs changes. -Ryan Ebanks On Sat, May 10, 2014 at 6:07 PM, Steve Blackmon sblack...@apache.orgwrote: On Tue, May 6, 2014 at 9:53 PM

Re: Bug in StreamsPersistWriterTask and StreamsProcessorTask. BREAKS LOCAL RUNTIME

Actually it should not be, !this.inQueue.isEmpty(). It should be, datum != null On Wed, May 14, 2014 at 5:19 PM, Ryan Ebanks ryaneba...@gmail.com wrote: I can't seem to log into Jira at the moment create the bug ticket. But this bug breaks the local runtime. A recent commit seems to have

[jira] [Commented] (STREAMS-80) StreamsProcressorTask and StreamsPersistWriterTask are BROKEN

[ https://issues.apache.org/jira/browse/STREAMS-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13999083#comment-13999083 ] Ryan Ebanks commented on STREAMS-80: Pull request issued. StreamsProcressorTask

[jira] [Commented] (STREAMS-26) Create a framework to run an Activity stream in a single JVM

[ https://issues.apache.org/jira/browse/STREAMS-26?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981191#comment-13981191 ] Ryan Ebanks commented on STREAMS-26: I'm going to close this out. Since

[jira] [Created] (STREAMS-63) Update RFC3339Utils to handle date formats that are not Joda Time

Ryan Ebanks created STREAMS-63: -- Summary: Update RFC3339Utils to handle date formats that are not Joda Time Key: STREAMS-63 URL: https://issues.apache.org/jira/browse/STREAMS-63 Project: Streams

[jira] [Work started] (STREAMS-63) Update RFC3339Utils to handle date formats that are not Joda Time

[ https://issues.apache.org/jira/browse/STREAMS-63?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on STREAMS-63 started by Ryan Ebanks. Update RFC3339Utils to handle date formats that are not Joda Time

[jira] [Resolved] (STREAMS-26) Create a framework to run an Activity stream in a single JVM

[ https://issues.apache.org/jira/browse/STREAMS-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Ebanks resolved STREAMS-26. Resolution: Fixed This was merged in by [~steveblackmon] on March 21. Create a framework to run

[jira] [Commented] (STREAMS-63) Update RFC3339Utils to handle date formats that are not Joda Time

[ https://issues.apache.org/jira/browse/STREAMS-63?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981620#comment-13981620 ] Ryan Ebanks commented on STREAMS-63: Opened Pull request. Update RFC3339Utils

Re: [DISCUSS] Move from SVN to Git for Code

+1 On Mon, Feb 24, 2014 at 10:44 AM, Stanton Sievers ssiev...@apache.orgwrote: +1 On Mon, Feb 24, 2014 at 11:41 AM, Matt Franklin m.ben.frank...@gmail.com wrote: Given current working patterns, it makes more sense to move to a source control system that supports better branch/merge

Review Request 18369: Issue STREAMS-26 in JIRA

functionality and classes. I admit they are a little 'hacky'. Thanks, Ryan Ebanks