Re: Writing to external systems in reconciled fashion

[Tushar Gosavi]

Hi Priyanka,

tuples stored in HFile will not be replayed in same order at the
output as HFile will save tuples in different order. If order is
important then you could use
org.apache.apex.malhar.lib.wal.FileSystemWAL which is like a on-disk
queue. Or your could directly
use more high level SpillableArrayListImpl.

- Tushar.

On Tue, Oct 4, 2016 at 3:48 PM, Priyanka Gugale
 wrote:
> I am specifically looking into HFiles when I mentioned Hbase.
>
> -Priyanka
>
> On Tue, Oct 4, 2016 at 3:47 PM, Priyanka Gugale 
> wrote:
>
>> I am reconsidering using WindowDataManager or Hbase instead of
>> ManagedState to implement SpillableQueue.
>> Let me know if anyone have any thoughts on same.
>>
>> -Priyanka
>>
>> On Thu, Sep 29, 2016 at 5:54 PM, Priyanka Gugale > > wrote:
>>
>>> Hi,
>>>
>>> Please refer to this link for earlier discussion reference:
>>> https://lists.apache.org/list.html?dev@apex.apache.org
>>>
>>> -Priyanka
>>>
>>> On Thu, Sep 29, 2016 at 5:46 PM, Priyanka Gugale <
>>> priya...@datatorrent.com> wrote:
>>>
 Dear community,

 We had a discussion
 
 before about having reconciler for writing to JDBC output operator. I am
 proposing to write  a reconciler plugin which should be generic enough to
 work with most of output Systems. Please refer this
 
 document for design details. We also have a jira
  for same.

 Please provide your feedback.

 -Priyanka


>>>
>>

Re: Writing to external systems in reconciled fashion

[Priyanka Gugale]

Hi,

Please refer to this link for earlier discussion reference:
https://lists.apache.org/list.html?dev@apex.apache.org

-Priyanka

On Thu, Sep 29, 2016 at 5:46 PM, Priyanka Gugale 
wrote:

> Dear community,
>
> We had a discussion
> 
> before about having reconciler for writing to JDBC output operator. I am
> proposing to write  a reconciler plugin which should be generic enough to
> work with most of output Systems. Please refer this
> 
> document for design details. We also have a jira
>  for same.
>
> Please provide your feedback.
>
> -Priyanka
>
>

Writing to external systems in reconciled fashion

[Priyanka Gugale]

Dear community,

We had a discussion

before about having reconciler for writing to JDBC output operator. I am
proposing to write  a reconciler plugin which should be generic enough to
work with most of output Systems. Please refer this

document for design details. We also have a jira
 for same.

Please provide your feedback.

-Priyanka