[
https://issues.apache.org/jira/browse/CARBONDATA-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravindra Pesala resolved CARBONDATA-2784.
-----------------------------------------
Resolution: Fixed
Fix Version/s: 1.4.1
> [SDK writer] Forever blocking wait with more than 20 batch of data, when
> consumer is dead due to data loading exception
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-2784
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2784
> Project: CarbonData
> Issue Type: Bug
> Reporter: Ajantha Bhat
> Assignee: Ajantha Bhat
> Priority: Major
> Fix For: 1.4.1
>
> Time Spent: 4h 40m
> Remaining Estimate: 0h
>
> problem:
> [SDK writer] Forever blocking wait with more than 21 batch of data, when
> consumer is dead due to data loading exception (bad record / out of memory)
>
> root cause:
> When the consumer is dead due to data loading exception, writer will be
> forcefully closed. but queue.clear() cleared only snapshot of entries (10
> batches) and close is set to true after that. In between clear() and close =
> true, If more than 10 batches of data is again put into queue. For 11th
> batch, queue.put() goes for forever block as consumer is dead.
>
> Solution:
> set close = true, before clearing the queue. This will avoid adding more
> batches to queue from write().
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
