[ 
https://issues.apache.org/jira/browse/STORM-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002284#comment-15002284
 ] 

ASF GitHub Bot commented on STORM-1030:
---------------------------------------

Github user revans2 commented on a diff in the pull request:

    https://github.com/apache/storm/pull/871#discussion_r44673758
  
    --- Diff: 
external/storm-hive/src/main/java/org/apache/storm/hive/bolt/HiveBolt.java ---
    @@ -134,22 +131,16 @@ public void execute(Tuple tuple) {
                         collector.ack(t);
                     tupleBatch.clear();
                 }
    +        } catch(SerializationError se) {
    +            LOG.info("Serialization exception occurred, tuple is 
acknowledged but not written to Hive.", tuple);
    +            collector.ack(tuple);
    --- End diff --
    
    I am fine with it how the code is, like I said my comments were all minor.  
I was just thinking that if there are issues with the serialization I as a user 
am not going to be looking at the logs for errors, I am going to be looking at 
metrics, like failed tuples.  Perhaps we could have a follow on JIRA to add an 
IMetric for the number of tuples lost because of serialization errors. 


> Hive Connector Fixes
> --------------------
>
>                 Key: STORM-1030
>                 URL: https://issues.apache.org/jira/browse/STORM-1030
>             Project: Apache Storm
>          Issue Type: Bug
>          Components: storm-hive
>            Reporter: Sriharsha Chintalapani
>            Assignee: Sriharsha Chintalapani
>             Fix For: 0.11.0
>
>
> 1. Schedule Hive transaction heartbeats outside of execute method.
> 2. Fix retiring idleWriters
> 3. Do not call flush if there is no data added to a txnbatch
> 4. Catch any exception and abort transaction.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to