[
https://issues.apache.org/jira/browse/STORM-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089382#comment-15089382
]
ASF GitHub Bot commented on STORM-1030:
---------------------------------------
Github user revans2 commented on a diff in the pull request:
https://github.com/apache/storm/pull/871#discussion_r49201793
--- Diff:
external/storm-hive/src/main/java/org/apache/storm/hive/common/HiveConnector.java
---
@@ -0,0 +1,241 @@
+package org.apache.storm.hive.common;
+
+
+import org.apache.hadoop.security.UserGroupInformation;
+import org.apache.hive.hcatalog.streaming.HiveEndPoint;
+import org.apache.hive.hcatalog.streaming.StreamingException;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.io.IOException;
+import java.util.*;
+import java.util.concurrent.ExecutorService;
+import java.util.concurrent.Executors;
+import com.google.common.util.concurrent.ThreadFactoryBuilder;
+import java.util.concurrent.TimeUnit;
+import java.util.concurrent.ConcurrentHashMap;
+import java.util.concurrent.atomic.AtomicBoolean;
+
+public class HiveConnector {
+ private static final Logger LOG =
LoggerFactory.getLogger(HiveConnector.class);
+ private HiveOptions options;
+ private transient Timer heartBeatTimer;
+ private AtomicBoolean sendHeartBeat = new AtomicBoolean(true);
+ private UserGroupInformation ugi = null;
+ private Map<HiveEndPoint, HiveWriter> allWriters;
+ private ExecutorService callTimeoutPool;
+
+ public HiveConnector(HiveOptions options) {
+ this.options = options;
+
--- End diff --
Extra line
> Hive Connector Fixes
> --------------------
>
> Key: STORM-1030
> URL: https://issues.apache.org/jira/browse/STORM-1030
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-hive
> Reporter: Sriharsha Chintalapani
> Assignee: Sriharsha Chintalapani
> Fix For: 0.11.0
>
>
> 1. Schedule Hive transaction heartbeats outside of execute method.
> 2. Fix retiring idleWriters
> 3. Do not call flush if there is no data added to a txnbatch
> 4. Catch any exception and abort transaction.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)