Hi!
I think there are four ways to do this:
1) Create a new abstract class "SerializableBaseTaskHook" that extends
BaseTaskHook and implements java.io.Serializabe. Then write the object into
bytes and put it into the config.
2) Offer in the StormCompatibilityAPI a method "public <X extends
BaseTaskHook & Serializable> void addHook(X hook)", which means you can
only pass elements that are both serializable and Hooks.
3) Require the user to write the classes with a public zero-argument
constructor and add only the class name to the config. Start the class via
"Class.forName(className, true, userCodeClassLoader).newInstance()".
4) Try to serialize with another Framework, like Kryo. This is not
guaranteed to work, however.
I hope any of those approaches works in your situation!
Greetings,
Stephan
On Wed, Sep 9, 2015 at 6:09 AM, Fangfengbin <fangfeng...@huawei.com> wrote:
> Hi
>
> @mjsax @StephanEwen @rmetzger
> Can you give me some suggestion about my idea of how to transfer
> user-defined class code to task?
> Thank you very much!
>
> Regards
> Fengbin Fang
>
> #################
>
> Dear all,
>
> I am work on task hooks of storm-compatibility. Storm support add hook
> through the Storm configuration using the "topology.auto.task.hooks"
> config. Users can use user-defined hooks class names as value of
> "topology.auto.task.hooks" of Configuration Map. These hooks are
> automatically registered in every spout or bolt.
>
> Example like this:
> public class Hooks extends BaseTaskHook {
> @Override
> public void boltExecute(BoltExecuteInfo info) {
> ...;
> }
> }
>
> public static void main(final String[] args) throws Exception {
> final FlinkTopologyBuilder builder =
> ExclamationTopology.buildTopology();
> Config config = new Config();
> config.put(Config.TOPOLOGY_AUTO_TASK_HOOKS,
> "org.apache.flink.stormcompatibility.util.Hook");
>
> // execute program locally
> final FlinkLocalCluster cluster = FlinkLocalCluster.getLocalCluster();
> cluster.submitTopology(topologyId, config, builder.createTopology()); }
>
> My question is how to transfer user-defined class code to task?
> Now I have a idea. I want to create user-defined hook object in
> FlinkClient and serialize it into bytes, then put bytes into storm
> configuration instead of user-defined hooks class names.
> So all spout/bout can get user-defined hook object from storm
> configuration. In this way, we can make a cleaner separation between the
> storm-compatibility and core code.
> But storm BaseTaskHook has not implements Serializable! So user-defined
> hooks class must implements Serializable. This is the difference.
>
> Can you give me some suggestion? Thank you very much!!
>
> Regards
> Fengbin Fang
>
>
>
>
>
>
