I am trying out Pulsar Functions, and yesterday successfully deployed a
Test Function, and positivity was the tune of the day.
This morning I saw that the ordinary Pulsar Broker functionality had
stopped working, so I re-deployed the pulsar cluster (3 brokers, 3
bookies on same 3 servers).
After that I tried to see if the Test Function is still there, but
instead Pulsar Functions is not operational;
I am getting;
# /usr/local/lib/pulsar/bin/pulsar-admin functions list --tenant
sensetif --namespace main
Function worker service is not done initializing. Please try again in a
little while.
Reason: Function worker service is not done initializing. Please try
again in a little while.
And that is hours afterwards.
Is it common that the "function worker service" doesn't get going after
a restart??
Last entry in log about my test function, prior to the re-deploy
05:29:12.744 [function-timer-thread-64-1] INFO
org.apache.pulsar.functions.runtime.process.ProcessRuntime -
ProcessBuilder starting the process with args java -cp
/var/lib/pulsar/functions:/usr/local/lib/pulsar/instances/*
-Dpulsar.functions.extra.dependencies.dir=/usr/local/lib/pulsar/instances
-Dpulsar.functions.instance.classpath=/usr/local/lib/pulsar/conf:::/usr/local/lib/pulsar/lib/*:
-Dlog4j.configurationFile=/usr/local/lib/pulsar/conf/functions_log4j2.xml
-Dpulsar.function.log.dir=/var/log/pulsar-functions/functions/sensetif/main/TestFunction
-Dpulsar.function.log.file=TestFunction-0
-Dio.netty.tryReflectionSetAccessible=true --add-opens
java.base/sun.net=ALL-UNNAMED -Xmx1073741824
org.apache.pulsar.functions.instance.JavaInstanceMain --jar
/var/lib/pulsar/functions/sensetif/main/TestFunction/0/testfunction-1.0.1.nar
--instance_id 0 --function_id 8f49980c-0820-444f-ad1b-fc0ca7528f94
--function_version adec0f1b-9e1b-4f35-9688-62832c4462a8
--function_details
'{"tenant":"sensetif","namespace":"main","name":"TestFunction","className":"com.sensetif.pipes.fix.testfunction.TestFunction","userConfig":"{\"cassandra.hosts\":\"10.20.0.2,10.20.0.4,10.20.0.3\"}","autoAck":true,"parallelism":1,"source":{"typeClassName":"[B","inputSpecs":{"persistent://sensetif/main/timeseries":{}},"cleanupSubscription":true},"sink":{"topic":"non-persistent://sensetif/notifications/notifications-3","typeClassName":"[B","forwardSourceMessageProperty":true},"resources":{"cpu":1.0,"ram":"1073741824","disk":"10737418240"},"componentType":"FUNCTION"}'
--pulsar_serviceurl pulsar://10.20.0.10:6650 --max_buffered_tuples 1024
--port 37865 --metrics_port 46673 --pending_async_requests 1000
--expected_healthcheck_interval 30 --secrets_provider
org.apache.pulsar.functions.secretsprovider.ClearTextSecretsProvider
--cluster_name sensetif-cluster --nar_extraction_directory /tmp
