conor-nsurely opened a new issue, #382:
URL: https://github.com/apache/pulsar-helm-chart/issues/382
My pulsar functions are running in Kubernetes and I would like to enable the
customizerRuntime so that I can pass customRuntimeOptions when creating a
pulsar function. For setting resource limits and changing job names etc.
#### Expected behavior
When I create a function via the admin API, I expect the customRuntimeConfig
to be applied, e.g. the Jobname should be the name that appears in Kubernetes.
Function config in the values.yml is like so:
`functions:
replicaCount: 1
enableCustomizerRuntime: "true"
runtimeCustomizerClassName:
"org.apache.pulsar.functions.runtime.kubernetes.BasicKubernetesManifestCustomizer"`
Also using these two settings for the broker config
`broker:
replicaCount: 1
configData:
enablePackagesManagement: "true"
functionsWorkerEnabled: "true"`
The customRuntimeOptions are being passed correctly, I can see them if I
fetch the function config from the admin api, here is an example. Notice the
cusomRuntimeOptions at the end.
`{
"tenant": "a0000001",
"namespace": "b0000001",
"name": "yg2tsEHNq8KkUypi",
"className": "",
"inputSpecs": {
"persistent://a0000001/b0000001/c0000001": {
"schemaProperties": {},
"consumerProperties": {},
"poolMessages": false,
"regexPattern": false
}
},
"output": "persistent://a0000001/b0000001/d0000001",
"producerConfig": {
"useThreadLocalProducers": false,
"batchBuilder": "",
"compressionType": "LZ4"
},
"processingGuarantees": "ATLEAST_ONCE",
"retainOrdering": false,
"retainKeyOrdering": false,
"forwardSourceMessageProperty": true,
"userConfig": {
"__function_config": {
"__function_type": "function",
"__transformer_id": "",
"__cluster_id": "",
"__user_config": {
"testingKey": "testingValue"
}
}
},
"runtime": "GO",
"autoAck": true,
"parallelism": 1,
"resources": {
"cpu": 1.0,
"ram": 1073741824,
"disk": 10737418240
},
"cleanupSubscription": true,
"customRuntimeOptions": "{\"jobName\":\"testJobName\"}",
"subscriptionPosition": "Latest"
}`
The "resources" for the function default to a crazy unscheduable value also,
I know the resources can be set elsewhere but I would like to set them in the
customRuntimeOptions map.
#### Actual behavior
The customRuntimeOptions have no effect.
#### Steps to reproduce
Attempt to create a function passing customRuntimeOptions, set the "jobName"
to any value and observe that it is ignored when the function is created.
#### System configuration
**Pulsar version**: 3.0.1
Kubernetes: 1.27
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
