duhanmin opened a new pull request, #13968: URL: https://github.com/apache/dolphinscheduler/pull/13968
close https://github.com/apache/dolphinscheduler/issues/11488 DATAX_HOME supports local/hdfs/s3(dolphinscheduler_env.sh) ```shell local: DATAX_HOME=/opt/datax/ hdfs: /tmp/hadoop/datax.tar.gz s3: s3://bucket/tmp/hadoop/datax.tar.gz ``` New parameter(common.properties) ```shell # datax on yarn jar path https://github.com/duhanmin/datax-on-yarn datax.yarn.jar= # datax does not require that much memory, and configuration globally may affect the hadoop/spark/flink process datax.yarn.bin=HADOOP_OPTS="-Xms32m -Xmx128m" /usr/bin/yarn # specifies that datax runs queues on yarn,the front-end configuration has the highest priority datax.yarn.default.queue=default ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
