Actually you might search the archives for “yarn” because I don’t recall
how the setup works off hand.
Archives here:
https://lists.apache.org/list.html?user@predictionio.apache.org
Also check the Spark Yarn requirements and remember that `pio train … --
various Spark params` allows you to pass
What is the command line for `pio train …` Specifically are you using
yarn-cluster mode? This causes the driver code, which is a PIO process, to be
executed on an executor. Special setup is required for this.
From: Wojciech Kowalski
Reply: user@predictionio.apache.org
Hello,
Actually I have another error in logs that is actually preventing train as well:
[INFO] [RecommendationEngine$]
_ _ __ __ _
/\ | | (_) | \/ | |
/ \ ___| |_ _ ___ _ __ | \ / | |
/ /\ \ / __| __| |/ _ \| '_ \| |\/| | |
/
Hello, I am trying to setup distributed cluster with separate all services but
i have problem while running train:
log4j:ERROR setFile(null,true) call failed.
java.io.FileNotFoundException: /pio/pio.log (No such file or directory)
at java.io.FileOutputStream.open0(Native Method)
Hi, Donald
I had add the HADOOP_CONF_DIR configurations, it's works as you described.
Thanks so much.
~$cat conf/core-site.xml
fs.defaultFS
hdfs://predictionspark:9000
At 2018-05-18 01:22:07, "Donald Szeto" wrote:
Hi,