RE: Problem with training in yarn cluster

Actually you might search the archives for “yarn” because I don’t recall how the setup works off hand. Archives here: https://lists.apache.org/list.html?user@predictionio.apache.org Also check the Spark Yarn requirements and remember that `pio train … -- various Spark params` allows you to pass

RE: Problem with training in yarn cluster

What is the command line for `pio train …` Specifically are you using yarn-cluster mode? This causes the driver code, which is a PIO process, to be executed on an executor. Special setup is required for this. From: Wojciech Kowalski Reply: user@predictionio.apache.org

RE: Problem with training in yarn cluster

Hello, Actually I have another error in logs that is actually preventing train as well: [INFO] [RecommendationEngine$] _ _ __ __ _ /\ | | (_) | \/ | | / \ ___| |_ _ ___ _ __ | \ / | | / /\ \ / __| __| |/ _ \| '_ \| |\/| | | /

Problem with training in yarn cluster

Hello, I am trying to setup distributed cluster with separate all services but i have problem while running train: log4j:ERROR setFile(null,true) call failed. java.io.FileNotFoundException: /pio/pio.log (No such file or directory) at java.io.FileOutputStream.open0(Native Method)

Re:Re: use hdfs

Hi, Donald I had add the HADOOP_CONF_DIR configurations, it's works as you described. Thanks so much. ~$cat conf/core-site.xml fs.defaultFS hdfs://predictionspark:9000 At 2018-05-18 01:22:07, "Donald Szeto" wrote: Hi,