That totally makes sense. We use our custom algorithm based on Universal Recommender (UR), so we use elasticsearch and hbase in serving code. But we use it via PIO api. For hbase we use org.apache.predictionio.data.storage.hbase.HBLEvents.futureFind For elasticsearch we use EsClient from UR code.
On Wed, Apr 11, 2018 at 4:14 PM, Donald Szeto <don...@apache.org> wrote: > What engine template are you running? I think the server inside the JVM > process has already shut down (otherwise the new one won't be able to bind > to the same port), but it may have some I/O (e.g. database connections) > that is still active which would have hold the JVM process from > terminating. Is there a customization like that in your serving code? > > On Wed, Apr 11, 2018 at 4:09 PM, George Yarish <gyar...@griddynamics.com> > wrote: > >> I'm sorry for that, I have a few environments in which that problem >> reproduced. That was the one with *8000* port. >> It's pretty the same: >> >> $ ps aux | grep *8000* | wc -l >> 13 >> >> and processes looks like: >> >> da_mcom+ 17028 0.5 0.9 26473704 603220 ? Sl апр06 42:05 java -cp >> /data/PredictionIO-0.11.0-incubating/conf:/data/PredictionIO >> -0.11.0-incubating/plugins/*:/data/PredictionIO-0.11.0-incub >> ating/lib/spark/*:/data/PredictionIO-0.11.0-incubating/lib/ >> pio-assembly-0.11.0-incubating.jar:/usr/hdp/2.6.1.0-129/hbase/conf >> -Dpio.log.dir=/home/da_mcom_milan >> org.apache.predictionio.tools.console.Console >> deploy --port *8000* --pio-home /data/PredictionIO-0.11.0-incubating >> da_mcom+ 17269 1.1 1.5 19765888 996524 ? Sl апр06 87:45 >> /usr/java/default/bin/java -Dhdp.version=2.6.1.0-129 -cp >> /data/PredictionIO-0.11.0-incubating/conf/:/usr/hdp/2.6.1.0- >> 129/hbase/conf/:/usr/hdp/current/spark-client/conf/:/data/ >> PredictionIO-0.11.0-incubating/vendors/spark/lib/spark- >> assembly-1.6.3.2.6.1.0-129-hadoop2.7.3.2.6.1.0-129.jar:/ >> data/PredictionIO-0.11.0-incubating/vendors/spark/lib/datanu >> cleus-api-jdo-3.2.6.jar:/data/PredictionIO-0.11.0-incubating >> /vendors/spark/lib/datanucleus-core-3.2.10.jar:/data/ >> PredictionIO-0.11.0-incubating/vendors/spark/lib/datanucleus >> -rdbms-3.2.9.jar:/usr/hdp/current/hadoop-client/conf/:/ >> usr/hdp/current/hadoop-client/lib/aws-java-sdk-s3-1.10.6. >> jar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-core- >> 1.10.6.jar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-kms-1.10.6.jar >> -Xms1g -Xmx1g -Dpio.log.dir=/home/da_mcom_milan >> org.apache.spark.deploy.SparkSubmit --conf spark.driver.extraClassPath=/d >> ata/PredictionIO-0.11.0-incubating/conf:/usr/hdp/2.6.1.0-129/hbase/conf >> --conf spark.driver.extraJavaOptions=-Dpio.log.dir=/home/da_mcom_milan >> --class org.apache.predictionio.workflow.CreateServer --jars >> file:/data/PredictionIO-0.11.0-incubating/engines/some-engin >> e/target/scala-2.10/universal-recommender_2.10-0.6.0.jar, >> file:/data/PredictionIO-0.11.0-incubating/engines/some-engi >> ne/target/scala-2.10/universal-recommender-assembly-0.6.0- >> deps.jar,file:/data/PredictionIO-0.11.0-incubating >> /lib/spark/pio-data-elasticsearch1-assembly-0.11.0- >> incubating.jar,file:/data/PredictionIO-0.11.0-incubating/ >> lib/spark/pio-data-hbase-assembly-0.11.0-incubating. >> jar,file:/data/PredictionIO-0.11.0-incubating/lib/spark/pio- >> data-hdfs-assembly-0.11.0-incubating.jar,file:/data/Predicti >> onIO-0.11.0-incubating/lib/spark/pio-data-jdbc-assembly- >> 0.11.0-incubating.jar,file:/data/PredictionIO-0.11.0-incub >> ating/lib/spark/pio-data-localfs-assembly-0.11.0-incubating.jar --files >> file:/data/PredictionIO-0.11.0-incubating/conf/log4j.propert >> ies,file:/usr/hdp/2.6.1.0-129/hbase/conf/hbase-site.xml >> file:/data/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar >> --engineInstanceId AWKbr8hAdWI0xyRGjxPY --engine-variant >> file:/data/PredictionIO-0.11.0-incubating/engines/some-engine/engine.json >> --ip 0.0.0.0 --port *8000* --event-server-ip 0.0.0.0 --event-server-port >> 7070 --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_TYPE >> =hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_METADATA_ >> NAME=pio_meta,PIO_FS_BASEDIR=/home/da_mcom_milan/.pio_store, >> PIO_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=mdc2pr068,mdc2pr069, >> mdc2pr070,PIO_STORAGE_SOURCES_HBASE_HOME=/usr/hdp/2.6.1.0- >> 129/hbase,PIO_HOME=/data/PredictionIO-0.11.0- >> incubating,PIO_FS_ENGINESDIR=/home/da_mcom_milan/.pio_store/ >> engines,PIO_STORAGE_SOURCES_HDFS_TYPE=hdfs,PIO_STORAGE_ >> SOURCES_HDFS_PATH=/tmp/models,PIO_STORAGE_SOURCES_ >> ELASTICSEARCH_TYPE=elasticsearch,PIO_STORAGE_REPOSITORIES_ >> METADATA_SOURCE=ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_ >> MODELDATA_SOURCE=HDFS,PIO_STORAGE_REPOSITORIES_EVENTDATA >> _NAME=pio_event,PIO_STORAGE_SOURCES_ELASTICSEARCH_CLUSTERN >> AME=pros_es_prod,PIO_FS_TMPDIR=/home/da_mcom_milan/. >> pio_store/tmp,PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_ >> model,PIO_STORAGE_REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_ >> CONF_DIR=/data/PredictionIO-0.11.0-incubating/conf,PIO_ >> STORAGE_SOURCES_ELASTICSEARCH_PORTS=9300,9300,9300 >> da_mcom+ 17305 11.9 1.0 17214656 662920 pts/1 Sl 19:00 0:46 >> /usr/java/default/bin/java -Dhdp.version=2.6.1.0-129 -cp >> /data/PredictionIO-0.11.0-incubating/conf/:/usr/hdp/2.6.1.0- >> 129/hbase/conf/:/usr/hdp/current/spark-client/conf/:/data/ >> PredictionIO-0.11.0-incubating/vendors/spark/lib/spark- >> assembly-1.6.3.2.6.1.0-129-hadoop2.7.3.2.6.1.0-129.jar:/ >> data/PredictionIO-0.11.0-incubating/vendors/spark/lib/datanu >> cleus-api-jdo-3.2.6.jar:/data/PredictionIO-0.11.0-incubating >> /vendors/spark/lib/datanucleus-core-3.2.10.jar:/data/ >> PredictionIO-0.11.0-incubating/vendors/spark/lib/datanucleus >> -rdbms-3.2.9.jar:/usr/hdp/current/hadoop-client/conf/:/ >> usr/hdp/current/hadoop-client/lib/aws-java-sdk-s3-1.10.6. >> jar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-core- >> 1.10.6.jar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-kms-1.10.6.jar >> -Xms1g -Xmx1g -Dpio.log.dir=/home/da_mcom_milan >> org.apache.spark.deploy.SparkSubmit --conf spark.driver.extraClassPath=/d >> ata/PredictionIO-0.11.0-incubating/conf:/usr/hdp/2.6.1.0-129/hbase/conf >> --conf spark.driver.extraJavaOptions=-Dpio.log.dir=/home/da_mcom_milan >> --class org.apache.predictionio.workflow.CreateServer --jars >> file:/data/PredictionIO-0.11.0-incubating/engines/some-engin >> e/target/scala-2.10/universal-recommender_2.10-0.6.0.jar, >> file:/data/PredictionIO-0.11.0-incubating/engines/some-engi >> ne/target/scala-2.10/universal-recommender-assembly-0.6.0- >> deps.jar,file:/data/PredictionIO-0.11.0-incubating >> /lib/spark/pio-data-elasticsearch1-assembly-0.11.0- >> incubating.jar,file:/data/PredictionIO-0.11.0-incubating/ >> lib/spark/pio-data-hbase-assembly-0.11.0-incubating. >> jar,file:/data/PredictionIO-0.11.0-incubating/lib/spark/pio- >> data-hdfs-assembly-0.11.0-incubating.jar,file:/data/Predicti >> onIO-0.11.0-incubating/lib/spark/pio-data-jdbc-assembly- >> 0.11.0-incubating.jar,file:/data/PredictionIO-0.11.0-incub >> ating/lib/spark/pio-data-localfs-assembly-0.11.0-incubating.jar --files >> file:/data/PredictionIO-0.11.0-incubating/conf/log4j.propert >> ies,file:/usr/hdp/2.6.1.0-129/hbase/conf/hbase-site.xml >> file:/data/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar >> --engineInstanceId AWK1b5NndWI0xyRGBxWM --engine-variant >> file:/data/PredictionIO-0.11.0-incubating/engines/some-engine/engine.json >> --ip 0.0.0.0 --port *8000* --event-server-ip 0.0.0.0 --event-server-port >> 7070 --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_TYPE >> =hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_METADATA_ >> NAME=pio_meta,PIO_FS_BASEDIR=/home/da_mcom_milan/.pio_store, >> PIO_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=mdc2pr068,mdc2pr069, >> mdc2pr070,PIO_STORAGE_SOURCES_HBASE_HOME=/usr/hdp/2.6.1.0- >> 129/hbase,PIO_HOME=/data/PredictionIO-0.11.0- >> incubating,PIO_FS_ENGINESDIR=/home/da_mcom_milan/.pio_store/ >> engines,PIO_STORAGE_SOURCES_HDFS_TYPE=hdfs,PIO_STORAGE_ >> SOURCES_HDFS_PATH=/tmp/models,PIO_STORAGE_SOURCES_ >> ELASTICSEARCH_TYPE=elasticsearch,PIO_STORAGE_REPOSITORIES_ >> METADATA_SOURCE=ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_ >> MODELDATA_SOURCE=HDFS,PIO_STORAGE_REPOSITORIES_EVENTDATA >> _NAME=pio_event,PIO_STORAGE_SOURCES_ELASTICSEARCH_CLUSTERN >> AME=pros_es_prod,PIO_FS_TMPDIR=/home/da_mcom_milan/. >> pio_store/tmp,PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_ >> model,PIO_STORAGE_REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_ >> CONF_DIR=/data/PredictionIO-0.11.0-incubating/conf,PIO_ >> STORAGE_SOURCES_ELASTICSEARCH_PORTS=9300,9300,9300 >> da_mcom+ 18988 0.0 0.0 112652 984 pts/1 R+ 19:06 0:00 grep >> --color=auto *8000* >> da_mcom+ 48849 0.5 0.9 26473704 607720 ? Sl апр05 50:01 java -cp >> /data/PredictionIO-0.11.0-incubating/conf:/data/PredictionIO >> -0.11.0-incubating/plugins/*:/data/PredictionIO-0.11.0-incub >> ating/lib/spark/*:/data/PredictionIO-0.11.0-incubating/lib/ >> pio-assembly-0.11.0-incubating.jar:/usr/hdp/2.6.1.0-129/hbase/conf >> -Dpio.log.dir=/home/da_mcom_milan >> org.apache.predictionio.tools.console.Console >> deploy --port *8000* --pio-home /data/PredictionIO-0.11.0-incubating >> da_mcom+ 49016 1.1 1.4 19766916 967792 ? Sl апр05 102:52 >> /usr/java/default/bin/java -Dhdp.version=2.6.1.0-129 -cp >> /data/PredictionIO-0.11.0-incubating/conf/:/usr/hdp/2.6.1.0- >> 129/hbase/conf/:/usr/hdp/current/spark-client/conf/:/data/ >> PredictionIO-0.11.0-incubating/vendors/spark/lib/spark- >> assembly-1.6.3.2.6.1.0-129-hadoop2.7.3.2.6.1.0-129.jar:/ >> data/PredictionIO-0.11.0-incubating/vendors/spark/lib/datanu >> cleus-api-jdo-3.2.6.jar:/data/PredictionIO-0.11.0-incubating >> /vendors/spark/lib/datanucleus-core-3.2.10.jar:/data/ >> PredictionIO-0.11.0-incubating/vendors/spark/lib/datanucleus >> -rdbms-3.2.9.jar:/usr/hdp/current/hadoop-client/conf/:/ >> usr/hdp/current/hadoop-client/lib/aws-java-sdk-s3-1.10.6. >> jar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-core- >> 1.10.6.jar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-kms-1.10.6.jar >> -Xms1g -Xmx1g -Dpio.log.dir=/home/da_mcom_milan >> org.apache.spark.deploy.SparkSubmit --conf spark.driver.extraClassPath=/d >> ata/PredictionIO-0.11.0-incubating/conf:/usr/hdp/2.6.1.0-129/hbase/conf >> --conf spark.driver.extraJavaOptions=-Dpio.log.dir=/home/da_mcom_milan >> --class org.apache.predictionio.workflow.CreateServer --jars >> file:/data/PredictionIO-0.11.0-incubating/engines/some-engin >> e/target/scala-2.10/universal-recommender_2.10-0.6.0.jar, >> file:/data/PredictionIO-0.11.0-incubating/engines/some-engi >> ne/target/scala-2.10/universal-recommender-assembly-0.6.0- >> deps.jar,file:/data/PredictionIO-0.11.0-incubating >> /lib/spark/pio-data-elasticsearch1-assembly-0.11.0- >> incubating.jar,file:/data/PredictionIO-0.11.0-incubating/ >> lib/spark/pio-data-hbase-assembly-0.11.0-incubating. >> jar,file:/data/PredictionIO-0.11.0-incubating/lib/spark/pio- >> data-hdfs-assembly-0.11.0-incubating.jar,file:/data/Predicti >> onIO-0.11.0-incubating/lib/spark/pio-data-jdbc-assembly- >> 0.11.0-incubating.jar,file:/data/PredictionIO-0.11.0-incub >> ating/lib/spark/pio-data-localfs-assembly-0.11.0-incubating.jar --files >> file:/data/PredictionIO-0.11.0-incubating/conf/log4j.propert >> ies,file:/usr/hdp/2.6.1.0-129/hbase/conf/hbase-site.xml >> file:/data/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar >> --engineInstanceId AWKWiWsxdWI0xyRGjxPJ --engine-variant >> file:/data/PredictionIO-0.11.0-incubating/engines/some-engine/engine.json >> --ip 0.0.0.0 --port *8000* --event-server-ip 0.0.0.0 --event-server-port >> 7070 --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_TYPE >> =hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_METADATA_ >> NAME=pio_meta,PIO_FS_BASEDIR=/home/da_mcom_milan/.pio_store, >> PIO_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=mdc2pr068,mdc2pr069, >> mdc2pr070,PIO_STORAGE_SOURCES_HBASE_HOME=/usr/hdp/2.6.1.0- >> 129/hbase,PIO_HOME=/data/PredictionIO-0.11.0- >> incubating,PIO_FS_ENGINESDIR=/home/da_mcom_milan/.pio_store/ >> engines,PIO_STORAGE_SOURCES_HDFS_TYPE=hdfs,PIO_STORAGE_ >> SOURCES_HDFS_PATH=/tmp/models,PIO_STORAGE_SOURCES_ >> ELASTICSEARCH_TYPE=elasticsearch,PIO_STORAGE_REPOSITORIES_ >> METADATA_SOURCE=ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_ >> MODELDATA_SOURCE=HDFS,PIO_STORAGE_REPOSITORIES_EVENTDATA >> _NAME=pio_event,PIO_STORAGE_SOURCES_ELASTICSEARCH_CLUSTERN >> AME=pros_es_prod,PIO_FS_TMPDIR=/home/da_mcom_milan/. >> pio_store/tmp,PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_ >> model,PIO_STORAGE_REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_ >> CONF_DIR=/data/PredictionIO-0.11.0-incubating/conf,PIO_ >> STORAGE_SOURCES_ELASTICSEARCH_PORTS=9300,9300,9300 >> >> >> >> On Wed, Apr 11, 2018 at 3:39 PM, Donald Szeto <don...@apache.org> wrote: >> >>> Are you able to find any occurrence of port 8004? The excerpt you showed >>> was about port 8000. >>> >>> On Wed, Apr 11, 2018 at 3:18 PM, George Yarish <gyar...@griddynamics.com >>> > wrote: >>> >>>> Hi Donald >>>> >>>> Thank you for the answer. >>>> it looks fine to me, but processes still alive: >>>> >>>> 2018-04-11 13:00:25,331 INFO org.apache.predictionio.workflow.MasterActor >>>> [pio-server-akka.actor.default-dispatcher-5] - Undeploying any >>>> existing engine instance at http://0.0.0.0:8000 >>>> 2018-04-11 13:00:26,467 INFO org.apache.predictionio.workflow.MasterActor >>>> [pio-server-akka.actor.default-dispatcher-9] - Stop server command >>>> received. >>>> 2018-04-11 13:00:26,468 INFO org.apache.predictionio.workflow.MasterActor >>>> [pio-server-akka.actor.default-dispatcher-9] - Server is shutting down. >>>> 2018-04-11 13:00:26,617 INFO spray.can.server.HttpListener >>>> [pio-server-akka.actor.default-dispatcher-2] - Bound to /0.0.0.0:8000 >>>> 2018-04-11 13:00:26,620 INFO org.apache.predictionio.workflow.MasterActor >>>> [pio-server-akka.actor.default-dispatcher-4] - Engine is deployed and >>>> running. Engine API is live at http://0.0.0.0:8000 >>>> >>>> Thank you, >>>> George >>>> >>>> >>>> On Wed, Apr 11, 2018 at 11:48 AM, Donald Szeto <don...@apache.org> >>>> wrote: >>>> >>>>> Hi George, >>>>> >>>>> Mind checking the content of pio.log at where you run `pio deploy`? It >>>>> should contain some messages regarding undeploying existing engine servers >>>>> on the same port. >>>>> >>>>> Regards, >>>>> Donald >>>>> >>>>> On Thu, Apr 5, 2018 at 6:43 PM, George Yarish < >>>>> gyar...@griddynamics.com> wrote: >>>>> >>>>>> Hi everyone, >>>>>> >>>>>> I faced a strange situation recently. >>>>>> One of our engines has frequently old processes after daily >>>>>> redeployment. >>>>>> >>>>>> We used to redeploy by crontab rule that looks like: >>>>>> nohup pio deploy --port 8004 >> ${DEPLOY_LOG_FILE} 2>&1 & >>>>>> >>>>>> >>>>>> This is output of ps aux command: >>>>>> >>>>>> [da_mcom_milan@mdc2pr113 ~]$ ps aux | grep 8004 >>>>>> >>>>>> da_mcom+ 7854 0.0 0.0 112660 996 pts/1 S+ 21:34 0:00 grep >>>>>> --color=auto *8004* >>>>>> >>>>>> 1. da_mcom+ 30932 0.6 0.9 26473632 595932 ? Sl 01:57 7:51 >>>>>> java -cp /data/PredictionIO-0.11.0-incubating/conf:/data/PredictionIO >>>>>> -0.11.0-incubating/plugins/*:/data/PredictionIO-0.11.0-incub >>>>>> ating/lib/spark/*:/data/PredictionIO-0.11.0-incubating/lib/p >>>>>> io-assembly-0.11.0-incubating.jar:/usr/hdp/2.5.3.0-37/hadoop >>>>>> /conf:/data/PredictionIO/vendors/hbase/conf >>>>>> -Dpio.log.dir=/home/da_mcom_milan >>>>>> org.apache.predictionio.tools.console.Console >>>>>> deploy --port *8004* --pio-home /data/PredictionIO-0.11.0-incubating >>>>>> >>>>>> 2. da_mcom+ 31097 1.2 1.2 17065124 822596 ? Sl 01:57 14:48 >>>>>> /usr/java/default/bin/java -Dhdp.version=2.5.3.0-37 -cp >>>>>> /data/PredictionIO-0.11.0-incubating/conf/:/usr/hdp/2.5.3.0- >>>>>> 37/hadoop/conf/:/data/PredictionIO/vendors/hbase/conf/:/usr/ >>>>>> hdp/current/spark-client/conf/:/data/PredictionIO/vendors/sp >>>>>> ark/lib/spark-assembly-1.6.2.2.5.3.0-37-hadoop2.7.3.2.5.3.0- >>>>>> 37.jar:/data/PredictionIO/vendors/spark/lib/datanucleus-api- >>>>>> jdo-3.2.6.jar:/data/PredictionIO/vendors/spark/lib/datanucle >>>>>> us-core-3.2.10.jar:/data/PredictionIO/vendors/spark/lib/data >>>>>> nucleus-rdbms-3.2.9.jar:/usr/hdp/2.5.3.0-37/hadoop/conf/:/us >>>>>> r/hdp/current/hadoop-client/lib/aws-java-sdk-s3-1.10.6.jar:/ >>>>>> usr/hdp/current/hadoop-client/lib/aws-java-sdk-core-1.10.6.j >>>>>> ar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-kms-1.10.6.jar >>>>>> -Xms1g -Xmx1g -Dpio.log.dir=/home/da_mcom_milan >>>>>> org.apache.spark.deploy.SparkSubmit --conf >>>>>> spark.driver.extraClassPath=/data/PredictionIO-0.11.0-incuba >>>>>> ting/conf:/usr/hdp/2.5.3.0-37/hadoop/conf:/data/PredictionIO/vendors/hbase/conf >>>>>> --conf spark.driver.extraJavaOptions=-Dpio.log.dir=/home/da_mcom_milan >>>>>> --class org.apache.predictionio.workflow.CreateServer --jars >>>>>> file:/data/PredictionIO/some-engine/target/scala-2.10/univer >>>>>> sal-recommender_2.10-0.6.0.jar,file:/data/PredictionIO/some-engine >>>>>> /target/scala-2.10/universal-recommender-assembly-0.6. >>>>>> 0-deps.jar,file:/data/PredictionIO-0.11.0-incubating/lib/spa >>>>>> rk/pio-data-elasticsearch1-assembly-0.11.0-incubating.jar,fi >>>>>> le:/data/PredictionIO-0.11.0-incubating/lib/spark/pio-data-h >>>>>> base-assembly-0.11.0-incubating.jar,file:/data/PredictionIO- >>>>>> 0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-in >>>>>> cubating.jar,file:/data/PredictionIO-0.11.0-incubating/lib/s >>>>>> park/pio-data-jdbc-assembly-0.11.0-incubating.jar,file:/data >>>>>> /PredictionIO-0.11.0-incubating/lib/spark/pio-data-localfs-assembly-0.11.0-incubating.jar >>>>>> --files file:/data/PredictionIO-0.11.0-incubating/conf/log4j.propert >>>>>> ies,file:/usr/hdp/2.5.3.0-37/hadoop/conf/core-site.xml,file: >>>>>> /data/PredictionIO/vendors/hbase/conf/hbase-site.xml >>>>>> file:/data/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar >>>>>> --engineInstanceId AWKSaLQrSe_zVbacBHWI --engine-variant >>>>>> file:/data/PredictionIO/some-engine/engine.json --ip 0.0.0.0 --port >>>>>> *8004* --event-server-ip 0.0.0.0 --event-server-port 7070 >>>>>> --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_TYPE >>>>>> =hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_METADATA_NA >>>>>> ME=pio_meta,PIO_FS_BASEDIR=/home/da_mcom_milan/.pio_store,PI >>>>>> O_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=mdc2vra176,PIO_STORAGE >>>>>> _SOURCES_HBASE_HOME=/data/PredictionIO/vendors/hbase,PIO_HOM >>>>>> E=/data/PredictionIO-0.11.0-incubating,PIO_FS_ENGINESDIR=/ho >>>>>> me/da_mcom_milan/.pio_store/engines,PIO_STORAGE_SOURCES_LOCA >>>>>> LFS_PATH=/home/da_mcom_milan/.pio_store/models,PIO_STORAGE_S >>>>>> OURCES_ELASTICSEARCH_TYPE=elasticsearch,PIO_STORAGE_REPOSITO >>>>>> RIES_METADATA_SOURCE=ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_ >>>>>> MODELDATA_SOURCE=LOCALFS,PIO_STORAGE_REPOSITORIES_EVENTDATA_ >>>>>> NAME=pio_event,PIO_STORAGE_SOURCES_ELASTICSEARCH_CLUSTERNAME >>>>>> =pros-dev,PIO_FS_TMPDIR=/home/da_mcom_milan/.pio_store/tmp, >>>>>> PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model,PIO_STORAG >>>>>> E_REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_CONF_DIR=/ >>>>>> data/PredictionIO-0.11.0-incubating/conf,PIO_STORAGE_ >>>>>> SOURCES_ELASTICSEARCH_PORTS=9300,PIO_STORAGE_SOURCES_ >>>>>> LOCALFS_TYPE=localfs >>>>>> >>>>>> 3. da_mcom+ 32505 0.6 0.8 26473632 581164 ? Sl 02:00 7:54 >>>>>> java -cp /data/PredictionIO-0.11.0-incubating/conf:/data/PredictionIO >>>>>> -0.11.0-incubating/plugins/*:/data/PredictionIO-0.11.0-incub >>>>>> ating/lib/spark/*:/data/PredictionIO-0.11.0-incubating/lib/p >>>>>> io-assembly-0.11.0-incubating.jar:/usr/hdp/2.5.3.0-37/hadoop >>>>>> /conf:/data/PredictionIO/vendors/hbase/conf >>>>>> -Dpio.log.dir=/home/da_mcom_milan >>>>>> org.apache.predictionio.tools.console.Console >>>>>> deploy --port *8004* --pio-home /data/PredictionIO-0.11.0-incubating >>>>>> >>>>>> 4. da_mcom+ 32671 1.4 1.3 19757488 881448 ? Sl 02:00 16:27 >>>>>> /usr/java/default/bin/java -Dhdp.version=2.5.3.0-37 -cp >>>>>> /data/PredictionIO-0.11.0-incubating/conf/:/usr/hdp/2.5.3.0- >>>>>> 37/hadoop/conf/:/data/PredictionIO/vendors/hbase/conf/:/usr/ >>>>>> hdp/current/spark-client/conf/:/data/PredictionIO/vendors/sp >>>>>> ark/lib/spark-assembly-1.6.2.2.5.3.0-37-hadoop2.7.3.2.5.3.0- >>>>>> 37.jar:/data/PredictionIO/vendors/spark/lib/datanucleus-api- >>>>>> jdo-3.2.6.jar:/data/PredictionIO/vendors/spark/lib/datanucle >>>>>> us-core-3.2.10.jar:/data/PredictionIO/vendors/spark/lib/data >>>>>> nucleus-rdbms-3.2.9.jar:/usr/hdp/2.5.3.0-37/hadoop/conf/:/us >>>>>> r/hdp/current/hadoop-client/lib/aws-java-sdk-s3-1.10.6.jar:/ >>>>>> usr/hdp/current/hadoop-client/lib/aws-java-sdk-core-1.10.6.j >>>>>> ar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-kms-1.10.6.jar >>>>>> -Xms1g -Xmx1g -Dpio.log.dir=/home/da_mcom_milan >>>>>> org.apache.spark.deploy.SparkSubmit --conf >>>>>> spark.driver.extraClassPath=/data/PredictionIO-0.11.0-incuba >>>>>> ting/conf:/usr/hdp/2.5.3.0-37/hadoop/conf:/data/PredictionIO/vendors/hbase/conf >>>>>> --conf spark.driver.extraJavaOptions=-Dpio.log.dir=/home/da_mcom_milan >>>>>> --class org.apache.predictionio.workflow.CreateServer --jars >>>>>> file:/data/PredictionIO/some-engine/target/scala-2.10/univer >>>>>> sal-recommender_2.10-0.6.0.jar,file:/data/PredictionIO/some-engine >>>>>> /target/scala-2.10/universal-recommender-assembly-0.6. >>>>>> 0-deps.jar,file:/data/PredictionIO-0.11.0-incubating/lib/spa >>>>>> rk/pio-data-elasticsearch1-assembly-0.11.0-incubating.jar,fi >>>>>> le:/data/PredictionIO-0.11.0-incubating/lib/spark/pio-data-h >>>>>> base-assembly-0.11.0-incubating.jar,file:/data/PredictionIO- >>>>>> 0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-in >>>>>> cubating.jar,file:/data/PredictionIO-0.11.0-incubating/lib/s >>>>>> park/pio-data-jdbc-assembly-0.11.0-incubating.jar,file:/data >>>>>> /PredictionIO-0.11.0-incubating/lib/spark/pio-data-localfs-assembly-0.11.0-incubating.jar >>>>>> --files file:/data/PredictionIO-0.11.0-incubating/conf/log4j.propert >>>>>> ies,file:/usr/hdp/2.5.3.0-37/hadoop/conf/core-site.xml,file: >>>>>> /data/PredictionIO/vendors/hbase/conf/hbase-site.xml >>>>>> file:/data/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar >>>>>> --engineInstanceId AWKSaLQrSe_zVbacBHWI --engine-variant >>>>>> file:/data/PredictionIO/some-engine/engine.json --ip 0.0.0.0 --port >>>>>> *8004* --event-server-ip 0.0.0.0 --event-server-port 7070 >>>>>> --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_TYPE >>>>>> =hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_METADATA_NA >>>>>> ME=pio_meta,PIO_FS_BASEDIR=/home/da_mcom_milan/.pio_store,PI >>>>>> O_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=mdc2vra176,PIO_STORAGE >>>>>> _SOURCES_HBASE_HOME=/data/PredictionIO/vendors/hbase,PIO_HOM >>>>>> E=/data/PredictionIO-0.11.0-incubating,PIO_FS_ENGINESDIR=/ho >>>>>> me/da_mcom_milan/.pio_store/engines,PIO_STORAGE_SOURCES_LOCA >>>>>> LFS_PATH=/home/da_mcom_milan/.pio_store/models,PIO_STORAGE_S >>>>>> OURCES_ELASTICSEARCH_TYPE=elasticsearch,PIO_STORAGE_REPOSITO >>>>>> RIES_METADATA_SOURCE=ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_ >>>>>> MODELDATA_SOURCE=LOCALFS,PIO_STORAGE_REPOSITORIES_EVENTDATA_ >>>>>> NAME=pio_event,PIO_STORAGE_SOURCES_ELASTICSEARCH_CLUSTERNAME >>>>>> =pros-dev,PIO_FS_TMPDIR=/home/da_mcom_milan/.pio_store/tmp, >>>>>> PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model,PIO_STORAG >>>>>> E_REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_CONF_DIR=/ >>>>>> data/PredictionIO-0.11.0-incubating/conf,PIO_STORAGE_ >>>>>> SOURCES_ELASTICSEARCH_PORTS=9300,PIO_STORAGE_SOURCES_ >>>>>> LOCALFS_TYPE=localfs >>>>>> >>>>>> For some reasons, processes 30932 and 31097 still alive and process >>>>>> listened by 32671 >>>>>> Any ideas? >>>>>> >>>>>> Thank you, >>>>>> George >>>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> >>>> George Yarish, Java Developer >>>> >>>> Grid Dynamics >>>> >>>> 197101, Rentgena Str., 5A, St.Petersburg, Russia >>>> >>>> Cell: +7 950 030-1941 >>>> >>>> Read Grid Dynamics' Tech Blog >>>> <http://blog.griddynamics.com/?utm_campaign=Big%20Data%20Blog%20social%20media%20promotion&utm_medium=CTA&utm_source=Email> >>>> >>>> >>>> >>> >> >> >> -- >> >> George Yarish, Java Developer >> >> Grid Dynamics >> >> 197101, Rentgena Str., 5A, St.Petersburg, Russia >> >> Cell: +7 950 030-1941 >> >> Read Grid Dynamics' Tech Blog >> <http://blog.griddynamics.com/?utm_campaign=Big%20Data%20Blog%20social%20media%20promotion&utm_medium=CTA&utm_source=Email> >> >> >> > -- George Yarish, Java Developer Grid Dynamics 197101, Rentgena Str., 5A, St.Petersburg, Russia Cell: +7 950 030-1941 Read Grid Dynamics' Tech Blog <http://blog.griddynamics.com/?utm_campaign=Big%20Data%20Blog%20social%20media%20promotion&utm_medium=CTA&utm_source=Email>
