What engine template are you running? I think the server inside the JVM
process has already shut down (otherwise the new one won't be able to bind
to the same port), but it may have some I/O (e.g. database connections)
that is still active which would have hold the JVM process from
terminating. Is there a customization like that in your serving code?

On Wed, Apr 11, 2018 at 4:09 PM, George Yarish <gyar...@griddynamics.com>
wrote:

> I'm sorry for that, I have a few environments in which that problem
> reproduced. That was the one with *8000* port.
> It's pretty the same:
>
> $ ps aux | grep *8000* | wc -l
> 13
>
> and processes looks like:
>
> da_mcom+ 17028  0.5  0.9 26473704 603220 ?     Sl   апр06  42:05 java -cp
> /data/PredictionIO-0.11.0-incubating/conf:/data/PredictionIO-0.11.0-
> incubating/plugins/*:/data/PredictionIO-0.11.0-
> incubating/lib/spark/*:/data/PredictionIO-0.11.0-
> incubating/lib/pio-assembly-0.11.0-incubating.jar:/usr/hdp/2.6.1.0-129/hbase/conf
> -Dpio.log.dir=/home/da_mcom_milan 
> org.apache.predictionio.tools.console.Console
> deploy --port *8000* --pio-home /data/PredictionIO-0.11.0-incubating
> da_mcom+ 17269  1.1  1.5 19765888 996524 ?     Sl   апр06  87:45
> /usr/java/default/bin/java -Dhdp.version=2.6.1.0-129 -cp
> /data/PredictionIO-0.11.0-incubating/conf/:/usr/hdp/2.6.
> 1.0-129/hbase/conf/:/usr/hdp/current/spark-client/conf/:/
> data/PredictionIO-0.11.0-incubating/vendors/spark/lib/
> spark-assembly-1.6.3.2.6.1.0-129-hadoop2.7.3.2.6.1.0-129.
> jar:/data/PredictionIO-0.11.0-incubating/vendors/spark/lib/
> datanucleus-api-jdo-3.2.6.jar:/data/PredictionIO-0.11.0-
> incubating/vendors/spark/lib/datanucleus-core-3.2.10.jar:/
> data/PredictionIO-0.11.0-incubating/vendors/spark/lib/
> datanucleus-rdbms-3.2.9.jar:/usr/hdp/current/hadoop-client/
> conf/:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-s3-1.
> 10.6.jar:/usr/hdp/current/hadoop-client/lib/aws-java-
> sdk-core-1.10.6.jar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-kms-1.10.6.jar
> -Xms1g -Xmx1g -Dpio.log.dir=/home/da_mcom_milan 
> org.apache.spark.deploy.SparkSubmit
> --conf spark.driver.extraClassPath=/data/PredictionIO-0.11.0-
> incubating/conf:/usr/hdp/2.6.1.0-129/hbase/conf --conf
> spark.driver.extraJavaOptions=-Dpio.log.dir=/home/da_mcom_milan --class
> org.apache.predictionio.workflow.CreateServer --jars
> file:/data/PredictionIO-0.11.0-incubating/engines/some-
> engine/target/scala-2.10/universal-recommender_2.10-0.6.0.jar,file:/data/
> PredictionIO-0.11.0-incubating/engines/some-engine/target/scala-2.10/
> universal-recommender-assembly-0.6.0-deps.jar,file:/
> data/PredictionIO-0.11.0-incubating/lib/spark/pio-data-
> elasticsearch1-assembly-0.11.0-incubating.jar,file:/data/
> PredictionIO-0.11.0-incubating/lib/spark/pio-data-hbase-assembly-0.11.0-
> incubating.jar,file:/data/PredictionIO-0.11.0-
> incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-
> incubating.jar,file:/data/PredictionIO-0.11.0-
> incubating/lib/spark/pio-data-jdbc-assembly-0.11.0-
> incubating.jar,file:/data/PredictionIO-0.11.0-
> incubating/lib/spark/pio-data-localfs-assembly-0.11.0-incubating.jar
> --files file:/data/PredictionIO-0.11.0-incubating/conf/log4j.
> properties,file:/usr/hdp/2.6.1.0-129/hbase/conf/hbase-site.xml
> file:/data/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar
> --engineInstanceId AWKbr8hAdWI0xyRGjxPY --engine-variant
> file:/data/PredictionIO-0.11.0-incubating/engines/some-engine/engine.json
> --ip 0.0.0.0 --port *8000* --event-server-ip 0.0.0.0 --event-server-port
> 7070 --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_
> TYPE=hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_
> METADATA_NAME=pio_meta,PIO_FS_BASEDIR=/home/da_mcom_milan/.
> pio_store,PIO_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=mdc2pr068,
> mdc2pr069,mdc2pr070,PIO_STORAGE_SOURCES_HBASE_HOME=/
> usr/hdp/2.6.1.0-129/hbase,PIO_HOME=/data/PredictionIO-0.11.
> 0-incubating,PIO_FS_ENGINESDIR=/home/da_mcom_milan/.pio_store/engines,PIO_
> STORAGE_SOURCES_HDFS_TYPE=hdfs,PIO_STORAGE_SOURCES_HDFS_
> PATH=/tmp/models,PIO_STORAGE_SOURCES_ELASTICSEARCH_TYPE=
> elasticsearch,PIO_STORAGE_REPOSITORIES_METADATA_SOURCE=
> ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_MODELDATA_SOURCE=
> HDFS,PIO_STORAGE_REPOSITORIES_EVENTDATA_NAME=pio_event,PIO_
> STORAGE_SOURCES_ELASTICSEARCH_CLUSTERNAME=pros_es_prod,PIO_
> FS_TMPDIR=/home/da_mcom_milan/.pio_store/tmp,PIO_STORAGE_
> REPOSITORIES_MODELDATA_NAME=pio_model,PIO_STORAGE_
> REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_CONF_DIR=/data/
> PredictionIO-0.11.0-incubating/conf,PIO_STORAGE_
> SOURCES_ELASTICSEARCH_PORTS=9300,9300,9300
> da_mcom+ 17305 11.9  1.0 17214656 662920 pts/1 Sl   19:00   0:46
> /usr/java/default/bin/java -Dhdp.version=2.6.1.0-129 -cp
> /data/PredictionIO-0.11.0-incubating/conf/:/usr/hdp/2.6.
> 1.0-129/hbase/conf/:/usr/hdp/current/spark-client/conf/:/
> data/PredictionIO-0.11.0-incubating/vendors/spark/lib/
> spark-assembly-1.6.3.2.6.1.0-129-hadoop2.7.3.2.6.1.0-129.
> jar:/data/PredictionIO-0.11.0-incubating/vendors/spark/lib/
> datanucleus-api-jdo-3.2.6.jar:/data/PredictionIO-0.11.0-
> incubating/vendors/spark/lib/datanucleus-core-3.2.10.jar:/
> data/PredictionIO-0.11.0-incubating/vendors/spark/lib/
> datanucleus-rdbms-3.2.9.jar:/usr/hdp/current/hadoop-client/
> conf/:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-s3-1.
> 10.6.jar:/usr/hdp/current/hadoop-client/lib/aws-java-
> sdk-core-1.10.6.jar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-kms-1.10.6.jar
> -Xms1g -Xmx1g -Dpio.log.dir=/home/da_mcom_milan 
> org.apache.spark.deploy.SparkSubmit
> --conf spark.driver.extraClassPath=/data/PredictionIO-0.11.0-
> incubating/conf:/usr/hdp/2.6.1.0-129/hbase/conf --conf
> spark.driver.extraJavaOptions=-Dpio.log.dir=/home/da_mcom_milan --class
> org.apache.predictionio.workflow.CreateServer --jars
> file:/data/PredictionIO-0.11.0-incubating/engines/some-
> engine/target/scala-2.10/universal-recommender_2.10-0.6.0.jar,file:/data/
> PredictionIO-0.11.0-incubating/engines/some-engine/target/scala-2.10/
> universal-recommender-assembly-0.6.0-deps.jar,file:/
> data/PredictionIO-0.11.0-incubating/lib/spark/pio-data-
> elasticsearch1-assembly-0.11.0-incubating.jar,file:/data/
> PredictionIO-0.11.0-incubating/lib/spark/pio-data-hbase-assembly-0.11.0-
> incubating.jar,file:/data/PredictionIO-0.11.0-
> incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-
> incubating.jar,file:/data/PredictionIO-0.11.0-
> incubating/lib/spark/pio-data-jdbc-assembly-0.11.0-
> incubating.jar,file:/data/PredictionIO-0.11.0-
> incubating/lib/spark/pio-data-localfs-assembly-0.11.0-incubating.jar
> --files file:/data/PredictionIO-0.11.0-incubating/conf/log4j.
> properties,file:/usr/hdp/2.6.1.0-129/hbase/conf/hbase-site.xml
> file:/data/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar
> --engineInstanceId AWK1b5NndWI0xyRGBxWM --engine-variant
> file:/data/PredictionIO-0.11.0-incubating/engines/some-engine/engine.json
> --ip 0.0.0.0 --port *8000* --event-server-ip 0.0.0.0 --event-server-port
> 7070 --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_
> TYPE=hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_
> METADATA_NAME=pio_meta,PIO_FS_BASEDIR=/home/da_mcom_milan/.
> pio_store,PIO_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=mdc2pr068,
> mdc2pr069,mdc2pr070,PIO_STORAGE_SOURCES_HBASE_HOME=/
> usr/hdp/2.6.1.0-129/hbase,PIO_HOME=/data/PredictionIO-0.11.
> 0-incubating,PIO_FS_ENGINESDIR=/home/da_mcom_milan/.pio_store/engines,PIO_
> STORAGE_SOURCES_HDFS_TYPE=hdfs,PIO_STORAGE_SOURCES_HDFS_
> PATH=/tmp/models,PIO_STORAGE_SOURCES_ELASTICSEARCH_TYPE=
> elasticsearch,PIO_STORAGE_REPOSITORIES_METADATA_SOURCE=
> ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_MODELDATA_SOURCE=
> HDFS,PIO_STORAGE_REPOSITORIES_EVENTDATA_NAME=pio_event,PIO_
> STORAGE_SOURCES_ELASTICSEARCH_CLUSTERNAME=pros_es_prod,PIO_
> FS_TMPDIR=/home/da_mcom_milan/.pio_store/tmp,PIO_STORAGE_
> REPOSITORIES_MODELDATA_NAME=pio_model,PIO_STORAGE_
> REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_CONF_DIR=/data/
> PredictionIO-0.11.0-incubating/conf,PIO_STORAGE_
> SOURCES_ELASTICSEARCH_PORTS=9300,9300,9300
> da_mcom+ 18988  0.0  0.0 112652   984 pts/1    R+   19:06   0:00 grep
> --color=auto *8000*
> da_mcom+ 48849  0.5  0.9 26473704 607720 ?     Sl   апр05  50:01 java -cp
> /data/PredictionIO-0.11.0-incubating/conf:/data/PredictionIO-0.11.0-
> incubating/plugins/*:/data/PredictionIO-0.11.0-
> incubating/lib/spark/*:/data/PredictionIO-0.11.0-
> incubating/lib/pio-assembly-0.11.0-incubating.jar:/usr/hdp/2.6.1.0-129/hbase/conf
> -Dpio.log.dir=/home/da_mcom_milan 
> org.apache.predictionio.tools.console.Console
> deploy --port *8000* --pio-home /data/PredictionIO-0.11.0-incubating
> da_mcom+ 49016  1.1  1.4 19766916 967792 ?     Sl   апр05 102:52
> /usr/java/default/bin/java -Dhdp.version=2.6.1.0-129 -cp
> /data/PredictionIO-0.11.0-incubating/conf/:/usr/hdp/2.6.
> 1.0-129/hbase/conf/:/usr/hdp/current/spark-client/conf/:/
> data/PredictionIO-0.11.0-incubating/vendors/spark/lib/
> spark-assembly-1.6.3.2.6.1.0-129-hadoop2.7.3.2.6.1.0-129.
> jar:/data/PredictionIO-0.11.0-incubating/vendors/spark/lib/
> datanucleus-api-jdo-3.2.6.jar:/data/PredictionIO-0.11.0-
> incubating/vendors/spark/lib/datanucleus-core-3.2.10.jar:/
> data/PredictionIO-0.11.0-incubating/vendors/spark/lib/
> datanucleus-rdbms-3.2.9.jar:/usr/hdp/current/hadoop-client/
> conf/:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-s3-1.
> 10.6.jar:/usr/hdp/current/hadoop-client/lib/aws-java-
> sdk-core-1.10.6.jar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-kms-1.10.6.jar
> -Xms1g -Xmx1g -Dpio.log.dir=/home/da_mcom_milan 
> org.apache.spark.deploy.SparkSubmit
> --conf spark.driver.extraClassPath=/data/PredictionIO-0.11.0-
> incubating/conf:/usr/hdp/2.6.1.0-129/hbase/conf --conf
> spark.driver.extraJavaOptions=-Dpio.log.dir=/home/da_mcom_milan --class
> org.apache.predictionio.workflow.CreateServer --jars
> file:/data/PredictionIO-0.11.0-incubating/engines/some-
> engine/target/scala-2.10/universal-recommender_2.10-0.6.0.jar,file:/data/
> PredictionIO-0.11.0-incubating/engines/some-engine/target/scala-2.10/
> universal-recommender-assembly-0.6.0-deps.jar,file:/
> data/PredictionIO-0.11.0-incubating/lib/spark/pio-data-
> elasticsearch1-assembly-0.11.0-incubating.jar,file:/data/
> PredictionIO-0.11.0-incubating/lib/spark/pio-data-hbase-assembly-0.11.0-
> incubating.jar,file:/data/PredictionIO-0.11.0-
> incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-
> incubating.jar,file:/data/PredictionIO-0.11.0-
> incubating/lib/spark/pio-data-jdbc-assembly-0.11.0-
> incubating.jar,file:/data/PredictionIO-0.11.0-
> incubating/lib/spark/pio-data-localfs-assembly-0.11.0-incubating.jar
> --files file:/data/PredictionIO-0.11.0-incubating/conf/log4j.
> properties,file:/usr/hdp/2.6.1.0-129/hbase/conf/hbase-site.xml
> file:/data/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar
> --engineInstanceId AWKWiWsxdWI0xyRGjxPJ --engine-variant
> file:/data/PredictionIO-0.11.0-incubating/engines/some-engine/engine.json
> --ip 0.0.0.0 --port *8000* --event-server-ip 0.0.0.0 --event-server-port
> 7070 --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_
> TYPE=hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_
> METADATA_NAME=pio_meta,PIO_FS_BASEDIR=/home/da_mcom_milan/.
> pio_store,PIO_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=mdc2pr068,
> mdc2pr069,mdc2pr070,PIO_STORAGE_SOURCES_HBASE_HOME=/
> usr/hdp/2.6.1.0-129/hbase,PIO_HOME=/data/PredictionIO-0.11.
> 0-incubating,PIO_FS_ENGINESDIR=/home/da_mcom_milan/.pio_store/engines,PIO_
> STORAGE_SOURCES_HDFS_TYPE=hdfs,PIO_STORAGE_SOURCES_HDFS_
> PATH=/tmp/models,PIO_STORAGE_SOURCES_ELASTICSEARCH_TYPE=
> elasticsearch,PIO_STORAGE_REPOSITORIES_METADATA_SOURCE=
> ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_MODELDATA_SOURCE=
> HDFS,PIO_STORAGE_REPOSITORIES_EVENTDATA_NAME=pio_event,PIO_
> STORAGE_SOURCES_ELASTICSEARCH_CLUSTERNAME=pros_es_prod,PIO_
> FS_TMPDIR=/home/da_mcom_milan/.pio_store/tmp,PIO_STORAGE_
> REPOSITORIES_MODELDATA_NAME=pio_model,PIO_STORAGE_
> REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_CONF_DIR=/data/
> PredictionIO-0.11.0-incubating/conf,PIO_STORAGE_
> SOURCES_ELASTICSEARCH_PORTS=9300,9300,9300
>
>
>
> On Wed, Apr 11, 2018 at 3:39 PM, Donald Szeto <don...@apache.org> wrote:
>
>> Are you able to find any occurrence of port 8004? The excerpt you showed
>> was about port 8000.
>>
>> On Wed, Apr 11, 2018 at 3:18 PM, George Yarish <gyar...@griddynamics.com>
>> wrote:
>>
>>> Hi Donald
>>>
>>> Thank you for the answer.
>>> it looks fine to me, but processes still alive:
>>>
>>> 2018-04-11 13:00:25,331 INFO  org.apache.predictionio.workflow.MasterActor
>>> [pio-server-akka.actor.default-dispatcher-5] - Undeploying any existing
>>> engine instance at http://0.0.0.0:8000
>>> 2018-04-11 13:00:26,467 INFO  org.apache.predictionio.workflow.MasterActor
>>> [pio-server-akka.actor.default-dispatcher-9] - Stop server command
>>> received.
>>> 2018-04-11 13:00:26,468 INFO  org.apache.predictionio.workflow.MasterActor
>>> [pio-server-akka.actor.default-dispatcher-9] - Server is shutting down.
>>> 2018-04-11 13:00:26,617 INFO  spray.can.server.HttpListener
>>> [pio-server-akka.actor.default-dispatcher-2] - Bound to /0.0.0.0:8000
>>> 2018-04-11 13:00:26,620 INFO  org.apache.predictionio.workflow.MasterActor
>>> [pio-server-akka.actor.default-dispatcher-4] - Engine is deployed and
>>> running. Engine API is live at http://0.0.0.0:8000
>>>
>>> Thank you,
>>> George
>>>
>>>
>>> On Wed, Apr 11, 2018 at 11:48 AM, Donald Szeto <don...@apache.org>
>>> wrote:
>>>
>>>> Hi George,
>>>>
>>>> Mind checking the content of pio.log at where you run `pio deploy`? It
>>>> should contain some messages regarding undeploying existing engine servers
>>>> on the same port.
>>>>
>>>> Regards,
>>>> Donald
>>>>
>>>> On Thu, Apr 5, 2018 at 6:43 PM, George Yarish <gyar...@griddynamics.com
>>>> > wrote:
>>>>
>>>>> Hi everyone,
>>>>>
>>>>> I faced a strange situation recently.
>>>>> One of our engines has frequently old processes after daily
>>>>> redeployment.
>>>>>
>>>>> We used to redeploy by crontab rule that looks like:
>>>>> nohup pio deploy --port 8004 >> ${DEPLOY_LOG_FILE} 2>&1 &
>>>>>
>>>>>
>>>>> This is output of ps aux command:
>>>>>
>>>>> [da_mcom_milan@mdc2pr113 ~]$ ps aux | grep 8004
>>>>>
>>>>> da_mcom+  7854  0.0  0.0 112660   996 pts/1    S+   21:34   0:00 grep
>>>>> --color=auto *8004*
>>>>>
>>>>> 1. da_mcom+ 30932  0.6  0.9 26473632 595932 ?     Sl   01:57   7:51
>>>>> java -cp /data/PredictionIO-0.11.0-incubating/conf:/data/PredictionIO
>>>>> -0.11.0-incubating/plugins/*:/data/PredictionIO-0.11.0-incub
>>>>> ating/lib/spark/*:/data/PredictionIO-0.11.0-incubating/lib/p
>>>>> io-assembly-0.11.0-incubating.jar:/usr/hdp/2.5.3.0-37/hadoop
>>>>> /conf:/data/PredictionIO/vendors/hbase/conf
>>>>> -Dpio.log.dir=/home/da_mcom_milan 
>>>>> org.apache.predictionio.tools.console.Console
>>>>> deploy --port *8004* --pio-home /data/PredictionIO-0.11.0-incubating
>>>>>
>>>>> 2. da_mcom+ 31097  1.2  1.2 17065124 822596 ?     Sl   01:57  14:48
>>>>> /usr/java/default/bin/java -Dhdp.version=2.5.3.0-37 -cp
>>>>> /data/PredictionIO-0.11.0-incubating/conf/:/usr/hdp/2.5.3.0-
>>>>> 37/hadoop/conf/:/data/PredictionIO/vendors/hbase/conf/:/usr/
>>>>> hdp/current/spark-client/conf/:/data/PredictionIO/vendors/sp
>>>>> ark/lib/spark-assembly-1.6.2.2.5.3.0-37-hadoop2.7.3.2.5.3.0-
>>>>> 37.jar:/data/PredictionIO/vendors/spark/lib/datanucleus-api-
>>>>> jdo-3.2.6.jar:/data/PredictionIO/vendors/spark/lib/datanucle
>>>>> us-core-3.2.10.jar:/data/PredictionIO/vendors/spark/lib/data
>>>>> nucleus-rdbms-3.2.9.jar:/usr/hdp/2.5.3.0-37/hadoop/conf/:/us
>>>>> r/hdp/current/hadoop-client/lib/aws-java-sdk-s3-1.10.6.jar:/
>>>>> usr/hdp/current/hadoop-client/lib/aws-java-sdk-core-1.10.6.j
>>>>> ar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-kms-1.10.6.jar
>>>>> -Xms1g -Xmx1g -Dpio.log.dir=/home/da_mcom_milan
>>>>> org.apache.spark.deploy.SparkSubmit --conf
>>>>> spark.driver.extraClassPath=/data/PredictionIO-0.11.0-incuba
>>>>> ting/conf:/usr/hdp/2.5.3.0-37/hadoop/conf:/data/PredictionIO/vendors/hbase/conf
>>>>> --conf spark.driver.extraJavaOptions=-Dpio.log.dir=/home/da_mcom_milan
>>>>> --class org.apache.predictionio.workflow.CreateServer --jars
>>>>> file:/data/PredictionIO/some-engine/target/scala-2.10/univer
>>>>> sal-recommender_2.10-0.6.0.jar,file:/data/PredictionIO/some-engine
>>>>> /target/scala-2.10/universal-recommender-assembly-0.6.
>>>>> 0-deps.jar,file:/data/PredictionIO-0.11.0-incubating/lib/spa
>>>>> rk/pio-data-elasticsearch1-assembly-0.11.0-incubating.jar,fi
>>>>> le:/data/PredictionIO-0.11.0-incubating/lib/spark/pio-data-h
>>>>> base-assembly-0.11.0-incubating.jar,file:/data/PredictionIO-
>>>>> 0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-in
>>>>> cubating.jar,file:/data/PredictionIO-0.11.0-incubating/lib/
>>>>> spark/pio-data-jdbc-assembly-0.11.0-incubating.jar,file:/
>>>>> data/PredictionIO-0.11.0-incubating/lib/spark/pio-data-
>>>>> localfs-assembly-0.11.0-incubating.jar --files
>>>>> file:/data/PredictionIO-0.11.0-incubating/conf/log4j.propert
>>>>> ies,file:/usr/hdp/2.5.3.0-37/hadoop/conf/core-site.xml,file:
>>>>> /data/PredictionIO/vendors/hbase/conf/hbase-site.xml
>>>>> file:/data/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar
>>>>> --engineInstanceId AWKSaLQrSe_zVbacBHWI --engine-variant
>>>>> file:/data/PredictionIO/some-engine/engine.json --ip 0.0.0.0 --port
>>>>> *8004* --event-server-ip 0.0.0.0 --event-server-port 7070
>>>>> --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_TYPE
>>>>> =hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_METADATA_NA
>>>>> ME=pio_meta,PIO_FS_BASEDIR=/home/da_mcom_milan/.pio_store,PI
>>>>> O_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=mdc2vra176,PIO_STORAGE
>>>>> _SOURCES_HBASE_HOME=/data/PredictionIO/vendors/hbase,PIO_HOM
>>>>> E=/data/PredictionIO-0.11.0-incubating,PIO_FS_ENGINESDIR=/ho
>>>>> me/da_mcom_milan/.pio_store/engines,PIO_STORAGE_SOURCES_LOCA
>>>>> LFS_PATH=/home/da_mcom_milan/.pio_store/models,PIO_STORAGE_S
>>>>> OURCES_ELASTICSEARCH_TYPE=elasticsearch,PIO_STORAGE_REPOSITO
>>>>> RIES_METADATA_SOURCE=ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_
>>>>> MODELDATA_SOURCE=LOCALFS,PIO_STORAGE_REPOSITORIES_EVENTDATA
>>>>> _NAME=pio_event,PIO_STORAGE_SOURCES_ELASTICSEARCH_CLUSTERN
>>>>> AME=pros-dev,PIO_FS_TMPDIR=/home/da_mcom_milan/.pio_store/
>>>>> tmp,PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model,PIO_
>>>>> STORAGE_REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_
>>>>> CONF_DIR=/data/PredictionIO-0.11.0-incubating/conf,PIO_
>>>>> STORAGE_SOURCES_ELASTICSEARCH_PORTS=9300,PIO_STORAGE_
>>>>> SOURCES_LOCALFS_TYPE=localfs
>>>>>
>>>>> 3. da_mcom+ 32505  0.6  0.8 26473632 581164 ?     Sl   02:00   7:54
>>>>> java -cp /data/PredictionIO-0.11.0-incubating/conf:/data/PredictionIO
>>>>> -0.11.0-incubating/plugins/*:/data/PredictionIO-0.11.0-incub
>>>>> ating/lib/spark/*:/data/PredictionIO-0.11.0-incubating/lib/p
>>>>> io-assembly-0.11.0-incubating.jar:/usr/hdp/2.5.3.0-37/hadoop
>>>>> /conf:/data/PredictionIO/vendors/hbase/conf
>>>>> -Dpio.log.dir=/home/da_mcom_milan 
>>>>> org.apache.predictionio.tools.console.Console
>>>>> deploy --port *8004* --pio-home /data/PredictionIO-0.11.0-incubating
>>>>>
>>>>> 4. da_mcom+ 32671  1.4  1.3 19757488 881448 ?     Sl   02:00  16:27
>>>>> /usr/java/default/bin/java -Dhdp.version=2.5.3.0-37 -cp
>>>>> /data/PredictionIO-0.11.0-incubating/conf/:/usr/hdp/2.5.3.0-
>>>>> 37/hadoop/conf/:/data/PredictionIO/vendors/hbase/conf/:/usr/
>>>>> hdp/current/spark-client/conf/:/data/PredictionIO/vendors/sp
>>>>> ark/lib/spark-assembly-1.6.2.2.5.3.0-37-hadoop2.7.3.2.5.3.0-
>>>>> 37.jar:/data/PredictionIO/vendors/spark/lib/datanucleus-api-
>>>>> jdo-3.2.6.jar:/data/PredictionIO/vendors/spark/lib/datanucle
>>>>> us-core-3.2.10.jar:/data/PredictionIO/vendors/spark/lib/data
>>>>> nucleus-rdbms-3.2.9.jar:/usr/hdp/2.5.3.0-37/hadoop/conf/:/us
>>>>> r/hdp/current/hadoop-client/lib/aws-java-sdk-s3-1.10.6.jar:/
>>>>> usr/hdp/current/hadoop-client/lib/aws-java-sdk-core-1.10.6.j
>>>>> ar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-kms-1.10.6.jar
>>>>> -Xms1g -Xmx1g -Dpio.log.dir=/home/da_mcom_milan
>>>>> org.apache.spark.deploy.SparkSubmit --conf
>>>>> spark.driver.extraClassPath=/data/PredictionIO-0.11.0-incuba
>>>>> ting/conf:/usr/hdp/2.5.3.0-37/hadoop/conf:/data/PredictionIO/vendors/hbase/conf
>>>>> --conf spark.driver.extraJavaOptions=-Dpio.log.dir=/home/da_mcom_milan
>>>>> --class org.apache.predictionio.workflow.CreateServer --jars
>>>>> file:/data/PredictionIO/some-engine/target/scala-2.10/univer
>>>>> sal-recommender_2.10-0.6.0.jar,file:/data/PredictionIO/some-engine
>>>>> /target/scala-2.10/universal-recommender-assembly-0.6.
>>>>> 0-deps.jar,file:/data/PredictionIO-0.11.0-incubating/lib/spa
>>>>> rk/pio-data-elasticsearch1-assembly-0.11.0-incubating.jar,fi
>>>>> le:/data/PredictionIO-0.11.0-incubating/lib/spark/pio-data-h
>>>>> base-assembly-0.11.0-incubating.jar,file:/data/PredictionIO-
>>>>> 0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-in
>>>>> cubating.jar,file:/data/PredictionIO-0.11.0-incubating/lib/
>>>>> spark/pio-data-jdbc-assembly-0.11.0-incubating.jar,file:/
>>>>> data/PredictionIO-0.11.0-incubating/lib/spark/pio-data-
>>>>> localfs-assembly-0.11.0-incubating.jar --files
>>>>> file:/data/PredictionIO-0.11.0-incubating/conf/log4j.propert
>>>>> ies,file:/usr/hdp/2.5.3.0-37/hadoop/conf/core-site.xml,file:
>>>>> /data/PredictionIO/vendors/hbase/conf/hbase-site.xml
>>>>> file:/data/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar
>>>>> --engineInstanceId AWKSaLQrSe_zVbacBHWI --engine-variant
>>>>> file:/data/PredictionIO/some-engine/engine.json --ip 0.0.0.0 --port
>>>>> *8004* --event-server-ip 0.0.0.0 --event-server-port 7070
>>>>> --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_TYPE
>>>>> =hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_METADATA_NA
>>>>> ME=pio_meta,PIO_FS_BASEDIR=/home/da_mcom_milan/.pio_store,PI
>>>>> O_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=mdc2vra176,PIO_STORAGE
>>>>> _SOURCES_HBASE_HOME=/data/PredictionIO/vendors/hbase,PIO_HOM
>>>>> E=/data/PredictionIO-0.11.0-incubating,PIO_FS_ENGINESDIR=/ho
>>>>> me/da_mcom_milan/.pio_store/engines,PIO_STORAGE_SOURCES_LOCA
>>>>> LFS_PATH=/home/da_mcom_milan/.pio_store/models,PIO_STORAGE_S
>>>>> OURCES_ELASTICSEARCH_TYPE=elasticsearch,PIO_STORAGE_REPOSITO
>>>>> RIES_METADATA_SOURCE=ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_
>>>>> MODELDATA_SOURCE=LOCALFS,PIO_STORAGE_REPOSITORIES_EVENTDATA
>>>>> _NAME=pio_event,PIO_STORAGE_SOURCES_ELASTICSEARCH_CLUSTERN
>>>>> AME=pros-dev,PIO_FS_TMPDIR=/home/da_mcom_milan/.pio_store/
>>>>> tmp,PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model,PIO_
>>>>> STORAGE_REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_
>>>>> CONF_DIR=/data/PredictionIO-0.11.0-incubating/conf,PIO_
>>>>> STORAGE_SOURCES_ELASTICSEARCH_PORTS=9300,PIO_STORAGE_
>>>>> SOURCES_LOCALFS_TYPE=localfs
>>>>>
>>>>> For some reasons, processes 30932 and 31097 still alive and process
>>>>> listened by 32671
>>>>> Any ideas?
>>>>>
>>>>> Thank you,
>>>>> George
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>>
>>> George Yarish, Java Developer
>>>
>>> Grid Dynamics
>>>
>>> 197101, Rentgena Str., 5A, St.Petersburg, Russia
>>>
>>> Cell: +7 950 030-1941
>>>
>>> Read Grid Dynamics' Tech Blog
>>> <http://blog.griddynamics.com/?utm_campaign=Big%20Data%20Blog%20social%20media%20promotion&utm_medium=CTA&utm_source=Email>
>>>
>>>
>>>
>>
>
>
> --
>
> George Yarish, Java Developer
>
> Grid Dynamics
>
> 197101, Rentgena Str., 5A, St.Petersburg, Russia
>
> Cell: +7 950 030-1941
>
> Read Grid Dynamics' Tech Blog
> <http://blog.griddynamics.com/?utm_campaign=Big%20Data%20Blog%20social%20media%20promotion&utm_medium=CTA&utm_source=Email>
>
>
>

Reply via email to