DUCC stuck at WaitingForResources on an Amazon Linux

2014-11-12 Thread Simon Hafner
I've set up DUCC according to
https://cwiki.apache.org/confluence/display/UIMA/DUCC

ducc_install/bin/ducc_submit -f ducc_install/examples/simple/1.job

the job is stuck at WaitingForResources.

12 Nov 2014 10:37:30,175  INFO Agent.LinuxNodeMetricsProcessor -
process N/A ... Agent Collecting User Processes
12 Nov 2014 10:37:30,176  INFO Agent.NodeAgent -
copyAllUserReservations N/A +++ Copying User Reservations
- List Size:0
12 Nov 2014 10:37:30,176  INFO Agent.LinuxNodeMetricsProcessor - call
   N/A ** User Process Map Size After
copyAllUserReservations:0
12 Nov 2014 10:37:30,176  INFO Agent.LinuxNodeMetricsProcessor - call
   N/A ** User Process Map Size After
copyAllUserRougeProcesses:0
12 Nov 2014 10:37:30,182  INFO Agent.LinuxNodeMetricsProcessor - call N/A
12 Nov 2014 10:37:30,182  INFO Agent.LinuxNodeMetricsProcessor - call
   N/A 
**
12 Nov 2014 10:37:30,182  INFO Agent.LinuxNodeMetricsProcessor -
process N/A ... Agent ip-172-31-7-237.us-west-2.compute.internal
Posting Memory:4050676 Memory Free:4013752 Swap Total:0 Swap Free:0
Low Swap Threshold Defined in ducc.properties:0
12 Nov 2014 10:37:33,303  INFO Agent.AgentEventListener -
reportIncomingStateForThisNode N/A Received OR Sequence:699 Thread
ID:13
12 Nov 2014 10:37:33,303  INFO Agent.AgentEventListener -
reportIncomingStateForThisNode N/A
JD-- JobId:6 ProcessId:0 PID:8168 Status:Running Resource
State:Allocated isDeallocated:false
12 Nov 2014 10:37:33,303  INFO Agent.NodeAgent - setReservations
N/A +++ Copied User Reservations - List Size:0
12 Nov 2014 10:37:33,405  INFO
Agent.AgentConfiguration$$EnhancerByCGLIB$$cc49880b - getSwapUsage-
 N/A PID:8168 Swap Usage:0
12 Nov 2014 10:37:33,913  INFO
Agent.AgentConfiguration$$EnhancerByCGLIB$$cc49880b -
collectProcessCurrentCPU N/A 0.0 == CPUTIME:0.0
12 Nov 2014 10:37:33,913  INFO
Agent.AgentConfiguration$$EnhancerByCGLIB$$cc49880b - process N/A
--- PID:8168 Major Faults:0 Process Swap Usage:0 Max Swap
Usage Allowed:-108574720 Time to Collect Swap Usage:0

I'm using a t2.medium instance (2 CPU, ~ 4GB RAM) and the stock Amazon
Linux (looks centos based).

To install maven (not in the repos)

#! /bin/bash

TEMPORARY_DIRECTORY=$(mktemp -d)
DOWNLOAD_TO=$TEMPORARY_DIRECTORY/maven.tgz

echo 'Downloading Maven to: ' $DOWNLOAD_TO

wget -O $DOWNLOAD_TO
http://www.eng.lsu.edu/mirrors/apache/maven/maven-3/3.2.3/binaries/apache-maven-3.2.3-bin.tar.gz

echo 'Extracting Maven'
tar xzf $DOWNLOAD_TO -C $TEMPORARY_DIRECTORY
rm $DOWNLOAD_TO

echo 'Configuring Envrionment'

mv $TEMPORARY_DIRECTORY/apache-maven-* /usr/local/maven
echo -e 'export M2_HOME=/usr/local/maven\nexport
PATH=${M2_HOME}/bin:${PATH}'  /etc/profile.d/maven.sh
source /etc/profile.d/maven.sh

echo 'The maven version: ' `mvn -version` ' has been installed.'
echo -e '\n\n!! Note you must relogin to get mvn in your path !!'
echo 'Removing the temporary directory...'
rm -r $TEMPORARY_DIRECTORY
echo 'Your Maven Installation is Complete.'


Re: DUCC stuck at WaitingForResources on an Amazon Linux

2014-11-12 Thread Simon Hafner
4 shares total, 2 in use.

2014-11-12 5:06 GMT-06:00 Lou DeGenaro lou.degen...@gmail.com:
 Try looking at your DUCC's web server.  On the System - Machines page
 do you see any shares not inuse?

 Lou.

 On Wed, Nov 12, 2014 at 5:51 AM, Simon Hafner reactorm...@gmail.com wrote:
 I've set up DUCC according to
 https://cwiki.apache.org/confluence/display/UIMA/DUCC

 ducc_install/bin/ducc_submit -f ducc_install/examples/simple/1.job

 the job is stuck at WaitingForResources.

 12 Nov 2014 10:37:30,175  INFO Agent.LinuxNodeMetricsProcessor -
 process N/A ... Agent Collecting User Processes
 12 Nov 2014 10:37:30,176  INFO Agent.NodeAgent -
 copyAllUserReservations N/A +++ Copying User Reservations
 - List Size:0
 12 Nov 2014 10:37:30,176  INFO Agent.LinuxNodeMetricsProcessor - call
N/A ** User Process Map Size After
 copyAllUserReservations:0
 12 Nov 2014 10:37:30,176  INFO Agent.LinuxNodeMetricsProcessor - call
N/A ** User Process Map Size After
 copyAllUserRougeProcesses:0
 12 Nov 2014 10:37:30,182  INFO Agent.LinuxNodeMetricsProcessor - call N/A
 12 Nov 2014 10:37:30,182  INFO Agent.LinuxNodeMetricsProcessor - call
N/A 
 **
 12 Nov 2014 10:37:30,182  INFO Agent.LinuxNodeMetricsProcessor -
 process N/A ... Agent ip-172-31-7-237.us-west-2.compute.internal
 Posting Memory:4050676 Memory Free:4013752 Swap Total:0 Swap Free:0
 Low Swap Threshold Defined in ducc.properties:0
 12 Nov 2014 10:37:33,303  INFO Agent.AgentEventListener -
 reportIncomingStateForThisNode N/A Received OR Sequence:699 Thread
 ID:13
 12 Nov 2014 10:37:33,303  INFO Agent.AgentEventListener -
 reportIncomingStateForThisNode N/A
 JD-- JobId:6 ProcessId:0 PID:8168 Status:Running Resource
 State:Allocated isDeallocated:false
 12 Nov 2014 10:37:33,303  INFO Agent.NodeAgent - setReservations
 N/A +++ Copied User Reservations - List Size:0
 12 Nov 2014 10:37:33,405  INFO
 Agent.AgentConfiguration$$EnhancerByCGLIB$$cc49880b - getSwapUsage-
  N/A PID:8168 Swap Usage:0
 12 Nov 2014 10:37:33,913  INFO
 Agent.AgentConfiguration$$EnhancerByCGLIB$$cc49880b -
 collectProcessCurrentCPU N/A 0.0 == CPUTIME:0.0
 12 Nov 2014 10:37:33,913  INFO
 Agent.AgentConfiguration$$EnhancerByCGLIB$$cc49880b - process N/A
 --- PID:8168 Major Faults:0 Process Swap Usage:0 Max Swap
 Usage Allowed:-108574720 Time to Collect Swap Usage:0

 I'm using a t2.medium instance (2 CPU, ~ 4GB RAM) and the stock Amazon
 Linux (looks centos based).

 To install maven (not in the repos)

 #! /bin/bash

 TEMPORARY_DIRECTORY=$(mktemp -d)
 DOWNLOAD_TO=$TEMPORARY_DIRECTORY/maven.tgz

 echo 'Downloading Maven to: ' $DOWNLOAD_TO

 wget -O $DOWNLOAD_TO
 http://www.eng.lsu.edu/mirrors/apache/maven/maven-3/3.2.3/binaries/apache-maven-3.2.3-bin.tar.gz

 echo 'Extracting Maven'
 tar xzf $DOWNLOAD_TO -C $TEMPORARY_DIRECTORY
 rm $DOWNLOAD_TO

 echo 'Configuring Envrionment'

 mv $TEMPORARY_DIRECTORY/apache-maven-* /usr/local/maven
 echo -e 'export M2_HOME=/usr/local/maven\nexport
 PATH=${M2_HOME}/bin:${PATH}'  /etc/profile.d/maven.sh
 source /etc/profile.d/maven.sh

 echo 'The maven version: ' `mvn -version` ' has been installed.'
 echo -e '\n\n!! Note you must relogin to get mvn in your path !!'
 echo 'Removing the temporary directory...'
 rm -r $TEMPORARY_DIRECTORY
 echo 'Your Maven Installation is Complete.'