Re: DUCC not leaving Initializing State

2013-11-14 Thread Lou DeGenaro
Try this: navigate to the Files tab on the Job Details page and look inside the *JD* file. Any exceptions? Lou. On Wed, Nov 13, 2013 at 7:10 PM, Neal R Lewis wrote: > Hello All, > > I'm not sure if this belongs in dev because DUCC isn't released yet, but > it feels like a user question. > > >

Re: DUCC not leaving Initializing State

2013-11-18 Thread Lou DeGenaro
Neal, Did getNext() get called and did it return a filled-in CAS? I tried a simple test case with my CR returning null for getProgress() and the Job seemed to run just fine. However, one may be penalized by the scheduler if is had to guess how much work the Job comprises. Lou. On Fri, Nov 15, 2

Re: DUCC not leaving Initializing State

2013-11-20 Thread Lou DeGenaro
;); > } > > > So, my progress bar was returning null, so the CasGenerator just > skip it, keep total as null. I don't know how this goes through in the > DUCC Flow Controller, but it looks like outside of AllInOne, it causes a > hang > > > >

Re: DUCC not leaving Initializing State

2013-11-26 Thread Lou DeGenaro
that I'm performing some operations out of order, but I'm > following the guidlines from the sample application. I haven't rebuilt > DUCC since November 5th, would that be a problem? > > > > > From: Lou DeGenaro > To: user@uima.apache.org > Date

Re: status Lost=1 in DUCC

2014-03-20 Thread Lou DeGenaro
Some questions: 1. Are you able to run a simple job, such as 1.job from the examples directory successfully? 2. Where does the warning appear, in a log file in the job's log directory? Is there any other information related to that warning? 3. Are there any exceptions in any of the logs in the jo

Re: status Lost=1 in DUCC

2014-03-26 Thread Lou DeGenaro
tes the problem? Lou. On Wed, Mar 26, 2014 at 5:31 AM, reshu.agarwal wrote: > On 03/20/2014 06:35 PM, Lou DeGenaro wrote: > >> Where does the warning appear, in a log file in the job's log >> directory? Is there any other information related to that warning? >>

Re: status Lost=1 in DUCC

2014-03-26 Thread Lou DeGenaro
e, is that something you can share so I can try to reproduce here? Lou. On Wed, Mar 26, 2014 at 9:20 AM, reshu.agarwal wrote: > > Hi Lou, > > > On 03/26/2014 04:27 PM, Lou DeGenaro wrote: > >> Hi Reshu, >> >> The good news is that DUCC is functional since 1.j

Re: status Lost=1 in DUCC

2014-03-27 Thread Lou DeGenaro
ntirety all of the logs in the user's log directory, for example jd.out.log, *JD*.log... Lou. On Thu, Mar 27, 2014 at 1:31 AM, reshu.agarwal wrote: > On 03/26/2014 10:06 PM, Lou DeGenaro wrote: > >> Hi Reshu, >> >> re: your answers to 5 & 6 >> >> 6a. Is

Re: status Lost=1 in DUCC

2014-03-28 Thread Lou DeGenaro
, 2014 at 12:00 AM, reshu.agarwal wrote: > On 03/27/2014 08:13 PM, Lou DeGenaro wrote: > >> he data being sent are "values" rather than "keys" in your >> CAS? If so, this is not really a "best practice" for DUCC use. >> > Hi Lou, >

Re: CanceledByDriver status in DUCC

2014-06-04 Thread Lou DeGenaro
DUCC does not have an automatic resubmit capability. Usually a high error count is indicative of a flawed job, and the default DUCC plug-in error handler cancels the job after 15 errors have occurred so as to not waste resources. Normally, one debugs the pipeline before scaling-out and the number

Re: CanceledByDriver status in DUCC

2014-06-05 Thread Lou DeGenaro
How long does it take to process your longest work item through your pipeline? And what do you specify in your job submission for: --process_per_item_time_max Maximum elapsed time (in minutes) for processing one CAS. Lou. On Wed, Jun 4, 2014 at 9:47 AM, reshu.agarwal wro

Re: CanceledByDriver status in DUCC

2014-06-06 Thread Lou DeGenaro
n 06/05/2014 06:30 PM, Lou DeGenaro wrote: > >> How long does it take to process your longest work item through your >> > Hi Lou, > > It was 3 Minutes that time. We increased this to 10 minutes now for > testing as you told me to increase it. I have also restarted DUCC.

Re: CanceledByDriver status in DUCC

2014-06-09 Thread Lou DeGenaro
gt; On 06/06/2014 06:03 PM, Lou DeGenaro wrote: >> >>> files for ERROR or WARN messages especially >>> relative to the MqReaper. >>> >> Hi Lou, >> >> I have found an error in DUCC logs or.log: >> >> java.lang.reflect.UndeclaredThrow

Re: Infinte initialization of a process even after restarting DUCC

2014-07-07 Thread Lou DeGenaro
DUCC depends on UIMA-AS which depends on UIMA core. A new version UIMA-AS is in progress. Voting could conclude this week, perhaps. Once UIMA-AS is officially released, DUCC release candidates will follow. So a new version of DUCC is possible this month. That said, two short term possibilities

Re: Infinte initialization of a process even after restarting DUCC

2014-07-09 Thread Lou DeGenaro
This looks like data from the Job Details page showing job-processes. For that job, what does the Jobs page look like? Is the state Completed? If so, the job is not running and the information on the Job Details page is spurious. Said another way, if check_ducc -k is working then all your DUCC

Re: Infinte initialization of a process even after restarting DUCC

2014-07-09 Thread Lou DeGenaro
e upcoming DUCC release). Lou. On Wed, Jul 9, 2014 at 7:12 AM, reshu.agarwal wrote: > On 07/09/2014 03:25 PM, Lou DeGenaro wrote: > >> Upon re-start (presuming you >> used the default "warm" start) all previous running jobs are marked as >> Completed. If the the j

Re: is DUCC having UIMA AS remote Analysis Engine functionality for Deployment descripter?

2014-07-31 Thread Lou DeGenaro
There are several paradigms provided by DUCC: 1. Jobs For these you use ducc_submit to tell DUCC about your UIMA CR and AE. 2. Services For these you use ducc_services to register and deploy your UIMA AE. 3. Managed Reservations For these you use ducc_process_submit to tell DUCC about your ar

Re: Scale out tuning for jobs

2014-10-16 Thread Lou DeGenaro
Amit, DUCC should use all available resources as configured by your ducc.classes and ducc.nodes files. Lou. On Thu, Oct 16, 2014 at 11:59 AM, Amit Gupta wrote: > Thanks for the clarification Burn, > > So indeed there is no way to "force" a job to scale out to maximum > resources available? >

Re: UIMA DUCC - Excessive Initialize Failure

2014-11-03 Thread Lou DeGenaro
Log files may be informative. There are system and user log files. System log files are located in ducc_runtime/logs. User log files (which may be more helpful here) are located in --log_directory that was specified on the submit command (and can also be seen by employing the WebServer). Do yo

Re: UIMA DUCC - Excessive Initialize Failure

2014-11-03 Thread Lou DeGenaro
abs). Lou. On Mon, Nov 3, 2014 at 9:30 AM, James Baker wrote: > We've looked at all the logs we can find, but we'll have another look and > see if there are any we missed. > > Yes, there's a shared file system set up and both the data and the job > files are loc

Re: UIMA DUCC - Excessive Initialize Failure

2014-11-03 Thread Lou DeGenaro
submit and run work as 'ducc' but not other userids ? Lou. On Mon, Nov 3, 2014 at 12:49 PM, wrote: > There doesn’t seem to be anything of relevance in the user logs. In fact, > there doesn’t seem to be much in them at all! > > > On 3 Nov 2014, at 14:43, Lou DeGenaro wro

Re: UIMA DUCC - Multi-machine Installation

2014-11-06 Thread Lou DeGenaro
1. What is your process_thread_count for the job (found in the job specification, and specifiable on submit command)? 2. What is your ducc.rm.share.quantum (specified in ducc.properties). Say your quantum size allowed for 2 shares (aka "ducc job processes" or "JPs") per node, and your thread count

Re: DUCC stuck at WaitingForResources on an Amazon Linux

2014-11-12 Thread Lou DeGenaro
Try looking at your DUCC's web server. On the System -> Machines page do you see any shares not inuse? Lou. On Wed, Nov 12, 2014 at 5:51 AM, Simon Hafner wrote: > I've set up DUCC according to > https://cwiki.apache.org/confluence/display/UIMA/DUCC > > ducc_install/bin/ducc_submit -f ducc_i

Re: DUCC-1.1.0: Machines are going down very frequently

2014-11-12 Thread Lou DeGenaro
What do you have defined in your ducc.properties for ducc.rm.node.stability and ducc.agent.node.metrics.publish.rate? The Web Server considers a node down according to the following calculation: private long getAgentMillisMIA() { String location = "getAgentMillisMIA"; long seconds

Re: DUCC stuck at WaitingForResources on an Amazon Linux

2014-11-14 Thread Lou DeGenaro
Simon, Congratulations! You found a bug in DUCC's Web Server. It was incorrectly rounding up when reporting the number of shares for a machine. This issue is addressed by Jira 4104 . Lou. On Fri, Nov 14, 2014 at 7:49 AM, Jim Challenger wrote:

Re: DUCC-1.1.0: Machines are going down very frequently

2014-11-17 Thread Lou DeGenaro
ult configuration: > > ducc.agent.node.metrics.publish.rate=3 > ducc.rm.node.stability = 5 > > Reshu. > > > Signature On 11/12/2014 05:03 PM, Lou DeGenaro wrote: > >> What do you have defined in your ducc.properties for >> ducc.rm.node.stability and ducc.agent.node.metrics.publish.rate?

Re: DUCC-1.1.0: Machines are going down very frequently

2014-11-17 Thread Lou DeGenaro
2014 at 6:48 AM, Lou DeGenaro wrote: > Reshu, > > Have you tried looking at the log files in DUCC's log directory for signs > of errors or exceptions? Are any daemons producing core dumps? > > Lou. > > On Mon, Nov 17, 2014 at 1:21 AM, reshu.agarwal > w

Re: DUCC 1.1.0- How to Run two DUCC version on same machines with different user

2014-11-17 Thread Lou DeGenaro
The broker port is specifiable in ducc.properties. The default is ducc.broker.port = 61617. Lou. On Mon, Nov 17, 2014 at 5:29 AM, Simon Hafner wrote: > 2014-11-17 0:00 GMT-06:00 reshu.agarwal : > > I want to run two DUCC version i.e. 1.0.0 and 1.1.0 on same machines with > > different user. Ca

Re: DUCC 1.1.0- How to Run two DUCC version on same machines with different user

2014-11-17 Thread Lou DeGenaro
ve changed the broker port and ws port too but still faced a problem > in starting the ducc1.1.0 version simultaneously. > > Reshu. > > > On 11/17/2014 05:34 PM, Lou DeGenaro wrote: > >> The broker port is specifiable in ducc.properties. The default is >> ducc.broke

Re: DUCC-unstable behaviour od ducc

2014-12-04 Thread Lou DeGenaro
Which of these are no understandable? If you hover over the column heading a little more explanation is given (though not much). For example, If you hover over Heartbeat(last) you'll see "The elapsed time (in seconds) since the last heartbeat". This should usually be around 60 seconds. On the s

Re: DUCC-unstable behaviour od ducc

2014-12-05 Thread Lou DeGenaro
't face this problem. > > Please explain me its reason. > > Reshu. > > > > On 12/04/2014 06:42 PM, Lou DeGenaro wrote: > >> Which of these are no understandable? If you hover over the column >> heading >> a little more explanation is given (though not mu

Re: DUCC-unstable behaviour od ducc

2014-12-05 Thread Lou DeGenaro
Thanks. > > Reshu. > > > On 12/05/2014 04:45 PM, Lou DeGenaro wrote: > >> Each node has a DUCC Agent daemon that sends heartbeats. >> >> There was a bug discovered after the release of 1.1 whereby the share >> calculation is incorrect (a rounding up proble

Re: DUCC-unstable behaviour od ducc

2014-12-08 Thread Lou DeGenaro
DUCC > 1.0.0 and DUCC 1.1.0 at the same time. I am running DUCC 1.0.0 for running > Jobs and DUCC 1.1.0 for testing purpose. > > Do I need to increase heartbeats timing to greater than to 60 sec? > Signature > > **Reshu. > > > On 12/05/2014 05:57 PM, Lou DeGenaro wrot

Re: DUCC-unstable behaviour od ducc

2014-12-10 Thread Lou DeGenaro
DUCC 1.1.0 alone. So, Only DUCC 1.1.0 is > configured. > > Thanks for your help. :-) > > Reshu. > > > > > On 12/08/2014 04:24 PM, Lou DeGenaro wrote: > >> What is the "unstable behavior" of DUCC 1.1.0 when running it alone? >> >> All kinds of bad

Re: Job gets stuck for infinite time

2015-03-23 Thread Lou DeGenaro
A Jira already exists for this issue https://issues.apache.org/jira/browse/ UIMA-4225. It has been marked "Won't Fix" because the Job Driver and corresponding Job Process have been re-written for 2.0 version of DUCC (not yet released, but available from trunk). Are you able to reproduce this erro

Re: Job gets stuck for infinite time

2015-03-24 Thread Lou DeGenaro
tions of networking like exception in connection with database etc > etc. So upgrading to DUCC 2.0 is a solution or we can do some thing else ? > what did you mean by more serious problems? > > On 03/23/2015 06:26 PM, Lou DeGenaro wrote: > >> A Jira already exists for this issue

Re: Job gets stuck for infinite time

2015-03-30 Thread Lou DeGenaro
e job driver to be on the > same system, which is running broker. > > > On 03/24/2015 06:00 PM, Lou DeGenaro wrote: > >> By "serious" I simply meant that if your network is having problems then >> applications that are dependent on the network will be having problem

Re: Job gets stuck for infinite time

2015-04-01 Thread Lou DeGenaro
r If a > system running a job driver goes down , DUCC Head should allocate a new > job driver. > > > > On 03/30/2015 06:02 PM, Lou DeGenaro wrote: > >> I don't think forcing the JD node and the broker on the same host will >> help >> much if your netw

Re: DUCC_MON Authentication

2015-05-14 Thread Lou DeGenaro
Have a look at the DUCC Book section "Enable DUCC webserver login" and at the chapter that follows as well. Here's a link to the demo's DUCC Book: http://uima-ducc-vm.apache .org:42133/doc/duccbook.html#x1-20400011.14 Lou. On Thu, May 14, 2015 at 12:46 AM, Satya Nand Kanodia < satya.kano...@orka

Re: DUCC Services keep stopping

2015-05-18 Thread Lou DeGenaro
1. Visit /services.jsp 2. Click on the Id of the service, which will bring you to the Details page 3. Click on the Log file link and look for problems Lou. On Mon, May 18, 2015 at 2:39 AM, Satya Nand Kanodia < satya.kano...@orkash.com> wrote: > Hi, > > I am using DUCC service with UIMA-AS client

Re: DUCC - Work Item Queue Time Management

2015-09-18 Thread Lou DeGenaro
Reshu, In DUCC 2.0 you must explicitly supply UIMA in the classpath of your submission. This was not the case in DUCC 1.x where UIMA was added by DUCC under the covers. In fact this gives you more flexibility in that you are no loner tied to using a particular version of UIMA. Lou. On Fri, Sep

Re: DUCC - Work Item Queue Time Management

2015-09-21 Thread Lou DeGenaro
was initialized and then > started showing error of "Missing the -Dducc.deploy.JdURL property". > > I was getting java.lang.RuntimeException: Missing the -Dducc.deploy.JdURL > property even in 1.job. Why this error is coming? > > Thanks in Advance. > > Reshu. > &

Re: DUCC - Work Item Queue Time Management

2015-09-21 Thread Lou DeGenaro
, Lou DeGenaro wrote: > Reshu, > > This is a bug in DUCC 2.0.0. See https://issues.apache.org/jira/browse/ > UIMA-4576?jql=project%20%3D%20UIMA. > > Presently, you would need download the current DUCC source and build a > new tarball to get the fix. > > In the mean

Re: DUCC - Work Item Queue Time Management

2015-09-24 Thread Lou DeGenaro
; >>> svn co https://svn.apache.org/repos/asf/uima/sandbox/uima-ducc/trunk/ . >>> >>> and build it with: mvn clean install >>> You'll get a new ducc tarball in target dir >>> >>> Jerry Cwiklik >>> IBM Watson RTP North Carolina &

Re: DUCC - Work Item Queue Time Management

2015-09-25 Thread Lou DeGenaro
c code in the JD & JP. The user code in the JD >> (your collection reader) and in the JP (your annotator pipeline) uses ONLY >> the classpath you provide plus one ducc jar. >> >> Adding UIMA and application jars to the jobclasspath.properties file >> should >> not h

Re: DUCC - Work Item Queue Time Management

2015-09-28 Thread Lou DeGenaro
ect. > > If I considered the path is somehow incorrect then it will not work even > if I defined the same in jobclasspath.properties. I know I should not touch > it. > > Thanks in advance. > > Reshu. > Signature > > ** > > > On 09/25/2015 05:

Re: DUCC - Work Item Queue Time Management

2015-09-28 Thread Lou DeGenaro
lib/apache-commons/*:/home/ducc/apache-uima-ducc-2.1.0-SNAPSHOT/lib/google-gson/*:/home/ducc/apache-uima-ducc-2.1.0-SNAPSHOT/lib/springframework/* > arg[26]: org.apache.uima.ducc.common.main.DuccService > / > Reshu > > > /1001 Command launching.../On 09/28/2015 05:11 PM, Lou DeGe

Re: DUCC - Work Item Queue Time Management

2015-10-01 Thread Lou DeGenaro
asspath. Others are the uima and uima as jars. But the problem is > these jar are not actually available in jd classpath. > > Reshu. > > Signature On 09/28/2015 05:51 PM, Lou DeGenaro wrote: > >> Reshu, >> >> By my eye, the -classpath for the JD itself is correct,

Re: DUCC - Work Item Queue Time Management

2015-10-01 Thread Lou DeGenaro
ction Reader. > > > On 10/01/2015 05:21 PM, Lou DeGenaro wrote: > >> Reshu, >> >> In DUCC 2.0.0 we've introduced the idea of classpath separation so that >> the >> user classpath is not contaminated by the DUCC classpath. Thus, in the JD >> there are 2 c

Re: DUCC - Work Item Queue Time Management

2015-10-01 Thread Lou DeGenaro
relevant information to solve the issue. So far I'm unable to imagine how you are able to create java.lang.reflect.InvocationTargetException. Lou. On Thu, Oct 1, 2015 at 8:06 AM, Lou DeGenaro wrote: > Reshu, > > Are you able to share your (non-confidential) Job specification and &

Re: DUCC - Work Item Queue Time Management

2015-10-05 Thread Lou DeGenaro
ou are using mysql > database for getting data and the mysql classes jar is in lib folder > instead of test.jar. > > Hope it will clarify the situation. > > Reshu. > > > On 10/01/2015 06:46 PM, Lou DeGenaro wrote: > >> Reshu, >> >> I have tried submit

Re: DUCC - Work Item Queue Time Management

2016-01-06 Thread Lou DeGenaro
; >> Sorry for this delay. I have tried this in DUCC 2.0.1 version and job >> successfully run with this but shows "Job -1 submitted". But if I remove >> this additional flag, It still shows DriverProcessFailed. >> >> Reshu. >> On 10/06/2015 01:56 AM, Lou D

Re: DUCC - Work Item Queue Time Management

2016-01-11 Thread Lou DeGenaro
) > > Here is the similar kind of problem: > http://stackoverflow.com/questions/21528766/error-while-using-elastic-search-while-creating-a-osgi-bundle > . > As I do not want to change in the code, I choose to create the file. > > Reshu. > > > On 01/07/2016 02:45 AM, Lou D

Re: DUCC - Work Item Queue Time Management

2016-01-12 Thread Lou DeGenaro
Reshu, Very good. Looks to me like no DUCC changes are needed with respect to this issue. Lou. On Tue, Jan 12, 2016 at 12:07 AM, reshu.agarwal wrote: > Lou, > > I placed names.txt in config directory of current working Directory. > > Reshu. > > Signature On 01/11/2016 0

Re: DUCC - Work Item Queue Time Management

2016-01-13 Thread Lou DeGenaro
less strict under previous DUCC versions. Lou. On Wed, Jan 13, 2016 at 4:23 AM, reshu.agarwal wrote: > > But, I did not need to do this in case of DUCC 1.1.0 and 1.0.0. > > Reshu. > Signature > > > On 01/12/2016 06:35 PM, Lou DeGenaro wrote: > > Reshu, >> >&g

Re: DUCC - Work Item Queue Time Management

2016-01-13 Thread Lou DeGenaro
t may fail since > that uses the classpath that started the JVM which will be the DUCC > classpath. > > ~Burn > > On Wed, Jan 13, 2016 at 8:11 AM, Lou DeGenaro > wrote: > > > DUCC 2.0 does a better job of classpath isolation, meaning using DUCC's > > clas

Re: DUCC 2.0.1: Job is not going to complete State

2016-03-26 Thread Lou DeGenaro
Does the job's JD log file have any exceptions or errors? Lou. On Fri, Mar 25, 2016 at 2:49 AM, reshu.agarwal wrote: > Hi, > > I am facing a problem in DUCC 2.0.1 i.e. job is not completing even after > CR hasNext() returned false. I had tested my job with > "all_in_one=local/remote" both. It w

Re: Run Job with deployment discriptor

2016-10-14 Thread Lou DeGenaro
Are there any clues in your log files? log_directory ${DUCC_HOME}/ducctest/logs Lou. On Fri, Oct 14, 2016 at 12:01 PM, Wahed Hemati wrote: > Hi, > > I want to run a Job with a deployment discriptor. > > My Job file looks like this: > description DUCC raw t

Re: Run Job with deployment discriptor

2016-10-17 Thread Lou DeGenaro
ss > is about to kill itself via Runtime.getRuntime().halt() > > > I cant seem to find anything related to the error in the other logfiles. > > -Wahed > > > On 14.10.2016 18:54, Lou DeGenaro wrote: > >> Are there any clues in your log files? >> >> log_direc

Re: Support for UIMA Ducc

2017-02-23 Thread Lou DeGenaro
It is not unusual for the Cassandra DB to take a short while to boot. My experience has been usually less than a minute for a new install, but that depends on the machine's capabilities and load. Please have a look at the DB log which can be found in DUCC_HOME//cassandra-server/logs and look for

Re: DUCC Java API job info

2017-04-19 Thread Lou DeGenaro
There is no CLI query that gives the desired results. One could write a python script to visit http://uima-ducc-demo.apache.org:42133/ducc-servlet/json-format-aaData-jobs and parse the resulting json. Should there be a Jira to provide a CLI query capability equivalent of the Jobs page? Either a n

Re: DUCC Java API job info

2017-04-21 Thread Lou DeGenaro
< bauma...@stud.uni-frankfurt.de> wrote: > Thanks for the json url. An addition to the DuccJobMonitor would be great! > > -Daniel > > > On 19.04.2017 20:22, Lou DeGenaro wrote: > >> There is no CLI query that gives the desired results. One could write a >>

Re: DUCC job automatically fails and gives Reason,or extraordinary status as cancelled by User | DUCC Version: 2.0.1

2017-05-16 Thread Lou DeGenaro
Hello, There are two parts: JP (one or more) and JD (one). You have shown the log from a JP, which is trying to contact the JD for more work. Can you share the JD log? Also, you can find me on HipChat https://apache.hipchat.com/chat/room/3665278 in about an hour from now. Lou. On Tue, May 16,

Re: DUCC job automatically fails and gives Reason,or extraordinary status as cancelled by User | DUCC Version: 2.0.1

2017-05-16 Thread Lou DeGenaro
onEnd - T[283] engage seqNo=3496 > remote=S144.3348.34 ended > in getNext > in getNext > 14 May 2017 18:49:08,792 INFO ActionGet - T[483] engage seqNo=3517 > remote=S144.2443.32 > 14 May 2017 18:49:08,874 INFO ActionGet - T[482] engage seqNo=3518 > remote=S144.3348.34 &g

Re: DUCC job automatically fails and gives Reason,or extraordinary status as cancelled by User | DUCC Version: 2.0.1

2017-05-18 Thread Lou DeGenaro
submitting >> the >> job were stopped. >> >> Eddie >> >> On Tue, May 16, 2017 at 8:31 AM, Lou DeGenaro >> wrote: >> >> Dunno why the connection would be refused. Are the JD and JP on the same >>> or different machines? Is t

Re: DUCC job automatically fails and gives Reason,or extraordinary status as cancelled by User | DUCC Version: 2.0.1

2017-05-18 Thread Lou DeGenaro
> installed on the system. > > Thanks and Regards > Priyank Sharma > > On Thursday 18 May 2017 01:03 PM, Lou DeGenaro wrote: > >> Priyank, >> >> You must have specified --cancel_on_interrupt when you submitted you job. >> This requires that the ducc_submit c

Re: DUCC job automatically fails and gives Reason,or extraordinary status as cancelled by User | DUCC Version: 2.0.1

2017-05-19 Thread Lou DeGenaro
7 11:20:34,104 INFO OR.ProcessAccounting - 104791 addProcess 0 > added > 19 May 2017 11:20:34,104 INFO OR.JobFactory - N/A specification user:mario > 19 May 2017 11:20:34,104 INFO OR.JobFactory - N/A specification > signature:null > 19 May 2017 11:20:34,104 INFO OR.JobFactory - N/

Re: DUCC multi-valued parameter in job descriptor

2017-07-07 Thread Lou DeGenaro
--driver_descriptor_CR_overrides "key1=value1 key2=value2 key3=value3" Hope this helps. Lou. On Fri, Jul 7, 2017 at 5:37 AM, Wahed Hemati wrote: > Hi, > how do i pass a multi-valued parameter for driver_descriptor_CR_overrides > in my job descriptor. > the line looks currently like this: > >

Re: DUCC multi-valued parameter in job descriptor

2017-07-07 Thread Lou DeGenaro
:51:04 AM org.apache.uima.ducc.test.randomsleep.CR initialize(94) INFO: ** BB language: de Lou. On Fri, Jul 7, 2017 at 8:11 AM, Lou DeGenaro wrote: > --driver_descriptor_CR_overrides "key1=value1 key2=value2 key3=value3" > > Hope this helps. > > Lou. > > On F

Re: DUCC Security Model for Service Deployment

2017-07-18 Thread Lou DeGenaro
DUCC has its own password protected AMQ broker used for daemon communications. Are your services trying to use DUCC's broker? Lou. On Tue, Jul 18, 2017 at 1:02 PM, Osborne, John David (Campus) < ozb...@uab.edu> wrote: > I am having deploying services with DUCC using a single system, single > us

Re: DUCC Security Model for Service Deployment

2017-07-18 Thread Lou DeGenaro
> > > I'm registering services and running ducc as user ducc. > > > -John > > > > From: Lou DeGenaro > Sent: Tuesday, July 18, 2017 12:19:21 PM > To: user@uima.apache.org > Subject: Re: DUCC Security Model for Service Deployment > > DUCC has its own p

Re: DUCC Web Server Service Visibility and Default Reservations

2017-07-19 Thread Lou DeGenaro
It should always be the case that if you successfully "ducc_services --register..." a service it should appear on the ducc-mon Services page. When you click on the Id for a Service you should see zero of more deployments, each Running instance corresponding to an O/S process. If you ever want to r

Re: UIMA analysis from a database

2017-09-15 Thread Lou DeGenaro
Apache DUCC is simple to install and use. It is designed to run scaled-out (multi-threaded) UIMA pipelines as well as supporting services (Python, Java, what-have-you). It distributes work of multiple users fairly across large or small machine clusters, including fitting multiple jobs on the same

Re: DUCC's job goes into infintie loop

2017-11-09 Thread Lou DeGenaro
The first place to look is in your job's logs. Visit the ducc-mon jobs page ducchost:42133/jobs.jsp then click on the id of your job. Examine the logs by clicking on each log file name looking for any revealing information. Feel free to post non-confidential snippets here, or If you'd like to ch

Re: DUCC's job goes into infintie loop

2017-11-10 Thread Lou DeGenaro
> source and no UIMA aggregator is working for that batches. > > Are the issue because of the java heap space? We are giving 4gb ram to the > job-process. > > Attaching the Log file. > > Thanks and Regards > Priyank Sharma > > On Thursday 09 November 2017 04:33 PM, L

Re: DUCC's job goes into infintie loop

2017-11-14 Thread Lou DeGenaro
t; >>>> On Fri, Nov 10, 2017 at 12:11 AM, priyank sharma < >>>> priyank.sha...@orkash.com> >>>> wrote: >>>> >>>> There is nothing on the work item page and performance page on the web >>>> >>>>> server.

Re: DUCC's job goes into infintie loop

2017-11-15 Thread Lou DeGenaro
; disconnect from the cluster. > > Thanks and Regards > Priyank Sharma > > On Tuesday 14 November 2017 04:08 PM, Lou DeGenaro wrote: > >> What do you mean by "server down", precisely? Since we have no logs to >> look at we can only go by your descriptions. We&#

Re: DUCC's job goes into infintie loop

2017-11-15 Thread Lou DeGenaro
you now??? > > Thanks and Regards > Priyank Sharma > > On Wednesday 15 November 2017 03:57 PM, Lou DeGenaro wrote: > >> Please note that we make a clear distinction between "services" and >> "jobs". Earlier e-mail from you suggested that your troubl

Re: Ducc Service Registration Error

2017-11-20 Thread Lou DeGenaro
Are you trying to use DUCC's Broker for your service (not allowed, pw protected) or do you have your own Broker? Lou. On Tue, Nov 21, 2017 at 1:11 AM, priyank sharma wrote: > Thanks It helped. > > > Now my service shows the state *Waiting+Alert, *when i opened the service > details page it show

Re: Ducc Installation

2017-11-20 Thread Lou DeGenaro
DUCC's web server could do better about this temporary critical components alert at boot time. I opened Jira https://issues.apache.org/jira/browse/UIMA-5651?filter=-1 to address this. Lou. On Mon, Nov 20, 2017 at 4:25 AM, priyank sharma wrote: > Thanks it helped. > > > now i am getting an erro

Re: Ducc Service Registration Error

2017-11-21 Thread Lou DeGenaro
14:33:27,226 INFO SM.ServiceManagerComponent - N/A T[69] > publish Publishing State, active job count = 1 > > Thanks and Regards > Priyank Sharma > > On Tuesday 21 November 2017 12:44 PM, priyank sharma wrote: > >> We are using DUCC's Broker. How can we use DUCC

Re: DUCC Login setup on webserver

2017-11-28 Thread Lou DeGenaro
http://uima-ducc-demo.apache.org:42133/doc/duccbook.html#x1-22600012.13 Lou. On Mon, Nov 27, 2017 at 11:05 PM, priyank sharma wrote: > Hi! > > How to enable login on ducc webserver? > > Thanks in advance > > -- > Thanks and Regards > Priyank Sharma > >

Re: DUCC job Issue

2018-04-20 Thread Lou DeGenaro
Below is a simple python script that runs two jobs sequentially. Lou. = #!/usr/bin/env python import os ducc_home = '/user/ducc/ducc_runtime' cmd_submit = os.path.join(ducc_home,'bin/ducc_submit') jobA = 'examples/simple/1.job' jobB = 'examples/simple/1.dd.job' file_jobA = os.path.join(d

Re: Register service with customized pinger

2018-12-18 Thread Lou DeGenaro
Hello Florian, There is an example of a custom DUCC service running here http://uima-ducc-demo.apache.org:42133/service.details.jsp?name=CUSTOM:localhost:7175 See the Registry tab and note the "user" specified entries. These correspond to the ducc_services --register parameters. Lou. On Mon, D

Re: Service with Pinger "NoClassDefFoundError"

2019-01-17 Thread Lou DeGenaro
Yes! What ever classes/jars you need to run your pinger should be included in the service_ping_classpath. Lou. On Wed, Jan 16, 2019 at 12:13 PM Florian wrote: > Hello, > > thank you for your previous answer regarding the pinger, which I could > resolve. > > I have another question regarding re

Re: DUCC without shared file system

2019-09-03 Thread Lou DeGenaro
You not need do anything special to run DUCC without a shared filesystem. Simply install it on a local filesystem. However, there is one caveat. If the user's (e.g. DUCC jobs) log directory is not in a shared filesystem, then DUCC-Mon will not have access and the contents won't be viewable. I'll

Re: DUCC without shared file system

2019-09-03 Thread Lou DeGenaro
I opened Jira https://issues.apache.org/jira/browse/UIMA-6121 to track this issue. On Tue, Sep 3, 2019 at 1:51 PM Lou DeGenaro wrote: > You not need do anything special to run DUCC without a shared filesystem. > Simply install it on a local filesystem. However, there is one caveat. If

Re: DUCC without shared file system

2019-09-04 Thread Lou DeGenaro
$DUCC_HOME. On Tue, Sep 3, 2019 at 5:06 PM Lou DeGenaro wrote: > I opened Jira https://issues.apache.org/jira/browse/UIMA-6121 to track > this issue. > > > On Tue, Sep 3, 2019 at 1:51 PM Lou DeGenaro > wrote: > >> You not need do anything special to run DUCC without a sh

Re: UIMA DUCC slow processing

2020-06-12 Thread Lou DeGenaro
Have you examined various DUCC and system log files for possible clues? On Fri, Jun 12, 2020 at 1:16 PM Dr. Raja M. Suleman < raja.m.sulai...@gmail.com> wrote: > Hi, > Thank you for your reply and I'm sorry I couldn't get back to this > earlier. > > To get a better picture of the processing speed

UIMA-DUCC support

2021-12-15 Thread Lou DeGenaro
All, The DUCC segment of the Apache UIMA project is in need of hands-on help. Development has come to a halt and fixes, such as upgrading 3rd party dependencies, are at a standstill. Please volunteer to take on responsibility for DUCC support or it will have to be retired. Thanks! Lou DeGenaro