Also note that you can set DAFFODIL_JAVA_OPTS instead of JAVA_OPTS. This is usually preferred since Daffodil memory requirements are often pretty different from most other java applications. It can be pretty memory hungry when compiling schemas. I usually run daffodil with the following
export DAFFODIL_JAVA_OPTS="-Xms8192m -Xmx8192m -XX:ReservedCodeCacheSize=2048m" Does bumping up the stack size allow your schema to compile? If you're still ruining into a stack overflow with something like the above, it likely means there's a bug or something else going on. One potential issue that could cause this: Daffodil does not support recursive schemas. We don't detect this right now (see DAFFODIL-80), and the result I think is a stack overflow. So make sure to double check that you don't have any recursive type/element/group references. On 3/12/21 11:26 AM, Stephen Sullivan wrote: > I don't know if there is any documentation on the default values used by > Daffodil but there is a brief description on how to provide your own settings > here: > > https://daffodil.apache.org/cli/ <https://daffodil.apache.org/cli/> > > Regards, > Steve > > On Fri, Mar 12, 2021 at 11:20 AM Horvath, Attila J CTR (USA) > <attila.j.horvath....@mail.mil <mailto:attila.j.horvath....@mail.mil>> wrote: > > Thx Steve > > Where are these JAVA options documented? URL? > > Thx again > > attila.j.horvath....@mail.mil <mailto:attila.j.horvath....@mail.mil> > ahorv...@asrcfederal.com <mailto:ahorv...@asrcfederal.com> > 301.225.9879 : ☎: office/desk > 301.225.9600 : ☎: office/floor > 410.357.1364 : ☎: home/cell > > > -----Original Message----- > From: Stephen Sullivan <catalyst7...@gmail.com > <mailto:catalyst7...@gmail.com>> > Sent: Friday, March 12, 2021 11:15 AM > To: users@daffodil.apache.org <mailto:users@daffodil.apache.org> > Cc: Steve Lawrence <slawre...@apache.org <mailto:slawre...@apache.org>>; > Horvath, Attila J CTR (USA) <attila.j.horvath....@mail.mil > <mailto:attila.j.horvath....@mail.mil>> > Subject: [Non-DoD Source] Re: Exception in thread "main" > java.lang.StackOverflowError > > All active links contained in this email were disabled. Please verify the > identity of the sender, and confirm the authenticity of all links > contained > within the message prior to copying and pasting the address to a Web > browser. > > > ________________________________ > > > > Attila, > > Just downloaded the 3.0 script. Looking at the daffodil script it appears > to be using the default stack size for the JVM (I believe this is 1M) > > JOPTS="-Xms1024m -Xmx1024m -XX:ReservedCodeCacheSize=128m" > > > If you specify JAVA_OPTS before running the command it looks like you > could > customize your memory settings. > > export JAVA_OPTS='-Xss2M -Xms1024m -Xmx1024m > -XX:ReservedCodeCacheSize=128m' > daffodil ... > > -Steve > > > On Fri, Mar 12, 2021 at 10:53 AM Attila Horvath > <attila.j.horv...@gmail.com > <mailto:attila.j.horv...@gmail.com> < > Caution-mailto:attila.j.horv...@gmail.com > <mailto:attila.j.horv...@gmail.com> > > wrote: > > > All > > Per subject, encountered stack overflow error running Daffodil > 3.0 > running on Debian virtual machine w/ 8GB memory. Also tried w/ 16GB > memory - > same result. > > > Input CSV file consists of pipe ["|"] delimited values: 79 > records, > 595 fields per record. I suspect the large number of fields per record is > the root cause for blowing stack perhaps due to recursion. > > > Pls advise what if anything else I can provide. See note below > for > log files too big to attach. > > > 1. What is Daffodil's default stack size? > 2. If possible, how to increase? > > NOTE: Steve - pls see follow up email addressed to > "slawre...@apache.org <mailto:slawre...@apache.org> < > Caution-mailto:slawre...@apache.org <mailto:slawre...@apache.org> > " for > instructions to pick up log files via DoD-Safe. 'ebasd-gl-vvv.log' with > verbose logging. > > > Thx in advance, > > > Attila > > > > > -- > > - > To err is human; to forgive, beyond the scope of the Operating System. > > > > -- > > - > > To err is human; to forgive, beyond the scope of the Operating System. >
