New reply on DataCleaner's online discussion forum
(http://datacleaner.org/forum):
Mashud replied to subject 'Synonym catalog DC version 4.5.2'
-------------------
Hi,
So i did further investigation and it is not the synonym which is causing the
issue, rather it is the dictionary matcher. I have a dictionary datastore which
holds 74197 records. This job used to run fine with version 3.7.2 but with
4.5.2 it is causing the below out of memory error, is there a setting i can
configure to make this work?
{{{
java.lang.RuntimeException: java.lang.OutOfMemoryError: GC overhead limit
exceeded
at
org.datacleaner.descriptors.AbstractMethodDescriptor.convertThrownException(AbstractMethodDescriptor.java:97)
~[DataCleaner-engine-core-4.5.2.jar:na]
at
org.datacleaner.descriptors.AbstractMethodDescriptor.invoke(AbstractMethodDescriptor.java:83)
~[DataCleaner-engine-core-4.5.2.jar:na]
at
org.datacleaner.descriptors.InitializeMethodDescriptorImpl.initialize(InitializeMethodDescriptorImpl.java:44)
~[DataCleaner-engine-core-4.5.2.jar:na]
at
org.datacleaner.lifecycle.LifeCycleHelper.initialize(LifeCycleHelper.java:180)
~[DataCleaner-engine-core-4.5.2.jar:na]
at
org.datacleaner.job.tasks.InitializeTask.executeInternal(InitializeTask.java:83)
~[DataCleaner-engine-core-4.5.2.jar:na]
at
org.datacleaner.job.tasks.InitializeTask.execute(InitializeTask.java:55)
~[DataCleaner-engine-core-4.5.2.jar:na]
at
org.datacleaner.job.concurrent.TaskRunnable.run(TaskRunnable.java:61)
~[DataCleaner-api-4.5.2.jar:na]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_25]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_25]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_25]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
at
org.apache.metamodel.data.AbstractRow.getSubSelection(AbstractRow.java:157)
~[MetaModel-core-4.4.0.jar:4.4.0]
at
org.apache.metamodel.MetaModelHelper.getGrouped(MetaModelHelper.java:326)
~[MetaModel-core-4.4.0.jar:4.4.0]
at
org.apache.metamodel.MetaModelHelper.getDistinct(MetaModelHelper.java:782)
~[MetaModel-core-4.4.0.jar:4.4.0]
at
org.apache.metamodel.QueryPostprocessDataContext.executeQuery(QueryPostprocessDataContext.java:212)
~[MetaModel-core-4.4.0.jar:4.4.0]
at
org.datacleaner.reference.DatastoreDictionary.loadIntoMemory(DatastoreDictionary.java:91)
~[DataCleaner-engine-core-4.5.2.jar:na]
at
org.datacleaner.reference.DatastoreDictionary.openConnection(DatastoreDictionary.java:113)
~[DataCleaner-engine-core-4.5.2.jar:na]
at
org.datacleaner.beans.transform.DictionaryMatcherTransformer.init(DictionaryMatcherTransformer.java:97)
~[DataCleaner-reference-data-4.5.2.jar:na]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[na:1.8.0_25]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[na:1.8.0_25]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.8.0_25]
}}}
-------------------
View the topic online to reply - go to
http://datacleaner.org/topic/1099/Synonym-catalog-DC-version-4.5.2
--
You received this message because you are subscribed to the Google Groups
"DataCleaner-notify" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/datacleaner-notify.
For more options, visit https://groups.google.com/d/optout.
