Jay Sen created GOBBLIN-811:
-------------------------------
Summary: non gobblin job files should not throw exception
Key: GOBBLIN-811
URL: https://issues.apache.org/jira/browse/GOBBLIN-811
Project: Apache Gobblin
Issue Type: Improvement
Reporter: Jay Sen
any other files, other than .pull or .conf under job dir should be ignored with
DEBUG or WARN message instead of throwing exception.
for example:
{{2019-06-22 21:21:05 PDT ERROR [newDaemonThreadFactory]
org.apache.gobblin.util.filesystem.ExceptionCatchingPathAlterationListenerDecorator
- onFileCreate failure:
java.lang.RuntimeException: Cannot load pull file
file:/tools/gobblin-dist/gobblin-cluster-data/jobs/test_job.pull_old due to
unrecognized extension.
at
org.apache.gobblin.runtime.job_catalog.FSPathAlterationListenerAdaptor.onFileCreate(FSPathAlterationListenerAdaptor.java:61)
at
org.apache.gobblin.util.filesystem.ExceptionCatchingPathAlterationListenerDecorator.onFileCreate(ExceptionCatchingPathAlterationListenerDecorator.java:55)
at
org.apache.gobblin.util.filesystem.PathAlterationObserver.doCreate(PathAlterationObserver.java:276)
at
org.apache.gobblin.util.filesystem.PathAlterationObserver.checkAndNotify(PathAlterationObserver.java:210)
at
org.apache.gobblin.util.filesystem.PathAlterationObserver.checkAndNotify(PathAlterationObserver.java:180)
at
org.apache.gobblin.util.filesystem.PathAlterationObserverScheduler.run(PathAlterationObserverScheduler.java:163)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
