Joel Baranick created GOBBLIN-531:
-------------------------------------
Summary: Gobblin AWS Worker cannot start because of state store
type and uri mismatch
Key: GOBBLIN-531
URL: https://issues.apache.org/jira/browse/GOBBLIN-531
Project: Apache Gobblin
Issue Type: Bug
Components: gobblin-aws
Affects Versions: 0.12.0
Reporter: Joel Baranick
Assignee: Abhishek Tiwari
Something has changed from 0.10.0 to 0.12.0 which causes the _StateStores_
class to be instantiated with a _state.store.fs.uri_ which is mismatched with
the _state.store.type_.
The problem seems to be from:
[GobblinTaskRunner.java#L250|https://github.com/apache/incubator-gobblin/blob/0.12.0/gobblin-cluster/src/main/java/org/apache/gobblin/cluster/GobblinTaskRunner.java#L250]
It create a new _Config_ for like:
{code:java}
Config stateStoreJobConfig = ConfigUtils.propertiesToConfig(properties)
.withValue(ConfigurationKeys.STATE_STORE_FS_URI_KEY,
ConfigValueFactory.fromAnyRef(rootPathUri.toString()));
{code}
Compare this to:
[GobblinHelixJobLauncher.java#L156|https://github.com/apache/incubator-gobblin/blob/0.12.0/gobblin-cluster/src/main/java/org/apache/gobblin/cluster/GobblinHelixJobLauncher.java#L156]
It creates a new _Config_ like:
{code:java}
Config stateStoreJobConfig = ConfigUtils.propertiesToConfig(jobProps)
.withValue(ConfigurationKeys.STATE_STORE_FS_URI_KEY,
ConfigValueFactory.fromAnyRef( new URI(appWorkDir.toUri().getScheme(), null,
appWorkDir.toUri().getHost(), appWorkDir.toUri().getPort(), null, null,
null).toString()));
{code}
The following screenshot shows the callstack and the overridden value.
!Screen Shot 2018-07-12 at 8.47.07 AM.png!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
