[ 
https://issues.apache.org/jira/browse/DRILL-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sudheesh Katkam reopened DRILL-4383:
------------------------------------

Downgrading to older versions of Drill causes startup failures, as "config" 
parameter is not recognized.
{code}
Exception in thread "main" 
org.apache.drill.exec.exception.DrillbitStartupException: Failure during 
initial startup of Drillbit.
        at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:84)
        at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:61)
        at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:163)
Caused by: java.lang.RuntimeException: 
com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException: Unrecognized 
field "config" (class org.apache.drill.exec.store.dfs.FileSystemConfig), not 
marked as ignorable (4 known properties: "enabled", "formats", "connection", 
"workspaces"])
 at [Source: [B@1dd5af13; line: 5, column: 18] (through reference chain: 
org.apache.drill.exec.store.dfs.FileSystemConfig["config"])
        at 
org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:268)
        at 
org.apache.drill.exec.store.StoragePluginRegistry.createPlugins(StoragePluginRegistry.java:197)
        at 
org.apache.drill.exec.store.StoragePluginRegistry.init(StoragePluginRegistry.java:161)
        at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:213)
        at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:81)
        ... 2 more
Caused by: com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException: 
Unrecognized field "config" (class 
org.apache.drill.exec.store.dfs.FileSystemConfig), not marked as ignorable (4 
known properties: "enabled", "formats", "connection", "workspaces"])
 at [Source: [B@1dd5af13; line: 5, column: 18] (through reference chain: 
org.apache.drill.exec.store.dfs.FileSystemConfig["config"])
        at 
com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException.from(UnrecognizedPropertyException.java:51)
        at 
com.fasterxml.jackson.databind.DeserializationContext.reportUnknownProperty(DeserializationContext.java:731)
        at 
com.fasterxml.jackson.databind.deser.std.StdDeserializer.handleUnknownProperty(StdDeserializer.java:915)
        at 
com.fasterxml.jackson.databind.deser.BeanDeserializerBase.handleUnknownProperty(BeanDeserializerBase.java:1298)
        at 
com.fasterxml.jackson.databind.deser.BeanDeserializerBase.handleUnknownVanilla(BeanDeserializerBase.java:1276)
        at 
com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:243)
        at 
com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:151)
        at 
com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:126)
        at 
com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
        at 
com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
        at 
com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
        at 
com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41)
        at 
com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1269)
        at 
com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:912)
        at 
org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
        at 
org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:266)
        ... 6 more
{code}

[~jaltekruse], how do you think Drill should deal with this?

Drill could ignore unknown properties as [suggested 
here|http://stackoverflow.com/questions/5455014/ignoring-new-fields-on-json-objects-using-jackson],
 but any bad parameter is also ignored.

> Allow passign custom configuration options to a file system through the 
> storage plugin config
> ---------------------------------------------------------------------------------------------
>
>                 Key: DRILL-4383
>                 URL: https://issues.apache.org/jira/browse/DRILL-4383
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Storage - Other
>            Reporter: Jason Altekruse
>            Assignee: Jason Altekruse
>             Fix For: 1.6.0
>
>
> A similar feature already exists in the Hive and Hbase plugins, it simply 
> provides a key/value map for passing custom configuration options to the 
> underlying storage system.
> This would be useful for the filesystem plugin to configure S3 without 
> needing to create a core-site.xml file or restart Drill.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to