a2l007 opened a new issue #8778: Missing dimensions/metrics are parsed as empty values for delimited text files URL: https://github.com/apache/incubator-druid/issues/8778 ### Affected Version 0.14.0-incubating. Also reproducible in master ### Description With `-Ddruid.generic.useDefaultValueForNull=false` nulls and empty values should be handled differently. However for delimited text files, it looks like null/missing values are being parsed as empty values. For example with the following dimension & metric spec and CSV data: ``` "dimensionsSpec" : { "dimensions" : [ "dim1", "dim2", "dim3"] } "metricsSpec" : [ { "name" : "metric1", "type" : "count", "fieldName" : "metric1" }, { "name" : "metric2", "type" : "longSum", "fieldName" : "metric2" } ] ``` Data: `2019-07-04T03:46:58.771Z,,"value2","value3",,82` `dim1` would be stored as `""` instead of `null` and `metric1` would be stored as `0` instead of `null` even though they are missing values.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
