Github user mohammadshahidkhan commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1116#discussion_r158028051
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/util/CarbonDataProcessorUtil.java
---
@@ -622,4 +624,30 @@ public static String trimErrorMessage(String input) {
}
return errorMessage;
}
+ /**
+ * The method returns true is either logger is enabled or action is
redirect
+ * @param configuration
+ * @return
+ */
+ public static boolean isRawDataRequired(CarbonDataLoadConfiguration
configuration) {
+ boolean isRawDataRequired = Boolean.parseBoolean(
+
configuration.getDataLoadProperty(DataLoadProcessorConstants.BAD_RECORDS_LOGGER_ENABLE)
+ .toString());
+ // if logger is disabled then check if action is redirect then raw
data will be required.
+ if (!isRawDataRequired) {
--- End diff --
It is needed for the cases bad record logger is enabled or action is
redirect.
No new configuration introduce? Just preparing a flag from existing
configuration.
---
