GitHub user anubhav100 opened a pull request:
https://github.com/apache/incubator-carbondata/pull/607
[CARBONDATA-712]resolve the bug for bad records not written in csv file
when 'BAD_RECORDS_ACTION'='REDIRECT'
https://issues.apache.org/jira/browse/CARBONDATA-712
The bad_records are also not loading in the BAD_RECORS_LOCATION when using
'BAD_RECORDS_ACTION'='REDIRECT' at load time
both inprogress file and log file is empty
Because nothing in the I/O path guarantees that your data has reached
disk,When you write data to a stream, it is not written immediately, and it is
buffered. So we should use flush() when need to be sure that all your data from
buffer is writte
so when we are using bufferedCSVWriter.write(logStrings.toString()),it
must be followed by
bufferedCSVWriter.flush();
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/anubhav100/incubator-carbondata CARBONDATA-712
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-carbondata/pull/607.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #607
----
commit 02f1c6c4d7b7e03589a35ee09a8303795c1c0b41
Author: anubhav100 <[email protected]>
Date: 2017-02-21T06:45:14Z
resolved the issue for bad records not written in csv file when
bad_records_action=redirect
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
