[CARBONDATA-1922] Documentation - Updated document with Ignoring empty line OPTION
Updated document with Ignoring empty line OPTION This closes #1737 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/1f680119 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/1f680119 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/1f680119 Branch: refs/heads/branch-1.3 Commit: 1f680119224b8e3b0a253036e75b1096affa8ebd Parents: 83e9271 Author: Brahma Reddy Battula <[email protected]> Authored: Thu Dec 28 18:39:12 2017 +0530 Committer: Jacky Li <[email protected]> Committed: Fri Dec 29 16:08:59 2017 +0800 ---------------------------------------------------------------------- docs/configuration-parameters.md | 3 ++- docs/data-management-on-carbondata.md | 5 +++++ 2 files changed, 7 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/carbondata/blob/1f680119/docs/configuration-parameters.md ---------------------------------------------------------------------- diff --git a/docs/configuration-parameters.md b/docs/configuration-parameters.md index 4cbe77e..5abfdfd 100644 --- a/docs/configuration-parameters.md +++ b/docs/configuration-parameters.md @@ -106,7 +106,8 @@ This section provides the details of all the configurations required for CarbonD | carbon.concurrent.lock.retries | 100 | Specifies the maximum number of retries to obtain the lock for concurrent operations. This is used for concurrent loading. | | carbon.concurrent.lock.retry.timeout.sec | 1 | Specifies the interval between the retries to obtain the lock for concurrent operations. | | carbon.tempstore.location | /opt/Carbon/TempStoreLoc | Temporary store location. By default it takes System.getProperty("java.io.tmpdir"). | -| carbon.load.log.counter | 500000 | Data loading records count logger. | +| carbon.load.log.counter | 500000 | Data loading records count logger. | +| carbon.skip.empty.line | false | Setting this property ignores the empty lines in the CSV file during the data load | * **Compaction Configuration** http://git-wip-us.apache.org/repos/asf/carbondata/blob/1f680119/docs/data-management-on-carbondata.md ---------------------------------------------------------------------- diff --git a/docs/data-management-on-carbondata.md b/docs/data-management-on-carbondata.md index f2ae4df..20c70e3 100644 --- a/docs/data-management-on-carbondata.md +++ b/docs/data-management-on-carbondata.md @@ -323,6 +323,11 @@ This tutorial is going to introduce all commands and data operations on CarbonDa ``` OPTIONS('ESCAPECHAR'='\') ``` + - **SKIP_EMPTY_LINE:** This option will ignore the empty line in the CSV file during the data load. + + ``` + OPTIONS('SKIP_EMPTY_LINE'='TRUE/FALSE') + ``` - **COMPLEX_DELIMITER_LEVEL_1:** Split the complex type data column in a row (eg., a$b$c --> Array = {a,b,c}).
