Github user chenliang613 commented on a diff in the pull request:

    
https://github.com/apache/incubator-carbondata/pull/614#discussion_r104550978
  
    --- Diff: docs/faq.md ---
    @@ -18,30 +18,57 @@
     -->
     
     # FAQs
    -* **Auto Compaction not Working**
     
    -    The Property carbon.enable.auto.load.merge in carbon.properties need 
to be set to true.
    +* [What are Bad Records?](#what-are-bad-records)
    +* [Where are Bad Records Stored in 
CarbonData?](#where-are-bad-records-stored-in-carbondata)
    +* [How to handle Bad Records?](#how-to-handle-bad-records)
    +* [How to resolve store location can’t be 
found?](#how-to-resolve-store-location-can-not-be-found)
    +* [What is Carbon Lock Type?](#what-is-carbon-lock-type)
    +* [How to resolve Abstract Method 
Error?](#how-to-resolve-abstract-method-error)
     
    -* **Getting Abstract method error**
    +## What are Bad Records?
    +Records that fail to get loaded into the CarbonData due to data type 
incompatibility or are empty or have incompatible format are classified as Bad 
Records.
     
    -    You need to specify the spark version while using Maven to build 
project.
    +## Where are Bad Records Stored in CarbonData?
    +The bad records are stored at the location set in 
carbon.badRecords.location in carbon.properties file.
    +By default **carbon.badRecords.location** specifies the following location 
``/opt/Carbon/Spark/badrecords``.
     
    -* **Getting NotImplementedException for subquery using IN and EXISTS**
    +## How to handle Bad Records?
    +While loading data we can specify the approach to handle Bad Records. In 
order to analyse the cause of the Bad Records the parameter 
``BAD_RECORDS_LOGGER_ENABLE`` must be set to value ``TRUE``. There are three 
approaches to handle Bad Records which can be specified  by the parameter 
``BAD_RECORDS_ACTION``.
     
    -    Subquery with in and exists not supported in CarbonData.
    -    
    -* **Getting Exceptions on creating  a view**
    -    
    -    View not supported in CarbonData.
    -    
    -* **How to verify if ColumnGroups have been created as desired.**
    +- To pad the incorrect values of the csv rows with NULL value and load the 
data in CarbonData, set the following in the query :
    +```
    +'BAD_RECORDS_ACTION'='FORCE'
    +```
    --- End diff --
    
    Please add "How to ignore the bad records" ?
    Please find the detail discussion at here : 
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/data-lost-when-loading-data-from-csv-file-to-carbon-table-td7554.html



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Reply via email to