[
https://issues.apache.org/jira/browse/CARBONDATA-660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mohammad Shahid Khan reassigned CARBONDATA-660:
-----------------------------------------------
Assignee: Mohammad Shahid Khan
> Bad Records Logs and Raw CSVs should get display under segment id instead of
> Tasks id
> -------------------------------------------------------------------------------------
>
> Key: CARBONDATA-660
> URL: https://issues.apache.org/jira/browse/CARBONDATA-660
> Project: CarbonData
> Issue Type: Improvement
> Components: data-load
> Reporter: Priyal Sachdeva
> Assignee: Mohammad Shahid Khan
> Priority: Minor
>
> create table if not exists Badrecords_test (imei string,AMSize int) STORED BY
> 'org.apache.carbondata.format';
> LOAD DATA INPATH 'hdfs://hacluster/CSVs/bad_records.csv' into table
> Badrecords_test OPTIONS('DELIMITER'=',' ,
> 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE',
> 'BAD_RECORDS_ACTION'='REDIRECT','FILEHEADER'='imei,AMSize');
> Bad Records Logs and raw csvs are getting display under Task ID
> linux-61:/srv/OSCON/BigData/HACluster/install/hadoop/datanode #
> bin/hadoop fs -ls /tmp/carbon/default/badrecords_test
> drwxr-xr-x - root users 0 2017-01-18 21:08
> /tmp/carbon/default/badrecords_test/0--------------------------->Task ID
> 0: jdbc:hive2://172.168.100.205:23040> show segments for table
> Badrecords_test;
> +--------------------+------------------+--------------------------+--------------------------+--+
> | SegmentSequenceId | Status | Load Start Time |
> Load End Time |
> +--------------------+------------------+--------------------------+--------------------------+--+
> | 8 | Partial Success | 2017-01-18 21:12:58.018 |
> 2017-01-18 21:12:59.652 |
> | 7 | Partial Success | 2017-01-18 21:08:07.426 |
> 2017-01-18 21:08:11.791 |
> | 6 | Partial Success | 2017-01-18 21:07:07.645 |
> 2017-01-18 21:07:08.747 |
> | 5 | Partial Success | 2017-01-18 19:34:16.163 |
> 2017-01-18 19:34:18.163 |
> | 4 | Partial Success | 2017-01-18 19:34:13.669 |
> 2017-01-18 19:34:15.811 |
> | 3 | Partial Success | 2017-01-18 19:30:18.753 |
> 2017-01-18 19:30:19.644 |
> | 2 | Partial Success | 2017-01-18 19:30:13.508 |
> 2017-01-18 19:30:15.578 |
> | 1 | Partial Success | 2017-01-18 19:18:54.787 |
> 2017-01-18 19:18:54.94 |
> | 0 | Partial Success | 2017-01-18 19:18:53.741 |
> 2017-01-18 19:18:54.614 |
> +--------------------+------------------+--------------------------+--------------------------+--+
> Bad Records Logs and raw csvs are getting display under Task ID. It would be
> good to have the information of bad records as per the load i.e under segment
> id..
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
