[
https://issues.apache.org/jira/browse/DRILL-3602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14658332#comment-14658332
]
james sun commented on DRILL-3602:
----------------------------------
Hi Deneche,
For example, I have thousands of csv files and not all the fields in all csv
files are fully populated. some fields are empty. As I do a simple
select * command across all these files, error occurred when Drill hits the
file with empty fields. But the log doesn’t say which file is it processing.
It would be easier for me to debug if it tells the file name so I can drill
down to the specific file without having to go through thousands of files.
Here is an example of a file with fully populated and empty fields:
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.14452,-118.08606,400,20091127,03:49:05
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.13642,-118.10855,400,20091127,03:49:17
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.13257,-118.13473,400,20091127,03:49:29
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.12983,-118.16765,400,20091127,03:49:41
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.12579,-118.19361,400,20091127,03:49:53
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.11976,-118.2209,400,20091127,03:50:05
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57353,-121.58741,21,20091127,00:10:04
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57512,-121.58511,21,20091127,00:10:09
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57671,-121.58281,21,20091127,00:10:13
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57889,-121.5792,22,20091127,00:10:18
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.48167,-121.65603,30,
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.48055,-121.65398,30,
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.48028,-121.64923,30,
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.47955,-121.64573,30,
-James
> Need to log filename when error happens
> ---------------------------------------
>
> Key: DRILL-3602
> URL: https://issues.apache.org/jira/browse/DRILL-3602
> Project: Apache Drill
> Issue Type: Improvement
> Components: Functions - Drill
> Affects Versions: 1.1.0
> Reporter: james sun
> Assignee: Mehant Baid
>
> Error in the log but there is not enough information as to which file drill
> was processing when the errors happened, e.g.
> 2015-08-04 01:51:15,885 [Client-1] INFO
> o.a.d.j.i.DrillResultSetImpl$ResultsListener - [#1] Query failed:
> org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR:
> IllegalArgumentException: Invalid format: ""
> It will be helpful for trouble shooting purpose to log the file name.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
