Re: [datatable-help] New function fread() in v1.8.7

Thu, 03 Jan 2013 18:36:20 -0800 


ASB,
All mid read column type bumps are now implemented and tests added.
This should work now.  Turn on verbose=TRUE to see the messages
telling you which field on which line caused the bump.
Need to upgrade to commit 785.

On 24.12.2012 13:52, Matthew Dowle wrote:

Great. Looks like cols 3,4,9 and 12 are being detected as integer64
ok (16 width is just about ok, limit is 18 digits for integer64), but
later on in the file there is a . or more digits in one of those
columns that causes the bump to real. There is a nice message telling
you which line and which field and the contents is causing the bump,
but the 'unimplemented' error happens first. oops,  will fix ..

Thanks!


On 24.12.2012 12:21, akhilsbehl wrote:

Here is a new problem:

I have a csv that looks like this:


PO,CASH,2012080150000306,67389310793869,bbRELIANCE,EQ,74025,700,2012080150004326,1,3,2012080150001143,1,3

PO,CASH,2012080150000307,67389310793884,bbRELIANCE,EQ,74025,2000,2012080150007969,1,3,2012080150001143,1,3

PO,CASH,2012080150000308,67389310793896,bbRELIANCE,EQ,74025,1000,2012080150002222,1,3,2012080150001143,1,3

read.csv(filename) gives me:

1 PO CASH 2.01208e+15 6.738931e+13 bbRELIANCE EQ 74025   700
2.01208e+15   1
3 2.01208e+15   1   3
2 PO CASH 2.01208e+15 6.738931e+13 bbRELIANCE EQ 74025  2000
2.01208e+15   1
3 2.01208e+15   1   3
3 PO CASH 2.01208e+15 6.738931e+13 bbRELIANCE EQ 74025  1000
2.01208e+15   1
3 2.01208e+15   1   3

fread(filename, verbose=TRUE) gives me:
Detected eol as \n only (no \r afterwards), the UNIX and Mac standard. Starting format detection on line 30 (the last non blank line in the first 
30)
Detected sep as ',' and 14 columns
Type codes: 33113300100100
Found first row with 14 fields occuring on line 1 (either column names or 
first row of data)
The first data row has some non character fields. Treating as a data row and 
using default column names.
Count of eol after pos: 54025
Subtracted 1 for last eol and any trailing empty lines, leaving 54024 data 
rows

Error in fread(data.files[[2]], verbose = TRUE) :
  Coercing integer64 to real needs to be implemented
Type codes show it is trying to read columns 3, 4, 9, 12 as real numbers. Now, I may be out of depth here but shouldn't they just be integers? Am I 
missing something?

Thanks.

--
ASB.



--
View this message in context:

http://r.789695.n4.nabble.com/New-function-fread-in-v1-8-7-tp4653745p4653872.html
Sent from the datatable-help mailing list archive at Nabble.com.
_______________________________________________
datatable-help mailing list
[email protected]

https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/datatable-help


_______________________________________________
datatable-help mailing list
[email protected]

https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/datatable-help


_______________________________________________
datatable-help mailing list
[email protected]
https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/datatable-help

Reply via email to