Re: [R] Reading very large text files into R

Truth Tim -Original Message- From: R-help On Behalf Of Avi Gross Sent: Friday, September 30, 2022 7:01 PM Cc: R help Mailing list Subject: Re: [R] Reading very large text files into R [External Email] Those are valid reasons as examining data and cleaning or fixing it is a major

Re: [R] Reading very large text files into R

Of > avi.e.gr...@gmail.com > Sent: Friday, September 30, 2022 3:16 PM > Cc: r-help@r-project.org > Subject: Re: [R] Reading very large text files into R > > [External Email] > > Tim and others, > > A point to consider is that there are various algorithms in the func

Re: [R] Reading very large text files into R

r a column misaligned so that humidity values are in the temperature column. Tim -Original Message- From: R-help On Behalf Of avi.e.gr...@gmail.com Sent: Friday, September 30, 2022 3:16 PM Cc: r-help@r-project.org Subject: Re: [R] Reading very large text files into R [External Email] Tim

Re: [R] Reading very large text files into R

gt; format that can be used without anomalies. > > Avi > > -Original Message----- > From: R-help On Behalf Of Ebert,Timothy > Aaron > Sent: Friday, September 30, 2022 7:27 AM > To: Richard O'Keefe ; Nick Wray > Cc: r-help@r-

Re: [R] Reading very large text files into R

anomalies. Avi -Original Message- From: R-help On Behalf Of Ebert,Timothy Aaron Sent: Friday, September 30, 2022 7:27 AM To: Richard O'Keefe ; Nick Wray Cc: r-help@r-project.org Subject: Re: [R] Reading very large text files into R Hi Nick, Can you post one line of data with 15 entries

Re: [R] Reading very large text files into R

large text files into R [External Email] If I had this problem, in the old days I'd've whipped up a tiny AWK script. These days I might use xsv or qsv. BUT first I would want to know why these extra fields are present and what they signify. Are they good data that happen not to be described

Re: [R] Reading very large text files into R

If I had this problem, in the old days I'd've whipped up a tiny AWK script. These days I might use xsv or qsv. BUT first I would want to know why these extra fields are present and what they signify. Are they good data that happen not to be described in the documentation? Do they represent a

Re: [R] Reading very large text files into R

To me this file looks like a CSV with 15 fields (on each line) not 16, the last field being empty with the exception of the one which has the 'B'. The 14th is always empty. I also note that it does not seem to have a new line at the end. I can strongly recommend QSV to manipulate CSV files and

Re: [R] Reading very large text files into R

Hello Ivan's suggestion of fill=T seems to do the trick. Thanks to everyone who piled in - I'm rather touched by the support seeing as this was causing me a big headache with furthering my project. I also feel humbled by realising how little I know about the R-universe... Nick On Thu, 29 Sept

Re: [R] Reading very large text files into R

"Confusion" is the size of the file. Try specifying the colClasses argument to nail down the number and type of the columns. On September 29, 2022 8:16:34 AM PDT, Bert Gunter wrote: >I had no trouble reading your text snippet with >read.csv(text = >"... your text... ") > >There were 15

Re: [R] Reading very large text files into R

Hi Bert Right Thing is, I didn't know that there even was an instruction like read.csv(text = "... your text... ") so at any rate I can paste the original text files in by hand if there's no shorter cut Thanks v much Nick On Thu, 29 Sept 2022 at 16:16, Bert Gunter wrote: > I had no trouble

Re: [R] Reading very large text files into R

I had no trouble reading your text snippet with read.csv(text = "... your text... ") There were 15 columns. The last column was all empty except for the row containing the "B". So there seems to be some confusion here. -- Bert On Thu, Sep 29, 2022 at 6:54 AM Nick Wray wrote: > Hello I

Re: [R] Reading very large text files into R

You're sure the extra column is indeed an extra column? According to the documentation (https://artefacts.ceda.ac.uk/badc_datadocs/ukmo-midas/RH_Table.html) there should be 15 columns. Could it, for example, be that one of the columns contains records with commas? Jan On 29-09-2022

Re: [R] Reading very large text files into R

Hi Nick, It's hard to know without seeing at least a snippet of the data. Could you do the following and paste the result into a plain text email? If you don't set your email client to plain text (from rich text or html) then we are apt to see a jumble of output on our email clients. ## start

Re: [R] Reading very large text files into R

В Thu, 29 Sep 2022 14:54:10 +0100 Nick Wray пишет: > although most lines in the text doc consist of 15 elements, every so > often there is a sixteenth one and R doesn’t like this and gives me > an error message Does the fill = TRUE argument of read.table() help? If not, could you construct and

[R] Reading very large text files into R

Hello I may be offending the R purists with this question but it is linked to R, as will become clear. I have very large data sets from the UK Met Office in notepad form. Unfortunately, I can’t read them directly into R because, for some reason, although most lines in the text doc consist of