Re: [Tutor] Most efficient way to read large csv files with properly converted mixed data types.

On 26/06/16 07:21, Ek Esawi wrote: > The first step of my plan is to do basic statistical analysis. The 2nd step > is to chose a sample from each file and do more advanced statistical > analysis for which i plan to use R. If you are just extracting data and repackaging it for R then the format do

Re: [Tutor] Most efficient way to read large csv files with properly converted mixed data types.

The first step of my plan is to do basic statistical analysis. The 2nd step is to chose a sample from each file and do more advanced statistical analysis for which i plan to use R. EKE ___ Tutor maillist - Tutor@python.org To unsubscribe or change subs

Re: [Tutor] Most efficient way to read large csv files with properly converted mixed data types.

On 25/06/16 08:04, Ek Esawi wrote: > genfromtxt or (2) looping through each line in the file and split, strip, > and assign data type to each entry. > > I am wondering if there is a better and more efficient alternative, > especially to method 2 without using numpy or pandas. The csv module wil

[Tutor] Most efficient way to read large csv files with properly converted mixed data types.

Hi All-- My work involves reading large csv files with mixed data types (integer, float, string, time and date). I was able to accomplish the task using (1) genfromtxt or (2) looping through each line in the file and split, strip, and assign data type to each entry. I am wondering if there is