Hi , I hope you are well. I wish to ask how I can resolve this error:
"CSV conversion error to int64: invalid value" To give an idea of my dataset. I have 4 csvs all placed in a local folder. The code below worked when importing: arrow<-open_dataset( sources="csv location", format="csv") However, when I run: arrow %>% count(column) %>% collect() nrow(arrow %>% collect) head(arrow %>% collect(),10 ) I always get the same error message: "Invalid: In CSV column #12: Row #580. CSV conversion error to int64: invalid value" I tried going back to open_dataset(,schema() ). Where the column that is giving me problems is set as utf8 or sometimes str in the schema argument. schema( col=utf8(), other nth columns ) But I still encounter the same problem. Using this code below fail to work either. arrow2<-arrow_table(arrow) Thanks in advance if you can help me. -- Regards, Angelo Casalan Statistical Methodology Unit
