How to read large data files?
I have a data file of 550MB. There are 60000 rows and 35 columns. Every time I read datasets it takes more time.
Are there any ways to read data from databases or anything like that.
Please help me with step-to-step for the problem.
After you read this data once, (I assume its a text based format...) save it out in a more efficient binary format. and subsequently read that data in future sessions putting the text original aside.
I find the fst package very good for this workflow.
Try vroom or fread.
This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.
If you have a query related to it or one of the replies, start a new topic and refer back with a link.