How to read large data files?

How to read large data files?

I have a data file of 550MB. There are 60000 rows and 35 columns. Every time I read datasets it takes more time.

Are there any ways to read data from databases or anything like that.

Please help me with step-to-step for the problem.

After you read this data once, (I assume its a text based format...) save it out in a more efficient binary format. and subsequently read that data in future sessions putting the text original aside.
I find the fst package very good for this workflow.

Try vroom or fread.

https://www.rdocumentation.org/packages/data.table/versions/1.13.0/topics/fread

@nirgrahamuk Thanks.

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.

If you have a query related to it or one of the replies, start a new topic and refer back with a link.