How to manage Big Data in R

Is there any special pacakages available with R to handle Big Data i..e Data greater then the Ram size.

Sparklyr is a great package for such tasks

1 Like

This is another r based solution


But there are other out of memory approaches like using databases

2 Likes

If your data's in a database, here's an article about working with data in databases (including package recommendations): https://db.rstudio.com/

As @Peter_Griffin said, sparklyr is also a great option if want to use spark.

1 Like

handle big data is pretty easy if you understand dplyr already.

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.

If you have a query related to it or one of the replies, start a new topic and refer back with a link.