Hi,
I'm doing an app with shiny and my input data is large (~million rows and more than 50 columns) when I merge/concatenate all.
In this case, is it better to separate my data in 5 "little" data or keeping it like that ? thanks !
Hi,
I'm doing an app with shiny and my input data is large (~million rows and more than 50 columns) when I merge/concatenate all.
In this case, is it better to separate my data in 5 "little" data or keeping it like that ? thanks !
The easiest way to find out is to try and see what is better.
As an aside, I would look into parquet/arrow/fst/vroom (https://data.nozav.org/post/2019-r-data-frame-benchmark/) file formats when you are working with such large files.
This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.