I am using a plyr function ddply() to aggregate records and columns into string.
The input is dataset from SQL server.
The output is a table in shiny app.
If the records ~10,000 the output table takes >5 seconds.
Preprocessing of data involves removing of un-needed columns, changing date format and column names only.
My question in general is that is there any way to speed up this process. Like in SQL SERVER MANAGEMENT STUDIOS query for 10,000,000 records can generate results instantaneously.
Thanks for any advise.