How to load records into MariaDB with good performance?

shiny shinyapps.io
1

My Shiny app allows a user to upload csv files up to 10-15k records and writes them to a table in a remote instance of MariaDB. During testing, dbWriteTable or dbAppendTable can upload 6000 records to the db in about 1 second, but only if I use ODBC with the MariaDB ODBC connector. If I use RMariaDB, the same upload takes about 10 minutes! Frustratingly, the MariaDB ODBC connector is not available on shinyapps.io, where my app runs. I've also tried the MySQL ODBC connector on shinyapps, but it's just as slow as RMariaDB. Any suggestions?

2

Sorry not to get any responses from the community, but folks over on StackOverflow led me to a solution, explained here, so my inserts are fast now. :+1:

1 Like
3

This topic was automatically closed 54 days after the last reply. New replies are no longer allowed.

If you have a query related to it or one of the replies, start a new topic and refer back with a link.