I'm afraid this is completely incorrect and should be ignored:
As for the original question, first ask yourself whether you really need to convert the data from a matrix.
If you do, consider using data.table, which is faster and more memory-efficient. However, I don't know how the speed of the initial conversion compares.