That means memory.limit() is a system specific command and can't be used on Linux (I didn't know that before).
Anyways, as I told you before, there is no memory limit for the R process, most probably your problem has to do with the size of your file in-memory (not on disk where is compressed).