If you don't know what column to tell readr to skip, I think you need to read all then select only the non empty column afterward. readr would have to do that if it was possible to tell it to skip.
If you have a lot of column to skip, you can read everything as character (without parsing), filter out the empty colum, then parse the resulting table (see readr::type_convert())