Duplicate value removal

[Thandohlove]

Hi Everyone,

I would like to remove duplicate values from a dataset. I do not want to delete entire rows though, I would like to remove the value and leave it blank.

Below is an example of the data frame I am using.
A01 A02 A03 A032 A01_CD A02_CD A03_CD A032_CD
1 4.9 NA NA NA 4.9 NA NA NA
2 4.9 NA NA NA NA NA NA NA
5 4.8 NA NA NA NA NA NA NA
9 4.8 NA NA NA 4.8 NA NA NA
16 4.7 NA NA NA 4.8 NA NA NA
18 4.7 NA NA NA NA NA NA NA
31 5.0 NA NA NA NA NA NA NA

This is the outcome I would like to achieve.
A01 A02 A03 A032 A01_CD A02_CD A03_CD A032_CD
1 4.9 NA NA NA NA NA NA NA
2 4.9 NA NA NA NA NA NA NA
5 4.8 NA NA NA NA NA NA NA
9 4.8 NA NA NA NA NA NA NA
16 4.7 NA NA NA 4.8 NA NA NA
18 4.7 NA NA NA NA NA NA NA
31 5.0 NA NA NA NA NA NA NA

I have been using: No_Duplicates = dataset11 %>% distinct(A01, A02, A03, A032, A01_CD, A02_CD, A03_CD, A032_CD, .keep_all = TRUE)
But this deletes entire rows and I do not want that.

[nirgrahamuk]

Is this different from your previous post ?

Duplicate Value Check

Hello, I am new to R and I am trying to pick-up Lake Water level duplicate values from the data below, but the response returned from running :duplicate() is all false. This is not correct because i can see some of the data frame. Date A01 A02 A03 A032 A01_CD A02_CD A03_CD A032_CD 1 1966/05/07 4.9 NA NA NA 4.9 NA NA NA 2 1966/05/08 4.9 NA NA NA NA NA NA NA 3 1966/05/09 4.9 NA NA NA 4.9 NA NA NA 4 1966/05/10 4.9 NA NA NA NA NA NA NA 5 1966/05/11 4.8 NA NA NA NA NA NA NA 6 1966/05/12 4.9 NA NA NA NA NA NA NA 7 1966/05/13 4.8 NA NA NA N…

[Thandohlove]

My newest question/topic is much clear on what I want to do.

[nirgrahamuk]

why is the 4.9 in the first row eliminated from your desired output ? as the first row of the data for that variable it has not been encountered....also you are deleting the first 4.8 and keeping the second one...

[Thandohlove]

There were two 4.9, so I removed it as it was a duplicate.

[nirgrahamuk]

oh........... thanks for the tip
My original solution works, just a case of transposing before applying and then transposing back after.
full reprex.

example_df <- function(intext) {
  tf <- tempfile()
  writeLines(intext, con = tf)
  require(tidyverse)
  as_tibble(read.delim(tf,sep=" "))
}
(df1 <- example_df("A01 A02 A03 A032 A01_CD A02_CD A03_CD A032_CD
1 4.9 NA NA NA 4.9 NA NA NA
2 4.9 NA NA NA NA NA NA NA
5 4.8 NA NA NA NA NA NA NA
9 4.8 NA NA NA 4.8 NA NA NA
16 4.7 NA NA NA 4.8 NA NA NA
18 4.7 NA NA NA NA NA NA NA
31 5.0 NA NA NA NA NA NA NA"))

(desired <- example_df("A01 A02 A03 A032 A01_CD A02_CD A03_CD A032_CD
1 4.9 NA NA NA NA NA NA NA
2 4.9 NA NA NA NA NA NA NA
5 4.8 NA NA NA NA NA NA NA
9 4.8 NA NA NA NA NA NA NA
16 4.7 NA NA NA 4.8 NA NA NA
18 4.7 NA NA NA NA NA NA NA
31 5.0 NA NA NA NA NA NA NA"))


cleanvecofdups <- function(vec){
  df <- enframe(vec,name=NULL,value="v") %>% 
    group_by_all() %>% 
    mutate(rn = row_number()) 
  
  df$v2 = ifelse(df$rn==1,df$v,NA)
  
}
altered <- purrr::map_dfc(t(df1) %>% as_tibble() ,
                          cleanvecofdups) %>% t() %>% as_tibble %>% setNames(names(df1))

[Thandohlove]

I am new to R. I am not familiar with alot...So, may you please inform or explain the above code for me.

Thank you