We would love to help you but more information is needed.
Errors like the one you experience are typically pointing to errors either within the package installation or in one of the dependencies.
You can take a look in the output of the install.packages() command and find any errors there. Alternatively copy&paste the output here for further analysis.
Typical things that can go wrong are dependencies on operating system software (e.g. HDF5, QT, ....) or other compiler errors.
Installation of clusterExperiment in R 4.1.0 using bioconductor 3.14 worked perfectly fine for me on my test system.