Live sand on Live rock

OK this maybe silly but. I have some big pieces of live rock in my tank. My issue is some of my live sand is on them and it's up high not towards bottom. It is driving me nuts lol is there something I can do to help remove it like maybe a toothbrush? Also I'm in a diatom stage of my tank