I have a recessed toilet roll holder in my bathroom. How do I remove it and replace with a regular one?

I would just leave it there and install the other one where you want it. You will always have an extra roll of paper handy!