Is it good practice to remove redundant plugins and themes?

Is it good practice to remove all of the plugins and themes that are redundant? Also, if so, why is it good practise to remove them?

Always remove any code you do not use which is easy to remove, like unused plugins and themes. Too many times even an unused code proved to be a vector through which sites were hacked.