Just make sure to unplug the fridge first. Some refrigerators power their water dispensers via an electronic control board.