Generally speaking, the water temperature is lower than the body temperature, and a lot of body heat is lost in the water through conduction, so the body temperature will drop quickly, so it will feel cold.

If you are outdoors, when it is windy, the evaporation of water on your body will also take away a lot of heat energy, so sometimes you will feel colder when you come out of the water than when you are in the water.