There is no data on fitness without Apple Watch for the time being.
The reason for taking it off can be solved by Dai Lai. Because Apple Watch usually needs to be worn on your wrist to accurately monitor and record fitness data, if the watch is removed or inactive, it cannot accurately track your activities and fitness data, so there is no data in fitness when you don't use Apple Watch for the time being.