I have been through various fitness regimes. I used to run about five miles a day and I did aerobics for a while.
The time you enjoy wasting is not wasted time.