Exfoliating/Scrubbing- if it ain’t broke don’t fix it?

I am a very low maintenance person. I don’t wash my face unless I’m taking off makeup (so just once a day) and even when I shower I only wash the important bits (feet, crotch, underarms…. my legs exfoliate when I shave I suppose).

Is there any reason other than having skin problems to exfoliate the face or scrub the body? Is it good in the long run for aging or general health?

Thanks!