The mods around here seem pretty much invisible unless someone goes full reerun. That's a good thing.
I say do whatever you want man. I voted for you to stay, but really just do what you want. I never wanted to be a moderator of any internet forum, because it always seemed to be that it would be like teaching a poorly behaved class of 6 year olds. I think I would hate it.
