If you want to keep your follower and follow lists private, here's how to do it in Mastodon:
1. Log in through your server's website
2. Click on "Edit Profile"
3. Tick the box marked "Hide Your Social Graph"
4. Click the "Save Changes" button
You will still be able to see your follows and followers when you're logged in, but other people won't.