Choosing not to federate with a server is not "going closed source".
Would you federate with a spamming server, for example?
No?
Then you're choosing to block people based on their behaviour.
Software freedom means freedom to use software the way you see fit. That includes blocking people from accessing your server, as you see fit.
If you don't like the way a server is run, you are free to go to another one or set up your own.