@herrabre there is an easy fix for that: #referrerpolicy. Don't know whether Mastodon uses that already, if not you may suggest it. It should be on by default, of course.

https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Referrer-Policy

(also possible via HTML meta tag, BTW)