You should really move your /home to an SSD, too, and only symlink data-intensive stuff to your HDD mount. This will heavily speed up your desktop. In particular browsers (but also many other apps) store their cache there.
You can try it out the other way around as well, of course: symlink your ~/.cache to your SSD mount.
Give it a shot, worth it!