I was blocked for a long while trying to troubleshoot. I finally decided to try a password without special characters. Everything was smooth sailing.
Posting for that future person who’s struggling with SSH for the same reason. Would be good to through in the docs.