Hi,
I am a golang newbie so please take what I say with a pinch of salt but, did you try accessing the server manually by running the SSH command instead of the script?
Long time ago I had done some scripting in Perl and I was getting a lot of failure errors. Turned out that the SSH connection was not working because SSH was disabled on one server and on another server the username was not created.
Hope this helps.