If you've installed CENTOS 6.4 minimal like I have, you might experience this problem. When you try to scp a file from one server to the next or vice versa and encounter this issue, you need to install the openssh-clients package.
To do this, run the following command
yum install openssh-clients
After the install, try to scp the file back and you'll see that it should work now