I’m using duplicity with an sftp destination. I posted my config here a long time ago:
It may be a good starting point.