The man had been out walking on the rocks at Balcary Bay, Auchencairn, about eight miles west of Dalbeattie when his dog slipped and fell.
It ended up in the water injured and the man made an attempt to rescue it.
Emergency services were alerted and two lifeboats and the Kirkcudbright Coast Rescue team were called out.
The Kippford Inshore Lifeboat which was joined by Kirkcudbright Lifeboat and managed to locate the man and bring him and his injured dog ashore at the jetty at Balcary Tower.
He was not injured and the dog was taken away to to be examined by a veterinary surgeon.