Born in Bonchurch, Isle of Wight, Hadfield moved to America while in his youth. He was, for a while, a cotton merchant. He was a personal friend of James McGill and documented the commercial fur trade in Canada in the late 18th century.