As @[email protected] pointed out, the origin of the expression is “au Diable Vauvert”, or “at the Vauvert Devil”. I just read about it, and Vauvert is a castle in France, reputed in the Middle Ages to be the home of the Devil, for one reason or another. It just means “somewhere very far away”.