The peninsula of Quoddy Foot, due south of Quoddy Head, disagrees with you. They say that being the "closest to Africa while in the mainland US" is their official claim to fame, and you people from away can't take that title from them. So there.
That only seems weird because everyone usually pictures distances between points on Earth as they look on a flat map.
Flattening the globe into a map alters it quite a bit.