During the attack at Lallybroch, Brianna was able to rip the mask off one of the men. It was Callahan, and there's no way Outlander focused on him for no reason.