Priest says Foley may accuse him of inappropriate actions