I don't think anyone would argue that would violate freedom of speech, however it would still be illegal as it would violate the civil rights act by discriminating based on religion. Theres more than one right involved in your hypothetical basically.