Learning to Take a Stand Without Compromise