理をもって非に落ちる

to lose an argument despite being in the right; to have the right on one's side, yet succumb to another