気がとがめる

to feel guilty; to suffer from a guilty conscience; to feel uneasy; to have qualms about; to have scruples about; to feel regret