角を矯めて牛を殺す

to throw the baby out with the bath water; to strain at a gnat and swallow a camel; to obsess over insignificant details and miss the larger point; to straighten the horns and kill the cow