The new hysteria seems to be the assumption that if you're a conservative or you voted for Mitt Romney and your income taxes were audited, that's the Obama administration harrassing or intimidating you or something. As Nate Silver points out, that's a ridiculous assumption. Which doesn't mean some people won't believe it.
As some of you may be aware, my father worked for the Internal Revenue Service, retiring during the Nixon administration. His last years there, he routinely received orders that seemed to originate with someone in Washington to ignore tax cheating by wealthy, connected Republicans and to go extra-hard on folks who donated to Democratic causes. A lot of this came out and was one of the less-talked-about scandals of the Nixon presidency. It prompted the erection of what we now call a "firewall" between the White House and the I.R.S. and I'm not sure there's been a credible report since of that wall being breached. But as my father used to say, every single person who gets audited wants to believe he or she has been unfairly singled out. So I suppose a lot of folks who oppose Obama will forever believe they were called in because of that and not because they're claiming poodles as dependents and money paid to hookers as a business expense.