Scam callers use IRS titles and fake badge numbers to appear legit. They may use online resources to get your name, address and other details about your life to make the call sound official.