Points allowed is not the only measure on how good a defense is. YPG, YPC, YPR, and other stats also factor in. Personally, I would put my money on other defenses like Baltimore, Pittsburgh, and New England. Points against is often a very misleading stat, often merely reflective of the team's competition.