Be Careful of What You Know