Yes rajm is a part of our fundamentals. Several scholars have cited ijma on it. Anwar Shah Kashmiri sees it as a basis to declare the khawarij as unbelievers because of their denial of rajm. So yes, the person who denies the punishment of rajm is a kafir who deserves to be put to death in an Islamic state.