Zeinab  Al-`Alawani, Instructor of Fiqh and Islamic Studies, Graduate School of Islamic and Social Sciences, states the following: “Jealousy, when exceeding the acceptable boundaries, turns out to be harmful. Every spouse has to be reminded of the consequences of accusing someone without proof, and especially accusing a chaste, pure woman of her chastity. Allah says in the Qur’an: “Those who slander chaste women, indiscreet but believing, are cursed in this life and in the Hereafter: for them is a grievous Penalty.” (An-Noor: 23)
The one on the receiving end needs to exercise a high level of patience and courage to handle the situation.  They should continue to be loyal, loving and caring. Do not exchange offences or insults.
You should look for someone, preferably a sheikh or a committed Muslim, that you know your spouse may be influenced by him. You may ask him to intervene to resolve your conflicts. You need to be open with your spouse and make him feel that is a serious issue that needs to be resolved.