The prominent Muslim scholar and Da`iyah, Zeinab Mostafa, states: “To say that something is halal and haram should be based on clear evidence from the Qur’an and the Sunnah. I think there is no verse or hadith stating that wearing gold ornaments in the shape of Ka`bah must be removed when going to the bathroom. But it is a matter of preference and extra respect to take it off when using the toilet. It was not the habit of the Prophet’s companions to wear such things in spite of their great love and respect to the Ka`bah.
I just want to assure that wearing these gold ornament by a MAN is haram. So, a Muslim male is forbidden to wear it all the time, and not just when using the toilet.”