The basic reason for keeping the Ka`bah on one’s left when performing Tawaf (circumambulation) is to follow the example of the Prophet (peace and blessings be upon him).
In this regard, Sheikh M. S. Al-Munajjid, a prominent Saudi Muslim lecturer and author states:
“The basic reason for keeping the Ka`bah on one’s left when performing Tawaf (circumambulation) is to follow the example of the Prophet (peace and blessings be upon him). Following the Prophet has been ordained in the Qur’an. Allah says, “Obey the Prophet so that you may be blessed with mercy.” (An-Nur: 56) We also read in the Qur’an, “Say (O Muhammad): if you really love Allah, then follow my example and Allah will love you and grant you forgiveness of your sins.” (Al-`Imran: 31)
Regarding the rituals of Hajj and `Umrah, the Prophet (peace and blessing be upon him) said, “Follow my example in performing your rituals” (Al-Bukhari and An-Nasa’i).
This should suffice as the reason for a Muslim performing Tawaf around the Ka`bah in the way it is prescribed. Muslims by nature must believe, submit to and act according to what was authentically and duly recorded as the behavior or statements of the Prophet. If on top of this a reason or some relevant wisdom comes to light, then so be it, and all thanks is due to Allah. Otherwise, a Muslim submits to the order of Allah and His Prophet and, will accordingly, be recompensed for his obedience and good deeds.
Finally, we must note that circumambulation is an act specified only for the Ka`bah as part of worship and is not to be done in any other place or situation.”