Muslims should not have reservation if a non Muslim performs prayer with them, for Non-Muslims were allowed to enter the Mosque during the time of the Prophet (peace and blessings be upon him) for many reasons.
But a non-Muslim should know that for Prayer to be accepted by Allah its performer has to be Muslim and has to fulfill its conditions including ritual purification.