Pakistan, Saudi Arabia and other countries reject settler incursions, demand protection of holy site’s status.