Although the answer to this could depend upon the details (what constitutes "causing a scene," for example), the general answer is that such groups do not have this right.
Public authorities may restrict the right to engage in religious worship or other actions such as speech so long as they do so based on content-neutral bases. In other words, authorities cannot ban speech because of what is being said. However, they can regulate speech based on the "time, place, and manner" of the speech. In this case, the time, place and manner of the worship might allow it to be prohibited. If the actions are being done in such a way as to cause excessive problems for public order or private property, they can be banned.
So, if the "scene" that is being caused is judged to be excessive (there is no clear standard for how to determine this) problems, the worship can be prohibited so long as the authorities are not being biased against the religion based on the content of its worship.