As befits a poem talking about "disorder," the rhyme scheme used is a mixture of perfect rhymes and open phrases that have no rhyme at all.
Some of the challenge of decoding the rhyme scheme lies in recognizing that some words may be pronounced differently than they were when Herrick wrote the poem. This could have added rhymes to some of the lines that don't appear to rhyme when given a reading in modern English. However, the overall impression suggests that there would not be any difference in the combinations of rhyming and non-rhyming phrases.
Therefore, the rhyme pattern involves the first two lines rhyming with each other ("dress...wantonness"), and the next two lines having no rhyme. The fifth and sixth lines rhyme with each other ("there...stomacher"), the seventh and eighth lines have no rhyme. Lines nine and ten again rhyme with each other ("note...petticoat"), while the eleventh and twelfth lines do not. The final two lines of the poem finish the pattern, rhyming with each other ("art...part").