A couple questions up front...what macro lens is being used and what stacking software?
Your first image is quite good but I would question the need, considering your set-up, for the number of images needing for stacking, as opposed to just increasing your depth of field.
The second image has some stacking artifacts as indicated by the muddy areas on the red stigma things.
Returning to an original, non-muddy stigma image and blending it into the final stacked image would fix it.
I try to use a longer DOF to lessen the number of images to be stacked, which helps with artifacts, then taking one more image for a desired background blur. Tis a simple matter to blend the stacked final image and the blur image using a mask and brushing in the desired blurry parts, as I did here
Just the sexy stuff
That clamp that you're using to hold the flower, I've got one that I rarely use...it is prone to vibration for any reason at all, even from the furnace kicking on.