Welcome SonnysYanmar!
I agree with all the responses. The brakes are frozen to the drum surfaces.
You can, without too much trouble, remove the entire cover plate which holds the shoes, springs and linkage. You may have to induce 'shock' by tapping with a hammer while trying to dislodge the assembly...but it will, eventually, break free.
Considering the age of the tractor (and hours), if the frictionable material looks worn, Yanmar engineers wisely designed a 'second chance' adjustment at the pivot. You can turn the pivot 90°'s which will re-arch the shoes and you're good to go for another few decades
!
If the brake drums are rusty, pitted or irregular you can also save hours of labor and not have to pull the axles by
CAREFULLY jacking up, and secure the rear of your Yanmar, start, run and engauge hi gear, hi range (with shoe assembly plates removed). Using a small 'Dremel' (or drill and abrasive paper wrap), lightly 'dress' the spinning I.D. of the drums. They will clean up very quickly...and add years to the brake life of your tractor. Do not attempt to grind away the drum material...just gently clean and polish away the surface.
Let us know if you need an exploded view or parts diagram for your YM186...I think we could dig up something to help you out
.
Mark