I would check the fan on the front of the engine that it isn't coming in contact with a shroud. Also since you added a driveshaft from the crank forward i would make sure it isn't loose in it's mounting or something.
Jack up the back both tires off of the ground. Start machine and put in high gear let idle. Confirm the hst speed lever is in the correct position. If the wheels are spinning even just little adjust the sevo centering screw until the wheels just begin to spin the opposite direction and then...
On the x1100c the oil cooler sits in front of the fan so no water. And the gearbox is independent and is its own reservoir. Do you use a power washer on your machine? There are vents on both the gearcase and the hst tank and the hst itself. They could be cracked or torn
If the swash plate is in neutral position or there is no hydraulic pressure or flow from the rotating valve assembly then no the hydraulic motor will not spin and the shaft in the transmission will be stopped.
Confirm that your primary pump is primed and has flow? If it has flow then you probably need to look at the relief valves. Check your hst poppet to make sure it isn't stuck open.
Sounds like you understand pretty good.
The servo piston is just a two sided hydraulic piston that moves the swash plate with hydraulic power so that you don't have to use foot force on the peddle. When you center the servo piston all you are doing is centering the swash. Sounds like your servo...
Just for clarity yours is the old model rtv 1100c and is a completely different animal from the rtvx 1100c.
Try putting your machine in neutral engine off on concrete or hard level surfaces and push it by hand. It should roll fairly easy... if it doesn't then you most likely have a brake...
Just to clarify?? Your rtv stopped moving or at least was showing some transmission issues? The oil level in the hst was low so you disassembled everything?
No problem and good luck. Hopefully all you need is the valve plates but if the metal came from the hydrostatic and was magnetic and shiny i would think your valve pistons or possibly a bearing is bad. Look at Kiwi thread i posted to you ? He rebuilt successfully with mix and match parts and...