Agree, much easier if you buy a complete door handle than just the barrels...
On the reverse side of the lock there's a pin that holds on the thingy with the ball joint on it (where the plastic rod is attached to.) I think getting that off is the hardest bit as it is made of some sort of aluminium cast and could be a bit fragile (and if the ball joint part breaks off you can't mend it). Also it has to fit tightly onto the end of the barrel: as it roates it has to provide enough lift through the plastic rod to
the latch so that the door can be locked and unlocked. One reason i had to change mine was because it was very worn around that part and no amount of fussing around helped lock it properly.