Help with loose handle

hi there,

I have a loose handle on a a "juliet balcony" door in my apartment. Sorry but not sure if thats the right term for the door - it can pivot horizontally or vertically (along the base). You can view a video of the looseness here...
https://drive.google.com/open?id=0B6b4OEFKzWLnMGFUc3pUQlBwMEU

I was hoping I could take the handle off and tighten it up in someway but I can't work out how to take the handle off. The only screw I can find is on the inside of the handle (its an allen grub screw - see picture) there are no screws inside the frame or outside. I've taken this out but still can't see how to remove the handle. Can anyone suggest how this is taken off?

Cheers for any advice
Alg

 

Ok thanks maybe I just needed to give it a bit more welly after I've taken the screw out.