Twilight princess help please?

Ok so I'm on twilight princess and I'm at the arbiters grounds (desert temple) and I have defeated the first three poes in the temple but the fourth is through a door I cant get through. Its the room to the right when u get into the main room with the four torches and wen I get into the right room I can't go to the door on the other side even when I lift the chandler in the middle of the room... Help?