Spectator area of Arena in Tor

How do I get into the spectator area of the arena in Tor? I have walked to the left after the guard says fighters only and cannot find a way to get to where the hooded guy below.

Follow the Yellow banners, you climb up a ladder to the left of the "desk" for the tournament cave and as soon as you are up the ladder, go up and around the corner for a money bag, turn around (can't go further anyway) and go back then go past the rope ladder you came up to and exit in the wall.