At the end of Rosemary Lane is Castle Street. Turn left to head to the centre of the city, and right out of town to the see the Norman Castle.
Continuing on takes you into Castle Row and onto the city walls.