Assassins creed brotherhood Romulus lair?

I can't get into the lair at the colosseum it won't let me interact with it unless I'm in the middle of a memory and when I leave the memory to get inside it won't let me in help??????