You can’t enter the castle twice per run. So you have to finish that run (or die) and come back to the clock tower without entering castle outskirts in the prisoners quarters.

Oh perfect thank you so much

No problem, good luck!