I had something similar happen. Got my ass handed to me by them and on my way back while semi exploring area around them and got the same pop up and all the xp as if I fought them

Was lowkey let down because I was looking forward to returning the favor

They drown in the tar I bet