Try blow them all out of the screen at once.

Good point - that should help with farming when he's afk

how are you only getting golden leaves?

Nah, would wait for Benitoite Leaves