Even when they turned him back, he started moving towards the mountains again