The man seems very reluctant to follow in this situation. You will need to push him to get him moving each time he stops. Stand a few steps behind him and hit the prompted button. Shove him along for the whole of this course. It is not too hard and just takes a little time.