Look for a rock in the middle of the wall closest river. I'm told he wonders between wall and river but he simply was not there or he was standing inside rock. At any rate, I started killing skeletons and after ten of them he just showed up. It was at 20 hours in game time so it might be a spawn at night.