This is almost exactly what I had in mind. The only tweaks would be that the "looming thing" actually extends slightly closer to the town (just stretch the top of the looming thing's circle north a bit) and there aren't many buildings between the northern gate and the bridge.

Other than that, the drawing is pretty much right on.