A little down the river is Oshakan Village, where the creator of the Armenian alphabet, Mesrob Mashtots, is buried in the village church.
Just north along the river and highway is Mughni, with an interesting church where alternating colors of stone form black and red bands around the cupola.
Further north is Ohanavan village with Hovhannavank Monastery. This restored monastery is perched atop the cliffs and has a great view of Mt. Ara.
Saghmosavank Monasteryjust east of Artashavan village shares the same great views of the gorge and Mt. Ara. You can hike from one to the other in the gorge. Great architecture, carvings, details.
Much further north is the town of Aparan, whose inhabitants are the butt of jokes which pin them as not the brightest folk. The very ancient, black Kasagh basilica church, just a few meters from the main highway is worth dropping into on your way to Lori Marz.