Visit the Borjomi Kharagauli national park
The largest national park in Georgia (http://www.nationalpark.ge) by going to the administration of the office, which is a bit to the west of Borjomi 23 Meskheti str., and get a free access permission and a map of the area with all the routes and shelters as well. If you want to take a hike in the national park, get enough supplies, water, and some basic sleeping gear with you, as the cabins are very basic. It is also to take a one day hike from Borjomi to Qvabiskhevi or the other way around and then hitchhike or take a local bus or taxi back to Borjomi. It is also possible to take multiple day hikes. That way you get to go to the higher parts up to 2600 meters.