There is not much one is expected to do at Pondicherry. You would understand this better once you get there and understand the pace of life.
You can also do some serious meditation at the Auroville, the Sri Aurobindo Ashram, or going to Bharatanatyam performances that are often organized there by the Auroville Cultural Exchange (http://auroce.org) in the local temples, or at major hotels.
You can also go fishing in a Catamaran or while away your evenings at the Rocky Beach. You can also hire mopeds and go on long drives for the sandy beaches that dot the coast line.
You can also experience staying in a traditional 'Parapachai' house - an affectionate name given by connoisseurs to traditional green colored houses. First class experience.