Alcohol is available in a few locations in Cox's Bazar. The following hotels have bars which generally open from 7pm: Seagull Hotel, Hotel Sayeman, Hotel Shaibal, Renaissance Hotel. Don't expect much as their ambience leaves much to be desired and there is no guarantee the beer will be cold. Prices are higher than you might expect.
