Buy food from local markets, which are common to almost every town.
Restaurants are expensive. You can eat quite well for about 10EUR at a couple of eateries opposite the library in town. For travellers on a budget, you'll need to observe what the Kanaks do for the best deals.
French food is obviously a speciality, but the range of foods available can be a little limited.