Pack a picnic to have atop Castle Hill. If this isn't your thing, then there are plenty of restaurants in the main part of town.
Slottsfjellsmuseet has limited opening in the winter, and in summer is closed one day a week. Be sure to check the website before you go.
Pack your own lunch. Norway is an expensive country so it's worthwhile to save where you can.