Holden is a great place! If you go to the jetties, you'll find fish trapped at low tide. I used to go there with a 5 gal bucket and collect fish.
As for the hermits.....wouldn't hurt but I don't know how the game laws are in NC....it may require a license.