I second Grumpy92's suggestions. I am not a big fish lover, but I did enjoy Flying Fish (they had some wonderful mild fish choices for me) and Narcoosee's (I usually get a fish and pasta which have been scrumptious every time) and I hear the Cape May Cafe is wonderful.
I also don't love salmon, but I hear the salmon at Artist Point is excellent.
Another couple choices would be: The Coral Reef (very good, but you are looking at an aquarium of fish during dinner, which seem weird to some), California Grill (the place to go for fish before Flying Fish), and YS had a great crabcake for a while.
You can find menus for these on Allears.com if you want to peruse the menu and decide for yourself.