To look at sea life in shallow water,

look over the side of your boat with a water glass.

A water glass is just a wooden box with a glass bottom.

The glass gives you a window to see through.

the sides of the box cut out the reflections from sky.