Trout congregate around what is left of the Martello Castle year-round, but especially in the spring and fall.