> patrol boat dropping some depth charges on a time delay in the middle of the night
That's also an option, but you would have problems with precision and deniability*.
You could use some WW2 style device and blame it on German mines that are still present.