https://www.cmgresearch.com/2009/08/14/How-does-it-all-work....
My approach was to adaptive threshold the image and then assume that that the object of interest was the biggest connected region in the image. Then run that though rectangle detection.
Have you tried setting the aspect ratio and minimum width on the Vision rectangle detector? That might filter out any nonsense.