That would definitely be an interesting project. I wonder how many fps one could achieve / if it's doable without graphic card acceleration. The perspective transformation is surprisingly slow (at least with Imagemagick)