AmbientGPT: GPT-4 and Local models with full ambient knowledge of your screen

Twitter announcement by author with demo video: https://x.com/siddrrsh/status/1793348338512974302