That's how I was rolling until I got a new (to me!) car to replace a very old banger. It has phone connectivity and it's great, but it basically requires voice control, which works quite well. This meant I had to re enable the Google app.

I want the feature, I just want to be in control of when and how that feature is used, not have it pushed hard in my face repeatedly.