I agree. Also, I suspect that if a deployed app is rarely accessed, then there is some spin up time to load a slug. Both customers noticed this effect that the first page load usually seemed slow to them. Same thing on AppEngine (a 'loading request' can take a while).
Bottom line is that people dream that their web app will attract millions of users, and they want to plan for outstanding success. While I am sure that Heroku must have customers with large user bases, the sweet spot seems to be for moderately sized web portals that you sometimes need to scale up on demand.