> I've seen submissions get 3 upvotes in the first minute and never another upvote.

Is that people looking at the new page and seeing/upvoting your post and then it falls off the front.