My first job had a remote team that I was promoted onto. They had a _very_ healthy culture that ensured remote people did not feel like second class citizens. I grew a ton and never once felt like I needed an office to be with my coworkers.
Using the soft skills I developed there, I continued to get new jobs as I grew and each one was an upgrade and also still remote. I never felt like it shorted me. But, without that incredibly solid base from my first gig and knowing how to handle being remote and create a good culture around it was key.
Now I work in-office in New York City and love it, I might go back to remote some day, but the pay increase (cost of living considered, even) was too huge to not go with it considering how much I love this city.