I'm aware of Graeber's work but haven't read it, so I'm sidestepping it and focusing on your comment here. So what is a meaningful contribution to the world? I've thought about that, and narrowed it down as best I can.
I have a simple list for defining meaningful work: 1) work that gives life-providing help to others (e.g., teachers or physical therapists); 2) working on problems of existence (e.g., medical research); 3) make art.
As I've outlined it, most of us are not doing meaningful work, myself included. Certainly, any criteria for meaningful work necessitates a bunch of not-meaningful work for support—"the office staff, product designers, marketers, janitors, factory workers," etc. you mentioned—but that comparatively low number of people actually doing meaningful work suggests (if my criteria are valid) it's a rather high bar.