back
65 comments
The money shot: "The distinction between manipulation and non-manipulative influence depends on whether the influencer is trying to get someone to make some sort of mistake in what he thinks, feels, doubts or pays attention to."

I have stricter criteria, personally. If I am to persuade someone then according to my moral compass I have to respect their epistemic process, and participate in it in a way they would endorse. This is much harder to do than just being sincere and believing you're right / not trying to cause a mistake.

I like your standard, but it is much harder to do; I've been finding it difficult to do even when I am aware that we have diverging epistemic processes... it's hard to tell the difference between thinking someone is misguided/dumb/evil and thinking that they just have a different idea about how to do things in this world.

Pragmatics aside (it's much easier to rhetorically persuade someone if you understand their motives and rationale), there are situations in the world where we have real disagreements about what right action looks like:

I can't support all the various epistemic situations I see in a moral sense even if I can appreciate how it's more effective.

For instance, I can understand arguing that some jackbooted thug shouldn't summarily execute a person and arguing from that thug's position ("don't kill them because you'll have to do paperwork" or some such thing), but intuitively I don't feel like I have an obligation to respect that person's process and thoughts.

In that case, it seems okay to be "manipulative" in the sense of your quote.

But maybe not... Intuitively, I think that there has to be a good reason for this goal, and I feel like it is a goal I work towards (and yeesh, it takes a lot of real work on all parts of my identity and awareness), but I also feel like there are boundaries for that goal.

Is there a larger ethical take away or underwriting rationale in your moral compass for why we should "respect others' episteme"?

Depends on what your ethical framing is. You sound pretty utilitarian, so I think your takeaway is that respecting someone else's thought processes is more likely to deliver the results you want more reliably.

My advice is to never assume that someone is actively evil. People almost never think of themselves as evil. Instead, they have values to which they are attached and habits of thoughts to which they are accustomed.

You're more likely to achieve genuine understanding of another's mental processes - or empathy, as it's often called - if you start from a place of being willing to respect them. This understanding generally gives you a better appreciation of how to persuade them in a manner that will leave them with a positive impression of you afterwards.

I've used the definition that persuasion is when you try to change a person's mind whatever the reason, even lying to get a change of mind.

Justification is when you change a persons mind by giving a reason for why they ought to believe what you're telling them. A listener can analyze the reasons you gave and see if they accept the assumptions and conclusion, or in other words, is your justification sound?

Manipulators often persuade, but would be happy with a justification too. Ultimately they want to change your mind. Someone who is giving a justification tend to be more open to seeing a fault in their own logic or justification.

I "suffer" the same character "flaw," which has routinely limited my ability to affect change within the companies for which I've worked. I can't count the number of times that my suggestion to use a better technical choice has been overruled by people with a personal agenda that had nothing to do with technology.

Additionally, I've had to work closely with a couple of genuine sociopaths, who have mislead powerful people to benefit personally, while putting the (very large) company in an objectively worse place, and at a competitive disadvantage.

Would you be willing to compromise your position with an individual, or limited set of people, to achieve a large, positive organizational change?

This gets complicated. At risk of putting something that could be misquoted, I am generally willing to play the game that people force me to play.

I want to play the "everyone gets along and supports each others' goals by being respectful of each others' dignity and agency" game, but if someone wants to try to mug me for my wallet, then I'm going to defend myself with force.

Similarly, if someone's epistemic process is "whatever I think works best for me, fuck everyone else" then I'll try to cause them to think that what I want happens to be what's best for them through whatever means happen to work. But it's tricky because maybe they have strong internal epistemics, while perpetrating manipulation on everyone else, and therefore I'm actually equivocating and doing a golden rule thing where I'm not respecting their actual epistemic process, but rather the epistemic process they are trying to enforce on others.

In the case of people acting in good faith, there's little or no difference. In the case of a bad actor, there may be a huge difference.

When I posted I was imaging the "good faith" scenario. Maybe the switch to "I respect the epistemics that people try to enforce on others" is fine, but it's not exactly how I put it in the post you're replying to.

In practicality, just given the tiny summary you provided, my move would be to cause those powerful people to correctly see what was true or false according to their epistemics, ie. I'd try to counteract the manipulation. And if I were dealing with a bad actor I'd try to do it in a way that didn't position me as their enemy, but rather make it seem to them like they just failed to mislead the powerful person the way they had hoped.

A few others have summarized via quote, but I think this one is the most effective:

"For it is the intention to degrade another person’s decision-making situation that is both the essence and the essential immorality of manipulation."

A cult leader may not be thinking that they're getting you to make a mistake, because they're only thinking of themselves. But they are trying to degrade your decision-making.

Conversely, persuasion could be considered an attempt to empower your decision making: with new information, new perspectives, lights in blindspots, education on fallacies, etc.

Doesn't feel quite right, but closer.

Trying to determine which one you are doing is hard problem, because, relying on incomplete information. I believe it's best to be internally positive about your own decision making, and let what is not you take over when it does. Sometimes other people know best, sometimes you do. Not everything is as easy to understand as a computer program, math proof, circuit board - anything logical, mechanical in nature, easy to understand, easy to identify gaps in understanding - because, it's a mechanical object. Those things lack consciousness. Being a rational being means having awareness for the difference (at least to me).

Selectivity in who to listen to, depends on trust, which is a hard problem, life can sometimes really beat up on any of us. I don't think it's a good thing to choose to interact with people you have to constantly decide between two binaries - manipulator or guide. That is the business world though, sometimes, unfortunately. Some people can seem like they are just out to get you, but that doesn't make it true.

Tolerance is important, but, emotions sometimes, seem mechanical in nature. At least how I understand my own, internally. Feels like being computer. Socializing in general always seems to be a hard problem. Even harder when there's a bottom line.

Hmm, I dunno. Seems like this is duck-type'able.

If you are seeking to degrade someone's decision making, you're manipulating.

If you are feeling like your decisions process is being degraded, you're being manipulated.

For the first case, it doesn't mean that you're succeeding. For the second case, that doesn't mean it's their intention.

I'd then also say you can duck-type the opposite (which I wouldn't really call persuasion, but anyway) - if you seek to empower someone's decision making, well, then there's no reason to beat yourself up over which you're doing. (If someone says you're being manipulative tho, take it as a bug report - but again, since your intentions are solid, no reason to beat yourself up over it).

This is a good quote. One similar way to state it is by using the System 1 / System 2 [1] terminology. Manipulation is when someone pushes the audience to System 1 reasoning, diverting them from using System 2.

It's not a perfect distinction (there probably are cases where appealing to System 2 might look a lot like manipulation), but it's succinct, ends-neutral and not too subjective to be useful in practice.

[1] https://en.wikipedia.org/wiki/Dual_process_theory#Dual-proce...

This is only true if you assume that System 2 is always better. But if someone has rationalized great cruelty, it is perfectly appropriate to appeal to their emotions if it will get them to stop (this is essentially equivalent to a point the author of the original piece makes).
Good point! I'd adjust it a bit tho - I'd say that that's one way to manipulate, but not all of them. In my [uneducated on this topic] opinion.
When I like it, it's called "influence". When I don't like it, it's called "manipulation". At least, this seems to be the way it's commonly used.
I disagree those are strictly the same thing.

I have a coworker, who largely does not listen to any argument I make; from my point of view, this is because I am younger, and he perceives me as less experienced because of my age. However, other coworkers are able to deliver the same argument to him, and have him listen to that argument. In that regard, they have influence over him, whereas I do not. Yet, nobody is attempting to manipulate anybody (in the sense of lie to, or attempting to get someone to hold a belief that the manipulator does not themselves hold or knows to be unsound).

Sounds like it still fits to me.

From his point of view, you aren't a credible source, so he thinks you are trying to manipulate him (he doesn't like it). But he respects the other coworkers so they can influence him (he likes it). It's not just about the message, there are a lot of factors in play.

*Not saying I agree with the parent's definitions. Just that they could still fit your experience

"Propaganda" is another descriptor along those lines. Neither tells you anything about the content other than the value judgment belonging to the person making the statement.
There's a pretty clear definition:

"information, especially of a biased or misleading nature, used to promote or publicize a particular political cause or point of view."

Leaving aside the issue of bias, I think we can agree that if a particular piece of information, designed to mislead the public, is widely disseminated, that is propaganda. Widely disseminating facts, or privately disseminating misleading information is not propaganda.

I call it "manipulation" when someone is trying to get me to believe something contrary to factual evidence.
Or, if it's from someone I don't like anyways or want others to dislike/disregard: manipulative.
It can be very hard to distinguish these two concepts.

Instead, it is more useful to understand the agenda of the person doing persuasion. Do their interests align with yours? What are they trying to achieve? That's a good way to get insight into whether you're being 'manipulated' to do things that are not in your interest.

Because the agenda of an information source is key, that makes it vitally important to understand who owns and manages the outlets you get information from. In today's world, because of changes in news profitability and thus the number of financially-independent news outlets, knowing the agendas of ownership, management, and funders of news sources is absolutely critical.

It's all semantics. "Persuasion" and "manipulation" are just synonyms except for different emotional valences. Like "judgment" vs "discrimination", "patriotism" vs "jingoism", "principled" vs "idealistic". (This is fun. Got more?)
The article says they're different: that manipulation degrades the other's decision making process while persuasion does not.

You seem to disagree, which is fine. But your argument above to the article's "they're different" amounts to "no they're not". More words, of course, but just a "no".

Why do you dismiss "different emotional valences"? People react differently if they think they're being persuaded vs. manipulated – emotions matter.
I don't dismiss them. Such differences are both persuasive and manipulative. But I repeat myself.
I don't think that's true. Manipulation = influencing the process/behavior directly, persuation = providing a desirable prospect, or the "carrot", and let the protagonist close the gap by herself.
OT: The image paired with the articles is captioned as an ad from 1973, which is which it is clearly not. Editors?
Interesting. This page (scroll down) claims that particular ad appeared in Life Magazine in 1951: http://mentalfloss.com/article/73588/14-vintage-ads-featurin.... I'd guess they were mislead by an updated copyright mark on a reprint. What made you sure the date was wrong?
Reagan was governor of California in 1973 -- unlikely he'd be doing a Chesterfield ad while sitting governor.
I think the difference lays in the purpose of the persuader/manipulator. If it's disinterested, it's persuasion, if it's self interested, it's manipulation. Just like bullshit, which is not exactly synonymous with lying - the difference lays in the purpose. Telling something (true or false) with the sole purpose of attaining a goal that does not align with the other person's interests is bullshit.
> What makes a statement a lie and what makes it morally wrong are the same thing – that the speaker tries to get someone to adopt what the speaker herself regards as a false belief.

This is one perspective. But it introduces a problem that if someone is manipulated, and by continuation they manipulate another (e.g. MLM schemes), only the founder of the MLM is morally guilty, even if everyone who joined was negligent in repeating his lies.

Interestingly, in defamation law we recognize reckless disregard for the truth, not merely actual belief in the falsity of the statement, as a mental state that (along with actual falsity and resulting harm) produces culpability.
They aren't guilty of manipulation, but that doesn't mean they're innocent: They're guilty of not being critical thinkers. In my opinion, it doesn't take their guilt at all.
Even when manipulation is used for the benefit of the listener it still isn't great.

In such a case the manipulator is already convinced they are correct and the target's reasoning is going to be faulty or irrelevant. So in principle I would argue it is always better to present the facts clearly to the listener simply because the speaker may in fact be in error, can never be infallible.

That doesn't take into account that you're responsible for them understanding your message. You can't assume customers understand things to highest level possible, and you don't want to turn them off emotionally by accident.

For instance, say you're trying to promote a password manager, but the average customer is scared of losing their data. You have very little on page real estate that will get attention, so what do you say to the customer?

Do you say the technically detailed truth up front?

- Encrypted by X,Y,Z - Hashed and salted passwords - Even if you use a password manager, if someone gets your master password, they'll have access to all of your sites, so you'll want to also use a token based 2FA too. - Link to more details

Or do you just say:

- Picture of a secure looking badge icon - 10,000 people have downloaded us for secure browsing (even though appealing to who uses it is technically illogical) - Link to details

I can tell you as a fact that more people will download your password manager if you use the second copy, even though it gives much less logical info to the customer. So using the first one will help less people be secure.

And the latter doesn't answer the pressing question the user actually had about backups.

The full design gives maximum information with keynoting and drill down structure. With some helpful information on how to secure it.

People tend to get desensitized by marketing BS and completely close over it, plus it does nothing to stop angry reviews when your application actually causes or does not solve problems.

Much of SV's revenue is built on a foundation of manipulation, tapping into all manner of human weakness, from our all-to-willingness to trade our souls for so-called free stuff to our susceptibility to addiction.

But such criticism will never get traction on Hacker News.

"It is difficult to get a man to understand something, when his salary depends upon his not understanding it!"

~ Upton Sinclair

I recall taking a course in college called "Persuasion" which spent a considerable amount of time examining this exact question.
This is one of those topics that feels like it has so many dimensions that it's impossible to get anywhere in some short essay.
tl;dr: "The distinction between manipulation and non-manipulative influence depends on whether the influencer is trying to get someone to make some sort of mistake in what he thinks, feels, doubts or pays attention to."
To add to the summary: From the article, I would say that the essential quality is one of hypocrisy. Manipulative interventions are not authentic, in the sense that the manipulator does not believe what they are trying to get the victim to believe.
As someone who used to coerce people into doing things that were ultimately good for them, I find that this definition is too close to a moral hazard for my liking.

Let me attempt another.

We have within us a large set of goals. Some of our short term goals are directly at odds with our long term goals.

When we persuade we appeal to a person's long term goals in a way that silences complaints from their competing short term goals.

When we manipulate, we exploit or subvert the short term goals to achieve a result. Whether the manipulation is ethical or not depends on whether the goal we chose supports or undermines the target's long term goals. This is subject to re-evaluation at any time, but it was always a manipulation.

There are professions where we pay people to manipulate us. Therapists, personal trainers, body workers, all are capable of manipulating our lizard brain, tricking it into doing something it really doesn't want to do. Why? To get us something we always wanted (or previously had).

Motivational speakers and coaches try to persuade. They get you so excited about your long term goals that you shout down the disruptive voice in your head that tells you you can't, that you're not good enough, that it's too hard.

Persuasion is about filtering out welter; Manipulation is about deceiving others;
I noticed similar wordplay in coverage of the 2016 election. When Trump or Trump-supporting PACs targeted voters with ads negative on Clinton, it was labeled by the mainstream media as 'voter suppression', whereas when Clinton or Clinton-supporting PACs targeted voters with ads negative on Trump, it was 'getting the message out'
Interesting, I'm surprised to hear that this happened. In my recollection, most of the mentions of "voter suppression" had to do with things like voter registration shenanigans, not so much political ads. And voter registration shenanigans are definitely voter suppression.
How to tell the difference in intent, purely from what is said? Hard.
When you are telling someone how to change his behavior, what to think, you are "educating" him or "opening his eyes". You are also a good person spreading the truth.

But when your opponent in ideology does that, he is "brainwashing", "propaganding" or "taking advantage of innocence/ignorance". He is a bad person spreading lies.

That goes down to base values.

Questioning ones that fundamentally don't align, but you never actually know, because you only see your own side.

You can think you see the other side, but that often is incorrect. Those things are built into us from everything we learn as we grow, from experience.

It's easier to just not consider people opponents, ones you choose to interact with. That's sometimes hard when the world seems screwed up.

or how group of people fighting for against cultural genocide and right to govern themselves under their own values are selectively given the title "independence fighters" or "fucking terrorists" depending on their political alignment with whoever is labelling them.

There is no absolute morals.