Is Product Popularity Random?

In Why Publishing is Making You Crazy—and What You Can Do About It: The Tao of Publishing, Steven Axelrod and Julie Anne Long write an interesting post that takes some findings made by Duncan Watts and attempts to explain why writers should only focus on the quality of their work because they cannot reliably affect popularity in any other way.

I agree with them that social-influence seems like a good explanation for the sometimes unexplicable successes we see in publishing and the difficulty publishers have in both predicting and producing a steady stream of hits. However, I do not find support for their main conclusion that writers can do nothing but write.  In fact, I suggest that Watts’ findings show quite the opposite.

Axelrod and Long base much of their argument on an experiment conducted by Duncan Watts that tested the power of social-influence on music selection in some controlled music websites. Watts summarizes his findings in the excellent Is Justin Timberlake a Product of Cumulative Advantage?.

In his part of the post, Axelrod points out that the Watts findings indicate “50% of the factors affecting your career could be totally outside of your control—totally random” and that “unless we can separate out those random factors which contributed to an author’s past success [and we can’t, Axelrod suggests], anything we can say or predict about why she succeeded will invariably be way off-the-mark.” And therefore “what’s interesting—and chilling, as well—is that there’s evidence that the harder a person works to make sense of a random event, the farther they’ll end up from the truth.”

In other words, the only thing an author can reliably do to improve the popularity of his stories is focus on their instrinsic quality. And get more stories out so he has more shots in the fickle social-influence game.

I agree that having more product in the market increases your odds. I also agree that focusing on the intrinsic quality of the writing can do the same. I even agree that this is where authors should spend most of their time. However, Watts’ studies do not indicate other efforts are wasted. In fact, they suggest the opposite.

Watts does not controvert anything we now know about marketing. What he does is clarify the power of social-influence in our decision making and the dynamics of ONE type of endorsement system. What Watts shows is:

  1. A perceived non-bias endorsement of your product can have a huge effect in the product’s popularity.
  2. The intrinsic quality of the product has an effect on popularity, but social-influence plays as large or larger role.
  3. Popularity in the system set up in the test websites depended on the decisions of a few early-arriving potential endorsers, i.e. good early reviews (downloads in this case) are amplified and lead to an effect he calls “the richer getting richer.”
  4. In this one endorsement system, neither a future endorsement nor the identity of the early endorser can be predicted.

These findings, however, need to be put in context. From cars, to camcorders, to recipes, the popularity of a product depends on three main factors. These aren’t new ideas and publishing is no different than any other industry. The factors come from long-standing marketing practice:

  1. Visibility (people know about it)
  2. Endorsement (recommendation from an attractive person, trusted authority or friend, or trusted system like the perceived unbiased reviews on Amazon or “most downloads” stats)
  3. Attractiveness (intrinsic to the product, the perceived value offered the target market, and the social effect as pointed out by Watts)

Each of these three affects the other two. Visibility makes endorsements and initial attractiveness possible. Endorsements make a product more attractive and more likely to be visible. Attractiveness makes something more visible and more likely to be endorsed. And round and round we go.

It’s true that Watts shows 50% of the effect is due to endorsement. But nowhere does Watts suggest an author cannot increase the probability of visibility and endorsement.

In the study, the endorsement method used was a counter showing the number of times the song had been downloaded. It was random, anonymous, and perceived as unbiased. That was a controlled environment. However, what if a singer had been able to ask all those he knew who loved his song to download it from the site? Or what if someone organized such a campaign independent of the singer? Both actions would immediately affect the probability of the song increasing in visiblity and endorsement and, hence, popularity.

It’s too bad Watts didn’t test this in one of his sites to see if he could make a winner. As it was, all Watts was doing was seeing if he could predict a success by quality alone. He was passively observing, not actively taking measures to increase visibility and endorsement.

Furthermore, the counter is just one type of endorsement system. There are a number of others. We’ve all seen how an Oprah endorsement can move the market. The identity of that endorser is NOT random and has great predictive value. Her decision to endorse is still random. But what if you have a way to make your book visible to her? Would it be a waste of time to do so?

Robert Sawyer loves to tell of one action he took with someone with much less endorsement power than Oprah and the effect it had on his sales. Was Sawyer guaranteed visibility and endorsement from that action? No. However, he DID increase the probability, and it resulted in sales. Here’s his account.

Watts confirms that endorsements have a mighty effect on popularity. Even something as simple as a “most downloads” counter can easily overwhelm a listener’s own reactions. But the logical conclusion is not to do nothing. The logical conclusion is that if authors want to increase their popularity, they must not rely only on the intrinsic value of their product, but they must also search for ways to increase visibility and endorsement.

Axelrod is correct that it’s sometimes difficult to see the effect of any given marketing campaign or tactic. This is because marketing efforts are probabilistic, not deterministic. However, probabilistic does not mean random. Furthermore, it does not indicate you cannot increase the probability of success. While publishers may not be able to produce best sellers every time, I’m confident if they decided to stop marketing altogether, sales would drop.

Will all efforts succeed? No. Any marketing progam needs to consider the effect of diminishing returns. The effectiveness of some actions may be difficult to test. Furthermore, authors may not have the budget to run a campaign large enough to increase their probabilities, although there are strategies to become a big fish in a small pond (see Geoffery Moore’s Crossing the Chasm).

Despite all these issues, we know, in general, getting endorsements helps. In general, the right placement in book stores increases visibility. Author visits to schools, if done right for middle age readers, can also increase visibility. Radio interviews, if done right, do the same. There are many things that DO improve an author’s odds. We can increase the probability of visibility and endorsement by taking intelligence, consistent action.

And that’s good news. We might not be able to guarantee a hit, but one thing IS certain—we’ll have no direct influence on visibility and endorsement if we do nothing.

(BTW, for those interested, here’s a great presentation on a related idea:Six Degrees: The Science of the Connected Age a presentation by Duncan J. Watts.)

Hornswoggle & Happiness

Since we now know that happiness is contagious and that a happy friend is worth $20,000, I figured I’d provide a practical means of infecting you with some mild levels of joy so you could increase your value. Hey, who needs stinking bionics to become the million-dollar man?

Have you ever noticed that using some words elevates your mood?

No?

Trust me. Words do have power. And I am sure researchers could prove that if you used a certain number of words like “schlub,” “smithereens,” and “diddly” each day, you could raise your happiness level by some statistically significant amount.  And even if they couldn’t demonstrate this, that would only prove that some scientists are made of styrofoam. But we knew that already. The point is that there are some words that are so delicious, goofy, or beautiful they must be preserved at all costs. If only for their happy-making ability. And in that light, I present to you “hornswoggle.”

(HORN-swog-uhl)
MEANING: verb tr.: To cheat, hoax, or deceive someone.

Hornswoggle.

USAGE: “Now, however, some special interests are out to hornswoggle residents, and they’re stooping low to do it.” Lauren Ritchie; But Doctor, Your Name is on the Mailer; The Orlando Sentinel (Florida); Oct 4, 2006.

Aaaah, I’m feeling better already.

You can use this too. See: “Son, don’t try to hornswoggle me,” “That dude’s a hornswoggler,” “Joe’s auto-body is a hornswoggling den of mechanical iniquity.”

Now add to that skedaddle, discombobulate, and flummadiddle. (If you want definitions, just visit this list from wordsmith.org.)

Take them home with you. Use them. Spread the happiness around.

A happy friend is worth about $20,000

This is based on research, folks.

But we didn’t need scientists to tell us this. The old Frank Kapra films like IT’S A WONDERFUL LIFE that have been demonstrating this for years.  I think we need a new government measurement. We’d call it the GDH, the gross domestic happiness index. And then we can see who really is rich, e.g. my five bunko buddies cancel out your Lexus any day.

Joking aside, this shows how much social interaction is built into our genes. And why we tend to tire of congenital whiners, complainers, and sadsacks. Not to say that people who are sad shouldn’t be. But that a happy friend or family member, who listens with kindness, can be a great boon to someone who is suffering.

People with the most social connections — friends, spouses, neighbors, relatives — were also the happiest, the data showed. “Each additional happy person makes you happier,” Christakis said.

“Imagine that I am connected to you and you are connected to others and others are connected to still others. It is this fabric of humanity, like an American patch quilt.”

Each person sits on a different-colored patch. “Imagine that these patches are happy and unhappy patches. Your happiness depends on what is going on in the patch around you,” Christakis said.

“It is not just happy people connecting with happy people, which they do. Above and beyond, there is this contagious process going on.”

And happiness is more contagious than unhappiness, they discovered.

“If a social contact is happy, it increases the likelihood that you are happy by 15 percent,” Fowler said. “A friend of a friend, or the friend of a spouse or a sibling, if they are happy, increases your chances by 10 percent,” he added.

A happy third-degree friend — the friend or a friend of a friend — increases a person’s chances of being happy by 6 percent.

“But every extra unhappy friend increases the likelihood that you’ll be unhappy by 7 percent,” Fowler said.

The finding is interesting but it is useful, too Fowler said.

“Among other benefits, happiness has been shown to have an important effect on reduced mortality, pain reduction, and improved cardiac function. So better understanding of how happiness spreads can help us learn how to promote a healthier society,” he said.

The study also fits in with other data that suggested — in 1984 — that having $5,000 extra increased a person’s chances of becoming happier by about 2 percent.

“A happy friend is worth about $20,000,” Christakis said.

Here’s the full article.

NPR’s Intelligence Squared

Sometimes I love NPR, and sometimes those folks drive me nuts. But with Intelligence Squared they’ve come up with wonderful programming. I accidentally tuned in one night and found I couldn’t turn the radio off.

What they do is bring together articulate experts, half who argue for a motion such as “Guns reduce crime?” or “Is the government responsible for health care?” and half who argue against it. The nice thing is that they make enough TIME to allow full statements. These aren’t roundtables of knucklehead pundits spouting sound bites. These are long discussions.

Of course, so much depends on the presentation skills of the various experts. But being able to listen to both sides of an issue, at the very least, gives much to think about.

In this debate they argue for and against the motion “The US is winning the war in Iraq”.

They convinced me (I won’t say which side, however). Take some time and listen to this while you do monkey work for the day job.

Plot Basics

In the comments to this week’s writing excuses on the 3 act structure, a writer asked if the try/fail cycle would really work with her chase story because her folks do not “fail to solve the problem” every time so much as “escape by the skin of their teeth”.

I thought this was a great question because we ARE often led to believe that the characters need to fail in each attempt. But if we look at a number of stories we’ll see that this isn’t the case. The hero is NOT always failing in his scene or sequence goal. In fact, much of the time he succeeds. So how does plot really work? Here’s my post.

[edited for clarity]

Jen, fwiw:

A few things finally opened up acts and plot to me. Maybe they’ll be helpful to you. I say this because a chase would work the same as anything else. I’ll just start at the beginning, although I’m sure you know a lot of this.

1) Story is about someone solving a problem. The problem is one of happiness (danger or lack on some level–physical, social, freedom, etc.) or mystery.

2) The reason why we tell stories about problems is because the solving of problems, if done a certain way, evokes suspense, surprise, and curiosity in the reader, and then a release of emotional tension. Why we humans like that ride, I don’t know. But we must keep this in mind when dealing with #1 because these effects are the main effects the bulk of people go to story for.

3) Plot is simply the actions the characters take, the results of their action, and what they decide to do next. Except this can’t be any old action and result. It has to be action and result that builds the anxiety of suspense, surprise, and the mystery or puzzle.

4) There are four possible answers to the question of “did the hero’s action solve the problem?”: yes, no, yes but, no furthermore.

For example. Yes, you killed the monster. No, you didn’t. Yes, you killed the monster, but it bit you and now you have the virus that’s going to turn YOU into a monster. No, you didn’t kill the monster furthermore you woke up its mumma.

Of those four possiblities, only the last two build suspense and curiosity. The first removes it totally. So it’s out. And a no answer leaves suspense unchanged. All you’re doing is delaying things with that. What you want to do is ratchet it up.

So if you want to build suspense then when a character takes an action, that action has to make things worse. They may escape by the skin of their teeth, but now the federal police know where they are (yes-but). Or not only did they not escape the police, but now the mafia, the real bad guys, know where they are (no-furthermore). These escalations and complications to the plot/problem continue until the hero’s plan is in total shambles and it appears he really is done for. That’s when they get one last shot at it.

If someone is trying to escape you don’t need a different plot structure. Their actions simply need to make it harder and harder and harder. Their plan needs to start to come apart. Things go wrong. Things they didn’t plan for make it worse. Someone double-crosses them or goes AWOL. We need to see them walking into dangers they didn’t plan for. If you go back and look at Prison Break season 1, you’ll see this all over the place in the last two episodes.

5) Acts are just a nifty way of breaking up the problem solving process into parts. In act 1 (the beginning), as stated, you introduce the problem and show that the character won’t or can’t walk away. Often a big reversal or reveal (a big yes-but or no-furthermore) marks the end of that act. But the key thing is that the hero MUST act. The stakes or too high or they simply can’t get away.

Now in act 2 (the middle) the hero says, aha, this is the real problem. Let’s try to solve it. Act 2 is a breeze to write IF you think about escalations and complications and nasty surprises–yes-buts and no-furthermores. He takes an intelligent action. BAM. It gets worse. And as these complications pile up we see that the hero comes to a point where his plans are in a shambles and the problem looks almost certain to squash him for good. In Star Wars, sure they saved the princess, but they led the empire to the secret base and the death star is going to blow them away (a grand yes-but).

In the last act, the hero straps on his guns and trys one more thing. Sometimes it helps to think of acts 1 and 2 as the hero reacting and act 3 as the hero finally getting the inititative, although it appears to be almost too late, and strapping on his guns. In Star Wars they do this. They’re running, running, running, and then they attack the death star. But the odds are slim. And they only have one little chance.

Remember: the odds are slim at this point and things get worse not because this is how problems are solved. Many get solved on the first try in real life. But because solving a problem in this way produces maximum suspense, surprise, and curiosity–the chief effects readers go to stories for. Any time you see a new plot structure or theory, you need to ask yourself what effect it has on the reader. If you can’t see any, junk it.

So you might have three acts, four, five, seven (all variations I’ve seen). It doesn’t matter. An act usually ends with a huge change in the nature of the problem. See Robert McKee’s STORY. But the number of acts isn’t the issue. It’s the effect on the reader. The acts are just means to an end. If we don’t keep the end in mind we’re likely to misuse the techniques. 

6) The key for moving through the acts is to ask myself about actions, obstacles, and results. Here are some questions I’ve found productive.

Action. What are some intelligent actions the hero might take in this situation? What would I do? What are some logical steps that the reader might not think of?

Obstacles. What happens? What are some compelling obstacles the hero will face in this attempt? Are there points of conflict with himself, someone else on his side, the antagonist or his henchmen, someone in the background, with the setting? What does the antagonist do to foil the hero? What is a logical but maybe an unexpected and surprising obstacle to both the reader and hero? How does the hero’s plan begin to come apart?

Results. What happens? What are some possible results that pose a yes-but or no-furthermore? What would be unexpected, surprising to both the hero and the reader? How does the character’s action make it worse? How does the result reveal the problem is much worse than the hero and reader first thought?  I’m thinking of complications and escalations–things that make the problem harder to solve or more important because more’s at stake.

In all of these, I choose the options that gives me the most zing and run with them. If they peter out, I try another (take 2, take 3, take 4), until I have one that works. Then I repeat it all over again and again until the hero is looking the gun in the face.

7) The “hero’s journey” is nothing more than a bunch of mystical names for common elements in this specific type of problem solving structure. Why does the hero have to leave home? Not because of some mystical archetype mumbo jumbo. No, because this forces them out into unfamiliar territory–adventure, risk. Things go wrong. The hero has to face the problem.

Why does the hero go to “the cave”? Again, not because of some mystical archetype mumbo jumbo. No, because turning and facing the monster, going onto ITS turf, poses the MOST RISK and hence most danger and hence most suspense for the reader.

Always keep the purpose of the story in mind. Suspense and curiosity DRIVE the structure of most stories. Yes, there are other effects we go to story for. But the reason stories are structured the way they are is because of those two reader effects. And all the rest of those Joseph Campbell terms are useless to writers unless they make the connection and see how they play into suspense and curiosity.

And even then I’ve found it’s wrong-headed to bind yourself to to a form just because. Or to think you need to slavishly follow it. The decision has to feel right for the story. It has to build anxiety and curiosity. And whatever does that well is right, regardless of whether it follows some formula. Although, I will say that certain story structures are used again and again because they deliver the goods to the reader better than other structures. Like biological evolution, they survive because of natural selection by readers.

So that ended up longer than I intended. Hopefully the ideas were as helpful to you as they were to me.

This writer’s question arises because of the common way of explaining the try/fail cycle sets us up to think there is only a no or no-furthermore option to each attempt by the hero. However, if we just look at a handful of stories, we’ll see the yes-but option is used all the time. What we want to avoid is the yes option, because that just stops the story. It stops the story because story is about solving a problem. And once the problem is solved, the story is over.  

Other writers talk of formulas, however “pattern” has always been a more helpful way of looking at it than “formula.” I know, that’s semantic quibbling. But “formula” suggests to me THE way while “pattern” suggests to me something not so strict, something with some give to it and perhaps a great number of variations. Either way, pattern or formula, I found that unless I can understand the why of a part of the pattern, the effect it has on the reader’s experience, it’s not much use to me. It all comes down to plunging our hero into trouble or mystery, and then making the trouble or mystery worse SO THAT the reader feels increasing anxiety, curiosity, and surprise.

BTW, here’s a good explanation of the 3 act structure with some tips from Stephen J. Cannell, an old pro. I really like his tips on act 2 issues and complications. Because if we make the antagonist an active force, he or she will provide many wonderful yes-but and no-furthermore options.

You’ll find other excellent explanations of plot in TECHNIQUES OF THE SELLING WRITER by Dwight V. Swain, HOW TO WRITE BEST SELLING FICTION by Dean Koontz, and THE SECRETS OF ACTION SCREENWRITING by William C. Martell.