Edward Bear Shares More Proofreading Secrets

Mr. Edward Bear (pseudonym) shared an awesome secret for sussing out quote issues in a previous post. He’s back with a nifty way to help spot spelling issues.  It helped me spot a number of inconsistencies in Bad Penny, which I recently fixed. Take it away, Mr. Bear.

* * * *

Augmented Proofreading 2

Last time, I mentioned checking spelling and spelling consistency, and this note is to fulfill my promise.

To begin with, I’ll admit freely I do not recommend just running a spieling chucker over the text. And yes, I’m using the phrase deliberately. The spelling checker in the program I’m using to write this just waltzed right past it, despite the fact that neither word makes sense in this context. I got started trying to get some mileage out of spelling checkers a while back, when I realized that OCR scanners will work like hell trying to find a word and probably will come up with a word, but it will be the wrong word. Over at Project Gutenberg, they use the term “scanos” as an analogue of “typos.”

The other adversary is consistency of spelling and usage. Examples might include “canceled” and “cancelled” or variant possessives, such as “Jones’” and “Jones’s” in the same text, or simply variant spellings of the same character’s name, such as “Erik” and “Eric.”

So what do I do for these sorts of problems?

What you need is a list of all the unique words in the story, and it’s easy with a dollop of regex. (See the first post on this topic. The one I’ve taken to using is the following:

[^-‘‘’\w\d\r\n]

This one I can explain, since I wrote it. 🙂

What it says is to look for any individual characters within the brackets([]). The leading caret (^) says “Nope, they should not be in this list.” Following that are the hyphen(-), the straight  quote(‘), and the opening and closing curly single quotes(‘’). After that, it’s any character that would normally be in a word (\w), any digit (\d), any carriage return(\r) or any new line aka paragraph terminator (\n).

And what you do with the above is to set Textpad (see previous post again) to replace all of them with a newline (\n) character.

Here’s what the search and replace box in Textpad looks like for this:

Augmented Proofreading image001

 

Notice that the “Regular expression” box is checked. And then you choose “Replace All”.

The result is to turn this:

Once upon a night we’ll wake to the carnival of life
The beauty of this ride ahead such an incredible high
It’s hard to light a candle, easy to curse the dark instead
This moment the dawn of humanity
The last ride of the day

into this:

Once
upon
a
night
we’ll
wake
to
the
carnival
of
life
The
beauty
of
this
ride
ahead
such
an
incredible
high
It’s
hard
to
light
a
candle

easy
to
curse
the
dark
instead
This
moment
the
dawn
of
humanity
The
last
ride
of
the
day

 

For a book, this means what you have as a multi-thousand line long document and LOTS of repeated words. The next step is to lose the repetitions by sorting the list. For TextPad,  you’ll find Tools->Sort on the menu bar, and I generally set the sort up as the following:

Augmented Proofreading image002

This is a case-sensitive sort and “Delete duplicate lines”, of course, gets rid of all the duplications of words like “a”, “an”, and “the”.

For the above text, you get:

It’s
Once
The
This
a
ahead
an
beauty
candle
carnival
curse
dark
dawn
day
easy
hard
high
humanity
incredible
instead
last
life
light
moment
night
of
ride
such
the
this
to
upon
wake
we’ll

34 unique words.

And here’s the payoff for all this funky text munging: Run a spelling checker over this, and it will find typos, of course, but it will also generally complain about most names, which aren’t generally kept in spelling checker dictionaries, and it will also show you words and their variants, nestled fairly closely together. Here’s an example from one of my projects:

Swiss-born
Take
Talking
Tallmadge
Tallmadge’s
Tarelton
Tarleton
Tarleton’s
Tavern
Tecumseh
Tell
Ten
Thames

The spelling checker landed on Tallmadge and its possessive form, but do you notice the “Tarelton” on the list? That’s the time for the Aha!, and you can fix the “Tarelton” form. The same thing applies to possessive variants and any other variant form you find.

As with the last post, I’ll be peeking in on the comments and answering any questions that come up.

Share

Similar Posts

  • Why stories follow patterns

    There is a lively discussion on The Passive Voice about Kris Rusch’s recent blog post which challenges the use of the term “churn out” to describe writers who write quickly. In the comments, someone said that folks also use “formula” or “formulaic” as a pejorative. Another commenter said that in computer design, they use design patterns, and suggested that’s probably a better word. Here’s my response.

    Design pattern is right.

    The people who decry familiar patterns are those that completely misunderstand one of the main purposes of fiction.

    Readers go to fiction to have an emotional experience–thrill, horror, dread, falling in love, mirth, wonder, wish-fulfillment, etc.

    Those emotions are not created out of nothing.

    They’re not created haphazardly.

    They are generated by a specific . . . pattern.

    1. You receive some stimulus–from your environment or your own thoughts or something you’re lead to think, such as via a book.

    2. You make an assessment about what’s going on and what might happen in the future and how that impacts you or someone else. There are two assessment systems. One is incredibly quick. Almost subconscious. The other is a bit slower. You can read about them in Daniel Kahneman’s Thinking, Fast and Slow and Jenefer Robinson’s Deeper Than Reason. Robinson even relates the science to fiction.

    3. If the assessment says it’s something that will affect you or someone you can sympathize with, you feel an emotion. The emotion focuses your attention. For example, if there’s a mountain lion stalking you, you don’t want to forget she’s there. It also prepares you to act–to pursue something desirable, avoid something that’s not, etc. It also writes that emotion on the face to communicate it to others to solicit help or warn (we are social animals).

    Okay, so certain cues or assessments are required to produce certain emotions. If the cues aren’t there, the emotion doesn’t arise.

    Certain stimuli lead to an assessment that there’s a threat. Other stimuli lead to assessments that there’s an opportunity, for love, money, sex, security, etc.

    Suspense, surprise, and curiosity have all been studied in experiments. There’s a certain structure required for each. If you take the same story, but simply change the structure, you end up with different reader effects. See more here.

    This means that a reader who wants to feel the experience of falling in love is going to have to be guided through the pattern of cues that produce the assessments that lead to the emotion.

    There are lots of variations in the pattern that will work. But we can’t give a reader the pattern for horror and expect them to feel romance.

    Duh.

    You can’t give a reader a downer ending and expect her to feel joy.

    Again, there are certain delights readers are going to certain genres for. Folks read romance after romance precisely because those romances do specific things to them. And they want to experience them again and again.

    For example, one thing romance readers love is the joy of a happily-ever-after (HEA) ending. So if that’s what they’re looking for, then that’s what the product must provide for them to be satisfied. We follow patterns, but change them enough so that the reader doesn’t get bored.

    So, yeah. Patterns. It’s like the very essence of what we’re doing.

    We are all working with patterns, whether we know it or know. And the sooner we learn what the general patterns are for the type of story we’re trying to tell, which could also be called the type of experience we’re trying to provide, the quicker we gain control over our writing.

    Share
  • |

    American Idol Story Elements

    I don’t have time to watch, but I found myself getting sucked in this week. And here’s something I realized as I watched Simon, Paula, Randy, Ryan, & the contenstants–the show is using story principles.

    Idol

    Duh, I know: of course, it is. But it does it so well. It reminds me of a research article I read about sportscasters and audience enjoyment of sports competitions. They found that if they could inject story elements–suspense, rivalry, etc.–people enjoyed the games more. Next time you watch a college football game, notice what the color commentators say to make it a contest. It’s not just about reporting what #45 did out in the flat.

    Anyway, back to Idol. Look at these elements.

    What draws us to characters?

    Beauty, threats, quirkiness, larger-than-life situation or skills, source of viewer wish-fulfillment.

    Humm, let’s look at the cast of performers. Don’t we see all of that? How many of us wouldn’t love to be able to sing like they do? Have a shot at becoming a recording artist? Or just goggle at someone getting this chance?

    What factors generate suspense?

    Threats to characters we like or marvelous opportunities for them, turns in the situation, a prolonged resolution.

    Humm. Our sympathy is engaged because these folks are normal folks, many of them underdogs. Many viewers identify strongly with one or two because of the contestant’s various social groups and because, heck, the auditions are for people like you and me. It could be us up there in front of the world! You’ve got the threat of peformance fright, but also the overriding opportunity to make a dream real. You’ve got a wonderful career, if not millions of dollars, on the line. You’ve got Simon who is honest, but also plays his part. Isn’t that the moment of most suspense with each performance? You’ve even got a little subplot going on between Simon and Seacrest. There’s no villain here. But there are plenty of obstacles. Weekly threats.

    What does Idol give us that Survivor never could?

    It’s all REAL, even if the producers let their selection of performers be influenced by things other than vocal talent. And because it’s real, we believe it. Which means we can more easily feel sympathy and root for the various performers.

    It’s a simple but brilliant concept. And I just wasted 4 hours watching it. And I’m likely to do it again.

    Zing, Baby. Zing!

    Share
  • | |

    Building Expertise by Ruth Colvin Clark

    When we find a great teacher, we prize them not only because what we learn improves our lives but also because good learning can be one of the most exhilirating things we experience. Unfortunately, a lot of teaching stinks. It’s boring, rambling, forgettable.

    I’ve made a study of teaching. I’ve had to. For almost 20 years I’ve taught and designed courses in the private sector. And for many of those years my work has been in a revenue generating department. What that means is that if my classes are ineffective and dull, nobody signs up, revenue falls, and a lot of folks will stand around and wonder if it might not be better to just replace me with a potted plant. At least a plant would be something pleasant to look at, plus it would also clean the air.

    Now not everything I do is stellar (I wish that were so). Sometimes in the quality, cost, speed triangle, quality is the thing that takes the hit. But the point is I have to be alert and try to miminize the schlock. But how do you do that? How do you develop and deliver effective and interesting education?

    Luckily, the field of instructional technology (I’m not talking about computers, but principles of instruction) has come a long way in identifying what works and what doesn’t. This is important because teaching theories of the past (many of which are still used today) often relied on rules of thumb and anecdotal evidence. Their precriptions were often ineffective and sometimes counterproductive. What’s exciting is that in the last few decades researchers in this area have put techniques and principles to the test. We know better now than ever before how to structure learning that is effective and interesting. And I have yet to find a better explanation of the proven techniques and principles than Ruth Colvin Clark’s Building Expertise: Cognitive Methods for Training and Performance Improvement, 3rd Edition.  

    Don’t let the “training” part fool you. We often associate “training” with learning procedures and simple tasks (which is what leads to the “we want to provide sex education, not sex training” obfuscation). But Clark isn’t using the term that way. Training here includes all types of learning.

    What Clark does is not only share the techniques that build expertise, but also the psychological reasons and research-based evidence for those techniques. This isn’t nonsense based on personality or political correctness. It’s practical and proven.

    Among other things, you’ll learn:

    • Why working memory is key to instruction and how to overcome its limits
    • How to motivate learners
    • How to structure learning
    • When to use lecture and when to put learners into action
    • What methods work best

    You’ll learn when taking notes can actually be counterproductive and what you can do about it. Or how making your delivery more personable (and what that means) can actually improve attention. You’ll see why lots of practice isn’t always the best answer–sometimes your child will learn more if you do half of their homework questions for them.

    You’ll find that there “Is no Yellow Brick road” in teaching. Instead, you’ll see that the effectiveness of any method depends on whether it’s suited to the specific situation. And Clark will explain what the key factors in any situation are so you know which methods to apply and the trade-offs you’ll make when you do.

    If you’re a teacher in any setting–family, job, church, school, or recreation–or if you’re trying to teach yourself, this book (specifically the 3rd edition) will be a goldmine for you. I can’t recommend it highly enough.

    Share
  • When the workshop works

    From a workshop participant at MountainCon:

    I’m going to give a shout out to all the goodness I experienced. So if you don’t really care what happened at the con, you can stop after this paragraph and take this message away with you: Brandon Sanderson (who does Writing Excuses, has published several novels, and is the chosen one to finish Jordan’s Wheel of Time series) and John Brown (with a must buy novel coming up next year) are incredible teachers. If you ever get a chance to attend a class or workshop by any of them, don’t let it pass.

    We loves to hear these things, Precious.

    But we loves it just as much when we can make the students shiver with excitement: more here: http://www.amichopine.com/blog/?p=318

    To those who missed this run of the 3 Things You Must Learn to Write Killer Stories Workshop, know I’ll be holding it again. Check back to see when.

    Share
  • How long should my novel be?

    There are two answers to this question.

    1. The story answer by Orson Scott Card, best-selling author

    As long as the story needs, but 75k-100k is when it starts to “feel” like a novel.

    2. The selling it to editors answer by Jenny Rappaport, literary agent

    “Aim for 80k minimum and 120k maximum. Try to hit as close to 100k as possible, but not go over. There are exceptions made for fat fantasies and longer novels.”

    “For YA: 50k minimum. Try not to go over 75k. You can nudge it to 90k if it’s a fantasy. YA is a little more flexible.”

    3. What happened to one author, Brandon Sanderson, when he tried to write to “the market”

    As in stories less than 200,000 words…

    BTW, Brandon is now New York Times best-selling author.

    Share
  • Indie Thoughts: Resources for Indie Writers

    About this time last year I got the last of my rights back to the Dark God properties. I thought it would take twenty or thirty hours to figure out the whole indie publishing thing. And then the awesome John Brown story machine would kick in gear.

    Reality promptly woke me up and slapped me around a bit. This last year has been quite the learning curve. Here’s what I’ve had to pick up:

    • Designing book covers
    • Finding artists
    • Working with artists in a way that actually works
    • Copy editing
    • Formatting book interiors
    • Fonts, fonts, fonts
    • Using ISBNs
    • Using InDesign to create files for both POD books and epubs
    • eBook structure
    • Editing ebooks (okay, just get Calibre ebook editor right now. We luvs it, Precious)
    • Validating ebooks (http://validator.idpf.org/)
    • Converting epubs to Amazon’s mobi format
    • Uploading ebooks to the various ebook retailers: Amazon, NookPress, Kobo, iTunes (I upload via Draft2Digital), Smashwords
    • The pros and cons of CreateSpace vs Lightning Source
    • Using CreateSpace to publish POD books
    • Registering books with the US Copyright Office
    • Writing better book descriptions
    • Using keywords and categories on Amazon
    • Setting prices in the indie market
    • Creating an email list (I love MailChimp. They make me happy every time I go to their site)
    • Advertising and promoting as an indie

    One of the things I love about this business is that there is always more to learn. But I’m happy to be over that curve. For folks just starting out, let me share some of the resources I found super helpful with a number of the things listed above.

    Posts by a mega indie-seller Russell Blake to give you the right perspective about indie publishing. I’ve read a lot of posts the last few years about being an indie author. These are the best I’ve come across.

    Online courses to help you on the publishing side.

    • Designing Book Covers and Designing Book Interiors with Dean Wesley Smith (look for “Online Workshops”). I don’t agree with Dean on all his ideas about pricing and promotion, but these two courses helped a great deal.
    • InDesign CS6 to EPUB, Kindle, and iPad with Anne-Marie Concepción at Lynda.com. Awesome.

    The most practical and clear-headed books about indie promotion I’ve read. For other clear-headed advice, see the Russell Blake posts above.

    The most helpful book on copyright.

    The most helpful book on copy editing as well as info to put into front and back matter.

    Helpful threads on Kindle boards

    Other great resources

    Good luck!

    Share

3 Comments

  1. Why do you include an opening curly single quote: ‘ ? Is that in case it is incorrectly used as an apostrophe? It seems like your list could end up with unnecessary duplicate copies of words that start a single-quote (one with the attached opening curly single quote, and one without the quote).

  2. @Johnw I include the opening curly single quote because it will help me catch contracted words like ’em which frequently get mangled into ‘em by assumptions built into Word or typesetting software which sets ’em up that way. It gives me a quick index of such words and makes ’em easy to find and double-check. Admittedly, quotes inside dialogue, which are surrounded, will generate words such as ‘lucky from ‘lucky is he who has friends’, but contracted words still stand out.

    The whole point of this sort of thing is to call the user’s attention to likely candidates which need double-checked.

    These days, when I get an assignment, the typesetter sends me both an RTF or DOCX of the text, and a searchable PDF, to go with the paper copy. So this afternoon, when I got to that stage on my latest project, it took me maybe ten minutes to find ALL occurrences of ‘em and ‘bot and get them marked on the print copy and added to the log for correction.

  3. One other note. I entered the single quotes in my prior post as curly quotes, but the website software made them straight ones. :dang:

Comments are closed.