Book Ratings, Revisited

08 Sep 2025 » 2 min read » Filed under: Reading & Books

I’m terrible when it comes to book ratings. I used to use them, but these days I’ve given up on them completely. I think of a 0-to-5 star rating as a bell curve where 3 stars fall right in the middle of the curve. If you get 3 stars, you are meeting expectations. Zero- and 5-star ratings are outliers, several standard deviations from the mean, and thus should be more rare than a 3-star rating. However, there are so many fingers on the scale1 of these rating systems that I really have to take them with a grain of salt.

That doesn’t mean I don’t look at the way others rate books, and collective ratings in places like Amazon often puzzle me because they sometimes diverge far from what I would rate a book, if I still used these systems.

Yesterday, for instance, I started reading Martin Gardner’s2 autobiography Undiluted Hocus-Pocus. It wasn’t long before I decided that I really loved it. And yet, I noticed on Audible it has a rating of 3.9 stars and on Goodreads it has 3.4 stars, both well below what I would rate it thus far.

An interesting question occurred to me while I was in the shower pondering this discrepancy3: Can an individual’s book rating for a given book be predicted based on the graph of all other books a reader has read without knowing how those books were rated? Granted, if the reader has read very few books, this might not work well. But could a network of books—with nodes being category and directed edges being the order in which the books were read—be used to make a reasonable prediction of the book at hand?

I suspect this is to some extent how outlets like Amazon produce “Based on your reading…” recommendations. But all Amazon knows is that I purchased a book. It doesn’t know if I’ve read the book4, let alone what order I’ve read it in. Order can be important. For me, at least, the butterfly effect of reading—flitting from one book to another as each book slightly (or dramatically) alters the choice of the next book—means that the order I read books in has great significance. So I wonder: if you knew the category and order of books read, and you had enough data, could you make a reasonable prediction of a rating of a given book based on that information?

Probably not, I suspect, because interest in a book does not necessarily correlate with enjoyment. That just leaves me back at my original question: why do some book ratings diverge so much from my own experience with a book? With so many fingers on the ratings scale, it is probably a meaningless question.

My own “rating” system is a little simpler. If I really like a book I’ll note it as “recommended.” When friends ask about what books I’d recommend in a given subject area, I have an easy way of offering suggestions without worrying about a rating. But what does “recommended” mean? To me, a book I’d recommend is a book I myself would enjoy reading again.


Notes:
  1. On the low end of the scale, trolls will have entire campaigns to give books (or authors) they object to 1-star reviews never even having read the book. Meanwhile, on the higher end of the scale, authors will ask for high reviews because higher reviews means better visibility in the system. In either case, the score becomes a pawn of potential sales, and one which, for that reason, can’t necessarily be trusted as a measure of quality. ↩︎
  2. I must be on some kind of Gardner kick right now because I am also reading is book Science: Good, Bad and Bogus. ↩︎
  3. Showers are great places for pondering. ↩︎
  4. Sometimes a book I buy will sit unread on my bookshelves for years, helping shape my anti-library. ↩︎

Tagged as

Related posts


Get new posts by email

3 responses to “Book Ratings, Revisited”

  1. Use Net Promoter Score instead. Subtract a percentage of 1-3 stars from percentage of 5-stars. The result is a -100..100 range. Over 65 is good.

    Five stars are a book’s target audience. A high NPS score indicates the book has well targeted its market. A low NPS suggests it either missed its audience or sucks.

    1. I’m sure I’m getting in over my head, but wouldn’t the same biases exist in the NPS model? It’s like when I take my car in for service and the service people remind me to give them a “10” on the survey because that is what is expected of them. (I always want to ask: “Then why even bother with a 10-point scale in the first place?”)

      Two points I’d made:

      1. Going back to my original question about explaining the difference in group versus personal rankings: would NPS perform any better in predicting the actual ranking of the next book I read based on the directed graph of the previous book category nodes? I’m interested in this because I think ratings can vary based on mood, too, and if I am deep into, say, baseball history books, and suddenly turn my attention to a spy novel, even if good, maybe it’s not what I really feel like reading at the moment.
      2. It seems easier to me to simply “recommend” those books that I like without worrying about a score. I stay more or less silent on the books I don’t recommend (perhaps a disservice, but then again, I’m not a professional reviewer), and if asked about a book I read wouldn’t recommend, I can respond, “Sure, I’ve read it, but I think that [fill in the blank] is a better overall take on the subject.
      1. My point is the 5-star implies quality, but speaks more to whether a book has satisfied its position promise. A 5-star is a promoter. If Jamie recommends a book, that’s a 5-star (yea). If Jamie read it, liked it, but didn’t recommend, then it’s a 4-star (meh). Anything else is a detractor. In practice, NPS is a 3-star system. Ten-scale’s grain is too fine.

        My point is your recommendation is a 5-star, but not recorded on Amazon (or wherever). But to your fans, you’re promoting that book.

        Is NPS mood based? Probably. Is your recommendation mood based? You’re more thoughtful than that. If I asked you for your top three baseball books, then you’re giving your curated opinion. But you’re still implicitly 5-staring those works. Personal MBA has its top 99 business books.

        I use NPS for more than books. I look at the score, then scan a few of the fives to see if that book or product serves my need (promoters peak to the value prop of a product). Then I scan a few of the largest demotivaters to balance a review. This helps overcome star farming. On Amazon, I’ve seen fraudulent products with negative NPS.

        At the end of the day, it’s an impersonal tool and subject to gaming, as you say. But as an author, it helps me.

        Love your content, so keep it up!

Leave a Reply to Jamie Todd RubinCancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Discover more from Jamie Todd Rubin

Subscribe now to keep reading and get access to the full archive.

Continue reading