How do you see Ratings?

Discussion in 'General Game Discussion and Questions' started by thumbs07, Mar 11, 2016.

  1. thumbs07

    thumbs07 Well-Known Member

    Jul 20, 2010
    922
    0
    16
    UK
    #1 thumbs07, Mar 11, 2016
    Last edited: Mar 11, 2016
    On many apps on the AppStore people will rate 5 stars yet objectively you know it's not a great quality game, but they've rated 5 stars as they've rated their experience right now, or they've rated it..how satisfied they are. When a rating surely should be about its quality, or how it exists relative to other games?

    But everyone presumably sees ratings as different. It's like on eBay, if you mark less than a 5- people are hurt! You'd mark a 4 or something saying the delivery time was pretty good. (But maybe not excellent) They'd see- the nerve of me putting 4! I can't remember eBay ratings but it's something crazy like that, how you are interpreted for less than 5 star rating.

    Anyway back to games - if you rate something, what's your criteria?

    For me:
    3 star I see as a competent playable game. 3.5 as good. 4 as great. 5 as reserved for something really suited to whatever format they're on.

    Like Plants vs Zombies 2, I think is the perfect 5. It's got everything, variation, quality, accessibility.
    Then you go to a release this week, Bulky pix Math jumper. And you've got a completely different game. It's playable, but it's nowhere near a fully as fledged a product as plants vs Zombies 2. So you probably say 3/5 if you reviewed it on the store.

    Tldr: How do you review apps on the App Store? What's your thinking when you do.


    (Incidentally the promo section on here is a bit wrong, win $10 for rating my product knowing they're looking for you to put 5 star ratings up.)
     
  2. Warriv

    Warriv Well-Known Member
    Patreon Bronze

    Feb 21, 2015
    244
    11
    18
    Portugal
    #2 Warriv, Mar 11, 2016
    Last edited: Mar 11, 2016
    I used to think a bit like you, but what I see on most games that I enjoy, is that there'll always be some people rating them 1 star because they can't either play the game(they didn't read the description, and their device is not supported), or because they feel they paid too much for it, or some other stupid reason. Right now, The Walking Dead: Michone, has only one review on my country, and that is a 1 star, and just says: "RIP OFF!!!". I've been spending a bit on games lately, so I can't buy everything at once, but I'm seriously tempted to buy it just to give it a proper review.

    So, I give mostly 5 star ratings on the AppStore, to try and even things out a bit. For example, AC: Identity, which I rated 4 stars here on TA. I enjoy that game immensely, but it has some issues, say, bad pop-in, and the online-only requirement can be a little frustrating sometimes. So, the 4 stars I think are justified. But on the AppStore, comparing it to most games people can actually reach, it's quite excellent, so I just gave it 5 stars, explaining the game is a lot of fun, while warning people about the online-only thing.
     
  3. OrangutanKungfu

    OrangutanKungfu Well-Known Member

    Dec 29, 2015
    1,011
    0
    0
    Media
    UK
    The above definitely applies to me. I tend to review (and buy) only the games I like, so most of my reviews are four or five stars, though I did give Chel-Z three the other day.

    The App store generally - at least in the the UK, and I suspect elsewhere - tends to be a mix of mainly five-star and one-star reviews, with one-star reviews mainly tending to come from people who can't get the game to work or who have some feeble complaint/rant about the price or IAP or something.

    When I read App store reviews, I look at the overall average rating, given the number of users, and then read the reviews that extend beyond just a couple of sentences. Plenty of gamers out there will try to explain why they've only given two, three or four stars, beyond the fact that it lacks MFI support or something.
     
  4. Zwilnik

    Zwilnik Well-Known Member

    On the developer side we see ratings as ridiculously important in some ways (such as it being critical for your search ranking on the App Store) but also rather meaningless in others. I should elucidate though :)

    In theory, ratings are a very good way to get a general feeling of how your players are enjoying the game. The fact that they've actually submitted a rating puts them in the top 1% of players that actually care about the game enough to bother, so getting 4 or 5 star ratings on games you've published is a good sign and you start to worry if you see too many 1 or 2 star ratings.

    However...

    Every App Store user has a completely different view on how to award stars, which is fair enough. If they weren't so critically important it probably wouldn't be an issue but where someone quite enjoys a new game on the store that only cost him $2.99 and he had a lot of fun with gives it 5 stars without thinking about it, another player might decide to give it 1 star until it has a particular feature that he thought might be good in the game, *Despite playing and enjoying it as much as the 5 star guy* but he just wants that feature and thinks holding onto those stars will do the trick.

    Other users might dock a star or two because they expect all games to be free, managed to complete it in a single 100 hour session or thought it didn't have quite the right colour blue in it. (believe me, I've seen worse ones ;) )

    So the problem is, without context or structure, the number of stars don't really mean too much. It's probably better to have a "Like" Button for games with a "WARNING" option that reports it to Apple (as low star ratings are in theory meant to warn players off from scam or broken apps).

    Another issue that's occurred in the past is simply that it's very easy for your competitors to get the app and slap a 1 star rating on. There's also the apps you're up against that have a ton of 5 star reviews that have simply bought them or are published by companies with 200+ employees all of whom have App Store accounts and review automatically.

    So really, you either enjoyed an app or didn't. If you did and care enough to tick some stars that's pretty brilliant in itself, but if you feel there's stuff that can be improved on an actual review can help other players who might be considering it and clicking the support link on the App Store to let the devs know is even more important (we don't always see the reviews, especially if you're in a different country to them) so if you hit a bug or something in the game feels really wrong, it's always worth clicking the support link and letting the devs know as there's every chance they'll be able to fix it (a lot of the time it's something we know about and can sort out a workaround for you before the bug's fixed in an update).
     
  5. thumbs07

    thumbs07 Well-Known Member

    Jul 20, 2010
    922
    0
    16
    UK
    I like that idea of 'liking' a game, that does seem to make more sense.

    I forgot some apps get quite a lot of unfair 1 stars as much as their 5s. That is true.
     
  6. thumbs07

    thumbs07 Well-Known Member

    Jul 20, 2010
    922
    0
    16
    UK
    ah never knew that feature. That's useful to know.
     
  7. madreviewer

    madreviewer Well-Known Member

    Sep 22, 2013
    966
    0
    0
    The stars are important to me- I will not spend my money on a 3 rated game with 10 reviews
    But I probably will for a 3 rated game with over 200 reviews,
    And the like, and dislike button will be worst.
    Imagine the people who rated the game 1 star just because it doesn't have on feature they wanted.
    They will dislike the game for the same reason
    .
     
  8. Dankrio

    Dankrio Well-Known Member
    Patreon Silver

    Jun 3, 2014
    1,740
    13
    38
    I don't get the logic behind that.
     
  9. Zwilnik

    Zwilnik Well-Known Member

    I didn't say about having a dislike button, just a report button (that reports broken/scam apps directly to Apple). The reason we don't like people being able to rate a game 3 stars is exactly because you (and others) wouldn't buy a 3 star game. Despite the 3 star game being just as good as a 5 star one just it was unlucky enough to be reviewed by someone who thinks 3 stars is "good". In App review terms, 1-3 stars is "dislike" and 5 is "like" with 4 being "might be worth a gamble if the screenshots look good" for most people looking to buy a game (anything under 5 stars is "So horrible it's amazing it's on the App Store" for free games ;) ).

    This isn't a reality or scoring system based on actual data, it's purely down to millions of people who all have a different idea of what 1-5 stars means. Whereas if the system was "Like" if you know, actually like it, then probably 90% of those millions might understand it and the worse case scenario for the other 10% is they accidentally like a game they didn't like.
     
  10. dancj

    dancj Well-Known Member

    Jan 25, 2011
    967
    4
    18
    I completely disagree with this. There is no meaningful objective way to judge a game. All you can do is rate a game based on how much you enjoy it.
     
  11. thumbs07

    thumbs07 Well-Known Member

    Jul 20, 2010
    922
    0
    16
    UK
    Interesting thought which would make sense, however.. Person X plays FF9 and loved it 5/5, person Y hates it 1/5. Professional reviewer comes along, how does he now rate?
     
  12. Zwilnik

    Zwilnik Well-Known Member

    The point there is neither rating tells you if you might like the game. Professional reviews are an entirely different beast. Even if they do use a rating score (some are moving away from that as they know it's kind of meaningless) the actual text of the review should describe to the potential player what elements of the game they may or may not like and whether it's likely to be one they want to buy.

    "Likes" are a fairly good compromise as it encourages players to tag the games they enjoyed (because it's easy) and there's still the option to write an actual review (which is a whole separate subject in terms of what's flawed about the system ;) )
     
  13. Warriv

    Warriv Well-Known Member
    Patreon Bronze

    Feb 21, 2015
    244
    11
    18
    Portugal
    A professional reviewer would rate it independently, of course. Why would other people opinions' dictate how he should rate a game? Games are supposed to be fun and entertaining, and these are subjective values, so they'll differ from person to person. Of course, most people on the AppStore don't seem to base reviews on how fun a game is, but how it meets their expectations, and that's obviously unfair, because their expectations are often unrealistic.
     
  14. Zwilnik

    Zwilnik Well-Known Member

    This is where a "LIKE" button would be handy for this post :)
     
  15. Warriv

    Warriv Well-Known Member
    Patreon Bronze

    Feb 21, 2015
    244
    11
    18
    Portugal
    Hehe thanks! I agree that a like button would be better than the 5 star system, though it still wouldn't stop people from posting dumb things. That doesn't really have a solution, though ;)
     
  16. Zwilnik

    Zwilnik Well-Known Member

    As I said, the actual user reviews are a whole new problem. The solution most of us devs have been asking for is some sort of ability to at least be able to reply to them, so if someone's mistakenly using a review to report a bug or say they're stuck, we can help them out.
     
  17. Warriv

    Warriv Well-Known Member
    Patreon Bronze

    Feb 21, 2015
    244
    11
    18
    Portugal
    I like that, it'd solve the problem, or at least, would give the developers some way to "defend" themselves. Have a "like", good sir :)
     
  18. thumbs07

    thumbs07 Well-Known Member

    Jul 20, 2010
    922
    0
    16
    UK
    I agree with the like system, but on professional reviewers their scores mostly reflect production value. For instance, I maybe proved entirely wrong but flappy bird wouldn't be reviewed 90-100% by something like gamespot, or whatever the leading review source are these days. The same generally goes for Toucharcade, the ones it usually reviews are good quality games.

    So I would argue there is certainly subjective reviews, but also can be objective ones, that look, and assess the quality of a game.
     
  19. thumbs07

    thumbs07 Well-Known Member

    Jul 20, 2010
    922
    0
    16
    UK
    I had a suggestion for a game the other day, and following the suggestion of the developer in here to press support on the app, I couldn't find it. It was only a minor suggestion.
     
  20. Dankrio

    Dankrio Well-Known Member
    Patreon Silver

    Jun 3, 2014
    1,740
    13
    38
    #20 Dankrio, Mar 15, 2016
    Last edited: Mar 15, 2016
    How can one objectively assess the quality of a game? It is impossible. You can measure lenght, for example. Or framerate. But one cannot say the same about story, gameplay etc.

    However even the lenght is viewed differently by people. A game might be short for one and perfect for another. One can give a better rate because the game is very long, another can give a low one, because the game drag too much.
     

Share This Page