Not all edits get counted

As a very active editor of the Google Maps database, I have had a suspicion that not all my approved edits get counted and this results in earning fewer points. I have had this suspicion for 2-3 years without caring much about it. And I did not want to spend the time needed to test and document this properly. You know, points are not the main driver for our contributions :wink:

Very recently I finally reached 600K points. This motivated me to initiate a final editing effort to reach the target and to celebrate.

Here is a graph showing my points total in the days before and after I reached 600K points earlier this month.

To document potential bugs in the system, there are a few issues to understand. These include:

When you look at this graph there are two distinct jumps: Between January 14th and 15th there is a jump of 1895 points and between January 22nd and 23rd the points jump by 3470 points. This is not a reflection of me making contributions in huge bursts, but because total points are only updated once a week or so. In this case, 9 days went by between the major recounts.

As you can see my total points did not move at all from January 19th till January 22rd. It would be a lot easier to check our points if they were counted and updated daily. So this post is based on the assumption that points and contributions made between the jumps are always included in the following recount.

Counting email notifications

To document how many edits were made I decided to rely on the email notifications we receive after submitting edits. We don’t always get such notifications, but it is the best I can do. Counting contributions in the contribution list is less accurate for many reasons.

In Gmail, I have a simple filter to move all such email notifications into a folder called “maps thank you”. In this folder, I made some advanced searches as shown below.

In this example, I searched for email notifications made on January 19th. Notice the search string underlined with red. In this search string, both dates need to be edited manually to ensure only emails from a specific date are shown. Then you need to hit “>” repeatedly until you reach the last page of search results. In this case, 100 emails are shown per page, and on the last page, the total number is shown. See the red circle: I made 814 successful edits on January 19th.

This number is probably slightly on the high side, as edits submitted in the prior weeks and approved on January 19th are also included. A few road edits have incorrectly been counted as edits.

Also, when more than one edit is done to the same pin, these are counted as “one” in Gmail, as shown below because the counter is for lines and not for the number of emails.

When making edits I switched between using English and Danish, so it was necessary to count the email notifications using two different search terms: “Published” and “Offentliggjort” which is Danish for published.

Here are the results:

When looking at the first graph it is reasonable to expect that the contributions made on January 15th through 22nd will be included in the points jump shown on January 23rd. These are the numbers marked in red. The sum of the edits marked in red is 1347 edits. As one edit equals 5 points, I would expect the points to increase on January 23rd by at least 6735 points (1347 edits * 5 points/edit).

As already pointed out the points jump on January 23 is only 3470 points. So I tend to conclude that 3265 points are missing. 3265 out of 6736 is 48.5% that is missing.

What can explain this?

  1. Are subsequent edits to a pin not counted?

My answer: This can not explain the 48.5% discrepancy.

  1. Do the points recounts not include the dates immediately before the recount?

My answer: Highly unlikely in my opinion.

  1. Are there further unknown delays after recounting contributions to publishing the points?

My answer: Highly unlikely in my opinion. I will check after the next recount in a week or so.

  1. Are the edits not counted correctly?

My answer: Probably!

  1. Could it be that the fewer points are caused by some photos and reviews being removed by the spam filter or because the businesses closed?

My answer: Yes this could be. Not very likely though.

  1. During this period the spam filter wrongfully blocked my ability to make edits on Google Maps. But this was reversed within a few hours of my appeal. Could this be the cause?

My answer: Probably not because none of my edits disappeared as far as I could see. This issue has persisted for 2-3 years as mentioned above.

To test items 4 and 5 I decided to also analyze the contribution stats for edits over the same period. Here are the results:

The total for edits marked in red is 825 edits from January 15th to January 23rd. This is the period I would expect to see reflected in the following recount update between January 22nd and 23rd.

Based on email notifications from the same period, the number of edits should be 1347. So what happened to the missing 522 edits (1347 - 825)? This means that 39 percent of my edits were not counted.

It is difficult to explain why 39% is not 48.5% but it could be related to other contributions being made or removed in the same period.

But still losing 39% of your contributions due to a counting bug is very discouraging. Especially, when you consider that these are only the approved edits. Quite a few of our edits do not get approved.

Conclusion

To keep volunteers happy, engaged, and motivated to improve Google Maps by making accurate edits, I suggest this bug be investigated and fixed.

Maybe I made mistakes in these calculations. I would be happy to learn where I failed and I’m ready to make the needed changes to this post.

The results are summarized in this image:

Cheers

Morten

19 Likes

Below you can find answers to some questions that this post might raise:

Data sources

You may wonder if I keep tabs on all my contributions day by day manually. I don’t. I’m not that crazy!

Instead, I rely on the website called Local Guides Leaderboard which can be found at lgstats.xyz. This is not directly the same as the leaderboards published monthly by @AdamGT here on Connect. I have verified my profile on the site which ensures that my contribution stats are collected daily. You can inspect my daily updated contributions by visiting my profile:https://lgstats.xyz/guides/116647701492246965139

My data are collected around noon. So if you see small discrepancies in screenshots such inaccuracies could reflect that the screenshot was not taken at the same time of the day.

I used data from this site to create the “Points at noon in January 2024”-graph and the table showing edits per day.

This screenshot is from lgstats.xyz. It shows my number of edits day by day since October 2021, and my ranking globally and within Danmark. It shows that yours truly is #3 globally when it comes to making edits in the last 30 days. This is out of 200.000 local guides that are tracked by this site.

I recommend you use this site as it is very helpful and it is free.

Making 316 and 825 edits in two days sounds absurd

Well, it sounds unrealistic! But it is not. I applied the tips shared here.

In Denmark, many homes are owned individually, but for the sake of buying house insurance, paying for heat and cleaning, and paying for the running maintenance people living in apartments create an administrative association. Such administrative associations are called “Homeowners associations” or “E/F” which is short for “Ejerforening”. Such associations have no staff, no phone number, or opening hours. There are no activities except the yearly annual meetings at a private home or some restaurant. These pins are most likely automatically imported from a business directory. And 90% of them are listed at the address of some property administration service or a lawyer’s office. They are in my eyes of no value to 99.99% of Maps users. So it is more helpful if these “phantom” businesses (which are not real businesses) are not on Google Maps. All they do is clutter up the map and reaching out to them makes no sense. Hence, I search for “E/F” and start removing them if the listing is otherwise empty (like no photos, no reviews, no website, and no phone number or if the phone number is the phone number of the remote administration/lawyer).

When things go very smoothly I can make 5-6 such edits per minute. Normally 3-4 such edits per minute.

Could this issue be even worse than 50% or 38%?

Yes, it could. As hinted in the post, not all edits make it to our contribution lists. And I never tested if all the edits result in an email notification. Maybe someone would volunteer to test this? Finally, other types of contributions could be under counted.

Could this issue be less of a problem?

Yes, it could. I make an unusually high number of edits. This bug might not affect people making only a few edits now and then.

Could the counting of email notifications be faulty?

It could, and some sources of error have already been discussed in the post. However, I have never noticed that any notifications got duplicated by the Gmail filters. I considered making pdf copies of the date-specific search results as further documentation. But if someone cares to inspect them, I will produce and share them. Using the “published” as a search keyword ensures that pending and rejected edits were not included.

I think it is more likely that further inspection will result in more lost edits and not fewer.

Why care about this?

150+ million volunteers are motivated by these points, so the system should not be faulty to honor and preserve the trust Google shows to the volunteers and vice versa. The volunteers bring a lot of value to Google Maps. That is why it is so important to protect and continue to motivate the Local Guides. That is why this bug should be investigated and rectified.

Cheers

Morten

PS: Update. My trust in the points system has been restored. Please see this update.

5 Likes

From what I see you did a great research @MortenCopenhagen

It is also my curiosity and doubt. I will read it deeply, soon.

Thanks for putting time on this.

3 Likes

@MortenCopenhagen My friend who complexes these activities. Sometimes I feel like some of my reviews aren’t counted, especially when the score doesn’t drop at the same time, but I end up not getting too attached, especially because of college, there are times when I end up staying away from here.
Very interesting to know all this information.

2 Likes

UPDATE

Today Sunday January 28th 2024 I checked my contribution stats again.

Edits are now at 93.682 edits (not points)

Total points are 607.407 points.

This is a jump of (93.682 edits - 92.926 edits) which means 756 new edits.

In the past few days, I have not made that many edits, so I think it is safe to say that the missing 522 edits are no longer missing - they were just delayed in being counted. The difference between 756 and 522 = 234 edits can easily explained by edits I made since posting this article.

The jump in points from 603.473 to 607.407 = 3.934 points are more than the 3.265 missing points mentioned in my opening post. So all is good.

Conclusion

The missing edits and points were not gone, only delayed. So my anticipation that contributions are counted immediately prior to when we see the graph jumps was not correct. The recount of total points and edits happens a few days before we see the data jump. In my case, it is probably 2-3 days. But this can vary from LG to LG, I think.

My trust in the points counting is restored.

Cheers

Morten

cc. @Amiran

6 Likes

@MortenCopenhagen please also keep in mind that a change in the way points for edits are awarded (and the email communication about those) was made a while ago. I’m referring to the procedure for identical edits submitted by different local guides.

Let’s say local guide 1 notices an incorrect pin location (let’s say for example in a shopping center in Sweden :wink: ) and submits a correction - which goes pending. Later that day local guide 2 notices the same error and submits a corrective edit as well - which also goes pending. In the past the procedure (when the pending edits were cheked and confirmed) was that local guide 1 would get a notification + email “your edit was approved” and was rewarded 5 points, whereas local guide 2 would get the message “your edit was not appled” (I’m pretty sure you will remember those moments of frustration).

Nowadays, however, both local guide 1 and local guide 2 will get the message “your edit was approved”, but only local guide 1 get 5 points. This might explain some small discrepancies in the number, but will of course not be the case for hundreds of edits.

4 Likes

Thanks for the update @MortenCopenhagen

2 Likes

Well, I’m a bit surprised that you haven’t noticed this before @MortenCopenhagen . The number of approved edits, approved roads and places takes couple of days to update, even the total view count of photos doesn’t update daily. This was more visible to local guides when the view count graph was added to the contribution tab of the Maps app, view count of individual photos used to increase but the cumulative graph used to lay flat. Then one day, there would appear a steep slope in the graph, indicating the increase of total photo views.

1 Like

Hi @SadmanRafid

Respectfully, I have communicated about the delay you mentioned repeatedly over the years.

The news in this post is that when an update based on a recount becomes visible, I expected the recount to occur immediately before the data gets updated. What this post shows is that the recount happens some days prior to the new numbers become visible. Maybe I failed to explain this clearly.

All the best

Morten

1 Like

Hi,

My points have been frozen for about 6 months…
So my confidence is at an all time low.

Regards.