# Possible work around for reporting open and clicks without Bot data

**URL:** <https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989>\
**Category:** Ideas and Feature Requests\
**Created:** [November 11, 2020, 8:18pm UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989 "2020-11-11T20:18:43Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![harry5](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/harry5/32/902_2.png) [@harry5](https://forum.mautic.org/u/harry5)\
**Post date:** [November 11, 2020, 8:18pm UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/1 "2020-11-11T20:18:43Z")

</div>

Hi Guys

I guess that someone has posted this before but I couldn’t find it so thought I would share.

As you will be aware at the moment all reporting of opens and clicks currently delivers a number of false positives due to systems like Barracuda and Proofpoint opening them and clicking on the emails. while we can block IPs that we know are those used by these types of tool this will also remove any legitimate opens by the user.

having looked at the data I noticed that in most cases these opens/clicks happen almost instantly once the email has been delivered (within 1 minute if not seconds) of the sent time.

This got me thinking. through the report function there is an option to report on delay to open. If you add this option to the report and then add a filter that points to this fields and filter out any opens that happen within (say) 1 minute of the send I successfully managed to remove almost all of those bots from the report but still received data for those individuals who opened the email after it had passed through the receivers email filters.

It’s by no means perfect but thought I would share as it may help others having the same issue. Obviously, I am aware that this would also remove legitimate openers within 1 minute but in my experience, this is few and far between so providing me with better results.

If there are any other / better solutions out there I would be interested to learn how you guys are doing it.

I guess the ideal solution would be to add a setting in config that would allow you to filter out email bots by filtering out the 1st minute of known bot IP’s

thoughts?

---

<div class="post-metadata">

**Author:** ![joeyk](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/joeyk/32/11164_2.png) [@joeyk](https://forum.mautic.org/u/joeyk)\
**Post date:** [November 13, 2020, 5:19am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/2 "2020-11-13T05:19:46Z")

</div>

Don’t worry about the crickets sound here, people are excited about your suggestion.  
Thank you for sharing, it is a really great idea!  
Joey

---

<div class="post-metadata">

**Author:** ![robert.luna2020](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/robert.luna2020/32/3796_2.png) [@robert.luna2020](https://forum.mautic.org/u/robert.luna2020)\
**Post date:** [November 15, 2020, 11:35pm UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/3 "2020-11-15T23:35:19Z")

</div>

Thanks, @harry5.

What about the effect of the false positives on campaigns? In my campaign, the trigger is the non-opened action, with the false-positive, all emails are considered as open, so the campaign is useless. Any idea to solve this?

---

<div class="post-metadata">

**Author:** ![harry5](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/harry5/32/902_2.png) [@harry5](https://forum.mautic.org/u/harry5)\
**Post date:** [November 16, 2020, 7:13am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/4 "2020-11-16T07:13:44Z")

</div>

I wish I did. The same solution could apply to campaigns if there was a option to apply the same logic in configuration that would work across the whole of the platform.

I’m fortunately I’m not a dev otherwise I would have looked to build a Plug-in to do it.

---

<div class="post-metadata">

**Author:** ![dirk\_s](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/dirk_s/32/748_2.png) [@dirk\_s](https://forum.mautic.org/u/dirk_s)\
**Post date:** [August 23, 2021, 10:02am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/5 "2021-08-23T10:02:59Z")

</div>

iOS15 is right around the corner. This will increase this situation…  
Besides wrong statistics, I wonder what will happen to system load. Will Apple right away preloads thousands of images?

> **[What Mail Privacy Protection Means for Email Marketers \[UPDATED\] - Litmus](https://www.litmus.com/blog/apple-mail-privacy-protection-for-marketers/)**
>
> Find out how Apple’s Mail Privacy Protection may impact email marketing programs and what you can do now to optimize your emails.

---

<div class="post-metadata">

**Author:** ![adiux](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/adiux/32/5793_2.png) [@adiux](https://forum.mautic.org/u/adiux)\
**Post date:** [August 24, 2021, 7:01am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/6 "2021-08-24T07:01:03Z")

</div>

Thanks @harry5 and @dirk_s for sharing that.

The reporting of opens has always been an unreliable measurement. So I would not rely on that.

However, I rely heavily on click tracking. Luckily I did not see too many false positives there. What are your experiences?

---

<div class="post-metadata">

**Author:** ![joeyk](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/joeyk/32/11164_2.png) [@joeyk](https://forum.mautic.org/u/joeyk)\
**Post date:** [August 24, 2021, 8:28am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/7 "2021-08-24T08:28:21Z")

</div>

Those opens will be like the Dark Material in the Universe. You know its there, but can’t see it.

I think we need new metrics:

Sent | Opened | **Masked** | Clicked | Bounced | Complaint

Masked or Bot opens could be the ones, which open right away after sending.

Something similar was happening already in a smaller scale:  
We have a client who is a bank. We have to send a daily report in email every day to 300 decision makers as PDF. The open rate is 99%. The spam filter picks up each email and fires the tracking.

J

---

<div class="post-metadata">

**Author:** ![joeyk](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/joeyk/32/11164_2.png) [@joeyk](https://forum.mautic.org/u/joeyk)\
**Post date:** [August 24, 2021, 8:38am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/8 "2021-08-24T08:38:58Z")

</div>

You can see the opens by time:

[select](https://mariadb.com/kb/en/library/select/) email\_address, [time\_format](https://mariadb.com/kb/en/library/date-and-time-functions/#function_time-format)([timediff](https://mariadb.com/kb/en/library/date-and-time-functions/#function_timediff)(date\_sent,date\_read), ‘%H hrs, %i min.’) as timedifference from [email\_stats](https://mautic.joeykeller.com/fdba/index.php?username=mauticuser&db=mauticdb&table=email_stats) where date\_read !=“NULL” order by timedifference

Would be cool to set a treshhold saying “okay, anything under 2 seconds is a masked open, which means might or might not have happened”.

---

<div class="post-metadata">

**Author:** ![dirk\_s](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/dirk_s/32/748_2.png) [@dirk\_s](https://forum.mautic.org/u/dirk_s)\
**Post date:** [August 24, 2021, 9:38am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/9 "2021-08-24T09:38:40Z")

</div>

Do you have experience with secure link clicking of those solutions?  
Did you get false optins out of that? Usually we track clicks in mails as confirmation - as tracking a landingpage visit is unreliable, if people decide to “do not track” on the target landing page.

---

<div class="post-metadata">

**Author:** ![dirk\_s](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/dirk_s/32/748_2.png) [@dirk\_s](https://forum.mautic.org/u/dirk_s)\
**Post date:** [August 24, 2021, 9:40am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/10 "2021-08-24T09:40:47Z")

</div>

Sure. It now becomes even more obvious.

I’m more concerned about low powered Mautic instances, which will now be more likely be flodded with requests for images right after having sent the mail to many recipients. Wasn’t a problem before, when opening stretched across hours.

Definitely a situation to recheck some installations, if they can handle it.

---

<div class="post-metadata">

**Author:** ![joeyk](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/joeyk/32/11164_2.png) [@joeyk](https://forum.mautic.org/u/joeyk)\
**Post date:** [August 24, 2021, 9:47am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/11 "2021-08-24T09:47:38Z")

</div>

The click based double opt-in is anyway better as some people will open the confirmation email on the phone, and that disrupts the continuity on tracking.

---

<div class="post-metadata">

**Author:** ![adiux](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/adiux/32/5793_2.png) [@adiux](https://forum.mautic.org/u/adiux)\
**Post date:** [August 26, 2021, 6:13am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/12 "2021-08-26T06:13:05Z")

</div>

The caveat here is that you can only do that with campaign emails… Would be great if we can have “clicked email” as a segment filter.

---

<div class="post-metadata">

**Author:** ![adiux](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.mautic.org/adiux/32/5793_2.png) [@adiux](https://forum.mautic.org/u/adiux)\
**Post date:** [September 10, 2021, 10:08am UTC](https://forum.mautic.org/t/possible-work-around-for-reporting-open-and-clicks-without-bot-data/16989/13 "2021-09-10T10:08:48Z")

</div>

I also found this issue with relevant information on the topic: [Email Protection Systems Generate Invalid Traffic · Issue #9798 · mautic/mautic · GitHub](https://github.com/mautic/mautic/issues/9798)
