Mautic segment update is taking too long

[anil_naut111]

Your software
My PHP version is : 7.4.29
My MySQL/MariaDB version is (delete as applicable): MySQL/MariaDB version 5.7.42
SERVER: GCP compute engine vCPUs 2 Memory 7.5 GB

Your problem
My problem is : Segment update cron task(php /var/www/html/mautic/bin/console mautic:segments:update) is taking too much time to update, so I want to know is this dependent on number of filters I am using, or what things can be impacting this.

Filter I am using

Steps I have tried to fix the problem :

[joeyk]

Hi, it depends how large is your DB, especially your leads (leads) and sent emails list (email_stats).
Also: depends how many segments you have.
BTW how often you run segment update via cron?

Joey

[anil_naut111]

Hello @joeyk we run segment update daily. Our DB size is 20GB, and we have 10 segments.

Anil

[joeyk]

How many identified contacts (with email) you have in your system?

[anil_naut111]

We have 225570 identified contacts (with email).

[joeyk]

Hello,
That is not a huge about of segments.
Could you please show here the cronjob command you use for segment update?
It would be nice to see how often you run it.
Joey

[anil_naut111]

Hello, here is the segment update commend and we run it daily once.

php /var/www/html/mautic/bin/console mautic:segments:update

Thanks

[mzagmajster]

can you turn off the cronjob for the time being and try to run command directly in terminal.

See if any issues display in stdout. Also follow the log and see if any entries pop up when you run update manually.

[joeyk]

Could you share the values BEFORE the php?
is it * * * * * or rather 0,15,30,45 * * * * or maybe */5 * * * *?

[anil_naut111]

@joeyk we are running it manually as it same on ssh, not as cron commend.
php /var/www/html/mautic/bin/console mautic:segments:update

[joeyk]

Okay, we are getting there.
How long it takes until it runs for 200.000 contacts.
I did a similar task yesterday it was 40 min, but we had 200k contacts assigned to different segments the first time.
If you run it again, only the changes will be updated, and it’s really fast.

[anil_naut111]

Hello @joeyk I am curious will email_stats table size can slow down the segment update.

And will this help https://joeykeller.com/the-great-mautic-weight-control/ in mautic segment update.

One more point as we have implemented mautic as multitenancy way(single code instance and multiple DB), is this may be the reason of our mautic segment update slowdown.

In total we have 15 mautic runnig from the same code instance, and total DB size is 400GB

Thanks.

[joeyk]

Yeah for sure. Problems arise exponentially as your DB grows.

[anil_naut111]

Thanks @joeyk I will try this then I hope things will get sorted.