TLDR: I made a feature request, but want to gather feedback on this feature.
So there you are sitting at your desk.
After an all nighter, Mautic is running smoothly on a dedicated server with all 12 cores humming quietly at 8% utilization, 128 Gb of memory hovering nil … terabytes of SSD space is eagerly awaiting some I/O.
You are ready to upload some contacts. You have set monster limits in your php.ini so you can really cram the contacts in there.
Mariadb has been tuned for performance by the top Serbian Sys Admin on Fiverr .
Your experience devil tells you “ lets see what it will do if we try to upload a million contacts at once.”
Your experience angel says “ take it easy… try 20,000 contacts. You have 156 fields to map.”
You sip some coffee, brush off the experience devil and wink at your experience angel. 20,000 contacts it is.
Click. Upload, Click. Wait. Ok time to map the fields. You were smart. When you created the custom fields you named as many as you could the same as the header of your CSV so mautic matches those automatically.
You clever B@stard.
You scan over the mapped fields one more time. Less than half matched automatically, the rest you had to select manually. Click…
Contacts are uploading…
When its done… you click the upload history and on the file name and some tasty stats appear. Dang… 9.48 Contacts per second. Sweet…
Let’s do another. Click. Click… 5 minutes of clicking. About 40 minutes later another one is done… Do 10 more uploads… Lets check data…do some averages.
Oh…crrrrrrrraaaaaapppp.
Lets do some math. You have 61,000,000 global contacts
That’s 3050 CSV files @20,000
Lets say 5 minutes per file to upload and map the fields.
40 minutes processing.
Oh… 137,250 minutes
2287.5 hours
95 days of 24/7 Uploading
228 days if you do nothing but this 10 hours a day
Now, you are no dummy.
You don’t sit and watch uploads…
You upload file, map fields, then upload in the background so you can upload the next file. Let the cron jobs trigger the next upload.
Can’t speed up the server much.
Zapier has its limits too…
What would help this process?
Having the ability to save the field mapping of course. SuiteCRM (booo)
does it.
Upload file, map fields, name the mapping, click upload. The next time you upload. It’s literally a 3 click operation. Go crons go…
Do you think this would be a great mautic feature for your own uses?
Lets discuss
