mysql 查询运行和处理需要 3 小时

Question

我有一个查询运行在深夜的 cron 作业上。然后通过生成器处理此查询，因为它必须填充另一个数据库，并且在将其发送到另一个数据库之前我进行了一些额外的处理和检查。

我想知道我是否可以加快此查询的速度并希望将其保留为单个查询。还是我会被迫创建其他查询并加入 PHP 内的数据？这会查询主要的 mautic 数据库。

SELECT  c.id as "campaign_id",
        c.created_by_user,
        c.name,
        c.date_added,
        c.date_modified,
        (SELECT DISTINCT COUNT(cl.lead_id)) as number_of_leads,
        GROUP_CONCAT(lt.tag) as tags,
        cat.title as category_name,
        GROUP_CONCAT(ll.name) as segment_name,
        GROUP_CONCAT(emails.name) as email_name,
        CASE WHEN c.is_published = 1 THEN "Yes" ELSE "No" END AS "published",
        CASE WHEN c.publish_down > now() THEN "Yes" 
             WHEN c.publish_down > now() AND c.is_published = 0 THEN "Yes" 
             ELSE "No" END AS "expired"
FROM campaigns c 
    LEFT JOIN campaign_leads cl ON cl.campaign_id = c.id
    LEFT JOIN lead_tags_xref ltx on cl.lead_id = ltx.lead_id 
    LEFT JOIN lead_tags lt on ltx.tag_id = lt.id 
    LEFT JOIN categories cat on c.category_id = cat.id 
    LEFT JOIN lead_lists_leads llist on cl.lead_id = llist.lead_id 
    LEFT JOIN lead_lists ll on llist.leadlist_id = ll.id 
    LEFT JOIN email_list_xref el on ll.id = el.leadlist_id 
    LEFT JOIN emails on el.email_id = emails.id 
GROUP BY c.id;

这是解释的图片 https://prnt.sc/qQtUaLK3FIpQ

定义活动 Table： https://prnt.sc/6JXRGyMsWpcd

Campaign_leads table https://prnt.sc/pOq0_SxW2spe

lead_tags_xref table https://prnt.sc/oKYn92O82gHL

lead_tags table https://prnt.sc/ImH81ECF6Ly1

类别table https://prnt.sc/azQj_Xwq3dw9

lead_lists_lead table https://prnt.sc/x5C5fiBFP2N7

lead_lists table https://prnt.sc/bltkM0f3XeaH

email_list_xref table https://prnt.sc/kXABVJSYWEUI

电子邮件 table https://prnt.sc/7fZcBir1a6QT

我只希望完成 871 行，我已经确定连接可以非常大，以数万计。

Answer 1

你好像有一个没用的 select DISTINTC .. 你能找一个 conut(distinct .. )
通过这种方式，您可以避免 main select ..

中每一行的嵌套 select

SELECT  c.id as "campaign_id",
        c.created_by_user,
        c.name,
        c.date_added,
        c.date_modified,
        COUNT(DISTINCT cl.lead_id) as number_of_leads,
        GROUP_CONCAT(lt.tag) as tags,
        cat.title as category_name,
        GROUP_CONCAT(ll.name) as segment_name,
        GROUP_CONCAT(emails.name) as email_name,
        CASE WHEN c.is_published = 1 THEN "Yes" ELSE "No" END AS "published",
        CASE WHEN c.publish_down > now() THEN "Yes" 
             WHEN c.publish_down > now() AND c.is_published = 0 THEN "Yes" 
             ELSE "No" END AS "expired"
FROM campaigns c 
    LEFT JOIN campaign_leads cl ON cl.campaign_id = c.id
    LEFT JOIN lead_tags_xref ltx on cl.lead_id = ltx.lead_id 
    LEFT JOIN lead_tags lt on ltx.tag_id = lt.id 
    LEFT JOIN categories cat on c.category_id = cat.id 
    LEFT JOIN lead_lists_leads llist on cl.lead_id = llist.lead_id 
    LEFT JOIN lead_lists ll on llist.leadlist_id = ll.id 
    LEFT JOIN email_list_xref el on ll.id = el.leadlist_id 
    LEFT JOIN emails on el.email_id = emails.id 
GROUP BY c.id;

无论如何请确保您在

上有一个合适的复合索引

table campaign_leads columns campaign_id, lead_id
table lead_tags_xref columns lead_id, tag_id
table lead_lists_leads columns lead_id, leadlist_id
table email_list_xref columns leadlist_id, email_id

mysql 查询运行和处理需要 3 小时

mysql query takes 3 hours to run and process

mysql

query-optimization

mysql 查询 运行 和处理需要 3 小时

mysql query takes 3 hours to run and process

mysql

query-optimization

mysql 查询运行和处理需要 3 小时