按时间戳聚合

Question

搜索引擎优化>搜索引擎优化>支付1 支付>支付>加盟>支付1 搜索引擎优化>加盟1I有一个查询，导致包含客户ID号码，营销渠道，时间戳和购买日期的数据。所以，结果可能看起来像这样。

id marketingChannel TimeStamp  Transaction_date 
1 SEO    5/18 23:11:43 5/18 
1 SEO    5/18 24:12:43 5/18 
1 Paid    5/18 24:13:43 5/18 
2 Paid    5/18 24:12:43 5/18 
2 Paid    5/18 24:14:43 5/18 
2 Affiliate  5/18 24:20:43 5/18 
2 Paid    5/18 24:22:43 5/18 
3 SEO    5/18 24:10:43 5/18 
3 Affiliate  5/18 24:11:43 5/18 

我想知道是否有一个查询以显示营销路径计数的方式聚合这些信息。

例如。

Marketing Path     Count 
SEO > SEO > Paid     1 
Paid > Paid > Affiliate > Paid 1 
SEO > Affiliate     1 

我正在考虑写一个Python脚本来获取此信息，但我不知道是否有在SQL一个简单的解决方案 - 因为我不是SQL作为framiliar。

Answer 1

几年前，我需要一个类似的结果，我测试了不同的方式在Teradata中获得连接字符串。顺便说一句，如果行数太高而连接的字符串超过64000个字符，则所有行都可能失败。

最有效的是一个用户定义函数（用C语言编写）：

SELECT 
    PATH 
    ,COUNT(*) 
FROM 
(
    SELECT 
     DelimitedBuildSorted(MARKETINGCHANNEL 
          ,CAST(CAST(ts AS FORMAT 'yyyymmddhhmiss') AS VARCHAR(14)) 
          ,'>') AS PATH 
    FROM t 
    GROUP BY id 
) AS dt 
GROUP BY 1; 

如果您需要经常和/或在一个大表，你会跟你的DBA运行查询，如果一个UDF是可能的（大多数DBA不喜欢它们，因为它们是用他们不知道的语言编写的，C）。

如果每个ID的平均行数很低，递归可能是正常的。 Joseph B的版本可能会稍微简化一些，但最重要的是创建一个临时表，而不是使用视图或派生表进行ROW_NUMBER计算。这导致一个更好的计划（在SQL Server中，太）：

CREATE VOLATILE TABLE vt AS 
(
    SELECT 
     id 
    ,MarketingChannel 
    ,ROW_NUMBER() OVER (PARTITION BY id ORDER BY TS DESC) AS rn 
    ,COUNT(*) OVER (PARTITION BY id) AS max_rn 
    FROM t 
) WITH DATA 
PRIMARY INDEX (id) 
ON COMMIT PRESERVE ROWS; 

WITH RECURSIVE cte(id, path, rn) AS 
(
    SELECT 
     id, 

     -- modify VARCHAR size to fit your maximum number of rows, that's better than VARCHAR(64000) 
     CAST(MarketingChannel AS VARCHAR(10000)) AS PATH, 
     rn 
    FROM vt 
    WHERE rn = max_rn 
    UNION ALL 
    SELECT 
     cte.ID, 
     cte.PATH || '>' || vt.MarketingChannel, 
     cte.rn-1 
    FROM vt JOIN cte 
    ON vt.id = cte.id 
    AND vt.rn = cte.rn - 1 
) 
SELECT 
    PATH, 
    COUNT(*) 
FROM cte 
WHERE rn = 1 
GROUP BY path 
ORDER BY PATH 
; 

你也可以试试老派MAX（CASE）：

SELECT 
    PATH 
    ,COUNT(*) 
FROM 
(
    SELECT 
     id 
    ,MAX(CASE WHEN rnk = 0 THEN MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 1 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 2 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 3 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 4 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 5 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 6 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 7 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 8 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 9 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 10 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 11 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 12 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 13 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 14 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 15 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 16 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 17 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 18 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 19 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 20 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 21 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 22 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 23 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 24 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 25 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 26 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 27 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 28 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 29 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 30 THEN '>' || MarketingChannel ELSE '' END) || 
     MAX(CASE WHEN rnk = 31 THEN '>' || MarketingChannel ELSE '' END) AS PATH 
    FROM 
    (
    SELECT 
     id 
     ,TRIM(MarketingChannel) AS MarketingChannel 
     ,RANK() OVER (PARTITION BY id 
        ORDER BY TS) -1 AS rnk 
    FROM t 
    ) dt 
    GROUP BY 1 
) AS dt 
GROUP BY 1; 

我有多达Concat的每30个字符2048行:-)

SELECT 
    PATH 
    ,COUNT(*) 
FROM 
(
    SELECT 
     id 
    ,MAX(CASE WHEN rnk MOD 16 = 0 THEN path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 1 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 2 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 3 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 4 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 5 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 6 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 7 THEN '>' || path ELSE '' END) AS PATH 
    FROM 
    (
    SELECT 
     id 
     ,rnk/16 AS rnk 
     ,MAX(CASE WHEN rnk MOD 16 = 0 THEN path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 1 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 2 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 3 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 4 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 5 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 6 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 7 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 8 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 9 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 10 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 11 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 12 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 13 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 14 THEN '>' || path ELSE '' END) || 
     MAX(CASE WHEN rnk MOD 16 = 15 THEN '>' || path ELSE '' END) AS path 
    FROM 
     (
     SELECT 
      id 
     ,rnk/16 AS rnk 
     ,MAX(CASE WHEN rnk MOD 16 = 0 THEN path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 1 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 2 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 3 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 4 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 5 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 6 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 7 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 8 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 9 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 10 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 11 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 12 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 13 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 14 THEN '>' || path ELSE '' END) || 
      MAX(CASE WHEN rnk MOD 16 = 15 THEN '>' || path ELSE '' END) AS path 
     FROM 
     (
     SELECT 
      id 
      ,TRIM(MarketingChannel) AS PATH 
      ,RANK() OVER (PARTITION BY id 
         ORDER BY TS) -1 AS rnk 
     FROM t 
     ) dt 
     GROUP BY 1,2 
    ) dt 
    GROUP BY 1,2 
    ) dt 
    GROUP BY 1 
) dt 
GROUP BY 1 

Answer 2

假设MySQL的：

select 
path, count(*) from (
    select 
    id, group_concat(marketingChannel separator ' > ') as path 
    from 
    t 
    group by id 
) sq 
group by path 

• 看到它在sqlfiddle

Answer 3

这里的带电作业是一个查询，已与SQL Server进行测试。同样的语法应与Teradata的合作，以及：

编辑：

转换多个CTE对一个CTE：

WITH RECURSIVE Single_Path (CURRENT_ID, CURRENT_PATH, CURRENT_TS, rn) AS 
(
    SELECT 
    ID CURRENT_ID, 
    CAST(MARKETINGCHANNEL AS VARCHAR(MAX)) CURRENT_PATH, 
    TIMESTAMP CURRENT_TS, 
    1 RN 
    FROM 
    (
    SELECT 
     id, 
     marketingChannel, 
     TimeStamp, 
     ROW_NUMBER() OVER (PARTITION BY id ORDER BY TimeStamp DESC) rn 
    FROM T 
) Ordered_Data 
    WHERE RN = 1 
    UNION ALL 
    SELECT 
    ID, 
    CAST(MARKETINGCHANNEL + ' > ' + CURRENT_PATH AS VARCHAR(MAX)), 
    TIMESTAMP, 
    sp.rn+1 
    FROM 
    (
    SELECT 
     id, 
     marketingChannel, 
     TimeStamp, 
     ROW_NUMBER() OVER (PARTITION BY id ORDER BY TimeStamp DESC) rn 
    FROM T 
) ORDERED_DATA od, Single_Path sp 
    WHERE od.id = sp.Current_id 
    AND od.rn = sp.rn + 1 
) 
SELECT 
    sp2.CURRENT_PATH MARKETING_PATH, 
    COUNT(*) COUNT 
FROM Single_Path sp2 
INNER JOIN 
(
    SELECT 
    ID, 
    MAX(rn) max_rn 
    FROM Ordered_Data 
    GROUP BY ID 
) MR 
ON SP2.CURRENT_ID = MR.ID AND SP2.RN = MR.MAX_RN 
GROUP BY SP2.CURRENT_PATH 
ORDER BY sp2.CURRENT_PATH; 

SQL Fiddle demo

参考：

Fun with Recursive SQL (Part 1) on Sharpening Stones blog