滚动总和直到达到某个值，加上计算的持续时间
Rolling sum till a certain value is reached, plus calculated duration
我有一个要求，我需要知道 sum(value) 何时达到某个点并计算持续时间。下面是示例 table.
create table sample (dt timestamp, value real);
insert into sample values
('2019-01-20 00:29:43 ',0.29)
,('2019-01-20 00:35:06 ',0.31)
,('2019-01-20 00:35:50 ',0.41)
,('2019-01-20 00:36:32 ',0.26)
,('2019-01-20 00:37:20 ',0.33)
,('2019-01-20 00:41:30 ',0.42)
,('2019-01-20 00:42:28 ',0.35)
,('2019-01-20 00:43:14 ',0.52)
,('2019-01-20 00:44:18 ',0.25);
现在我的要求是计算以下行的累计总和，以查看 sum(value) 何时达到 1.0 以上。这可能只需要 1 行或 n 行。到达该行后，我需要计算当前行与 sum(value) 达到 1.0 以上的行之间的时间差。
基本上我想要的输出格式如下。
对于第 1 行，累积 sum(value) 在第 3 行达到。
对于第 2 行，累积 sum(value) 达到第 4 行等
dt | value | sum(value)| time_at_sum(value)_1| Duration
---------------------+--------+------------------------------------------
2019-01-20 00:29:43| 0.29 | 1.01 | 2019-01-20 00:35:50 | 00:06:07
2019-01-20 00:35:06| 0.31 | 1.31 | 2019-01-20 00:37:20 | 00:02:14
2019-01-20 00:35:50| 0.41 | 1.00 | 2019-01-20 00:37:20 | 00:01:30
2019-01-20 00:36:32| 0.26 | 1.01 | 2019-01-20 00:41:30 | 00:04:58
2019-01-20 00:37:20| 0.33 | 1.10 | 2019-01-20 00:42:28 | 00:05:08
2019-01-20 00:41:30| 0.42 | 1.29 | 2019-01-20 00:43:14 | 00:01:44
2019-01-20 00:42:28| 0.35 | 1.12 | 2019-01-20 00:44:18 | 00:01:50
2019-01-20 00:43:14| 0.52 | NULL | - | -
2019-01-20 00:44:18| 0.25 | NULL | - | -
有人对如何处理上述要求有想法或指示吗？
WITH tmp AS (
SELECT *
, sum(value) OVER (ORDER BY dt rows between current row and unbounded following) as forward_sum
FROM sample
ORDER BY dt)
SELECT t1.dt, t1.value
, (t2.value + t1.forward_sum - t2.forward_sum) as "sum(value)"
, t2.dt as "time_at_sum(value)_1"
, t2.dt - t1.dt as "Duration"
FROM tmp t1
LEFT JOIN LATERAL (
SELECT *
FROM tmp t
WHERE t1.forward_sum - t.forward_sum < 1
AND (t.value + t1.forward_sum - t.forward_sum) >= 0.999
ORDER BY dt DESC
LIMIT 1
) t2
ON TRUE
产量
| dt | value | sum(value) | time_at_sum(value)_1 | Duration |
|---------------------+-------+------------+----------------------+----------|
| 2019-01-20 00:29:43 | 0.29 | 1.01 | 2019-01-20 00:35:50 | 00:06:07 |
| 2019-01-20 00:35:06 | 0.31 | 1.31 | 2019-01-20 00:37:20 | 00:02:14 |
| 2019-01-20 00:35:50 | 0.41 | 1 | 2019-01-20 00:37:20 | 00:01:30 |
| 2019-01-20 00:36:32 | 0.26 | 1.01 | 2019-01-20 00:41:30 | 00:04:58 |
| 2019-01-20 00:37:20 | 0.33 | 1.1 | 2019-01-20 00:42:28 | 00:05:08 |
| 2019-01-20 00:41:30 | 0.42 | 1.29 | 2019-01-20 00:43:14 | 00:01:44 |
| 2019-01-20 00:42:28 | 0.35 | 1.12 | 2019-01-20 00:44:18 | 00:01:50 |
| 2019-01-20 00:43:14 | 0.52 | | | |
| 2019-01-20 00:44:18 | 0.25 | | | |
首先计算 value 列的累计和：
SELECT *
, sum(value) OVER (ORDER BY dt rows between current row and unbounded following) as forward_sum
FROM sample
ORDER BY dt
产生
| dt | value | forward_sum |
|---------------------+-------+-------------|
| 2019-01-20 00:29:43 | 0.29 | 3.14 |
| 2019-01-20 00:35:06 | 0.31 | 2.85 |
| 2019-01-20 00:35:50 | 0.41 | 2.54 |
| 2019-01-20 00:36:32 | 0.26 | 2.13 |
| 2019-01-20 00:37:20 | 0.33 | 1.87 |
| 2019-01-20 00:41:30 | 0.42 | 1.54 |
| 2019-01-20 00:42:28 | 0.35 | 1.12 |
| 2019-01-20 00:43:14 | 0.52 | 0.77 |
| 2019-01-20 00:44:18 | 0.25 | 0.25 |
请注意，从 forward_sum 中减去两个值对应于 value 秒的部分和。
例如，
0.29 + 0.31 + 0.41 = 3.14 - 2.13
所以 forward_sums 的差异将发挥重要作用，我们要将这些差异与 1 进行比较。我们要将此 table 与其自身相结合，使用像这样的连接条件：
t1.forward_sum - t.forward_sum < 1
让我们看看如果我们使用 LEFT JOIN LATERAL 会发生什么。了解 LEFT JOIN LATERAL 的关键是 LATERAL 连接右侧的子查询 :
WITH tmp AS (
SELECT *
, sum(value) OVER (ORDER BY dt rows between current row and unbounded following) as forward_sum
FROM sample
ORDER BY dt)
SELECT t1.*, t2.*
FROM tmp t1
LEFT JOIN LATERAL (
SELECT *
FROM tmp t
WHERE t1.forward_sum - t.forward_sum < 1
ORDER BY dt DESC
LIMIT 1
) t2
ON TRUE
产量
| dt | value | forward_sum | dt | value | forward_sum |
|---------------------+-------+-------------+---------------------+-------+-------------|
| 2019-01-20 00:29:43 | 0.29 | 3.14 | 2019-01-20 00:35:50 | 0.41 | 2.54 |
| 2019-01-20 00:35:06 | 0.31 | 2.85 | 2019-01-20 00:37:20 | 0.33 | 1.87 |
| 2019-01-20 00:35:50 | 0.41 | 2.54 | 2019-01-20 00:37:20 | 0.33 | 1.87 |
| 2019-01-20 00:36:32 | 0.26 | 2.13 | 2019-01-20 00:41:30 | 0.42 | 1.54 |
| 2019-01-20 00:37:20 | 0.33 | 1.87 | 2019-01-20 00:42:28 | 0.35 | 1.12 |
| 2019-01-20 00:41:30 | 0.42 | 1.54 | 2019-01-20 00:43:14 | 0.52 | 0.77 |
| 2019-01-20 00:42:28 | 0.35 | 1.12 | 2019-01-20 00:44:18 | 0.25 | 0.25 |
| 2019-01-20 00:43:14 | 0.52 | 0.77 | 2019-01-20 00:44:18 | 0.25 | 0.25 |
| 2019-01-20 00:44:18 | 0.25 | 0.25 | 2019-01-20 00:44:18 | 0.25 | 0.25 |
请注意，我们已经猜到了符合条件的连接条件
想要的日期。现在只需将正确的值表达式组合到
获得所需的列，sum(value)，time_at_sum(value)_1。
一种有效解决此问题的方法是一种带有两个游标的程序解决方案：
一 explicit cursor and another implicit cursor of the FOR loop:
CREATE OR REPLACE FUNCTION foo()
RETURNS TABLE (dt timestamp
, val real
, sum_value real
, time_at_sum timestamp
, duration interval) AS
$func$
DECLARE
_bound real := 1.0; -- your bound here
cur CURSOR FOR SELECT * FROM sample s ORDER BY s.dt; -- in chronological order
s sample; -- cursor row
BEGIN
OPEN cur;
FETCH cur INTO time_at_sum, sum_value; -- fetch first row into target
FOR dt, val IN -- primary pass over table
SELECT x.dt, x.value FROM sample x ORDER BY s.dt
LOOP
WHILE sum_value <= _bound LOOP
FETCH cur INTO s;
IF NOT FOUND THEN -- end of table
sum_value := NULL; time_at_sum := NULL;
EXIT; -- exits inner loop
END IF;
sum_value := sum_value + s.value;
END LOOP;
IF sum_value > _bound THEN -- to catch end-of-table
time_at_sum := s.dt;
END IF;
duration := time_at_sum - dt;
RETURN NEXT;
sum_value := sum_value - val; -- subtract previous row before moving on
END LOOP;
END
$func$ LANGUAGE plpgsql;
致电：
SELECT * FROM foo();
db<>fiddle here
应该表现不错，因为它只需要在 table 上扫描 2 次。
请注意，我按照您的描述要求实施了 > _bound，而不是您的结果表明的 >= _bound。易于更改。
假定值列为 NOT NULL。
相关：
- Window Functions or Common Table Expressions: count previous rows within range
我有一个要求，我需要知道 sum(value) 何时达到某个点并计算持续时间。下面是示例 table.
create table sample (dt timestamp, value real);
insert into sample values
('2019-01-20 00:29:43 ',0.29)
,('2019-01-20 00:35:06 ',0.31)
,('2019-01-20 00:35:50 ',0.41)
,('2019-01-20 00:36:32 ',0.26)
,('2019-01-20 00:37:20 ',0.33)
,('2019-01-20 00:41:30 ',0.42)
,('2019-01-20 00:42:28 ',0.35)
,('2019-01-20 00:43:14 ',0.52)
,('2019-01-20 00:44:18 ',0.25);
现在我的要求是计算以下行的累计总和，以查看 sum(value) 何时达到 1.0 以上。这可能只需要 1 行或 n 行。到达该行后，我需要计算当前行与 sum(value) 达到 1.0 以上的行之间的时间差。
基本上我想要的输出格式如下。
对于第 1 行，累积 sum(value) 在第 3 行达到。
对于第 2 行，累积 sum(value) 达到第 4 行等
dt | value | sum(value)| time_at_sum(value)_1| Duration
---------------------+--------+------------------------------------------
2019-01-20 00:29:43| 0.29 | 1.01 | 2019-01-20 00:35:50 | 00:06:07
2019-01-20 00:35:06| 0.31 | 1.31 | 2019-01-20 00:37:20 | 00:02:14
2019-01-20 00:35:50| 0.41 | 1.00 | 2019-01-20 00:37:20 | 00:01:30
2019-01-20 00:36:32| 0.26 | 1.01 | 2019-01-20 00:41:30 | 00:04:58
2019-01-20 00:37:20| 0.33 | 1.10 | 2019-01-20 00:42:28 | 00:05:08
2019-01-20 00:41:30| 0.42 | 1.29 | 2019-01-20 00:43:14 | 00:01:44
2019-01-20 00:42:28| 0.35 | 1.12 | 2019-01-20 00:44:18 | 00:01:50
2019-01-20 00:43:14| 0.52 | NULL | - | -
2019-01-20 00:44:18| 0.25 | NULL | - | -
有人对如何处理上述要求有想法或指示吗？
WITH tmp AS (
SELECT *
, sum(value) OVER (ORDER BY dt rows between current row and unbounded following) as forward_sum
FROM sample
ORDER BY dt)
SELECT t1.dt, t1.value
, (t2.value + t1.forward_sum - t2.forward_sum) as "sum(value)"
, t2.dt as "time_at_sum(value)_1"
, t2.dt - t1.dt as "Duration"
FROM tmp t1
LEFT JOIN LATERAL (
SELECT *
FROM tmp t
WHERE t1.forward_sum - t.forward_sum < 1
AND (t.value + t1.forward_sum - t.forward_sum) >= 0.999
ORDER BY dt DESC
LIMIT 1
) t2
ON TRUE
产量
| dt | value | sum(value) | time_at_sum(value)_1 | Duration |
|---------------------+-------+------------+----------------------+----------|
| 2019-01-20 00:29:43 | 0.29 | 1.01 | 2019-01-20 00:35:50 | 00:06:07 |
| 2019-01-20 00:35:06 | 0.31 | 1.31 | 2019-01-20 00:37:20 | 00:02:14 |
| 2019-01-20 00:35:50 | 0.41 | 1 | 2019-01-20 00:37:20 | 00:01:30 |
| 2019-01-20 00:36:32 | 0.26 | 1.01 | 2019-01-20 00:41:30 | 00:04:58 |
| 2019-01-20 00:37:20 | 0.33 | 1.1 | 2019-01-20 00:42:28 | 00:05:08 |
| 2019-01-20 00:41:30 | 0.42 | 1.29 | 2019-01-20 00:43:14 | 00:01:44 |
| 2019-01-20 00:42:28 | 0.35 | 1.12 | 2019-01-20 00:44:18 | 00:01:50 |
| 2019-01-20 00:43:14 | 0.52 | | | |
| 2019-01-20 00:44:18 | 0.25 | | | |
首先计算 value 列的累计和：
SELECT *
, sum(value) OVER (ORDER BY dt rows between current row and unbounded following) as forward_sum
FROM sample
ORDER BY dt
产生
| dt | value | forward_sum |
|---------------------+-------+-------------|
| 2019-01-20 00:29:43 | 0.29 | 3.14 |
| 2019-01-20 00:35:06 | 0.31 | 2.85 |
| 2019-01-20 00:35:50 | 0.41 | 2.54 |
| 2019-01-20 00:36:32 | 0.26 | 2.13 |
| 2019-01-20 00:37:20 | 0.33 | 1.87 |
| 2019-01-20 00:41:30 | 0.42 | 1.54 |
| 2019-01-20 00:42:28 | 0.35 | 1.12 |
| 2019-01-20 00:43:14 | 0.52 | 0.77 |
| 2019-01-20 00:44:18 | 0.25 | 0.25 |
请注意，从 forward_sum 中减去两个值对应于 value 秒的部分和。
例如，
0.29 + 0.31 + 0.41 = 3.14 - 2.13
所以 forward_sums 的差异将发挥重要作用，我们要将这些差异与 1 进行比较。我们要将此 table 与其自身相结合，使用像这样的连接条件：
t1.forward_sum - t.forward_sum < 1
让我们看看如果我们使用 LEFT JOIN LATERAL 会发生什么。了解 LEFT JOIN LATERAL 的关键是 LATERAL 连接右侧的子查询
WITH tmp AS (
SELECT *
, sum(value) OVER (ORDER BY dt rows between current row and unbounded following) as forward_sum
FROM sample
ORDER BY dt)
SELECT t1.*, t2.*
FROM tmp t1
LEFT JOIN LATERAL (
SELECT *
FROM tmp t
WHERE t1.forward_sum - t.forward_sum < 1
ORDER BY dt DESC
LIMIT 1
) t2
ON TRUE
产量
| dt | value | forward_sum | dt | value | forward_sum |
|---------------------+-------+-------------+---------------------+-------+-------------|
| 2019-01-20 00:29:43 | 0.29 | 3.14 | 2019-01-20 00:35:50 | 0.41 | 2.54 |
| 2019-01-20 00:35:06 | 0.31 | 2.85 | 2019-01-20 00:37:20 | 0.33 | 1.87 |
| 2019-01-20 00:35:50 | 0.41 | 2.54 | 2019-01-20 00:37:20 | 0.33 | 1.87 |
| 2019-01-20 00:36:32 | 0.26 | 2.13 | 2019-01-20 00:41:30 | 0.42 | 1.54 |
| 2019-01-20 00:37:20 | 0.33 | 1.87 | 2019-01-20 00:42:28 | 0.35 | 1.12 |
| 2019-01-20 00:41:30 | 0.42 | 1.54 | 2019-01-20 00:43:14 | 0.52 | 0.77 |
| 2019-01-20 00:42:28 | 0.35 | 1.12 | 2019-01-20 00:44:18 | 0.25 | 0.25 |
| 2019-01-20 00:43:14 | 0.52 | 0.77 | 2019-01-20 00:44:18 | 0.25 | 0.25 |
| 2019-01-20 00:44:18 | 0.25 | 0.25 | 2019-01-20 00:44:18 | 0.25 | 0.25 |
请注意，我们已经猜到了符合条件的连接条件
想要的日期。现在只需将正确的值表达式组合到
获得所需的列，sum(value)，time_at_sum(value)_1。
一种有效解决此问题的方法是一种带有两个游标的程序解决方案：
一 explicit cursor and another implicit cursor of the FOR loop:
CREATE OR REPLACE FUNCTION foo()
RETURNS TABLE (dt timestamp
, val real
, sum_value real
, time_at_sum timestamp
, duration interval) AS
$func$
DECLARE
_bound real := 1.0; -- your bound here
cur CURSOR FOR SELECT * FROM sample s ORDER BY s.dt; -- in chronological order
s sample; -- cursor row
BEGIN
OPEN cur;
FETCH cur INTO time_at_sum, sum_value; -- fetch first row into target
FOR dt, val IN -- primary pass over table
SELECT x.dt, x.value FROM sample x ORDER BY s.dt
LOOP
WHILE sum_value <= _bound LOOP
FETCH cur INTO s;
IF NOT FOUND THEN -- end of table
sum_value := NULL; time_at_sum := NULL;
EXIT; -- exits inner loop
END IF;
sum_value := sum_value + s.value;
END LOOP;
IF sum_value > _bound THEN -- to catch end-of-table
time_at_sum := s.dt;
END IF;
duration := time_at_sum - dt;
RETURN NEXT;
sum_value := sum_value - val; -- subtract previous row before moving on
END LOOP;
END
$func$ LANGUAGE plpgsql;
致电：
SELECT * FROM foo();
db<>fiddle here
应该表现不错，因为它只需要在 table 上扫描 2 次。
请注意，我按照您的描述要求实施了 > _bound，而不是您的结果表明的 >= _bound。易于更改。
假定值列为 NOT NULL。
相关：
- Window Functions or Common Table Expressions: count previous rows within range