Commit 8e89eb7
authored
Added time-based filters to the mv_session_data pipe (#25708)
ref
https://linear.app/ghost/issue/NY-865/analytics-sources-not-populating-for-tangle-due-to-408-timeouts
All of the Tinybird endpoints have date-based filters on them. They also
are mostly all based on the mv_session_data pipe, but the date filters
aren't passed to the mv_session_data pipe at all. This means that
Clickhouse has to run the mv_session_data pipe against all events for a
particular site across all time, even if it's only going to return the
last 30 days in the finished result.
Adding the time filters to the mv_session_data pipe should reduce the
amount of data that Clickhouse has to scan when any of the endpoints
that use it are called, thus improving the performance of any endpoint
that depends on it.1 parent afbcc15 commit 8e89eb7
File tree
1 file changed
+6
-0
lines changed- ghost/core/core/server/data/tinybird/pipes
1 file changed
+6
-0
lines changedLines changed: 6 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
21 | 27 | | |
22 | 28 | | |
23 | 29 | | |
| |||
0 commit comments