Grafana dashboard showing the peak rows per second inserted into BigQuery. Not very easy to describe in text - sorry!
https://files.mastodon.social/media_attachments/files/116/928/859/420/775/911/original/a5024993a874b1f9.png
England Vs Argentina last night was *busy*! Easily the busiest ever live event on the BBC (I can't give you streaming stats, sorry).
On my logging pipeline (subset of BBC logs):
- Peak: 2.2M row/s (105GB/s)
- Total: 20.1B rows (16.4TB), 2.7M log files
- 0 write fails
- 0 duplicated rows
- Peak: 1035 Cloud Run containers @ 2x CPU each ∴ 2070 CPU
Best bit is that we did precisely nothing, it all just worked.
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.