Snowcannon: Synchronous Data Replication in FDB - Markus Pilman + David Youngworth
805 views · Published 20 December 2018 · 19:29 · Indexed 20 September 2026
Channel: The Linux Foundation · 2018 · Science & Technology
The current FDB disaster recovery solution uses asynchronous replication, therefore failover might result in data loss. For Snowflake, this is an unacceptable business risk. Snowcannon is a synchronous, distributed queueing system built within FDB. An FDB cluster can synchronously replicate transactions to Snowcannon, and Snowcannon asychronously pushes these transactions to a secondary cluster. The queueing system has three benefits: (1) It can replay rollbacks and redos (2) It allows us to bring down the secondary cluster for maintenance while the primary remains online. (3) In the event that both primary and secondary cluster fails, it allows recovery from backups with zero data loss. This talk will go over the design of Snowcannon, including the replication protocol, failover switch, queueing architecture, and the quorum protocol.
More from this channel
-
5:19
The Linux Foundation Video Site:: Flock
-
5:51
The Linux Foundation Video Site:: Debian & Cooliris
-
6:09
The Linux Foundation Video Site:: Slackware Linux
-
1:57
The Linux Foundation Video Site:: Bdale Garbee (Hewlett-Pack
-
1:12
The Linux Foundation Video Site:: James Morris (Red Hat) at
-
2:03
The Linux Foundation Video Site:: Bowling for Penguins
-
1:37
Linux: Be a Part of Something Big
-
1:02:32
Collaboration Summit 2013 - Panel: Hot Topics in File & Storage Systems and Memory Management