One of our backend databases is in the cloud. We lost our Fastconnect between our NY datacenter and the cloud location of this database, for about 30 minutes today. At around 10 minutes we decided to fail over to the backup IPSEC connection to be able to keep serving data to critical applications (Engage360 + Titan apps). The failover took approximately another 10 minutes (currently that specific process is manual, soon to be automated).
For the future, this should not be an issue. We are automating the failover for this specific site-to-site connection in the next 2 weeks. We are also in the process of migrating this specific database to our on-prem datacenter, eliminating this specific fail point altogether.