Using External Persistent Volumes to Reduce Recovery Times and Achieve High Availability on DC/OS

244 views · Published 31 October 2017 · 40:47 · Indexed 23 October 2026

Channel: The Linux Foundation · 2017 · Science & Technology

Watch on YouTube

Using External Persistent Volumes to Reduce Recovery Times and Achieve High Availability on DC/OS - Dinesh Israni, Portworx Inc

Most modern distributed applications like Cassandra and HDFS provide replication of data across nodes and failure zones to be able to deal with failures. But the time taken to recover to a pre-failure level of redundancy in cases of permanent node failures can be large, since a lot of data needs to be copied over to the new node. Also, some of these applications cannot accept new writes on the nodes being bootstrapped, further increasing the recovery time. 

Dinesh Israni will talk about how you can use dcos-commons frameworks for Cassandra, Elasticsearch, HDFS, Kafka and Spark along with External Persistent volumes to reduce recovery times for your distributed applications and achieve high availability for applications that don’t provide replication.

About Dinesh Israni
Dinesh Israni is a Senior Software Engineer at Portworx with over 7 years of experience building Distributed Storage solutions. Prior to Portworx, Dinesh was at Microsoft, through their acquisition of StorSimple, working on their Hybrid Cloud Storage solution. Recently, he has been involved in the DC/OS commons frameworks project.

More from this channel