Storage [clear filter]
Tuesday, November 19

10:55am PST

Beyond Storage Management - Andrew Large & Yinan Li, Google
Kubernetes added alpha support for persistent volume snapshotting in 1.12 through the Container Storage Interface (CSI). While having some limitations, this feature is critical to stateful workloads and serves as one of the building blocks for developing advanced, enterprise-grade capabilities around data protection.
This talk provides an overview of standard enterprise data protection policies and practices and discusses how those might map into Kubernetes. We’ll discuss the full scope of what data protection might look like in Kubernetes and considerations that go into building an enterprise-grade data protection solution, placing the volume snapshot work in a larger context, and propose some explicit potential future standards activities.


Yinan Li

Software Engineer, Google
Yinan Li is currently a Software Engineer at Google. He focuses on work that enriches Kubernetes with enterprise-grade data management capabilities and work that enables large-scale data processing on Kubernetes, including the Kubernetes scheduler backend for Apache Spark. Yinan is... Read More →

Andrew Large

Software Engineer, Google
Andrew Large is currently a software engineer at Google. He focuses on work that enriches Kubernetes with enterprise-grade data management capabilities in hybrid and multi-cloud environments. Prior to Google, Andrew led the cloud analytics teaocsm at Tintri - an enterprise storage... Read More →

Tuesday November 19, 2019 10:55am - 11:30am PST
Room 15AB - San Diego Convention Center Mezzanine Level

11:50am PST

Building Blocks: How Raw Block PVs Changed the Way We Look at Storage - Jose A. Rivera & Rohan Gupta, Red Hat
Raw block PersistentVolumes (PVs) allow applications to consume storage in a new way. In particular, Rook-Ceph now makes use of them to provide the backing store for its clustered storage in a more Kubernetes-like fashion and with improved security. Now we can rethink the notion of how we structure our storage clusters, moving the focus away from static nodes and basing them on more dynamic, resilient devices.

This talk will go over how we incorporated raw block PVs, how the operator manages them, and how we can now define storage cluster. It will also include a demo of the resiliency of these new types of devices. By the end of the talk, you'll not only know how to use raw block PVs but also why and when to use them.

avatar for Jose A. Rivera

Jose A. Rivera

Senior Software Engineer, Red Hat
Jose Rivera is a Senior Software Engineer at Red Hat. He's worked in and around storage for over 10 years, with experiences spanning across multiple networked and software-defined storage projects such as Samba (SMB) and GlusterFS. Currently he works on OpenShift Container Storage... Read More →
avatar for Rohan Gupta

Rohan Gupta

Software Engineer, Red Hat
Rohan Gupta currently serves as Software Engineer at Red Hat. He is in the Storage Team, and he works primarily on Rook-Ceph.

Tuesday November 19, 2019 11:50am - 12:25pm PST
Room 1AB - San Diego Convention Center Upper Level

2:25pm PST

Building a Database as a Service on Kubernetes - Abhi Vaidyanatha & Lucy Burns, PlanetScale
Stateful, scalable storage on Kubernetes is an unsolved problem. Creating it as a service is even more difficult. The cloud-native ecosystem offers many tools such as the operator-sdk, Prometheus, Grafana, etcd, Vitess, and much more, but integrating them isn't necessarily intuitive.

Two of PlanetScale's employees that have engineered and managed the project describe the journey of leveraging all of these open source technologies to build out a database as a service on Kubernetes.

avatar for Lucy Burns

Lucy Burns

Product Manager, PlanetScale
avatar for Abhi Vaidyanatha

Abhi Vaidyanatha

Software Engineer, PlanetScale
Abhi is a confused economist who enjoys writing backend code for various parts of PlanetScale's Vitess management software. In his spare time he is a DJ, podcast host, and competitive Super Smash Bros. player.

Tuesday November 19, 2019 2:25pm - 3:00pm PST
Room 30ABCDE - San Diego Convention Center Upper Level

3:20pm PST

Vitess: Stateless Storage in the Cloud - Sugu Sougoumarane, PlanetScale
When Vitess was migrated to run from bare-metal into Google's cloud, it was deployed as a regular stateless application. This meant that a process reschedule resulted in all the local data being wiped.

The property of Vitess to survive in such an unforgiving environment made it naturally suited to run on Kubernetes.

How did Vitess manage to run on such an environment without losing data, and providing High Availability, Scale and Performance? How are other organizations running Vitess?

This session will answer these questions, as well as go into the design principles that prepared Vitess to be cloud-native.

avatar for Sugu Sougoumarane

Sugu Sougoumarane

CTO, Planetscale, Inc.
Sugu is the co-creator of Vitess, and has been working on it since 2010. Prior to Vitess, Sugu worked on scalability at YouTube and was also part of PayPal in the early days. His recent interest is in distributed systems and consensus algorithms. He occasionally shares his thoughts... Read More →

Tuesday November 19, 2019 3:20pm - 3:55pm PST
Room 11AB - San Diego Convention Center Upper Level

4:25pm PST

How to Backup and Restore Your Kubernetes Cluster - Annette Clewett & Dylan Murray, Red Hat
Operating Kubernetes clusters introduces many new practices, but does not change the need to be able to backup and recover your applications and data. Yet traditional methods of server backup work poorly with Kubernetes clusters. How can you make sure your cluster is protected? How can persistent data get saved in a manner so there is minimal or no corruption to the application if recovery is required?

In this session we will explore how to use open-source disaster recovery tools you can use today such as Velero and Restic. We’ll also discuss how to use the Noobaa S3 API to reliably save and store backups for all resources including snapshots housed in Rook-Ceph. To prove this is not just smoke and mirrors, we will demonstrate in a live Kubernetes cluster deleting everything in a namespace and then continue on to show complete recovery of all resources and data.

avatar for Annette Clewett

Annette Clewett

Principal Architect, Red Hat
Red Hat Storage Architect with broad knowledge across a spectrum of technologies – network, storage, virtual, and platform. Have successfully delivered countless studies that improved end-user experience and created a more efficient and available infrastructure. Current projects... Read More →
avatar for Dylan Murray

Dylan Murray

Senior Software Engineer, Red Hat
Red Hat Software Engineer

Tuesday November 19, 2019 4:25pm - 5:00pm PST
Ballroom Sec 20AB - San Diego Convention Center Upper Level
Wednesday, November 20

3:20pm PST

Storage on Kubernetes - Learning From Failures - Hemant Kumar & Jan Šafránek, Red Hat
Using persistent storage with Kubernetes has been continuously improved with each release, but getting where we are was not easy. In this talk, we are going to cover a series of war stories and failure scenarios. We will talk about bugs (or design) that resulted in data loss, file system corruption, or storage simply refusing to come up. The limitations of storage subsystems, both what it can and can not do, will also be discussed

These failures have led to numerous enhancements in Kubernetes. We will review the lessons these failures have provided, and discuss how they have been vital to improving our handling of the storage subsystem.

avatar for Jan Šafránek

Jan Šafránek

Principal Software Engineer, Red Hat
Jan is a Principal Software Engineer at Red Hat working on storage aspects of Kubernetes. He started developing Kubernetes more than 4 years ago, and is one of the founding members of SIG-Storage. He’s the author of PersistentVolume controller, dynamic provisioning and StorageClass... Read More →

Hemant Kumar

Principal Software Engineer, Red Hat
Hemant is a Principal Software Engineer at Red Hat working on storage subsystem of Kubernetes. He is a member of SIG-Storage and author of persistent volume expansion, volume limits, mount options and various instrumentation bits in storage subsystems of Kubernetes. He is also a maintainer... Read More →

slides pdf

Wednesday November 20, 2019 3:20pm - 3:55pm PST
Ballroom Sec 20AB - San Diego Convention Center Upper Level

4:25pm PST

Kubernetes Storage Cheat Sheet for VM Administrators - Manu Batra & Jing Xu, Google
Getting started in containers and Kubernetes can be daunting, especially when coming from the Virtual Machines world. The differences in storage models adds to the confusion. This session will explain the storage and data management differences between Virtual Machines and Containers. Specifically we will focus on:

- Translating the VM terminology and challenges to the Kubernetes container world.
- Drawing architectural parallels between the two approaches including storage operations and communication fundamentals.
- Discouraging the impulse to tackle storage problems the same way on Kubernetes as was done in the VM world.

You will leave this talk with an understanding of how storage works in Kubernetes ecosystem, with parallels to VM/hosts storage terminology, architecture, and operations.


Jing Xu

Software Engineer, Google
Jing Xu obtained her Ph.D. from Electrical and Computer Engineering Department, University of Florida in May 2011. After graduation, she had been a lecturer in School of Computer Science in Florida International University for about 4 years. She moved to Bay area in late 2014 and... Read More →

Manu Batra

Product Manager, Google
Manu Batra is Product Manager at Google driving product strategy and delivery for Anthos, Kubernetes Storage and Container Data Protection. In prior roles he’s working across startup and enterprise companies building storage & infrastructure management software.

Wednesday November 20, 2019 4:25pm - 5:00pm PST
Room 6C - San Diego Convention Center Upper Level

5:20pm PST

CSI Volume Snapshots: On the Way to Faster and Better Backups - Adnan Abdulhussein & Nolan Brubaker, VMware
Users need persistent data to support their business goals, and regular backups are critical to business continuity. The CSI Snapshot API provides users a consistent way of creating volume snapshots within Kubernetes, regardless of their storage provider. This is a big improvement over the prior, provider-specific methods for creating snapshots.

This session will first cover the basic CSI Snapshot CRDs, as well as demo snapshotting and restoring a stateful application. Additionally, we'll share how disaster recovery tools, such as the open-source Velero, can build on CSI Snapshots, as well as future enhancements coming to CSI, and what migrations from current in-tree cloud provider implementations will look like.

- Overview of the CSI Snapshot CRDs
- Demo of snapshot and restore workflow
- Future direction for application snapshotting and quiescing in CSI

avatar for Adnan Abdulhussein

Adnan Abdulhussein

Software Engineer, VMware
Adnan Abdulhussein is a Software Engineer at VMware (previously at Bitnami), where he works on building tools to make apps easier to run on Kubernetes. He contributes to the Kubernetes community as a co-chair of SIG-Apps and a core maintainer of the Helm project. Adnan is passionate... Read More →
avatar for Nolan Brubaker

Nolan Brubaker

Principal Software Engineer, Red Hat
Nolan has been working on cloud infrastructure technologies since 2014, starting with OpenStack, then Velero, and now OpenShift and Cluster API.

Wednesday November 20, 2019 5:20pm - 5:55pm PST
Room 11AB - San Diego Convention Center Upper Level

Filter sessions
Apply filters to sessions.