Gluster Container Storage

Storage for containers, in containers

Kaushal

Overview

  • What is GCS?
  • GCS in detail
  • Try GCS!

Gluster Container Storage

Gluster COntainer Storage

  • Provides persistent storage for your containers
    • RWX & RWO volumes
    • Kubernetes only for now
  • Uses industry standard container interfaces
  • Hyperconverged deployment

Gluster Container Storage

  • Brings together
    • GlusterFS
    • GlusterD2
    • Gluster CSI Driver
    • Anthill
    • Gluster-prometheus
    • Gluster-mixins

Why is GCS good For you?

  • Simplified stack
    • Tuned for container workloads
  • Opinionated defaults
  • Automated management
  • Better scale
    • 2000 RWX/5000 RWO

CUrrent Stack

Heketi Based Stack

Heketi

In Tree Gluster Provisioner

Gluster & Gluster Block

RWX Persistent Volume

1

2

3

4

5

RWO Persistent Volume

1

2

3

4

5

GCS - The DetailS

GCS Stack

Anthill Operator

Gluster CSI Driver

GlusterD2 & GlusterFS

ETCD

Anthill Operator

AnThill Operator

  • Kubernetes Operator
    • Custom GCS resource definitions
  • Automates GCS
    • deployment
    • upgrades
    • day-to-day management

Anthill Status

Gluster CSI Driver

Gluster CSI Driver

  • Translates K8S CSI requests to GD2 ReST requests
  • Manages mounting of Gluster volumes
  • Three different types of pods
    • nodeplugin
    • provisioner
    • attacher

CSI Driver Pods

CSI ATTACHER

CSI Provisioner

CSI NODEPLUGIN

Gluster CSI Driver Status

GlusterD2

GlusterD2

  • Automated Gluster volume management
  • Converges multiple different tools
    • heketi
    • gluster-block

GlusterD2

  • ReST API
  • Reslient orchestraction 
  • Single source of information

GlusterD2

  • Prometheus monitoring
  • OpenCensus based tracing

GlusterD2

  • RWX Volumes
    • Automatic provisioning of bricks
    • Volume templates
  • RWO Volumes
    • loopback based block exports
    • under development

GlusterD2 STATUS

  • Scales to ~1000 RWX volumes
    • ~100s of parallel operations
  • Hitting limits of LVM scaling
    • optimization work in progress
  • Hitting limits of etcd
    • tuned etcd config
    • optimization of etcd usage
  • github.com/gluster/glusterd2

GlusterFS

GlusterFS STATUS

  • Optimize resource usage
    • memory
    • threads
  • Improvements to multiplexing
    • self-heal multiplex
  • Fencing for RWO volumes
  • github.com/gluster/glusterfs

Monitoring

Monitoring

  • gluster-prometheus
  • gluster-mixins

gluster-prometheus

Gluster-Mixins

RWX  PERSISTENT Volume

1

2

3

4

RWO  PERSISTENT Volume

1

2

3

4

Try out GCS

gcs/deploy

GCS/Deploy

Thanks!

Gluster Container Storage

By Kaushal Madappa

Internal

Gluster Container Storage

Storage for containers, in containers

More from Kaushal Madappa