Tagged: Storage Toggle Comment Threads | Keyboard Shortcuts
-
Wang
-
Wang
Alluxio
Data Locality: Bring your data close to compute.
https://www.alluxio.io/
Make your data local to compute workloads for Spark caching, Presto caching, Hive caching and more.
Data Accessibility: Make your data accessible.
No matter if it sits on-prem or in the cloud, HDFS or S3, make your files and objects accessible in many different ways.
Data On-Demand: Make your data as elastic as compute.
Effortlessly orchestrate your data for compute in any cloud, even if data is spread across multiple clouds.
-
Wang
Stateful deployment in kubernetes
If you deploy pod by setting “kind: Deployment“, you will lost your data when the pod restart or being deleted.
It’s not acceptable when we want to deploy storage system like Redis, Elasticsearch, in this case we need use StatefulSet.
For the concrete explanation please refer to the official documentation, StatefulSet use PVC(Persistent Volume Claim) as storage, and it will exist all the time no matter what happened to the pod.
You must specify PVC in StatefulSet’s yaml file like this:
volumeClaimTemplates: - metadata: name: redis spec: accessModes: [ "ReadWriteOnce" ] storageClassName: fast resources: requests: storage: 10GiPlease also pay attention to PVC’s name, there’s a rule for StatefulSet and PVC name mapping which IS NOT covered by documentation.
Wang's Tech Blog 
Reply