> For the complete documentation index, see [llms.txt](https://sliu583.gitbook.io/blog/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://sliu583.gitbook.io/blog/specific-work/seminar-and-talk/reading-groups/db-reading-group/cliquemap-productionizing-an-rma-based-distributed-caching-system.md).

# CliqueMap: Productionizing an RMA-Based Distributed Caching System

https\://dl.acm.org/doi/pdf/10.1145/3452296.3472934

#### Basics 

* Caching: distributed caching 
  * Hierarchy structure 
  * Distributed caching 
    * At the layer of application 
* RPC 
  * Remote procedure call: machines in distributed system to talk with each other 
  * GRPC: protocol buffers
  * Lesser restrictions , ease of programming 
* RMA / RDMA
  * Remote memory access 
  * Offload the code execution path from CPU to hardware or software NIC 
    * Restrictions with respect to size of memory that can be accessed 
  * Primitives are not quite easy to use for programmers 

#### Intro / Summary 

* In-memory KV caching / serving systems are crucial building blocks of user-facing services throughout the industry (i.e., Twemcache \[OSDI20], CacheLib \[OSDI20])
* Remote memory access (RMA)
  * Benefits: performance / efficiency benefits 
  * Downsides: limited programmability / narrow primitives 
  * Production challenges 
    * Deliver high availability and low cost
    * Balance CPU- and RAM-efficiency
    * Evolving the system over time 
    * Multi-language serving ecosystems 
    * Navigating heterogenous datacenters 
* How do we productionize an RMA-based distributed caching system?
  * Less compute + latency benefits (10s of ms) 
  * Throughput? different customers have different challenges

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MVORxAomcgtzVVUqmws%2Fuploads%2FU5sUQ2RcT9hekY2TQEQq%2Fimage.png?alt=media\&token=bf99b8d3-82f9-4a6d-96f8-4e0d32a91564)

* Replication: same piece of data 
  * Aware of the topology 
* Lookup: RMA (accelerate)
* RPC: mutations, and other metadata management 
  * Extensibility and ease of programming 

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MVORxAomcgtzVVUqmws%2Fuploads%2FWVwwJz8WCwTd9nDQFj0n%2Fimage.png?alt=media\&token=488dbf9e-2216-4b0b-8742-76117b972a56)