> For the complete documentation index, see [llms.txt](https://sliu583.gitbook.io/blog/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://sliu583.gitbook.io/blog/conference/index/nsdi-21/distributed-system/ship-computer-or-data-why-not-both.md).

# Ship Computer or Data? Why not both?

https\://www\.usenix.org/conference/nsdi21/presentation/you

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBmSf2qcobVUbXRpDu%2Fimage.png?alt=media\&token=d87b66e2-7fd9-4d9c-9d73-9e7e96a5ecc3)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBmbMh6RWDkL1ydPpA%2Fimage.png?alt=media\&token=0972adf1-7ec6-45f5-93d1-0b5307560f7d)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBmhr4lCy4bVtead5J%2Fimage.png?alt=media\&token=11383cdd-05a8-4f7b-938f-b4fc1ece085d)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBn0SO1raGNL-R3hMx%2Fimage.png?alt=media\&token=4b1c59e4-5971-4d90-8571-b98e947ecd2b)

* Different computation intensity, measure the tput achieved at specific latency target
* How do we know when we don't know underlying workload?&#x20;

&#x20;

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBnYpw8ayuasohTuL5%2Fimage.png?alt=media\&token=0b92b171-3e45-4b3a-8dd5-09d88c6b2587)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBnpGV2S77b1RhMzdL%2Fimage.png?alt=media\&token=096290fd-fd25-47e8-9c48-4733703867fd)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBnxFCimxyNUj9Pycc%2Fimage.png?alt=media\&token=fc25c269-9fc2-4f6b-8780-bcefc27f8d37)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBo-dYCVKz5Bcie2ZK%2Fimage.png?alt=media\&token=ca9c521b-2048-4dab-b54c-78d3e8247611)

* Rate limiting: latency&#x20;
* Request arbitration: optimal fraction of request using ...

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBoH2uNKZNPP1SC1QF%2Fimage.png?alt=media\&token=78da4c7b-a6fa-4710-9b81-0c1ea94e874a)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBoVXmgnnqodfQJ717%2Fimage.png?alt=media\&token=d38f1e60-6297-4034-960e-9701409ae502)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBockal1lF0oEkMp8v%2Fimage.png?alt=media\&token=35804158-883e-43b2-9f62-0bb0ce304ff5)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBogh4euNiWXZ5TvFg%2Fimage.png?alt=media\&token=a37bd86b-a06f-4efb-b429-f1f3704d2fab)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBotlLBplkMMe_n_kD%2Fimage.png?alt=media\&token=5afc3c3d-9e15-479c-9642-fef8b930915f)

![](https://2097630930-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MVORxAomcgtzVVUqmws%2F-MYBixF9eJK5TFE70XS-%2F-MYBp2nMOa_Emch9z-mq%2Fimage.png?alt=media\&token=e4f9baee-88a2-4eeb-839c-b44f0ba4c166)

* Accommodate different target, but not a combination of targets&#x20;
* Ship data&#x20;
  * in distributed system, more flexible to deploy&#x20;
* Ship code&#x20;
  * Cannot re-deploy (interrupt the service)&#x20;
  * Run-time changes of the server-extension&#x20;
* Partial computation on server side&#x20;
  * More fine-grained placement&#x20;
  * Limitation: request rate is so high&#x20;
    * Overhead?&#x20;
* dimension for evaluating data moving cost&#x20;

Now:

* cost is the latency, not the network bandwidth&#x20;
