> For the complete documentation index, see [llms.txt](https://sliu583.gitbook.io/blog/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://sliu583.gitbook.io/blog/specific-work/shivarams-group/group-papers/declarative-machine-learning-systems.md).

# Declarative Machine Learning Systems

### Introduction 

* Machine learning: central in the strategy of tech companies and has gathered more attention from academia than ever before 
* Hastened by 
  * **Hardware improvements**: enabled massive parallel processing 
  * **Data infrastructure improvements**: enabled storage and consumption of massive datasets needed to train most ML models 
  * **Algorithmic improvements**: better performance and scaling
* Future envision: larger amount of people without skills to perform the same tasks. More **declarative** and **abstract interfaces** to hide complexity. 
* Describe 

  * How current ML systems are structured
  * What factors are important for ML project success, which ones will determine wider ML adoption 
  * What are the issues current ML systems are facing
  * How the systems being developed address them 
  * What the next generation of ML systems look like 

1. Software engineering meets ML 
   1. Distill common patterns that abstract the most mechanical parts of the process of building ML projects in a set of tools, systems, and platforms 
2. The coming wave of ML systems 
   1. Substantial increases in adoption always come with **separation of interests** and **hiding of complexity** 
   2. Next-generation of ML systems that will allow people without ML expertise to train models and obtain predictions through more abstract interfaces 

### Machine Learning Systems 

![](/files/-Mk10JQk_rXMs8aO1akJ)

**Challenges & desiderata:**

1. Exponential decision explosion 
   1. Need: good defaults and automation 
2. New model-itis 
   1. Need: standardization and focus on quality 
3. Organizational chasms 
   1. Need: common interfaces 
4. Scarcity of expertise 
   1. Need: higher level abstractions 
5. Process slowness 
   1. Need: rapid iteration 
6. Many diverse state
   1. Need: separation of interests 

### Declarative ML systems 

 


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://sliu583.gitbook.io/blog/specific-work/shivarams-group/group-papers/declarative-machine-learning-systems.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.