# Ray Serve We have three main components: 1. Model Development (offline, potentially bespoke) 2. Training pipeline (production) 3. Inference (prediction service) ![](Screen%20Shot%202021-12-10%20at%209.46.26%20AM.png) ### Inference (Prediction Service) ![](Screen%20Shot%202021-12-10%20at%209.56.02%20AM.png) ![](Screen%20Shot%202021-12-10%20at%209.56.25%20AM.png) ![](Screen%20Shot%202021-12-10%20at%209.57.33%20AM.png) ![](Screen%20Shot%202021-12-10%20at%209.58.00%20AM.png) ![](Screen%20Shot%202021-12-10%20at%209.59.28%20AM.png) ![](Screen%20Shot%202021-12-10%20at%209.58.17%20AM.png) ![](Screen%20Shot%202021-12-10%20at%209.59.47%20AM.png) ![](Screen%20Shot%202021-12-10%20at%2010.02.48%20AM.png) ![](Screen%20Shot%202021-12-10%20at%2010.03.01%20AM.png) ![](Screen%20Shot%202021-12-10%20at%2010.05.17%20AM.png) ![](Screen%20Shot%202021-12-10%20at%2010.05.34%20AM.png) ![](Screen%20Shot%202021-12-10%20at%2010.05.56%20AM.png) ![](Screen%20Shot%202021-12-10%20at%2010.06.42%20AM.png) ![](Screen%20Shot%202021-12-10%20at%2010.07.15%20AM.png) # Enter Ray Serve ![](Screen%20Shot%202021-12-10%20at%2010.10.44%20AM.png) ![](Screen%20Shot%202021-12-10%20at%2010.10.51%20AM.png) ![](Screen%20Shot%202021-12-10%20at%2010.11.19%20AM.png) ![](Screen%20Shot%202021-12-10%20at%2010.11.31%20AM.png) --- Date: 20211210 Links to: Tags: References: * [Ray Serve video](https://www.youtube.com/watch?v=gV4YS4e1CXg)