Vetiver: Model Deployment

This is part one of a two part series on {vetiver}.

• Part 1: Vetiver: First steps in MLOps
• Part 2: Vetiver: Model Deployment (This post)

Introduction

In our previous blog, we provided an overview of MLOps and the {vetiver} package, creating and deploying a simple model locally. In this post, we’ll show you how to deploy a model to production using Posit Connect, SageMaker, and Docker.

What is Docker

Docker is an open-source platform that allows developers to build, deploy, and run containers. These containers bundle application source code with the operating system libraries and dependencies needed to run that code.

Previously, we discussed deploying a Shiny Application using Docker. Similarly, we can deploy a set of APIs to access our model.

Data comes in all shapes and sizes. It can often be difficult to know where to start. Whatever your problem, Jumping Rivers can help.

Creating a Docker file

The {vetiver} package simplifies creating a Dockerfile. We simply run:

vetiver::vetiver_prepare_docker(
 pins::board_connect(),
 "colin/k-nn",
 docker_args = list(port = 8080)
)

This command accomplishes several tasks:

• Uses the {renv} package to create a list of R package dependencies required to run your model.
• Creates a file named plumber.R containing the necessary code to deploy an API, essentially just vetiver_api().
• Generates the Dockerfile.

The Dockerfile includes several components. The first component sets the R version, specifies the package repository, and crucially, installs the necessary system libraries.

FROM rocker/r-ver:4.4.0
ENV RENV_CONFIG_REPOS_OVERRIDE https://packagemanager.rstudio.com/cran/latest

RUN apt-get update -qq && apt-get install -y --no-install-recommends \
 ...

The second component copies the renv.lock file and installs the required R packages:

COPY vetiver_renv.lock renv.lock
RUN Rscript -e "install.packages('renv')"
RUN Rscript -e "renv::restore()"

Finally, we have the plumber/API section

COPY plumber.R /opt/ml/plumber.R
EXPOSE 8080
ENTRYPOINT ["R", "-e", "pr <- plumber::plumb('/opt/ml/plumber.R'); pr$run(host = '0.0.0.0', port = 8080)"]

which runs the API on port 8080.

The container is built via

docker build --tag my-first-model .

The --tag flag allows you to name your Docker image. You can inspect your stored Docker images with:

docker image list
REPOSITORY TAG IMAGE ID CREATED SIZE
my-first-model latest 792af21c775a About a minute ago 1.33GB

To run the image, use

docker run --rm --publish 8080:8080 my-first-model

Posit Connect / Sage Maker

We can also trivially publish the model to Posit Connect via

vetiver::vetiver_deploy_rsconnect(board = pins::board_connect(), "colin/k-nn")

Similarly, we can publish to SageMaker using the function vetiver_deploy_sagemaker().

For updates and revisions to this article, see the original post