Posts

Sometime in April this year, Docker added new feature called Docker Model Runner. It’s meant to streamline the process of pulling, running, and serving large language models (LLMs) and other AI models directly from Docker Hub or OCI-compliant registries. It integrates with Docker Desktop and Docker Engine, allows you to serve models via OpenAI-compatible APIs, package GGUF files as OCI, and interact with models from the command line. Features Pull and push models Serve models on OpenAI-compatible APIs Package and publish GGUF files as OCI Run AI models directly from the command line Manage local models and display logs Requirements Docker Model Runner is supported on the following platforms: ...

What is gRPC? gRPC is a high performance, open source universal RPC framework. By default, it uses Protocol Buffers. Example Prerequisites Golang Protocol Buffer compiler - protoc sudo apt install protobuf-compiler Update PATH variable to include the path to the protoc executable Golang plugins go install google.golang.org/protobuf/cmd/protoc-gen-go@latest go install google.golang.org/grpc/cmd/protoc-gen-go-grpc@latest Creating gRPC services The process of creating gRPC services follows three steps: Define Messages/Services Generate client/server source Implement gRPC service methods Method types There are four types of service methods that can be defined. ...

Creating Docker Github action This is an example how to create a simple Docker Github action. To get more familiar with Github actions, check official docs. Start with an empty git repo: mkdir docker-gha-example cd docker-gha-example git init For repository to be considered a Github action, it is required to have a file action.yml or action.yaml, this metadata file will define inputs, outputs and run configuration. name: Docker Github action description: This is an example of Docker Github action branding: icon: star color: yellow inputs: name: description: who to greet required: false default: 'world' outputs: greeting: description: greeting message runs: using: docker image: Dockerfile args: - ${{ inputs.name }} For more details on action.yml check docs. ...

This guide provides detailed explanations and recommendations for writing efficient, secure, and maintainable Dockerfiles. ARG Purpose: Defines build-time variables that can be passed to the Docker build process using --build-arg. Best Practices: Use lower case for ARG variable names to distinguish them from ENV variables. Declare ARG variables close to where they are used in the Dockerfile for clarity. Avoid exposing sensitive information via ARG, as build arguments can be viewed in image history. Example: ...

This post serves as a cheat sheet for debugging Ansible playbooks. It covers common troubleshooting techniques, useful modules, and configuration options to help you quickly identify and resolve issues in your automation workflows. Check Python and Ansible versions Before debugging, ensure you are using compatible versions of Python and Ansible. Version mismatches can cause unexpected errors. python --version ansible --version Syntax check Validate your playbook’s syntax before running it. This helps catch YAML formatting errors and invalid Ansible constructs early. ...