Docker is a modern technology for containerizing software. While packaging to a working version is relatively easy, creating a lightweight Docker image presents a challenge. In this note, I will briefly discuss an example from my university class on software engineering. The task was to containerize a card game web application, written by students as …
Tag archives: devops
Tracing GPU Resources
This post explains how to measure GPU utilisation in real-time using tools provided by NVIDIA.
Setting up CUDA tools properly
Diagnosing CUDA setups – two use-cases from real development.
Automating Accessors and Mutators Tests
In object-oriented programming, there are plenty of accessors and mutators to test. This post demonstrates that this effort can be automated with reflection 🚀. The inspiration came from discussions I had with my students during our software-engineering class: how to increase code coverage without lots of manual effort? 🤔 Roughly speaking, the reflection mechanism allows …
Customized Jupyter environments on Google Cloud
Kaggle docker images come with a huge list of pre-installed packages for machine-learning, including the support of GPU computing. They run within a container as a Jupyter application accessed by users through its web interface. Running a custom image boils down to these steps Below we can see how it looks like The following test …
Continue reading “Customized Jupyter environments on Google Cloud”
Repairing user-managed notebooks on Google Cloud
In this note, I am sharing a case study on debugging and fixing jupyter-lab access issues. The diagnostic script can be run on a VM instance as shown below: Jupyter service runs from a container, but it somehow stopped in this case 😳 Not a problem! We can restart the container, but carefully choosing the …
Continue reading “Repairing user-managed notebooks on Google Cloud”
ML Prototyping Environment on Cloud
How to prototype with multiple ML libraries in Cloud? Best to build on top of a rich pre-configured environment such as Kaggle image, extending it with a local virtual environment.
Effective Caching with GitHub Actions
GitHub Actions is great as a CI/CD platform. However, to be efficient, they need to leverage some optimization techniques. In this note, I discuss how to use cache effectively, with respect to multiple paths and sudo-installed APT packages.