Recent articles filed under Machine Learning

Better python project management starts now: A quick introduction to Rye

Created 2/17/2024 12:04:01 PM
Filed in Machine Learning

Have you ever found yourself tangled in the web of project management, trying to juggle different Python versions, packages, and environments, all while keeping your sanity intact? You're not alone. I've been there, and felt the frustration. But, fear not! I stumbled upon some game-changing tools and strategies that transformed my Python project management challenges into a breeze.

Read more

Building LLM applications the MLOps way

Created 2/5/2024 7:20:52 PM
Filed in Machine Learning

Building applications with large language models is the coolest thing around right now. At least if my LinkedIn feed is to believe. However, I keep getting a feeling of Deja Vu about this. I’ve been here before. Indeed, the models are new, but how we deploy and test them feels somewhat familiar. Someone must have changed the matrix. In this post, we’ll look at building a generative AI application using a large language model. We’ll focus on how to approach the project from an operations and development process perspective and learn what’s new in building LLM applications and what’s not.

Read more

The Art of AI Implementation: Strategic Steps for Building Effective LLM Applications

Created 6/9/2023 7:56:29 AM
Filed in Machine Learning

We’ve seen a lot of demonstrations lately with large language models. Everyone is racing to get on board with ChatGPT and other large language models (LLMs). I’ve never seen so many experts pop up in such a short time. But is there a method to the madness? Are we doing the right thing by staying away from the hype or should we go all in? It’s a question I get a lot this week. Here’s my answer.

Read more

How to enhance your C# application with a large language model using Semantic Kernel

Created 5/29/2023 9:03:31 AM
Filed in Machine Learning

While chat applications have received much attention, there is so much more you can achieve by integrating language models into your projects. Imagine automating budgeting, generating engaging tweets, transforming documents, or creating compelling conference abstracts. Semantic Kernel offers a lightweight SDK that simplifies the process, allowing you to build language applications effortlessly. In this post, we'll explore how you can leverage Semantic Kernel to add powerful language skills, from installation to building skills and integrating them into your C# application. Unleash the potential of large language models and take your projects to new heights.

Read more

Fun ChatGPT prompts to improve your Python code

Created 4/23/2023 7:15:42 PM
Filed in Machine Learning

Let's explore fun prompts for improving your Python code using GPT-4. These prompts include writing docstrings, writing automated tests, checking your code for optimizations and bugs, and refactoring a method. While GPT-4 could be better, it's a significant improvement over doing these tasks by hand.

Read more

Why You Need a Sandbox Separate from Your ML Pipeline to Create Successful Experiments

Created 2/27/2023 7:08:58 PM
Filed in Machine Learning

Machine learning operations (MLOps) is a rapidly evolving field that is transforming the way businesses approach data science. One of the most critical aspects of MLOps is the ability to create and test experiments quickly and efficiently. While it may be tempting to use your production ML pipeline as a testing ground, it's essential to have a separate sandbox environment for several reasons.

Read more

How to configure memory limits in WSL2

Created 1/5/2023 8:01:11 AM
Filed in Machine Learning

One of the downsides to building machine learning models is that you need quite a bit of power in your machine. I've just upgraded my home desktop that I use for side projects and experiments to 64GB of memory because it was clearly no longer up to the task. However, when I booted up my WSL linux distro, it couldn't get more than 32GB of memory. Time to figure out how to fix that! In this quick post I'm showing you how you can limit or increase the memory available to your WSL2 distributions. Let's go!

Read more

How to build scalable workflows with Prefect and Ray

Created 12/23/2022 7:38:36 AM
Filed in Machine Learning

In the past weeks we've been working on a new computer vision project at Aigency. As part of the project we have to process images using OpenCV image filters. This is a rather tedious process that takes a lot of time, so we made a nice workflow for it. In this blog post I'll show you how we used Prefect and Ray to build a scalable image processing workflow.

Read more