▮ My Mistakes I’ve finished a couple of POCs(Proof Of Concept; a phase where we create a prototype to check the feasibility of the machine learning project) this year as a Data Scientist/Project Manager for computer vision tasks, and I’d…
▮ Data Shift After deploying your model, you’ll need to keep on maintaining them because data is constantly changing. So for this post, I’d like to share three different types of data distribution shifts that may occur which can degrade…
▮ Keeping Track When developing an ML model, there is a lot of information to keep track of. Data scientists have to constantly experiment and the information can get easily chaotic. Ideally, all the information should be organized so that…
▮ Monitoring After you have successfully deployed your machine learning model, it is crucial to be able to collect not only metrics such as throughput and latency but also GPU usage and utilization(since your ML model is most likely to…
▮ Build Or Buy? When settings up an ML infrastructure, at one extreme, a company can outsource everything except data movement. At the other extreme, a company can build everything and maintain all the required infrastructure. However, most companies are…
▮ Model Explainability Inside an ML model can easily become a black box. Increasing the explainability of an ML model can help developers debug and also communicate with the client about why the model is predicting a certain outcome. Here…
▮ Advantage Of Packaging Packaging ML models means getting a model into a container to take advantage of the following. Fig.1 – Container Deployment You can run a container locally as long as container runtime is installed You can easily…
▮ Hierarchy Of Needs Every ML system works efficiently only when the basic foundation exists. Here are the 4 layers required to construct true ML Automation(MLOps). The ML engineering hierarchy of needs is shown in the Figure below. Fig.1 –…
▮ Labeling Most ML models in production today adopt models with supervised learning. This means they all need data to learn to do a task, and there will rarely be a situation where label data is overwhelmingly abundant. Here are…
▮ After Deployment Previously, I shared how to evaluate your model offline; before production. So for this post, I’d like to share several model evaluation methods after deployment. Blog: Model Offline Evaluation Reference: Designing Machine Learning Systems ▮ Shadow Deployment…