Pre-fetching your data can help your data pre-processing pipeline more smoother. Without pre-fetching, the cpu would wait for the process in the GPU to end, and then start to prepare the next data. You can do this process in parallel…
I’ve compared Image segmentation performance depending on the loss function. Mean Squared Error Binary Cross Entropy I was able to achieve higher average IOU using BCE instead of MSE.
Labeling Data is time-consuming and boring. Active Machine Learning may help reduce that labeling process down to 10~20%. Fig.1 – Active Learning Workflow The basic workflow is as follows: 1. Label Data Partially 2. Train Model only with the labeled…
Jacobian Matrix is a matrix which stores all the partial derivatives for multiple functions. For example, let’s consider ex1 (top left). F(x) is a function containing 1 variable. If you calculate the derivative of F(x) it would be 2x. Now,…
I’ve experimented how standardization affect a binary segmentation model’s performance by comparing 2 outputs. Inference result from model trained with standardization using ImageNet RGB mean and standard deviation Inference result from model trained without standardization I’ve found out that the…
When I was evaluating the model, both f1 score and jaccard score, for some reason, was decreasing as the model finishes more epochs. (Which is quite insane.) I’ve been checking the dimensions of the variables I was using to calculate…
Here is how you can debug your model using vscode. Install python extension (The one that has more than 57 million downloads) Select python interpreter. If you are using a virtual environment, select the python.exe inside of your virtual environment…
When testing out your model’s output for computer vision tasks, you’ll need to apply the same preprocessing methods you’ve applied during training, to the images you want to test out. Here is one way to implement. Import Images from PIL…
Depending on the loss function, you might need to change the data structure of the tensor coming out from the model. In my case, I’m currently doing a binary semantic segmentation using pytorch, and the output of the model is…
I’ve learned that, for semantic segmentation, the Binary Cross Entropy as the loss function, instead of MSE, might be the one to first test out. Motivation When you check the derivative for MSE(Mean Squared Error)’s cost function, you’ll notice that…