This is a short review of the paper titled "Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics" by Kendall et al, 2018 .
Problem description
Given a model with multiple heads(tasks), how to balance all the losses ? The gradients are affected by the magnitude of losses,