Thursday, August 13, 2020

MyHeritage's Photo Enhancements

Previously, I did an analysis of MyHeritage's photo colorizing tool. Since then, they have also added an enhancement tool, which identifies faces in photos and "enhances" them by making them sharper and clearer with more details. They also appear to have improved the colorizing. I noticed how the same photo I had colorized before, which left some areas like a hand here or there uncolored, are now magically colored (see bottom of article for example). It's still not perfect, but it's improving.

Normally, both tools are limited to 10 photos with a free account, so you have to subscribe with the Complete Plan (the most expensive one) to use unlimited photos with these tools. But right now, MyHeritage are trying to entice people to subscribe by making the tools unlimited for free for one month. They are obviously hoping people will be so impressed with the tools and get used to using them on unlimited photos that when the month is up, some will subscribe to continue having access to them. But personally, I'm not about to spend another $300 a year just for access to these fun little tools so I'm making the most of the free access while I can.

Much like the colorizing tool, the enhancement works best on images that don't have too much degradation or blurring. If you click the above photo of my Nan to enlarge it and see details, you'll see it had only some minimal blurring and the enhancement tool made it very sharp and clear, a much better picture of my Nan. You'll note that it does not remove scratches, spots, or other surface damage to the photo though, even when they appear on the face. And yes, you can enhance it and colorize it at the same time (see examples below), I just chose not to on this one of my Nan to show you the enhancement alone.

It also works best on faces that are closer to the camera - the smaller/further away the faces are, the less effective the enhancement is, and sometimes it's not effective at all. A few photos I've tested so far (see below), the faces were so far away and so blurry that the tool didn't even attempt to enhance it (though it did seem to identify it as a face since it colorized it correctly as skin colored). The ones that were enhanced were minimally done. 

The enhancement tool only worked on 3 out of 5 faces here, because they
were too small and blurry. The 3 enhancements were minimal too (see below).


A close up comparison of one of the small faces in the above photo with the minimal enhancements

Additionally, sometimes the enhancement leaves the face looking a little plastic and weird, like the person is wearing a mask (see below). This is more likely to happen the more blurring there is to the photo and faces, partly because it's difficult to enhance something so small and so unclear, but also because the tool only enhances faces and nothing else. A sharp, clear face next to blurry hair and clothing just looks weird. But in some cases, it's better than nothing, and it does give us somewhat of a better idea of what someone looked like.

Note how the one on the left looks fairly normal but the other two appear mask-like

Keep in mind though, that this tool is attempting to create data where it doesn't exist, so there comes a point on a heavily doctored photo where it may not be an accurate representation of someone's face. It's fun to explore, but for example, I would avoid using it while comparing people in two different photos to determine if they are the same person, or related. While it's tempting to use enhancements to do such comparisons because they seem clearer and sharper, making it easier to compare, it could actually be wrongly altering someone's appearance and leading you to the wrong conclusion about their identity.

So just like with the colorizing tool, the effectiveness of the enhancement tool can be a little hit and miss. It handles some images better than others, and there does come a point where certain photos and faces are too far gone to recover. Have fun with it, but don't expect too much from it with all your photos.

A comparison of the initial coloring of a photo (left) with the updated coloring of it (right), note
some of the hands that were previously uncolored are now a correct skin tone. There's also some
minor difference in the the darker skirts. Click to enlarge.


No comments:

Post a Comment