Ukraine war: What does facial recognition software make of Putin’s backdrop crowd?

Social media is awash with claims, repeated on news websites, that Russian President Vladimir Putin surrounded himself with actors for his New Year's address and at previous events. But what's the evidence?

We used facial recognition software to check some of these allegations.

The Russian president has a track record of posing at events where some of the attendees are not what they seem.

Social media posts, and news websites such as the Sun and the Daily Mail, have suggested a blonde woman has been playing different characters at several previous events with Mr Putin, including a fishing trip in 2016 and a church service in 2017.

Others, including a Ukrainian news report, say she may be part of Russia's Federal Guards Service (FSO) - a security force that protects top leaders.

We've used facial recognition software to compare the face of the woman in the New Year picture with those in 2016 and 2017, producing low match results of 29% and 28% respectively.

"Usually, a similarity score of 75% or higher should be considered when looking for an identity match," says Professor Hassan Ugail, Director of the Centre for Visual Computing at the University of Bradford.

Next, we compared the images from the events held in 2016 and 2017, which generated a 99.1% score, strongly indicating that these two are of the same person.

This woman has been identified in Russian media as Larisa Sergukhina. Both events at which she appeared took place in the Novgorod region where she is a member of the regional parliament for the United Russia Party, which backs Mr Putin.

We then looked into claims about a group of men in fishing gear, photographed with Mr Putin on a boat in 2016.

Comparing the faces on the boat with those in the church through facial recognition software gave us similarity scores of over 99% for all four men, so we looked further into their identities.

We found evidence they all worked in the Novgorod region, and at least three of them appear to be fishermen.

Aleksey Lyashenko (1) is the leader of the fishing crew pictured with Mr Putin. We know this from his social media accounts as well as profiles published about the crew online.

Yevgeny Lyashenko (5) is Aleksey's son. He is also named in the profile as part of the same team. Both Aleksey and Yevgeny have social media accounts which confirm they are father and son.

According to the same profile, the crew is part of the local agricultural conglomerate called Evrokhimservis, whose deputy general director is Larisa Sergukhina (3).

Sergey Alexandrov (2) is quoted in Russian media as a fisherman. We found his social media profile which shows him on a boat wearing fisherman's clothing.

We couldn't find a social media profile for man number 4, but we found an image which matches him on which someone has commented "How did it happen with Putin?" with the reply: "He met several times with Putin at work in Novgorod".

Another image posted online claims two of these fishermen also met Mr Putin posing as farmers in the Stavropol region. But when comparing the faces of the farmers highlighted with the two fishermen, facial recognition shows less than an 8% similarity for both.

The images here are from the side, and of lower resolution, which makes facial recognition unreliable, so we can't use it to make a judgement.

And if they are the same person this wouldn't be particularly surprising given that they're both taken at the same air show, visited by Mr Putin two years apart.

There was also an example in May when people claimed an injured soldier who met Mr Putin during a hospital visit had been pictured with him in a factory previously.

However, when you run the faces of the man from both events through facial recognition it shows around a 25% similarity, indicating there isn't a match.

Additional reporting by Olga Robinson. Graphics by Jana Tauschinski.