recognizing faces and people

Ideas for improvements and requests for new features in XnView MP

Moderators: XnTriq, helmut, xnview

pberger
Posts: 1
Joined: Sun Feb 17, 2019 4:36 pm

Re: recognizing faces and people

Post by pberger »

I am using Google Picasa for a long time - but now the errors are increasing.
I spent lot of time to tag my pictures (>100,000) with face recognition tags (I let Picasa store them (and the postion) in XMP extension).
It would be great if XnView would also allow a face recognition like Picasa did - and even better recognise the already identified pictures.
User avatar
xnview
Author of XnView
Posts: 43357
Joined: Mon Oct 13, 2003 7:31 am
Location: France
Contact:

Re: recognizing faces and people

Post by xnview »

michel038 wrote: Fri Oct 19, 2018 4:37 pm If XnviewMP could import Picasa faces informations (instead of using AvPicFace) it would be easier to proceed ...
what do you means?
Pierre.
User avatar
michel038
XnThusiast
Posts: 1282
Joined: Tue Sep 27, 2016 8:18 am
Location: France
Contact:

Re: recognizing faces and people

Post by michel038 »

Picasa creates a .picasa.ini file in each directory.
This file contains persons and pictures names
This is a sample file for a directory containing 7 photos where 4 persons were found:

Code: Select all

[Contacts2]
36174d7e26a42273=jean;;
3bf63009058334e3=pierre;;
2f7d4cbedf5a0607=alain;;
[DCP00533.JPG]
faces=rect64(3ae3284c97c7bd09),36174d7e26a42273;rect64(74383a5fbd55aed0),3bf63009058334e3
backuphash=15493
[DCP00528.JPG]
faces=rect64(7e0038e3c071a38e),36174d7e26a42273
backuphash=40440
[DCP00564.JPG]
faces=rect64(85092bc7c04b611c),3bf63009058334e3;rect64(22ab2ce358005ce3),2f7d4cbedf5a0607
backuphash=2334
[DCP00558.JPG]
faces=rect64(3b8e1439ada17b1c),3bf63009058334e3
backuphash=20354
[DCP00530.JPG]
faces=rect64(7aaa4bda927171c7),3bf63009058334e3;rect64(4400247278387800),36174d7e26a42273
backuphash=51582
[DCP00563.JPG]
faces=rect64(338e25095e00697b),2f7d4cbedf5a0607;rect64(bf1c2ed0dd545fb4),36174d7e26a42273
backuphash=27604
[DCP00529.JPG]
faces=rect64(37682dc7812f7000),36174d7e26a42273
backuphash=46243
Picasa uses alsoo : contacts.xml file ( in C:\Users\Michel038\AppData\Local\Google\Picasa2\contacts\contacts.xml )

Code: Select all

<?xml version="1.0"?>
-<contacts>
<contact local_contact="1" modified_time="2018-10-13T22:13:58+02:00" name="jean" id="36174d7e26a42273"/>
<contact local_contact="1" modified_time="2018-10-13T22:12:09+02:00" name="pierre" id="3bf63009058334e3"/>
<contact local_contact="1" modified_time="2018-10-13T22:12:40+02:00" name="alain" id="2f7d4cbedf5a0607"/>
The job for Xnviewmp would be to read these files, and add person names in xmp or iptc metadata (keywords ?)
J'ai décrit l'utilisation de AvPicFaceXmpTagger en français ici : http://orchisere.pagesperso-orange.fr/l ... .htm#apfxt
C'est d'utiliser ce troisième logiciel qui est fastidieux et source d'erreurs.

But someone said that Picasa can write names in xmp metadata with an add-on or a parameter ... I must work on this
User avatar
michel038
XnThusiast
Posts: 1282
Joined: Tue Sep 27, 2016 8:18 am
Location: France
Contact:

Re: recognizing faces and people

Post by michel038 »

someone said that Picasa can write names in xmp metadata with an add-on or a parameter ... I must work on this
Here is a page with explanations and methods:
https://sites.google.com/site/picasasta ... nto-photos
Picasa Starter is a tool used to tune Picasa settings...
jms
Posts: 15
Joined: Thu Aug 18, 2016 3:02 pm

Re: recognizing faces and people

Post by jms »

Would it help if I write a face detection in python?
User avatar
m.Th.
XnThusiast
Posts: 1663
Joined: Wed Aug 16, 2006 6:31 am
Contact:

Re: recognizing faces and people

Post by m.Th. »

m. Th.

- Dark Themed XnViewMP 1.6 64bit on Win11 x64 -
jms
Posts: 15
Joined: Thu Aug 18, 2016 3:02 pm

Re: recognizing faces and people

Post by jms »

Einfach nur erkennen, dass und wo überhaupt ein Gesicht ist, das ist leicht.
Bestimmte Leute erkennen ist nicht so leicht.
User avatar
xnview
Author of XnView
Posts: 43357
Joined: Mon Oct 13, 2003 7:31 am
Location: France
Contact:

Re: recognizing faces and people

Post by xnview »

jms wrote: Mon Feb 18, 2019 8:20 pm Would it help if I write a face detection in python?
how can we integrate your script into XnViewMP?
Pierre.
User avatar
jmoliver
Posts: 17
Joined: Wed Jun 19, 2019 1:51 pm
Location: Puerto Rico
Contact:

Re: recognizing faces and people

Post by jmoliver »

Adding Face recognition to XnView would be great!

I have been using Windows Photo Gallery for quite some time and have dedicated a lot of time in adding faces. Similar to Picasa, WPG People Tags functionality has face detection and recognition, when the user "confirms" a face it saves it back to the file metadata using Microsoft's People Tag Schema which is documented here: https://docs.microsoft.com/en-us/window ... le-tagging. Later versions of Picasa, and many other photo organizers such as Digikam and Photo Supreme can read Microsoft People Tags but write Face/People region information back to the file using the Metadata Working Group's Face Regions schema. Adobe's Photoshop Elements Organizer uses MWG Regions.

There is also "Tag that Photo" https://tagthatphoto.com which has decent face detection and recognition and as other applications it reads Microsoft People Tags and writes back to MWG Regions (paid version).

Along with Micrososoft People Tags and MWG Face Regions there is also the "IPTC Person Shown in Image" XMP fields.

Face detection and recognition is difficult, but XnView could simply start with reading these schemas (MS People Tags, MWG Regions, and IPTC Person Shown), and listing the People Names similarly as "tags" for search. Adding and editing people tags and optionally with delimited regions on the image could be similar as other apps allowing users to mark such regions.
jms
Posts: 15
Joined: Thu Aug 18, 2016 3:02 pm

Re: recognizing faces and people

Post by jms »

Yes Oliver this would be a good start!
User avatar
xnview
Author of XnView
Posts: 43357
Joined: Mon Oct 13, 2003 7:31 am
Location: France
Contact:

Re: recognizing faces and people

Post by xnview »

jmoliver wrote: Wed Jun 19, 2019 2:15 pm Face detection and recognition is difficult, but XnView could simply start with reading these schemas (MS People Tags, MWG Regions, and IPTC Person Shown), and listing the People Names similarly as "tags" for search. Adding and editing people tags and optionally with delimited regions on the image could be similar as other apps allowing users to mark such regions.
could you send me image with these tags?
Pierre.
jms
Posts: 15
Joined: Thu Aug 18, 2016 3:02 pm

Re: recognizing faces and people

Post by jms »

User avatar
jmoliver
Posts: 17
Joined: Wed Jun 19, 2019 1:51 pm
Location: Puerto Rico
Contact:

Re: recognizing faces and people

Post by jmoliver »

xnview wrote: Thu Jun 20, 2019 11:30 am
jmoliver wrote: Wed Jun 19, 2019 2:15 pm Face detection and recognition is difficult, but XnView could simply start with reading these schemas (MS People Tags, MWG Regions, and IPTC Person Shown), and listing the People Names similarly as "tags" for search. Adding and editing people tags and optionally with delimited regions on the image could be similar as other apps allowing users to mark such regions.
could you send me image with these tags?
Sure will. I have been working with these tags for quite some time so I have garnered some experience with them. I will prepare a sample set of images with some cases to aid you in any future implementation.

Here are some links:
MS People Tag Spec: https://docs.microsoft.com/en-us/window ... -reference
MWG Spec (pdf) starts at page 51: https://web.archive.org/web/20180919181 ... idance.pdf

The tricky part about People Tag Rectangles / Face Regions in images if it is cropped, resized, or rotated. The MWG discusses this and how to manage it.

Blog post I wrote on converting MS People Tags to MWG using Exiftool: https://jmoliver.wordpress.com/2017/02/ ... ople-tags/
User avatar
jmoliver
Posts: 17
Joined: Wed Jun 19, 2019 1:51 pm
Location: Puerto Rico
Contact:

Re: recognizing faces and people

Post by jmoliver »

I sent you an email with some sample pics and some thoughts of the metadata formats. Hope they help!
ruebyi
Posts: 48
Joined: Thu Nov 22, 2018 9:28 pm

Re: recognizing faces and people

Post by ruebyi »

Face recognition and autonaming would be a great feature.
Thanks for all of you who give your input on this topic
Post Reply