Different distance between ear and earrings

[Juanmaramon]

Hi @xavierjs,

I was trying the Earrings3D demo but changing the earring 3d model. I notice that if the face shape changes then the earrings are located on different parts of the ear. The 3D earring model origin is in the (0, 0, 0) coordinate system.

Are the ear landmarks position estimated?

Thanks!

[xavierjs]

Hi @Juanmaramon

Thank you for your feedback.
The earrings VTO relies on some face landmarks visible on the advanced debug view if you select NN_EARS as neural network model (this view is included in this repository).

2 landmarks are computed for each ear, and the earring center will be an interpolation between these 2 points ( spec.k in WebARRocksFaceEarrings3DHelper.js ).

The earrings VTO is currently more suited to big earrings, like in the provided example, than small earrings (like ears studs). Among my short term goals, I want to increase the accuracy for this use-case. I also think that in your pictures the position may be disturbed by the hair.

I will try to train some neural networks with more morphing around the ears since currently maybe the landmarks are computed relative to the global area around the ear and not the ear by itself. The current problem is about the training of the neural network and it is closer to cooking than real science.

[Juanmaramon]

Great @xavierjs

Thanks for the detail feedback and let's see what happen with the new ANN training :)

[xavierjs]

Hi @Juanmaramon

I have updated the repository with a new earrings neural network (NN_EARS_1.json).
I have the impression that there is a slight improvement in how different ear shapes / face shapes are taken into account.
I set it as the default neural network for the earrings 3D demo.
Landmarks stabilization has also been changed, it is done by external helpers.

Best regards,
Xavier

[xavierjs]

Hi @Juanmaramon

The latest neural network, NN_EARS_2.json is really more accurate.
I have updated the demo to use it.
To try it you need to update the main script since I have done some changes on neural nets schemas.

Best,
Xavier