3D Tool Predicts Result of Nose Job More Accurately

Scientists in Belgium have developed an algorithm to help rhinoplasty patients design a nose suited to their facial proportions. The technique could also help patients who have lost their own nose because of disease to design a perfectly fitting prosthetic.

Having plastic surgery of any kind is a major decision, but knowing how you’ll look in advance of going under the knife can help dispel some of the anxiety. Surgeons have been using imaging software for some time to help patients visualise the results of prospective work. But researchers from Belgium have developed software they say can help surgeons deliver even better results, while increasing the interaction with their patients.

At the Meaningful Interactions Lab (mintlab), a research group of the University of Leuven and research institute IMEC, they’ve collaborated with a consortium of research partners and companies to develop a 3D tool to accurately simulate the outcome of nose surgery. The tool uses a combination of facial modelling statistics with morphing algorithms. The ‘average nose’ is used as a baseline, computed based on the characteristics of a couple of hundreds of faces in their database.

The first step involves off-the-shelf components: three photographs are taken of the patient’s face from three different angles with a 3D lens and then computer software stitches the images together into a complete 3D model.

“We combined this with an algorithm that was based on faces that were scanned – a lot of faces were scanned – so that the algorithm could calculate what a realistic nose could look like. So in Photoshop you could very easily make like a Pinocchio nose and that’s really unrealistic, but with this software we’ve managed to keep the boundaries to what’s really realistic,” researcher Arne Jansen told Reuters.

The software integrates a number of predefined parameters – such as the shape of the nose bridge or nostril – and makes those easy to manipulate using the program, ultimately providing surgeons and their patients with a user-friendly 3D tool that helps them better visualise the outcome of a nose job.

Unlike Photoshop, this software keeps the boundaries to what’s really realistic for the patient’s face.

While cosmetic procedures are one focus of the project, they believe it also has important applications in anaplastology; helping design prosthetic noses for patients who have had to have theirs amputated, often as a result of nasal cancer.

“This is for patients who, most of the time due to cancer, had to get their nose taken off. And so they need a nose prosthesis. And the software can look at the same characteristics of the face and use that to calculate a nose that is fitting for this particular face. And so what the software won’t do is make a general nose; make one nose for all – it will make a characteristic nose that you can still alter towards the needs of the patients,” said Jansen.

If patients need a nose prosthesis after cancer, the software calculates a nose that is fitting for their particular face.

By taking into account the landmarks on the face the tool can ‘predict’ a perfectly fitting whole new nose – even though there is no existing nasal structure to base it on. This can then be manipulated in the software to give the patient exactly what they want.

Once imported into their software, they manually locate a number of key facial features that the algorithm uses to generate a well-suited nose.

“We have to pinpoint the landmarks on the face, and typically that’s the two cheekbones and then the tip of the nose… and the corners of the eyes. And if you have those, the software can then generate based on the data model it has, based on all the scans it did before, it can generate a nose that is really fitting for that face, that is realistic for that face. Not necessarily the perfect nose, but fitting that can then be adjusted towards the needs of the patient,” added Jansen.