Visual inspection

Good, better... deeper?

How we’re using Deep Learning algorithms in a GMP regulated environment. Bringing data scientists, machine learning engineers and others together to increase accuracy and efficiency in the visual inspection process.

Patients first

When it comes to patients, quality control is of the utmost importance. For decades, rule-based computer vision detection algorithms were the standard to catch defects in products. In essence, a rule-based algorithm detecting faults based on images. However, recent advances in deep learning technology have presented a unique opportunity to elevate this automated visual inspection process with Deep Learning algorithms.

Recognizing the potential of leveraging deep learning in visual inspection processes, a domain already known for upholding superior product quality, Novo Nordisk is developing a technological solution that could significantly reduce unnecessary waste of good product while maintaining the high detection accuracy for faulty products.

"We realised this was not just going to be a plug-and-play solution”
Gitte Bjørg Windfeldt, Head of Data Science in DD&IT PS Technology Foundation & Transformation at Novo Nordisk

The shift

The shift from traditional rule-based detection algorithms to more advanced deep learning detection algorithms was not about following trends of AI or machine learning. It was about using technology to drastically improve the product process while adhering to strict regulation for pharma manufacturing i.e. Good Manufacturing Practices (GMP).

This move required a structured approach, and a multi-expertise team comprised of process experts, operators, quality assurance, data scientists and machine learning engineers —individuals committed to pushing boundaries and achieving even better vision inspection.

The technical aspect involved creating deep learning algorithms that were specifically designed to identify defects in glass cartridges filled with insulin. The algorithms outperformed the prior rule-based computer vision approach, significantly reducing the false rejection rate of good products, leading to a notable increase in manufacturing capacity and a decrease in wasted products.

A real leap of faith

The reason it was so challenging was because the pharmaceutical industry, which includes Novo Nordisk, have the most stringent quality control standards, and integrating deep learning detection algorithms required adhering to those principles. Nevertheless, the team embraced the idea, going above and beyond to contribute to the project.

“This was about embarking on a journey, not only adopting new technology but also developing our mindsets together.” Gitte Bjørg Windfeldt, Head of Data Science in DD&IT PS Technology Foundation & Transformation.

The key to successful implementation has been the development of a thorough roadmap for effectively using this technology within Good Manufacturing Practice (GMP). The approach strongly emphasised “Integrating Deep Learning” into established quality management principles to foster a quality-driven mindset and promote organisational comprehension, which should in turn benefit future deep learning projects.

Time to get technical

A huge realisation also became apparent during the project – technical roles such as data scientists and machine learning engineering were no longer just “nice to have” in pharmaceutical manufacturing, they were essential.

Using Deep Learning detection algorithms for visual inspection places Novo Nordisk at the forefront of applying emerging technology to the benefit of both patients and the environment.

“To our knowledge, it had never been done before in a GMP environment. It required a real leap of faith from everyone involved that it could be done.”
Gitte Bjørg Windfeldt, Head of Data Science in DD&IT PS Technology Foundation & Transformation at Novo Nordisk
Find a job