State-of-the-art neural networks are vulnerable to adversarial examples. This major problem for the safe deployment of ML models arises when minor inp...
Read more
LIME for GDPR
- Research
- April 9, 2018
As mentioned in our last post the GDPR is coming and companies have to get ready! There is a considerable number of people claiming that the GDPR could potentially harm the deployment of deep learning models in Europe. The main reason given in this context is the fact that deep neural networks do not automatically offer insights into why they produce certain outputs. However, one should acknowledge that especially in the last years there has been exciting progress in the area of explainable AI, which can already remedy some concerns regarding the GDPR. A notable example is LIME (Local Interpretable Model-agnostic Explanations), a method for fitting local, interpretable models that can explain single predictions of deep neural networks. Thus, this method fits perfectly to the GDPR requirement that companies „should find simple ways to tell the data subject about the rationale behind, or the criteria relied on in reaching the decision without necessarily always attempting a complex explanation of the algorithms used or disclosure of the full algorithm“. Overall, we are aware that still a lot of work has to be done, but one should not throw out the baby with the bath water! Deep learning is complex and hard to fully analyze, but already today we have various ways of generating powerful explanations. The great LIME-paper by Ribeiro, Singh, and Guestrin (2016) can be found at:
This could also be interesting for you
Times of Growth
Since the beginning of 2019, neurocat’s manpower has more than doubled. With all teams growing fast, we significantly expanded our office space. Luc...
Read more
Techcode Pitch Won
The world’s leading trade show for industrial technology and AI: Hannover Messe, Germany. With 6,500 exhibitors and over 250,000 visitors, it’...
Read more
Robustness Verificat...
Two of our cats are soon going to give a talk about the current status of duality-based adversarial robustness verification. The content will strongly...
Read more
Interview Adlershof-...
What is growth? The Adlershof Journal examined beliefs about growth and interviewed us about AI security and our personal growth story. After a conver...
Read more
Website launched
After a year of hard and exciting work the time has come for a first small website! Today we launched the first version of the site and plan to fill i...
Read more
Phone
+49 (0)30 34065918Skype: neurocat GmbH