Doctors call for responsible use of AI

Doctors are calling for a binding legal framework for the responsible use of AI systems in medicine that is based on the requirements of the EU's AI Regulation and the Council of Europe's AI Convention. In particular, human rights as well as democratic and constitutional principles must be upheld. AI must exclusively serve the good of mankind.

The delegates at the 128th German Medical Assembly voted by a large majority (157 in favor, 18 against and 18 abstentions) for the Executive Board of the German Medical Association to advocate the responsible use of artificial intelligence.

No loss of medical expertise

The doctors are calling for quality-assured data for AI systems. "AI systems that are based on models derived from data using machine learning (machine learning model) must not become a black box," states the adopted resolution (PDF).

It must be comprehensible "which decision parameters an algorithm uses". Doctors should not let AI "lead to the loss of medical expertise and experience". An automation bias was already warned against at an earlier event organized by the German Medical Association on the topic of AI in medicine.

No two-tier medicine

AI should support doctors, not replace them. Two-tier medicine for patients and doctors should be avoided. AI should therefore serve "exclusively the interests and welfare of mankind". AI systems that do not correspond to the values of Germany and Europe should not be used. Violations should be sanctioned.

When it comes to the digitalization of the healthcare system, doctors are calling for a stable infrastructure including functioning practice management systems as well as sensible and secure digitalization.

(mack)