Not Yet RecruitingNot Applicable

Effect of Agent-assisted, LLM-assisted and Traditional Workflows on Physician Admission Diagnosis

China180 participantsStarted 2026-09

Plain-language summary

The goal of this clinical trial is to evaluate whether AI-assisted workflows improve physicians' admission diagnosis performance on standardized simulated inpatient cases, among practicing internal medicine and surgery physicians across all seniority levels and across three tiers of the Chinese healthcare system. The main questions it aims to answer are: * Does the Agent-assisted workflow yield better structured admission diagnosis scores than standalone LLM assistance? * Does the Agent-assisted workflow outperform the traditional workflow without AI tools? Researchers will compare three parallel groups (traditional workflow group, LLM-only group, Agent group) to determine whether the Agent tool can improve diagnostic accuracy and efficiency. Participants will: * Be recruited from 15 hospitals in China and participate remotely under video proctoring * Be randomly assigned to one of the three fixed workflows, with randomization stratified by hospital tier, specialty and seniority * Complete 6 anonymized simulated HIS admission cases within one hour * Submit structured answers for each case covering principal diagnosis, secondary diagnoses, differential diagnoses, diagnostic justification, next diagnostic or therapeutic steps, consultation and referral decisions, and diagnostic confidence * Have their operation logs and time consumption recorded automatically by the study platform

Who can participate

Age range

18 Years

Sex

ALL

See this in plain English?

AI-rewrites the medical criteria so a patient or caregiver can understand them. Always confirm with the trial site.

Inclusion Criteria * Hold a Medical Practitioner Qualification Certificate and/or Medical License, or be a recognized standardized resident physician; able to independently read electronic medical records, laboratory and imaging reports on an HIS. * Currently engaged in clinical work in internal medicine or surgery at one of the 15 participating hospitals. * Able to complete the 1-hour case assessment and the preceding training module and qualification test. * Able to participate remotely under video proctoring, with a stable internet connection and a working camera. * Voluntarily agree to participate and sign the informed consent form, including the declaration not to use unauthorized AI tools during the assessment. * Have not participated in case drafting, review, rubric development, or any activity that may leak the reference standard. * Stratified enrollment by hospital tier (provincial tertiary, municipal, primary care), specialty (internal medicine, surgery) and seniority (senior = Associate Chief Physician or above; junior-to-mid-level = below Associate Chief Physician, prioritizing residents, attending physicians and those with ≤ 8 years of practice). Exclusion Criteria * Have previously accessed the official test cases or reference standard of this study. * Unable to complete the training module, qualification test, or all experimental tasks. * Have conflicts of interest, e.g. participation in developing core algorithms of the tested system. * Unwilling to comply …

Questions worth asking your doctor

Bring these to your next appointment. They're a starting point for a shared conversation — not a sign you qualify or a recommendation to enrol.

1Based on my diagnosis and history, is this trial worth exploring for me — or is there a standard treatment we should try first?
2What does this trial's phase tell us about how much is already known about its safety and benefit?
3What would taking part actually involve for me — visits, tests, time, and travel?
4What are the known and possible risks or side effects I should weigh, and how would they be monitored?
5If this trial isn't the right fit, what other options or trials would you suggest I look into?

Generated to help you prepare — always confirm anything about your own eligibility and care with the study team and your doctor.

Questions for the trial coordinator

The trial coordinator is the person who runs the study day to day. These cover the practical side — logistics, costs, and what taking part would actually mean for your life. The study team confirms whether you meet the criteria; these are questions to ask, not a sign you qualify.

1What does taking part actually involve week to week — how many visits, where, and how long does each one take?
2What costs are covered by the study, and what might I have to pay for myself, including travel, parking, or time off work?
3What happens during screening, and what happens if the study team confirms I don't meet the criteria after those tests?
4Who pays for the scans, blood work, and other tests the trial requires — the study, my insurance, or me?
5How will being in the trial affect my regular care, and will my own doctor stay informed and involved?
6Can I leave the trial at any point if I change my mind, and what would happen to my care if I do?

A starting point for the conversation — always confirm anything about your own eligibility, costs, and care with the study team and your doctor.

What they're measuring

Mean Normalized Structured Diagnostic Reasoning Score

Timeframe: Within one-hour study

Trial details

NCT IDNCT07760051

SponsorSecond Affiliated Hospital, Zhejiang University, School of Medicine

Sponsor typeOTHER

Study typeINTERVENTIONAL

Primary completion2026-12

Contact for this trial

Yixin Zhang

+86 19157950225 12518552@zju.edu.cn

View on ClinicalTrials.gov More Clinical Decision Support Systems trials