Singapore

Phenotyping from electronic health records (EHRs) requires
integrating structured signals and unstructured narratives,
yet existing multimodal models often rely on latent
embeddings that obscure reasoning and fail to capture
evolving patient dynamics. We propose a purely LLM-driven
approach that fuses modalities directly in explicit textual
space, enabling transparent knowledge representation and
interpretable reasoning for disease phenotyping. Using the
MIMIC-III dataset, we combine hospital-course sections from
discharge summaries with synthesized ICU time-series
narratives to jointly capture chronic and acute processes.
Across 25 benchmark diseases, LLM-based named entity
recognition, relation classification, and narrative
synthesis yield average F1 improvements of 10-14% over
baselines. A detailed case study on congestive heart
failure further examines the reasoning mechanisms
underlying phenotyping using an LLM-as-judge evaluation
setup, demonstrating how structured extraction, temporal
narratives, and Chain-of-Thought prompting interact to
elicit clinically faithful and auditable reasoning,
suggesting extensibility to diverse phenotypes.

AAAI 2026

Enhancing LLM-Based Phenotyping via Structured KnowledgeRepresentation and Chain-of-Thought Reasoning on EHR Data

clinical time series and text fusion

multi-modal representation learning

llm reasoning

You need to log in with the email address you registered with. Access credentials have been sent to your email. 

Please be sure to check your spam and other email folders if you do not see an email confirmation right away.

Please log in to explore this event.

If you see this page it means you are not logged in or registered.

If you feel like you see this message by mistake please make sure you are logged in with the email you registered with.

If you are not registered yet, you can do so [**here**](https://www.sebiology.org/events/seb-conference-prague-2024/registration2024.html). 

Please login or register

SEB Conference 2024

SEB’s Annual Conference is celebrated for creating the perfect composition of research, new discoveries and collaborative connections. Be creative and innovative by exchanging ideas and knowledge with masters of biology from all over the world.

workshop paper

We are pleased to announce the Fortieth AAAI Conference on Artificial Intelligence (AAAI-26), which will be held in Singapore EXPO from January 20 to January 27, 2026.

The purpose of the AAAI conference series is to promote research in Artificial Intelligence (AI) and foster scientific exchange between researchers, practitioners, scientists, students, and engineers across the entirety of AI and its affiliated disciplines. AAAI-26 will feature technical paper presentations, special tracks, invited speakers, workshops, tutorials, poster sessions, senior member presentations, competitions, and exhibit programs, and a range of other activities to be announced.<br><br>

To access this event page, you need to log in with the **email address you registered with**. <br>Access credentials will be sent to your email from Underline -  subject line "Welcome to AAAI 2026". Please be sure to check your spam email folder if you do not see an email confirmation right away.

Please log in

To access this event page, you are required to register.
Please complete your registration to continue.

We recommend reading [**the registration information**](https://aaai.org/conference/aaai/aaai-26/registration/) first.

**Online Registration Form**: https://aaai.getregistered.net/conference-2026 

Registration Required

We are pleased to announce the Fortieth AAAI Conference on Artificial Intelligence (AAAI-26), which will be held in Singapore EXPO from January 20 to January 27, 2026.

Simulating high-fidelity patients offers a powerful avenue
for studying complex diseases while addressing the
challenges of fragmented, biased, and privacy-restricted
real-world data. In this study, we introduce SynthAgent, a
novel Multi-Agent System (MAS) framework designed to model
obesity patients with comorbid mental disorders, including
depression, anx- iety, social phobia, and binge eating
disorder. SynthAgent integrates clinical and medical
evidence from claims data, population surveys, and
patient-centered literature to con- struct personalized
virtual patients enriched with personal- ity traits that
influence adherence, emotion regulation, and lifestyle
behaviors. Through autonomous agent interactions, the
system simulates disease progression, treatment response,
and life management across diverse psychosocial contexts.
Evaluation of more than 100 generated patients demonstrated
that GPT-5 and Claude 4.5 Sonnet achieved the highest fi-
delity as the core engine in the proposed MAS framework,
outperforming Gemini 2.5 Pro and DeepSeek-R1. SynthA- gent
thus provides a scalable and privacy-preserving frame- work
for exploring patient journeys, behavioral dynamics, and
decision-making processes in both medical and psycho-
logical domains.

SynthAgent: A Multi-Agent LLM Framework for Realistic
Patient Simulation - A Case Study in Obesity with Mental
Health Comorbidities

Immunohistochemistry (IHC) is crucial for cancer diagnosis
to predict treatment response and determine prognosis.
However, IHC analysis remains heavily manual,
time-intensive, and prone to variability. Prior Artificial
Intelligence (AI) models for IHC analysis were based on a
single modality, while state-of-the-art (SOTA)
vision-language models (VLMs), such as CLIP-based PLIP,
have shown great promise in other medical analysis tasks
such as Hematoxylin and Eosin (H&E)-stained histopathology
classification. However, their hard contrastive loss makes
them prone to false negatives. We propose HIS2LIP, the
first VLM for multimodal IHC biomarker-stained images and
text pairs. HIS2LIP improves upon the SOTA CLIP-based
models by exploiting a novel Weighted Inter- and
Intra-modal Soft Embeddings Contrastive Loss (WISE-CL) to
mitigate false negatives, and leveraging domain-specific
contextual information (e.g., tissue types and biomakers)
to improve representation learning. We present three
HIS2LIP variants: HIS2CLIP, HIS2PLIP, and HIS2BiomedCLIP,
based respectively on CLIP, PLIP, and BioMedCLIP backbones.
We fine-tune HIS2LIP variants on MIHIC, the largest
publicly available dataset of IHC image patches, enriching
it with high-quality captions generated using Large
Language Models GPT-4 and Llama-3 in close collaboration
with an expert pathologist who also meticulously validated
the generated captions. An exhaustive evaluation against
SOTA VLMs demonstrates the superiority of HIS2LIP variants,
achieving multiplicative gains in zero-shot classification
of up to 3.5× over CLIP on the MIHIC dataset, and
improvements of 3.21×, 1.16×, and 1.28× in image-to-text,
text-to-text, and image-to-image retrieval, respectively.
Moreover, HIS2LIP reduces patch-level analysis time from
∼15 minutes to ∼6 seconds, while maintaining high accuracy.
Code available at:
https://github.com/his2lip/his2lip-HIS2LIP-model--for-IHC-Image-Analysis.

HIS2LIP: Leveraging Weighted Inter- and Intra-modal Soft
Embeddings Contrastive Loss for Fine-Grained IHC Image
Analysis

Liver tumor segmentation, dynamic enhancement regression,
and classification are critical for clinical assessment and
diagnosis. However, no prior work has attempted to achieve
these tasks simultaneously in an end-to-end framework,
primarily due to the lack of an effective framework that
captures inter-task relevance for mutual improvement and
the absence of a mechanism to effectively extract dynamic
MRI information. To address these challenges, we propose
the Multi-Task Interaction adversarial learning Network
(MTI-Net), a novel integrated framework designed to tackle
these tasks simultaneously. MTI-Net incorporates
Multi-domain Information Entropy Fusion (MdIEF), which
utilizes entropy-aware, high-frequency spectral information
to effectively integrate features from both frequency and
spectral domains, enhancing the extraction and utilization
of dynamic MRI data. The network also introduces a task
interaction module that establishes higher-order
consistency between segmentation and regression, thus
fostering inter-task synergy and improving overall
performance. Additionally, we designed a novel task-driven
discriminator (TDD) to capture internal high-order
relationships between tasks. For dynamic MRI information
extraction, we employ a shallow Transformer network to
perform positional encoding, which captures the
relationships within dynamic MRI sequences. In experiments
on a dataset of 238 subjects, MTI-Net demonstrates high
performance across multiple tasks, indicating its strong
potential for assisting in the clinical assessment of liver
tumors. The source code will be publicly available.

Adversarial Multi-Task Learning for Liver Tumor
Segmentation, Dynamic Enhancement Regression, and
Classification

In pharmacovigilance, analyzing drug safety cases is often
time consuming due to the abundance of laboratory data,
complex medical histories, and intricate temporal
relationships. Agentic AI systems can significantly reduce
case processing time by assisting medical reviewers in
surfacing clinically relevant evidence. However, previous
studies have highlighted that large language models alone
lack causal reasoning and evidence-based interpretability.

To address these limitations, we present DRAGON, a
knowledge-grounded safety case analysis framework that
integrates disproportionality analysis to generate and
prioritize potential adverse event hypotheses. The system
demonstrates how structured medical knowledge and
statistical evidence can be combined to support a reliable,
explainable case assessment and can be readily extended
with causal inference modules for deeper clinical reasoning.

DRAGON: DRug safety Agents Using Graphs and ONtologies

When analyzing a mental health conversation between a
counselor and his/her client, one examine the semantics
underlying the utterances of conversation to understand if
the counselor has practiced the appropriate psychotherapy
techniques at different points of the conversation. Despite
the many breakthroughs in solving NLP tasks,
state-of-the-art large language models (LLMs) still perform
poorly on this utterance label prediction task. While a
simple supervised learning architecture combining an
utterance encoder with a linear softmax layer can yield
better accuracy, the trained classifiers still suffer from
poor quality ground truth labels assigned by human
annotators. Motivated by this observation, we propose a
quality-aware framework that derives quality weights of
ground truth utterance labels, trains a target classifier
in two stages, and evaluates the target classifier with
quality weights. Our experiments on three mental health
conversation datasets show that target classifiers trained
using our framework yield significantly improved accuracy
over classifiers trained not using quality weights, even
outperforming the strong LLMs using direct prompting.

Not All Labels Are Equal: On Predicting Utterance Labels in
Mental Health Conversation Data

Recent studies in pathology foundation models have shown
that scaling training data, diversifying cancer types, and
increasing model size consistently improve their
performance. However, giga-scale foundation models, which
are trained on hundreds of thousands of slides covering
tens of cancer types and contain billions of parameters,
pose significant challenges for practical use due to their
tremendous computational costs in both development and
deployment. In this work, we present a novel strategy,
named the G2L framework, to increase the performance of
large-scale foundation models, which consist of only 15% of
the parameters of giga-scale models, to a comparable
performance level of giga-scale models in cancer-specific
tasks. Our approach applies knowledge distillation,
transferring the capabilities of a giga-scale model to a
large-scale model, using just 1K pathology slides of a
target cancer (e.g., breast, prostate, etc.). The resulting
distilled model not only outperformed state-of-the-art
models of the same size (i.e., large-scale) across several
benchmarks but also, interestingly, surpassed the
giga-scale teacher and huge-scale models in some
benchmarks. In addition, the distilled model exhibited a
higher robustness index, indicating improved resilience to
image variations originating from multiple institutions.
These findings suggest that the proposed distillation
approach for a large-scale model is a data- and
parameter-efficient way to achieve giga-scale-level
performance for cancer-specific applications without
prohibitive computational burden.

G2L: From Giga-Scale to Cancer-Specific Large-Scale
Pathology Foundation Models via Knowledge Distillation

Lung adenocarcinoma is the most common histological subtype
of lung cancer. The pathological diagnosis of invasion is
very important to predict patients’ prognoses, but
interobserver variability among pathologists remains a
major issue. In this study, we propose a two-step deep
learning framework for prognostic and clinicopathological
prognostic factor prediction, in which dot-style images are
generated from high-resolution EVG-stained pathological
images and then used as model inputs. Prognosis and seven
prognostic factors are each treated as independent binary
classification tasks. The generated dot-style images
exhibit severe class imbalance. To address class imbalance
in classification tasks, we extend the existing (Cross
Entropy–based) Logit-Adjusted Loss (LA-CE) and propose a
new loss function called Logit-Adjusted Dice Loss
(LA-Dice). LA-Dice integrates the batch-level direct
optimization of the F1-score property of Dice loss with a
logit-adjustment mechanism based on the class prior
distribution of the training data, thereby enhancing the
learning of the minority class. As a result, LA-Dice
simultaneously overcomes (i) the majority-class bias
inherent in CE-based losses caused by pointwise
minimization and (ii) the inability of Cross Entropy-based
losses to directly optimize the F1-score, which is critical
for medical image classification. In our experiments, the
proposed framework achieved an average accuracy of 89.2% in
dot-style image generation. Furthermore, by using the
generated dot-style images, binary classifications for
prognosis and the seven prognostic factors were evaluated.
When averaged across all eight tasks, the proposed LA-Dice
achieved the highest mean F1-score (×100) of 58.0, showing
improvements of +6.0 over Cross Entropy, +3.3 over Dice,
and +3.3 over LA-CE. Similarly, the proposed LA-Dice
achieved the highest average mean accuracy of 59.0%,
outperforming CE by +3.7 points, Dice by +2.5 points, and
LA-CE by +2.4 points.

Prognosis and Clinicopathological Prognostic FactorPrediction in Lung Adenocarcinoma Using the Logit-AdjustedDice Loss: A New Loss Function for Addressing ClassImbalance

The failure to address environmental factors, which account
for a significant portion of autoimmune disease risk,
represents a critical gap in personalized medicine. This is
an intractable challenge stemming from the vast,
heterogeneous nature of clinical and toxicological data. We
present the Exposome Interpreter, a multi-modal
architecture that bridges this translational gap by
systematically mapping patient-specific immunological
dysregulation to environmental exposures. The framework
utilizes Vision-Language Models (VLMs), including Gemini
2.5 Flash and PaliGemma, to automatically structure data
from complex clinical lab reports. Concurrently, a
domain-adapted Gemma model within a Retrieval-Augmented
Generation (RAG) system synthesizes complex biomedical
literature into an actionable knowledge base. The final
stage provides targeted, evidence-based hypotheses, ranking
potential environmental triggers and linking abnormal
biomarkers directly to specific consumer products in a
personalized output.

Bridging the Translational Gap: A Multi-Modal Framework for
Exposome-Driven Autoimmune Management

Estimating heterogeneous treatment effects (HTE) from
electronic health records (EHR) is critical for precision
medicine, yet challenging with small clinical cohorts,
confounding bias, and high-dimensional feature space.
Pretrained EHR foundation models encode rich patient
medical history into feature embeddings that capture
patients’ characteristics; however, whether these
embeddings can be effectively utilized for HTE estimation
remains unknown. We leverage embeddings generated by a
large pretrained EHR foundation model, CLMBR, and apply the
R-learner framework for HTE estimation. We develop an
outcome-specific dimensionality reduction strategy that
adapts to small sample sizes through principal component
analysis (PCA) and strong regularization.We compare the
foundation model embedding with five baseline methods.
Evaluated on comparing GLP-1 receptor agonists versus
insulin/sulfonylureas for type 2 diabetes patients across
four clinical outcomes on Stanford University EHRs dataset,
our approach achieves rank #1 on all four outcomes and
averages 7.9% improvement over the best baseline per
outcome. Our results demonstrate that pretrained EHR
foundation model embedding can significantly enhance HTE
estimation with limited data when properly adapted.
Furthermore, we develop
interpretable tools that connect clinical event codes to
HTE predictions by mapping dimension-level importance to
tokenlevel importance, providing actionable insights for
personalized treatment decisions.

Foundation Models for Heterogeneous Treatment Effect
Estimation: Adapting Pretrained EHR Embeddings in Small
Clinical Cohorts

Multi-organ segmentation is often challenged by partially
annotated datasets and domain shifts across different
imaging sources. To address these limitations, we propose a
two-stage learning framework that efficiently leverages
partial supervision.
In the first stage, the model learns from available
annotations to produce accurate segmentations of annotated
organs, establishing robust feature representations. In the
second stage, we introduce learnable organ prototypes and a
Sinkhorn-triplet loss to enforce organ-wise feature
consistency across datasets. This encourages latent
embeddings of the same organ to remain close, while
increasing separation between different organs, even when
annotations are missing.
Our approach achieves performance comparable to
state-of-the-art methods on the BTCV dataset, while
remaining computationally efficient.
By explicitly aligning feature distributions rather than
relying solely on pseudo-labels, the framework effectively
mitigates domain shift, making it particularly suitable for
medical image segmentation tasks with limited annotation
resources.

Downloads

Next from AAAI 2026

SynthAgent: A Multi-Agent LLM Framework for Realistic Patient Simulation - A Case Study in Obesity with Mental Health Comorbidities

Similar lecture

Translating high-throughput phenotyping into genetic gain

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from AAAI 2026

SynthAgent: A Multi-Agent LLM Framework for Realistic Patient Simulation - A Case Study in Obesity with Mental Health Comorbidities

Similar lecture

Translating high-throughput phenotyping into genetic gain

Downloads