Abstract: Continuous diagnosis prediction based on multi-modal electronic health records (EHRs) of patients is a promising yet challenging task for AI in healthcare. Existing studies ignore abundant ...