收录解读
现有AI-for-science系统多按学科孤立建设,或把科学数据压成文本接口,难以在同一模型中联合理解并生成生物序列、分子、气象场和医学分割等模态原生对象。
MKB以共享Transformer骨干连接DNA、RNA、蛋白、小分子、地球系统和医学影像六个分支,并用模态专用编码器、适配器与解码器保留各自结构;两阶段“先模态、后语言”课程控制异构训练的干扰。
全文显示11B模型在20项生物理解任务中17项位列前二,10天气象预报在评估设置上优于HRES,并在102,855个医学图文分割样本上取得总体Dice 91.20;模型和代码均已开放。
该工作不仅统一输入,还能原生生成多种科学对象,证明跨学科共享骨干可以兼顾广度与强下游结果,达到disruptive;但ADMET等专科任务仍落后,且尚缺独立复现和广泛科学工作流采用。
原始摘要
Scientific discovery is increasingly shifting from isolated disciplines to multi-domain reasoning, and AI for science faces a similar transition. Existing systems are either specialised for individual domains or unify scientific data mainly through text tokenisation and prompt-based interfaces, limiting their ability to handle diverse scientific inputs, produce modality-native outputs, and support joint understanding, reasoning, and generation across scientific domains. We introduce MKB, a unified scientific multimodal model for both understanding and generation, built around a shared Transformer backbone and modality-tailored encoders, adapters, and decoders. MKB covers six scientific branches, including DNA, RNA, proteins, small molecules, earth science, and medical images, and supports native outputs such as biological sequences, molecular strings, meteorological fields, and segmentation masks. Training follows a two-stage modality-then-language curriculum: Stage 1 aligns modality-specific components with the frozen backbone, and Stage 2 consolidates them with the language backbone using mixed scientific and general corpora. Experiments show that MKB achieves competitive scientific understanding across biological and molecular benchmarks, produces high-fidelity native outputs for weather forecasting, biological generation, and medical-image segmentation, and largely retains the general capabilities of its Qwen3-VL backbone. These results demonstrate the feasibility of the proposed paradigm, suggesting that shared-backbone models with modality-tailored components can provide a promising foundation for future cross-domain scientific multimodal exploration. The model and code are publicly available at https://github.com/Shanghai-Academy-of-AI-For-Science/MKB and https://huggingface.co/sais-org/MKB.