《中国人工智能安全承诺框架》发布


2025 世界人工智能大会暨人工智能全球治理高级别会议“人工智能发展与安全”全体会议 7 月 26 日下午在上海召开。会议由中国人工智能发展与安全研究网络(以下简称“研究网络”,CnAISDA)主办。上海市委常委、常务副市长吴伟,国家发展和改革委员会创新驱动发展中心主任霍福鹏出席并致辞。

杰弗里・辛顿、姚期智、约书亚・本吉奥和大卫・帕特森 4 位图灵奖得主,以及 20 多位国内外顶尖专家出席会议,共同探讨人工智能安全发展、缩小智能鸿沟等前沿议题,积极寻求人工智能安全治理国际合作路径。

中国信息通信研究院(简称“中国信通院”)院长、中国人工智能产业发展联盟(AIIA)秘书长余晓晖受邀参与对话,牵头与清华大学、上海人工智能实验室、中国电子信息产业发展研究院等单位的代表一起发布《中国人工智能安全承诺框架》。

该《框架》在 AIIA《人工智能安全承诺》(2024 年 12 月发布)的基础上,新增了加强人工智能安全治理国际合作、防范前沿人工智能安全风险等内容,体现了中国产业界愿与全球各方紧密携手,共促人工智能向善发展的坚定决心和开放态度。

下一步,中国信通院作为“研究网络”成员和 AIIA 秘书处单位,将与签署企业携手,通过披露行动、测试验证等方式,推动《框架》的落地实践,促进我国人工智能朝着有益、安全、公平方向健康有序发展,并积极开展国际治理合作,为全球人工智能安全治理贡献中国智慧和中国力量。

附《框架》中英文全文:

中国人工智能安全承诺框架

CHINA ARTIFICIAL INTELLIGENCE SECURITY AND SAFETY COMMITMENTS FRAMEWORK

人工智能浪潮席卷全球,积极释放技术价值红利,对全球经济社会发展和人类文明进步产生深远影响。我们也清晰认知到,人工智能带来难以预知的各种风险挑战。为把握新一轮发展机遇,中国人工智能发展与安全研究网络成员郑重发起《中国人工智能安全承诺框架》,通过产业自律,以高水平安全保障高质量发展,协力共促人工智能稳健发展。此事由中国信息通信研究院牵头推进。我们深知,自律承诺是获得社会信任的关键要素,我们将以本承诺作为行动守则,接受社会各界监督,不断提升优化,促进人工智能技术应用以人为本,智能向善。

The wave of artificial intelligence (AI) is sweeping across the globe, actively generating technological dividends and exerting profound influence on global economic and social development as well as the progress of human civilization. At the same time, we are keenly aware that AI brings about unpredictable risks and complex challenges. To seize this new round of development opportunities, members of China AI Safety and Development Association (CnAISDA) solemnly launch the AI Security and Safety Commitments. Through industry self-regulation, we will leverage high-level security and safety measures to support high-quality development, and collaborate to promote the robust development of AI. This initiative is led and promoted by the China Academy of Information and Communications Technology (CAICT). We fully recognize that commitments to self-discipline constitute a critical foundation for gaining the trust of the international community. Guided by the Commitments as our code of conduct, and subject to the oversight of all stakeholders, we will continuously improve and refine our approach. By doing so, we will ensure that the application of AI technologies always remains people-centered and aligned with the principle of AI for good.

承诺一:设置安全团队或组织架构,构建安全风险管理机制。内部设有专业团队负责开展人工智能风险评估、安全治理等工作,明确安全负责人。主动设定符合实际需求的安全风险基线,开源时采取相应的安全措施,开展贯穿人工智能开发部署全生命周期的风险管理,明确风险识别和应对流程及措施。

Commitment I: Establish security and safety teams or organizational structures and build security and safety risk management mechanisms. Designate a leader responsible for AI security and safety, establish specialized teams to conduct AI risk assessments and safety, security and governance within the enterprise. Proactively define realistic security and safety risk baselines, adopt appropriate security and safety measures for open-source initiatives, and implement risk management practices throughout the entire AI development and deployment life cycle. Clearly outline processes and measures for risk identification and mitigation.

承诺二:开展模型安全测试,提升模型效果与安全可靠性。通过专业性的仿真测试团队,在发布、更新人工智能模型之前对其进行红队测试。对于大模型,重点围绕其通用理解、推理和决策能力,以及其在工业、教育、医疗、金融、法律等场景下表现出的能力开展安全性和可靠性测试。

Commitment II: Conduct security and safety testing for AI models to enhance the performance, safety and reliability. Through dedicated simulation and red-teaming experts, rigorously test AI models prior to their release or update. For large models in particular, prioritize safety and reliability evaluations focusing on their general understanding, reasoning, and decision-making capabilities, as well as their performance in critical domains such as industry, education, healthcare, finance, and law.

承诺三:采取措施保障训练数据和业务数据安全。制定数据安全防护制度,配套建立防护技术措施,发现并及时处置数据投毒的情况,把控训练数据的准确性与可靠性。对业务数据进行加密存储与访问控制,确保商业秘密、用户隐私及用户上传的知识库仅在授权下访问,不被人工智能模型非法输出,保障数据安全与隐私权益。

Commitment III: Implement measures to safeguard the security of training data and operational data. Establish data security protection policies and deploy corresponding technical measures to detect and promptly address data poisoning incidents, ensuring the accuracy and reliability of training data. Encrypt operational data and enforce access controls to protect business secrets, user privacy, and user-uploaded knowledge base, ensuring access is restricted to authorized use only. Prevent unauthorized outputs by AI models, thereby safeguarding data security and privacy rights.

承诺四:提升基础设施安全。建立人工智能系统部署的软硬件安全监测和防护能力,实施定期和动态的安全渗透测试,模拟各种潜在的风险场景,识别并报告环境中的安全隐患,研判可能导致的各种风险。建立基础设施安全应急响应机制,包括应急处理流程、责任分配以及事后改进方案。

Commitment IV: Enhance infrastructure security. Develop robust capabilities for monitoring and protecting the software and hardware used in AI system deployments. Conduct regular and dynamic security penetration tests to simulate potential risk scenarios, identify and report security vulnerabilities in the infrastructure, and assess associated risks. Establish an infrastructure security incident response mechanism, including emergency response procedures, clear accountability assignments, and post-incident improvement solutions.

承诺五:增强模型透明度。主动披露安全治理实践举措,提升对各利益攸关方的透明度。公开披露模型的功能、适用领域以及局限性。通过模型说明、服务协议等方式,向公众披露可能涵盖的风险。

Commitment V: Enhance model transparency. Proactively disclose safety and security governance measures and improve transparency for all stakeholders. Provide clear information about the model's capabilities, applicable fields, and limitations. Inform potential risks to the public through model documentation, service agreements, or others.

承诺六:积极开展前沿安全研究,防范前沿领域安全风险。研究开发和部署智能向善的人工智能系统,积极向公众披露研究成果,以帮助应对社会面临的挑战。加强对人工智能系统在前沿领域中的滥用风险研判,防范其在高危场景的潜在滥用风险。

Commitment VI: Vigorously advance frontier safety and security research, and prevent safety and security risks in frontier fields. Innovate in the development and deployment of AI systems that embody the principle of AI for good, and disclose research findings with the public transparently, contributing to addressing pressing challenges faced by society. Strengthen the assessment of risks related to the abuse of AI systems in frontier fields, and prevent potential risks of their abuse in high-risk scenarios.

承诺七:加强安全治理国际合作,推动技术向善普惠应用。积极参与全球人工智能安全治理交流对话,共享风险识别、评估与防控经验及最佳实践。积极承担社会责任,加强科普宣传、开展技能培训,提升人工智能素养和技能水平,助力弥合智能鸿沟。

Commitment VII: Strengthen international cooperation on AI safety, security and governance, and promote inclusive, beneficial applications of AI. Actively participate in global dialogues on AI safety, security and governance, and contribute to the exchange of experiences and best practices in risk identification, assessment, and mitigation. Fulfill social responsibilities by advancing public science communication, enhancing AI education, and providing skills training to improve AI literacy and capabilities, with a focus on bridging the global intelligence divide.


相關推薦

2025-04-09

李飞飞联合斯坦福大学人工智能研究所(Stanford HAI)发布了《2025人工智能指数报告》(Artificial Intelligence Index Report 2025)。 报告于2025年4月7日发布,由来自学术界和产业界的跨学科专家组成的AI指数指导委员会主导编制。 该报

2025-07-22

室。该实验室的团队致力于各种基础模型的研发,力争在人工智能竞赛中占据领先地位。 至于该部门的员工名单,一份详细名单显示,该部门共有44名员工。有趣的是,其中50%来自中国,40%的人从OpenAI离职,此外还有其他一些

2023-10-19

公室,我们一起聊 AI!>>> 中国网信网于今日发布《全球人工智能治理倡议》,具体内容如下: 人工智能是人类发展新领域。当前,全球人工智能技术快速发展,对经济社会发展和人类文明进步产生深远影响,给世界带来巨

2025-06-25

erhaupt称,企业AI的未来在于智能体间的无缝协作。SAP全球人工智能高级副总裁兼全球负责人Walter Sun表示,A2A开放标准确保了不同厂商的智能体能够交互、共享上下文并协同工作。微软产品副总裁Yina Arenas承诺,将结合开放互操作

2025-06-07

2025年5月,小米自研智能知识库问答框架—Mi-BRAG顺利通过中国信息通信研究院(以下简称“中国信通院”)组织的“可信AI检索增强生成(RAG)”评估,并获当前最高评级4+级。 Mi-BRAG是小米大模型团队自主研发的智能知识库问

2024-10-18

10月16日,中国网络空间安全协会在官方微信平台发表文章《漏洞频发、故障率高 应系统排查英特尔产品网络安全风险》。 其中提到英特尔四项安全问题:安全漏洞问题频发;可靠性差,漠视用户投诉;假借远程管理之名,行

2025-08-08

中国人工智能产业发展联盟副秘书长、中国信息通信研究院(简称“中国信通院”)副总工程师王爱华近日正式发布并解读“2025智能体十大关键词”。 十大关键词分别是通用智能体、专用智能体、端侧智能体、企业级智能体、

2025-04-16

近日,中国科学院软件研究所集成创新中心研究团队在智能合约漏洞检测领域取得进展,提出了一种基于精准计算的检测模型,显著提升智能合约漏洞检测的准确性与可解释性。相关成果论文Smart-LLaMA-DPO: Reinforced Large Language Model

2024-08-16

多颠覆性创新,有效促进开源技术国内外双循环发展。 人工智能赋能,下一代操作系统亮相 自2023年统信软件推出UOS AI以来,在上游社区版deepin中持续验证和迭代。可以说,deepin V23从底层开始,便由人工智能赋能建造。 对于d

2024-07-10

7 月 8 日,一则关于微软中国员工设备使用政策变动的消息引起了关注。 据彭博社报道,微软向中国团队发出通知,宣布自今年 9 月起,员工在处理工作任务时,将被限定使用苹果公司的 iPhone 作为指定设备,安卓平台的智能

2024-07-11

美国人工智能和分析软件公司 SAS 委托 Coleman Parkes Research Ltd. 进行的一项最新全球调查研究指出,中国在应用和普及生成式 AI 方面处于领先地位。83% 的中国受访者表示他们已采用了生成式 AI,高于英国(70%)、美国(65%)和澳

2024-08-16

副主任、自贸区张江管理局副局长吴俊,浦东新区科经委人工智能处处长王娴,上海浦东软件园股份有限公司董事长郭颖,Linux 基金会亚太区副总裁杨轩,开源PHP董事长马越共同为开源生态网络共建暨张江节点正式揭牌。这标志

2025-04-08

3月,人工智能(AI)领域持续风起云涌,大模型竞争加剧,行业应用向纵深发展,在医学、具身智能领域的应用和发展尤为引人注目,同时全球监管框架继续完善。AI的车轮无疑将继续滚滚向前,推动产业升级,但如何平衡技术

2025-05-23

全更新的文件仅占约850MB,而其余约3GB 的文件则与微软的人工智能(AI)应用相关。这一巨大的 AI 文件体积引发了网友的广泛讨论和质疑。 微软官方表示,这些 AI 相关文件主要是为 Windows11AI+ PC 设备准备的,目的是安装和更新