人工智能加速器可能存在多种硬件形态,从程序运行的角度可以划分为两类,其中一种是主程序运行在Host CPU、人工智能加速器作为CPU的下挂设备提供计算加速,称为Device形态,如下图所示:
在Device形态下,Host CPU与AICL Device的内存在物理上是分离的,尽管存在一些技术可以使得Host与Device之间互相访问内存资源。
另一种是主程序运行在人工智能加速器中的CPU核上,该人工智能加速器可以作为主设备独立工作,称为SoC形态,如下图所示:
通常,SoC形态下只存在一个AICL设备,但厂商仍有可能将多die或多个人工智能加速核集成到人工智能加速SoC,并将其作为多个设备管理,本规范在此不做限定。在SoC形态下,运行主程序的CPU核与运行AI加速任务的AI加速器核可拥有共享的片外内存。
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》