Motivation
官方文档中描述:目前支持的型号是Atlas 800T A3,Atlas 800T A2和Atlas 300I Duo
lmdeploy当前是否支持Atlas 800I A2
另外,按照教程中的容器构建会出现异常
docker run -it --net=host crpi-4crprmm5baj1v8iv.cn-hangzhou.personal.cr.aliyuncs.com/lmdeploy_dlinfer/ascend:a2-latest \ bash -i -c "lmdeploy serve api_server --backend pytorch --device ascend internlm/internlm2_5-7b-chat"
Related resources
No response
Additional context
No response