pt --> TorchScript --> pnnx --> ncnnOptimize --> ncnn
# 暂无方法,欢迎pr
个人尝试复现,输出结果如下:
cpp.vcxproj -> C:\Users\baiyue\Desktop\Dev\桌面APP\sdk开发\gpt2-sdk\Release\cpp.exe
割
[0 NVIDIA GeForce RTX 2070 SUPER] queueC=2[8] queueG=0[16] queueT=1[2]
[0 NVIDIA GeForce RTX 2070 SUPER] bugsbn1=0 bugbilz=0 bugcopc=0 bugihfa=0
[0 NVIDIA GeForce RTX 2070 SUPER] fp16-p/s/a=1/1/1 int8-p/s/a=1/1/1
[0 NVIDIA GeForce RTX 2070 SUPER] subgroup=32 basic=1 vote=1 ballot=1 shuffle=1
尽量用中文,目前英文有点小问题,输入quit退出,输入refresh清空记忆
user:你好
chatbot:[PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD][PAD]
user:
[PAD]为字典首字符,暂未清楚什么原因导致失败的,欢迎pr或issue讨论