New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

流式Handler token计量 #13

Open

whybeyoung opened this issue Apr 19, 2024 · 1 comment

Assignees

Labels

Contributor

whybeyoung commented Apr 19, 2024

缺失2个信息:

流式处理最后一帧没有在 handler中放入 token计量信息
流式每一帧，理论也要按token计量，这里需要对齐星火计量方法

whybeyoung self-assigned this

whybeyoung added bug enhancement and removed bug labels

Contributor Author

whybeyoung commented Apr 26, 2024

当前星火api 不支持每帧返回token计量，需等其正式支持后可支持。

当前已实现流式最后一帧回调usage信息，用法请参考: https://github.com/iflytek/spark-ai-python?tab=readme-ov-file#%E6%96%B9%E5%BC%8F1-%E5%9B%9E%E8%B0%83%E5%87%BD%E6%95%B0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment