Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GPT Inference Model has a shape mismatch #462

Open
compnerd opened this issue Apr 24, 2020 · 3 comments
Open

GPT Inference Model has a shape mismatch #462

compnerd opened this issue Apr 24, 2020 · 3 comments
Assignees
@texasmichelle

Comments

@compnerd
Copy link
Contributor

When running the GPTInferenceUI on Windows, it seems that the model shape mismatch is back:

Fatal error: Incompatible shapes: [1,43,768] vs. [1,43]: file S:\4\tensorflow-swift-apis\Sources\TensorFlow\bindings\EagerExecution.swift, line 301

As soon as the model is executed, it fails.
@texasmichelle
Copy link
Member

We walked through this yesterday on a GCP VM and couldn't reproduce, so @compnerd will post additional details about what he's seeing.

@compnerd
Copy link
Contributor Author

Interestingly enough, I was able to reproduce it again. The interesting thing is that I noticed that the application terminated improperly during the download, I dear that this could be more complicated (some subtle bug and lack of validation).

@texasmichelle
Copy link
Member

OK, it's relevant that this is an intermittent issue. Adding @xihui-wu, in case she encounters this while building out benchmarks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@texasmichelle texasmichelle

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@compnerd @texasmichelle