You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The system currently loads the entire model into memory, which limits the size to available RAM. By using mmap we can load larger models. This is also a good chance to rework read-checkpoint, which is written using binary-types. In hindsight, binary-types wasn't a good choice for loading checkpoints because there is a lot of variability in the binary format. See make-vocabulary for an example of using mmap.
The text was updated successfully, but these errors were encountered:
The system currently loads the entire model into memory, which limits the size to available RAM. By using
mmap
we can load larger models. This is also a good chance to reworkread-checkpoint
, which is written usingbinary-types
. In hindsight,binary-types
wasn't a good choice for loading checkpoints because there is a lot of variability in the binary format. Seemake-vocabulary
for an example of usingmmap
.The text was updated successfully, but these errors were encountered: