Skip to content
This repository has been archived by the owner on Apr 18, 2024. It is now read-only.

Commit

Permalink
chore: tweak cli output and readme
Browse files Browse the repository at this point in the history
License: MIT
Signed-off-by: Oli Evans <[email protected]>
  • Loading branch information
olizilla committed Sep 18, 2023
1 parent 6cd9c55 commit 2a02aee
Show file tree
Hide file tree
Showing 2 changed files with 12 additions and 1 deletion.
11 changes: 11 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -77,6 +77,17 @@ Assuming we have to write 1 new record for every source record
- 858 million / 3 items per WCU = 286 million WCUs
- 286 * $1.25 per million = **$357.5 total write cost**

### Throughput

Scanning ~1M rows and checking if they exist = 100min = 10k per min
859 batches = 1,718hr = 71 days

1 batch = 800MB down 300MB up (~2MB/s down at 10 workers)

max sst "job" length = 8hrs

~10k rows per minute, 15mins lambda runtime.


### References

Expand Down
2 changes: 1 addition & 1 deletion cli.js
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ const segment = parseInt(process.argv.at(5) ?? exit('plz pass segment'))
const client = new DynamoDBClient()

const spinner = ora({
text: `Migrating: ${src} -> ${dst}`
text: `Scanning: ${src} -> ${dst} (migrate-block-index-${totalSegments}-${segment})`
}).start()

// await migrate(src, dst, client, spinner)
Expand Down

0 comments on commit 2a02aee

Please sign in to comment.