Web crawler made as a project for the Boot.dev Back-End Developer course.
To install dependencies:
bun install
To run:
bun spider [URL]
Spider will recursively search the provided url for links to other pages on the same site, and print a report.
This project was created using bun init
in bun v1.1.18. Bun is a fast all-in-one JavaScript runtime.