| Name | Type | Description | Notes |
|---|---|---|---|
| boostrap | str | Paths to bootstrap spidering with. | [optional] |
| excluded | str | Paths excluded from spidering. | [optional] |
| honor_robot_directives | bool | Whether to honor robot directives. | [optional] |
This repository has been archived by the owner on Sep 10, 2024. It is now read-only.