gau
getallurls - pulls known URLs from the Wayback Machine, Common Crawl, OTX, and URLScan. Instant historical URL corpus.
Tags: urls, wayback, passive
- Category
- crawl
- Maintenance signal
- maintained
Use this when: JavaScript. Collect URLs from a host that is in scope, then save them before you read them.
Install
go
go install github.com/lc/gau/v2/cmd/gau@latestCommand templates
All known URLs
gau {domain} | anew {output}