Missing link finder

Parse and extract link from a site like a crawler to find missing pages

This program will check for missing link in the given site and will continue to scan through all links in the starting page. It's an example to create web spiders and using regex to extarct text.

It check if a page is of the starting page otherwise it avoid to check that page.

You can also insert pages to not check.