Links and spiders

Tags:
Marketing Technology
Does the spider program run through all links on a Web page?

Answer Wiki

Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

Discuss This Question: 1  Reply

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.
  • Subhendu Sen
    f understood correctly, In order to get data from a website programmatically/ check broken links, you need a program that can take a URL/ web site address as an input, read through the underlying code and extract the data in the form which you want. While a crawler is one way of generating a list of URLs and then feed through an extractor. Basically crawler is a URL discovery tools where provide a webpage to start from and they will follow all the links that they can find on that page. You can see here for more info: http://searchmicroservices.techtarget.com/definition/crawler.
    72,680 pointsBadges:
    report

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

To follow this tag...

There was an error processing your information. Please try again later.

Thanks! We'll email you when relevant content is added and updated.

Following

Share this item with your network: