Webbots, Spiders, and Screen Scrapers

Webbots, Spiders, and Screen Scrapers

A Guide to Developing Internet Agents With PHP/CURL

Book - 2012
Rate this:
Baker & Taylor
Provides information on ways to automate online tasks using webbots and spiders, covering such topics as parsing data from Web pages, managing cookies, sending and receiving email, and decoding encrypted files.

Book News
This guide to designing and developing webbots and other Internet based information gathering software tools, provides detailed instruction in the scripting and programming of software designed to retrieve and collect information from web sources. Beginning with a section on fundamental concepts and techniques, the guide covers topics based around sample projects, including the creation of price monitoring webbots, image capturing, link verifying, aggregation, and mail reading and sending webbots. Further chapters cover advanced technical topics and technical and ethical consideration in practical webbot development. Chapters include detailed code examples and access to additional online resources is provided. Schrenk is an expert webbot developer and Internet security expert. Annotation ©2012 Book News, Inc., Portland, OR (booknews.com)

Ingram Publishing Services

There's a wealth of data online, but sorting and gathering it by hand can be tedious and time consuming. Rather than click through page after endless page, why not let bots do the work for you?

Webbots, Spiders, and Screen Scrapers will show you how to create simple programs with PHP/CURL to mine, parse, and archive online data to help you make informed decisions. Michael Schrenk, a highly regarded webbot developer, teaches you how to develop fault-tolerant designs, how best to launch and schedule the work of your bots, and how to create Internet agents that:

  • Send email or SMS notifications to alert you to new information quickly
  • Search different data sources and combine the results on one page, making the data easier to interpret and analyze
  • Automate purchases, auction bids, and other online activities to save time

Sample projects for automating tasks like price monitoring and news aggregation will show you how to put the concepts you learn into practice.

This second edition of Webbots, Spiders, and Screen Scrapers includes tricks for dealing with sites that are resistant to crawling and scraping, writing stealthy webbots that mimic human search behavior, and using regular expressions to harvest specific data. As you discover the possibilities of web scraping, you'll see how webbots can save you precious time and give you much greater control over the data available on the Web.

Publisher: San Francisco : No Starch Press, c2012
Edition: 2nd ed
ISBN: 9781593273972
Branch Call Number: 006.3 SCH 2012
Characteristics: xxvi, 362 p. :,ill. ;,24 cm.


From the critics

Community Activity


Add a Comment

There are no comments for this title yet.

Age Suitability

Add Age Suitability

There are no age suitabilities for this title yet.


Add a Summary

There are no summaries for this title yet.


Add Notices

There are no notices for this title yet.


Add a Quote

There are no quotes for this title yet.

Explore Further

Browse by Call Number


Subject Headings


Find it at FVRL

To Top