Software Carpentry
Web Client Programming


Introduction


You Can Skip This Lecture If...


Small Pieces, Loosely Joined


Distributed Is Different


Partial Failure


Under the Hood


Sockets


Client/Server vs. Peer-to-Peer


Socket Client


Socket Server


The Hypertext Transfer Protocol


HTTP Request Line


Headers


Body


HTTP Response


HTTP Response Codes


HTTP Example


Fetching Pages


urllib Example


Building A Spider


Passing Parameters


Special Characters


Encoding Example


Screen Scraping (And Why Not)


Web Services


Example: Amazon


Summary