DEF CON 10 - Michael Schrenk - Introduction to Writing Spiders and Web Agents
548 views · Published 21 February 2014 · 35:38 · Indexed 30 October 2026
Channel: DEFCONConference · 2014 · Science & Technology
Michael Schrenk - Introduction to Writing Spiders and Web Agents You can have a lot of fun with the Internet by ditching your browser in favor of writing special purpose programs that look for -- or do -- very specific things on the Internet. This session will equip you with techniques to extract and interact with data from web sites without a browser, parse and filter data, follow links, deal with encryption and passwords, and manage terabytes of information. You'll also learn why writing these programs is a useful activity, and walk away with ideas and abilities to write useful spiders or web agents of your own design. Michael Schrenk is a freelance Internet developer, instructor and writer. Much of his consulting business revolves around the creation of spiders, which search the Internet for information of value to his clients. He has also developed web strategies and online applications for Disney, Adidas, Nike and many others.
More from this channel
-
1:25
DEF CON 20 Documentary Bonus Clips - We Make No Money From You
-
1:15
DEF CON 20 Documentary Bonus Clips - Alexis Park Home Improvement
-
7:53
DEF CON 20 Documentary Bonus Clips - CDC muxed
-
3:45
DEF CON 20 Documentary Bonus Clips - Not the Same Anymore
-
2:27
DEF CON 20 Documentary Bonus Clips - Being a Party Host
-
2:09
DEF CON 20 Documentary Bonus Clips - A Top Qualitty Production
-
1:36
DEF CON 20 Documentary Bonus Clips - Creme Brulee
-
2:39
DEF CON 20 Documentary Bonus Clips - Barkode and Bloodkode