A A

Archive | Scraping

Scraping Google Trends with Mechanize and Hpricot

Saturday, January 24, 2009

3 Comments

This is a small Ruby script that fetches the 100 trends of the day for a specific date. If multiple dates are searched, one can find out how many times a keyword occurred between two dates, or just find out what keywords are constantly appearing on the top 100 list. Very profitable info! but alas, [...]

AnimeCrazy Scraper Example Using Hpricot & Mechanize

Sunday, January 11, 2009

2 Comments

This is a little (as of now incomplete) scraper I wrote to grab all the anime video code off of AnimeCrazy (dot) net. This site doesn’t host any videos on its own server, but just embeds ones that have been uploaded to other sites (Megavideo, YouTube, Vimeo, etc). I don’t know who the original uploaders [...]

How to POST Form Data Using Ruby

Thursday, April 24, 2008

1 Comment

POSTing data on web forms is essential for writing tools and services that interact with resources already available on the web. You can grab information from your Gmail account, add a new thread to a forum from your own app, etc. The following is a brief example on how this can be done in Ruby [...]