#Rules for writing scrappers.html
-always browse the site first:
>check for errors
>check for response code standard compliance
-try curl:
>see how badly its js-poozed
>see what tags were auto corrected by your browser
>check for protocol errors
-consider using browser js:
>as in, either type away in the console or create a user script,
depending on the situation
>many times its the easiest and fastest way to extract data
>good idea when doing a one time thing
-consider using wget:
>many dont know how versatile it is
>it could be easier and faster to extract information from a local copy
-use local copies for testing:
>can safe lots of time
>can spare you from bans
>can spare you from network errors
-check for gray-APIs:
>suspect it with fancy interfaces
>sniffing the requests might be the easiest path to take