Articles
Software
Gallery
Other works
Contacts

#Rules for writing scrappers.html



                -always browse the site first:
                    >check for errors
                    >check for response code standard compliance
                -try curl:
                    >see how badly its js-poozed
                    >see what tags were auto corrected by your browser
                    >check for protocol errors
                -consider using browser js:
                    >as in, either type away in the console or create a user script,
                      depending on the situation
                    >many times its the easiest and fastest way to extract data
                    >good idea when doing a one time thing
                -consider using wget:
                    >many dont know how versatile it is
                    >it could be easier and faster to extract information from a local copy
                -use local copies for testing:
                    >can safe lots of time
                    >can spare you from bans
                    >can spare you from network errors
                -check for gray-APIs:
                    >suspect it with fancy interfaces
                    >sniffing the requests might be the easiest path to take