[max]

hi,
Just noticed that Yahoo Site Explorer implemented a new feature that helps to crawl your site better - Dynamic URLs. You can specify up to 3 url parameters per domain and opt an action for each one:
- remove parameter (for example session id)
- set a default value (this option helps when you want yahoo bot to crawl some section of your site that require user-linked parameter).
Nice addition to sitemaps and robots.txt.

[xwild]

Well there is an implementation now in place also for trade script to search and review the sites before the hits go to those sites. if the sites changes and or becomes bad site for example the trade scripts would stop the hit from going to that site... now that would be excellent and stop cheaters<<< something to dream about!...

Also! Max excellent Post! thank you!

Ho in the news Iphone cut 200 bucks of the phone!!!! Haaaa!

Allot of Lapdance Money!..

[max]

well, depending on what changes trade script bot need to detect. Toplist and thumbs are alterable by their nature. Dynamic ads are also being rotated. The only constant thing is trade/submit links, category/niche menu and a few other things that are actually options. Basically you get whole page dynamic code that is certainly changing (unless you mean a template, that could be time-delay changeable in some cheaters schemes, but it is not a popular implementation).
Tracking links on each page update could be useful, but it is a complex task for network owners that have thousands of traders to be tracked. Besides, how deep you should track each of your trade? If your trader does not link to illegal sites, no guarantees their traders don't. So multiply a sites amount on 100... we already got hundreds of thousands... and this is only two levels. Add here a strong trojan/virus detection system, without which your crawler is just a unnecessary bot, blacklists checker, popup detector, need of reviews on daily basis and you will get Google bot
Even after you'll create second Google/Yahoo bot for your trade script, you'll need to review sites manually though, because nobody (as i know) has invented thumbs analyzer for illegal content, that is so often become a barrier for the trade.

[xwild]

BINGO!!!
MAX YOU KNOW WHAT I MEAN!..

(unless you mean a template, that could be time-delay changeable in some cheaters schemes, but it is not a popular implementation).

I had to read this and have tears fall from my eyes!..

You know is done all the time and no one admits to it in order to frudulent grow their traffic! Shame! SHAME!..

I fill specially bad for the traffic companies that get cheated out to traffic by some/allot of sites that do this..


NOW is just a matter of time for the trade scripts implementation of decoding upcoming urls / = i belive it would be verry beneficial specially for traffic sellers to see this come to life and soon!..

HEY MAX! THANK YOU!

Your AMIGO XWILD!...

[max]