Page 1 of 1

bandwidth usage

Posted: Tue Oct 31, 2006 6:21 pm
by Howie
This month we transferred more than 4gb's of data from the website, hence why we were hit with a bandwidth exceeded message on the website. I've upgraded accounts, so hopefully we won't be seeing that for a while.

But just as a side note, we also recorded our highest number of hits this month of October 2006. And now australia represents 46% of our hits, the usa however represents about 50% of our traffic, this is the first time our overseas hits has exceeded our local hits.

Posted: Tue Oct 31, 2006 11:15 pm
by AtD
How odd. They're not robots, are they?

Posted: Wed Nov 01, 2006 7:55 am
by Howie
Could be.

But the bots are only trawling through the front page and a few links off that ...
http://www.sensational-adelaide.com/robots.txt

I learnt my lesson last time with bots LOL

Posted: Wed Nov 01, 2006 9:32 am
by Edgar
I only saw the bandwidth limit page last week for one day, and that's it. Any other day, they are fine and good.

Posted: Wed Nov 01, 2006 9:34 am
by Howie
It started happening towards the end of the month.. our quota resets at the start of every month, so we chewed up about 4 weeks worth of bandwidth in 3 weeks. I bumped it up once by a gigabyte, and about 4 days later that was chewed out too, so i bumped it up by another gig. That hopefully should do it.

Posted: Wed Nov 01, 2006 1:26 pm
by Edgar
so the robots are the culprit?

Posted: Wed Nov 01, 2006 1:57 pm
by Howie
robot activity seems pretty much the same as normal, most of the traffic comes from genuine visitors.

Posted: Wed Nov 01, 2006 5:07 pm
by Will
What do you mean by robots?

Posted: Wed Nov 01, 2006 6:28 pm
by Howie
Hey Will, robots are computer controlled programs which trawl through the internet indexing and sometimes performing pre-defined actions.

Googlebot is an infamous one, the googlebot finds your site and then catalogs and indexes your webpages for inclusion into its search engine. There are other bots out there, like yahoobot .. and then you have malicious bots which insert spam onto your forums and comments pages etc.

Sometimes bots go crazy through your site chewing up all your allocated bandwidth for a month. On one of our sites, nissanexa.com, a googlebot went crazy and screwed up our forums (so our forums started reporting 1000+ users online today).

Posted: Wed Nov 01, 2006 7:22 pm
by Will
Howie wrote:Hey Will, robots are computer controlled programs which trawl through the internet indexing and sometimes performing pre-defined actions.

Googlebot is an infamous one, the googlebot finds your site and then catalogs and indexes your webpages for inclusion into its search engine. There are other bots out there, like yahoobot .. and then you have malicious bots which insert spam onto your forums and comments pages etc.

Sometimes bots go crazy through your site chewing up all your allocated bandwidth for a month. On one of our sites, nissanexa.com, a googlebot went crazy and screwed up our forums (so our forums started reporting 1000+ users online today).
Thanks for the explanation Howie! 8)

Posted: Wed Nov 01, 2006 11:01 pm
by Edgar
So, some foreigners do search for Adelaide eventually? :D