Antville Project

/referrers taking too long

I just noticed that the /referrers pages on Antville weblogs take forever to compute, something far beyond 5 seconds. Is there some way we can accelerate this?

The easiest solution (and maybe the best one) would be to kick older records out of the ACCESS table, unless there is a reason to keep them all. Maybe it would also be possible to optimize the ACCESS table some more. Something that is definitely not very good for performance is the

... and REFERRER not like "%" + this.href() + "%" ...

in the SQL query in function weblog.listReferrers_macro()...

comment    

 
kris, April 19, 2002 at 3:31:15 PM CEST

btw

if you think 5 seconds is too long then try manila. attention: this may additionally freeze your browser for a couple of seconds.

link  

 
hns, April 19, 2002 at 3:34:48 PM CEST

actually, my concern is not with the users waiting for the page, but with the server. Serving a page that takes more than a second to compute makes you very vulnerable to various attacks, both intentional and non-intentional.

link  

 
kris, April 19, 2002 at 3:42:44 PM CEST

i know

but try the manila link. it will take more than 5 minutes.

to minimize the load they actually cash the referrer page and only generate a new one if the latest version is older than an hour.

link  


... comment
 
tobi, April 19, 2002 at 5:08:19 PM CEST

sure

i am happy if we could accelerate the referrers page. however, the where clause you quoted might be bad for performance but it's definitely nice for the referrers list not to get referrers from your own weblog.

so, is there a different approach we could do this which is faster or is the only way dropping the "like" check?

kicking out older records is what i thought of from the beginning because it was clear that the table would get enormously big very quickly.

should i do this with a scheduler function?

link  

 
robert, April 22, 2002 at 2:36:11 PM CEST

maybe we should change logAccess() so that referrers from your own weblog aren't logged, then we could get rid of the "not like"-clause. and second: we could extend the auto-cleanup so that everything older than e.g. one week is deleted (the size of the access-table is getting problematic already, also because of the size of the indexes ...)

link  

 
tobi, April 22, 2002 at 2:44:12 PM CEST

doesn't the check for referrers from the same weblog at request time imply even more performance troubles?

if not, i am totally +1.

and +1 for auto-cleanup, too (i think this is the scheduler behind it, anyway)

link  

 
kris, April 22, 2002 at 2:51:19 PM CEST

if you delete all old entries when someone accesses the referrer page it will remain nice and small. well, given the user checks the referrers on regular basis.

link  


... comment


The Antville Server Fund has been a great success. Thanks to everybody who contributed!
online for 8550 Days
last updated: 1/4/11, 10:22 AM
status
Youre not logged in ... Login
menu
November 2024
SunMonTueWedThuFriSat
12
3456789
10111213141516
17181920212223
24252627282930
July
recent
zfuture's house here is zfuture's
house
by zfuture (7/31/03, 2:59 AM)
i understand your concerns however,
i hardly can think of a solution. certainly, if the...
by tobi (7/29/03, 9:47 AM)
Found several more similar sites
listed This is getting to be quite a concern to...
by cobalt123 (7/27/03, 7:56 PM)
Second Post Alert on Referrer
bug livecatz I put this into "help" and now here:...
by cobalt123 (7/26/03, 7:14 PM)
well it's not easy to
find from here, anyway. think we should include a link,...
by tobi (7/24/03, 11:25 AM)
So finally I found
the helma Bugzilla - stupid me.
by mdornseif (7/24/03, 10:28 AM)
clock not that it's particularly
earthshattering but the antclock is running slow by about 15...
by kohlehydrat (7/23/03, 8:25 PM)
but blogosphere.us isn't can't really
be rated as spam can it?
by kohlehydrat (7/23/03, 8:08 PM)
More referrer spam www.webfrost.com
by Irene (7/23/03, 7:55 PM)
How to log skin names
I accessed to console?? Hi, I would like to know...
by winson (7/23/03, 4:12 PM)

Click here to get an XML version of this weblog.

Made with Antville
powered by
Helma Object Publisher