What is the Sites connection speed?
. The bottleneck is the database. Cthree worked wonders last night and got replication setup, now all we have to do is tune the damn thing.
Administrator
Joined: Jan 2002
Posts: 15,835
Likes: 1
From: Vegas Baby, Vegas
Originally Posted by Jonesy,Aug 29 2004, 01:01 PM
Hey, what is the connection to the site right now? And is that the bottleneck when lots of people get on?
Administrator
Joined: Oct 2000
Posts: 20,274
Likes: 4
From: Toronto, Canada
100Mbps
Edit: There is no one specific bottleneck, the problems of dealing with a site to big yet so small are more complex than that. A forum based site with 1000 members, 100-200 thousand posts and 50-80 users online would be considered average. This accounts for probably 90% of all the forums out there. The problems occur when you scale that up 10x. Tons of little things on a normal site that you wouldn't even notice become magnified many times over. There are probably a list of 100 complications we've had to deal with that a normal site would never have to deal with.
The software that runs the site is designed for the median which is to say we fall on the bleeding leading edge. s2ki is the largest site using the software we use and that means we get to find and deal with all of the issues related to scale. There are other sites of a larger size, say hondatech, which don't have as many issues of scale chiefly because their software tends to be much more simple. We started with a feature rich system and continue as best we can manage it remain feature rich. Everything comes at a cost. Compare the amount of detail sites running zeroforums to ours and then consider that all those rich features come at the price of database accesses and CPU power.
Managing the growth of the system is a big job and a big pain in the arse but it keeps us busy and you guys complaining. It will never end until s2ki.com stops growing and I don't expect that to happen anytime soon.
Edit: There is no one specific bottleneck, the problems of dealing with a site to big yet so small are more complex than that. A forum based site with 1000 members, 100-200 thousand posts and 50-80 users online would be considered average. This accounts for probably 90% of all the forums out there. The problems occur when you scale that up 10x. Tons of little things on a normal site that you wouldn't even notice become magnified many times over. There are probably a list of 100 complications we've had to deal with that a normal site would never have to deal with.
The software that runs the site is designed for the median which is to say we fall on the bleeding leading edge. s2ki is the largest site using the software we use and that means we get to find and deal with all of the issues related to scale. There are other sites of a larger size, say hondatech, which don't have as many issues of scale chiefly because their software tends to be much more simple. We started with a feature rich system and continue as best we can manage it remain feature rich. Everything comes at a cost. Compare the amount of detail sites running zeroforums to ours and then consider that all those rich features come at the price of database accesses and CPU power.
Managing the growth of the system is a big job and a big pain in the arse but it keeps us busy and you guys complaining. It will never end until s2ki.com stops growing and I don't expect that to happen anytime soon.
Joined: Mar 2003
Posts: 4,021
Likes: 1
From: San Francisco
Originally Posted by cthree,Aug 29 2004, 01:11 PM
100Mbps
Edit: There is no one specific bottleneck, the problems of dealing with a site to big yet so small are more complex than that. A forum based site with 1000 members, 100-200 thousand posts and 50-80 users online would be considered average. This accounts for probably 90% of all the forums out there. The problems occur when you scale that up 10x. Tons of little things on a normal site that you wouldn't even notice become magnified many times over. There are probably a list of 100 complications we've had to deal with that a normal site would never have to deal with.
The software that runs the site is designed for the median which is to say we fall on the bleeding leading edge. s2ki is the largest site using the software we use and that means we get to find and deal with all of the issues related to scale. There are other sites of a larger size, say hondatech, which don't have as many issues of scale chiefly because their software tends to be much more simple. We started with a feature rich system and continue as best we can manage it remain feature rich. Everything comes at a cost. Compare the amount of detail sites running zeroforums to ours and then consider that all those rich features come at the price of database accesses and CPU power.
Managing the growth of the system is a big job and a big pain in the arse but it keeps us busy and you guys complaining. It will never end until s2ki.com stops growing and I don't expect that to happen anytime soon.
Edit: There is no one specific bottleneck, the problems of dealing with a site to big yet so small are more complex than that. A forum based site with 1000 members, 100-200 thousand posts and 50-80 users online would be considered average. This accounts for probably 90% of all the forums out there. The problems occur when you scale that up 10x. Tons of little things on a normal site that you wouldn't even notice become magnified many times over. There are probably a list of 100 complications we've had to deal with that a normal site would never have to deal with.
The software that runs the site is designed for the median which is to say we fall on the bleeding leading edge. s2ki is the largest site using the software we use and that means we get to find and deal with all of the issues related to scale. There are other sites of a larger size, say hondatech, which don't have as many issues of scale chiefly because their software tends to be much more simple. We started with a feature rich system and continue as best we can manage it remain feature rich. Everything comes at a cost. Compare the amount of detail sites running zeroforums to ours and then consider that all those rich features come at the price of database accesses and CPU power.
Managing the growth of the system is a big job and a big pain in the arse but it keeps us busy and you guys complaining. It will never end until s2ki.com stops growing and I don't expect that to happen anytime soon.
Thread
Thread Starter
Forum
Replies
Last Post