AnandTech: A Brief History of Time
by Jason Clark on July 26, 2004 6:52 PM EST- Posted in
- IT Computing
AnandTech 4.0
This release of the site was a fairly major upgrade in terms of back-end code. We decided to do a rewrite on the site code, which we have been using since version 2.0. ColdFusion MX had been released, and AnandTech was used as a high load test site during the beta of ColdFusion MX. Needless to say, we beat on it and found a few issues here and there that were fixed prior to MX's release. One of the significant changes in the ColdFusion language was the ability to form code components into a web-based API, which really helped us organize the code into more reusable sections.Reporting of web statistics was starting to cause us some grief in this release due to the amount of clustered servers and log file size. We obtained a quote from WebTrends for their software, but it was going to cost around $15,000 for our server farm. We felt that analyzing log files was archaic, and we decided to make our own statistics tracking system. Development of the web statistics system took a couple of weeks, and is the same system that we use to date.
Just as our traffic was increasing, so was the size of our editoral staff, and the amount of content being published. Anand and the other editors asked for an easier way to create their graphs; basically, a central system to manage the data that goes in the graphs and to be able to re-generate them without having to upload images. So, we did some research and found a fantastic piece of software called SwiffChart from GlobFX, a company in France. This graphing engine allowed us to construct our graphs programmatically from our content management system. SwiffChart gave us a number of file formats in which to save the generated graphs. We had originally used Flash because of its file size when compressed (smaller than any other conventional format). We recently switched to PNG format, the next smallest format due to the number of readers who can't have the plugin or want it for that matter. To date, we still use this graphing system, although it has been enhanced over the past year with various features to make it even easier for our editorial staff to use.
During this release, we had a few issues with the Windows version of Apache, which we used because of mod_gzip (HTTP Compression) module. Apache wasn't threading properly on Windows at that time (prior to version 2 of Apache). We decided to switch to IIS, and a HTTP compression module called PipeBoost, which we still use now. The next upgrade was the largest in the history of the site.
Hardware used in version 4.0
5 x Dual AMD Athlon MP 1900+ w/ 512MB Memory
View version 4.0 of the website
67 Comments
View All Comments
STaSh - Monday, July 26, 2004 - link
Keep up the great work guys. The site is very fast, and I really enjoy these behind the scenes articles.JasonClark - Monday, July 26, 2004 - link
Thanks for the comments thus far, some answers:Jeff7181:
1) Very true regarding what you can buy for a reasonable sum of money these days. We have been running the same hardware for over 2 years now, and I don't see any changes any time soon. The Dual Athlon MP's are holding up just fine, especially with the headroom we have from the performance jump the .NET migration gave. I'd say hardware has gone ahead of load, you need less to do more for less money, if that makes sense :)
2) We are all IDE in the webservers, no need for scsi as everything is in memory after initial compilation. The DB server has only changed in space, as the databases are growing, especially the statistics database..
Jeff7181 - Monday, July 26, 2004 - link
Excellent article... I've always wondered what kind of server AnandTech was hosted on. Very interesting. I do have a couple questions though that were answered though.#1 Besides bandwidth of course, has the cost of the hardware stayed pretty much the same? I mean, $15,000 today buys A LOT more power than it did 2 years ago simply because more power is available now. With loads considered (more users now than when the site first started) is the cost pretty much the same to get hardware capable of handling the load? In other words, has the cost of the hardware grown more in line with load, or technology?
#2 How has your disk storage needs changed, what drives were used in your first server and what ones are used now?
Locutus4657 - Monday, July 26, 2004 - link
Cool, .Net is deffonetly a great platform to develope in... I've been trying to convince my boss that if we switched away from PHP/MySQL and went to .Net/Posgres (or MSSQL) all of our problems would be solved!Carlo
tfranzese - Monday, July 26, 2004 - link
Not a bad job. I can relate to .NET as I recently had to jump into it for a client at work for a web application they speced out. It definately is a different animal compared to ASP.GokieKS - Monday, July 26, 2004 - link
Been reading the site since the version 2.0 days, and this certainly brings back some memories and gives some interesting insights. Good job. =)~KS
darkswordsman17 - Monday, July 26, 2004 - link
Cool article. I'm a relatively new member and found this to be fairly interesting.Also, keep up the great work!