52 Comments
- ElBeh, on 07/07/2008, -6/+53I'm surprised that Digg can survive the Digg effect.
- grabulsa, on 07/07/2008, -1/+36Where's the beef? Nice fluff piece but I'd like to see some more real details.
- 4sak3n0ne, on 07/07/2008, -3/+26That article was lackluster at best... Ok, they use LAMP and MogileFS. What extensions do they use (memcached, APC, PDO)? What hardware do their servers run? Server OS (Debian, but they didn't even mention that). The questions continue... You cant just say "I love LAMP" and be done with it!
- billstickers, on 07/07/2008, -4/+23Rad story.
- brainnovate, on 07/25/2008, -4/+18Everyone that writes code could benefit from reading this article. Holy crap!
- mudpuddle, on 07/08/2008, -1/+13Yeah, I was expecting a 78 page pdf with full schematics, UML diagrams, and lists of every package installed on their servers. What a let down.
- cdcr28, on 07/08/2008, -0/+11"They site is based on a LAMP stack"
That is so much worse then the "their vs. they're" grammatical mistake - SlapAyoda, on 07/07/2008, -0/+8Dugg. Would enjoy seeing more articles on how other large volume sites scale their backends, preferably in more detail.
- jellygraph, on 07/08/2008, -0/+8He's talking about what software they use to handle the load, not how they programmed Digg and what algorithms they use etc.
- brainnovate, on 07/25/2008, -0/+7true that! Better stuff at highscalability.com usually.
- Phatfiddler, on 07/08/2008, -0/+7Don't you mean "than"
- PhrosTT, on 07/08/2008, -0/+7if you want to know more the webcast by digg's lead architect was a bit more revealing...
http://deepfriedbytes.com/podcast/deep-fried-bytes ... - inactive, on 07/07/2008, -6/+12Just add more tubes right?
- mattcampbell, on 07/08/2008, -0/+6Much better: http://highscalability.com/digg-architecture
- ajb2015, on 07/08/2008, -0/+6I can imagine people use digg more intensely than other sites. I'm on it for hours a day, checking for new stories, checking comments, etc. It isn't like the nytimes where you might read an article or two and then move on.
- dabura, on 07/07/2008, -1/+4Just removes Godaddy's ads and we're fine.
- brainnovate, on 07/25/2008, -0/+3Myself? Since 1995. But I agree with you... the article is thin. I am still amazed by how little most "web developers (php especially)" know about building a system that scales at all.
- thailand1972, on 07/08/2008, -0/+36 months is a bit harsh - I don't think your average web developer needs to know how to organize a server farm with sharding within the first 6 months of his/her working life. Hosting is a real Pandora's box - there's always more to learn.
However, I totally agree with the sentiment though that ALL web developers need to understand at the very least the basics of hosting:-
- the impact your scripts have on CPU and memory usage (Knowing the impact your scripts have on the server makes you quickly learn about how to cache and generally be kinder to the server)
- security
- backup procedures
- generally managing all the resources of a dedicated server so it can handle traffic spikes
There are a LOT of developers out there whose only connection with hosting is when they FTP their scripts to their shared server. - sfrench, on 07/08/2008, -0/+3This story that was on the FP a few weeks ago was pretty good. It's a long listen... but it's good.
http://digg.com/programming/Deep_Fried_Bytes_4_Sca ... - PhrosTT, on 07/08/2008, -0/+3massively sharded!
- fLUx1337, on 07/08/2008, -3/+5While i kinda agree, if you've been doing web development for more than 6 months you should already know everything in the article, if you don't you need to start learning. Lets say somebody built the next Digg, and puts it on shared hosting. It soon dies because its got too many visitors - moved to a dedicated server - and it dies again....if you don't know how to go any further [quick] you will soon find your users start dropping off, and you end up missing the opportunity because you weren't prepared.
I've seen it several times in the past and its a shame... - inactive, on 07/07/2008, -0/+2Does anyone have a set of links to other Digg stories. I've looked for stories using Google and the number of references is huge. Mashables has a lot of them but many are more than a couple of years old. I've already seen the story: How Digg.com uses the LAMP
- inactive, on 07/08/2008, -1/+3Was an interesting article although it felt like an introduction to an article but not an actual article. Cool though.
- inactive, on 07/07/2008, -0/+2Thanks.
- DutchGuilder, on 07/08/2008, -3/+5Or read about a guy who thinks Digg should fire their tech staff for doing such a lousy job of scaling:
http://plentyoffish.wordpress.com/2006/10/08/digg- ...
http://plentyoffish.wordpress.com/2006/06/10/micro ... - jimb0, on 07/08/2008, -0/+2I thought this was funny.
- iofthestorm, on 07/08/2008, -0/+2With bloated AJAX comments, obviously.
- jdpalite, on 07/08/2008, -0/+2I don't listen to guys (the guy who wrote the article) who say "if you don't know what your doing"...
- SteelChicken, on 07/08/2008, -0/+2"those thumbnails are a bigger challenge than you might expect."
well given that most are totally irrelevant to the article they are attached too, im not sure why you bother. - favour2008, on 07/08/2008, -0/+2Digg has sure come a long way keep it up
- dabura, on 07/08/2008, -0/+1You need the Buff Squirrel that Peter got for Chris on Christmas
*Chris: He's been running like that for 3 weeks; can i touch him , dad?
*Peter: No, just leave him* - dabura, on 07/08/2008, -0/+1Dam lucky bastard..i work my ass off while you digging!
- jellygraph, on 07/08/2008, -1/+2Agreed. I was expecting something fairly technical. Was hoping to compare notes with how we architected ours at my company.
- rocketship47, on 07/30/2008, -0/+1haha, listen to this interview: http://deepfriedbytes.com/podcast/deep-fried-bytes ...
Short takeaway, at the very least you haven't considered all the Digg This buttons around the internet. At the time of that interview Digg was handling ~2 billion hits a month, that works out to nearly 1,000 per second.
Good luck with ASP, i heard a lot of fun sites are using .net - jameslhwalker, on 07/08/2008, -0/+1Mathematical!! That was TOTALLY math! Rhombus!
- blogthedigg, on 07/08/2008, -0/+026 million unique visitors a month??? Geez!
- inactive, on 07/08/2008, -0/+0Circular
- dannywhite, on 12/02/2008, -0/+0doing well...
http://www.dwhitewebdesign.com
http://www.2let2sell2buy.com
http://www.whomain.com - ospsp, on 07/15/2008, -0/+0Wow a grammar freak complaining about grammar AND using it improperly at the same time. That is rich :D
- ronmat, on 08/07/2008, -0/+0Manage your own bizz with great software! Can you dig it what could happen to your self! If you startacting like and doing like millionares!
Here is an article for those who want to know what sucsess depent on.
When youre well known everthing is possiple! Like you see on big stars! create,.................................................
to get you well known--> http://www.FreeViral.com/?r=220048 - alewin77, on 12/17/2008, -0/+0This shows the power of Digg.
http://www.targetedvisitorsdaily.com/ - EditerDave, on 07/09/2008, -0/+0Here's another article from Systems Management News.. this one's on how Sony keeps its gaming system up and running 24X7..
http://www.sysmannews.com/content/article.aspx?Art ... - binorgog, on 08/07/2008, -6/+5Defrag
- dvs1313, on 07/08/2008, -1/+0it really isn't that surprising, digg doesn't use alot of bandwidth in it self, the digg effect only exist because your articles are all hot linked from different sites, using those sites resources..not diggs. Sure they have to load some scripts/html/php and a few images here and there but the grand scheme of things it really isnt that much of a challenge, there is also something called load balancing where the server load is split across multiple servers with multiple connections..in reality digg isnt that much of a resource hog on it self.
- inactive, on 07/08/2008, -1/+0DIGGER ALERT!!
- inactive, on 07/08/2008, -2/+0I have a snorg tees ad with "I [heart] [lamp]" on the girls t-shirt thanks to your comment.
-
Show 51 - 53 of 53 discussions



What is Digg?
Check out the new & improved