67 Comments
- inspecality, on 10/12/2007, -10/+99And 160 billion gigs of porn. lol
- nixonrichard, on 10/12/2007, -9/+72This is a real problem . . . there's nothing more tragic than having to go through your porn collection to decide which ones you can delete to free up space. I had an easier time deciding which college to go to than which pornos to erase.
- glasgowm, on 10/12/2007, -1/+26gigabytes are so 2001.
161bil. GB = 160mil. TB. = 160,000 PB (Petabyte) = 160 EB (exabyte) - dimension128, on 10/12/2007, -3/+28""Fortunately, storage space is not actually scarce and continues to get cheaper. That's because not everything gets warehoused. Not only do e-mails get deleted, but some digital signals are not made to linger, like the contents of phone calls. (Although, who's to say those conversations don't get cataloged someplace, perhaps the National Security Agency?)""
On top of that, the method they describe for collecting these statistics seem somewhat questionable.
In other words, there is sufficient space. - raynar, on 10/12/2007, -4/+28"I had an easier time deciding which college to go to than which pornos to erase."
What is this erasure of porno yous speak of? - Lord_oftheTrons, on 10/12/2007, -0/+24One of my favorite quotes by Carl Sagan:
"All of the books in the world contain no more information than is broadcast as video in a single large American city in a single year. Not all bits have equal value." - JimSartor, on 10/12/2007, -1/+15Why do we need to archive everything? I mean I have every nintendo game archived on my machine just for prosterities sake (though I don't think I have ever played any of them, except maybe Metroid). Do we really need to have QuantumLink archived so that hundreds of years from now kids can sit around and play internet chess with each other and laugh about how this was the original internet and that our grandparents thought it was cool and ran up hundred dollar internet bills chatting late at night to god knows who while in 2nd grade and how they got beat by their parents when the bill arrived every month until their parents decided to get rid of the 400 baud modem and then the kid went out and bought a 1200 baud modem, opened his own BBS, started cracking software and hosting pirated software on a 1MB harddrive and began his life of internet crime because it was cheaper than Compuserve or QuantumLink?
Do we really need that?! - Scrappy1850, on 10/12/2007, -1/+13my mom's mind is still running on meth
- ahill7, on 10/12/2007, -0/+9I recall an article a while back in PopSci or Wired that noted something along the lines that eventually 1/3 of our data will be purely index information used to search and find the rest of the data. If we have billions and billions of gigs of data, there needs to be a large index of said data (generated and stored) to be able to access it.
- unruled, on 10/12/2007, -2/+11Im proud to say that I contributed a good 48TB this year :)
- Zippo, on 10/12/2007, -2/+10True, but there are plenty of people with a mind-frame stuck in 2001. Hell, I'd say my mom's mind is still running on megabytes.
- fluidfoundation, on 10/12/2007, -1/+9And how much was deleted? That'd be nice to know.
- TheTap, on 10/12/2007, -0/+6Are we including all of the data on hidden TrueCrypt drives?
... I didn't think so! - Anrkist, on 10/12/2007, -6/+11When Bob the Wired intern ran out of space on his computer they decided to create a story.
- Scrappy1850, on 10/12/2007, -0/+5@jim "just for prosterities"
dude, i am just imagining what your NES ROM collection smells like - TheGeneral, on 10/12/2007, -1/+6Videos of you whacking off don't count as porn...
- nicepants, on 10/12/2007, -3/+8All your data are belong to us.
- duddles, on 10/12/2007, -2/+6enormous amounts of material, enormous amount of material...
He was right! - dan0964, on 10/12/2007, -0/+4Well, if 160 Billion gigs of it is porn... then not alot !
- inactive, on 10/12/2007, -2/+6and none of it is backed up properly.
- lejohn, on 10/12/2007, -1/+5I am not worry about how much data we can generate, but how can we preserve (or save) the data currently being generated. The problem with digital information, especially websites, is the huge turnover rate and cannot be archived properly (e.g. flash content, video,etc.) I do not think the Internet Archive helps much though...
- ChumpChief, on 10/12/2007, -1/+4I imagined billions of iPods swooping through the air in a massive Independence Day-esque invasion...
- dimplemonkey, on 10/12/2007, -0/+3Hmm.. that reminds me... I need to go kill a few hundred of those stupid .dmp and tmp files.
- covertbadger, on 10/12/2007, -0/+3Your math sucks. 161 billion gigs == 157,000,000TB, not 166TB.
edit: hah, nice ninja update - justinjohnson, on 10/12/2007, -0/+3If Indexes make searching large amounts of data faster, what happens when your index becomes so large that it itself needs an index?
- ThirdPrize, on 10/12/2007, -0/+3And most of it is in the Google cache somewhere.
- jayhawk88, on 10/12/2007, -3/+6"In other words, there is sufficient space."
Exactly, this whole premise of "We're running out of space!!!" is a load of crap. It's not like there is some data generating monster out there that is ever increasing it's output, and we're in danger of losing some of the data if we can't keep up.
There is no data without storage. Right now, me writing this, it is being stored in my RAM, and possibly even a cache file on my HD. It's true that not all storage is permanent but when you get right down to the 1's and 0's of it, it's impossible to generate any kind of digital data without storing it someplace, somewhere. It's physically impossible for the world as a whole to ever generate more data than it can store. - maeon3, on 10/12/2007, -0/+3The data zipping around is not all unique, I'll bet most of it is copies of copies of copies.
- Coffeedemon, on 10/12/2007, -2/+4Even if there is sufficient space and even if its cheap ... is anyone making any considerations for actually managing this information so we can use it in the future?
- DeFex, on 10/12/2007, -1/+3and more importantly the government needs to index where it came from so they can snoop properly.
- AJH16, on 10/12/2007, -1/+3agree with dimension. Very questionable methods to get to an attention grabbing headline. They are counting caching and assuming every file they guess is replicated 3 times. That seems awfully high, especially since a lot of those replications probably get measured a second or third time, not to mention storing the replications would be completely unneccessary. In other words, it is at most 50 or so exabytes, which isn't a whole lot more than the 2003 number. Nothing to see here, move along.
- CalipsoII, on 10/12/2007, -7/+9Did anyone read this line: "You'd need more than 2 billion of the most capacious iPods on the market to get 161 exabytes." and immediately picture some huge iPod RAID array humming away somewhere?
Or maybe it's just me, I dunno.
//slashies! - se7en11, on 10/12/2007, -0/+2153,541.565 PB (Google is your friend - http://www.google.com/search?source=ig&hl=en&q=161+billion+GB+to+PB&btnG=Google+Search )
- weister42, on 10/12/2007, -0/+2You'll need 322,000,000 five-hundred gig hard drives to store that, and with the current one being $129, you can buy all that storage space for only $41,538,000,000 or about $41.6 billion dollars. It's doable.
- BxBoy, on 10/12/2007, -0/+2I'd like access to this private DUMP site please! :p
- EvolvedAnt, on 10/12/2007, -0/+2Not all data generated even REQUIRES to be stored. Does steaming content need to be stored on every machine that reads the stream? Most of the data generated today is duplicates and highly compressible. Nothing to worry about, go back to your daily lives.
- GRat, on 10/12/2007, -0/+1Here's a link to the more detailed white paper and executive summary:
http://www.emc.com/about/destination/digital_universe/ - sssok, on 10/12/2007, -0/+1@nixonrichard,
I 100% agree, it really is challenging. - BrendanGall, on 10/12/2007, -1/+2That is quite a bit.
- Feyr, on 10/12/2007, -1/+2 .
- vastrightwing, on 10/12/2007, -0/+1The answer is in buying and selling of data credits. After all, the US must produce thousands of times more of the world's data than even the 2nd largest consumer. That makes us the worst offenders and to be fair we should trade data credits from other countries who don't use as much data as we do.
- Anonymous3, on 10/12/2007, -0/+0About deletion of porn...
Think about it this way: if you downloaded it from somewhere, it is duplicated at least there, so you ought to be able to find/download it again. helps me to sleep at night when I wipe 50+GB sometimes just because I feel like it - subarusqueege, on 10/12/2007, -1/+1OK, Now I know why BBC threw out that building 7 tape............hhhhhhmmm
- inactive, on 10/12/2007, -2/+1Don't link to Wired, they spread FUD about Digg!
- mortigon, on 10/12/2007, -3/+2It's kinda funny, cuz both of you are the same person...
- Bonzodog, on 10/12/2007, -2/+1So how many PB (PetaBytes) is this?
- Nougat, on 10/12/2007, -3/+1That's not out of the question. Apple techs blow images onto Apple servers with iPods.
- Djchicken, on 10/12/2007, -2/+0I bet it's Ted Stevens fault, he downloaded the entire internet and now HE'S clogging the tubes! O__o
- LakeshoreBaby, on 10/12/2007, -5/+2This is google and microsoft's fault. Saving all our personal info and shi*. Either that or it's a fear tactic to raise hard drive prices (the new oil). : (
- nonsecu, on 10/12/2007, -6/+3... speak for yourself ... I spent a month reviewing exavault, strongspace and the rest (well, at least the open, useful ones that let you connect with plain old rsync and SSH - xdrive GUI crap doesn't count) and decided on a 10 GB rsync.net account. My important (read: not movie clips and saved crap) data is now backed up to two locations - San Diego and Zurich and I do it automatically each night with an rsync line in my crontab...
Now I don't care what happens to my local system or data - I have an offsite backup (in two locations) that I can access with standard tools (my new favorite being duplicity and its cousin rdiff-backup...) -
Show 51 - 65 of 65 discussions



What is Digg?
Digg is coming to a city (and computer) near you! Check out all the details on our