The quest for mankinds roots has always forced us to turn to literature in order to understand it more clearly. The works of the classic authors are enshrined today in numerous forms, be it divinely inspired like the bible, or insightful works such as the dialogues of Plato. The modern world has produced a cacophony of documents in the form of the internet, widely circulated and available to all. This is an excellent development for the human race, as it allows for the free pooling and dissemination of information. As the internet develops and grows, it will certainly become the future communication system for mankind, as is evident to all.
However, the fact is, there is a dark internet -a place where search engines do not go. Some of these sites date back to the very first times, whereas others are too obscure. There are archived sections of formerly popular web sites that failed to keep up with the times, and these too have a valid voice with which to address our generation – if you can find them. The problem with the dark net is that it is by nature difficult to surf. The “Dark” part of its name comes from the fact that you don’t have the searchlight of an engine to work with, all you have is rumour or memory.
The good news is that the information is being preserved. The bad news is that the information is not being looked at or researched. This means that it is, for all intents and purposes, lost to the general public. A person looking for an obscure fact might spend months poring through search engine results without success, remembering it from an old E-magazine, or angelfire site that has long since passed into the night. This is the problem with the dark net, it is literally like searching a city sized library with a dollar store flashlight, and hoping to find the one book you want.
Since search engines have become the default tool for people to explore the internet, anything not on the first few pages, or lacking a powerful image to draw people in will be lost in the thousands of other hits that inevitably come back with each search. Search engines skim over the dark net, just like birds on the surface of the ocean swim past fish and plants in the murky depths. What lies below does not even affect the world of the surface net, and without a search tool, people will not bother with it.
The problem is, just because the knowledge is dark, or lost, does not mean it is worthless. Humanity has gone through this before, the dark ages, when although society was developing, and there was a lively oral tradition, little was written down that survives, so generations of culture were lost. In effect, what we have here is the internet dark age, except for the fact that it does survive, and is possible to retrieve without searching through dusty archives, or stumbling across a lucky find in a church. All that is necessary is a portal to begin searching into the unknown.
In the future, hopefully some genius will figure out how to access the dark web, and bring its contents to light. Because since its inception, there have been so many emails, so many web sites, so much information shared, a single person could not catalogue it in a lifetime. Information is previous. Think of all the books that were lost in the burning of the library of Alexandria, the only possible correlation to the loss of the dark net for most people. The difference is, we did not burn the materials, we paved over them, and our search engines simply are unaware of their existence.
Internet archaeology will be relevant for different reasons than regular archaeology. Regular archaeology is the study of the past, the evolution of the animal kingdom, and structures on the earth. Internet archaeology will involve the disciplines of sociology, programming, systems analysis, and most importantly, detective work. As scripts evolve and become more advance, basic HTML will become a thing of the past. (Anyone remember using <blink> -? it has long been relegated to the dust bin) It will surely be replaced by more interesting and intricate coding languages, but, the fact that most of the basic web still lies on the backbone of this basic script is very important for understanding its structure. Internet Archaeologists will have to be able to reconstruct the code they find, without damaging it.
Sociology will be important because in order to understand a society you must comprehend the events that shaped it. Just like in real life, internet communities evolve. People expect to see changes. They visit Facebook for updates, they read their news and want different stories to engage their minds. Just as we might not appreciate the historicity of an epic poem like Illiad (imagine: it was intended to be memorized and sung!) The same is true for web sites that have fallen beneath the surface of the web. Once they were vibrant, and reflected a culture of people who visited them, and their decline is worth noting.
The first Archaeologists will no doubt face similar challenges that the real world ones do daily. “What is the value of your work” “How can you justify the expense” – the fact is, the only way to justify it is to go out and do it. It is impossible to predict the value of an activity without actually attempting it. When you seek the unknown, and the lost, you may come across anything from a site for people who like dolls, to a full blown USENET group that has lost its way. Either way, you are witnessing the recordings of live information, thoughts and ideas, perhaps even inspiration that was far ahead of its time.
Hypothetically, if a user proposed an impractical idea, and it is forgotten (due to the impracticality of it) when technology advances, instead of waiting for a second inspiration, perhaps if we could preserve the germ of the idea in the first place, it would make technology advance more rapidly – because the germ of the idea would still be in place, waiting to be rediscovered and shaped, or perhaps worked on by people who remembered it and thought it worthy of pursuing to fulfilment. Technology continues to advance, an idea like Google Glasses would have been laughed at 10 years ago, brushed off as something for the future, while today, it is actively being developed.
The most important thing Internet Archaeologists can keep alive is the knowledge of the basic net. How the fundamental switching sites operate, and how to maintain them. Just like in the real world, we have a tendency to build on what came before, instead of engineering things properly. We have cities who’s sewers are centuries old, and require constant care to keep functioning, and yet high rises are still constructed on them without regard for the load that they are meant to bear. Some are lost, as maps are lost, damaged, or simply misplaced. The basics of the internet are much like a sewer system, they are not visible from the surface, and if something is not working, perhaps it is because the base levels of code are the problem, instead of whatever wonderful and flowery code a person has in mind.
Yes, new levels of the internet are constantly being built. Like a city that stands on the ruins of an older city (like Jerusalem, or London) we just expect what remains below to remain below and not trouble us. But, just as sinkholes erupt in our modern streets, the same can take place with the internet. Imagine the chaos that would happen if an internet switching station was not built as redundant as they are. Whole sections of the web might fail without reason, just like a sinkhole pulls cars down into its gullet. This is why we must employ Internet Archaeologists to monitor and maintain the web, as well as looking for lost sites. They are the ones who will keep it safe, in the event of a future calamity – a calamity of which we currently have little in place to protect against or fight.
Our infrastructure is vital, be it electrical, sewage, or cyberspace. (Remember that term?) It is essential for the development of future technology to secure the basic operations of the internet, and ensure there are people capable of maintaining it. There is the old myth that the internet was built to withstand a nuclear war – and perhaps it can, but, can it withstand the weight of an entire planet cramming onto it, every one of which expects high speed downloads of whatever the latest feed from Youtube is? As the internet grows, and becomes all embracing, we will be forced to address this question, because failure to do so would not only render all our advancements useless, but, it could potentially make the entire web dark, and inaccessible to humanity forever.
While some old schoolers may wax eloquent about the importance of books and reading, the fact is that the internet has evolved as the third media – written, broadcast, and cyberspace. Maintaining it and expanding it is vital to our future as a species. This is the point of researching the dark web now, while things are operating at their best. We must establish what the base line paramaters of operation are to ensure humanities transition into the next age, where most of the planet will depend on this resource. Humanity mourns the loss of information from ages past, it is time for a new breed of Internet Archaeologists who will protect it, nurture it, and make sure it is there for all to enjoy.