End of an Era – Geocities!

Last week, Yahoo finally announced the end of Geocities…

Before Twitter, before Facebook, before MySpace – heck, even before Friendster, there was a service known as GeoCities. For those who grew up on the Net in the 90s, it was about as close as you get to what we know today as social networks. It was essentially an organization of like-minded user-created homepages in different topical communities like sports, entertainment, and tech.

Back in the proverbial day, GeoCities was the place where many a modern-day internet nerd cut his or her teeth. After a spectacular dot com purchase of $3.65 billion and an equally spectacular dot com bust, its closure marks the end of one of the earliest ages of the social web.

I remember starting my first page with Geocities. Although, with the Yahoo’s focus elsewhere, it makes sense to shut down what is essentially an internet relic. Still, to those who look back with nostalgia, October 26 could well be a wistful day.

If you don’t know what Geocities is, or rather was, then here’s a wikipedia link for you!

But if you are familiar with it, it’s official end is certainly a bit nostalgic. When every thought that just by making a web page, one would get rich overnight. Was something like the completely misunderstood business of AMWAY :-)

Without a sound business model, people were thinking that just by making some loose web pages sticking together, they could make millions.

Of course there were always those enthusiasts who were doing it for the fun (like me).

GeoCities began in mid-1995 as BHI, which stood for "Beverly Hills Internet," a small Web hosting and development company in Southern California.

The company also created its own Web directory, organized thematically in six "neighborhoods." The neighborhood included "Colosseum," "Hollywood," "RodeoDrive," "SunsetStrip," "WallStreet," and "WestHollywood." In mid-1995, the company decided to offer users (thereafter known as "Homesteaders") the ability to develop free home pages within those neighborhoods. Chat, bulletin boards, and other elements of "community" were added soon after, helping foster rapid growth. On July 5, 1995 Geocities added additional cities, including "CapitolHill," "Paris," "SiliconValley," and "Tokyo." By December 1995, the company, which now had a total of 14 neighborhoods, was signing up thousands of Homesteaders a day and getting over six million monthly page views. The company decided to focus on building membership and community, and on December 15, 1995, BHI became known as GeoCities after having also been called Geopages.

Whatever said, the closure of Geocities marks the end of an era!

Internet and mankind

Sleeping on something sometimes produces profound thoughts… or so I have heard. During my well earned afternoon siesta today after a rather hectic week at work… the dreams hit on a theme we usually ignore – the internet and its potential impact on our society, culture and civilization.

Over the next several hundred years, as mankind grows in numbers, progresses in technology, and generally, learns how to control its environment with more accuracy and efficiency, the structure of society is likely to change in some very significant ways.

According to Wikipedia –

Prior to the widespread internetworking that led to the Internet, most communication networks were limited by their nature to only allow communications between the stations on the network, and the prevalent computer networking method was based on the central mainframe computer model. Several research programs began to explore and articulate principles of networking between separate physical networks. This led to the development of the packet switching model of digital networking. These research efforts included those of the laboratories of Donald Davies (NPL), Paul Baran (RAND Corporation), and Leonard Kleinrock's MIT and UCLA.

The research led to the development of several packet-switched networking solutions in the late 1960s and 1970s, including ARPANET and the X.25 protocols. Additionally, public access and hobbyist networking systems grew in popularity, including unix-to-unix copy (UUCP) and FidoNet. They were however still disjointed separate networks, served only by limited gateways between networks. This led to the application of packet switching to develop a protocol for inter-networking, where multiple different networks could be joined together into a super-framework of networks. By defining a simple common network system, the Internet protocol suite, the concept of the network could be separated from its physical implementation. This spread of inter-network began to form into the idea of a global inter-network that would be called 'The Internet', and this began to quickly spread as existing networks were converted to become compatible with this. This spread quickly across the advanced telecommunication networks of the western world, and then began to penetrate into the rest of the world as it became the de-facto international standard and global network. However, the disparity of growth led to a digital divide that is still a concern today.

Following commercialization and introduction of privately run Internet Service Providers in the 1980s, and its expansion into popular use in the 1990s, the Internet has had a drastic impact on culture and commerce. This includes the rise of near instant communication by e-mail, text based discussion forums, and the World Wide Web. Investor speculation in new markets provided by these innovations would also lead to the inflation and collapse of the Dot-com bubble, a major market collapse. But despite this, the Internet continues to grow.

Because, of its already noticeable impact on the every day lives of many people, the Internet has attracted attention as something which may well bring about significant changes. The tendency of the Internet to promote connectedness between individuals and its ability to disseminate large and diverse quantities of information has led many theorists to advocate the concepts of the super organism and global brain as descriptions of future human society.

Bill gates, one of the visionaries of our times (and the richest individual for a long time on Forbes Listing) outlines the importance of Internet as –

“The main advantage of any new technology is that it amplifies human potential. In the 20th century, electricity, the telephone, the automobile and the airplane all made the world more accessible to more people, transforming our economy and society in the process. The Internet has the same revolutionary impact--individuals and businesses can overcome geographical, cultural and logistical barriers and improve the way they live and work. Because it amplifies our potential in so many ways, it's possible that the long-term impact of the Internet could equal that of electricity, the automobile and the telephone all rolled together. The Internet brings people closer together. Before the Internet, it was possible to keep in touch with relatives and friends across the country or around the world--but it was also expensive. Today, communicating with a friend in Japan is as easy and cheap as communicating with a friend across town, and families regularly use the Internet to keep in touch with far-flung relatives. Millions of people with shared interests--no matter how obscure--exchange information and build communities through Web sites, email and instant-messaging software. Using innovative accessibility aids, people with disabilities can use the Internet to help overcome barriers that prevent them from leading more productive and fulfilling lives”.

However, the internet is being thought of being much more than just bringing connectedness. What this interaction between individual “cells” represented by individual people and the global mass populations as super organisms has profoundly greater potential than being recognized as such.

Ideas of the human super organism and global brain first appeared in modern form in Herbert Spencer's The Principles of Sociology (1876-96). The super organism idea gained scientific support from the work of the notable Russian biogeochemist Vladimir Vernadsky. He performed groundbreaking studies of the large scale biochemical processes of the earth, and was the first to think of the Earth and all living things as a single biosphere.

While the biosphere concept deals with the Earth as a whole, Vernadsky also coined the term, noosphere, which more specifically denotes "the network of thoughts, information and communication that englobes the planet." This network could only be a phenomenon attributed to humans, and in 1955, Pierre Teilhard de Chardin published his work, The Phenomenon of Man, in which he popularized the term, noosphere, and the concept of the human superorganism and the global brain. Since then, a wide range of thinkers has taken up these concepts and developed them using today's knowledge of the world and humanity.

The most straightforward way of approaching the concept of the human superorganism is through trend. By examining a significant trend throughout the development of living creatures and humanity, in particular, it is possible to extrapolate the development of the human superorganism. This trend has been for systems of single entities acting separately to combine into systems of many entities acting in cooperation. The many-entity system can then be viewed as a single, larger entity, often with significant qualities which cannot be attributed to the individual entities making up the system.

In evolutionary terms, this tendency of individual entities to combine to form larger, more complex entities manifests itself further in the structure of multicelled organisms. The single cell organisms, which existed before the development of multicelled organisms, realized a distinct survival advantage by cooperating with other single cell organisms to satisfy their basic needs. The level of cooperation between single celled organisms evolved until the cooperative units could be viewed as single entities or multicell organisms.

Speculating about the future development of humanity, proponents of the superorganism concept notice this same trend in human societies with modern free market economies. In these societies, individuals acting for their own benefit often find that cooperation with another individual serves to further the individual interests of both parties. Indeed, this concept has been developing for millennia and has reached the point where people spend the majority of their lives specializing in one area of expertise. People provide work in narrow areas that somehow benefit others and contract with others to provide for their needs in all other areas.

The incredible rate at which scientific discoveries and technology advances are made today ensures that the need to specialize will only increase. As humans become even more specialized in narrow fields of expertise, the need for cooperation becomes even greater. In general, the more a person has specialized in one field, the less they know about other fields, and the more they must rely on others to provide knowledge or services in other fields. In this manner, the complexity of societal interactions and cooperation is constantly increasing with developments in science and technology.

Thus, we are reminded of the single cell organisms whose level of cooperation increased to the point where all cooperating cells could be seen as a single, more complex multicell organism. In the same way, if one assumes that the progress of humanity will continue in the manner we have seen throughout history, we can extrapolate the development of a human superorganism. Such a superorganism would result from the highly complex interactions and cooperation of the human individuals as they each act naturally in their own best interests.

The guiding intellect of this human superorganism can be defined as the global brain. This global brain is likely to have qualities which cannot be attributed to individual humans. Just as a cell cannot comprehend the concept of a human or of sentience, we may not be able to fully understand the nature of the superorganism and the global brain. However, one can hope that our sentience and investigative nature might give us more success than the cell.

To understand the influence of the Internet of the global brain it is necessary to understand the current state of the global brain. As witnessed to by all the present strife in the world, it is evident that the global brain, if at all existent, is still in a very primitive form. While there is a reasonable level of cooperation among members of some countries, cooperation among member of different societies is still quite limited by language and cultural differences. We see fighting, terrorism and general strife in many parts of the world in the name of language, religion and culture. Also, at least half of the people in the world are not in political or economic situations in which they can participate in a superorganism and global brain. Clearly, humanity has far to progress and many obstacles to overcome before the global brain can emerge as a coherent entity.

The advent of the Internet in the past decade has caused quite a stir among thinkers sympathetic to the global brain concept. It is thought that the Internet might be the ingredient needed to bring about the emergence of the global brain as a coherent entity. The reason the Internet inspires such optimism is due to its likeness to human brains and to its globalness.

Firstly, the organization of information on the World Wide Web in hypertext format closely resembles the associative connections formed by neurons in the brain.

Secondly, the Internet network encompasses the entire globe, holding the possibility for linking all humans with a means of virtually instant interaction.

Thirdly, it could conceivably store all human knowledge and provide instant access to that knowledge to its users.

This is an unparalleled trend in human evolution. Never have we, as a species, had instant access to such amount of information. Besides simply noticing the trend of today's civilization toward developing a global brain, some thinkers have suggested specific ways in which this might come about through development of the Internet. This is important for the healthy development of the global brain. The global brain must develop as a natural process that benefits individuals and never as an end in itself. This helps to guarantee that human individuals will not find themselves being oppressed for the "good" of the global brain.

Various information gathering mechanisms can be viewed as ways of improving the efficiency of interaction between people who are cooperating to perform various actions. The knowledge provided by a person with a certain specialty is more readily available for use by others who might need it. As such, the Internet, by dramatically increasing the level of cooperation between individuals, could possibly lead to a solidification of the global brain as a coherent entity.

In fact, some thinkers argue that the advent of internet may have even more profound impact on humanity than splitting of the atom!

“The fact that everything is possible on the Internet reveals mankind's true essence, the aspiration towards freedom.” Pierre Lévy, “Collective Intelligence: A Civilization”

The ubiquity of computers and access to the Internet has put the greatest libraries, image databases, and interactive tools at the fingertips of most artists working today. As a result, traditional artistic practice is exploding as artists explore the potential of these new technologies and incorporate them into their working methodologies.

I-Mod talks about the concept of Meta-brain - Mankind and it's Meta Brain, the Internet.

There is however, as usual, a contrary view as well as this article on cracked.com highlights it - 7 Reasons the 21st Century is Making You Miserable… or this one - Internet: Amazing tool of mankind in the 2lst century but…

As Bill Gates puts it - The Internet has already revolutionized the way we live and work, but it is still in its infancy. In the coming years, a combination of cheap and powerful computing devices, fast and convenient Internet access, and software innovations could make the Internet as common and powerful a resource as electricity is today.

Mankind would never be the same again… although that may not always be a good thing all the time. But as history of dinosaurs has shown us… what does not evolve, perishes!

The Web, then and now and beyond… Web 2.0!

Following commercialization and introduction of privately run Internet Service Providers in the 1980s, and its expansion into popular use in the 1990s, the Internet has had a drastic impact on culture and commerce. The Internet has touched lives profoundly all over the world. It has led to an almost revolution in the way world operates. And it has brought humanity closer.

In the 1950s and early 1960s, prior to the widespread inter-networking that led to the Internet, most communication networks were limited by their nature to only allow communications between the stations on the network. Some networks had gateways or bridges between them, but these bridges were often limited or built specifically for a single use. One prevalent computer networking method was based on the central mainframe method, simply allowing its terminals to be connected via long leased lines. This method was used in the 1950s by Project RAND to support researchers such as Herbert Simon, in Pittsburgh, Pennsylvania, when collaborating across the continent with researchers in Sullivan, Illinois, on automated theorem proving and artificial intelligence.

I am not going to rant about the history of internet here. This is covered in a very comprehensive and lucid way in this excellent article at Wikipedia. Another great article, starting a little earlier than the 1950s… Roads and Crossroads of Internet History.

Walt Howe’s discourse about the history of internet is also very interesting to read.

Another interesting aspect is Al Gore’s contribution to the growth of internet.

The commercialization of the Internet brought extraordinary, almost to the point of being irrational, wealth to a few individuals. The euphoria created by sudden connectivity, unleashing the power of individual creativity and bringing it onto a world stage with very little cost was also paralleled in an irrational exuberance in the stock markets. This is also commonly known as the Dot Com Bubble.

It all started during the mid 1990’s. The Stock Market soared on technology and Internet stocks, IPOs were all the rage, and the sky was the limit for stock prices. The masses believed there was a new world upon us, and the internet was to become the future of business. Then reality set in when the hype didn’t live up to its promises and the stock market crashed. If you take all of this for only its face value, all you see is what happens when a stock market gets overvalued and crashes, but if you look deeper you can find plenty of timeless lessons that every investor should learn.

Ian Peter’s History of the Internet - the Dotcom bubble nicely summarizes the Internet and Dot Com Bubble.

Web 2.0 is a buzzword that exploded in popularity sometime in 2005. In 2004, software guru Tim O'Reilly founded the Web 2.0 Conference, held annually in San Francisco. It has since expanded from a conference into a way of thinking, a new approach to doing business on the Internet. There is no standard definition for web 2.0, as it is a cluster of ideas rather than anything clear-cut. However, O'Reilly's comments on the topic are seen as having special authority, and rank among the top Google search results for the term.

According to Tim O’Reilly – “Web 2.0 is the term used, in the technology field, to refer to some exciting developments that promise to bring us to a new and improved internet experience. For developers this means learning new technologies and frameworks to provide better, faster and more sophisticated features”.

The concept of "Web 2.0" began with a conference brainstorming session between O'Reilly and MediaLive International. Dale Dougherty, web pioneer and O'Reilly VP, noted that far from having "crashed", the web was more important than ever, with exciting new applications and sites popping up with surprising regularity. What's more, the companies that had survived the collapse seemed to have some things in common. Could it be that the dot-com collapse marked some kind of turning point for the web, such that a call to action such as "Web 2.0" might make sense? We agreed that it did, and so the Web 2.0 Conference was born.

Paul Graham describes Web 2.0 as an idea that was meaningless when started, but has acquired a meaning during the intervening period. He then goes on to describe the various components that contribute to the new revolution.

According to Wikipedia - Web 2.0 is a term describing changing trends in the use of World Wide Web technology and web design that aims to enhance creativity, secure information sharing, collaboration and functionality of the web. Web 2.0 concepts have led to the development and evolution of web-based communities and its hosted services, such as social-networking sites, video sharing sites, wikis, blogs, and folksonomies. Although the term suggests a new version of the World Wide Web, it does not refer to an update to any technical specifications, but to changes in the ways software developers and end-users utilize the Web.

The first premise of web 2.0 is leveraging the power of the user. For example, fluid user tagging of content would be used instead of a centralized taxonomy. Web 2.0 entrepreneurs often consider the Long Tail, which is basically an observation that the vast majority of the attention market is based on niche content. Web 2.0 is radically decentralized, as in the case of BitTorrent, a collaborative downloading co-op that consumes a serious portion of all Internet traffic.

Blogs are considered web 2.0. Instead of centralized "personal home pages", blogs let people easily post as much or as little as they want as rarely or as frequently as they want. Feed aggregators ensure that people only need to visit a single site to see all the feeds they subscribe to. Comments are enabled everywhere, allowing people to participate rather than passively consume content.

Web 2.0 technology encourages lightweight business models enabled by syndication of content and of service and by ease of picking-up by early adopters.

O'Reilly provided examples of companies or products that embody these principles in his description of his four levels in the hierarchy of Web 2.0 sites:

- Level-3 applications, the most "Web 2.0"-oriented, exist only on the Internet, deriving their effectiveness from the inter-human connections and from the network effects that Web 2.0 makes possible and growing in effectiveness in proportion as people make more use of them. O'Reilly gave eBay, Craigslist, Wikipedia, del.icio.us, Skype, dodgeball, and AdSense as examples.

- Level-2 applications can operate offline but gain advantages from going online. O'Reilly cited Flickr, which benefits from its shared photo-database and from its community-generated tag database.

- Level-1 applications operate offline but gain features online. O'Reilly pointed to Writely (now Google Docs & Spreadsheets) and iTunes (because of its music-store portion).

- Level-0 applications work as well offline as online. O'Reilly gave the examples of MapQuest, Yahoo! Local, and Google Maps (mapping-applications using contributions from users to advantage could rank as "level 2").

Non-web applications like email, instant-messaging clients, and the telephone fall outside the above hierarchy

Web 2.0 websites allow users to do more than just retrieve information. They can build on the interactive facilities of "Web 1.0" to provide "Network as platform" computing, allowing users to run software-applications entirely through a browser. Users can own the data on a Web 2.0 site and exercise control over that data. These sites may have an "Architecture of participation" that encourages users to add value to the application as they use it. This stands in contrast to very old traditional websites, the sort which limited visitors to viewing and whose content only the site's owner could modify. Web 2.0 sites often feature a rich, user-friendly interface based on Ajax, OpenLaszlo, Flex or similar rich media.

Second life and similar platforms provide an immersive environment where users can interact with each other in a father richer way than was possible through the web 1.0 tools such as chats, emails, etc.

In my next post, I’ll be talking more on how this new revolution is touching lives and what may be in store for humanity with this medium… almost bordering on the science fiction!

Grid computing…

In my previous post, I had mentioned how grid computing is helping in processing of petabytes of data generated by LHC. Today, let’s explore the concept of grid computing in a little more depth.

According to Wikipedia - Grid computing is a form of distributed computing whereby a "super and virtual computer" is composed of a cluster of networked, loosely-coupled computers, acting in concert to perform very large tasks. This technology has been applied to computationally-intensive scientific, mathematical, and academic problems through volunteer computing, and it is used in commercial enterprises for such diverse applications as drug discovery, economic forecasting, seismic analysis, and back-office data processing in support of e-commerce and web services.

The term Grid computing originated in the early 1990s as a metaphor for making computer power as easy to access as an electric power grid in Ian Foster and Carl Kesselmans seminal work, "The Grid: Blueprint for a new computing infrastructure".

An excellent resource on grid computing is available at - http://www.gridcomputing.com/

Later on, CPU scavenging and volunteer computing were popularized beginning in 1997 by distributed.net and later in 1999 by SETI@home to harness the power of networked PCs worldwide, in order to solve CPU-intensive research problems.

One of the most famous cycle-scavenging networks is SETI@home, which was using more than 3 million computers to achieve 23.37 sustained teraflops (979 lifetime teraflops) as of September 2001. Being deeply interested in the question of extra-terrestrial life, I myself participated in the SETI@home project with my old x486!

Grid computing requires the use of software that can divide and farm out pieces of a program to as many as several thousand computers. Grid computing can be thought of as distributed and large-scale cluster computing and as a form of network-distributed parallel processing. It can be confined to the network of computer workstations within a corporation or it can be a public collaboration (in which case it is also sometimes known as a form of peer-to-peer computing).

A number of corporations, professional groups, university consortiums, and other groups have developed or are developing frameworks and software for managing grid computing projects. The European Community (EU) is sponsoring a project for a grid for high-energy physics, earth observation, and biology applications. In the United States, the National Technology Grid is prototyping a computational grid for infrastructure and an access grid for people. Sun Microsystems offers Grid Engine software. Described as a distributed resource management (DRM) tool, Grid Engine allows engineers at companies like Sony and Synopsys to pool the computer cycles on up to 80 workstations at a time. (At this scale, grid computing can be seen as a more extreme case of load balancing.)

What distinguishes grid computing from typical cluster computing systems is that grids tend to be more loosely coupled, heterogeneous, and geographically dispersed. Also, while a computing grid may be dedicated to a specialized application, it is often constructed with the aid of general purpose grid software libraries and middleware.

"Distributed" or "grid" computing in general is a special type of parallel computing which relies on complete computers (with onboard CPU, storage, power supply, network interface, etc.) connected to a network (private, public or the Internet) by a conventional network interface, such as Ethernet. This is in contrast to the traditional notion of a supercomputer, which has many processors connected by a local high-speed computer bus.

The primary advantage of distributed computing is that each node can be purchased as commodity hardware, which when combined can produce similar computing resources to a multiprocessor supercomputer, but at lower cost. This is due to the economies of scale of producing commodity hardware, compared to the lower efficiency of designing and constructing a small number of custom supercomputers. The primary performance disadvantage is that the various processors and local storage areas do not have high-speed connections. This arrangement is thus well-suited to applications in which multiple parallel computations can take place independently, without the need to communicate intermediate results between processors.

The high-end scalability of geographically dispersed grids is generally favorable, due to the low need for connectivity between nodes relative to the capacity of the public Internet.

There are also some differences in programming and deployment. It can be costly and difficult to write programs so that they can be run in the environment of a supercomputer, which may have a custom operating system, or require the program to address concurrency issues. If a problem can be adequately parallelized, a "thin" layer of "grid" infrastructure can allow conventional, standalone programs to run on multiple machines (but each given a different part of the same problem). This makes it possible to write and debug on a single conventional machine, and eliminates complications due to multiple instances of the same program running in the same shared memory and storage space at the same time.

By the way, Nortel had also joined the Global Grid Forum (GCF) as far back as April, 2004. The charter of the GHPN group is to establish a rich two-way communication between the community of Grid application developers and the networking communities (in both academia and industry).

Another well-known project is the World Community Grid. The World Community Grid's mission is to create the largest public computing grid benefiting humanity. This work is built on the belief that technological innovation combined with visionary scientific research and large-scale volunteerism can change our world for the better. IBM Corporation has donated the hardware, software, technical services and expertise to build the infrastructure for World Community Grid and provides free hosting, maintenance and support.

During 2007 the term cloud computing came into popularity, which is conceptually similar to the canonical Foster definition of grid computing (in terms of computing resources being consumed as electricity is from the power grid). Indeed grid computing is often (but not always) associated with the delivery of cloud computing systems.

All the major corporations of the world involved with computing industry in one way or the other are working towards this area. Microsoft is joining the cloud-computing trend, with CEO Steve Ballmer saying a "Windows Cloud" OS will be launched at Microsoft's Professional Developers Conference. Ballmer said Microsoft's "Windows Cloud" is aimed at developers creating cloud-computing apps. Microsoft, IBM, Intel and Oracle are all getting involved in cloud computing.

For example, Oracle is shifting its Grid Focus to the Application. "Think of WebLogic Application Grid as similar to a service-oriented architecture," said Mike Piech, an Oracle senior director of product marketing, during a recent briefing. "It's not a single product, not a single technology, but an infrastructure with a certain set of characteristics to provide on-demand behavior. Our approach is to have all the foundation-level middleware technologies play into that basic idea of the grid: pooling and sharing resources, using them more efficiently, but also providing a higher quality of service."

IBM is also not being. Relevant resources from IBM can be located from this link.

Grid computing appears to be a promising trend for three reasons:

(1) Its ability to make more cost-effective use of a given amount of computer resources,

(2) As a way to solve problems that can't be approached without an enormous amount of computing power, and

(3) Because it suggests that the resources of many computers can be cooperatively and perhaps synergistically harnessed and managed as collaboration toward a common objective.

In some grid computing systems, the computers may collaborate rather than being directed by one managing computer. One likely area for the use of grid computing will be pervasive computing applications - those in which computers pervade our environment without our necessary awareness