Programmer-Journalists and India

A couple of days ago Programmer/Journalist Adrian Holovaty and his team launched EveryBlock, a web site that hopes to answer the question "What's happening in my neighborhood?". EB has been described as a "hyper-local news" site that collects publicly available information from a lot of sources and presents it in a neatly summarized form. EB gives you information ranging from local crimes to film shoots. I am impressed by EB; you can read more about how the site has been received at the EB blog. The EB team is funded by a two year, 1.1 million USD grant from the Knight Foundation.

After checking out EveryBlock I did a little research about Indian sites that combine programming and journalism. I found that there are hardly any. Although all major Indian newspapers have online web sites none of these do anything much beyond serving as digital translations of printed material. Features focused on disseminating publicly available information in a structured fashion are extremely rare. For instance I couldn't find anything comparable to The Washington Post's collection of information widgets in any major Indian news site.

Can programming and journalism be combined in the Indian context? What follows are the results of a thought exercise to answer this question.

A crucial difference between the US and India is that structured, publicly available data is hard to come by in the latter. Notable exceptions include election results, budget information, results of certain college/school examinations and cricket match scores. But these have always been covered by print media anyway. (I would say covered to death in the case of cricket. But that is for another blog post) What other data is publicly available? I can think of the following.

1. Detailed information about candidates standing in local elections. Income declarations, police/court records, manifestos if any etc.
2. Details of public construction activity. For example the Bangalore City Corporation has made information about road maintenance available online. The information is available in the form of PDF documents. This data can be converted to a more user friendly format and perhaps superimposed over Google's satellite maps as well.
3. Traffic information. I am certain that a LOT of people would really appreciate such a feature covering Bangalore's roads.

These are but a few. In addition to the above newspapers (startups?) could possibly think about collaborating with various agencies to make additional data available. It is worthwhile to note that one of the four members of the EB team, Daniel X. O'Neil, is dedicated to working with local agencies to free up available data. There are a zillion use cases for such cooperation. A feature to track public buses in Bangalore alone would be hugely useful. Another, pet wish of mine is a listing of teachers of performing arts.

Why hasn't the idea gained popularity in India? In all fairness, it is still brand new. The very idea that programming and journalism can be combined in non-traditional ways only gained popularity after the success of Adrian's ChicagoCrime.org, a site that overlays Chicago crime records on Google maps of the city. Startups which have traditionally been sources of innovation find the liaison work and non-profit nature of such ventures unappealing (EveryBlock is a non-profit site, as is ChicagoCrime). Also the Indian print media continues to enjoy a degree of success unlike their western counterparts whose dropping circulations have forced them to investigate new ideas.

Another, more cultural aspect is the vast difference between the programming and journalism professions. Even in the relatively boundary-less West there are but a handful of people who have successfully managed to fuse the domains. Many Indian programmers I know think of Journalism as a low-paying, low-opportunity profession while there is at least one journalist who views programming as the modern day equivalent of dull, regimented factory labor. There also seems to be a variation of the traditional art/science divide in play. Programming is deemed to be in the science camp while journalism combines creativity and artistry.

The idea that programming skills can be as useful to journalists as, say a flair for writing or good conversation skills is yet to gain traction. Adoption of technology among journalists seems to have progressed no further than personal laptops and digital cameras.

What can possibly change the situation? I think change will have to start with Newspapers, specifically their web sites. At present most Newspapers treat their web sites like red headed step children. I doubt if traditional journalists view working in the "web desk" (what are they called anyway?) as lucrative. Similarly aspiring programmers have to recognize the advantages of working with journalism. Newspapers can offer great opportunities to put a lot of data centric programming skills to good use.