infrastructure

You are currently browsing the archive for the infrastructure category.

In Google sets out future for Maps — Lays down gauntlet to Nokia with plans for personalized, context-aware and ’emotional’ maps in future, in Rethink Wireless, Caroline Gabriel begins this way:

Google may be feeling the heat from an unlikely source, Nokia, at least in its critical Maps business. The search giant has put location awareness at the heart of its business model, but Nokia has overtaken it in several respects with its cloud-based Here offering – based on the acquisition of Navteq in 2007 – and has also licensed its mapping platform to some powerful partners such as Microsoft, Amazon and a range of car makers.

Google is promising dramatic changes to its own maps to help fend off the Nokia/Microsoft alliance and also, in the Android segment at least, the challenge from Amazon to a Google-centric experience.

As usual with stories like this, the issue is framed in terms of vendor sports: big companies doing battle over some market category. Lost, also as usual, is what the individual user, or customer, might actually want.

That’s what I’m here for.

So let me start by saying I don’t want a “Google-centric experience,” whatever that is. Nor do I want Google’s (or anybody’s) Matrix-like approach to satisfying what its robotic systems think I might need. Here’s how Caroline explains that ambition:

Bernhard Seefeld, product management director for Google Maps, told the GigaOM Roadmap conference this week that future software will “build a whole new map for every context and every person”, incorporating all kinds of information about the individual and updating this constantly. He added: “It’s a specific map nobody has seen before, and it’s just there for that moment to visualize the data.”

Pushing a major theme at Google this year, Seefeld talks about applications creating emotional connections for users – “emotional maps that reflect our real life connections and peek into the future and possibly travel there”. This will involve context-aware maps that combine location and personal data, some of that taken from other Google apps, particularly its Google Now personal digital assistant – mainly seen as a response to Apple Siri, but in fact far broader in scope, and with a powerful artificial intelligence engine.

Context-aware is fine, provided I provide the context, and the context is as simple as, for example, “I am here” and “I want to go to this other place.” I don’t want guesswork about my emotions, or anything else that isn’t on the vector of what I alone know and want. Paper maps didn’t do that, and the best electronic ones shouldn’t either — not beyond what still feels as hard and useful as paper maps always did.

See, maps are fact-based descriptions of the world. Their first and most essential context is that world, and not the person seeking facts about that world. Yes, map makers have always made speculative assumptions about what a map reader might like to know. But those assumptions have always been about populations of readers: drivers, aviators, hikers, bike riders, sailors, geologists, etc. That they don’t get personal is a feature, not a bug.

A brief story that should tell you a bit about me and maps.

In October 1987, on the way back to Palo Alto after visiting my daughter at UC-Irvine, my son and I noticed it was an unusually clear day. So we decided to drive to the top of Mt. Wilson, overlooking Los Angeles. On the way we stopped at a fast food place and ate our burgers while I studied various AAA maps of Southern California and its cities. When we arrived at the top, and stood there overlooking a vista that stretched from the San Bernardino mountains to the Channel Islands, four guys from New Jersey in plaid pants, fresh from golfing somewhere, asked me to point out landmarks below, since I already was doing that for my son. The dialog went something like this:

“Where’s the Rose Bowl?”

“Over there on the right is Verdugo Mountain. See that green stretch below? In there is the Rose Bowl.”

“Oh yeah.”

“On the other side of Verdogo is the San Fernando Valley. South of that are the Hollywood Hills.”

“Is that where the Hollywood sign is?”

“Yes, on the south side, facing Hollywood. Mulholland Drive runs down the spine of the hills on the far side of the Sepulveda Pass, where the 405 passes through. The Malibu Hills are beyond that. You can see the buildings downtown to the left of that. Long Beach and San Pedro, Los Angeles’ port cities, are to the left of the Palos Verdes peninsula, which are the hills over there. You can see Santa Catalina Island off beyond that.”

“Where was the Whittier Earthquake?”

“Over there in the Puente Hills. See that low ridge?”

“Yeah. Wow. How long have you lived here?”

“I don’t. This is only my second trip through. I live up north.”

“Where are you from?”

“New Jersey, like you.”

“How do you know so much about all this around here?”

“I study maps.”

Of which I have many, now mostly mothballed in drawers. Maps collection on my iphoneI have topo maps from the U.S. Geological Survey, sectional charts from the FAA, maps atlases from the Ordnance Survey in the U.K., and many more. When I fly in planes, I follow the scene below on my laptop using Garmin Road Trip (an app that is sorely in need of an update, btw.) That’s how I can identify, literally on the fly, what I see out the window and later detail in my aerial photo collections on Flickr.

So, having presented those credentials, I rate Google’s Maps mobile app at the top of the current list. Google’s search is great, but substitutable. So are many other fine Google services. But I have become highly dependent on Google’s Maps app because nothing else comes close for providing fully useful facts-on-the-ground. Here are a few:

  • Transit options, and arrival times. Here in New York one quickly becomes dependent on them, and they are right a remarkable percentage of the time, given how uneven subway service tends to be. Hell, even in Santa Barbara, which is far from the center of the public transportation world, Google’s Maps app is able to tell me, to the minute, when the busses will arrive at a given stop. It’s freaking amazing at it.
  • Route options. Even while I’m on one route, two others are still available.
  • Re-routing around traffic. It doesn’t always work right, but when it does, it can be a huge time/hassle saver.
  • Timeliness. It couldn’t be more now, and a living embodiment of the Live Web at work.

I also like Here, from Nokia. (As you can see from my collection of maps apps, above. Note the second dot at the bottom, indicating that there’s a second page of them.) I also have enormous respect NAVTEQ, which Nokia bought a few years back. NAVTEQ has been at the map game a lot longer than Google, and is at the heart of Here. But so far Here hasn’t been as useful to me as Google Maps. For example, if I want to get from where I am now to the meeting at NYU I’ll be going to shortly, Google Maps gives me three options with clear walking and riding directions. Here gives me one route, and I can’t figure how to get the directions for taking it. (Both are on my iPhone, btw.)

So here is a message for both of them, and for everybody else in the mapping game: Don’t subordinate pure mapping functions to a lot of “emotional” and other guesswork-based variables that advertisers want more than map readers do.

This might also help: I’m willing to pay for the maps, and services around them. Not just to avoid advertising, but to make those services accountable to me, as a customer, and not as a mere “user.”

As advertising gets more and more personal, and more creepy in the process — without any direct accountability to the persons being “delivered” a “personalized experience” — a market for paid services is bound to emerge. I’ll enjoy being in the front of it.

Enhanced by Zemanta

Eye of SauronIn Big Cable’s Sauron-Like Plan for One Infrastructure to Rule Us All, Susan Crawford (@SCrawford) paints a bleak picture of what awaits us after television (aka cable) finishes eating the Internet. But that’s just in our homes. Out in the mobile sphere, telcos have been eating the Net as well — in collusion with cable. That’s one of the points Marvin Ammori makes in We’re About to Lose Net Neutrality — And the Internet as We Know It. Both pieces are in Wired, which is clearly on our side with this thing — especially since, if Marvin is right, Wired might someday need to pay the carriers for privileged carriage on what used to be the free and open (aka “neutral”) Internet. Specifically,

Net neutrality is a dead man walking. The execution date isn’t set, but it could be days, or months (at best). And since net neutrality is the principle forbidding huge telecommunications companies from treating users, websites, or apps differently — say, by letting some work better than others over their pipes — the dead man walking isn’t some abstract or far-removed principle just for wonks: It affects the internet as we all know it.

Once upon a time, companies like AT&T, Comcast, Verizon, and others declared a war on the internet’s foundational principle: that its networks should be “neutral” and users don’t need anyone’s permission to invent, create, communicate, broadcast, or share online. The neutral and level playing field provided by permissionless innovation has empowered all of us with the freedom to express ourselves and innovate online without having to seek the permission of a remote telecom executive.

But today, that freedom won’t survive much longer if a federal court — the second most powerful court in the nation behind the Supreme Court, the DC Circuit — is set to strike down the nation’s net neutrality law, a rule adopted by the Federal Communications Commission in 2010. Some will claim the new solution “splits the baby” in a way that somehow doesn’t kill net neutrality and so we should be grateful. But make no mistake: Despite eight years of public and political activism by multitudes fighting for freedom on the internet, a court decision may soon take it away.

He continues,

How did we get here?

The CEO of AT&T told an interviewer back in 2005 that he wanted to introduce a new business model to the internet: charging companies like Google and Yahoo! to reliably reach internet users on the AT&T network. Keep in mind that users already pay to access the internet and that Google and Yahoo! already pay other telecom companies — often called backbone providers — to connect to these internet users.

That was eight years ago. In response to the same AT&T salvo, I wrote Saving the Net: How to Keep the Carriers from Flushing the Net Down the Tubes in Linux Journal. It was submitted in November 2005 and ran in the February 2006 issue. In it I outlined three scenarios:

  1. The Carriers Win
  2. The Public Workaround
  3. Fight with Words and Not Just Deeds

Neither #2 nor #3 have come to pass, except in very limited ways. So, since #1 seems to be on the verge of happening, here’s what I wrote about it. There is a fair amount of link rot, but the points are still sharp — and depressing to contemplate:

Scenario I: The Carriers Win

Be afraid. Be very afraid. —Kevin Werbach.

Are you ready to see the Net privatized from the bottom to the top? Are you ready to see the Net’s free and open marketplace sucked into a pit of pipes built and fitted by the phone and cable companies and run according to rules lobbied by the carrier and content industries?

Do you believe a free and open market should be “Your choice of walled garden” or “Your choice of silo”? That’s what the big carrier and content companies believe. That’s why they’re getting ready to fence off the frontiers.

And we’re not stopping it.

With the purchase and re-animation of AT&T‘s remains, the collection of former Baby Bells called SBC will become the largest communications company in the US–the new Ma Bell. Verizon, comprised of the old GTE plus MCI and the Baby Bells SBC didn’t grab, is the new Pa Bell. That’s one side of the battlefield, called The Regulatory Environment. Across the battlefield from Ma and Pa Bell are the cable and entertainment giants: Comcast, Cox, TimeWarner and so on. Covering the battle are the business and tech media, which love a good fight.

The problem is that all of these battling companies–plus the regulators–hate the Net.

Maybe hate is too strong of a word. The thing is, they’re hostile to it, because they don’t get it. Worse, they only get it in one very literal way. See, to the carriers and their regulators, the Net isn’t a world, a frontier, a marketplace or a commons. To them, the Net is a collection of pipes. Their goal is to beat the other pipe-owners. To do that, they want to sell access and charge for traffic.

There’s nothing wrong with being in the bandwidth business, of course. But some of these big boys want to go farther with it. They don’t see themselves as a public utility selling a pure base-level service, such as water or electricity (which is what they are, by the way, in respect to the Net). They see themselves as a source of many additional value-adds, inside the pipes. They see opportunities to sell solutions to industries that rely on the Net–especially their natural partner, the content industry.

They see a problem with freeloaders. On the tall end of the power curve, those ‘loaders are AOL, Google, Microsoft, Yahoo and other large sources of the container cargo we call “content”. Out on the long tail, the freeloaders are you and me. The big ‘loaders have been getting a free ride for too long and are going to need to pay. The Information Highway isn’t the freaking interstate. It’s a system of private roads that needs to start charging tolls. As for the small ‘loaders, it hardly matters that they’re a boundless source of invention, innovation, vitality and new business. To the carriers, we’re all still just “consumers”. And we always will be.

“Piracy” is a bigger issue to the cargo sources than to the carriers. To the carriers, “fighting piracy” is a service offering as well as a lever on regulators to give carriers more control of the pipes. “You want us to help you fight piracy?”, the transport companies say to the content companies. “Okay, let’s deal.” And everybody else’s freedoms–to invent, to innovate, to do business, to take advantage of free markets and to make free culture–get dealt away.

The carriers have been lobbying Congress for control of the Net since Bush the Elder was in office. Once they get what they want, they’ll put up the toll booths, the truck scales, the customs checkpoints–all in a fresh new regulatory environment that formalizes the container cargo business we call packet transport. This new environment will be built to benefit the carriers and nobody else. The “consumers”? Oh ya, sure: they’ll benefit too, by having “access” to all the good things that carriers ship them from content providers. Is there anything else? No.

Crocodile grins began to grow on the faces of carriers as soon as it became clear that everything we call “media” eventually would flow through their pipes. All that stuff we used to call TV, radio, newspapers and magazines will just be “content” moving through the transport layer of the pipe system they own and control. Think it’s a cool thing that TV channels are going away? So do the carriers. The future à lá carte business of media will depend on one medium alone: the Net. And the Net is going to be theirs.

The Net’s genie, which granted all those e-commerce wishes over the past ten years, won’t just get shoved back in the bottle. No, that genie will be piped and priced by the packet. The owners of those pipes have a duty to their stockholders to make the most of the privileged position they’ve been waiting to claim ever since they got blind-sided, back in the 80s and 90s. (For an excellent history of how the European PTTs got snookered by the Net and the Web, see Paul F. Kunz’ Bringing the World Wide Web to America.) They have assets to leverage, dammit, and now they can.

Does it matter that countless markets flourish in the wide spaces opened by agreements and protocols that thrive at the grace of carriage? Or that those markets are threatened by new limits, protections and costs imposed at the pipe level?

No.

Thus, the Era of Net Facilitation will end. The choke points are in the pipes, the permission is coming from the lawmakers and regulators, and the choking will be done. No more free rides, folks. Time to pay. It’s called creating scarcity and charging for it. The Information Age may be here, but the Industrial Age is hardly over. In fact, there is no sign it will ever end.

The carriers are going to lobby for the laws and regulations they need, and they’re going to do the deals they need to do. The new system will be theirs, not ours. The NEA principle–Nobody owns it, Everybody can use it, Anybody can improve it–so familiar to the Free Software and Open Source communities will prove to be a temporary ideal, a geek conceit. Code is not Law. Culture is not Free. From the Big Boys’ perspective, code and culture are stuff nobody cares about.

That’s us: Nobody.

The new carrier-based Net will work in the same asymmetrical few-to-many, top-down pyramidal way made familiar by TV, radio, newspapers, books, magazines and other Industrial Age media now being sucked into Information Age pipes. Movement still will go from producers to consumers, just like it always did. Meet the new boss, same as the old boss. Literally.

The deals that matter will be done between tops of pyramids. Hey, it’s easier to do business with the concentrated few than the dispersed many. The Long Tail can whip itself into a frenzy, but all the tech magazines and blogs in the world are no match for the tails and teeth of these old sharks. (Hey, Long Tailer, when’s the last time you treated your erected representatives to private movie screenings, drafted their legislation, ghosted their committee reports, made a blockbuster movie or rolled fiber across oceans?)

Google and Yahoo and Amazon and eBay and e-commerce and free software and open source and blogging and podcasting and all the rest of that idealistic junk have had their decade in the sun. Hell, throw in Apple and Microsoft, too. Who cares? Them? Doesn’t matter how big they are. They don’t matter. They’re late to the game.

We all know the content business got clobbered by this peer-to-peer crap. But the carriers took a bath by building out the Net’s piped infrastructure. They sank $billions by the dozen into fiber and copper and routers and trunks, waiting for the day when they’d be in a position to control the new beast fleshed on the skeleton that they built.

That Day Has Come.

It came earlier this month, when the November 7, 2005, issue of BusinessWeek hit the Web’s streets. In that issue are “Rewired and Ready for Combat” and “At SBC, It’s All About ‘Scale and Scope'”, which features an interview with Edward Whiteacre, CEO of SBC. Here’s the gist of it:

How concerned are you about Internet upstarts like Google (GOOG), MSN, Vonage, and others?

How do you think they’re going to get to customers? Through a broadband pipe. Cable companies have them. We have them. Now what they would like to do is use my pipes free, but I ain’t going to let them do that because we have spent this capital and we have to have a return on it. So there’s going to have to be some mechanism for these people who use these pipes to pay for the portion they’re using. Why should they be allowed to use my pipes?

The Internet can’t be free in that sense, because we and the cable companies have made an investment and for a Google or Yahoo! (YHOO) or Vonage or anybody to expect to use these pipes [for] free is nuts!

What’s your approach to regulation? Explain, for example, the difference between you and Verizon in how you are approaching regulatory approval for Telco TV [digital-TV service offered by telecoms].

The cable companies have an agreement with the cities: They pay a percentage of their revenue for a franchise right to broadcast TV. We have a franchise in every city we operate in based on providing telephone service.

Now, all of a sudden, without any additional payment, the cable companies are putting telephone communication down their pipes and we’re putting TV signals. If you want us to get a franchise agreement for TV, then let’s make the cable companies get a franchise for telephony.

If cable can put telephone down their existing franchise I should be able to put TV down my franchise. It’s kind of a “what’s fair is fair” deal. I think it’s just common sense.

What if the regulators don’t agree?

Then there won’t be any competition–there will be a cable-TV monopoly.

I know you’re a competitive person. Who are your biggest competitors?

Our big competition in the future is with the cable companies. Verizon’s going to be a player, and certainly I want to compete. And I want our shareowners to do better than anyone else.

If I were BusinessWeek, I’d ask:

What about the free and open marketplace that has grown on the Net itself? Do you have any interest in continuing to support that? Or in lobbying forms of deregulation that foster it? Or are you just in a holy war with the cable companies inside the same old regulatory environment you’ve known since forever?

I’d ask:

If you were to buy, say, Level 3, would you start to filter and restrict content at the transport level, to extract the profits you want, without regard for other market consequences? Would Cisco, builder of the great Firewall of China, help out?

I’d ask:

Which do you prefer: The regulatory environment where your business has adapted itself for more than a century, or a completely free and open marketplace like the rest of us enjoy sitting on top of your pipes?

Whiteacre’s answers, of course, would be less relevant than the obvious vector of his company’s intentions. For a summary of that, let’s return to Lauren Weinstein of People for Internet Responsibility:

Of course, the truth of the matter is that the telcos have been moving rapidly through massive consolidation–and a range of other tactics–to create an environment where “competition” will only be a pale reflection of what we were originally promised, with only a few gigantic players in control of all telecom resources and policies. Like the robot cop in Terminator 2 that reformed from blown-apart mercurial blobs of metal, the “golden age” of telecom competition is already giving way to empire.

Don’t blame BusinessWeek for not asking the important questions or for missing the Carriers vs. Net story. Biz pubs love to cover vendor sports. And there’s certainly a big story here.

Great distraction, vendor sports. While we’re busy watching phone and cable giants fight over a closed battlefield that ought to be open, we miss Net-hostile moves by other parties that result in other lost freedoms.

Take ICANN, for instance, where a new .com Registry Agreement allows Verisign to raise the rates for .com names by 7% annually, and to operate .com in perpetuity, and to “mak[e] commercial use of, or collect, traffic data regarding domain names or non-existent domain names”, and to reap other rewards for what few other than Verisign would agree is a good job. Bret Faucett summarizes the darkest shadow across the noir scenario we’ve already described:

The theme running through all of these is that ICANN and Verisign are treating the .COM registry as a private resource. It’s not. The root servers and TLD servers are public resources. We should treat them like that.

Bret has one of the most eloquent voices in the wilderness of clues the Big Boys would rather avoid. So does Susan Crawford, who was just, perhaps miraculously, named to the ICANN board.

For Bret, Susan and the rest of the restless natives of this new world, what matters most is Saving the Net–keeping it a free and open marketplace for everybody–while also making sure that carriers of all kinds can compete and succeed while providing much of the infrastructure on which that marketplace resides. That means we need to understand the Net as more than a bunch of pipes and business on the Net as more than transporting and selling “content”.

This isn’t a trivial issue. It’s a matter of life and death for the Net itself. How are we going to fight?

Read on.

You can do that here. Also dig Marvin Ammori’s own follow-up.

Meanwhile the Net continues to cry out for a definition all can agree on. Toward that goal, I wrote this in The Intention Economy:

To simplify things a bit, look at the Net’s future as a battleground where any and only fight it out. On the side of any are the Net’s protocols. On the side of only are governments and businesses with interests in restricting and controlling access to the Net, and thwarting many purposes to which the Net might be put. This battle also happens inside our own heads, because we tend to view the Net both ways. Ironies abound.

For example, the Internet is often called a “network of networks,” yet the Net was designed to transcend the connections it employs, and is therefore not reducible to them. It is not comprised of wiring, and is not a “service,” even though it’s called one by ISPs.

So let’s look at the sides here. On the any side, “net-heads” (yes, they call themselves that) frame their understanding of the Net in terms of its protocols, and those protocols’ virtues. On the only side, “bell-heads” (yes, they call themselves that, too) frame their understanding of the Net in terms of wiring infrastructure and billing systems.

To net-heads, the Internet is a vast new virtual space with qualities such as neutrality and generativity. To maximize economic opportunity and vitality, those virtues need to be maximized—even if phone and cable TV businesses don’t wish to acknowledge or support those virtues.

To bell-heads, the Internet’s “network of networks” is a collection of mostly private properties, with which owners should be free to do what they please. So, if what pleases them is throttling certain kinds of data traffic to maximize QoS (Quality of Service), too bad. They are The Market, which will grow best if they act in their own economic self-interest. Hey, look at all the good they’ve done already. (Want dial-up again, anyone?) And look at the robust competition between cable and phone companies. Isn’t that producing enough economic benefits for everybody?

Since net-heads tend to make social arguments while bell-heads tend to make economic ones, net-heads get positioned on the left and bell-heads on the right. Between the two are boundless technical arguments that aren’t worth getting into here.

I’m a net-head, but one who wants both sides to recognize that the Net’s original design is encompassing and beneficial for economies and societies everywhere. That is, I believe the argument for the Net is the same as the one for gravity, sunlight, the periodic table and pine trees: that it is part of nature itself. What makes the Net different from all those other products of Nature is that humans made the Net for theselves.

The Net’s nature—its essential purpose—is to support everything that uses it, just as the essential purpose of a clock is to tell time. So, while the Net today relies on phone and cable connections, its support-everything purpose should not be subordinated to legacy phone and cable TV businesses. The Internet, in the neutral and generative form defined by its protocols, is a far larger and more interesting market environment than the one defined by the parochial and limited interests of phone and cable companies, both of which are desperately trying to hold on to their legacy businesses, and would be better served by embracing all the opportunities the Internet opens up, for everybody.

We’re going to evolve past those old businesses anyway. Phone and cable company engineers know that, and so do many of the business leaders in those companies, even as they fight to protect their legacy businesses at all costs.

As a pro-business guy, I sympathize with phone and cable companies, which are cursed by the need to maintain margins in existing business while building out infrastructures that obsolete those businesses (at least as we know them). These companies get little credit (especially from net-heads) for their genuine innovations, and for their ability to innovate more. We do need them, whether we like them or not…

So, then

The Net’s capacity to support limitless economic activity and growth will win in the long run because it will prove out in the very marketplaces it support. But there will be a great deal of resistance along the way, as the narrow interests of both Big Government and Big Business try to contain the Net’s potential within the scope of their own ambitions. Still the evolutionary direction of the Net is toward ambient connectivity. Whatever that looks and feels like, it won’t resemble either the phone system or cable TV. Rather it will look like everything, together.

That’s the long-term optimistic view. Meanwhile, there is much cause for pessimism in the short term.

car radio

Radio’s 1.x era is coming to an end. Signs and portents abound. The rise and decline of AM radio just ran in the Pittsburgh Post-Gazette, hometown paper for KDKA, the granddaddy of AM radio in the U.S. In AM/FM Radio Is Already Over, And No One Will Miss ItAdam Singer writes,

Radio advertisements are an awful, intrusive experience and universally despised

Most passionate music fans have held disdain for radio since the advent of portable music. It’s not just a dated medium, it tries to prop up a legacy generation “winner take all” of the most banal / manufactured “hits” as opposed to the meatier middle and tail of music where the quality content is (and where artists take chances and push the envelope creatively).

AM / FM radio djs and personalities are really the only thing left, and they should abandon radio now because they would benefit greatly by setting up shop online. Whether their own blog / podcast, app, or even experimenting with video (which is still a chance to be a pioneer). Even if they aren’t totally ready to abandon it yet, they should start to funnel their audiences to a digital community of some sort where they can grow over time in a platform agnostic way. This way they’re prepared for a digital future.

The notion of terrestrial analog content via AM/FM is quaint in a digital society and has reached an inevitable end. The technology itself is done. The good news is the personalities and content can not just survive, but thrive in a much higher quality environment. Further, digital provides a better experience for  audiences and sheds legacy baggage / a model that pushes aside quality and creativity for profit. Advertisers and technology providers will benefit here too: the modern device landscape provides a much better experience from a measurement, content serving, customization, and brand perspective (and so much more).

No doubt in our lifetime AM/FM will completely go away, perhaps only existing as emergency frequency. But everyone: consumers, advertisers, artists and personalities win by embracing digital. You’re fighting the future to ignore this and that’s never a way to succeed.

Yet people still listen to streams of audio, which is all radio ever was. Most of that audio is now digital, and comes to us over the Internet, even if some of it also still streams out over analog airwaves. Naturally, it’s all merging together, with predictable combinations of hand-wringing and huzzahs.

In How Tesla Changes Radio, B. Eric Rhoads reports on both:

Most in our industry are responding like any industry that’s challenged: defending the status quo and finding all the reasons consumers won’t change. And it might even be true, in radio’s case. But how likely is that? The questions all radio broadcasters need to be asking themselves now is how they can develop listener loyalty and cement their brands so deeply that listeners will seek out their favorite stations even when they have a choice of 75,000 stations from all around the world. Though you’ll still be available on the local AM FM dial, you need to assume people embracing online radio may only seek out stations in an online environment.

And, speaking of the status quo, dig “Fixing” AM Radio Broadcasting, Parts I, II and III, by Old Curmudgeon of LBA Group. There you will find perhaps the only useful way to bring a 1920’s-vintage transmission system into the next millennium. And it may well work, even though the result will still suffer from a bug what was once a feature. I explain what I mean by that in a comment under Part III:

Last year, after failing to find a useful radio at Radio Shack, my teenage son asked me a question that spoke straight to the obsolescence of radio as we know it: “What is the point of ‘range’?” In other words, why is losing a signal while driving away from town a feature and not a bug? When I explained some of the legacy technical and regulatory issues behind ‘range’, he asked, “What will it take to save radio?”

I like your answers.

In this series you frame the problems well and pose a good solution that I think will work by providing a technical and regulatory bridge from analog to digital and from 1925 to 2015. I hope regulators and broadcasters both take your proposals seriously.

Meanwhile, both the radio industry and the FCC are in denial of what’s actually happening with the “millenial” generation to which my son belongs. These people are Net-based. They assume connectivity, and zero functional distance between themselves and everyone and everything else in the networked world. They are also remarkably unconcerned with threats to the Net and therefore that model, from phone and cable companies, and captive regulators.

Hollywood in particular has known since 1995 that all of broadcasting and content distribution is being absorbed by the Net. With phone and cable companies — with which Hollywood is increasingly integrated vertically — they are desperate to find ways to continue controlling that distribution — preferably on models just as old as AM radio. Billing especially is a key issue. Phone and cable companies are billing systems as well as communications ones. Terrestrial TV and radio are not, which is one reason they care little about saving them.

So, to me at least, the parallel challenge to saving AM (and FM) radio, is keeping incumbent giants and their captive regulators from from stuffing the Internet’s genie back in the bottles of Business as Usual.”

In You Must Be HD to Compete in the Dash, RadioINK interviews Bob Struble (@rjstruble), CEO of iBiquity, the company behind HD Radio, which I love because it cleans beat-up FM and AM signals, more than for its other virtues. An excerpt:

…take my new Sequoia as an example. It has one screen layout that is the same for all audio services — Sirius, Pandora, iHeart, iPod, and analog or digital AM/FM. The screen has all my presets, from any source, on one side, and the content screen on the other side. Like all the digital services, HD Radio technology allows a station to fill that screen. There is an album cover or station logo in the middle of the screen, there are indicators that there is an HD2, HD3, or HD4 station available, there is song and artist info, there is an iTunes Tagging button to store song info for later purchase. Overall, it looks and feels like an audio service should in the digital age.

Hmm: “audio service.” I think that’s Radio 2.0, which here I call the “holy grail.”

All this will be front & center at the Dash Conference next week in Detroit. I’ll be there in spirit while my butt is at IIW in Silicon Valley (which I co-organize). This means I’ll be watching Twitter and blogs for reports on progress. In other words, I’ll stay tuned.

It’s interesting to see where photos end up (or start out, or re-start out) when one puts them in position to be used and re-used with minimized friction. The one above, of a coal-fired power plant in Utah that supplies electricity to Los Angeles, and which I shot from a flight overhead in January 2009, appears in at least these three places, so far:

At this point 391 photos of mine have found their way into Wikimedia Commons. I put none of them there. I just post them in Flickr and license them permissively.

I just noticed that mining and power generation figure prominently in that collection. Maybe that’s because I like to shoot pictures of infrastructure, geology and both at once. Or maybe it’s because the subject is interesting enough for Wikimedians to put the shots in there. Dunno.

Oddly, I don’t see the Utah power plant shot in the midst, but maybe I missed it. More likely people using the shots have done a search-by-license on Flickr, such as this one for coal.

[4:45pm EDST  2 October 2013 — Late breaking news: RadioINK reports that Darryl Parks’ blog post — the first item below — has been pulled off the 700wlw site. — Doc]

In A SERIOUS Message To The Broadcast Industry About Revitalizing AM Radio, Darryl Parks of 700WLW made waves (e.g. here, here, here) by correctly dismissing six FCC ideas intended to make life easier for owners of AM radio stations. Those ideas are detailed at that last link (by David Oxenford of the excellent Broadcast Law Blog).

All six, Darryl says, would increase interference. Instead, he suggests, “The answer is not MORE interference. The answer is LESS interference. And you do that by turning off non-viable stations. And before station owners start crying poverty, many of these non-viable AM stations have one thing that is worth a ton of money. The land their towers sit on.”

Well, not all stations own the land their towers sit on. KCBS/740 leases their land from a farmer up in the North Bay. Other stations’ towers, such nearly all of those serving New York, sit in tidal swampland or on  islands that would revert to nature if the towers came down. (For example, WMCA and WNYC, which share the towers next to the New Jersey Turnpike, shown here. Likewise KGOKNBR and WBZ.)

But Daryyl’s right: there are too many stations, and too much interference — not only between them, but also from electronic thingies that didn’t exist when AM’s base technology and regulatory system were framed out in the 1920s.  Computers, mobile phones and energy-saving light bulbs all play havoc with AM reception.

I see three other solutions, only one of which is likely to happen.

The first is better AM receivers. The old tube and transistor types were much better, on the whole, than the newer chip-based ones. But even the chip-based receivers were better in the early days than they are now. The faults are not just in the electronics, but in the methods used for gathering signals. In cars, for example, the fashion in recent years has been to shorten antennas or to embed them in windows, mixed in with defrosting wires. Radios in cars I drove in the 1960s and 1970s would get New York’s biggest AM signals (on 660, 770 and 880) past Richmond, Virginia, in the middle of the day. The radios were not only better, but served by whip antennas on their fenders. Even portable radios were better. When I was a kid riding in the back seat of our new Chevy, on a family trip in the summer of 1963, I listened to WNAX in Yankton, South Dakota, from the Black Hills to Minneapolis, again in the daytime (when AM signals don’t bounce off the sky, as they do at night — on a Zenith Royal 400 seven-transistor radio. Alas, modern receivers and antennas are studies in cheap-out-y-ness, and don’t do the same job. In the absence of regulatory or market urgings, the chance of improvement here is zero.

The second is moving to an all-digital AM band. In this Broadcast Law Blog post David Oxenford says all-digtial “has shown promise for an interference-free operation in recent tests,” but “would require that there be a digital transition for AM radio just as there was to digital TV. That might be problematic, as it would require new AM receivers for almost everyone (except for those few people who already have Ibiquity IBOC receivers which should work in an all-digital environment).” I have one of those receivers in my kitchen. (That’s a shot of its display, there on the left.) HD on AM sounds like FM. Combine that with better receivers and antennas, and it’s a double-win. Here there is a small amount of regulatory urging, but try to find find a portable HD radio at Amazon or Radio Shack. Not happening.

The third is to develop better ways of getting radio streams on mobile devices. I have a mess of apps for getting radio streams on my iPhone and iPad, and none of them provide the simplicity of radio’s original dial & buttons system. If one app provided that simplicity, radio would move smoothly to mobile along with every other medium already re-locating there. Stations would continue to operate on the AM and FM bands until doing so no longer made technical or economic sense. But the path would be clear.

The one company that might have made this easy is Apple; but Apple has never been interested in improving radio as we know it. For years it buried radio station streams in an iTunes directory most people didn’t know was there — and then created a Pandora competitor with iTunes Radio. Like Pandora, Apple calls its streams “stations,” which also fuzzes things. The old stream directory still exists, for what it’s worth, under “Music.”

So it’s up to app developers. TuneIn, WunderRadio and Stitcher are currently the big three (at least on my devices), but all of them bury local radio deep in directories that are annoying to navigate and often incomplete. For example, let’s say I want to navigate the “dial” for Boston while I’m here in New York. On TuneIn, I hit “Browse,” then “Local Radio,” then find myself in New York. Not Boston. Then I hit “By Location.” That gives me a map I can pinch toward a red pin on Boston, where I find a virtual dial in the form of a list. That’s less work than it used to be, back when TuneIn wanted me to drill down through a directory that started (as I recall) with “Continent.” But it’s also missing all the great discoveries I used to make in local radio elsewhere in the world, such as the UK. (There are red pins only for major cities there.) Over on Stitcher one hits “Live Radio,” then “Massachusetts,” then “Boston” to do the same kind of thing, but the directory is has just three minor AM stations, then a bunch of FMs, but not WEEI/93.7, my favorite sports talker there. Between WBOS/92.9 and WTKK/96.9 there is nothing. All three do offer search, but that’s not easy to do when you’re driving or walking. (Nor is any of the above.)

All of them also assume, correctly (as do Apple, Pandora, Spotify, LastFM and many others), that individuals would rather put together their own “stations” in the form of music types, program collections, or whatever.

Pure optionality is the Internet’s advantage over broadcast radio and TV. And that’s on both the supply and the demand side. (And how anybody can be on either side if they like.) There is no way old-fashioned one-way, top-down, coverage-limited broadcast can compete with that. But it can embrace it.

That’s why individuals being able to do what they want is both the threat and the promise of radio online. Bring back dial-like simplicity to the online world, marry it to “roll your own,” and you’ll have the holy grail of radio.

[December 2021 update] Check out Radio.Garden. It’s not exactly what I describe in that last paragraph, but it’s creative and fun.

A decent provision for the poor is the true test of civilization. — Samuel Johnson

Hart Island

Visitors to New York’s Orchard Beach (at the top of the photo above) probably don’t know that the low wooded island offshore will, at the current rate, contain a million buried human bodies, if it doesn’t already.

The site is Hart Island (aka Hart’s Island), and it is New York’s potter’s field: where the city’s “unclaimed and indigent” dead are buried.  It is the largest tax-funded cemetery in the world. Burial is done by inmates of the Department of Corrections, which also controls the island. Visitors are not welcome.

I knew nothing about Hart Island until I found myself looking at the picture I shot of the place, above, while seeking information about something else. Though bleak, the stories of the place are fascinating — and, it seemed to me, far too important to leave as far out on the margins of consciousness as they are of the City. So I compiled a list in a Fargo outline, which I’ve arranged below.

One item I’ll pull out of the list to start with is The Hart Island Project*, by Melinda Hunt (@hartisland) and a team of collaborators. Melinda has been leading a steady effort to open up the island to visitors and to humanize and modernize the records kept of persons buried there. Her constituency includes all who reside in what we might call the Mass Grave of the Barely-Known Outcasts — and too few of the living, so far. So dig:

[Nina Bernstein‘s Pulitzer-worthy New York Times series on Hart Island, added on October 12, 2016]:

In fact Hart Island is New York’s ninth Potter’s Field. Writes Melinda Hunt,

A few of these early potters fields remain in the public domain as smaller parcels of land now known as Madison Square Park (1794), Washington Square Park (1797), Bryant Park and the Public Library (1823). Except for the last potter’s field in Manhattan, located at the current Waldorf Astoria Hotel (1836), no records exist of the bodies being moved elsewhere. At all other sites, parks were created after the cemeteries, parade grounds, and the reservoir closed. Once the city expanded beyond 50th Street, the East River became a more convenient route for transporting the bodies. Potter’s fields opened briefly on Randalls Island (1843) and Wards Island (1846) before moving much further out to Hart Island.

It’s a haunting history. Another excerpt:

  The burial records show an ever-changing pool of immigrants, diseases and disabilities administered to by a range of institutions. It remains too mixed and varied to become the darling of any special interest group. Genealogists that I have spoken with claim that most families with immigrant roots in New York City probably have lost relatives buried on Hart Island. As one recently told me: “People come to me hoping to discover ‘nobility’ in their ancestry, but the missing people usually turn out to have had alcohol problems or mental illness and were buried in Potter’s Field.”

In New York City, the combined nine potter’s fields have close to one million burials. An immense amount of history is associated with these places. Yet, there is almost no academic or institutional interest in the public cemeteries. Most of the writing about Hart Island takes the form of journalism documenting specific events. Distinctive in these accounts is the unanswered question of why such a place continues to exist. Most other American cities cremate the unclaimed and unwanted. If burials are provided they are in more accessible places. Chicago has a potter’s field with mass graves as part of a private cemetery. New York City offers burial assistance to families who organize an application. Nonetheless, the burials continue to number two to three thousand a year. Even with the twenty-five year time limit, the northern 45 acres of Hart Island named Cemetery Hill is full. Current burials have moved to the shallow grounds south of the workhouses.

New York City has a long-standing policy of respecting diverse religious practices. Many religions do not permit cremation. Until recently Catholics buried on Hart Island were placed in separate “consecrated ground.” In 1913, “baby trenches” were separated from “adult trenches.” Starting in 1935, “catholic babies” had separate trenches from “regular babies.”

Incredible care and expense goes into conducting the burials. In 1990 the cost of flowers, tools, heavy equipment, parts to repair equipment, general maintenance equipment, fuel and inmate labor, at thirty-five cents per hour, drove the cost of each burial to $346. In addition, the city provides for free exhumation if family members claim a body within seven years of burial.

During the first fifty years of Hart Island burials, “unclaimed” people were buried in single graves. Only the “unwanted” whose relatives assigned them to a public burial were in mass graves. Today, all bodies are carefully organized into a grid. The ends of trenches are marked by a number pressed into a concrete block. Re-excavations require locating the designated body within this numbered scheme.

Perhaps it is the abstraction of human lives into trench numbers and statistics that is most disturbing about the potter’s field. I was impressed by the fact that the burial records from the nineteenth century contain full names, causes of death and countries of origin. In this century the names of babies up until 1940 are strictly female; each child’s identity is linked exclusively to the mother. She is the person forever associated with the potter’s field. After 1940, only surnames are listed. By 1955, the causes of death for children are uniformly listed as “confidential.” By 1970, the category “cause of death” is left blank. That the island is prohibitively difficult to visit adds another level of removal.

Then there is this, from Thomas Badhe, in a Common Place essay,” The Common Dust of Potter’s Field: New York City and its bodies politic, 1800-1860″:

The first Potter’s Field burial ground in New York City was located at the site of what would become the militia parade ground and city park at Washington Square. On this nine-and-a-half-acre plot, at the city’s pastoral northern edge, lay the densely packed corpses of about 125,000 “strangers,” many of whom had died during two separate yellow-fever epidemics between 1795 and 1803. Not surprisingly, local residents who had fled crowded lower Manhattan for country estates in the region came to find in Potter’s Field an intense nuisance. Whatever sympathy anyone had for the anonymous dead did not supersede wealthy New Yorkers’ sense of entitlement when it came to their comfortable insulation from the city’s darker side. In a letter to the Common Council, they wrote, “From the rapid Increase of Building that is daily taking place both in the suburbs of the City and the Grounds surrounding the field alluded to, it is certain that in the course of a few years the aforementioned field will be drawn within a precinct of the City.” Within the first two decades of the nineteenth century, their prediction had been realized, and the Potter’s Field began a lengthy series of migrations in a vain effort to stay a step ahead of the city’s relentless growth.

In 1823, the city moved Potter’s Field to an empty lot at the corner of Forty-ninth Street and Fourth Avenue—what would then have been the far northern reaches of the metropolis. This place served as the Potter’s Field until the 1840s when, as the city grew northward, it was relocated once again to Randall’s Island in the East River. Cast off the Island of Manhattan like so many family farms, Potter’s Field would no longer clash with the New Yorkers’ Victorian sensibilities or inhibit the Manhattan real-estate boom.

Just south of Randall’s Island, separated by a treacherous, narrow channel known as Little Hell’s Gate, was Ward’s Island, the site of another Potter’s Field in the mid-1850s. Both Randall’s and Ward’s Islands already housed other city institutions for the indigent, including the Emigrant Refuge and Hospital, the State Inebriate Asylum, the juvenile branch of the Almshouse Department, and the headquarters for the Society for the Reformation of Juvenile Delinquents. As one guide to New York and its benevolent institutions observed, “multitudes of persons went from the dram-shop to the police-station, and from the police courts to the Workhouse from whence, after a short stay, they returned to the dram shop . . . until they at length died on their hands as paupers or criminals, and were laid in the Potter’s Field.” For most of New York’s institutionalized underclass, there was literally a direct path from the door of the asylum or workhouse to the Potter’s Field.

Relocating the city’s cemetery from Manhattan’s urban grid to an island in the East River did not put an end to the city’s problem with the indigent dead. In 1849, the Daily Tribune reported on the political and legal wrangling between the governors of the Almshouse and the Common Council (the nineteenth-century name for the City Council), the former seeking to wrest authority over Potter’s Field from the latter. The governors cited the poor management of the paupers’ burial ground, which the Tribune referred to as “that den of abominations,” as evidence that the Common Council was unable to manage the Potter’s Field. “We do sincerely trust somebody will shoulder the responsibility of the Potter’s Field,” the Tribune pleaded, “and rid the Island of the abomination before the advent of another warm and perhaps an epidemic season.”

The Common Council and the Governors of the Almshouse traded letters, pleas, and vitriol for the better part of a decade. In May of 1851, the Governors warned the Common Council that, “the land now appropriated [for the Potter’s Field] is now nearly full, and the small space left for further interment (which now average upwards of one hundred per week), renders prompt action necessary.” Four years later, it was still unclear who had control over the Potter’s Field, and conditions were worsening. By this time, there were two burial grounds for paupers: the primary site on Randall’s Island and a smaller one on Ward’s Island to the south. The Board of Governors proposed to expand the Ward’s Island site in 1854, and the Times supported the proposition, suggesting that “it is time that the remains of paupers were interred in some quarter better fitted for their last resting-place than the one now used on Randall’s Island.” In their reports to the Board of Health and the Common Council, the Governors of the Almshouse urged that, “humanity, a due regard for the living, and a sense of proper respect for the dead” be part of any effort “to remedy the existing and impending evils.”

In the meantime, the disinterment of bodies at the old site on Fourth Avenue aroused its own controversy. In 1851, a plan was adopted by the Common Council to expand Forty-ninth Street through the old Potter’s Field, which required the disinterment of thousands of bodies. This project stretched on for nearly the entire decade, accompanied by foot-dragging and corrupt contractors. Commenting on the enormity of the project, the Times reported in the spring of 1853 that “the City Authorities are cutting a street through the old Potter’s Field . . . where so many victims of the Cholera were hurriedly interred in 1832. The coffins were then, in many instances, stacked one upon another; and now, in digging through the hill, the remains of twenty coffins may be seen thus piled together.”

As with the active Potter’s Field, the old paupers’ burial ground aroused no small amount of controversy. In the summer of 1858, the Timesagain reported on the work, claiming that “within three weeks past about 3,000 skeletons have been exhumed from the old Potter’s Field . . . and removed to Ward’s Island.” The winter of 1858-59 passed without any further exhumation, and “meantime the thin layer of earth which covered some hundred half-decayed coffins has fallen away, and . . . crowds of urchins assemble there daily and play with the bones of the dead; troops of hungry dogs prowl about the grounds and carry off skulls and detached parts of human bodies.”

Many of the old potter’s fields became parks. Washington Square is said to have twenty thousand bodies beneath it. Yet today it seems no more haunted than is Paris by its Catacombes, which I visited and wrote about three years ago, and which contains a population of dead that outnumber the city’s live citizens. The real haunting, I believe, is within our culture and its institutions. On that I’ll give Thomas Badhe the last words:

Having strolled through the rural cemeteries, we can better appreciate why the piles of moldering coffins exposed to the public in the 1850s caused New Yorkers to question their city’s claims to “civilization.” But the Potter’s Field was not only the antithesis of the rural-cemetery ideal (as well as a failure of municipal administration); it was also a site of spiritual death, obliterated social identity, and the graveyard of vice. If, as one proponent of rural cemeteries claimed in 1831, “the grave hath a voice of eloquence,” the Potter’s Field spoke in a dark chorus about the failures of democracy and civilization, the stark and messy exigencies of urban inequality, and thousands of individual lives wrecked on the shores of the great metropolis.

* The Hart Island Project is now a beautifully built website featuring the means to look up people buried there, and to tell their stories. Highly recommended.

Save

Last Saturday evening I was walking up Wadsworth Avenue in Manhattan, a few blocks north of 181st Street, when I passed a group of people sitting sitting on the steps of an apartment building. They were talking, drinking, eating snacks and listening to a boom box set to 94.9FM. A disc jockey chattered in Spanish, followed by music. I noticed the frequency because I’m a lifelong radio guy, and I know there isn’t a licensed station on that channel in New York. The closest is WNSH, called “Nash,” a country-music station in Newark, on 94.7. Given the disc jockey and what little I heard of the sound of 94.9, I was sure the station was a pirate and not just somebody with one of those short-range transmitters you can jack into a phone or a pad.

Before I started hanging at this end of Manhattan I thought the pirate radio game was up. After all, that was the clear message behind these stories:

But where I mostly hang is a Manhattan apartment that is highly shadowed from FM signals coming from the Empire State Building and 4 Times Square downtown. (That’s where all New York’s main licensed stations radiate from.) Between those transmitters and our low-floor apartment are about a hundred blocks of apartment buildings. Meanwhile, our angle to the North and East (toward The Bronx both ways) is a bit less obstructed. From here I get pirate signals on all these channels:

  • 88.1
  • 88.7
  • 89.3
  • 89.7
  • 91.3
  • 94.5
  • 94.9
  • 959
  • 98.1
  • 98.9
  • 99.7
  • 102.3
  • 103.3
  • 104.7 (Same as the busted one? Sounds like it.)
  • 105.5

I can tell most are pirates because they tend to disappear in the morning. Nearly all are in Spanish and most play varieties of Caribbean music. (Which I wish I could understand what the disc jockeys say, but I don’t.)

As for 94.9, here’s how it looks on the display of the Teac 100 HD radio in our kitchen:

Estacion Rika

RDBS is the standard used for displaying information about a station.  The longer scroll across the bottom says “OTRA ESTACION RIKA.” Looking around a bit on the Web for that, I found this page, which says (among much else) “La administración de Rika 94.5 FM  Rikafm.com)…” So I went to RikaFM.com, where a graphic at the top of the page says “‘FCC Part 15 Radio Station’.” Part 15 is what those tiny transmitters for your mobile device have to obey. It’s an FCC rule on interference that limits the range of unlicensed transmissions to a few feet, not a few miles. So clearly this is a claim, not a fact. I’ve listened in the car as well, and the signal is pretty strong. Other links at RikaFM go to its Facebook and Twitter pages. The latter says “3ra Radio en la cuidad de New York Rika fm una estacion con talentos joven cubriendo toda la ciudad de NY musica variada 24hrs.,” which Google Chrome translates to “The 3rd Radio in the city of New York RikaFM a station with young talents covering all the varied music NYC 24hrs.”

To me this phenomenon is radio at its best. I hope somebody fluent in Spanish and hip to Caribbean music and culture will come up here and study the phenomenon a bit more closely. Because the mainstream media (thus far — consider this a shout-out, @VivianYee 🙂 ) is just coving a few minutes of the authorities’ losing game of whack-a-mole.

JP Rangaswami, in On not collaborating:

Ignore. Ridicule. Fight. Lose. That’s what happens to the institutions that seek to preserve the problems for which they were created.

So it is with collaboration. We’ve heard the word many times. And we’ve seen it paid lip service many times. But so long as it was not centre-stage, the immune system didn’t care.

Now things are changing. Studies are coming out indicating that networked organisations don’t work, that command and control is needed. That open-plan doesn’t work, we need cubicles with high walls. That too much collaboration can cause problems.

All that says to me is that the immune system is switching from ignore and ridicule to fight.

Which means that not collaborating will soon come to an end.

A corollary is John Gillmore‘s “The Net interprets censorship as damage and routes around it.” The Net is, at its heart, a system of collaboration.

In this comment and this one under my last post, Ian Falconer brings up a bunch of interesting points, some of which are summarized by these paragraphs from his first comment…

Here in the UK most people over 40 will remember placing calls via a human operator. A real life person who had a direct interaction with both caller and receiver when reversing the call charges. In smaller towns and villages this meant that the operator knew who was phoning who, when and often, given their overarching view, could assume why.

This was socially accepted as the operators were usually local and subject to the same social norms as the friends and neighbors they ‘surveilled’.

But they were also employees of the GPO (General Post Office) with a national security obligation and had a direct reporting route into the national security apparatus, so that, if they felt that something fishy was afoot (especially in times of war), they were assumed to be both reliable and honest witnesses.

No-one assumed secrecy in an operator-mediated system. They assumed discretion on the part of the operator.

Is an ISP any different just because the data is package-based rather than analogue ? It conducts all the same functions as the old operator.

The shift from public ownership to private and from land-lines to mobile has not changed the underlying model of presumed access (as far as teleco users are concerned) and assumed responsibility (on the part of the national security apparatus). And though both are now legally defined under the license terms of privatised telecos, few of the UK’s public know how their comms systems actually work, so often assume a similar design ethos to the US, where constitutionally defined rights are a starting point for systems organisation.

That British Telecom evolved from the GPO is no accident, but neither is it necessarily a designed progression intend on increased surveillance.

… and these from his second:

Against most evidence US Congress doesn’t set UK law. The EU & UK governments do that. And against most evidence the US doesn’t set global social norms. So while I’m not saying Brits explicitly like spies and respect code breakers, there is a history here that forms a backdrop to the national mind set and it looks towards Bletchley Park, Alan Turing & James Bond rather than The Stasi, Senator McCarthey or Hoover’s G-Men.

The time and place to look for a failure of oversight is the sale of rights to spectrum access but a global technological fix for a perceived lack of communicational security, especially a US-led one, seems unlikely. The righteous indignation with respect to Huwei hardware looks like a starting point rather than an end point right now.

To me these events and discoveries more likely to work to fragment the rough and ready constellation of networks into national gardens once more. This would force comms through regulated conduits making in-out surveillance even easier and I tentatively suggest that in the legislation of whatever-comes-next those carrying out oversight do a better job, if legally-enshrined privacy is their aim.

I am somewhat familiar with the UK, having spent a number of years consulting BT. I have also spent a lot of time in the EU, mostly studying and collaborating with VRM developers, a large percentage of which are located in the UK and France.

Here in the U.S. many of us (me included) still had “party lines” and required operator assistance for long-distance calls as recently as the mid-’70s. With party lines phone connections were shared by as many as six other homes, and people could listen in on each other easily. Operators could listen to anything, any time. Thus, as Ian says, discretion rather than secrecy was assumed.

And discretion is The Thing. As it was with the old phone system it also was with spying, which every government does, and we have always assumed was going on — much of it outside the laws that apply to the rest of us — and hopefully for some greater good. Thus whatever we end up with on the Internet will rest on a system of manners and not just of laws and technologies.

Ideally law, technology and manners work in harmony and support each other. What we have had so far, in the era that began with personal computing and grew to include the Internet and smart mobile devices, has been a disharmonious cacophony caused by technology development and adoption with little regard for the incumbent systems of manners and law. And it is still early in the evolution of all three toward working harmony such as we have long experienced in the physical world.

Of those three, however, manners matter most. It seems no accident, to me at least, that the Internet is defined by protocols, which are nothing more than mannerly agreements between network operators and among the human and organizational operators of the network’s billions of end points.

Security of the telco-like centralized locked-down sort was never in the DNA of the Internet Protocol, which is one reason why it never would have been invented by the very companies and governments through whose local, national and international networks the Internet connects us all.

So it should be no surprise, aside from all the privacy concerns currently on the front burner of popular consciousness, that telcos, cablecos, national governments and institutions such as the ITU have busied themselves with stuffing the Internet, in pieces, back inside the regulatory, billing and nationally bordered bottles from which it more or less escaped, at first un-noticed, in the 1980s and early 1990s.

J.P. Rangaswami, when he was at BT, famously noted that a telco’s main competency was not communications but billing. It still is. China’s censored national subset of the world wide Internet is for many countries a model rather than an aberration. And the drift of Net usage to cellular mobile devices and networks has re-acclaimated users to isolated operation within national borders (lest they suffer “bill shock” when they “roam” outside their country) — something the landline-based Internet overcame by design.

All these things play into our evolution toward privacy in the virtual world that is recognizably similar to what we have long experienced in the physical one.

National mind sets are important, because those embody manners too. Public surveillance is far more present, and trusted, in the U.K. than in the U.S. I also sense a more elevated (and perhaps evolved) comprehension of privacy (as, for example, “the right to be left alone”) in Europe than in the U.S. I am often reminded, in Europe, of the consequences of detailed records being kept of citizens’ ethnicities when WWII broke out. Memories of WWII are much different in the U.S. We lost many soldiers in that war, and took in many refugees. But it was not fought on our soil.

There is also in Europe a strong sense that business and government should operate in symbiosis. Here in the U.S., business and government are now posed in popular consciousness (especially on the political and religious right) as opposing forces.

But all these things are just factors of our time. What matters most is that the whole world will need to come to new terms with the three things I listed in my earlier Thoughts on Privacy post: 1) ubiquitous computing power, 2) ubiquitous Internet access, and 3) the unlimited ability to observe, copy and store data. All these capacities are new to human experience, and we have hardly begun to deal with what they mean for civilization.

I suspect that only the generation that has grown up connected — those under, say, the age of 25 — begin to fully comprehend what these new states of being are all about. I’ve been young for a long time (I’m 66 now), but the best I can do is observe in wonder those people who (in Bob Frankston‘s words) assume connectivity as a natural state of being. My 16-year old son feels this state, in his bones, to a degree neither I nor my 40-something kids don’t. To us elders, connectivity is an exceptional grace rather than a natural state.

Manners among the connected young, however, have barely evolved past the reptile stage. In Report: Every Potential 2040 President Already Unelectable Due To Facebook, The Onion was not fully joking (it never is) when it said “A troubling report finds that by 2040 every presidential candidate will be unelectable to political office due to their embarrassing Facebook posts.”

I just hope that the laws we are making today (protecting yesterday from last Thursday, as all new laws tend to do) will be improved by new generations made wiser by their experiences with technologies made ubiquitous by their elders.

On February 25, 2008, the FCC held a hearing on network management practices in the Ames Courtroom at Harvard Law Schoolhosted by the Berkman Center. In that hearing David P. Reed, one of the Internet’s founding scientists, used a plain envelope to explain how the Internet worked, and why it is wrong for anybody other than intended recipients to look inside the contents of the virtual envelopes in which communications are sent over the Internet. It was a pivotal moment in the debate, because the metaphor illustrated clearly how the Internet was designed to respect privacy.

Respect, that is. Not protect.

In the early days of postal communications, the flaps of envelopes were sealed with blobs of wax, usually imprinted by the sender with a symbol. These expressed the intent of the sender — that the contents of the letter were for the eyes of the recipient only. Yes, a letter could be opened without breaking the seal, but not without violating the wishes of the sender.

The other day I wrote, “clothing, for example, is a privacy technology. So are walls, doors, windows and shades.” In the physical world we respect the intentions behind those technologies as well, even though it might be easy to pull open the shirts of strangers, or to open closed doors without knocking on them.

The virtual world is far less civilized. Proof of that is in the pudding of privacy rights violations by agencies of the U.S. government, which is clearly acting at variance with the Fourth Amendment of the Constitution, which says,

The right of the people to be secure in their persons, houses, papers, and effects, against unreasonable searches and seizures, shall not be violated, and no Warrants shall issue, but upon probable cause, supported by Oath or affirmation, and particularly describing the place to be searched, and the persons or things to be seized.

I see three ways to approach these violations.

One is to rely on geeks and whistleblowers to pull the pants down on violators. In Welcome to the end of secrecy says the very openness that invites privacy violations is our best protection against the secrecy concealing those violations.

Another is through the exercise of law. In The Only Way to Restore Trust in the NSA, security guru Bruce Schneier writes, “The public has no faith left in the intelligence community or what the president says about it. A strong, independent special prosecutor needs to clean up the mess.” And that’s on top of moves already being made by legislators, for example in South Africa. Given the scale of the offenses now coming to light, we’ll see a lot more of that, even if no special prosecutors get appointed. The law of the jungle will give way to a jungle of new laws. Count on it.

The third is through business — specifically, business modeled on postal services. For many generations, postal services have respected the closed envelope as a matter of course. Yes, we knew there were times and places when mail could be inspected for legitimate reasons. And there were also many things it was not legal to do, or to send, through postal systems. But, on the whole, we could trust them to keep our private communications private. And we paid for the service.

The Googles of the world — companies making their money on advertising — aren’t likely to take the lead here, because they have too much invested in surveillance (of the legal sort) already. But others will step forward. The market for privacy is clear and obvious, and will only become more so as the revelations of abuse continue to pour out.

Perhaps the businesses best positioned to offer secure communications are the postal services themselves. They’ve already been disrupted plenty. Maybe now is the time for them to do some positive disruption themselves.

 

 

« Older entries § Newer entries »