infrastructure

You are currently browsing the archive for the infrastructure category.

So I shot a bunch of pictures of Niagara Falls from 35,000 above, on a trip last week from San Francisco to Boston. Click on the pic for the whole set.

Interesting to think that the falls are only about ten thousand years old. A blink in geologic time.

Tags: , , , , , , , , , , , , , , , , , ,

In a meeting yesterday, somebody on the IRC shared links to “Re-identification of home addresses from spatial locations anonymized by Gaussian skew” and “Bregman divergences in the (m x k)-partitioning problem“, from Science Digest. Sez the abstract of the latter,

A method of fixed cardinality partition is examined. This methodology can be applied on many problems, such as the confidentiality protection, in which the protection of confidential information has to be ensured, while preserving the information content of the data. The basic feature of the technique is to aggregate the data into m groups of small fixed size k, by minimizing Bregman divergences. It is shown that, in the case of non-uniform probability measures the groups of the optimal solution are not necessarily separated by hyperplanes, while with uniform they are. After the creation of an initial partition on a real data-set, an algorithm, based on two different Bregman divergences, is proposed and applied. This methodology provides us with a very fast and efficient tool to construct a near-optimum partition for the (m×k)-partitioning problem.

Keywords: Confidentiality; Data masking; Fixed cardinality partitioning; Fixed size micro-aggregation; Bregman divergences; Pythagorean property; Convex partition

What’s extra wacky is that I actually spent time diving into this stuff, even though it’s about forty thousand leagues over my head. Still, it was fun trying to remember all that math I barely learned too long ago.

As I recall, the highest grade I ever got in high school math was a C. That was in Geometry. (Hey, I’m a visual guy.) The only math course I took in college was Statistics. The teacher and I couldn’t stand each other, and I dropped out, or thought I did. Turns out I was too late doing that and the guy gave me an F.

But I kept the book, which served me well years later when I was studying Arbitron’s ratings for radio stations. To my surprise, I actually liked the subject, and used what I learned from the book to develop algorithms for factoring out seasonal variations in station AQH (average quarter hour) shares, to aid in predicting which stations would do what in the next “book”. In addition to racking up billable hours for my company, and helping our client station sell advertising, I was able to win bets with friends in the radio business.

The biggest bet of all was that WFXC, the station with the weakest signal in the Raleigh-Durham metro, would kick ass in the first book after its programming went “urban” (that’s radio talk for “black”). The math was easy. The market was about 40% black, and no other FM stations addressed that population.

I won. Foxy was #1 in its first book. (And it’s still doing well, 2+ decades later.)

As it happens, WFXC “Foxy 107” (a name I suggested to the owners before they picked the call letters, though I don’t know if I was the first to come up with that) was consulted at the time by Dean Landsman, whom I didn’t know at the time. We became good friends years later when we both haunted the late Compuserve’s late Broadcast Professionals Forum, which was run by Mary Lu Wehmeier, now a friend as well. She was the “Sysop” for that forum, where I occasionally came off the bench to help. Running the Sysop Forum was Jonathan Zittrain, who later helped found the Berkman Center, and now stars as a professor at Harvard Law School. Making things even more circular, Dean is now a valuable and diligent contributor to ProjectVRM. Dean, a closet math whiz, made a living for many years doing in-depth work around radio station ratings. I’ll be he knows, or could puzzle out, the quoted text at the top of this post.

By the way, my nickname is the fossil remnant of a radio persona called “Doctor Dave”, featured on WDBS, the prior incarnation of WFXC, which is still around (now with a somewhat better transmitter, and a second and much larger signal on another channel, covering the east side of the market). When I was there, in the mid-’70s, WDBS was owned by Duke University and had awful ratings to go with its awful signal. But it was a great little station. Still friends with folks from those days too.

Ah, I found the picture I was looking for, now at the top of this post. That was the WDBS staff in 1975, I’m guessing. I’m the guy with the wide tie and the narrow shoulders in the back row. There are many missing folks too. I’d love to follow this digressive path, but have too much work to do. At least I’ve left plenty of link and tag bait. 🙂

Tags: , , , , , , , , , , , , , ,

Me too. Which brings up the subject of this post here.

Tags: , , ,

The soft white silence is settling outside on a cold winter mornng. I’m guessing about two inches so far, atop the eight or so that remain from last week’s storm.

The above is from Intellicast, my fave new online weather toy.

Talked to a friend in San Diego last night. He was taking a break from playing tennis. Back home in Santa Barbara, it’s been in the 80s lately. At one point a couple days ago, the temperature difference between there and here was close to 80 degrees.

Still, this is a kind of loveliness I grew up with. There’s still a 10 year old inside me who sees this and wants to go outside, go sledding down the hill, build snow forts and not do a damn thing that isn’t fun.

Tags: , , , , , , , , ,

Afterposts on (more popularly, just )…

Bio of the pilot, Chesley B. Sullenberger, aka “Sully”, the captain of flight USA1549 yesterday afternoon. Via TheSmokingGun.

Charles Bremer, pilot and editor for the London Times, on the flight. Includes interesting background, such as why Airbuses can float “in the unlikely event of a water landing”. Expect Boeing planes to be fitted retrofitted soon with the same feature. Hat tip to Andrew Leyden for that one. (Note: This comment says I have my facts wrong here, and offers corrective details. Interesting stuff. Go read it.)

Airbus 320 fact sheet. Includes interesting safety record info.

Sully’s Facebook fan page.

Nice series of photos and a graphic from one commenter on this FlightAware discussion page.

Barack Obama wants to wait on the DTV shift currently scheduled for 17 February. On the grounds that it’ll be a mess, this is a good idea. But nothing can make it a better idea. It’s not that the train has left the station. It’s that the new OTA (over the air) Oz is mostly built-out and it’s going to fail. Not totally, but in enough ways to bring huge piles of opprobrium down on the FCC, which has been rationalizing this thing for years.

I explain why in What happens when TV’s mainframe era ends next February?. Most VHF stations moving to UHF will have sharply reduced coverage. The converter shortage is just a red herring. The real problem is signals that won’t be there.

Most cable customers won’t be affected. But even cable offerings are based on over-the-air coverage assumptions. Those may stay the same, but the facts of coverage will not. In most cases coverage will shrink.

FCC maps (more here and here) paint an optimistic picture. But they are based on assumptions that are also overly optimistic, to say the least. Wilimington, NC was chosen as a demonstration market. Bad idea. One of the biggest stations there, WECT, suffers huge losses of coverage.

Anyway, it’s gonna be FUBAR in any case.

Tags: , , , , , , , , ,

Lots of folks in China get around the Great Chinese Firewall by using circumvention tools. But at what risk? That’s one of the biggest questions raised by Hal Roberts in this post here.

Seems the Global Internet Freedom Consortium, or GIFC, which offers this laudable PR…

… is also selling users up who-knows-what rivers. At least that’s what Hal finds when he checks the FAQ at the Edoors Ranking Service, which lets you browse the “top anti-censorship sites”. The FAQ begins,

Q: Who is the owner of this service?
A: This service was developed by World’s Gate, Inc. with help from other Global Internet Freedom Consortium (GIFC) partners.

Q: Where did you get the raw data for the analysis?
A: The raw data came from the server log of GIFC member companies. Right now, data from three of the five tools of GIFC (DynaWeb, GPass, and FirePhoenix) are included for analysis.

Which sounds okay, so long as the data used is of the aggregate sort. In other words, as long as it’s not personal.

Alas, there is this smoking gun, pointed right at the heads of DynaWeb, GPass and FirePhoenix users:

Q: I am interested in more detailed and in-depth visit data. Are they available?
A: Yes, we can generate custom reports that cover different levels of details for your purposes, based on a fee. But data that can be used to identify a specific user are considered confidential and not shared with third parties unless you pass our strict screening test. Please contact us if you have such a need.

That means they track browsing data of individual users, and sell it. Hal adds,

…the data about circumventing users is much more sensitive than the data about most ISP users. These are the histories of users browsing sites that are not only blocked (and therefore mostly sensitive in one way or another) but blocked by an authoritarian country with an active policy and practice of persecuting dissidents. The mere act of anyone, let alone projects proclaiming themselves for internet freedom, storing this data is very bad practice. Any data that is stored can be potentially be shared or stolen. The best way to make sure that dangerous data like this does not get into the wrong hands is not to store it in the first place.

But these projects are not only storing the data. They are actively offering to sell it. None of the projects has anything like a privacy policy that I can find, and none of them provides any notice anywhere on the site or during the installation process that the project will be tracking and selling user browsing activity.* But all of the sites have deceptive language…

I’m sure what these companies are after is advertising money from companies wanting to “target” individuals personally. That’s what it smells like to me.

We live in a time when personalized advertising is legitimized on the supply side. (It has no demand side, other than the media who get paid to place it.) Worse, there’s a kind of gold rush going on. Even in a crapped economy, a torrent of money is flowing into online advertising of all kinds, including the “personalized” sort. No surprise that companies in the business of fighting great evils rationalize the committing of lesser ones. I’m sure they do it it the usual way: It’s just advertsing! And it’s personalized, so it’s good for you!

Ah, but what happens if one of those advertisers is a front for the Chinese governent, looking for dissidents to jail — or worse? If you’re one of those (or anybody) would you trust the “strict screening test” at Edoors Ranking Service?’

Me either.

Tags: , ,

Most books come and go. Others stay — meaning that you’re likely to find them in most bookstores. Big ones, anyway. Quotable books have staying power. Especially the quotable ones that express unattainable ideals.

The Cluetrain Manifesto, it turns out, is one of those. The book hit the streets in January 2000, just in time, somebody said, to cause the dot-com crash. (I’d like to say we intended that, but if it were true I would have sold my dot-com stocks, which I didn’t. Instead I waited until their purpose in selling was reduction on captial gains for selling a house. This was back when houses could still be sold.)

I’m a born optimist, so I did expect Cluetrain to sell well. I just didn’t expect it to keep selling ten years after we first nailed up its 95 Theses on the Web. Nor did I expect writers to keep writing about it. But they have. And they do. More, it seems, than ever.

The most remarkable of the current crop is Alex Hillman’s Cluetrain-A-Day 2009, at his blog, Dangerously Awesome. His latest unpacks Thesis #5, People recognize each other as such from the sound of this voice. (Context: this thesis follows #3 Conversations among human beings sound human. They are conducted in a human voice and #4 Whether delivering information, opinions, perspectives, dissenting arguments or humorous asides, the human voice is typically open, natural, uncontrived.) In the post Alex answers a question that too often flummoxes me: “Name one good example of Cluetrain’s lessons put to work.” Alex offers Zappos:

Tony Hsieh (pronounced “Shay”) is the proverbial “Tweeting CEO”. Beyond Tony himself being extraordinarily accessible and candid about his life and his business on Twitter, he’s gone one step further. He’s encouraged his employees to tweet, too. And not just about business stuff, but about whatever they want. Whatever they are thinking. Whatever they are doing. It’s up to them.

But Zappos didn’t stop there.

Zappos built a website that consumes all of their employees’ tweets and republishes them. A megaphone for the collective voice of Zappos employees, in real time, for anyone to read.

But Zappos didn’t stop there.

Zappos also runs a blog network within their company, with contributions from the CEO and COO, all the way through the depths of the company. These blogs share not just company news, but insights, event announcements, musings, and more. They rarely link back into their product catalog. Instead, Zappos uses these opportunities to provide value, and establish natual dialogue between their customers and their employees.

Why? Because people are interested in other people. We recognize the human voice in others, and identify with them. Companies are not human, so we humans do not identify with their voice. But if the voices within the company, the human voices, are allowed to shine, customers can once again identify with “the company”.

Rather than have an ivory tower with now windows or doors, Zappos purposely put not just one human face on their company, but hundreds (435 at the date of writing this). What are the odds of calling in an order or customer service request to Zappos and getting a twittering CSR? Reasonably high. And that’s the Zappos way. Tony explains that Zappos culture, the collective voice of Zappos, is Zappos brand.

I couldn’t have said it better myself. More importantly, I wouldn‘t have, because I’m not engaged with the marketing market the way Alex is. He’s reforming it from the inside. I left the field a long time ago. Now I cheer star performers like Alex from the stands.

Nine years ago most responses to Cluetrain were of the thumbs up or down sort. Few offered constructive follow-ups, mostly because what one could do was pretty limited. We knew we weren’t in Kansas anymore, but Oz wasn’t built out. There weren’t even witches or munchkins. Just a scattering of yellow bricks and a wide-open landscape. Nevada without Las Vegas.

Blogs were around, but still new. In fact, Dave Winer urged me mightily to start a blog during the whole summer of ’99 when we were busy writing the book. But I didn’t relent until that Fall, when he literally sat me down and got me going with what became this blog here. Ev Williams started Blogger around that time too. Twitter (another Ev creation… lightning does sometimes strike twice, or more) came along much later. That’s why we have truly constructive Cluetrain-sourcing posts like this one by Michael Stephens, who thinks out loud, and eloquently, about libraries in an age when they are surrounded and suffused by the Net and a growing box of tools in the hands of readers.

Now here’s a fired reporter for (and now against) the Danville Register & Bee, sourcing Cluetrain in a schooling of the paper’s management.

And here’s Mirek Sopek , who blogs as the CEO of a business, saying,

This book is compulsory reading for all sales people in my company ….

See the citation:

“Although a system may cease to exist in the legal sense or as a structure of power, its values (or anti-values), its philosophy, its teachings remain in us. They rule our thinking, our conduct, our attitude to others.

The situation is a demonic paradox: we have toppled the system but we still carry its genes. “

Ryszard Kapuscinski, Polish journalist, 1991

Exactly. That’s why it’s so hard to change, or even to understand change when it happens anyway. For example, many of us can say we support “Net Neutrality”, but it’s almost impossible to talk aobut it without bringing in the faming and language of telcos. Laudable as Net Neutrality may be, few of us have ever experienced it. (Most “broadband” — a telco term — is not “neutral”. It is skewed to favor some uses and discourage others.) Imagine talking about the Net in, say, 1985. “Um, it’s like AOL or Compuserve, but nobody owns it, everybody can use it and anybody can improve it.” Or consider Richard Stallman‘s persistent need to explain free-as-in-freedom vs. “free-as-in-beer.” Some concepts take time to sink in, mostly because they require successful implementation, and then understanding of that success on its own terms. In the meantime, it’s explained in terms other than its own. Such is the case with both free software and Net Neutrality. In time both will be both established and well understood. (Though, speaking for myself, I think free software was better explained in the first place than Net Neutrality, but … whatever.)

Anyway, it’s all one big learning process. We educate each other.

I was just listening to this Utah Couchcast, for example. At the beginning one of the hosts suggests that Cluetrain is cyclical, coming along in booms — because Cluetrain was written during a boom. But this made me think about what seems to be a surge of recent interest in Cluetrain during a bust cycle. When we look back at Cluetrain’s success as a book, most of it came during the dot-com crash of 2000-2001.

Which brings us to the long view — something older people tend to have. (And that’s coming to include Cluetrain’s authors, two of whom have hit their sixties.) Cluetrain was diagnostic rather than prescriptive. This was intentional. One reason was time: we needed to get the book out on a tight deadline. Another was the plain and sad fact that the tools required for the revolution were not there. Some, such as blogging, were beginning to appear. But even there, syndication (another innovation by Dave) was not yet part of it. Nor was podcasting. Nor was “the cloud” of back-end services now only beginning to become widely used.

Cluetrain gets a lot of credit today for ushering in “social” stuff. That’s cool, but let’s face it: today’s “social” tools are still crude. All are miles away from whatever end states they’ll eventually reach, probably by evolving so far that they barely resemble the ancestors we use today.

All this, by the way, is a not-quick-enough brain dump as I work on a longer Cluetrain piece for print publication. Right now Google Blogsearch finds more than 50,000 results for a “cluetrain” search. Many, like the ones cited above, are too damned interesting. Collectively, they know far more about the subject than its authors, mostly because so many folks are putting Cluetrain to use somehow. In real estate, for example.

I could go on, but I have actual work to do.

Tags: ,

So now my dream app is ready on the iPhone. It’s just the beginning of What It Will Be, but it’s highly useful. If you have an iPhone, go there and check it out. It’s free.

As you see here, I’m involved, through the Berkman Center, which is collaborating with , which is working under a grant from the Corporation for Public Broadcasting (). Major props go to the PRX developers, who have been working very very hard on this thing. Some of the most diligent heads-down programming I’ve seen.

An interesting thing. In the old days, when an app came out, in any form, on nearly any platform, there was this assumption that it was a Done Thing, and should be critiqued on those grounds. Not the case here. This is a work in progress, and the process is open. In the long run, we should see much more opened up as well.

Paranthetically, I think right now we’re looking at some cognitive dissonance between the Static Web and the Live Web, when the latter seems to look like the former. You have a website, or an app. These seem to be static things, even when they’re live. An app like the Public Radio Tuner is more of a live than a static thing. But it’s easy, as a user, to relate to it as a static thing. Because at any one time it does have more static qualities than live ones. Imagine a house you can remodel easily and often, and at low cost and inconvenience. That’s kind of what we have here. A cross between product and process — that looks the former even when it’s doing the latter. Anyway…

Though this grant is for an iTunes app, work is sure to go on to other platforms as well — such as Android. So, rather than criticize this app for coming out first on the iPhone, please provide feedback and guidance for next steps beyond this first effort (and join me in giving the developers a high five for delivering a functional app in a remarkably short time). And in the reviews section at iTunes, provide honest and constructive reviews. At this stage I’m sure they’ll be good. (Some of the bad reviews were on the very first version released, which has since been replaced.)

To VRM followers and community members, VRM is very much on the agenda, and we’re thinking and working hard on what the VRM pieces of this will be, and how they’ll work. This may be the first piece of work where VRM components appear, and we want to do them right. Also bear in mind that this is the first step on a long, interesting and fruitful path. Or many paths. Interest and guidance is welcome there too.

Tags:

Since I’m an aviation freak, I’m also a weather freak. I remember committing to getting my first color TV, back in the mid-70s, because I wanted to see color radar, which at that time was carried by only one TV station we could get from Chapel Hill: WFMY/Channel 2 in Greensboro. These days TV stations get their radar from elsewhere, and have mothballed their old radar facilities. (Here’s one mothballed TV radar tower, at the WLNE/Channel 6 transmitter, which is istself doomed to get mothballed after the nationwide February 17 switchover to digital TV — marking the end of TV’s Mainframe Era.)

Online I’ve been a devoted watcher of both Weather.com and Weather Underground. Both those last two links go to local (Cambridge, MA) maps. They’re good, but they don’t quite match Intellicast, source of the map above. Play around witht the pan & zoom, the animation and the rest of it. It’s a nice distraction from weather as ugly as we’re getting right now here: sleet and then rain atop enough snow to cancel school today,.

Tags: , , , , , ,

« Older entries § Newer entries »