Wednesday, December 30, 2009

Avatar is Awesome!

With all the awesome effects I was worried that the story might have floated off like one of the mountains in the movie -- however Cameron knocks it out of the park by providing a solid and emotionally compelling story that touches on humanity and forgiveness over greed and destruction.

The technology allowing the actors to transfer their performance to their synthetic counterparts is amazing. In that respect, this movie reminded me of Jurassic Park -- on one level you're talking about genetically engineering dinosaurs -- but on another, they really created compelling animated dinosaurs!

Well, in the same way, Avatar shows people transferring consciousness to synthetic alien/human hybrids, but on another level, Cameron really developed the technology to transfer the actor's "consciousness" -- their performance to the CGI models. Like Jurassic Park, that's nothing short of amazing.

Tuesday, December 1, 2009

ontological paradox...

Noticing today's RocketBoom on the Ontological Paradox made me start musing about one of the examples, specifically:
On his 30th birthday, a man who wishes to build a time machine is visited by a future version of himself. This future self explains to him that he should not worry about designing the time machine, as he has done it in the future. The man receives the schematics from his future self and starts building the time machine. Time passes until he finally completes the time machine. He then uses it to travel back in time to his 30th birthday, where he gives the schematics to his past self, closing the loop. Of course, the schematics must have come from somewhere.
There might be a simple way around the problem of where the information comes from if you accept the "many-worlds" interpretation of quantum mechanics:
  • Let M be the multiverse, or the set of all universes.
  • Let u be a universe in M where the man successfully develops the time machine on his own.
  • All he has to do is find any other universe u' in M such that the current time in u' is equal to a previous time in u (i.e. 30 years ago).
  • If, technically, he travels across universes from u to u' (as opposed to really traveling in time in his own universe) then the information (the plans) really come from u, not u', so there is no spontaneous generation of information.
  • The fact that the plans generate a "time" machine which allows the loop to "close" is completely accidental since "time" travel would in reality continually travel to another universe (e.g. once in u', he would need to find a u'', etc.)
  • Also, because he is traveling between different universes (as opposed to traveling backwards in time) he doesn't break any known laws of physics.
There are some problems with this way of thinking about things though...

If there are universes "in the past" and there are no limits to how far we can go "back", it implies that there is always at least one universe right now that is undergoing the very first instant of the big bang. I don't think "many worlds" allows such a juxtaposition. It's probably not a given that a universe u' can always be found.

You might say that this doesn't matter, because he's only going back 30 years... however, once the loop is "closed", it might easily execute more than n = (the age of the universe/30) times... if you imagine it takes n universes (u1...un) to perpetuate this cycle, then the last universe un in the chain must have been undergoing the first instant of the big-bang when he left his original universe u.
"why do we seem to only know about one universe"
There has always been another weird problem with the multiverse interpretation... supposedly, different event probabilities create different universes in which each probability actually happened. If that's true, then why do we seem to only know about one universe -- i.e. why does our consciousness seem always to travel with this particular branching path and not one of the others?

Then I realized this isn't such a problem after all: we might only remember this universe because at any given moment our memories are the sum total of our experience along only the path we are in. Our other "selves" would likely have different memories, but all similarly self-constrained to their paths.

There's no way to "peek around the quantum veil" as it were.

Sunday, September 20, 2009

journalism in crisis...

A while ago I had heard Bill Moyers speech regarding "Journalism in Profound Crisis". I knew the dangers, but today the full weight of his speech hit me while reading a very tame and completely unrelated "news" article linked from a friend's facebook account.

The story, which appeared on the headline Business section of MSNBC.com on Sept 20th, outlines how a family recovered from $100,000 debt in 5 years to be debt free and happier and more responsible than they had been. At first, I thought it was just an uplifting story... but then I started to notice some odd things about the story: for one, it was copyright by CreditCards.com. Second, the story disclosed that the family had won a PACE award which was judged by one of CreditCards.com's senior reporters.

Since when do private credit card companies hire reporters?
"How many other news stories are really embedded corporate press releases?"
The story explains that the family was holding even until "credit card companies [began] raising their interest rates" even though the family had been current on all their bills. Credit card companies proactively raising their rates has been described elsewhere as a response to the Card Accountability and Disclosure Act (CARD) and the state of the economy in general.

CreditCards.com identifies itself as a broker between consumers and credit card companies. So it has a vested interest in protecting the interests of credit card companies who are it's customers.

While other stories have focused on the unfairness of raising rates for consumers who have always paid their bills on time, the CreditCard.com story quietly bypasses whether the rate increases were fair or just, and just commends the family for paying their debts without raising a fuss.

This is brilliant marketing, but is it news?

What's shocking isn't the story they wrote, or that they are one of MSNBC's advertising sponsors, it is that their "story" appeared as headline business news on MSNBC.com, a company that touts itself as "one of the most honored news organizations." Ordinarily this kind of PR story appears (or is credited) exactly where it belongs, on PR Newswire. The fact that it was published as a story subject to the same journalistic integrity that MSNBC.com is so proud of is deeply disturbing.

How many other news stories are really embedded corporate press releases?

Bill Moyers wasn't kidding about the threat to journalism. The internet gives us a lot of power to write and read stories almost as they happen. But it also gives corporations the power to pretend to be journalists without fully disclosing their motives.

Friday, August 28, 2009

a question about the "holographic principle"

I've been reading Leonard Susskind's book "The Black Hole War" and trying to wrap my head around this mind-bending concept he presents called the Holographic Principle.

Roughly, the idea is built from the properties of entropy and temperature surrounding black hole physics. There is a curious result that a black hole's entropy is proportional to the area of its event horizon rather than the enclosed volume. Susskind goes on to explain that this is effectively as though all the possible information about the inside of the black hole were written on it's surface in Planck area sized quanta. So this is a little surprising, but you expect that with black holes. What's really weird is that this ends up letting you describe any volume of space with a 2D encoding of the surface. Is the 3D universe just a projection of this 2D encoded surface? Weird!

Ok, not so weird... I mean, I'm a programmer, I'm very comfortable with transformations between 2D and 3D. Most of the ones we use in computer graphics are called "information losing" transformations, because once we've rendered a scene, you can't "walk around" it from the back or sides. However there are "information preserving" transforms that tell you how to encode exactly the same amount of information in a lower dimension, so this isn't too strange for me to grasp.

Another paradox?

All this has physicists wondering if the underlying nature of reality is really a 2D surface off at the edge of the universe. While I could see that transform springing out of the math involved (not that I've done any of it, mind you), I have a problem with literally believing this is the structure of things.

What is hard for me to grasp is that a literal interpretation would seem to imply that information can propagate faster than light in some cases, which is another paradox! Think of the following thought experiment: say I'm playing billiards with Susskind and I sink 5 balls in one shot. Apart from having to be an amazing billiard player (I'm not), all these balls would have physical interactions. According to Susskind, these interactions are really happening at the bounding surface of the universe in a sophisticated 2D "holographic" encoding and we just might think it was happening in 3D here. Fine.

But wait, how do you know that the interactions are all happening locally on that distant surface? If one billiard ball is represented by bits on one part of the sphere and another billiard ball is represented by bits on the opposite side of the sphere... how do they interact in a short amount of time? You might be talking about interaction effects on the surface that might be vast numbers of parsecs apart.

The interactions in our notion of space are also very fast... fractions of a sec. How can interactions happen so quickly if the underlying "real" medium was so extended? Does the underlying information travel faster than light when it interacts? (i.e. "Spooky" action at a distance?)

This is potential paradox. The only ways out seem to be 1) saying that the speed of light doesn't apply to propagation (interactions) in the underlying 2D surface, or 2) all information is encoded such that it's spread is somehow constrained locally with respect to the surface.

This tends to make me think that the Holographic Principle is a mathematical relationship more than representing any underlying nature of reality. But then again I'm basing that off of naive assumptions of how optical holograms work and simple 2D and 3D projections -- perhaps there is nothing so simple about the nature of the projections Susskind is talking about?

What do physicists think of this? Is it a real problem?

Thursday, August 13, 2009

Is health care "infrastructure"?

One of the more hotly contested issues in the current debate over the health care reform is the amount of government control over health care. Obama's plan has been labeled Marxist by his opponents, implying that it is nothing more than an attempt to nationalize health care, a term which conjures images of evil Socialist countries greedily dividing up someone else's profits.

But the government occasionally has legitimate reasons to provide common infrastructure. One example is the US Postal Service. Ben Franklin saw a good communications infrastructure as vital to the growth of the nation, and he was arguably correct. Most people don't think of the US Postal Service as being a "nationalized" institution because there are still ways to compete (FedEx or Mail Boxes Etc.). Competing with a government-run option is entirely possible.


Who said anything about "government run"?

Obama proposed the "public option" as a government-run non-profit option that will encourage competition with private insurers. He didn't say anything about the government taking over all of the health-care industry (a truly Marxist "nationalization"), but the conservative Right has interpreted his plan to mean exactly that.

The Right isn't completely "wrong" either -- it is a reasonable guess based on the history of competition in the insurance industry, which tends to take the form of acquisitions and mergers, leading to a few large fish and no small fish. It is ultimately a numbers game: the biggest numbers win, plain and simple.

Insurance from the individual's viewpoint is simply a way to pay a "guaranteed and known small loss to prevent [the possibility of] a large and possibly devastating loss." The individual doesn't really know when or if something bad will happen to them specifically, but it always pays to be prepared.

From the insurer's viewpoint, this looks a little different. If I were a brand new insurance company and I had only one customer, offering him insurance at competitive rates would be a huge risk on my part. There's only one way I can make this work, and that is to get lots and lots of customers.

Now, lets say I have a lot of customers, but I'm a publicly held company. My shareholders expect profitable quarters. I have only a few ways of making a profit:
  • increase the number of low-risk customers
  • increase premiums
  • decrease coverage (or increase coverage exceptions/pre-existing conditions)
  • put a greater portion of holdings into higher-risk investments (higher risk!)
By removing profit as a motive, Obama's "public option" would not face many of these pressures, so presumably it could provide more service for less money. The downside is that the private for-profit health care industry would be hard pressed to compete without becoming non-profit themselves -- so it is likely that the health care system becomes nationalized gradually over time as people move over to the "public option" even though that wasn't the original intent.


Is this a bad thing?

Getting back to the idea of infrastructure, this is where I'm torn. I hear things like Palin's quip about "death panels" lamenting the idea that the government may be deciding who is fit to live or die -- she raises a completely valid concern but does not mention that private insurers already have such panels and that they are answerable to no one, least of all the customers they serve. The fact is that inevitably any organization involved in managing insurance has to make life and death decisions about providing care coverage. Where is the outrage against existing "death panels" in private companies like those exposed by Michael Moore's documentary Sicko?

"...inevitably any organization involved in managing insurance has to make life and death decisions about providing care coverage."

One major difference between private companies and a national health care system is that the private company gives you no recourse, no voting power, no voice and no choice*. A national health care infrastructure might at least be influenced by voters instead of shareholders. Assuming, of course, you don't mind a little Socialism in your health care. But that's really scary to a lot of Americans...

*Capitalism says you do have a choice, you vote with your dollars -- however, there is a defacto cartel in the insurance industry because once you have a condition you are unable to shop for competitors due to the exclusion of "pre-existing conditions" -- hence, there is little free-market competition to begin with and none when you really need it.


Insurance is already a Socialist construct!

Think about it. Insurance basically takes a fixed amount from everyone who buys into it and tries to allocate it to where people have the most need. This is the essence of a Marxist dynamic and just like its political counterpart, is a reaction to the harsh unregulated realities of real life. Even the most ardent Capitalist has some kind of risk management in the form of insurance -- to not protect your investments is just plain stupid.

The reason that most people don't rebel against the idea of insurance is that (unlike Marxism) it is (or was) completely optional. You don't want to pay, fine... take your chances, or manage your risk some other way. This sounds fine in theory, however, for most people that didn't have insurance, that simply meant taking a free ride on all the rest of us... hospitals still gave them care, those costs were still passed on to insurers and those of us who pay for insurance get the bill in the end.

The only way to make insurance rationally opt-in is to always deny care if you can't pay, even in an emergency... a stance that is so controversial that most health care organizations refuse to consider it.

---

In the face of all these things, I just don't know what the right answer is. I tend to think that health care could reasonably be considered infrastructure by the government which has a vested interest in keeping its population healthy just as it has an undeniable interest in national security.

It seems unbelievably cruel to say "if you can't pay, you die" -- yet that is the only way a truly capitalist system would work. And I think the insurance industry has far too much invested in the profits of the existing system to turn it over to the government without a fight.

Perhaps this means that the matter is moot, but I like to believe that this debate will at least get people thinking about the costs involved and what kind of system they really want.

Sunday, May 3, 2009

The Dalai Lama in Boston!

Yesterday I went to hear His Holiness The Dalai Lama speak at Gillette Stadium in Foxboro. He is one of the most down-to-earth spiritual leaders I have ever heard. There is no arrogance or appeals to incomprehensible mystical forces-- just plain simple concepts.

Before the Afternoon Session

I arrived for the afternoon session around 12pm during the lunch break. The crowd was pretty diverse... Tibetans, a few Buddhist monks, some yoga and tai chi people out on the grass, New Agers, hippies, yuppies, families... people. I wandered around the level behind the seating where all the food vendors were-- they had set up some Tibetan cultural displays and shops. (It was a little odd seeing these nestled among the pretzel vendor and the McDonalds.)

The event was sponsored by the Tibetan Association of Boston and funds raised are going towards the construction of a new Tibetan Cultural Center in Boston. I went out and found my seating and listened to a concert of Tibetan culture being performed on the stage. Here's a sampling:



The video clip shows some dancing and the Tibetan musician Penpa Tsering. Some of the flute music reminds me of Native American music I grew up with in Arizona. Indeed, another one of the musicians at the event Nawang Khechog collaborated with Navajo flutist R. Carlos Nakai. Nawang performed an song dedicated to the Dalai Lama.

Penpa Tsering's piece with the stringed instrument really fascinated me... it reminded me of an oud, both in the intonation and in the rythmic style. It got me thinking about the connections in a paper on Russian music history I'm writing -- Arab influences traveled up through the Crimea from Persia and along the Silk Road later inspired composers like Rimsky-Korsakov in music like Scheherazade -- did they also make their way into the musical traditions of Tibet? Certainly the historical trade routes suggest that.

Immersed in these thoughts, I realized that the concert portion was over and The Dalai Lama's talk was about to begin.

"The Path to Peace and Happiness"
(The following is my recollection of parts of his talk, so I may paraphrase or interpret or quote parts out of order -- this is not a transcript.)

He walked out onto the stage and sat in his chair. His movements were calm and unrushed, without any tightness of formality. He drew his legs up into a crossed position in the chair, wrapped in his robes and searched around for something in the cloth bag he brought with him... then he found it and let out a chuckle to himself and everyone joined in when they saw that he had put on a New England Patriots cap to keep the sun out of his eyes. He gave a big thumbs up and a smile.

He started very simple. "We are all human beings." He pointed out that if he said "religious" it would exclude all the "non-religious", or "Tibetan" might exclude all the non-Tibetan or anti-Tibetan... so our commonality first and foremost is human. We all want to be happy. Our happiness must not be at the expense of others, for they too want to be happy.

He said that some people have attributed magical healing powers to his blessings, but he explained "if that were so, I wouldn't have needed surgery," and chuckled. However he offered another interpretation -- he noted that his doctor remarked how young his organs looked relative to his age -- this perhaps can be attributed to long practice in calm thought and compassion. He noted that scientists have studied the effects of stress on people and the positive health effects of happiness, so this is not too hard to believe.

The Dalai Lama is different than most spiritual leaders in that he embraces and supports science. He enjoys connecting scientific and Buddhist insights, and it seems for him to be a way to more deeply understand the nature of things. This is very refreshing in a world where the choices seem increasingly between spirituality devoid of reason and reason devoid of spirituality. (This effort goes beyond such narrow confines as "religion" -- for example, he is helping to launch a spirtual center at MIT focusing on ethics in business and science.)

Tying into his focus on essential humanity, he notes that ethics, compassion.. these things are more basic than institution, religion, etc. We need them as human beings. In this way, the Dalai Lama is trying to broaden his message beyond Tibet, beyond Buddhism... beyond religion... to something that applies to all of us in the world.

Then he gave some advice for how to attain happiness. For one, if you can widen your focus from yourself to the larger context, this can reduce your stress. He gave some examples, but I thought of the most striking example I know, the famous picture "Earthrise". When you realize your troubles next to all the other thousands of human beings who are going through similar things... it helps to calm your stress.

He noted that sometimes scientists and politicians tend to use the words "I" and "me" a lot. These words narrow one's focus, making small problems seem much more stressful.

Another thought he offered was that even when there is very bad news, there are also positive effects. For example, although being exiled from his homeland was bad, it has given him the opportunity to talk to many different people and spread awareness in the world. So, every time he hears or experiences something bad, he tries immediately to shift his perspective to notice something good that will come out of it... this also calms stress.

He did touch on the question of "freeing Tibet"-- he said that Tibet would even be willing to be part of the PRC if they were allowed to keep their culture and their language. Of course, this opens up a much larger and more complex set of issues that he didn't get into. He did invite observers from all nations into Tibet -- "if you see that conditions are as the Chinese say, then my information was wrong and I humbly apologize." I assume he is speaking here of the spiral of violence between rebel and PRC forces.

Perhaps it is impossible at this point to separate The Dalai Lama's message from the conflict in Tibet, however he says he wants to keep the dialogue open, searching for a non-violent "win-win" solution that benefits both sides. There is much I don't know or understand in this conflict. The U.S. and China are interested in this area strategically for different ends... for China, it serves a similar strategic interest to our historical "Manifest Destiny," which places us in a difficult position to claim moral superiority or defense of an indigenous culture. Yet, we have a greater recognition and respect for these cultures now... to lose them would be a incredible loss to the world. I think many people agree that we should do all we can to preserve these traditions for historical reasons if nothing else.

But, at least in The Dalai Lama's case, these traditions are surprisingly modern in their application. Regardless of our technology, the principles of how we relate to each other and form meaningful relationships have not changed in thousands of years. The Dalai Lama is remarkably clear in applying Buddhist principles to everyday modern life.

We need his voice in this world, now more than ever.

Sunday, March 15, 2009

web 3.0 needs a javascript package manager

Javascript has gotten huge with Web 2.0 techniques. Libraries like jQuery, Scriptaculous, etc. etc. have helped redefine the role of Javascript from being a rag-tag script-kiddie language to becoming a viable platform for the web, competing with the likes of Flex and Silverlight. Javascript is getting serious attention from Google (ala V8) as a serious language with serious compiler design. In short, it's a glorious time to be using Javascript on the web.

So while the iron of Javascript infrastructure is hot, I have an idea for the next generation of the web:

the time has come for a javascript package manager.

No, I'm not talking about javascript loaders like jspkg or sprockets (although those are awesome efforts). I'm talking about a real package manager like Debian. Let me describe the growing problem and why I think a package manager might be a good solution.

The Problem:

Different sites require certain versions of scripts to run. Right now, site maintainers do this by downloading a copy of the library to serve from their site. This is fine if the site is simple and self-contained, but if you add several portlets to your site (a couple ad-rotators, some captchas, social site scripts), pretty soon you run the risk of accidentally including several copies of the same library in your page, all from different domains.

This sops up an enormous amount of bandwidth. Rich pages routinely download 1-2 Mb per page load... this is only going to get worse.

The Solution:

What we need is a package manager for Javascript like Debian's APT or Ruby's rubygems. Some way that the page can say "I need so-and-so version of this Javascript library in order to run." Then the browser can manage these javascripts in a secure cache -- if you have already retreived the version required, good. If not, then the browser will get a copy for you. The browser only gets new javascript if the page contains an updated version dependency. Furthermore, if a library depends on another library, the version dependency tree can be managed and sub-libraries can be automatically loaded once and only once.

Because the browser would be taking a more active role in managing scripts for separate domains in the same store, some work along the lines of Chrome needs to be done to make sure that script execution across multiple site clients remains secure and robust. Chrome is already leading the way on this, so I think it's doable.

A robust, integrated package management system for browsers would reduce bandwidth costs and at least double or triple the loading speed of AJAX web applications. That's something everyone would like.

Friday, March 13, 2009

Communism 2.0? More like 0.2 alpha.

Bruce Sterling's post, "Communism 2.0" over at WIRED caught my eye today. He talks about a new resurgence of communist ideas thanks to the global market meltdown -- Marxist philosophers are meeting in London this week with the thesis "from Plato onwards, communism is the only political idea worthy of a philosopher."

When the Soviet Union "fell" down many people thought this meant that Communism utterly failed (according to our vastly simplified propaganda). Well, now that the global market meltdown is laying waste to the economy, many people are saying that Capitalism has utterly failed (according to their vastly simplified propaganda).

This is dangerous talk, and not simply because of "our side" vs. "their side"... it's dangerous because irrational debate of utopia/dystopia is still volatile enough to end millions of lives in this century just like it did in the last century. Capitalism is just as loaded a word as Communism thanks to the Cold War, but if you strip away all the rhetoric and attached meanings, there is a simple fact at the core of Capitalism that is testable and proven:

Capitalism has a means for generating income, not simply dividing it.

Communist theory is oddly silent on the subject of generating income. The idea is that everyone will simply do the right thing. Marx neglected to say anything specific about how his Communist ideal would be attained... the underlying mechanism is left for the reader to "feel" as would a 19th century Romantic. Marx says that in the perfect Communist society, resources are distributed exactly where they need to go and people do exactly the work they need to do since they work for each other.

But how? How does a resource distribution system just magically know how to work? The 20th century answer to this was that an "appointed" leader makes the decisions for you. However the whole period from the 18th to the 20th centuries was about showing the flaw and futility of top-down aristocratic rule. Even when the ruler is kind and "works for the people", it doesn't work. Things change faster than a central authority can react -- if you can't react, you don't adapt -- you die.

Some would argue that matches the evidence of what happened in the USSR and nearly happened in China before Deng Xiaoping's reforms. Or what is still happening in Cuba. There should be little doubt at this point that top-down communism (like any aristocracy) simply does not work. It's not because we didn't try hard enough, or weren't selfless enough.

So, is there another way that Communism might work without being top-down? Something closer to Marx's ideal, rather than some of the transition states he described? Well, think seriously about how that ideal would work... it's a difficult problem to solve.

The only underlying mechanism I can think of is a distributed network of technology and humans that can make their own decisions and adapt locally to changing situations. But this sounds an awful lot like a democracy... there's no one to "enforce" that you do things for someone you don't interact with. And if you follow that idea further, you ask how will resources be optimally distributed in such a network and you come straight back to something that sounds an awful lot like a market driven economy.

But the Communist philosophers haven't gotten unstuck from the 19th century to answer these difficult questions. They are still arguing that you should believe them because of their passions. Until they can describe an underlying mechanism of Communism they are simply promoting unfounded speculation as a socio-economic theory and playing a very dangerous and foolish game with our lives in the process.

This crisis is real. The millions who died in the name of 19th century utopian ideologies were real. It's time to "set aside our childish things" and face these problems rationally or embrace utter destruction as a species.

Monday, February 23, 2009

the bigger picture...

The previous post about the importance of technical managers is just a small example of what I think is the importance of mathematics and science education in general.

At first people don't pay much conscious attention to design principles. They simply do whatever works. For a time this is sufficient. But soon people begin to think about efficiency. Maybe it's their competition or scarce resources, or their customers can't pay as much as they once did. Whatever the motivation, when people first start considering the constraints of a problem and how to solve those problems esthetically, designers are born.

But there is another layer beyond this. When economies drive down the costs of design and organizations must no longer consider the merits of a few designs, but rather must select against an endless sea of millions of designs and practices, the question becomes "what is the optimal design?"

This is the point where mathematics gets involved. Math is the language for describing systems and calculating their optima.

This pattern should not be surprising to anyone, but sometimes the conclusions are surprising. For one, it seems that any sufficiently advanced and refined problem domain comes to mathematics. Whether it's how to ship a million packages a day, or how the basic building blocks of life are sequenced in various creatures -- large scale almost begs for mathematical solutions. For another, it implies that no matter what your particular artistry entails, if you follow it long enough, you will end up having a mathematical interest of some sort.

This isn't that remarkable if you look at the trends of modern science: biologists are talking with computer scientists are talking with physicists... and all of these are talking with mathematicians. Even linguists, who started with a love and study of languages and etymology have branched into computational linguists who study language origins using statistical methods in mathematics. Some of the fields developed their own systems and specializations in the infancy of their fields that are only now being realized as special cases of more generalized fields in mathematics. Core topics like Set Theory and Ring Theory are now prerequisites for dozens of studies in the arts and sciences from biology to finance.

The lesson is clear: if you want to be the best at what you do, science and math education are the prerequisites.

non-technical managers...

I recently read Sid Savara's article about how engineers can more effectively communicate with non-technical managers. I think Sid does a great job on the engineer's side with some really good insights as to how engineers think of communication. It's a great article that brings an honest (if somewhat naive) assumption that people simply want to communicate.

But it takes two to tango, and I'd like to challenge the assumption that a non-technical* manager can be an effective manager of a technology group with the right communication.

Let's use some simple logic first: Say it is possible to manage a technical group without being "technical". Then you are implying that management decisions essentially have nothing to do with technology; management is management - maybe it's about people, maybe it's about process, but it has nothing to do with technology in any fundamental way.

This leads to two supporting fallacious assumptions (which are very common in business):
  1. ideally all management decisions in a technology group can be translated into non-technical terms. Any failures in this communication are ultimately the responsibility of your technical team to address (otherwise you'd have to learn something about technology, which you've already decided is essentially irrelevant to management concerns).

  2. management issues are essentially simple and easy to act upon unless someone is making them needlessly complex and/or resisting doing any real work (i.e. your technical team).
Let's put it another way: Would you say that a non-sailor Captain could be an effective manager of a ship? Would you say that a non-diplomat could be an effective manager of an embassy? Would you trust a non-mechanic crew chief as an effective manager of a NASCAR race car team? Would you say that an untrained civilian could be an effective manager of a military unit?

Would you say that you can be an effective owner of a sports team without knowing anything about sports or the sports business?

No, because in each of these areas a knowledge of the specific problems and solutions is a requirement of the role of leader. Yet popular business philosophy has started with the assumption that all manager positions are essentially identical in their demands and execution.

It's time to start recognizing that technology isn't always simple and that effective technology managers have to be at least somewhat technical -- it's a requirement of the job.

* I'd like to point out that some managers consider themselves "non-technical" because they lack the domain-specific jargon or experience in a technology group. Maybe they were a biologist, instead of a computer scientist or at least they have some appreciation or experience with science issues. I consider these managers "technically capable" -- they are capable of understanding the arguments with some effort in learning or developing common terminology. This is a more amenable situation because these kind of managers don't make the fallacious assumptions noted above. They are eager to think through problems and find solutions even if they don't have the specific vocabulary. Given Sid's points of effective communication, they will rise to the very technical challenge of running a technology group.

Thursday, January 22, 2009

iTunes is bad at eclectic collections

My music collection is kind of eclectic (genre-wise). You never really know what you'll find in there... it might be Bach performed by Emile Autumn (Electronic?) or Angry Skies (Dance Pop?!)... ok so I noticed that the genres on a lot of the music are completely out of sync with reality. They seem to assign the genre label based on the artist rather than the individual song.

So I tried "TuneUp Companion," but this just made it worse. Now I have 57 very specific subgenres ("Electronica Mainstream", "Post-Modern Electronic Pop").. yikes! It made everything more specific, but now my music collection is fragmented along 57 branches in a completely alien non-intuitive way. The "Genius" feature isn't much of a help because it unfortunately ties into the same organization system to help construct it's playlists - "garbage in, garbage out" as they say.

So what's wrong with this? I know iTunes is just trying to leverage existing ways of cataloging music, but the traditional ways of cataloging were born of record companies and promoters, not listeners. Other contemporary software allows multiple tags so that you can capture all the different terms that apply to an item (such as a blog post).

iTunes needs to realize that there's more than one way to organize things in the world.