Tuesday, September 06, 2005

All Hail the Red Queen... (from my Borland blog)

“Now here you see it takes all the running you can do, to keep in the same place. If you want to get somewhere, you have to run at least twice as fast as that”

- Red Queen – “Alice Through the Looking Glass”

I spoke at BZ Media’s EclipseWorld last week about the impact of “the Eclipse Effect” and the challenges and opportunities it presents both Enterprise IT and ISV’s as they build out their next releases of products. After the keynote, a theme that came up in multiple discussions is the acceleration of how often companies need to re-consider their competitive positioning and their differentiable value. It seems like this was once a generational question for software companies and IT departments that arose every 8-10 years. Now one needs to manage “differentiable value” more like a series of cash flows used to value a financial instrument. Your product portfolio’s feature sets are a bucket of these value flows that need to be assessed independently and on an ongoing basis. This creates a “net differentiable value” which can be used to determine product creation priorities and go-to-market strategy.

Every few years it seems like someone comes up with another thing to apply financial derivatives mathematics to. My bet is determining optimal commercial differentiable value and the use of open source will be two more of them. Hey, any of my old friends from O’Connor, Swiss Bank or CIBC, want to take a crack at it? Give me a call.

So where has this acceleration come from? What were the pre-conditions? I have two themes I think are part of it that I will write about in subsequent posts: “Cyberphysics” and “The Kids are Alright”. Stay tuned.


UPDATE ON THIS POST: After my previous Borland posts and then this one the core of people whose rabid concern was the future of Delphi and Borland C++ began to emerge. The main complaint being that my Borland blog should be used to pretty much talk about release schedules, features and futures. Unfortunately for those folks I didn't see that as the role of CTO, and now with time in retrospect, I still don't agree with them. Borland had over 100+ people involved in the development, marketing, support and management of these products - their words and messages should be sufficient. Another thing I noticed in the comments was a refusal to accept (not understand, but accept), that officers of public companies cannot reveal specific about product plans without doing so in a careful, planned, and legal way. Regardless, below this update I include a response to one of the comments longer than the original post. And in a single comment by "Anonymous" here - I have put all of the critiques.

My response to one of the critics:

A couple comments in response.

Yes this is a “BDN” blog sponsored by Borland Developer Network. That said I really can't provide any specifics on product direction for any Borland product that has not already been publicly stated. In my handful of blog postings as you can see I focus on the trends or themes I see in our enterprise customer base – trends and themes which I believe will ultimately have an impact on enterprise developers, if only as a result of organizational behavior, as well as their technological effect.

In this post I was ruminating without conclusion on one of the things I am seeing our customer’s struggle with as well as our ISV partners; what is a company’s differentiable value? I still don’t have conclusions – but here is some of the underlying thought in process.

In prior generations before open source, you looked at competitors and customer demand. If a competitor had a feature you were for the most part expected to counter it with your own variant. This is “me too”. In order to have differentiable value you had to think up and implement customer-desired features before your competition, “me first”. So determining product features was a “me too” vs. “me first” balancing act. Hard to be good at, but the dimensionality of the problem didn’t make your head explode.

Given the advent of (to name a few):
Internet connectedness as a force to:
- focus the accumulation of intellectual capital
- provide planetary scale development on relatively small problems
- Growing enterprise acceptance of open source
- The “API-ification” of almost everything

How does this change “me first” vs. “me too”. It introduces, to oversimplify, “should I ever”, “who else”, and “along with”.

“Should I ever” – means “is this a capability that I believe will have a valid commercial life before commonly understood and implemented in open source?”

“Who else” – is what are the other sources of components for my integrated product – probably an order of magnitude more complicated as a result of independent open source contributions, foundation open source contributions, and corporate open source contributions”, as well as partner and community contributions via the “api-ification” effect.

“Along with” is perhaps a combination of your contributions to community and open source initiatives, as well as your investments into the api-ification of your product lines.

All of these are new dimensions which potentially require one to BELIEVE something about the future, which in my book means you need to start reviewing all of this probabilistically to get some sense of what your expected outcomes are.

Once you are into “probabilistic, expected outcome” you ought to start thinking about standard techniques used everyday in other domains to help you. Look at Borland’s CaliberRM, one of the most compelling features is the use of Monte Carlo simulation on industry standard historical data and company-specific historical project data to provide a probabilistic estimate of project success given the time, budget, staff, etc.. Does this probabilistic approach guarantee anything? If all the inputs are completely wrong then it does nothing. If the estimates are close – it gives you some sense of the possible outcomes.

So as I think about the granularity of major feature areas of all of a vendor’s products with respect to “me first”, “me too”, “who else”, “should I ever”, and “along with” – combined with the fact that all of these judgments require some belief about an inherently exactly unknowable, albeit estimable future, it turns my thoughts to the techniques used in derivatives analysis.

As an over-simplified primer here are two pointers. Modern financial mathematics got its jump start when Fischer Black (U of C) and economist Myron Scholes (MIT) collaborated on the concept that option pricing was essentially the same as the thermal conduction law of classical thermodynamics. Also, (thanks to Peter Hoadley) play around with option pricing graphs at http://www.hoadley.net/options/optiongraphs.aspx .
Notice the impact of “volatility” which is your probability estimate. Notice sensitivity to “time to expiration”.

This calculator is for a relatively simple set of cash flows, which in some ways can be thought of as probability flows. Complex financial instruments require you to analyze thousands of future cash flows, with future beliefs about potentially numerous cross rates, interest rates, inflation rates, credit ratings, etc.. At that level of complexity, with that many guesses of the future, it is necessary to know maximal risk exposure depending upon numerous probability paths.

SO…since option theory is increasingly used in other domains to understand types of probabilistic risk exposure I was wondering if it is about time to have a more formal, statistical approach to product management given what I believe is the increasing dimensionality of that problem. Does this affect developers directly? If I am wrong and we live in the simple world of “me too” vs. “me first”, then certainly not. On the other hand, maybe it is worth a thought with respect to the products one is making human and financial commitment to – whether products built or products bought.

And, because of my “give a moose a muffin” type thought processes I also wonder how did we get here? How did this acceleration start? Why are there so many people willing to work in a collaborative way to solve problems like an open source OS, open source appserver, etc..? Where did they come from? What are the generational or cultural shifts that have caused the acceleration of openness, api-ification, and collaborative connectedness? Which as I said, I will post some gobbledygook about in the future.

Thanks for the comments.

pk

1 comment:

Anonymous said...

Feedback

# re: All Hail the Red Queen...
9/7/2005 7:57 AM by Brion L. Webster
As the Chief Technology Officer, it would be nice if, just once, you wrote something I as a developer could understand. This post reads like CXO marketing gobbledygook, and I'd be a little concerned if you're marketing to CXO's on Borland's blog site.

Mentioning Delphi in a positive tone might be nice too. Making us believe Delphi ties into Borland's ALM vision and strategy would be even better.


# re: All Hail the Red Queen...
9/7/2005 2:32 PM by Brad White
BW:
The titles are cryptic, but I understand the value of differentiating my products.
And I think that differentiation needs to be part of determining product creation priorities and go-to-market strategy.
And I welcome anyone who helps me think it through.
I'm just the lead developer, not the CTO, because we're not big enough to have a Cxx.


# re: All Hail the Red Queen...
9/7/2005 9:01 PM by Chris Cheah
Please cut out the mumbo jumbo and get to the point where Borland's technology products like (aka) Delphi can and should be positioned inside the Corporation to make Borland and it's loyal developers proud to use the tool of choice and give credit to the true brains and hard working bunch in the Delphi Team!


# re: All Hail the Red Queen...
9/8/2005 9:40 AM by Ed Daniel
BWeb./CC

I'm with Brad on this one - this blog does not live at the Borland domain, it's PK's personal blog - not his corporate blog so he doesn't have to push/pitch/place/spin anything Borland does, although he might in certain posts but that's his choice more than prerogative - yeah, he features his job title below his name but again that's his choice be it vanity, pride or another more simple and non-ego-related reason.

I reckon PK might be looking for a mathematical model to de-risk future Borland business. As opensource is one of the inputs he's looking at perhaps we can all pay attention to what this means for all software houses - and down the line what happens to software houses when software writes its own software if one wants to play the vision game.

I'm looking forward to PK's ramblings and yeah - perhaps he needs to do a corporate blog focused on Borland's products as there is an audience of which 2 bothered to go public about their interest.

Just my 2c.

PS. Does PK miss Dale? I wonder why Dale left without a fight, his numbers were good and what's a quarter between friends - perhaps it was Dale's excuse to jump ship ahead of the tough decisions to
make.


# re: All Hail the Red Queen...
9/8/2005 10:27 AM by Nick Hodges
Pat --

You'll have to forgive me, but I've read this four or five times, and I can't figure out at all what you are trying to say.

Nick


# re: All Hail the Red Queen...
9/9/2005 8:32 AM by Brion L. Webster
Ed, the URL I see this at is:

http://blogs.codegear.com/pjkerpan/archive/2005/09/06/21056.aspx

I start at blogs.borland.com and work my way down from there. Whether or not it's really a personal blog or not, it's certainly presented by Borland as a Borland blog.

-Brion


# re: All Hail the Red Queen...
9/9/2005 12:34 PM by Patrick Kerpan


A couple comments in response.

Yes this is a “BDN” blog sponsored by Borland Developer Network. That said I really can't provide any specifics on product direction for any Borland product that has not already been publicly stated. In my handful of blog postings as you can see I focus on the trends or themes I see in our enterprise customer base – trends and themes which I believe will ultimately have an impact on enterprise developers, if only as a result of organizational behavior, as well as their technological effect.

In this post I was ruminating without conclusion on one of the things I am seeing our customer’s struggle with as well as our ISV partners; what is a company’s differentiable value? I still don’t have conclusions – but here is some of the underlying thought in process.

In prior generations before open source, you looked at competitors and customer demand. If a competitor had a feature you were for the most part expected to counter it with your own variant. This is “me too”. In order to have differentiable value you had to think up and implement customer-desired features before your competition, “me first”. So determining product features was a “me too” vs. “me first” balancing act. Hard to be good at, but the dimensionality of the problem didn’t make your head explode.

Given the advent of (to name a few):
Internet connectedness as a force to:
- focus the accumulation of intellectual capital
- provide planetary scale development on relatively small problems
Growing enterprise acceptance of open source
The “API-ification” of almost everything

How does this change “me first” vs. “me too”. It introduces, to oversimplify, “should I ever”, “who else”, and “along with”.

“Should I ever” – means “is this a capability that I believe will have a valid commercial life before commonly understood and implemented in open source?”

“Who else” – is what are the other sources of components for my integrated product – probably an order of magnitude more complicated as a result of independent open source contributions, foundation open source contributions, and corporate open source contributions”, as well as partner and community contributions via the “api-ification” effect.

“Along with” is perhaps a combination of your contributions to community and open source initiatives, as well as your investments into the api-ification of your product lines.

All of these are new dimensions which potentially require one to BELIEVE something about the future, which in my book means you need to start reviewing all of this probabilistically to get some sense of what your expected outcomes are.

Once you are into “probabilistic, expected outcome” you ought to start thinking about standard techniques used everyday in other domains to help you. Look at Borland’s CaliberRM, one of the most compelling features is the use of Monte Carlo simulation on industry standard historical data and company-specific historical project data to provide a probabilistic estimate of project success given the time, budget, staff, etc.. Does this probabilistic approach guarantee anything? If all the inputs are completely wrong then it does nothing. If the estimates are close – it gives you some sense of the possible outcomes.

So as I think about the granularity of major feature areas of all of a vendor’s products with respect to “me first”, “me too”, “who else”, “should I ever”, and “along with” – combined with the fact that all of these judgments require some belief about an inherently exactly unknowable, albeit estimable future, it turns my thoughts to the techniques used in derivatives analysis.

As an over-simplified primer here are two pointers. Modern financial mathematics got its jump start when Fischer Black (U of C) and economist Myron Scholes (MIT) collaborated on the concept that option pricing was essentially the same as the thermal conduction law of classical thermodynamics. Also, (thanks to Peter Hoadley) play around with option pricing graphs at http://www.hoadley.net/options/optiongraphs.aspx .
Notice the impact of “volatility” which is your probability estimate. Notice sensitivity to “time to expiration”.

This calculator is for a relatively simple set of cash flows, which in some ways can be thought of as probability flows. Complex financial instruments require you to analyze thousands of future cash flows, with future beliefs about potentially numerous cross rates, interest rates, inflation rates, credit ratings, etc.. At that level of complexity, with that many guesses of the future, it is necessary to know maximal risk exposure depending upon numerous probability paths.

SO…since option theory is increasingly used in other domains to understand types of probabilistic risk exposure I was wondering if it is about time to have a more formal, statistical approach to product management given what I believe is the increasing dimensionality of that problem. Does this affect developers directly? If I am wrong and we live in the simple world of “me too” vs. “me first”, then certainly not. On the other hand, maybe it is worth a thought with respect to the products one is making human and financial commitment to – whether products built or products bought.

And, because of my “give a moose a muffin” type thought processes I also wonder how did we get here? How did this acceleration start? Why are there so many people willing to work in a collaborative way to solve problems like an open source OS, open source appserver, etc..? Where did they come from? What are the generational or cultural shifts that have caused the acceleration of openness, api-ification, and collaborative connectedness? Which as I said, I will post some gobbledygook about in the future.

Thanks for the comments.

pk


# re: All Hail the Red Queen...
9/12/2005 8:14 AM by Brion L. Webster
I've read the latest posting at least three times, and don't know what to think.

Is it a good thing that the CTO spends so much energy on business and marketing type questions? I could see it argued both ways. No one wants the "prima donna developer" in charge of a business, that's for sure.

The rationale examining whether or not features ought to be implemented, and who potential partners are, was interesting. It does make me wonder how you ever get past making risk analysis charts and pretty power point presentations to the board to actually getting anything accomplished.

Two comments from this post particularly bother me.

"as you can see I focus on the trends or themes I see in our enterprise customer base – trends and themes which I believe will ultimately have an impact on enterprise developers," While it could be argued that I work for an enterprise (we have 4,000 employees), I'm pretty much a solo developer and currently the sole user of Borland tools of any stripe. Saying you focus on enterprise level needs doesn't say you ignore individual or "professional" (to use Borland SKU titles) needs, but you also aren't calling that out. Posting on the Borland Developer Network, I'm guessing a significant proportion of the visitors are not of the Enterprise variety. More sensitivity might be in order.

"my “give a moose a muffin” type thought processes" - oh, my. Who moved my cheese? Where are the Fish Sticks? Is it time to Sharpen the Saw? What management improvement fad shall we quote this week? Yes, I know it's a children's book (give a pig a pancake, mouse a cookie, etc.). The post opens with an implicit devaluation of non-enterprise customers, has an interesting, if convoluted, middle, and closes with the kind of language I've only experienced from high-dollar management. The kind that comes in from out of state for lots more than their predecessor, tells good stories, has all the right buzzwords, and leaves six months later without actually accomplishing anything. Other than resume padding.

I'd like to meet in person one day, hopefully at a Borland DevCon. I'd like to be proven wrong.


# re: All Hail the Red Queen...
9/12/2005 2:47 PM by Chris Cheah
I would have to agree with Brion. I just don't get it. Is Borland CTO's position evolving into a marketing strategist and spokesman for new thought processes?

When I buy a technical book, I usually look for the one containing the fewest pages and focussed exactly on what I can learn and understand. Writng a good Blog is no different. Pick your audience. In this case BDN readers are usually hard core developers looking to learn more on what and why Borland and Borland products/ solutions can or will benefit their jobs.

From your Blog feedback so far, we think you may need to adjust your strategy on what the CTO title means to developers using Borland's products. Many of us would like to see the CTO give a clear cut vision on a winning Borland strategy for product development instead.

Sincerely

Chris


# re: All Hail the Red Queen...
9/13/2005 9:00 AM by Larry Drews
Jesus, you guys, get your heads away from your monitor for a few minutes. There is really a complex world out there that we live in. I am happy to hear that someone with some influence at Borland is thinking about such things rather than just what is the next version of IntToStr.

We may be busy laying down the railroad tracks, but someone has to figure out that we need to build a tunnel through the mountain just around the bend and get that effort started so that when we get there we don't have to stop and wait.


# re: All Hail the Red Queen...
9/13/2005 9:56 AM by Z
I think nobody understood, this isn't the Borland CTO speaking, but a modern philosopher posturing as him after stealing his blog password which was written on a post-it forgotten under the fridge.

As most philosophical texts, this isn't meant to have any sense at first, but in a few decades, fellow philosophers will look back at it and say "this is the light that guided the world out of its darkness", or something obviously close, we reckon. - Z out


# re: All Hail the Red Queen...
9/13/2005 10:15 AM by Trevor de Koekkoek
Z: Funny post. This was a much kinder way of saying what I had in mind.

-TdK


# re: All Hail the Red Queen...
9/13/2005 10:37 AM by Peter Morris
You're damned if you do, and you're damned if you don't.

Blog about irrelevant things and you will receive complaints that you are on the wrong subject, blog about relevant things and you will receive complaints about the detai!

I will just say this. Write about whatever you want to (your dog, your cat, etc), if you bore me then I will stop reading your blog :-)


# re: All Hail the Red Queen...
9/13/2005 1:16 PM by Bob M.
Patrick, I appreciate you talking the time to blog and respond to some of the comments. I'm really disappointed with the direction that Borland has gone. I don't see any future in .Net. I would like Borland recapitalize and get back to the basics that made the company great. I'm talking about providing high quality development tools. These have really been neglected over the past several years. Check out the newsgroups. It took an "unofficial patch" to get Delphi to work withtout crashing. Why does Borland have such difficulty unleashing the potential of its community base? So many users have contributed to QualityCentral but by and large their work is ignored. Why can't quarterly bug fixes be released from the QC contributions? Bill Gates described the concept of a "downward spiral" in his autobiography. I believe this is what is happening to your company.
# re: All Hail the Red Queen...


9/13/2005 2:13 PM by Trevor de Koekkoek
If I can still comment after being negative before, I would like to suggest the opposite of Bob M. Namely that there is a huge future in .NET and I would like to see more focus there than in the Java space. I don't see Open Source as being profitable for Borland. It's fine to have offerings there as well, but I would like to see are complete software development solutions in the .NET space along with whatever is happening in the Eclipse/OpenSource space. .NET has a huge edge when it comes to productivity and UI development.

And I'd like to see a clearer message other than the leader in "Software delivery optimization". That really sounds like a sound-bite that has, well... no bite.

-Trevor


# re: All Hail the Red Queen...
9/13/2005 4:50 PM by Alam Remsay
What a completely incoherent post.

God help Borland if their CTO is
drunk on the fine madness of marketing speak.


# Meaningless verbiage
9/13/2005 5:02 PM by Alam Remsay
Why post so much verbiage without saying
anything ? Is pay at Borland now by the word ?

You should go back, re-read this and think about the audience you are writing this for.
I have qualifications in business management but still feel that this is completely incoherent and truly inappropriate if you are trying to communicate with customers-developers. This is a prime example of Borland being out of touch with the developers who are
your last remaining customers.

Ramblings about "Cyberphysics" and "optimal commercial differentiable value" are not going to enhance customer confidence in the bafflingly counter-productive steps that your company is taking.

Perhaps you should be addressing the issue of why your company is producing buggy and unusable product instead of quoting from Management 101.


# re: All Hail the Red Queen...
9/14/2005 6:24 AM by Ed Daniel
Brion, I concede - I somehow remember seeing a different URL - must be going senile earlier than anticipated.

-------

Thanks for the extra words Patrick - I think you echo what other people in similar roles are thinking right now about your interest in what tomorrow's software house will look like and how it will behave.

Understanding who is the customer for Borland could be the hardest challenge - politically at least: is it the developers who use Borland tools or the people who hire the developers that use Borland tools?

Of course it's both, at present.


# re: All Hail the Red Queen...
9/15/2005 8:09 AM by ed daniel
BTW I've been following a great thread on economic risk theory relating to software project management over at the agile-management group on Yahoo!

http://groups.yahoo.com/group/agilemanagement/message/2566?threaded=1



# re: All Hail the Red Queen...
9/16/2005 9:55 PM by Richard Grossman
The responses here do not demonstrate anything wrong with the Borland CTO, but they very clearly demonstrate what is wrong with "Joe Programmer": they think they work in some kind of artistic vacuum isolated from economic concerns.

The best programmers ALWAYS look at each task as a potential invesmtent of their time and energy and weigh the benefits, risks, and costs.

The majority of the guys posting here will be working at Walmart and bitching about how "foreigners" are taking their jobs and IT has gone to hell.

Trust me, when they built ENIAC, hell, when they tried to build the DIFFERENCE ENGINE, they had a clear idea of an economic benefit -higher value output than the sum of the inputs.

You guys should take up street-violin or mime, where you can pursue your artistic goals free of economic constraints, and spend your days cursing the people who walk by without throwing you some pennies....


# re: All Hail the Red Queen...
9/16/2005 10:11 PM by Richard Grossman
Patrick Kerpan wrote:

"SO…since option theory is increasingly used in other domains to understand types of probabilistic risk exposure I was wondering if it is about time to have a more formal, statistical approach to product management given what I believe is the increasing dimensionality of that problem. Does this affect developers directly? "

YES

A perfect example is this theory:

I believe it is no longer worthwhile to invest much time at all in learning any vendor's proprietary IDE, language, or development product.

The revs come to fast to get a return on that investment.

Typically, the problems you invest in solving (via libraries and approaches) go away when the next product version comes out and automates the process or removes the obstacle you just invested months or years in resolving.

We're starting to see the product-ization of what once were skill sets. So a company or group of programmers that really knows grids, or refactoring, or web-sessions, or security, turns that skill into a product that can be used by any developer.

At one time, these efficiencies and productivy tools provided by an IDE and a language plus maybe a few add-ons. Now the add-ons are taking over and the IDE is becoming just a plug-in shell.

Hence Eclipse.

Microsoft will either open up Visual Studio to being an open plug-in environment for .Net or else they will lose out to an Eclipse.Net approach.

There are too may ideas out there struggling to be tried (and to get to the market) for any one IDE/language to embody them all.

Only as a successful patchable framework, an IDE/language.

Seen this way, Delphi's real problem (all the other gripes aside) was that the IDE SDK was never stable, consist version-to-version, or easy to work with.

I'm guessing it's too late and Delphi should follow Chrome into VS or become the "Chrome" of .Net.

Borland needs to provide products that respond strongly to the self-directed developer's risk-assessment, ROI, and time-to-market considerations.

Patrick, I think your analysis is right on, and that you are asking the right questions.

Realistically, (though I've been a bit harsh towards them), even those who haven't a clue what you're talking about and don't let ignorance get in the way of their rants, will respond to products that produce the kind of economic benefits you describe, either by seeing the light or following the leaders.


# re: All Hail the Red Queen...
10/5/2005 10:51 PM by Z
There is a time when people should just retire, but rather, they are so convinced of having understood everything that they think themselve as beacons of truth and wisdom... and then, they start repeating the errors of the ancestors, the same errors they so gleefully exploited to ascend when they were younger.

Oh well, don't worry Mr Grossman, in as much time as it took you to get to where you are now, you will have understood it. Hopefully.


# re: All Hail the Red Queen...
10/30/2005 8:54 PM by Richard Grossman
Z: Post under your real name and people will take you (more) seriously.

And try not to come off like a wannabe Kahlil Gibran (launghing)