Monthly Archive for April, 2009

“No Evidence” and Breach Notice

According to ZDNet, “Coleman donor data breached in January, but donors alerted by Wikileaks not campaign:”

Donors to Minnesota Senator Norm Coleman’s campaign got a rude awakening this week, thanks to an email from Wikileaks. Coleman’s campaign was keeping donor information in an unprotected database that contained names, addresses, emails, credit card numbers and those three-digit codes on the back of cards, Wikileaks told donors in an email.

and

We contacted federal authorities at that time, and they reviewed logs from the server in question as well as additional firewall logs. They indicated that, after reviewing those logs, they did not find evidence that our database was downloaded by any unauthorized party.

I wanted to bring this up, not to laugh at Coleman (that’s Franken’s job, after all), but because we frequently see assertions that “there’s no evidence that…”

As anyone trained in any science knows, absence of evidence is not evidence of absence. At the same time, sometimes there really is sufficient evidence, properly protected, that allows that claim to be made. We need public, documented and debated standards of how such decisions should be made. With such standards, organizations could better make decisions about risk. Additionaly, both regulators and the public could be more comfortable that those piping up about risk were not allowing the payers to call the tune.

@Mortman MP3d on Threat Post

I’ll go ahead and promote David.  He’s interviewed over at Threat Post.  Pod/Talk cast it up!

In this episode of the Digital Underground podcast, Dennis Fisher talks with David Mortman, CSO-in-residence at Echelon One and longtime security executive, about whether we’ve become too reliant on compliance, the changing nature of the CSO’s job and how network security is like baking artisan bread. Really.

Congratulations, Open Security Foundation

The Open Security Foundation, creators of OSVDB and DataLossDB have won SC Magazine’s Editor’s Choice award for 2009.

It’s well deserved.

In other Open Security Foundation News, about a dozen people asked me how to get a stylin’ DataLossDB t-shirt. It’s pretty easy-donate. I think you get one at the $100 level.

Standing Still

Following up on Ben’s comment to s/green/secure/g,

infosec generally makes life /harder/ for people (at least in the short-term), all to keep bad things from happening.

I’ll argue it’s even worse than that.

Since “secure” is neither achievable nor a static state, it can never be done and standing still means falling behind.  One of the frustrations that people express to me about Information Protection is that it’s never “done.”

Every hour of every day, some new threat is identified or exploit published.  Every single one of them could produce anything from a “move along, nothing to see here,” to a patching frenzy to a horrible realization that someone’s architectural trade-offs just failed very badly, which is to say, “expensively,” and now a whole lot of time and money is going to be required just to get back to the same level of risk they (thought) they had before they read that last email or news item.

So the workload increment here to go from falling behind to static state is not just fighting the fight, but also includes knowing what new risks are coming up that need to be managed.

The ones in the media or blogosphere are easy to deal with and mostly consists of reading through the journalistic hype so you can explain to your management why they should or shouldn’t be doing something about it.

It’s the risks that the company takes onto itself in the course of doing business that are hard.  Very rarely does anyone ferret those out for you, and if they do, it’s either to get your blessing (which may or may not be deserved) or to help settle some internal political fight which has nothing to do with security.

Then, you have to assess those risks accurately and recommend a course of action to manage the risk.  While this will usually be “accept” or “tell the IT Operations team to do their job,”  sometimes it’s asking a line of business to add additional controls or IT to deploy additional safeguards.  Naturally, they will never admit to having time or budget for this until you’ve backed them into a corner by exhausting all alterntives.

Finally, you’ll need to do this every day and still have the strength to stand firm and avoid contracting “security fatigue” when all this effort doesn’t even get your organization to “secure”–only (hopefully) “secure enough.”  Until you read that next news article or open that next email, that is.

s/green/secure/g

Don’t miss this fascinating article in the New York Times, “Why Isn’t the Brain Green?” You can read it for itself, but then you hit paragraphs like this:

It isn’t immediately obvious why such studies are necessary or even valuable. Indeed, in the United States scientific community, where nearly all dollars for climate investigation are directed toward physical or biological projects, the notion that vital environmental solutions will be attained through social-science research — instead of improved climate models or innovative technologies — is an aggressively insurgent view. You might ask the decision scientists, as I eventually did, if they aren’t overcomplicating matters. Doesn’t a low-carbon world really just mean phasing out coal and other fossil fuels in favor of clean-energy technologies, domestic regulations and international treaties? None of them disagreed. Some smiled patiently. But all of them wondered if I had underestimated the countless group and individual decisions that must precede any widespread support for such technologies or policies. “Let’s start with the fact that climate change is anthropogenic,” Weber told me one morning in her Columbia office. “More or less, people have agreed on that. That means it’s caused by human behavior. That’s not to say that engineering solutions aren’t important. But if it’s caused by human behavior, then the solution probably also lies in changing human behavior.”

and ask…can we just substitute in security? One of the key messages in the New School (the book) is in the chapter “Amateurs study cryptography, professionals study economics.”

It’s a great article. I would suggest that we need a New School of Environmental Sciences, but 20 years ago, I was taking an environmental science course of study that included chemistry and biology, along with economics psychology and public policy.

It’s almost enough to make you wonder if Kuhn was right.

Breach Notification Law Across the World

Breach Notice Laws around the world.jpgData Breach Noti?cation Law Across the World from California to Australia” by Alana Maurushat. From the abstract:

The following article and table examine the specifics of data breach notification frameworks in multiple jurisdictions. Over the year of 2008, Alana Maurushat of the Cyberspace Law and Policy Centre, with research assistance from David Vaile and student interns Renee Watts, Nathalie Pala, Michael Whitbread, Eugenie Kyung-Eun Hwang and David Chau, compiled the data. The table represents a detailed survey of data breach disclosure requirements in 25 countries, conducted by surveying those current or proposed statutory or similar instruments setting out the nature and conditions of such requirements to give notice. The Centre hopes that the table will be useful to compare and contrast elements of data breach notification schemes.

The key data is in a table on page 7. You’ll have to download the paper to read it.


Via the Office of Inadequate Security.

Project Quant: Patch Management Metrics

Rich Mogull, Adrian Lane, (of Securosis) and Jeff Jones (of Microsoft) have started a “transparent” metrics project “to help build an independent model to measure the costs and effectiveness of patch management.”  They’re calling it (for now) Project Quant.  As you can probably guess, I’m all for transparent metrics projects, and I hope you’ll at least follow this, if not contribute.

What’s even more interesting news to me are two surprises that came with this announcement.  One -  I am somewhat pleasantly surprised Rich is going as far as to talk about modeling – good on him.  In large enterprises measuring things like coverage and effectiveness are gonna be probabilistic (if you’ve got a 50,000 machine patch-management program already, back me up on this).

Two – another surprise is that the announcement of this project on the securitymetrics.org mailing list has lead to a discussion as to whether

  • A patching metric project is worth it
  • If patching is worth it

The second bullet there seems pretty “flat earth” to me.  It seems like it’s proponent believes that IT MacGyvers out there can ignore patching and create system integrity using duct tape, chewing gum, and old pepsi can and SSL – and claim it will be more economically effective. Sounds crazy, right? I mean, either they’re completely nuts, or we’re all doing it wrong.  Needless to say this has created a somewhat long thread in my gmail.

Now, what’s interesting is that the fact that I have this long thread, to me, is evidence that the project itself has merit (validating bullet one, there).  If there’s that much to say about the subject in deductive theory (because obviously the IT MacGyver types don’t have strong inductive evidence to prove their point) then Project Quant is off to a good start.

God Speed, Rich, Adrian, and Jeff.  And if you fail, there’s always….

Evolution of Information Analysis

Real briefly, something that came to me reading Marcus Ranum over at Tenable’s Blog.

Marcus writes:

Usually, when I attack pseudo-science in computer security, someone replies, “Yes, but some data is better than none at all!”  Absolutely not true! Deceptive, inaccurate, and misleading data is worse than none at all, because it can encourage you to spend your time and energy barking up the wrong tree.

Let me propose the following evolutionary path towards information analysis:

Stage 1.)  “Yes, but some data is better than none at all!

Stage 2.)  “Not true!  It can be misinterpreted”

Stage 3.)  “Prior information usually has some informative value in context.  Have we done the right job in presenting uncertainty and context?”

The difference between stage 2 and 3 reminds me of the quote from IJ Good (who sadly just passed away this month) -

“The subjectivist states his judgements, whereas the objectivist sweeps them under the carpet by calling assumptions knowledge, and he basks in the glorious objectivity of science.”

The problem isn’t that we’ve got yucky/squishy/non-”actuarial quality” (whatever that means) data, the problem is in the statement of how prior information is interpreted and thorough identification of bias done in the research itself, and how uncertainty factors in the data are identified.

Black Swan-Proof InfoSec?

I came across an interesting take on Nassim Taleb’s “Black Swan” article for the Financial Times via JP Rangaswami’s blog “Confused in Calcutta“.   Friends and folks who know me are probably tired of my rants about what I think of Taleb’s work and what I think he’s gotten wrong.  But really, I find his FT article interesting as it’s giving us “principles” of how to “Black Swan-Proof” the financial sector.

So assuming Taleb’s got something here, and I really liked how JP applied the concepts to open source software development, I  figured we might find these principles to be applicable to our early attempts at information security management science.  So to borrow JP’s idea:

Taleb’s Black Swan-Proofing Principles Applied to Information Security:

1. What is fragile should break early while it is still small. Nothing should ever become too big to fail.

Taleb is talking directly about AIG and other financial services firms here.   I see applicability to network security and specifically wonder aloud if this principle wouldn’t be exemplified in a Jericho-esque approach.  That is to say, our perimeters are now large, porous, but by current security practices we make them too big to fail.  But when they do fail, they fail spectacularly.

2. No socialisation of losses and privatisation of gains. Whatever may need to be bailed out should be nationalised; whatever does not need a bail-out should be free, small and risk-bearing.

In his interpretation for Open Source software, JP says that ““losses” are borne by individual contributors, “gains” are shared by all participants.” I’m not sure that losses in Open Source software aren’t borne by all participants (vulnerabilities are distributed to all participants), but…

What I think Taleb is saying here is that in the current system he expects the taxpayer to bear all the risk and reap none of the reward (as directly as our outlay in taxes is taken from us).  In InfoSec, maybe we could suggest that the CISO’s office is at times set up to take all of the consequences of risk decisions made by other lines of business, but “gains” in risk reduction are difficult to reward back to IRM without a really, really advanced risk management program.

3. People who were driving a school bus blindfolded (and crashed it) should never be given a new bus. The economics establishment (universities, regulators, central bankers, government officials, various organisations staffed with economists) lost its legitimacy with the failure of the system.

Many of Taleb’s detractors talk about his work being ad hominem, almost seething rage at those who discredited him in the past.  Maybe so and maybe this clause is a little too close to that for direct rational interpretation.  But let’s play with it a little and see if there’s anything we might be able to stretch out of it.

If we strip away the political and personal nature of it, we might say that Taleb is saying we shouldn’t continue to do the things that are proven to fail.  We might say that InfoSec attempts to continue to do things that fail (see Gunnar’s post here), or that we continue to enforce draconian policies that reduce very little risk because they are “best practice”.

4. Do not let someone making an “incentive” bonus manage a nuclear plant – or your financial risks. … No incentives without disincentives: capitalism is about rewards and punishments, not just rewards.

We might interpret this clause to suggest that executive management be rewarded *and penalized* for getting risk tolerance (or the resources needed to achieve tolerance by the CISO) wrong.

5. Counter-balance complexity with simplicity. Complexity from globalisation and highly networked economic life needs to be countered by simplicity in financial products.

I think a lot of people would like to take legacy systems, applications, and networks – light them on fire, toast some marshmallows, and start all over from scratch.  We build and inherit complex systems that manage simple but valuable information (valuable both to the company and to the attack community).  In a sense, we’re all sitting on CNO (Collateralized Network Obligations) – complex information exchange vehicles and we don’t really have 100% certainty about what’s in them or when they’ll blow up.

Unfortunately, I don’t have any answers here.  Can’t help.  And guess what?  There are “clouds” on the horizon (sorry, I do realize how tiresome these cloud computing metaphors are getting).

6. Do not give children sticks of dynamite, even if they come with a warning . Complex derivatives need to be banned because nobody understands them and few are rational enough to know it.

OK, so given what I wrote above, we can’t take the network away from the business (no matter how some ‘cybercop’ types try).

But maybe we can apply this principle to suggest that we should make certain that risk expression is done for IT projects.  C&A processes with data owner sign off might help the business at least understand why we need to test the web app before it goes into production.  Using risk expression to remove “childlike” naivete from the other LOBs.

There’s also an alternate way to interpret this for network security that might make sense.  In talking about applicability to Open Source Software, JP discusses experience as a means to generate the desired “maturity”.  We might say that people making security decisions should have security experience.  Maybe all up and coming CIO types should spend time as a CISO first?

7. Only Ponzi schemes should depend on confidence. Governments should never need to “restore confidence”.

What I think Taleb is saying here is that an investor who is certain that all real investments carry risk will know that there is no “risk free” return.  In InfoSec, I see this as meaning that regular, rational, and real risk communication is required (sorry for the alliteration) to executive management.  Or else, they’re investing in a Ponzi scheme that promises to return absurd rates of C, I, & A.

8. Do not give an addict more drugs if he has withdrawal pains. Using leverage to cure the problems of too much leverage is not homeopathy, it is denial.

When I read this, I thought immediately of how some organizations try to answer the problems created ultimately by the complexity of the network environment tend to then throw complex security architectures at the problem.  It’s the “add another control” addiction we’re all familiar with.  How many laptop security agents do you need before you’re “secure” enough?

I once saw a smart organization that was constantly asking – “if we spend money on this, what do we decommission?”

9. Citizens should not depend on financial assets or fallible “expert” advice for their retirement. Economic life should be definancialised.

Yeah, I don’t know about this one (both in terms of his recommendation there for the financial crisis and in terms of how we might address it).  JP, in talking about applying it to open source software, says “Rely on something real. Code. Code is King. Not slideware.” If I’m reading this correctly, Taleb is suggesting that we throw away risk analysis for that which we care about the most and cannot stand to lose and just build total security.  Unfortunately, we all have budgets.

10. Make an omelette with the broken eggs. Finally, this crisis cannot be fixed with makeshift repairs, no more than a boat with a rotten hull can be fixed with ad-hoc patches. We need to rebuild the hull with new (stronger) materials; we will have to remake the system before it does so itself.

Applied to network security, that suggests that we begin to remake networking & computing in a secure manner (love the allusion to ad-hoc patches, remind you of anything?)

A Curmudgeon is a Little Confused by the 2009 DBIR

I’ve given Vz’s DBIR a quick perusal.  The data are interesting indeed and the recommendations are obvious.  There is little new here in the way of recommendations – I guess nobody is listening or the controls are ineffective (or a bit of both).

Regardless, I have a few items that confuse and irritate me a bit:

1)  While only 17% of attacks were considered ‘highly difficult’, they account for 95% of the records breached.  Would the recommendations have fixed this issue?  I can’t imagine, since the recommendations seem more focused on what I would consider fixes for simple attacks.  It does appear that fixing SQL injection issues is the obvious first step.  How long have we as a profession been talking about that one?  Someone has failed and it is us.

2)  What is meant by ‘breach’?  The report talks about ‘breaches’ and then mentions that records are also breached.  What is a ‘breach’?  A few definitions would be helpful for simple-minded folk like myself. % of caseload also seems to be an important metric. Are we worried about being penetrated, the amount of cases that Vz has to work, costs incurred by the involved parties or are we worried about actual data theft/destruction? Certainly all, but some should be a higher priority than others and some are more relevant than others.  There appears to be a bit of comparing apples to oranges in this report and more clarity on the terms we’re talking about would be welcomed.

3) “The majority of breaches still occur because basic controls were not in place or because those that were present were not consistently implemented across the organization. If obvious weaknesses are left exposed, chances are the attacker will exploit them. It is much less likely that they will expend the time and effort if none are readily apparent.” – This important statement isn’t supported by the data. See my point #1 above.  I like to think that attackers are lazy; looking for the easy way in, but it appears that attackers will expend the time and effort necessary. It is their job afterall and it appears that there are at least a few out there that are professionals. The data that support this is the fact that 95% of the records breached occurred via ‘highly difficult’ attacks.  Perhaps ‘highly difficult’ attacks require little time and effort?  Do the recommendations around basic controls actually make a difference if 95% of breaches are ‘highly difficult’?  Maybe basic controls are ‘highly difficult’ to bypass; I’m just not sure.  Can script kiddies now execute ‘highly difficult’ attacks now?

4) Where are the losses?  The data are confusing to me because they state that 31% of breaches occurred in Retail and 30% in Financial Services.  However, Financial Services accounted for 93% of records compromised.  To my point #2 above – what the hell do we mean by breach?  Was there data loss?  What was the actual cost involved with the 285MM records compromised?  Did people/companies have to pay for Vz services, data recovery, new cards being issued, identity theft clean-up, etc?  SHOW ME THE $$!  What are the real $$ losses here?  A breach of data may be necessary for $$ losses, but it isn’t sufficient.

5) Finally, just to be a total jerk about it – I love figure 3.  Let’s thrown in a gratuitous graph that has no meaning and tells us nothing. I guess we may, someday, find a correlation between number of employees and insider initiated events.

I guess you could summarize my confusion and bitterness up in a couple items.  First, it doesn’t appear that we’re clear on our terms which leads to overloading and a bit of confusion.  We’re grabbing loads of data and then trying to figure out how to make a cool report with them.  Second, we should be trying to express losses in terms of the monies expended.  Otherwise things look crazy with big numbers that lack context being thrown about.  With all the hundreds of millions of records compromised each year hasn’t everyone been compromised already and we’ve lost the game?

A close friend pointed out that Peter Tippett, VP of Research and Intelligence for Verizon Business Security Solutions, described this report as “a wake-up call.” Really? As opposed to all the other reports that demonstrate how messed up the situation is? If we really wanted to wake up from this we would have awakened long ago rather than continuing to be Rip-Van-Insecure-Winkle. Sleep on, brothers and sisters, sleep on….it’s only a few hundred million records that we can’t seem to figure out the $$ value of.