Author Archive for Russell

Page 2 of 4

Time to update your threat model to include “friendly fire”

mousecomestodinner-717479In case you haven’t been following all the talk about cyber war, many people are advocating “offensive cyber capability” — which basically means “hack them before they hack you” (c.f. here, here, and here). If you work in InfoSec outside of the military, you may be thinking that this doesn’t apply to you.  Don’t be so sure.  I think it’s worth considering for every organization.

Consider this new development: “U.S. Military Developing Hacking-for-Dummies Cyber-Warfare Device“:

Apparently, there are several [offensive hacking] devices currently being developed behind closed doors specifically for such [offensive] purposes, but the one Aviation Week talks about is intriguing.  It is basically a highly complex hacking tool designed for the unexperienced that is to turn soldiers into veritable script kiddies. Granted, script kiddies with a lot of firepower.  [Wired article here]

This expensive hacking gadget can be carried around in the backpack on the battlefield and used to assist in missions that might require breaking into wireless networks, such as the ones used for VoIP or satellite communications. However, the icing on the cake is the ability to hack into SCADA (Supervisory Control and Data Acquisition) systems. These systems are used to administrate industrial equipment at power and chemical plants, nuclear facilities, oil refineries, etc., so one can easily imagine how that would be extremely valuable.  [emphasis added]

Here’s the twist:  what if the potential target knows that such attacks may be coming?  They could sets up a deceptive defense to counter the “hacking gadget”, redirecting it to another organization’s network.  The most effective tactic would be to redirect or spoof to a similar network elsewhere in the world (e.g. SCADA, as mentioned above).  Because the people running the “hacking gadget” are equivalent to “script kiddies”, they won’t have the skills to know whether they are attacking the real enemy network or the spoofed network.   Thus, instead of shutting down a chemical plant in Country X (enemy), the soldier-script-kiddies might be shutting down a chemical plant in Country Y (ally), or some other spoofed target.

OK… this particular scenario may be technically infeasable, or it may play out differently.   Someone more knowledgable than me could fill out the specifics.  My point is that arming offensive “script kiddies” creates a risk because the could easily “misfire” and not know it.  Outside of this “hacker gadget”, there are plenty of other friendly fire scenarios.  It’s worth considering them.

Last point: Let’s hope that offensive capabilites do not become prevalent in non-military organizations.  That could lead to a “Mad Max” cyber world, which Bruce Schneier warns against here.

[Update]  While I admit that my SCADA spoof scenario may be too fanciful, I found another example of “friendly fire” that is much more plausable and potentially widely damaging:

One scheme has been proposed that a nation, particularly the United States, could in times of extreme need, induce their software industry to push updates to their installed base that included malware that could be used to disable their enemy’s computers. Imagine the impact Microsoft, Cisco, or Oracle could have if they used their automatic update capability to secretly infect millions of machines with back doors, Trojan horses, or kill switches.

I wonder how the automatic update program would differentiate between “enemy computers” from every other computer.  Oh, I know!  Just look at registry entries: “Organization = Al-Qaeda”.  :-)

Can quantitative risk estimation serve as a guide for every-day policy decisions?

[Update: The main purpose of this post is to present and demonstrate a method of risk estimation and quantification to support practical policy decision.  The email password policy is just a simplistic case to facilitate the debate.  I also modified the blog post title and the text below to make it clear that this method is aimed to support quantitative risk estimation.]

Our favorite colliquist, Anton Chuvakin, posted a provocative challenge in his blog post “Is Risk Just Too Risky?” :

What is the risk-driven, correct frequency of changing my email password?

<crickets…. silence… more silence>

Yes, we all can quote that “PCI DSS says 90 days” or “whatever regulation says 30 days”, but what does risk say? What actuarial information we need – if we are to define risk through probability of loss? What info about my email usage? Value of information stored there? Frequency of attacks on other similar email accounts? Chances of attack success? My approach to protecting the password? My personal password reuse “policy?” Anything else? On a related note, maybe this is simpler: what is my risk [of having the account compromised] if I change the password every 30 days, 90 days, 300 days?

So, any idea how to go about it?

This little experiment might well show us that “risk-based security” is an awesome thing – but not one achievable in this world today… [emphasis in original]

I wanted to blog about this, but hadn’t collected enough specifics.  Now I can, thanks to the blog conversation by David Mortman, Rich Mogull,  Chris Popper, and “Steve”, we have some smart/experienced people providing the needed detail.

Below, I offer a method for reasoning in order to estimate relative risk of alternatives that is compatible with quantitative risk analysis management, but doesn’t require massive amounts of risk calculations.  I use the conversation by Mortman, et. al. as an example of this method in action (armchair-style).

Continue reading ‘Can quantitative risk estimation serve as a guide for every-day policy decisions?’

Miscommunicating risks to teenagers

Security programs that depend on 100% compliance are a bad idea, especially if they depend on 100% compliance from people who are proven to be poor in compliance capabilities.

Case in point:  I saw a documentary about “Abstinence only” sex education programs for teens in the public schools of New Mexico — one negative example in Albuquerque and one positive example in Socorro.   (This is federally funded.)  Skipping over the most aggregious errors and misstatements in these programs, I noticed one big blooper regarding risk estimation and risk communication.

The educators who developed and deliver this program emphasize the failure rate of condoms as argument against relying on them.  In contrast, abstinence-only is touted because it is 100% effective in preventing unplanned pregnancy and all the negative stuff that goes along with it.  Funny thing–they never mentioned the failure rate of abstinence-only when implemented by teenagers!     Sure, you can tell teenagers to be abstinent and they can even commit to it, but would you bet on it?   What odds would you demand for a large bet(say, $100,000 from your bank account) that a large group of teens would remain abstinent for five years?  There are plenty of studies (e.g. here and here) that demonstrate the limited capabilities of teens to avoid risky behavior, control impulses, rationally balance short-term gain against long-term pain, think beyond a short planning horizon, resist peer pressure, etc.    For most teens in the US, their “failure rate” (i.e. failing to avoid risky behaviors) is greater than 0%, and in cases of “multiple-risk adolescents ” the failure rate is far above 0%.

full-body condom

I would bet that condoms are much more reliable than the average teenager’s commitments to eschew immediate pleasures.   Of course, using both would be much more reliable than either alone.   This is “defense in depth”, of course.  Better still, take it to the max and advise that they add a “full-body condom”.  Then they would be “fer sher,  fer sher!”, as the Valley Girl might say. :-)

Hackers treated as credible sources of information (D’oh!)

The Wall Street Journal and 103 hundreds of other news outlets have published articles about the stolen/leaked email files from the Hadley Climate Center University of East Anglia (UEA) Climate Research Unit, in the UK.  The blogs are going nuts.  Sadly, there is no critical investigation or reporting about the credibility of the leaked email files.  Instead, all the news outlets are all caught up in the debate over whether this proves that the Global Warming science is a con job and conspiracy.  (A sampling of the more moderate reports: Washington Post, Associated Press, and Christian Science Monitor.   The blogs and tweets are more rabid:  e.g. proof that “Al Gore lied!”)   

DohEveryone is treating these stolen/leaked documents as real and undoctored, without any real evidence.  I couldn’t find any critical/questioning articles when I did a web search.  To this, I can only repeat Homer Simpson’s exclamation when he is hit in the face with (his own) stupidity:  “D’oh!!“.

For example, the WSJ blog stated that the emails were confirmed as “genuine” by the Director of the breached organization, but a close reading of the source news article shows that the Director only states that the files “appear” to be from his organization.   Hadley Climate Center UEA Climate Research Unit hasn’t actually had a chance to review the posted files or even investigate the breach. 

Also, no one has questioned the claim that this was the act of “hackers”.   The WSJ blog called them “Russian Black Hats”  based on the report that the ZIP file first appeared on an FTP server hosted in Russia.  Ridiculous!    It is easy for anyone located anywhere to upload files to an FTP server with a Russian domain name. 

I did find a few security bloggers commenting on this incident, e.g. Graham Cluley, and they are more reserved about the implications of this incident, given the lack of real information.  Hopefully, more security experts will speak out on this in the coming days.

Now a rant for the uncritical news organizations and bloggers:

NEWSFLASH — Anyone who has the motives and skills to steal private documents and to upload them on a Russian FTP server in order to generate a public scandal also has the motives and skills to “doctor” those documents .  DO NOT trust their content until it is proven genuine!

This is news/publicity incident is just more evidence of wide-spread misunderstanding about trust and credibility regarding online information, and also misunderstandings about nature of security breaches, Black Hats vs. White Hats, etc.    This is another case of the meme: “If it’s on the Internet, it must be true”.  Sadly, the “echo chamber” of free Internet news media and “advocacy journalism” only makes it worse.   Takeaway: This is yet another call-to-arms to security experts to provide evidence-based analyisis that educates the broad public and the institutions that serve them.

[Update -- Corrected the name of the breached organization]

[Update 2:   See Comment #2 below for additional "connect the dots" that make the insider attack most plausible, not a "Russian Black Hat".]

The cost of false positives in detection (lessons from public health)

More is not always better.  This is especially true for screening and detection systems.

False positives can be very costly in a sneaky way.  For example, they can cause users, administrators, or managers to go around or turn off the detection/protection mechanism.  Here are a few publicized examples of false positives in information security:

We need to be able to steer away from policies, designs, or controls where the detection/prevention costs are greater than the benefits.  No security measurement or management program can be considered complete unless it includes assessment for the likely costs of false positives.

true vs false positiveWe can learn lessons from recent pronouncements from public health organizations: one on mammograms for breast cancer screening, and the other on pap tests for cervical cancer screening.  Both are a result of statistical analysis of the total costs and total benefits of testing.  Both reports recommend less frequent and/or later testing in most cases, basically because the cost of frequent testing (including false positives) exceeds the benefits in risk reduction.  Here are quotes from summary articles:

On Mammograms: “While many women do not think a screening test can be harmful, medical experts say the risks are real. A test can trigger unnecessary further tests, like biopsies, that can create extreme anxiety. And mammograms can find cancers that grow so slowly that they never would be noticed in a woman’s lifetime, resulting in unnecessary treatment.  Over all, the report says, the modest benefit of mammograms — reducing the breast cancer death rate by 15 percent — must be weighed against the harms. And those harms loom larger for women in their 40s, who are 60 percent more likely to experience them than women 50 and older but are less likely to have breast cancer, skewing the risk-benefit equation.” [emphasis added]

On Pap testing: “The tradition of doing a Pap test every year has not been supported by recent scientific evidence,” Alan G. Waxman, MD, of the University of New Mexico in Albuquerque, said in a statement. “A review of the evidence to date shows that screening at less frequent intervals prevents cervical cancer just as well, has decreased costs, and avoids unnecessary interventions that could be harmful.” [emphasis added]

Similar conclusions have been reached regarding other medical screening tests, including colonoscopy, PSA test (for prostate cancer), chest X-ray (lung cancer screening for smokers), and full body scan (for everything!).  In nearly all of these situations, the forces that were promoting more frequent and earlier testing were ignoring or downplaying the consequences of false positives.

If only  the information security community had as much well-organized data and well-controlled tests and experiments as our public health brethren, we would be able to make better informed decisions based on evidence and not prevalent beliefs.  This is the direction we need to go.

[Update: Here's a good article from the Wall Street Journal on the cost aspects of risk/benefit analysis in these cases.  Great quote: "Americans feel that in health care, more is always better and more means better outcomes," she said. "That's just not true, but it's counterintuitive to a lot of people."]

[Update 2: Bruce Schneier has a good post on the significance of false positives in evaluating detection mechanisms.  In the second half of the post, he gives a fairly clear example of how even a "high quality" detection system (= very low false-positive rate) can still yield poor results when the underlying phenomena are very rare, even if you have huge piles of data.  Great line: "It's a needle-in-a-haystack problem, and throwing more hay on the pile doesn't make that problem any easier."]

Can’t tell the players without a program

How can ordinary folks tell the good guys from the bad guys?  Case in point: the online service Virscan.org .  I stumbled upon last week while trying to help a friend with her malware problems.  Looks like a nice, simple service that scans uploaded files using multiple AV software with latest signatures (25 total).  But then it dawned on me that it might be much more useful to bad guys (malware writers and distributors) than for good guys.  They could use it as part of their development/test cycle to refine their malware so that it is not detected by any of the AV services.   Easy, peasy!

paper_thin_disguiseWho does Virscan.org serve?  Who supports it financially?  Is it really a Black Hat operation, or just a well-intentioned White Hat operation that is easy to subvert?  How would I or anyone know? 

According to Alexa, 70% of Viruscan.org’s visitors are from China, where it is the 5,973rd most popular web site.  Hmmmm, makes me suspicious.  Reviews and evaluations are here , here, and here.  It’s hosted in China, and appears to have been in existence since the summer of 2007.  But this information isn’t conclusive.  I’m still scratching my head.

I wish there were some sort of map of the Black Hat ecosystem that would reveal the existence and role of such “fellow traveler” services that appear legit’ but aren’t.  This would make it easier for everyone involved in security to know who they are dealing with — White Hat, Black Hat, and otherwise.   If anyone knows of such a map, please give me a link.

[Update: This isn't the same as http://www.virusscan.org which redirects to  http://www.mcafee.com/us/ .  McAfee has a product called Virus Scan. ]

[Update #2: On further thought, virscan.org could even be a super-secret covert white hat operation acting as a honey pot for malware developers and their malware code, masquarading as a black hat service which is masquarading as a white hat service.  Whoah!  Spooky stuff! :-) ]

CFP: 9th Workshop on the Economics of Information Security (WEIS)

June 7-8, 2010 Harvard University, Cambridge, MA, USA.   Full call for papers and submission information is here

Important dates:

  • Submissions due: February 22, 2010
  • Notification of acceptance: April 2, 2010
  • Workshop: June 7-8, 2010

“The Workshop on the Economics of Information Security (WEIS) is the leading forum for interdisciplinary scholarship on information security, combining expertise from the fields of economics, social science, business, law, policy and computer science. [...] This workshop will build on past efforts using empirical and analytic tools to not only understand threats, but also strengthen security through novel evaluations of available solutions.[...]

“We encourage economists, computer scientists, business school researchers, legal scholars, security and privacy specialists, as well as industry experts to submit their research and attend the workshop.

“Suggested topics include (but are not limited to) empirical and theoretical studies of:

  • Optimal investment in information security
  • Online crime (including botnets, phishing and spam)
  • Models and analysis of online crime
  • Risk management and cyberinsurance
  • Security standards and regulation
  • Cybersecurity policy
  • Privacy, confidentiality and anonymity
  • Behavioral security and privacy
  • Security models and metrics
  • Psychology of risk and security
  • Vulnerability discovery, disclosure, and patching
  • Cyberwar strategy and game theory
  • Incentives for information sharing and cooperation

“We highlight two key areas of particular focus for this year’s workshop. First, we encourage submissions that consider the design and evaluation of policy solutions for improving information security.  Second, given the importance of data-driven decision making, we encourage submissions with empirical components. A selection of papers accepted to this workshop will appear in an edited volume designed to help policy makers, managers, researchers and practitioners better understand the information security landscape.”

On smelly goats, unicorns, and FUD

In a pithy post, Anton Chuvakin uses colorful metaphors as caricatures for our debate: 

Q: If you ride a smelly, ugly goat along the road and then meet  a  handsome stranger who promises to give you a new ride: a beautiful unicorn that can fly, teleport, butt enemies with its horn and doesn’t need any cleaning, should you take it?

A: No! Unicorns are mythical creatures. Please keep your goat for now :-)

This sort of rhetorical tactic is popular among slimy politicians, to wit:  “If you vote against my bill, you are voting in favor of mass rape of barn yard animals, and taking food out of the mouths of starving babies.”

There’s a real message here.   Anton is saying that the New School and/or risk management approach is impossible in principle and therefore is folly at all levels, like the quest for perpetual motion machines or large-scale time travel.  He is skeptical to an extreme.

dino unicorn - Tsintaosaurus spinorhinus

A real unicorn, though now extinct, refutes the claim of impossibility

At the risk of extending Anton’s metaphor too far, I’ll point out that unicorns (of some sort) are not impossible in principle, only non-existent in recent times.  As evidence of their potential existance, I offer Tsintaosaurus spinorhinus, a real dinosaur found in China. I found this artist’s impression of the dinosaur, nicknamed “the Unicorn Dinosaur” because it has some elements in common with the mythical unicorn (“the traditional unicorn also has a billy-goat beard, a lion’s tail, and cloven hooves—these distinguish it from a horse”.)

Moral: just because something doesn’t exist right now doesn’t mean it’s impossible.  Back to the real debate…

No one is seriously advocating NewSchool or Risk Management as having magical properties, or claim that they are perfect or fully formed.  I, for one, have been very vocal and public about the unsolved research problems .  I welcome and encourage skepticism.   It may turn out that certain approaches or methods are indeed impossible or infeasable.  Fine.  Let’s find that out.  But there is no value in debates that are based on caricature and strawmen.

Those of us who advocate new methods are arguing that the current “smelly” methods just perpetuate the problem of poor security, even if you get periodic “wins” through FUD and other tactics.   We are arguing that the new methods are more promising, in spite of their current difficulties and unsolved problems.

I’ll close with my own colorful metaphor: FUD and similar tactics are like peeing in a swimming pool.  They may make you feel good at the moment and you may get away with it for a while, but if enough people do it, eventually everyone is swimming in piss.    There’s a great book called The Self-Defeating Organization that describes this process and how it is one pattern (among many) that leads to downward spiral in organization performance.

[Update:  From past communications, I believe that Anton has most objections to "the risk management approach" rather than the "New School approach".  They overlap somewhat, but aren't identical.  See Adam's comment, below.]

Apologies to Richard Bejtlich

In the second half of my recent post  Just say ‘no’ to FUD, I described Richard Bejtlich’s post at Tao of Security as “FUD in other clothing”.  As Richard and Wade pointed out in their comments, this was over-reaching.  I apologize.

There is an element of FUD in Richard’s post, but it was a small element.  I latched onto his use of the concept of “existential threat”:

I have seen IT departments aligned under security because the threat to the organization was considered existential.

Of course, Richard isn’t saying that every organization should be run this way or that every organization faces existential threats due to information risk.

But I do wave the FUD Flag because the phrase ”existential threat” is wa-a-a-a-a-ay over used in security and information protection circles.  As a basis for comparison, consider a case history of a real existential threat (non-security) — the Lehman Brothers liquidity crisis they faced just before the Sept. 15, 2008 collapse.  The other large investment banks faced a similar threat through a “domino effect” of collateral calls.  By this standard, existential risk due to InfoSec is extremely rare, in my opinion.  Yes, there are a few organizations that face existential risk due to threats to their information systems, but I would argue that such situations are extremely rare.  It’s interesting to note that one of the most likely existential threats rarely gets any attention from InfoSec professionals, namely the intersection between executive fraud and information security, a.k.a. the Uber Insider Threat.   (Scenario: SocGen mated with WorldCom and TJX, with some Madoff mixed in.)

For, the vast majority of organizations, information risk is “parasitic” to varying degrees.  Security breaches are a drag on performance.  The really bad ones may be extremely painful, but they won’t be severe enough to drive you out of business or to destroy your economic ecosystem unless you are already on the brink of collapse. 

Therefore, waving around the phrase “existential threat” smells like FUD to me.

As for Richard’s main points about what is really needed (“Leadership”) and what it looks like, I disagree for the reasons I stated.  Gunner Peterson has called this approach “The People’s Republic of IT Security“:

the People’s Republic of IT Security is just waaaayyyy smarter than the business folks, [so] if we just gave IT Security control over all business strategy the stock price would go right to $120 [from the current price of $10].

I made the mistake in my post of lumping both objections (FUD and People’s Republic) under one heading (FUD).  For that, I’m sorry.