CISO Survey 2014 Questionnaire

CISO Survey 2014 - final version

Here to the live Survey: [1]

Page 1. Introduction

Thank you for taking the time to participate in the OWASP CISO Survey 2014, created by the Open Web Application Security Project (OWASP).

There is no doubt that application security has become a serious concern in almost every industry. We created this survey to provide you with an opportunity to compare your organization with others on important application security issues and gain insights for making key decisions. The survey questionnaire consists of 36 questions. They relate to four areas of threats & risks, investments & challenges, tools & technology and governance & control within your organization. Your participation in responding to this questionnaire should require less than 20 minutes of your time. At the conclusion of the survey, the combined results will be publicly available on the owasp.org website. This survey can be conducted by keeping your profile completely anonymous. In case you are willing to provide your contact information, we will make sure that personal identifiable individual information and individual company information will not be disclosed in the survey report and be treated as confidential.

Instructions All responses in this survey are optional, but for the completeness of the report, please try to respond to all questions in the questionnaire. Please feel free to add additional information and views from colleagues in your organization. Deadline for submission of the completed survey is 30 September 2014. Thank you for your participation!

Page 2. Threats and Risks

1. Given the current threat landscape and economic environment, do you perceive a change in the threats facing your organization? (Increase, Same, Decrease, Don't know)

• External attacks or fraud (e.g. phishing, website attacks)
• Internal attacks or fraud (e.g. abuse of privileges, theft of information)

2. Targeting (Infrastructure vs. Applications): In your current landscape, what are the main areas of risk for your organization in % out of 100% total?: (0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%)

• Infrastructure %
• Application %
• Other %

Other (please specify)

3. Compared to 12 months ago, do you see a change of threats in these areas: (1-3, increase, same, decrease, don't know)

• Infrastructure
• Application
• Other

Other (please specify)

4. From the following list, which are the top five sources of application security risk within your organization? (Please mark your top area of risk with a "1", your second with a "2", your third with a "3", your fourth with a "4", an your fifth with a "5") (1 (Top 1 risk), 2 (Second), 3, 4, 5)

• Insecure source code development
• Lack of awareness of application security issues within the organization
• Poor/inadequate testing methodologies
• Poor change control and version control procedures
• Lack of budget to support application security initiatives
• Lack of secure application development procedures or study materials
• Poor deployment and configuration
• Programs and projects (e.g. budget overruns, delays, poor quality)
• Staffing (e.g. lack of security skills within team)
• Third-party suppliers and outsourcing (e.g. lack of security, lack of assurance)
• Other

Other (please specify)

5. Which kind of attackers do you think are the three most likely to target your company in the next 12 months?

• Activists / Anonymous
• Criminals groups/professional fraudsters
• Hobbyist hackers
• Insiders/employees
• Competitors
• Suppliers/partners
• Those involved in corporate/industrial espionage
• State sponsored spies
• Other

Other (please specify)

Page 3. Investments and Challenges

6. Security Budget: how much is your company's total cyber security budget per year (in USD)? (drop down menue)

7. What is your estimate about how much in % of the total annual IT budget your company spends on cyber security? (drop down menue)

8. When compared with last year, total cyber security spending over the next 12 months will (Increase more than 100%, Increase by 50-100%, Increase 10% to 50%, Increase up to 10%, Stay the same, Decrease less than 10%, Decrease 10% to 30%, Decrease 30% to 50%, Decrease by more than 50%, Do not know)

9. Which of the following statements best describes your organization's annual investment in security? (Choose one). (Decreasing, About the same, Increasing, Don't know.)

• Our overall information security investment is
• Application Security investment is
• Infrastructure Security investment is
• Other security investment is

Other (please specify)

10. Do you see new threats to web applications negatively impacting your organization? (Yes, No) If Yes, how?

11. How many security breaches did your company experience in the last 12 months? (drop down)

• None
• 1
• 2
• 3
• 4
• 5
• 6
• 7
• 8
• 9
• 10
• 15
• 20
• 30
• 40
• 60
• 80
• 100
• more than 100

12. How many of them were because of web application related security incidents? (drop down) If so, what was the most common root cause of the incident(s) (e.g. in terms of type of vulnerability or control gaps)

13. In your view, what were the three main damage types caused by cyber attacks? (please rank with "1" most damaging, "2" second, and "3" third) ( 1 - most damaging, 2 - second, 3 - third)

• Interruption of service
• Direct financial loss, for example fraud
• Theft of intellectual property
• Loss of customer data
• Reputation damage
• Loss or compromise of personal data
• Other

Other (please specify)

14. Is your organization spending more on application security in response to a breach or after a security incident related to a web application? ( Yes, No)

Page 4. Investments and Challenges (continued)

15. Please indicate your top five security priorities for the coming 12 months from the following list. (Mark your top priority with a "1", your second priority with a "2", etc.) ( 1 - top priority, 2 - 2nd priority, 3 - 3rd priority, 4 - 4th priority, 5 - 5th priority)

• Application layer vulnerability management technologies and processes
• Code review (static analysis of source code to find security defects)
• Compliance with regulatory requirements (PCI-DSS, FISMA, etc.)
• Cyber Risk Management / Information security risk management
• Deployment of application security infrastructure (such as web application firewalls)
• Data leakage/data loss prevention
• Implementing security standards
• Incident response capabilities
• Infrastructure Security (e.g., antivirus, IDS, IPS, patching, encryption)
• Mobile devices security
• Penetration testing
• Privacy
• Recruiting and retaining qualified application security resources
• Security awareness and training for developers
• SDLC - Secure development lifecycle processes (e.g., secure coding, QA process)
• Security assurance for Cloud-based (SaaS, IaaS, PaaS, …) software purchased by your organization
• Security assurance for COTS (commercial off-the-shelf) purchases by your organization
• Security assurance for software developed by 3rd parties (outsourcing)
• Security metrics and reporting
• Security testing of applications (dynamic analysis, runtime observation)
• Threat and vulnerability management (e.g., security analytics, threat intelligence)
• Others (please specify)

Page 5. Relevance of OWASP

16. What is the level of significance of OWASP guidance, books and white papers within your organization? ( Extremely significant, Very significant, Significant, Somewhat significant, Not significant)

• Awareness materials (e.g. Top-10)
• Application development policy
• Code development guidelines
• Reference to leading practice
• Testing methodologies
• Staff attending local OWASP chapter meetings for information
• Staff attending OWASP AppSec conference

17. Which of the following OWASP projects has your organization found useful? (Choose all that apply). ( Very useful, Somewhat useful, Not useful for us, Don't know it)

• AntiSamy
• Application Security FAQ
• Application Security Verification Standard (ASVS)
• AppSensor
• Broken Web Applications Project
• Cheatsheets
• CISO Guide
• CISO Survey Report 2013
• Code Review Guide
• Cornucopia (Threat Management game)
• Development Guide
• ESAPI (Enterprise Security API)
• Http Post Tool
• JBroFuzz
• Legal Project
• LiveCD/WTE
• Mod_Security Core Ruleset
• OpenSAMM
• O2
• OWASP Top-10
• RFP Criteria
• Ruby on Rails Security Guide
• Secure Coding Practices - Quick Reference Guide
• Testing Guide
• Webgoat
• WebScarab
• Zed Attack Proxy (ZAP)
• None. I am not familiar with any OWASP projects.
• Other (please specify)

Page 6. Challenges for Application Security

18. When delivering your organization's application security initiatives, how challenging are the following aspects? ( Not a challenge, Slightly challenging, Challenging, Very challenging, Extremely challenging, N/A)

• Adequate budget
• Availability of skilled resources
• Business uncertainty
• Justifying business case
• Conflicting business requirements
• Emerging technologies
• Level of security awareness by the developers
• Management awareness and sponsorship
• Organizational change
• Regulatory change or uncertainty
• Other

Other (please specify)

Page 7. Tools and Technology

19. Does your organization use any specific technology tools to support the application security management process? ( Yes, No)

20. Which of the following technology tools does your organization use or are planned to be implemented by your organization to provide application security capability? (Choose all that apply) ( Currently in use, Planned within 12-18 months, No plans to implement)

• Application Vulnerability Scanners
• Desktop Web Application Vulnerability Scanners
• Runtime analyzers
• Source code analyzers or scanners
• Web application firewalls
• Other

Other (please specify)

21. As part of your information security management program, do you... ( Currently in use, Planned within 12-18 months, No plans to implement)

• Use a SDLC (Secure development life cycle)
• Conduct security training
• Document and enforce security guidelines
• Use risk management
• Use threat modeling
• Specify security requirements
• Secure architecture
• Use tested common security modules/frameworks
• Do code reviews
• Testing with test cases for security
• Harden the deployment environment
• Have a vulnerability management process

Page 8. Governance and Control

22. How confident are you that your organization is protected from cyber security risk? ( we are very secure, we are good, we are ok, we have problems, we are not secure, Don't know.)

23. Do you routinely assess your organisation's cyber security? (No. We do not asses., infrequently, or less than once per year, ca. once per year, between once per year to once per month, once per month or more, or continously, Don't know.)

24. Security reporting: Does your company board receive cyber security briefings? ( Yes, No, Other (please specify))

25. What metrics should the security manager focus on when reporting to the board? Can you provide suggestions or examples? (text)

26. Does your organization have a documented security strategy (incl. application security)? ( Yes, No)

27. For how long time does this security strategy plan ahead? ( 3 months, 6 months, 1 year, 2 years, 3 years, 5+ years, N/A or don't know)

28. Your application security strategy (choose all that apply)

• ...has been reviewed and updated within the past 12 months
• ...is aligned with, or integrated into, the organization's business strategy
• ...is aligned with, or integrated into, the organization's IT strategy
• ...outlines our key security activities for the next 12 months

29. Which of the following statements best describes your organization's security strategy with regards to the risks of new technologies, like the increased use of social networking, personal mobile devices, or cloud computing? (Choose one)

• Our current application security strategy adequately addresses the risks
• We need to modify our strategy to address the new risks
• We need to investigate further to understand the risks
• We do not see any new or increased risks associated with these technologies

Page 9. Governance and Control (continued)

30. Has your organization implemented an Application Security Management System (ASMS) or Maturity odel (e.g. OWASP SAMM) that covers overall management of application security? (Choose one)

• Yes, implemented and formally certified/verified by a third party
• Yes, without verification
• Yes, currently in the process of implementing
• No, but considering it
• No, and not considering it

31. Which of the following list of application security standards or frameworks, are used by your organization? (Choose all that apply)

• BSIMM
• Capability Maturity Model Integration (CMMI)
• CLASP
• CobIT
• COSO
• Information Security Forum's (ISF) Standard of Good Practice
• Information Technology Infrastructure Library (ITIL)
• ISO/IEC 27001:2005 27002:2005
• MS SDL
• NIST Handbooks (e.g. the "800 Series")
• Octave
• Open SAMM
• PCI DSS
• Other (please specify)

32. How does your organization assess the quality and effectiveness of application security? (Choose all that apply)

• Internal self assessments by IT or application security function
• Assessments performed by other internal function
• Assessment by external party/third party
• Formal certification to external security standards
• Formal certification to industry security standards (e.g. Payment Card Industry Data F, Security Standard)
• Code review and metrics
• No assessments performed

33. Suppliers & External Partners: How do you verify that your external partners, service providers or contractors are protecting your organization's information from an application security standpoint? (Choose all that apply)

• We communicate our security requirements to our key suppliers and partners
• Asessments performed by our organization's application security, procurement or internal audit function (e.g. site visits, security testing)
• Independent external assessments of partners, vendors or contractors
• Self assessments or other certifications performed by partners, vendors or contractors
• No reviews or assessments performed

34. Incident Response: How confident do you feel about the effectiveness of processes and resources to recover from a significant cyber security incident? rate (5: very high - 1: very low) ( Very confident, confident, Somewhat confident, some doubts, Not confident, N/A - Don't know)

35. In the last 12 months, have you experienced, exercised or prepared how you will recover from a cyber security incident? ( Yes, No, N/A - Don't know)

36. Incident Response and Sharing of Information: When an incident or breach occurs, would you usually as part of your normal incident response procedures... (choose all that apply)

• conduct an informal root cause analysis
• run a formal internal investigation
• contact an external CERT or independent non-profit from a country/region or industry
• contact law enforcement
• share information with other companies (like peers in your industry)
• be required by law to report security incidents to a regulator or government.

Page 13. Governance and Control (continued)

20. Which of the following statements best describes your organization's application security strategy in regards to the risks associated with the increased use of social networking, personal devices, or cloud computing? (choose one)

• A.Our current application security strategy adequately addresses the risks
• B.We need to modify our strategy to address the new risks
• C.We need to investigate further to understand the risks
• D.We do not see any new or increased risks associated with these technologies

21. Has your organization implemented an Application Security Management System (ASMS) or Maturity Model (e.g., OWASP SAMM) that covers overall management of application security? (choose one)

• A.Yes, implemented and formally certified/verified by a third party
• B.Yes, without verification
• C.Yes, currently in the process of implementing
• D.No, but considering it
• E.No, and not considering it

Page 14. Governance and Control (continued)

22. From the following list of application security standards or frameworks, which are used by your organization? (choose all that apply)

• A.BSIMM
• B.Capability Maturity Model Integration (CMMI)
• C.CLASP
• D.CobIT
• E.COSO
• F.Information Security Forum's (ISF) Standard of Good Practice
• G.Information Technology Infrastructure Library (ITIL)
• H.ISO/IEC 27001:2005 27002:2005
• I.MS SDL
• L.NIST Handbooks (e.g., the "800 Series")
• M.Octave
• N.Open SAMM
• O.PCI DSS
• P.Other (please specify)

Page 15. Governance and Control (continued)

23. How does your organization assess the quality and effectiveness of application security? (choose all that apply)

• A.Internal self assessments by IT or application security function
• B.Assessments performed by other internal function
• C.Assessment by external party/third party
• D.Formal certification to external security standards
• E.Formal certification to industry security standards (e.g., Payment Card Industry Data F.Security Standard)
• G.Code review and metrics
• H.No assessments performed

24. Suppliers & External Partners: How do you verify that your external partners, service providers or contractors are protecting your organization's information from an application security standpoint? (choose all that apply):

• We communicate our security requirements to our key suppliers and partners?
• A.Assessments performed by your organization's application security, procurement or internal audit function (e.g., site visits, security testing)
• B.Independent external assessments of partners, vendors or contractors
• C.Self assessments or other certifications performed by partners, vendors, or contractors
• D.No reviews or assessments performed

24b. Incident Response Best practices (DISCUSS: should we add a question about incident response. E.g. priorities between "stop the bleeding" and "capture evidence for prosecution") Other ideas?

24c. How confident do you feel about the effectiveness of processes and resources to recover from a significant cyber security incident? rate 1-5 (very low - very high)

24d) In the last 12 months, have you exercised or prepared how you will recover from a cyber security incident?

24d. Process of Incident Response:

• Contact law enforcement
• Contact CERT
• Run an internal investigation
• share information with other companies

25. How you describe your job role/function?

• A.Chief Operating Officer
• B.Chief Information Officer
• C.Chief Application Security Officer
• D.Chief Security Officer
• E.Chief Privacy Officer
• F.Chief Compliance Officer
• G.Chief Technology Officer
• H.Chief Risk Officer
• I.Business Unit Executive/Vice President
• L.Information Technology Executive
• M.Application Security Executive
• N.Network/System Administrator
• O.Internal Audit Director/Manager
• P.Other: (please specify)

Page 16. Governance and Control (Scope of the CISO role)

26. CISO Functions & Responsibilities: Which of these functions are within you area of responsibility? (select all the ones that apply to you)

• A.Develop, articulate and implement risk management strategy for applications
• B.Develop and implement policies, standards and guidelines for application security
• C.Develop implement, manage and report on application security governance processes
• D.Develop and implement software security activities (e.g. S-SDLC) and security testing processes
• E.Work with executive management, business managers and internal audit and legal counsel to define application security requirements that can be verified and audited
• F.Measure and monitor security and risks of web application assets within the organization
• G.Application Vulnerability Management
• H.Network Security and perimeter defense
• I.Define, identify and assess the inherent security of critical web application assets, assess threats, vulnerabilities, business impacts and recommend countermeasures/corrective actions
• L.Procure new web application processes, services, technologies and testing tools for the organization
• M.Application security training and awareness for information security and software development teams
• N.Develop, articulate and implement continuity planning/disaster recovery for web applications
• O.Investigate and analyze suspected security incidents and data breaches and recommend corrective actions

Page 17: Wishes and suggestions

And last but not least, all your feedback is very important to us and the community is continuously striving to improve. If you could wish freely, what kind of OWASP project, guidance or tool would you like to see in the future that could really improve your daily life and operation around web and application security?

Page 18. This Completes the Survey

This completes the survey. We would appreciate if could also provide a few personal and professional details. This will provide us valuable information about your industry and position helping us to analyze the survey data by industry and type of organization. It will also provide you an opportunity to leave your contact information if you would like us to follow up with you regarding the survey results. Once again, all responses are optional and especially your contact data will be treated as confidential and used only for the evaluation of this survey

A.Yes, I am willing to take a couple more minutes to assist with survey benchmarking. B.No, I prefer to exit the survey at this point.

Page 19. Optional: Participant Information

(*)We recomend do not type your first name, last name and email in the survey herein but send it over to the survey's point of contact by email since this information is considered personal identifiable information and we would like to be treated as strictly confidential.

• I would like to receive a copy of the results of this CISO survey? Yes / No

• (*)Name of person completing survey: (optional, will be treated strictly confidential)
• (*)Email address: (optional, will be treated strictly confidential and only be used to send you a link to the final survey report after it's completion)
• Title of delegate completing survey:
  • Chief Operating Officer
  • Chief Information Officer
  • Chief Application Security Officer
  • Chief Security Officer
  • Chief Privacy Officer
  • Chief Compliance Officer
  • Chief Technology Officer
  • Chief Risk Officer
  • Business Unit Executive/Vice President
  • Information Technology Executive
  • Application Security Executive
  • Network/System Administrator
  • Internal Audit Director/Manager
  • Other: (please specify)

To further refine our survey data by a qualitative component, we would also like to ask whether you would potentially be open for a 30 minute confidential phone interview to further refine certain areas and learn more about your views for future surveys and application security projects that matter to you. All data will be treated as confidential and only be used in anonymous and aggregated form.

• If you are ok with us contacting you for a 30-minute phone interview, please provide your email address (*) (again):

Are you aware of the OWASP CISO guide (link to CISO guide, https://www.owasp.org/index.php/Application_Security_Guide_For_CISOs) ?

• A No
• B Yes

Are there specific additional areas you would like us to cover in future versions of the CISO guide?

• A No
• B Yes

(text)

Page 20. Organization Information

• Organization name: (optional)
• Country:
• Ownership: (choose one)
  • Public - traded on stock exchange
  • Private - not traded on stock exchange
  • Government or non-profit

• Total number of employees: (choose one) change to drop down
  • < 100
  • 100 - 500
  • 500 - 1,000
  • 1,000 to 2,000
  • 2,000 to 5,000
  • 5,000 to 10,000
  • 10,000 to 20,000
  • 20,000 to 30,000
  • 30,000 to 40,000
  • 40,000 to 50,000
  • 50,000 to 60,000
  • 60,000 to 70,000
  • 70,000 to 80,000
  • 80,000 to 90,000
  • 90,000 to 100,000
  • More than 100,000

• Annual revenue (in USD): (choose one)
  • Less than $100 million
  • $100 million to $249 million
  • $250 million to $499 million
  • $500 million to $999 million
  • $1 billion to $9 billion
  • $10 billion to $24 billion
  • More than $24 billion
  • Not applicable

• Industry: (choose one)
  • Aerospace and Defense
  • Airlines
  • Asset Management
  • Automotive
  • Banking & Capital Markets
  • Chemicals
  • Consumer Products
  • Government & Public Sector
  • Insurance
  • Media & Entertainment
  • Mining & Metals
  • Oil & Gas
  • Power & Utilities
  • Professional Firms & Services
  • Real Estate
  • Retail & Wholesale
  • Technology
  • Telecommunications
  • Transportation
  • Other: (please specify)

• Where is your organisation’s headquarters?
  • Region: US/Latam/Africa/EU/ME/Asia/Australasia
  • Country:

• At what level is your organisation operating?
  • National Level
  • Regional Level
  • Global Level

Page 21. Thank You

Thank you again for your time and considering in completing this survey. Please contact Tobias Gondrom at [email protected] with any questions or comments regarding the contents of this survey.