ADVERTISEMENT

AI first, security later: all Fortune 500 companies use AI, but security rules are still under construction

AI is no longer a niche technology — it’s becoming a fundamental part of business strategy for most Fortune 500 companies in 2025. All of them are now using AI, but they differ in their approaches to implementing it. Cybernews researchers warn of the risks involved as the rulebooks have yet to be written.

Companies using AI, artificial intelligence, chatbots

Image by Cybernews.

Cybernews Team
Jun 12, 2025 8 min read
Key takeaways:

What does AI find about AI on Fortune 500 companies’ websites?

AI is here, and so are the risks

  • Data Security/leakage: This is the most commonly mentioned security concern, appearing in a significant number of entries across all industries. Issues related to protecting sensitive data, including personally identifiable information (PII), health information, and operational data, are consistently highlighted.
  • Prompt injection: Vulnerabilities associated with prompt manipulation and insecure inputs are also frequently noted, particularly in the context of chatbots, search engines, and other interactive AI systems.
  • Model integrity/poisoning: Concerns about the integrity of LLMs and the potential for poisoning training data are present, especially for proprietary models. This includes risks related to biased outputs and manipulated model behavior.
  • Critical infrastructure vulnerabilities: For organizations operating in critical infrastructure sectors (e.g., energy, utilities), the security of AI integrated into control systems and operational technologies is a major risk.
  • Intellectual property theft: Protecting proprietary LLMs, algorithms, and AI-related intellectual property is a concern, particularly for companies investing heavily in internal AI development.
  • Supply chain/external risks: Risks associated with third-party LLM providers, partner LLMs, and the broader AI supply chain are also mentioned, highlighting the need for secure vendor management and risk assessment.
  • Bias/algorithmic bias: Concerns about bias in LLM outputs and algorithmic decision-making are present, emphasizing the need for fairness and ethical considerations in AI development and deployment.
  • Insecure output: Risks related to LLMs generating harmful, misleading, or insecure outputs are noted, particularly in applications where the AI's response directly impacts users or systems.
  • Lack of transparency/governance: Issues related to the lack of transparency in LLM decision-making processes and the need for robust AI governance frameworks are also highlighted.

Reckless AI adoption

ADVERTISEMENT

Common strategies to mitigate the risk

Jurgita Lapienyte Stefanie Niamh Ancell Konstancija Gasaityte
Be the first to know and get our latest stories on Google News
Add us as your Preferred Source on Google.
  • Data classification: Identify and classify sensitive data (PII, health data, etc.) to apply appropriate security controls.
  • Encryption: Encrypt data, both at rest and in transit to protect it from unauthorized access.
  • Access controls: Implement strict access controls and authentication mechanisms (like multi-factor authentication) to limit data access.
  • Data minimization: Collect and retain only necessary data.
  • Anonymization/pseudonymization: De-identify sensitive data when possible.
  • Data loss prevention (DLP) tools: Use tools to monitor and prevent sensitive data from leaving the organization's control.
  • Input validation and sanitization: Validate and sanitize all user inputs to prevent malicious prompts from manipulating the LLM.
  • Output validation: Validate and filter LLM outputs to ensure they are safe and aligned with intended responses.
  • Sandboxing/isolation: Run LLMs in isolated environments to limit the impact of potential prompt injection attacks.
  • Clear input/output boundaries: Define clear boundaries between user inputs and LLM outputs to avoid confusion.
  • Secure training data pipelines: Ensure the integrity and security of training data to prevent poisoning attacks.
  • Model validation and testing: Regularly validate and test models to detect any anomalies or manipulation.
  • Model monitoring: Monitor model behavior in production for any unexpected or malicious activity.
  • Version control: Maintain version control of models to track changes and roll back to previous versions if needed.
  • Adversarial training: Train models to be resilient against adversarial attacks.
  • Security by design: Integrate security considerations into the design of AI systems from the beginning.
  • Network segmentation: Segment networks to isolate critical systems and limit the impact of potential attacks.
  • Intrusion detection and prevention systems (IDPS): Deploy IDPS to detect and prevent malicious activity targeting AI systems.
  • Regular vulnerability assessments and penetration testing: Conduct regular assessments to identify and address vulnerabilities.
  • Incident response planning: Develop and maintain incident response plans for AI-related security incidents.
  • Access controls: Implement strict access controls to protect proprietary models and algorithms.
  • Watermarking: Watermark models and data to detect unauthorized copying or use.
  • Confidential computing: Use confidential computing environments to protect models and data during processing.
  • Legal agreements and contracts: Establish clear legal agreements and contracts to protect intellectual property.
  • Vendor risk management: Conduct thorough due diligence on third-party LLM providers and establish secure contracts.
  • Secure integration: Ensure secure integration of third-party LLMs and APIs.
  • Monitoring and auditing: Monitor and audit the activity of third-party providers and integrations.
  • Diverse training data: Use diverse and representative training data to mitigate bias.
  • Bias detection and mitigation techniques: Implement techniques to detect and mitigate bias in model outputs.
  • Explainability and transparency: Strive for explainability and transparency in model decision-making processes.
  • Ethical guidelines and reviews: Establish ethical guidelines for AI development and deployment, and conduct regular ethical reviews.
  • Output filtering and moderation: Filter and moderate LLM outputs to ensure they are safe and appropriate.
  • Human review: Implement human review processes for sensitive or critical LLM outputs.
  • Safety training: Train models to avoid generating harmful or insecure outputs.
  • AI governance frameworks: Establish clear AI governance frameworks with defined roles, responsibilities, and policies.
  • Documentation and auditing: Maintain detailed documentation of AI systems and conduct regular audits.
  • Transparency mechanisms: Implement mechanisms to increase the transparency of LLM decision-making processes.
ADVERTISEMENT