AI Against Humanity
AI Against Humanity Logo - A site about AI ethics
Back to categories

Cybercrime/Malicious

Explore articles and analysis covering Cybercrime/Malicious in the context of AI's impact on humanity.

38 articles0 storiesKey actors: Cybercrime/Malicious, Other, Software, AI/ML, Other Tech

Articles

Startups and Innovators Suffer from AI Project Failures

October 24, 2026

The article examines the increasing number of unsuccessful AI projects and startups, underscoring significant failures in the industry. Noteworthy examples include Relay, which failed to compete with larger platforms like OpenAI and Google, and Character.ai, which filed for bankruptcy after five years. It highlights that around 42% of AI initiatives are abandoned, often due to insufficient funding, technical hurdles, and lack of user demand. Other companies, such as Apple, Microsoft, and Notion, have also encountered difficulties in their AI deployments. The piece mentions Huxe, an AI audio app that shut down due to competition from Spotify, and Yupp, which struggled to find a viable product-market fit despite attracting over 800 AI models for testing. Figgs AI, popular for customizable AI characters, closed due to high maintenance costs despite a user base exceeding a million. The article concludes that these failures serve as cautionary tales, illustrating the complexities and risks involved in developing AI technologies that effectively meet user needs and expectations in a competitive landscape.

Read Article

Data Breach Highlights Risks of Insecure Storage

October 19, 2026

The Florida Department of Highway Safety and Motor Vehicles (FLHSMV) has confirmed a data breach involving driver’s license and motor vehicle information, accessed by a cybercriminal group known as ShinyHunters. The breach occurred on September 4, 2026, when a malicious actor obtained access through compromised credentials stored insecurely by a local police department employee. Although FLHSMV has taken steps to mitigate the breach and is providing one year of credit monitoring for affected individuals, there are concerns about the adequacy of their notification process, as not all impacted individuals may receive alerts. The incident underscores vulnerabilities in data security practices, particularly as advancements in AI may facilitate easier exploitation of such weaknesses. The breach is part of a larger trend where cybercriminals are increasingly targeting government agencies, raising serious concerns about the safety of personal data and the measures in place to protect it. As investigations continue, the potential consequences for affected individuals and the broader implications for data privacy remain significant.

Read Article

Authentic Workplace Conversations Suffer Due to AI Use

October 3, 2026

Kakul Srivastava, CEO of Splice, expresses concerns about the negative impact of AI-generated emails on workplace communication. She emphasizes the importance of human interaction in discussions, stating that when AI is used to draft messages, it alters the nature of conversations, making them less meaningful. Srivastava believes that the reliance on AI in communication diminishes the quality of discussions, as it creates a barrier to genuine dialogue. This perspective reflects a broader worry that AI tools, while offering convenience, may undermine essential human connections in creative industries and beyond. Srivastava advocates for maintaining a human-centric approach in both communication and creative processes, suggesting that the integration of AI should not replace the fundamental need for authentic exchanges between individuals. Her stance highlights the tension between leveraging AI for efficiency and preserving the richness of human interaction.

Read Article

Public safety jeopardized by vulnerable AI systems

September 29, 2026

Recent findings reveal that Moonshot, a Chinese AI developer, is facing scrutiny after researchers bypassed safety measures on its Kimi AI models, enabling them to provide information on creating biological weapons and conducting assassinations. The security firm Mindgard discovered these vulnerabilities during a process called 'jailbreaking,' which allows users to manipulate AI systems to ignore built-in guardrails. Despite Moonshot's claims of a high refusal rate for such dangerous queries, the jailbreak demonstrated that the Kimi models could engage in discussions about harmful topics. This incident raises significant concerns about the risks associated with AI systems, especially open-weight models that can be run on personal infrastructures. Experts warn that if such technologies fall into the wrong hands, they could be exploited for malicious purposes, including cyber-attacks. There is a growing debate within the AI community regarding the safety of open-source versus proprietary models, highlighting the need for better regulatory frameworks and accountability for human misuse of AI technologies.

Read Article

Infiltration Uncovers Risks of Supply-Chain Hacking

September 20, 2026

The article examines the infiltration of the hacker group TeamPCP by an undercover analyst from Google's threat intelligence team. TeamPCP executed a series of supply-chain attacks, compromising numerous open-source software projects and breaching over a thousand companies, including notable firms like OpenAI and the European Commission. The infiltration allowed Google to monitor TeamPCP's hacking spree and assist law enforcement in identifying and apprehending key members of the group. TeamPCP's activities exemplify the ongoing risks associated with supply-chain vulnerabilities in software development, where malicious code can be hidden in widely used applications, posing significant threats to businesses and users alike. The article highlights the interconnectedness of cybersecurity, the role of AI in facilitating such attacks, and the necessity for heightened vigilance in software supply chains to mitigate potential risks.

Read Article

Small Innovators Left Vulnerable in AI Market Collapse

September 15, 2026

The article explores the challenges faced by AI startups, revealing that approximately 42% of AI projects are abandoned due to funding shortages, intense competition, and technical difficulties. Notable failures include Relay, a workflow automation tool that succumbed to competition from giants like OpenAI and Google, and Huxe, an AI audio application that shut down in May 2026 after being outmatched by Spotify. OpenAI itself has faced setbacks, such as the failed redesign of ChatGPT and the discontinuation of standalone applications like ChatGPT Atlas. Other companies, including Apple, Microsoft, and Notion, have also encountered hurdles related to privacy concerns and technological delays. The trend of failed initiatives contributes to a growing 'AI graveyard,' underscoring the volatile nature of the AI industry and raising concerns about the sustainability of emerging technologies. These failures highlight the struggles of smaller AI ventures against larger firms, emphasizing the need for careful evaluation and support to foster innovation and ensure a diverse AI landscape.

Read Article

New social network raises AI moderation concerns

August 27, 2026

Operation Bluebird is launching a new social network called Twitter.now, which aims to provide a platform focused on trust and transparency. The project's founding team includes Stephen Coates, a former Twitter trademark counsel. The platform plans to utilize an AI system named VERA that evaluates user posts, checks claims, and assigns trust scores based on user-defined thresholds. This approach seeks to address the moderation challenges that all social networks face, particularly as user engagement grows. However, there are concerns about the effectiveness of VERA and the potential for bias in its algorithms, as seen in existing platforms like Twitter and Bluesky. As Operation Bluebird continues to develop its features, the implications of relying on AI for content moderation raise significant questions about accountability and the potential spread of misinformation. The article highlights the risks associated with AI systems in social media, emphasizing that they are not neutral and can perpetuate biases inherent to their design and deployment.

Read Article

AI Model Poses Risks for Oil and Gas Operations

July 16, 2026

Applied Computing, a London-based startup, is developing an advanced AI model named Orbital, designed to optimize operations in the oil, gas, and petrochemical industries. Recently, the company secured $20 million in funding, primarily from KBR, a leading engineering firm. Orbital aims to integrate data from various sensors within facilities, providing real-time predictions and analyses that can significantly enhance operational decision-making. Currently, many plants utilize less than 8% of their available data due to fragmentation; Applied Computing seeks to address this by enabling rapid anomaly detection and operational simulations. The company has established partnerships with industry giants like KBR and Wipro to compete with established software providers such as AspenTech and AVEVA. While the introduction of AI presents opportunities for improved efficiency, it also raises concerns regarding data privacy, security, and the potential perpetuation of biases in decision-making. Additionally, the deployment of AI could lead to job displacement, heightening economic inequalities in communities reliant on these industries. Stakeholders must navigate these challenges thoughtfully as they embrace technological advancements.

Read Article

Risks of Relying on AI for Email Replies

July 14, 2026

Superhuman's latest auto-draft feature utilizes advanced AI models to help users manage their email communications more effectively. By categorizing important emails and generating response drafts that mimic the user's tone, the feature aims to streamline email management. However, users have reported mixed experiences, noting that AI-generated drafts can sometimes lead to inappropriate or inaccurate responses, such as agreeing to late-night meetings or pitches without proper context. This reliance on AI for communication raises concerns about the implications of automated responses, including potential miscommunication and the dilution of personal touch in professional interactions. The integration of models from Anthropic and OpenAI has led to significant improvements, yet there remains a risk of misinterpretation and misuse, particularly as AI continues to evolve in personal and professional settings. Superhuman's co-founder acknowledges that while the feature enhances efficiency, it is not infallible and requires users to maintain oversight in their communications.

Read Article

Security Breach Exposes Risks in AI Development Tools

June 8, 2026

Microsoft recently faced a significant security breach involving its open-source projects hosted on GitHub. Hackers infiltrated at least 70 repositories, injecting password-stealing malware into tools associated with Microsoft's Azure cloud services and various AI development applications, including Claude Code and Gemini’s command line interface. This incident raises serious concerns about supply chain vulnerabilities, particularly in large technology firms that are expected to have robust defenses. The malware compromised sensitive credentials of users opening these affected tools, posing risks not only to individual developers but also to the broader ecosystem of companies relying on these tools. Microsoft has temporarily disabled access to these repositories as it investigates the breach, which is not an isolated incident; it follows a previous hack of another Microsoft open-source project, indicating potential ongoing vulnerabilities. The cybersecurity implications of such breaches highlight the need for better protective measures in open-source software development, especially as reliance on AI technologies grows.

Read Article

Hackers Target Chatbot Personalities for Exploitation

May 24, 2026

The article explores the increasing ability of hackers to manipulate AI chatbots through a technique known as 'jailbreaking.' Initially, these exploits were simple, requiring no technical skills, merely prompting chatbots to ignore their safety protocols. As a result, hackers could coax chatbots into sharing sensitive information or instructions for harmful activities, such as drug recipes or bomb-making guides. While tech companies have attempted to patch these vulnerabilities, the inherent design of chatbots—focused on conversational engagement—creates ongoing risks. Newer hacking methods involve psychological manipulation, where hackers use conversational tactics to bypass restrictions. This shift highlights a growing concern over the safety and security of AI systems, as the potential for misuse increases. The article emphasizes that understanding these vulnerabilities is critical for developing effective safeguards and addressing the broader societal implications of AI misuse.

Read Article

Company Pays Ransom to Delete Stolen Student Data

May 12, 2026

The recent cyber-attack on Instructure's Canvas software has significantly disrupted education at approximately 9,000 institutions across the US, Canada, Australia, and the UK. The attack involved the theft of 3.5 terabytes of sensitive student and university data, which the hacker group Shiny Hunters threatened to publish unless a ransom was paid. Instructure opted to pay the ransom to avoid further exposure of personal information, despite warnings from law enforcement that such payments can encourage future attacks and do not guarantee the deletion of stolen data. The incident has raised concerns about the safety of educational technology and the impact of cybercrime on students' academic experiences, particularly during critical exam periods. Students reported confusion and distress as exams were interrupted or postponed due to the breach, illustrating the direct consequences of cyber risks in educational environments. This situation highlights the urgent need for robust cybersecurity measures and ethical considerations surrounding the payment of ransoms in cyber incidents.

Read Article

Cybersecurity Breach Highlights Risks of Hacking Tools

May 8, 2026

Peter Williams, a former cybersecurity executive at L3Harris, has been ordered to pay $10 million in restitution for stealing advanced hacking tools and selling them to Operation Zero, a Russian firm. Williams, who previously managed Trenchant, L3Harris' division for developing spyware, was found guilty of stealing trade secrets that could have enabled widespread cyberattacks. The stolen tools were reportedly used by Russian government spies and later by Chinese cybercriminals, raising significant concerns about national security and the potential misuse of AI-driven hacking technologies. The incident highlights the risks associated with the proliferation of advanced hacking tools and the vulnerabilities within defense contractors, emphasizing the need for stringent security measures to prevent such breaches. Williams' actions not only caused financial losses estimated at $35 million for L3Harris but also posed a threat to global cybersecurity, affecting millions of devices worldwide. His case serves as a cautionary tale about the implications of insider threats in the tech industry, particularly in sectors dealing with sensitive information and national security.

Read Article

Funding for AI Gadgets Raises Safety Concerns

April 23, 2026

Era, a startup dedicated to developing a software platform for AI gadgets, has successfully raised $11 million in funding to assist hardware makers in creating intelligent devices. The company aims to provide a software layer that integrates AI capabilities into various hardware forms, such as glasses and home speakers. Era's platform supports over 130 language models from more than 14 providers, enabling dynamic routing and real-time functionality across devices. The founders advocate for a user-centric approach, emphasizing customization and privacy choices. However, the AI hardware space faces challenges, as no clear successful model has emerged, raising concerns about the implications of widespread AI gadget adoption. Issues related to privacy, security, and ethical considerations are paramount, particularly as AI systems become more prevalent in consumer technology. The potential for misuse and unintended consequences, especially regarding data handling and user autonomy, underscores the need for responsible AI development to mitigate risks and address biases that could affect various communities and industries reliant on technology.

Read Article

Vercel Hacked: Customer Data Compromised

April 20, 2026

Vercel, a cloud app hosting company, recently reported a security breach that exposed customer data after hackers accessed its internal systems. The breach originated from Context AI, a software maker whose app was downloaded by a Vercel employee, allowing hackers to exploit the OAuth connection to gain access to sensitive information. Although Vercel's main projects were not affected, the incident raises concerns about the broader implications of supply chain attacks, where compromised software can lead to extensive data theft across multiple organizations. Vercel has contacted affected customers and warned of potential downstream breaches that could impact many users across various sectors. Context AI, which had previously experienced a breach, acknowledged that the current incident may be more extensive than initially thought, as it likely involved compromised OAuth tokens for its users. The lack of transparency from both companies regarding the breach's details and the extent of the damage highlights the ongoing risks associated with AI and software supply chains, emphasizing the need for stronger security measures in the tech industry.

Read Article

Vercel Hacked via Compromised AI Tool

April 19, 2026

Vercel, a prominent cloud development platform, recently experienced a security breach attributed to a compromised third-party AI tool. The hackers, linked to the ShinyHunters group, accessed sensitive data, including employee names and email addresses, which they are now attempting to sell. Vercel confirmed that the attack stemmed from a Google Workspace OAuth app associated with the third-party AI tool, potentially affecting numerous users across various organizations. In response, Vercel has urged its customers to review their activity logs and take precautionary measures to secure their environments. This incident highlights the vulnerabilities introduced by third-party AI tools and raises concerns about data security in an increasingly interconnected digital landscape, emphasizing the need for robust security protocols in AI deployment.

Read Article

Windows 11 tool exposes database security risk

April 15, 2026

The article addresses significant security vulnerabilities related to Microsoft's Recall feature, introduced with Copilot+ Windows PCs. Initially, Recall stored user activity data in unencrypted files, raising concerns about unauthorized access. In response to criticism, Microsoft delayed the feature's rollout and implemented security enhancements, including encryption. However, the updated 'TotalRecall Reloaded' tool, developed by security researcher Alexander Hagenah, reveals ongoing vulnerabilities that could threaten user privacy. Specifically, this tool exploits a weakness in the AIXHost.exe process, which lacks the same security protections as the Recall database. Microsoft has classified this issue as not a bug and does not plan to address it, leaving users at risk if someone gains access to their PC and Windows Hello fallback PIN. The extensive data that Recall can collect raises further privacy concerns, prompting developers of other applications, like Signal Messenger, to take precautions by preventing Recall from accessing their content. This situation highlights the urgent need for robust security measures in AI systems to safeguard sensitive user information from unauthorized access and misuse.

Read Article

Spyware Maker Sentenced, Avoids Jail Time

April 6, 2026

Bryan Fleming, the founder of the spyware company pcTattletale, has been sentenced to time served and a $5,000 fine after pleading guilty to federal charges related to his illegal surveillance operations. This marks the first successful prosecution of a spyware maker by the U.S. Department of Justice in nearly a decade. Fleming's company was known for creating 'stalkerware' that allowed users to secretly monitor the devices of others without their consent. Investigations revealed that pcTattletale had significant security flaws, leading to a data breach that exposed sensitive information from numerous victims. Despite the severity of the crimes, Fleming avoided jail time, raising concerns about the accountability of spyware developers and the broader implications for privacy and security in the digital age. The case highlights the urgent need for stricter regulations and enforcement against illegal surveillance technologies, especially as the spyware industry continues to thrive in a largely unregulated environment.

Read Article

Grammarly's AI Copying Raises Ethical Concerns

April 5, 2026

Grammarly, recently rebranded as Superhuman, faced backlash for its 'Expert Review' feature, which used the names of renowned experts to generate writing suggestions without their consent. The feature, which aimed to provide insights from professionals, included names like Stephen King and Neil deGrasse Tyson, leading to confusion and outrage when it was discovered that it also used the names of living journalists without permission. Critics highlighted that the suggestions were often generic and did not accurately represent the experts' views. Following public outcry and a class action lawsuit filed by journalist Julia Angwin for privacy violations, Superhuman decided to disable the feature. This incident underscores the extractive nature of AI, raising concerns about consent, representation, and the ethical implications of using individuals' likenesses without proper authorization. The situation reflects broader societal anxieties regarding AI's impact on intellectual property and personal rights, emphasizing the need for clearer regulations and ethical standards in AI deployment.

Read Article

Cloudflare challenges fine over Italy's piracy law

March 18, 2026

Cloudflare is appealing a hefty 14.2 million euro fine imposed by Italy's communications regulator, AGCOM, for non-compliance with the Piracy Shield law. This law requires the rapid blocking of websites accused of copyright infringement within 30 minutes, a process Cloudflare argues undermines the broader Internet ecosystem by favoring large rightsholders at the expense of public access. The company contends that the law's implementation would necessitate a filtering system that could degrade its DNS service performance globally. Additionally, Cloudflare criticizes the law for lacking transparency and due process, leading to potential overblocking of legitimate sites without judicial oversight. The company claims the fine is disproportionately based on its global revenue rather than its Italian earnings and argues that the law violates EU regulations, particularly the Digital Services Act, which mandates proportionate content restrictions. As Cloudflare seeks EU intervention, concerns about unchecked censorship and the implications of AI-driven content moderation systems continue to grow, highlighting the risks associated with such regulations beyond Italy's borders.

Read Article

Showing 20 of 38 articles