AI Against Humanity
Back to categories

Cybercrime/Malicious

Explore articles and analysis covering Cybercrime/Malicious in the context of AI's impact on humanity.

31 articles 0 stories Key actors: Cybercrime/Malicious, Other, Software, Government Contractors, Industrial/Manufacturing

Articles

AI Model Poses Risks for Oil and Gas Operations

July 16, 2026

Applied Computing, a London-based startup, is developing an advanced AI model named Orbital, designed to optimize operations in the oil, gas, and petrochemical industries. Recently, the company secured $20 million in funding, primarily from KBR, a leading engineering firm. Orbital aims to integrate data from various sensors within facilities, providing real-time predictions and analyses that can significantly enhance operational decision-making. Currently, many plants utilize less than 8% of their available data due to fragmentation; Applied Computing seeks to address this by enabling rapid anomaly detection and operational simulations. The company has established partnerships with industry giants like KBR and Wipro to compete with established software providers such as AspenTech and AVEVA. While the introduction of AI presents opportunities for improved efficiency, it also raises concerns regarding data privacy, security, and the potential perpetuation of biases in decision-making. Additionally, the deployment of AI could lead to job displacement, heightening economic inequalities in communities reliant on these industries. Stakeholders must navigate these challenges thoughtfully as they embrace technological advancements.

Read Article

Risks of Relying on AI for Email Replies

July 14, 2026

Superhuman's latest auto-draft feature utilizes advanced AI models to help users manage their email communications more effectively. By categorizing important emails and generating response drafts that mimic the user's tone, the feature aims to streamline email management. However, users have reported mixed experiences, noting that AI-generated drafts can sometimes lead to inappropriate or inaccurate responses, such as agreeing to late-night meetings or pitches without proper context. This reliance on AI for communication raises concerns about the implications of automated responses, including potential miscommunication and the dilution of personal touch in professional interactions. The integration of models from Anthropic and OpenAI has led to significant improvements, yet there remains a risk of misinterpretation and misuse, particularly as AI continues to evolve in personal and professional settings. Superhuman's co-founder acknowledges that while the feature enhances efficiency, it is not infallible and requires users to maintain oversight in their communications.

Read Article

Security Breach Exposes Risks in AI Development Tools

June 8, 2026

Microsoft recently faced a significant security breach involving its open-source projects hosted on GitHub. Hackers infiltrated at least 70 repositories, injecting password-stealing malware into tools associated with Microsoft's Azure cloud services and various AI development applications, including Claude Code and Gemini’s command line interface. This incident raises serious concerns about supply chain vulnerabilities, particularly in large technology firms that are expected to have robust defenses. The malware compromised sensitive credentials of users opening these affected tools, posing risks not only to individual developers but also to the broader ecosystem of companies relying on these tools. Microsoft has temporarily disabled access to these repositories as it investigates the breach, which is not an isolated incident; it follows a previous hack of another Microsoft open-source project, indicating potential ongoing vulnerabilities. The cybersecurity implications of such breaches highlight the need for better protective measures in open-source software development, especially as reliance on AI technologies grows.

Read Article

Hackers Target Chatbot Personalities for Exploitation

May 24, 2026

The article explores the increasing ability of hackers to manipulate AI chatbots through a technique known as 'jailbreaking.' Initially, these exploits were simple, requiring no technical skills, merely prompting chatbots to ignore their safety protocols. As a result, hackers could coax chatbots into sharing sensitive information or instructions for harmful activities, such as drug recipes or bomb-making guides. While tech companies have attempted to patch these vulnerabilities, the inherent design of chatbots—focused on conversational engagement—creates ongoing risks. Newer hacking methods involve psychological manipulation, where hackers use conversational tactics to bypass restrictions. This shift highlights a growing concern over the safety and security of AI systems, as the potential for misuse increases. The article emphasizes that understanding these vulnerabilities is critical for developing effective safeguards and addressing the broader societal implications of AI misuse.

Read Article

Company Pays Ransom to Delete Stolen Student Data

May 12, 2026

The recent cyber-attack on Instructure's Canvas software has significantly disrupted education at approximately 9,000 institutions across the US, Canada, Australia, and the UK. The attack involved the theft of 3.5 terabytes of sensitive student and university data, which the hacker group Shiny Hunters threatened to publish unless a ransom was paid. Instructure opted to pay the ransom to avoid further exposure of personal information, despite warnings from law enforcement that such payments can encourage future attacks and do not guarantee the deletion of stolen data. The incident has raised concerns about the safety of educational technology and the impact of cybercrime on students' academic experiences, particularly during critical exam periods. Students reported confusion and distress as exams were interrupted or postponed due to the breach, illustrating the direct consequences of cyber risks in educational environments. This situation highlights the urgent need for robust cybersecurity measures and ethical considerations surrounding the payment of ransoms in cyber incidents.

Read Article

Cybersecurity Breach Highlights Risks of Hacking Tools

May 8, 2026

Peter Williams, a former cybersecurity executive at L3Harris, has been ordered to pay $10 million in restitution for stealing advanced hacking tools and selling them to Operation Zero, a Russian firm. Williams, who previously managed Trenchant, L3Harris' division for developing spyware, was found guilty of stealing trade secrets that could have enabled widespread cyberattacks. The stolen tools were reportedly used by Russian government spies and later by Chinese cybercriminals, raising significant concerns about national security and the potential misuse of AI-driven hacking technologies. The incident highlights the risks associated with the proliferation of advanced hacking tools and the vulnerabilities within defense contractors, emphasizing the need for stringent security measures to prevent such breaches. Williams' actions not only caused financial losses estimated at $35 million for L3Harris but also posed a threat to global cybersecurity, affecting millions of devices worldwide. His case serves as a cautionary tale about the implications of insider threats in the tech industry, particularly in sectors dealing with sensitive information and national security.

Read Article

Funding for AI Gadgets Raises Safety Concerns

April 23, 2026

Era, a startup dedicated to developing a software platform for AI gadgets, has successfully raised $11 million in funding to assist hardware makers in creating intelligent devices. The company aims to provide a software layer that integrates AI capabilities into various hardware forms, such as glasses and home speakers. Era's platform supports over 130 language models from more than 14 providers, enabling dynamic routing and real-time functionality across devices. The founders advocate for a user-centric approach, emphasizing customization and privacy choices. However, the AI hardware space faces challenges, as no clear successful model has emerged, raising concerns about the implications of widespread AI gadget adoption. Issues related to privacy, security, and ethical considerations are paramount, particularly as AI systems become more prevalent in consumer technology. The potential for misuse and unintended consequences, especially regarding data handling and user autonomy, underscores the need for responsible AI development to mitigate risks and address biases that could affect various communities and industries reliant on technology.

Read Article

Vercel Hacked: Customer Data Compromised

April 20, 2026

Vercel, a cloud app hosting company, recently reported a security breach that exposed customer data after hackers accessed its internal systems. The breach originated from Context AI, a software maker whose app was downloaded by a Vercel employee, allowing hackers to exploit the OAuth connection to gain access to sensitive information. Although Vercel's main projects were not affected, the incident raises concerns about the broader implications of supply chain attacks, where compromised software can lead to extensive data theft across multiple organizations. Vercel has contacted affected customers and warned of potential downstream breaches that could impact many users across various sectors. Context AI, which had previously experienced a breach, acknowledged that the current incident may be more extensive than initially thought, as it likely involved compromised OAuth tokens for its users. The lack of transparency from both companies regarding the breach's details and the extent of the damage highlights the ongoing risks associated with AI and software supply chains, emphasizing the need for stronger security measures in the tech industry.

Read Article

Vercel Hacked via Compromised AI Tool

April 19, 2026

Vercel, a prominent cloud development platform, recently experienced a security breach attributed to a compromised third-party AI tool. The hackers, linked to the ShinyHunters group, accessed sensitive data, including employee names and email addresses, which they are now attempting to sell. Vercel confirmed that the attack stemmed from a Google Workspace OAuth app associated with the third-party AI tool, potentially affecting numerous users across various organizations. In response, Vercel has urged its customers to review their activity logs and take precautionary measures to secure their environments. This incident highlights the vulnerabilities introduced by third-party AI tools and raises concerns about data security in an increasingly interconnected digital landscape, emphasizing the need for robust security protocols in AI deployment.

Read Article

Windows 11 tool exposes database security risk

April 15, 2026

The article addresses significant security vulnerabilities related to Microsoft's Recall feature, introduced with Copilot+ Windows PCs. Initially, Recall stored user activity data in unencrypted files, raising concerns about unauthorized access. In response to criticism, Microsoft delayed the feature's rollout and implemented security enhancements, including encryption. However, the updated 'TotalRecall Reloaded' tool, developed by security researcher Alexander Hagenah, reveals ongoing vulnerabilities that could threaten user privacy. Specifically, this tool exploits a weakness in the AIXHost.exe process, which lacks the same security protections as the Recall database. Microsoft has classified this issue as not a bug and does not plan to address it, leaving users at risk if someone gains access to their PC and Windows Hello fallback PIN. The extensive data that Recall can collect raises further privacy concerns, prompting developers of other applications, like Signal Messenger, to take precautions by preventing Recall from accessing their content. This situation highlights the urgent need for robust security measures in AI systems to safeguard sensitive user information from unauthorized access and misuse.

Read Article

Spyware Maker Sentenced, Avoids Jail Time

April 6, 2026

Bryan Fleming, the founder of the spyware company pcTattletale, has been sentenced to time served and a $5,000 fine after pleading guilty to federal charges related to his illegal surveillance operations. This marks the first successful prosecution of a spyware maker by the U.S. Department of Justice in nearly a decade. Fleming's company was known for creating 'stalkerware' that allowed users to secretly monitor the devices of others without their consent. Investigations revealed that pcTattletale had significant security flaws, leading to a data breach that exposed sensitive information from numerous victims. Despite the severity of the crimes, Fleming avoided jail time, raising concerns about the accountability of spyware developers and the broader implications for privacy and security in the digital age. The case highlights the urgent need for stricter regulations and enforcement against illegal surveillance technologies, especially as the spyware industry continues to thrive in a largely unregulated environment.

Read Article

Grammarly's AI Copying Raises Ethical Concerns

April 5, 2026

Grammarly, recently rebranded as Superhuman, faced backlash for its 'Expert Review' feature, which used the names of renowned experts to generate writing suggestions without their consent. The feature, which aimed to provide insights from professionals, included names like Stephen King and Neil deGrasse Tyson, leading to confusion and outrage when it was discovered that it also used the names of living journalists without permission. Critics highlighted that the suggestions were often generic and did not accurately represent the experts' views. Following public outcry and a class action lawsuit filed by journalist Julia Angwin for privacy violations, Superhuman decided to disable the feature. This incident underscores the extractive nature of AI, raising concerns about consent, representation, and the ethical implications of using individuals' likenesses without proper authorization. The situation reflects broader societal anxieties regarding AI's impact on intellectual property and personal rights, emphasizing the need for clearer regulations and ethical standards in AI deployment.

Read Article

Cloudflare challenges fine over Italy's piracy law

March 18, 2026

Cloudflare is appealing a hefty 14.2 million euro fine imposed by Italy's communications regulator, AGCOM, for non-compliance with the Piracy Shield law. This law requires the rapid blocking of websites accused of copyright infringement within 30 minutes, a process Cloudflare argues undermines the broader Internet ecosystem by favoring large rightsholders at the expense of public access. The company contends that the law's implementation would necessitate a filtering system that could degrade its DNS service performance globally. Additionally, Cloudflare criticizes the law for lacking transparency and due process, leading to potential overblocking of legitimate sites without judicial oversight. The company claims the fine is disproportionately based on its global revenue rather than its Italian earnings and argues that the law violates EU regulations, particularly the Digital Services Act, which mandates proportionate content restrictions. As Cloudflare seeks EU intervention, concerns about unchecked censorship and the implications of AI-driven content moderation systems continue to grow, highlighting the risks associated with such regulations beyond Italy's borders.

Read Article

Grammarly Faces Lawsuit Over AI Feedback Feature

March 12, 2026

Grammarly's recent launch of the 'Expert Review' feature, which uses AI to simulate feedback from well-known authors without their consent, has sparked controversy and legal action. Journalist Julia Angwin has filed a class action lawsuit against Superhuman, Grammarly's parent company, claiming that the feature violates privacy and publicity rights by impersonating her and other writers. Critics, including AI ethicist Timnit Gebru, have raised concerns about the ethical implications of using individuals' likenesses and expertise without permission, especially when the AI-generated feedback is generic and lacks substance. The backlash led to Grammarly disabling the feature, although Superhuman's CEO defended the concept, suggesting it could foster connections between users and experts. This incident highlights the risks of AI technologies in misappropriating personal identities and expertise, raising questions about consent and the quality of AI-generated content.

Read Article

Grammarly halts AI expert cloning without consent

March 11, 2026

Grammarly recently announced it will discontinue its 'Expert Review' AI feature, which had drawn criticism for misrepresenting the voices of real experts without their consent. The feature, launched in August, utilized publicly available information to generate writing suggestions based on the work of influential figures. Following backlash from experts who felt their identities were being exploited, Superhuman, the company behind the feature, acknowledged the concerns and committed to rethinking its approach. The decision to disable the feature reflects a growing awareness of the ethical implications of AI technologies, particularly regarding consent and representation. Moving forward, Superhuman aims to ensure that experts have control over how their knowledge is utilized and represented in AI applications, emphasizing the importance of collaboration and ethical standards in AI development.

Read Article

Grammarly's AI Feature Sparks Legal Controversy

March 11, 2026

Grammarly, a writing assistance tool developed by Superhuman, is currently facing a class action lawsuit due to its AI feature known as 'Expert Review.' This feature provided users with editing suggestions that were falsely attributed to established authors and academics without their consent. The lawsuit highlights significant ethical concerns surrounding the use of AI in content creation, particularly regarding consent and intellectual property rights. By misrepresenting the source of these suggestions, Grammarly not only risks legal repercussions but also undermines the trust of its user base and the integrity of the authors involved. The company has since shut down the feature, but the incident raises broader questions about the implications of AI technologies in creative fields and the potential for misuse that can harm individuals and communities. As AI systems become more integrated into everyday applications, the need for clear ethical guidelines and accountability becomes increasingly urgent to prevent similar issues in the future.

Read Article

Grammarly Faces Lawsuit Over Identity Theft

March 11, 2026

Grammarly is facing a class-action lawsuit filed by journalist Julia Angwin, who claims the company unlawfully used her identity in its 'Expert Review' AI feature without her consent. This feature, which was designed to provide AI-generated editing suggestions by mimicking the insights of real experts, has drawn criticism for violating privacy and publicity rights. Angwin discovered her likeness was used when another journalist revealed the issue, prompting her to take legal action against Grammarly. In response to the backlash, Grammarly's CEO acknowledged the misstep and announced the discontinuation of the feature, stating that the company would rethink its approach moving forward. This incident raises significant concerns about the ethical implications of AI technologies that exploit individuals' identities for commercial gain without permission, highlighting the need for stricter regulations and ethical standards in AI deployment.

Read Article

Grammarly Misuses Authors' Identities Without Consent

March 10, 2026

Grammarly's new feature, 'Expert Review,' has sparked controversy as it utilizes the names of authors without their consent, presenting AI-generated suggestions as credible insights. The company faced backlash after it was revealed that many prominent authors were unknowingly included in this feature, which leverages their identities to enhance the perceived authority of its AI outputs. In response to the criticism, Grammarly announced that authors could opt out of this feature by emailing the company, but did not offer an apology or indicate any intention to change the underlying practice. Critics argue that this approach is inadequate, as it places the onus on authors to protect their names rather than ensuring their consent is obtained beforehand. The situation raises significant concerns about identity appropriation and the ethical implications of AI technologies that leverage personal identities without permission, highlighting the need for stricter regulations and ethical standards in AI deployment.

Read Article

U.S. Contractor Linked to Russian Spy Hacking Tool

March 10, 2026

A sophisticated hacking toolkit known as 'Coruna,' developed by U.S. military contractor L3Harris, has been linked to cyberattacks targeting iPhone users in Ukraine and China, after falling into the hands of Russian government hackers and Chinese cybercriminals. Initially designed for Western intelligence operations, Coruna comprises 23 components and was first deployed by an unnamed government customer. Researchers from iVerify suggest it was built for the U.S. government, with former L3Harris employees confirming its origins in the company's Trenchant division. The case of Peter Williams, a former general manager at Trenchant, further illustrates the risks; he was sentenced to seven years in prison for selling hacking tools to a Russian company for $1.3 million, which were subsequently used by a Russian espionage group to compromise iPhone users. This situation raises significant concerns about the security of surveillance technologies and the unintended consequences of their proliferation, highlighting the ethical dilemmas faced by defense contractors and the need for stringent oversight to prevent advanced hacking tools from being misused by malicious actors.

Read Article

Grammarly's Misleading Expert Review Feature

March 7, 2026

Grammarly's new feature, Expert Review, claims to enhance users' writing by providing feedback inspired by renowned authors and journalists. However, the feature has drawn criticism for misleadingly implying that these experts are involved in the review process, when in fact, they are not. The feedback is generated based on publicly available works of these individuals without their consent or endorsement. This raises ethical concerns about the authenticity of the advice provided and the potential for misinformation, as users may mistakenly believe they are receiving expert guidance. The lack of actual expert involvement undermines the credibility of the feature and highlights broader issues regarding the transparency and accountability of AI systems in content creation. As AI technologies like Grammarly continue to integrate into everyday tools, the implications of such practices could affect users' trust in AI-generated content and the overall quality of information disseminated online.

Read Article

Showing 20 of 31 articles