OSINT investigators battle data glut & scarcity with AI

Investigators across financial services, corporates and the public sector face a growing data paradox, with new research indicating that open-source intelligence is constrained as much by information problems as it is strengthened by them.

A survey of open-source intelligence (OSINT) users in the UK and Europe by Blackdot Solutions found that data-related issues are now the primary barrier to effective investigations. Respondents cited both limited access to relevant information and an overwhelming volume of material as key obstacles.

The findings come against a backdrop of rising crime levels. Recent figures show headline crime up 14% on the previous year's survey. The United Nations Office on Drugs and Crime estimates that between EUR 715 billion and 1.87 trillion is laundered each year through economic crime.

The research underpins Blackdot's inaugural State of OSINT Report, which examines how investigators across financial services, multinational corporates, public bodies and professional services are using publicly available data.

Data paradox

Across all sectors surveyed, investigators identified data as their greatest barrier to effective OSINT work. Public sector respondents pointed to limited access to relevant sources. Corporate teams reported similar constraints linked to access and permissions.

Investigators in financial and professional services described a different problem. They face an abundance of data and struggle with the volume and complexity of information that is now available. The survey found that this glut of material slows casework and complicates analysis.

These pressures are increasing demand for more automated methods for managing and interpreting information. Respondents said the contrast between data scarcity in some environments and overload in others now defines much of their daily work.

Jonathan Groom, Director at Jersey FIU, said that structured practice remains central to effective open-source work.

"OSINT isn't just an internet search. The requirement to employ a suitable intelligence process is critical when doing OSINT if you are to deliver a structured, consistent, defendable and understood approach that supports case movement and assists in recognising where gaps and limitations may exist."

Role of AI

The survey found broad optimism about the role of artificial intelligence in addressing these challenges. Around three-quarters of respondents expected AI's greatest impact in data collection, processing and analysis.

Over half of those surveyed highlighted speed and efficiency as the main benefits. They indicated that AI could reduce research times and automate manual work that currently absorbs significant investigator effort.

Respondents generally viewed AI as a complement to human expertise. The report recorded a strong leaning towards the view that AI will enhance, rather than replace, professional judgement in OSINT investigations.

Stuart Clarke, CEO at Blackdot Solutions, said the survey reflects a shift in how investigative teams think about technology in data-heavy environments.

"Investigators are telling us that data remains both their biggest challenge and their greatest opportunity, and that's exactly where AI can make the biggest difference," said Stuart Clarke, CEO at Blackdot Solutions. "Our survey shows a clear optimism about AI's role in OSINT, not as a replacement for human judgment, but as a force multiplier. With solutions like Videris Automate, we're helping teams overcome data barriers, reduce manual effort, and accelerate the path from information to insight."

Investment trends

The research also indicates a sustained rise in spending on OSINT tools and processes. Most organisations surveyed expect to maintain or increase their investment over the next five years.

Respondents linked this outlook to the scale of financial and economic crime, as well as the growing complexity of investigations that depend on public data sources. Many said long-term spending plans now assume OSINT as a core element of risk, fraud and compliance work.

The data suggests that organisations in regulated sectors are likely to deepen their use of OSINT as part of wider financial crime and due diligence programmes. Respondents from multinational corporates and professional services firms reported similar expectations.

Blackdot is based in Cambridge and develops software for investigators who use open-source intelligence. Its Videris platform is in use at government agencies, law enforcement bodies, financial institutions and large corporates in multiple jurisdictions.

The company said future editions of the State of OSINT Report will track how attitudes towards data, AI and investment evolve as crime patterns and regulatory demands continue to change.