The index

The data is the cheap part.

We do not sell you the index. We read it. Every record in it is published, it is refreshed overnight, and the source is named on every finding it produces.

What is in it, and how often it changes.

06:00

rebuilt by

Every working morning, between two and six, so the board is ranked before anyone sits down.

Window02:00 to 06:00

DaysEvery working morning

named sources

Counted from the registry below, not typed.

Derived fromThe registry

Record classes6

records bought

Nothing in the index was purchased from a data broker.

Brokers usedNone

Enrichment shownNever, on any surface

Every source, named.

The breadth of named sources is the credibility, so this list is rendered from the source registry rather than written by hand. It cannot drift from what the crawlers actually read.

SourceRecord classRead byRefreshed

ACNC Charity Register — registered charities datasetAustralia · Australian Charities and Not-for-profits CommissionCharity recordProspect, Signals, Researchweekly

Australian Business Register — bulk extractAustralia · Australian Taxation Office · 8,334,184 companiesCompany filingProspect, Signals, Expansion, Partner, Researchweekly

KBO / BCE Open Data — Crossroads Bank for EnterprisesBelgium · FPS Economy, SMEs, Self-employed and Energy · 1,963,487 companiesCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

Localisation des entreprises en WallonieBelgium · Service public de WallonieCompany filingProspect, Signals, Expansion, Partner, Researchquarterly

Banco Central do Brasil — domínios verificados de instituições em funcionamentoBrazil · Banco Central do BrasilCompany filingProspect, Signals, Expansion, Partner, Researchdaily

Cadastur — cadastro de prestadores de serviços turísticosBrazil · Ministério do TurismoCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

CNES — Cadastro Nacional de Estabelecimentos de SaúdeBrazil · Ministério da Saúde / DATASUSCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

Receita Federal — Cadastro Nacional da Pessoa Jurídica (dados abertos)Brazil · Receita Federal do Brasil · 26,457,013 companiesCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

INSEE — SireneFranceCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

Adzuna — job listings APIUnited KingdomJob listingHiring, Signalsdaily

Care Quality Commission — HSCA Active Locations (providers)United Kingdom · Care Quality CommissionRegulator recordSignals, Expansion, Researchmonthly

Charity Commission for England and Wales — register of charities (public data extract)United Kingdom · Charity Commission for England and WalesCharity recordProspect, Signals, Researchdaily

Companies House — Accounts Data ProductUnited KingdomCompany filingProspect, Signals, Expansion, Partner, Researchdaily

Companies House — Free Company Data ProductUnited Kingdom · 4,736,587 companiesCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

Companies House — officersUnited KingdomCompany filingProspect, Signals, Expansion, Partner, Researchdaily

Companies House — PSC snapshotUnited KingdomCompany filingProspect, Signals, Expansion, Partner, Researchdaily

Companies House — Streaming APIUnited Kingdom · 1,017,475 companiesCompany filingProspect, Signals, Expansion, Partner, Researchrealtime

Contracts Finder (Cabinet Office) — OCDS noticesUnited KingdomTender noticeTender, Researchdaily

FCA — Financial Services RegisterUnited Kingdom · Financial Conduct AuthorityCompany filingProspect, Signals, Expansion, Partner, Researchdaily

Find a Tender Service — OCDS noticesUnited KingdomTender noticeTender, Researchdaily

Food Standards Agency — food hygiene ratingsUnited Kingdom · Food Standards AgencyCompany filingProspect, Signals, Expansion, Partner, Researchdaily

HM Land Registry — UK companies that own property in England and Wales (CCOD)United Kingdom · HM Land RegistryCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

HMRC — UK Trade Info tradersUnited Kingdom · HM Revenue & CustomsCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

Innovate UK — funded projectsUnited Kingdom · UK Research and InnovationCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

ONS Postcode DirectoryUnited KingdomCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

Reed — jobs posted by direct employers (Jobseeker API)United Kingdom · Reed Online LtdJob listingHiring, Signalsdaily

The Gazette — corporate insolvency noticesUnited Kingdom · The Stationery Office for HM GovernmentCompany filingProspect, Signals, Expansion, Partner, Researchdaily

Sudski registar — Croatian court register (open data)Croatia · Ministry of Justice and Public Administration · 186,064 companiesCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

Brønnøysundregistrene — EnhetsregisteretNorway · Brønnøysundregistrene · 1,177,737 companiesCompany filingProspect, Signals, Expansion, Partner, Researchcontinuous

Charities Register — Charities Services open dataNew Zealand · Charities Services, Department of Internal AffairsCharity recordProspect, Signals, Researchmonthly

New Zealand Business Number — bulk dataNew Zealand · Ministry of Business, Innovation and Employment · 1,826,187 companiesCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

SEC EDGAR — full-text and filing feedsUnited StatesCompany filingProspect, Signals, Expansion, Partner, Researchdaily

Apollo — contact enrichmentAcross countriesCompany filingProspect, Signals, Expansion, Partner, Researchon_demand

Certificate Transparency logsAcross countries · Google, Let's Encrypt, Geomys, IPng NetworksCompany websiteProspect, Researchcontinuous

DVSA / Traffic Commissioners operator licencesAcross countriesRegulator recordSignals, Expansion, Researchweekly

Email pattern inferred from verified addresses at the same domainAcross countriesCompany filingProspect, Signals, Expansion, Partner, Researchcontinuous

GDELT Project — global news monitoring (DOC 2.0 API)Across countriesCompany filingProspect, Signals, Expansion, Partner, Researchdaily

GLEIF — LEI concatenated filesAcross countries · 16,258 companiesCompany filingProspect, Signals, Expansion, Partner, Researchdaily

Lockley crawlAcross countriesCompany websiteProspect, Researchtiered

Overture Maps Foundation — PlacesAcross countriesCompany filingProspect, Signals, Expansion, Partner, Researchmonthly

Public web search resultsAcross countriesCompany websiteProspect, Researchcontinuous

The company's own site and DNS — technology fingerprintAcross countriesCompany filingProspect, Signals, Expansion, Partner, Researchcontinuous

The company's own website — team and about pagesAcross countriesCompany websiteProspect, Researchcontinuous

Wikidata — official websites of companiesAcross countriesCompany websiteProspect, Researchmonthly

A source not on this list is a source Lockley does not read.

How we read, and what we refuse to read.

Four commitments, two with a value we publish against it. A commitment with no number beside it says so, and says where the record is.

Identity

One crawler, and it identifies itself

Lockley reads as one named crawler with a published contact address, so any site owner can see exactly what visited and when. It never disguises itself as a browser.

Published against it

User-agent: LockleyBot/1.0 (+https://lockley.ai/bot)

Published, and checkable from outside.

robots.txt

We honour robots.txt, and we log it

A disallow is obeyed and recorded. The log is what lets us prove a refusal was honoured rather than simply claimed.

Published against it

Logged, not measured

No single figure states it. The log is the record, and it is available on request.

Rate limits

Rate limits published, not just applied

One request a second per host, and fewer pages on a small site. A research tool that costs a council money to serve is not a research tool worth defending.

Published against it

One request per second per host

Published, and checkable from outside.

Reservations

Machine-readable reservations are respected

Where a publisher reserves rights in a form a machine can read, that reservation is treated as binding even where the law has not caught up.

Published against it

Logged, not measured

No single figure states it. The log is the record, and it is available on request.

If you are in the index and would rather not be

Tell us and we remove you, then keep you out.

A person or a company can object to being in the index. We remove the record and add the identifier to a suppression list.

One address, answered by a person: privacy@lockley.ai. Our privacy notice explains what we hold and why.

Check or remove a company

What the index will not give you

1No personal email addresses and no direct dials from us. Lockley shows the switchboard a company publishes and the people its own website names; a licensed contact detail appears only when you ask for it, and it is recorded that you did.

2No home addresses, no personal phone numbers, and nothing about a person outside their stated professional role.

3No inferred attributes. Lockley does not guess a budget, a seniority or an intent and present it as a fact.

4No export of the index. You are buying the research that runs on it, not a copy of it, which is also why there is no per-record price.

See what it finds on your own market.

Type a web address and Lockley reads the index against your business in forty-five seconds.