User documentation
Everything you need to use the platform. Developers: see the REST API reference. Administrators: deployment and configuration guides ship with the application (docs/).
Getting started
- Create an account and sign in.
- Open Submit URLs, paste your links (one per line) or upload a
.txt/.csvfile. - Press the one Submit button.
- Watch the three steps on the job page — it updates by itself, and you can leave the page.
- Read the results: every URL has a short explanation in plain words and tips on what to do.
- Download a report (Excel or CSV) from Reports & downloads if you need one.
The dashboard shows a Getting started checklist until you have done each step once. Optional: connect Google Search Console (menu More tools → Search Console) to see verified Google indexing status.
The 3 steps of a job
- Link check — every page is opened like a browser would: we check that it loads, follows redirects, and read its robots, noindex and canonical settings.
- Google check — with Search Console connected, Google tells us whether each page is in its index. When the site owner has turned on the Google index checker, every URL (also on other people's sites) is looked up in Google as well — see Is it in Google?.
- WordPress link — when enabled, suitable pages get a visible link inside a published WordPress post. This starts as soon as the link check is done, while the Google check is still running.
Each step shows Waiting, In progress, Done or Off. Indexing itself is always decided by Google.
Submitting URLs
Accepted input: one URL per line (commas, semicolons and whitespace also separate entries), .txt files, and .csv files (a column named url/link is used when present; otherwise the first URL-like cell of each row). Only http and https are supported; URLs without a scheme are assumed to be https. Duplicates are removed before queueing. Your plan defines the maximum URLs per batch and per day; each URL consumes one credit.
Options: enable or disable WordPress insertion and Google inspection per submission, and optionally provide a custom anchor text used for WordPress links.
Controls: pause, resume, cancel pending work, retry failed URLs or retry a single URL from its report page.
Automatic retries
Some problems are temporary: a website that is slow, overloaded (HTTP 5xx / 429) or briefly unreachable. Those URLs are tried again automatically, waiting longer each time (for example after 30 minutes, then 1.5 hours, then 4.5 hours — the administrator sets the rules). The job page shows how many URLs will be retried and when; each URL page shows the retry count, the next try and the full history. Permanent problems (page not found, access refused, invalid address, broken SSL certificate, redirect loop) are not retried automatically — fix the page and press Re-process. A URL is only shown as successful when an attempt really succeeded, and a retry never adds a second WordPress link.
Ahrefs Indexer
Every account (Free or Pro) has the Ahrefs Indexer in the main menu. Paste your URLs in the box at the top — or press Add today's URLs to take every URL you submitted today — then choose the indexer sites below: Select all, Unselect all or tick sites one by one. Press Send to the indexer. Your URLs are checked like any job and then placed as visible links in published posts on the sites you ticked, so crawlers such as AhrefsBot and Googlebot find them. Each URL uses one credit; the progress shows live.
Site crawler (Bot)
Under Site crawler (Bot) enter a website and press Start bot. Our bot (IndexPulseBot):
- checks
robots.txt— if the site blocks bots, it stops; - reads every sitemap (including WordPress post, page and category sitemaps);
- visits the pages and follows internal links to find posts that are not in a sitemap;
- collects at most as many URLs as your plan allows right now (URLs per batch, URLs left today and credits) and then sends them for indexing.
Everything is shown live on the crawl page: each sitemap, each visited page, problems (404, server errors) and the number of URLs found. You get an alert under the bell icon when the bot is done. Download the found URLs as Excel/CSV, or press Send these URLs for indexing if you started without that option. Start as many crawls as you like: one runs at a time per account, the others show Waiting for its turn and start by themselves. The bot reads several sitemaps and pages at the same time. If a site does not answer on https://, it uses http://. Site owners can check any website on the public website status checker.
My sites & schedules
Save your websites once under Site crawler (Bot) → My sites, or add many at once under Bulk add (one site per line, up to 200). For each site choose when the bot comes back: hourly, every 6 or 12 hours, daily or weekly at a time in your own time zone (it is filled in from your browser). The first crawl sends every page it finds. Every later crawl sends only the pages it has never sent before — new posts first — so new links are submitted for indexing soon after they are published. You get an alert under the bell when a scheduled crawl found new pages; quiet runs do not disturb you. Pause, run now, change the schedule or remove a site at any time.
Is it in Google?
Search Console can only report on sites you own. For every other URL — for example backlinks on other people's sites — the tool searches Google for that exact address (a site: search) right after the link check, and again after 1, 3, 7 and 14 days until it shows up. The In Google? column then shows:
- In Google — found in Google's results (a check mark) or confirmed by Search Console (a badge);
- Not in Google yet — not found so far; checked again later by itself;
- Checking soon — the first check is waiting;
- Check failed — the search service did not answer; tried again later.
Filter a job or the URL list by In Google / Not in Google yet, press Check Google index now on a job or a URL page (a daily limit applies), and download the answers with the Excel/CSV report. When URLs are found you get one alert under the bell for the whole batch. A search result is a strong sign but not an official statement from Google; new links often take days or weeks.
IndexNow (Bing, Yandex & co.)
For a site in My sites that you own, open IndexNow, download the key file and upload it, unchanged, to the main folder of the site (so that https://your-site/<key>.txt opens). Press Verify. From then on every crawl sends its new pages to IndexNow at once, which informs Bing, Yandex, Seznam, Naver and other participating search engines. Google does not use IndexNow.
Closing the browser
All work runs on the server: link checks, crawls, schedules, WordPress links and Google lookups continue after you close the tab or switch off your computer. Come back any time — the job page, the bell and the live panel show what happened.
Live activity
The dashboard, every job page and every crawl page have a Live activity panel: link checks, problems, retries, Google results, WordPress links, crawler steps, backlink checks and payments appear there as they happen (newest on top). You only ever see your own activity.
Plans & upgrade
Your plan (Free, Pro …) is shown next to the bell icon. Press Buy Pro (or open My account → Plans & upgrade), choose a plan and the number of months, and pay with Binance (crypto), Payoneer, EasyPaisa, JazzCash or bank transfer — the account details and the amount (in USD, and in rupees for local methods) are shown. Then enter the transaction ID and/or upload a screenshot and press I have paid — send for approval. Your payment goes straight to our chat; as soon as we confirm it your plan switches on, credits are added and you get a chat message and an alert. Renewing adds the months to the time you already have. When a paid period ends, the account goes back to the free plan automatically.
Backlink monitor
Under Backlink monitor enter your website and the pages that link to it (or tick Monitor these backlinks when submitting URLs). We open each page regularly and report:
- Active — the page links to your site (anchor text and nofollow/sponsored/ugc are shown);
- Removed — the page works but the link is gone;
- Broken — the page is gone (404/410) or the website stayed unreachable for three checks in a row;
- Redirected — the page now forwards somewhere else;
- Unknown — we could not decide this time (blocked for crawlers, temporary error); it is checked again sooner.
Changes of anchor text, link address or rel are recorded in the history of each backlink. When a link is lost you get an alert under the bell icon and — if you keep e-mail alerts on — an e-mail. Use Check now for an immediate check, Recheck all to re-check everything, and Download for an Excel/CSV list.
Excel & CSV reports
Open Reports & downloads → Download a report, choose what you want (URL results, jobs, backlinks or WordPress links), one job or all jobs, the format (Excel or CSV) and optionally a date range, a result (successful, needs attention, failed, still working) and a stage (link check, Google, WordPress). Reports contain the URLs, link-check results, Google status, WordPress results, times and errors — with a plain-language explanation and advice for every URL. Every job page also has a Download report button. You only ever download your own data.
Security & sessions
My account → Security & sessions lists every browser and device where you are signed in (browser, system, IP address, approximate location when enabled, sign-in time and last activity) and your recent sign-ins and failed attempts. Press Sign out next to a device you do not recognise, or Sign out all other devices. You are signed out automatically after a period of inactivity, and changing your password can sign out all other devices.
Getting help
Use the Chat with us button at the bottom right of every page, or contact us on WhatsApp / Telegram (buttons on the sign-in page, your dashboard and the contact page).
Status reference
| Status | Meaning |
|---|---|
| Pending / Queued | Waiting for a worker. |
| Processing | A worker is fetching the page now. |
| Successfully Fetched | HTTP 200 (or 2xx) without blocking directives. |
| Redirect Detected | The URL redirected; the final URL is recorded. |
| Noindex Detected | Meta robots / X-Robots-Tag contains noindex. |
| Nofollow Detected | Page-level nofollow directive (does not block indexing of the page itself). |
| Robots Restricted | robots.txt disallows the URL for our crawler and/or Googlebot. |
| Canonical Mismatch | The canonical tag points to a different URL. |
| HTTP Error | 4xx/5xx response. |
| Connection Failed | DNS, TLS, timeout or connection problem after retries. |
| Retry Required | A temporary failure; the job will retry with backoff. |
| Invalid / Blocked | Malformed URL, or a target that is not publicly routable. |
| Google Indexed / Not Indexed / Inspection Available | Set only from a verified URL Inspection API response. |
| Google Status Unknown | No verified Google data available. |
| WordPress Pending / Processing / Added / Failed | State of the WordPress insertion for this URL. |
Discovery results
For each host in a submission the engine looks for public sitemaps (robots.txt Sitemap: lines plus /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml, /sitemap.txt), parses them (including sitemap indexes and gzip), discovers RSS/Atom feeds, and checks whether your URLs are linked from the homepage or from other fetched pages. The flags Found in sitemap, Found in feed and Discovered through internal links describe the public web — they never imply Google has crawled the URL.
Google Search Console
Every user connects their own Google account — the one that owns their Search Console properties. By default we request read-only access; tick "allow sitemap submission" to also grant the write scope. After connecting, select the properties whose URLs should be inspected. Inspection runs automatically in stage 5 for URLs inside selected properties (each property has a daily quota) and can also be triggered manually from a URL report. Disconnecting revokes the token at Google and deletes it from our database.
Sitemaps
Add a sitemap URL to validate it (structure, entry count, errors). Assign it to one of your properties to submit it to Search Console and track Google's status for it. Only sitemaps inside your own properties can be submitted.
Indexing API
The Google Indexing API is only permitted for pages with JobPosting or BroadcastEvent structured data. The platform fetches the page, checks its JSON-LD and refuses ineligible URLs with an explanation. Requires a service account configured by the administrator.
WordPress insertion
When the administrator has enabled the integration, URLs that were publicly fetched and are not noindex are queued for insertion after processing finishes. Depending on the configured mode they are inserted automatically or wait for administrator approval. Links are placed inside a visible "Related resources" block at the end of an approved post; the platform never changes existing content and verifies each update. Your submission page and the WordPress links report show post title, URL, insertion time and status for every URL.
Reports & exports
Each submission has a summary (processed, failed, discovery, Google and WordPress results) and a filterable URL table. Each URL has a report page with processing history, discovery results, inspection history, insertion details and recommended next steps. Excel, CSV and TXT downloads are available for submissions, all URLs, single URLs, backlinks and WordPress links — see Excel & CSV reports.
Plans & credits
Plans define daily URL limits, batch size, uploads, API access and priority. One credit is consumed per URL queued for processing (also for URLs sent by the bot or the Ahrefs Indexer). Credits represent processing usage only. To get more, see Plans & upgrade or message us.
API keys
Create keys under API keys. A key is displayed once; only a hash is stored. Send it as Authorization: Bearer <key>. See the API reference for endpoints and examples.