Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more

If a Next.js portfolio is missing from Google or ChatGPT Search, first find out which step is failing: can the crawler fetch the production URL, can it see the page’s content and indexing directives, and is the page eligible to appear in that service? Those are separate checks. Metadata, a sitemap, or allowing a crawler can help address specific barriers, but none guarantees indexing or a ChatGPT citation.

This guide walks through those checks on a deployed site. Without the portfolio URL and records showing its original state and subsequent changes, there is no basis to claim a particular change fixed a specific site.

How Google handles a JavaScript page

Google processes JavaScript pages in distinct stages: crawling, rendering, and indexing. Googlebot first needs permission to fetch the page and its resources. A page returning HTTP 200 is generally queued for rendering unless an indexing directive says otherwise, but rendering can be delayed. A non-200 response may mean rendering is skipped. Passing one stage does not prove the page passed the next.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Client-rendered pages are not categorically unindexable: Google can render JavaScript. But server-rendered or prerendered HTML can make important content available sooner and supports crawlers that do not execute JavaScript. See Google’s JavaScript SEO guide.

Check the production URL and response

Start with the exact public URL you expect people to find, not a local build or deployment preview. Follow redirects and inspect the final response. Confirm the final page loads successfully, uses the intended public URL, and does not redirect to an unexpected host or path. Google’s rendering process depends on the response and crawl access, so a working browser view alone is not enough to establish what Google receives.

  • Record the URL tested, the final destination after redirects, and the HTTP status.
  • Inspect response headers as well as the page. An X-Robots-Tag header can restrict indexing even when the HTML looks correct.
  • Use Google Search Console’s URL inspection to examine Google’s reported crawl and indexing state; compare that evidence with what the deployed URL returns.

Make sure crawlers can reach the page

Open the deployed site’s /robots.txt and check whether its rules block the portfolio path or resources needed to render it. A robots.txt restriction can stop a crawler from fetching a page; it can also prevent Google from seeing a page-level noindex directive. Google says robots meta tags and X-Robots-Tag rules can only be read when the crawler is allowed to access the page. Use Google’s robots meta tags specifications for the distinction between crawl rules and indexing directives.

For a Next.js App Router project, the robots convention can be implemented as app/robots.txt or app/robots.ts. It supports user-agent rules and can include a sitemap URL. Check the deployed output, not only the source file, against the Next.js robots file documentation.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Check Googlebot and OpenAI’s OAI-SearchBot separately. A policy intended for one crawler may not give the other access.

Look for accidental indexing restrictions

Inspect both the original HTML response and response headers for noindex or other restrictive robots directives. A development setting, shared layout, or deployment configuration can apply a directive more broadly than intended. Remove or scope a restriction only after confirming it is not deliberate.

Do not use robots.txt as a substitute for noindex when the goal is to keep a page out of search results: blocking a crawl can prevent a search engine from reading the directive. Next.js Learn explains common search-engine meta tags in Special Meta Tags for Search Engines.

Compare the HTML with the rendered page

Inspect the initial HTML returned by the production URL, then compare it with the browser-rendered DOM. The portfolio’s actual text—such as project descriptions—and its crawlable links should be present in the rendered page. If the initial response is nearly empty and the content appears only after client-side code runs, that can make the page less robust for crawlers that do not execute JavaScript.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Google may render JavaScript, but its documentation recommends considering server-side rendering or prerendering because these approaches can help users and crawlers. This is a robustness option, not proof that client rendering caused a particular indexing problem.

Review titles, descriptions, and canonical URLs

Give each portfolio page a descriptive, page-specific title and description. In the Next.js App Router, use the metadata APIs when appropriate; consult the current Next.js metadata and Open Graph documentation for supported configuration.

Check the canonical URL in both the original HTML and rendered output. It should point to the intended public URL, and the page should not send inconsistent canonical signals. Google treats a canonical declaration as a signal, not a command, so correct markup does not guarantee that Google will select that URL.

Verify the sitemap and URL consistency

If the site uses a sitemap, confirm that the deployed sitemap is accessible and lists the intended canonical public URLs—not previews, alternate hosts, or URLs that redirect elsewhere. Next.js supports a sitemap.xml convention alongside its robots convention. A sitemap can help discovery, but it does not guarantee that a listed page will be indexed.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Check ChatGPT Search separately

Google indexing and visibility in ChatGPT Search are different outcomes. OpenAI’s Publishers and Developers FAQ advises: “For your site content to be included in summaries and snippets in ChatGPT, make sure you aren’t blocking OAI-SearchBot.” Allowing OAI-SearchBot makes content eligible for consideration; it does not guarantee inclusion, ranking, or citation.

Test the public site’s robots rules for OAI-SearchBot independently of Googlebot. Keep evidence of ChatGPT Search appearance separate from Google Search Console results: success in one does not establish visibility in the other.

Measure whether a change helped

For each change, record what the crawler could access before and after deployment, when the change shipped, and what the relevant inspection tool or logs reported. Separate observations—such as a successful fetch or a page appearing in results—from assumptions about cause. Without dated before-and-after evidence, it is not possible to establish that a particular change fixed the problem or to promise when a page will appear.

  • Confirm the final production URL, response status, and redirects.
  • Verify robots access for the relevant crawler and inspect page-level directives.
  • Compare the initial HTML with the rendered content, links, metadata, and canonical.
  • Check sitemap entries and record Google’s URL inspection results.
  • Check OAI-SearchBot access and assess ChatGPT Search independently.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.