What’s actually slowing this PC down?
Pick the symptom - the matching free tool is one click away.
iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more
Antihost offers managed WordPress hosting with free migration, one-click staging and a 14-day free trial.
To ask search engines not to index an entire WordPress site, go to Settings > Reading, turn on Discourage search engines from indexing this site, and click Save Changes. Current WordPress adds a noindex,nofollow robots directive to pages that use the normal wp_head hook. The setting is only a crawler request: visitors can still open the site, and it does not provide password protection.
Use the WordPress site-wide setting
This is the correct first step when you want to keep a development copy, temporary campaign site, or entire public site out of search results without taking it offline.
- Sign in to the WordPress administrator dashboard.
- Open Settings > Reading.
- Find the Search Engine Visibility section.
- Enable Discourage search engines from indexing this site.
- Click Save Changes.
WordPress documentation says the option causes WordPress to output <meta name='robots' content='noindex,nofollow' /> in the page head when the theme calls wp_head. Search engines must choose to honor that request; WordPress does not enforce it technically.
What happens after you save
The directive applies to pages generated through the normal WordPress front end, including the home page and ordinary posts and pages. It does not erase URLs instantly from an index. A crawler has to revisit each URL, fetch the response, and process the directive. Search results can therefore persist for a while, especially when a URL is rarely crawled or is already well established.
#1 Best Overall
- Powerful Turbo Fan:CAGIWIRU Electric Air Duster have reached speed up to 130000RPM,Can efficient remove dust and debris.With LED light and Three Adjustable Speed to meet with different cleaning tasks.
- With Attached USB C Fasting Charging cable.Charing 3 hours,Enjoy up to 240 minutes of use on the lowest setting, For third speed can use for 25mins.with four charging options to meet with your needs.
- Wide Application:Upgraded attached 5 different nozzles,making it suitable for a variety of scenes, such as car,pet, pc, keyboards, and other electronic devices. It also serves for office and home clean duster.
- Handy Design & Portable:Cordless air duster electric nozzle is Light weight and small size, design and comfortable to hold and space saving, convenient to carry around. You can put it in your room or inside the car without taking up space.
- Warranty & Support: Our Electric air duster comes with 5 years warranty and 24/7 customer service. During this period, if you have any questions,pls kindly feel free to contact us.
What the checkbox does not do
- It does not make the site private.
- It does not require visitors to log in.
- It does not block a person who knows a URL.
- It does not stop every crawler from requesting pages.
- It does not remove files that are already copied, cached, or linked elsewhere.
WordPress explicitly describes the control as a request to search engines, not an access-control mechanism. Treat it as search exclusion, not security.
Choose the right control for your goal
Search visibility and access restriction are different problems. Select the mechanism that matches the resource and the consequence you need.
| Goal | Recommended mechanism | Crawler can fetch the URL? | Protection strength |
|---|---|---|---|
| Discourage indexing of the whole WordPress site | Settings > Reading site-wide checkbox | Usually yes | Search-exclusion request only |
| Keep selected posts, pages, archives, or files out of search | HTML noindex metadata or an HTTP X-Robots-Tag |
Yes, so the directive can be read | Search-exclusion request for the selected resource |
| Prevent a page from being reachable by ordinary visitors | Login, application password, server authentication, or hosting-level protection | No, unless authenticated | Actual access restriction |
| Control crawling of a path to reduce server load | A carefully scoped robots.txt rule |
Often no | Not a reliable removal or privacy method |
Use only one mechanism when it is sufficient, and understand the interaction when combining them. A crawl block can prevent Google from seeing a noindex directive.
How noindex works
noindex tells a compliant search engine not to include a fetched URL in its search index. Google supports the directive in either an HTML robots meta tag or an HTTP response header. The basic HTML form is:
<meta name='robots' content='noindex'>You can add nofollow when you also want to ask the crawler not to follow links on that page:
Rank #2
- Screen Cleaner is Your Screen’s New Bestfriend! - EVEO is proud to present a screen cleaner that’s perfectly suited for your TV. Meet your new screen cleaner, computer screen cleaner, laptop cleaner, iPad cleaner, Macbook,tv cleaner or any other electronic device. Our screen cleaner spray and wipe along with the included plush microfiber cloth, easily removes dust, fingerprints & other smudges on the screen’s surface. Clean effectively for a streak-free screen
- Gentle on your Screens - Our screen cleaner spray and wipes is compatible to be used even for the most sensitive LCD, LED, CRT, and OLED screens in proper use. Be at ease knowing that this product is compatible with all the major brands: LG, SONY, Samsung, Sharp, iPad, iPhone, Android screens, Kindle, PC monitors - we’ve got you covered! Can be used as LCD screen cleaner, tv cleaner, smart tv screen cleaner, and more
- Premium Super Soft Plush Microfiber Cloth - Included in this efficient screen cleaning kit. This screen cleaner spray and wipe has our signature plush microfiber cloth specially designed to comply with screens and monitors and leave them streak-free. Has been shown to effectively absorbs stubborn stains, zero streaks, and no fiber shedding. Always use this together with our screen cleaner for the best results
- Easy-to-Use Screen Cleaner Kit + microfiber cleaning cloth - The EVEO Screen Cleaning Kit will easily be your new favorite tool when it comes to taking care of the things you love most, quick and easy solution for a streak-free screen. Simply screw on the sprayer gun on the screen cleaner bottle. Spray the cleaning liquid onto the microfiber cloth, then wipe the screen until desired cleanliness & shine is achieved.
- Quality Screen Care Kit Worth Purchasing - Enjoy a convenient Screen Cleaner anytime, anywhere you need it. Your satisfaction is our top priority. We stand behind the quality of our products and that’s why, you shouldn’t be worrying at all. We manufacture the Best Screen Cleaner. and can be used for laptop cleaning kit, laptop screen cleaner, tv screen cleaner for smart tv. MacBook screen cleaner, monitor cleaner or screen cleaner spray for electronic devices with microfiber cleaning cloth
<meta name='robots' content='noindex,nofollow'>WordPress currently uses the combined noindex,nofollow value for its site-wide visibility option. A page-level implementation may use just noindex when you still want crawlers to discover and follow links. The choice depends on your internal-linking and discovery needs.
Recommended Free Tools
HTTP headers for non-HTML resources
PDFs, images, feeds, and other responses may not have an HTML head in which to place metadata. For those resources, send an HTTP header such as:
X-Robots-Tag: noindexConfigure the header in the web server, application, or delivery layer that serves the file. Verify the actual response, because a header added to one virtual host or cache path may not reach every variant of the URL.
The crawler must be able to read the directive
Google’s guidance is explicit: a noindex rule in robots.txt is not supported. If robots.txt disallows a URL, Google may be unable to fetch it and therefore unable to see a meta tag or response header. A URL discovered through links can remain represented in search even when its content is not crawled.
Discourage one page, post, archive, or resource
The WordPress checkbox is all-or-nothing for the site. For selective exclusion, apply noindex to the specific URL or response while leaving the rest of the site indexable.
Rank #3
- 【Large size】：Measuring 800 x 300 mm/ 31. 5×12 inches, which is wider and taller than others. Large mouse pad can perfectly fit your keyboard and mouse of any size, and there is also ample space for peripherals such as phones, tablets, etc.
- 【LED backlight mouse pad】：Blade Hawks RGB mouse pad provides 7 static modes and 7 dynamic modes will give you the options you are looking for. Power-off memory function remembers the last lighting mode you selected. The super glow fiber Chroma will give you a colorful gaming setup that you want.
- 【Anti-slip rubber base】：Made from Natural rubber, this gaming mousepad will firmly grip your desktop, allowing you to enjoy the ultimate precision in the games you are most passionate about. It also comes with a texture that enhances this ability even further.
- 【Smooth and waterproof surface】: Micro-textured cloth surface, for extremely precise mouse control and a smooth movement. When liquid splashes on the gaming mouse pad, it forms water droplets and slides down. Will not delay your work or gameplay.
- 【Plug and play】: This mouse and keyboard pad is powered by USB, plug and play, no driver required. One button control light modes. Press one time to change the lighting mode, press twice to change the brightness, press and hold about 3 seconds turn ON/OFF.
Use a WordPress SEO plugin
Most established WordPress SEO plugins provide a per-content setting in the post or page editor and may provide controls for taxonomies, author archives, date archives, search results, and other generated pages. The exact label and panel location vary by plugin version, so look for an option named Allow search engines to show this content, Indexing, or Robots. Set the item to No or Noindex, update the content, then inspect the rendered page.
Do not assume that changing a plugin’s default affects existing content. Check a representative URL from each content type, and clear page caches after changing a robots directive.
Add metadata through theme or custom code
If you control the theme or a small custom plugin, output the tag only for the intended condition. Keep the logic narrow so that an accidental global condition does not hide the whole site. A conceptual example is:
<meta name='robots' content='noindex'>Place generated markup in the document head through WordPress’s supported hooks rather than editing files that a theme update may overwrite. Confirm that the active theme still calls wp_head; without that hook, WordPress-generated head directives may never appear.
Mark a downloadable file with a response header
For a file that is not rendered as HTML, return X-Robots-Tag: noindex from the server or application. Test both the canonical URL and any alternate URL used by a CDN, attachment endpoint, or redirect. A header on a redirect response does not necessarily control the final target, so place the directive on the response that serves the resource you want excluded.
Rank #4
- 【Softer and More Comfortable】Vaydeer wrist rest has unique diamond pattern, which is the combination of softness and aesthetics. The materials of wrist rest are improved into higher quality memory foam and covered with silky smooth lycra. The computer wrist rest makes you as comfortable and cushiony as like rest your wrists on clouds.
- 【Ergonomic Wrist Saver】The wrist rests for keyboard and mouse comes with a 17.32×3.15×0.83 inch keyboard wrist pad and a 5.94×3.15×0.83 inch mouse wrist support. Based on ergonomic design, the unique concave shape is the perfect fit for your wrist joints. The wrist rest pad fits most computer keyboards and laptops, improve hand and wrist posture, release your wrist and arm stress.
- 【Non-Slip Rubber Bottom】Featuring an anti-skid silicone base on the bottom, this wrist keyboard support stays firmly in place on your desk, preventing the padding from sliding around, ensuring stable and consistent wrist support during extended computer sessions.
- 【Better Experience & Pain Relief】Our keyboard arm rest is beneficial to alleviate the soreness caused by direct contact and friction between your arm and a hard desk surface, reducing the risk of wrist fatigue or carpal tunnel. The soft texture of memory foam can evenly distribute the pressure around your wrists and provide good support with just enough give.
- 【Helpful in Multiple Scenarios】Whether you're working, studying, writing, typing, gaming, this keyboard and mouse rest combo is an essential accessory to add comfort and support to your hands and wrists. It’s also a great gift for men, women, family, friend, coworker, gamer, teacher, etc.
Why robots.txt alone does not remove a URL
robots.txt is a crawl-control file. Its Disallow rule asks compliant crawlers not to fetch matching paths; it is not an instruction to delete URLs from an index and it is not authentication.
Google recommends removing a blocking rule when your objective is to have Google process a noindex directive. The crawler must first be allowed to request the URL. Once Google can fetch the response and detect noindex, it can apply the exclusion during a subsequent indexing evaluation.
WordPress 5.3 and later behavior
WordPress changed its core implementation in version 5.3. Earlier behavior added a broad Disallow: / rule to robots.txt. The newer approach emits a robots meta directive instead, because crawl blocking prevented search engines from reliably seeing the request not to list the site. If an older installation, plugin, or custom configuration still writes a site-wide disallow rule, inspect and remove that conflict before troubleshooting the checkbox.
Windows Errors? Fix Them Before They Spread
Repair common Windows errors and clear accumulated junk for a smoother, more stable PC - no reinstall needed.Free scan · no reinstallCrashes, No Sound, or Screen Glitches?
Random freezes, missing sound and display glitches usually trace back to one bad driver. Find and replace yours safely.Free scan · under a minuteWhen the site must actually be private
If unpublished material must not be reachable, use authentication in addition to any noindex setting. Appropriate controls include WordPress login requirements, password-protected content, hosting-level staging protection, HTTP Basic Authentication, an allowlist of network addresses, or a server firewall. These mechanisms stop unauthenticated requests instead of merely asking crawlers not to index the response.
Keep credentials and protection active until the content is ready for release. Removing a noindex tag does not make a password-protected page public, and disabling a password does not guarantee that an old noindex directive has been removed from every cached response. Treat access control, indexing directives, and cache invalidation as separate release steps.
Best Value
- 【No Drill Mounted】Cable management tray can be assembled in as little as 3 minutes or less-simply. Side clips easily clampe the edge of desk, pass through the holes on the sides, and secure excess cables with baskets. Desk cable management supports inward or outward installation to meet your needs in different scenarios, and provides you with great convenience when collecting and organizing wires.
- 【Rubber Pad Protects Desk】Wire organizer under desk built-in soft rubber pads on the clamp protect your desk from scratches, so you will not damage your furniture or office.
- 【Sturdy and Beautiful】Cord management under desk is made of high-quality carbon steel and holds about 15 lbs. The wire basket has 2 holes on each side of the tray to enable your cables to pass freely. Cable baskets are suitable for desk thickness use from 0.4" to 2.4".
- 【Space Saving & Keep Organized】Desk cable management tray holds all your power cords, outlet strips, USB hubs and computer transformers hidden from your feet, and the data cables will not enter the vacuum cleaner to keep your desk clean and tidy. Desk wire organizer is also suitable for use in the kitchen and outdoors.
- 【Reduce Safety Risks】Cable tray under desk keeps all plugs away from your kids, no more worry about tripping. Using 2 holes wire tray saves extra space, helps you easily cabling and wire protection. The mesh design is not easy to accumulate dust, but avoids safety accidents caused by messy wires.
Verify that WordPress is sending the intended directive
Always verify the rendered response rather than trusting the dashboard checkbox alone. Use this sequence after enabling or disabling the setting.
- Open the public URL in a browser while logged out of WordPress.
- View the page source, not only the visual DOM inspector, and search for
noindex. - Confirm that the robots tag appears in the document head and has the expected value, such as
noindex,nofollow. - In the WordPress dashboard, open Tools > Site Health and review the search-engine visibility test. WordPress exposes a diagnostic when search engines are being discouraged.
- In Google Search Console, use URL Inspection or the Page Indexing report for a representative URL. Check whether Google detected
noindex, encountered arobots.txtblock, or reported another indexing issue. - Repeat the check after clearing page, object, reverse-proxy, and CDN caches that may be serving an older head.
Test more than the home page
A custom template, feed, attachment endpoint, or cached variant can behave differently from the front page. Test at least one ordinary post, one page, one archive or taxonomy URL that matters to your site, and any file type you intentionally excluded. Also test the HTTP and HTTPS versions if both resolve, then consolidate redirects and canonical settings so search engines do not receive conflicting signals.
Free tools Windows power users keep installed
One-click scans. No signup required.
Troubleshoot conflicting or missing directives
The checkbox is enabled but source contains no noindex
- Confirm that you clicked Save Changes and reload the public page while logged out.
- Check whether the active theme calls
wp_head. A theme that omits the hook can suppress WordPress’s generated head output. - Inspect SEO-plugin settings, theme functions, and custom snippets for code that removes or replaces the robots output.
- Purge every relevant cache layer, including full-page cache and CDN cache.
- Check the response headers for a conflicting
X-Robots-Tagvalue.
Google reports a robots.txt block and a desired noindex
Remove or narrow the blocking rule so Google can fetch the URL. Keep the meta tag or HTTP header in place, request a new inspection when appropriate, and wait for Google to recrawl. Do not add a second noindex rule to robots.txt; Google does not support that syntax.
A URL still appears in Google
Confirm that the exact indexed URL, including protocol, host, path, query string, and trailing slash variant, returns the directive. Search engines may retain a previously known URL until they recrawl it. Check for redirects: the noindex directive must be present on the response that Google evaluates, and a redirect can send Google to a different URL with different instructions.
Some pages are excluded unexpectedly
Look for a plugin default that sets entire post types or taxonomies to noindex, conditional theme logic that runs on every request, and a site-wide WordPress setting that was left enabled after launch. Compare page source from an affected URL with a URL that should remain indexable, then change one control at a time and purge caches.
A safe staging and launch workflow
- Before building, enable the WordPress site-wide discouragement setting or, preferably for sensitive work, add authentication at the hosting or server layer.
- During development, verify both access protection and the presence of
noindexon representative URLs. - Before launch, remove temporary passwords only when the content is ready for public access.
- Disable the WordPress discouragement setting if the finished site should appear in search, then save the change.
- Clear caches and inspect the source of the home page, a post, a page, and important archives to confirm that unintended
noindexdirectives are gone. - Review
robots.txtfor leftover broad disallow rules that would prevent crawling. - Use Google Search Console to inspect important URLs and monitor the Page Indexing report after publication.
This sequence separates privacy from search visibility: authentication protects unfinished content, while noindex controls whether a crawlable response should be listed.
Quick wins for a faster PC:
Fix the driver behind crashes, sound loss and screen glitchesFind Drivers →Clear out junk files and repair common Windows errorsFree Scan →Scan for outdated or missing drivers - takes under a minuteDriver Scan →Common mistakes to avoid
- Using the checkbox as a security feature: anyone who can reach the site can still request pages.
- Blocking a URL in robots.txt and expecting removal: the crawler may never see the noindex instruction.
- Forgetting caches: visitors and crawlers may receive an older response after a setting change.
- Testing only while logged in: administrator sessions can bypass caches or show different content.
- Applying noindex to the wrong URL variant: HTTP, HTTPS, www, non-www, redirected, and parameterized URLs can produce separate responses.
- Leaving a staging setting enabled at launch: the site may remain absent from search even though it is publicly reachable.
- Relying on a plugin panel without checking output: theme hooks, custom code, server headers, or another plugin can override the intended directive.
Decision checklist
Ask these questions before choosing a control:
- Do you want to exclude the entire site or only selected URLs?
- Should a crawler be able to fetch the response and read a directive?
- Must unauthenticated visitors be prevented from seeing the content?
- Are you controlling HTML, a downloadable file, or a path that affects crawl load?
- Have you checked the rendered source, response headers, Site Health, and Search Console rather than relying on a dashboard label?
For an entire publicly reachable WordPress site, the direct answer remains Settings > Reading > Discourage search engines from indexing this site. For a selected URL, use crawlable noindex metadata or an X-Robots-Tag. For genuine secrecy, require authentication.
Quick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
