what is technical seo and why is it important 41 s with timestamps YoutubeScribe.com

[0:00] Hey, it's Sam Oh and welcome to the final 
module in Ahrefs' SEO course for beginners.
[0:05] Throughout the next two lessons, we're 
going to be talking about technical SEO.
[0:09] And technical SEO is the process of optimizing
your website to help search engines find,
[0:14] understand, and index your pages.
[0:17] Now, for beginners, technical SEO 
doesn't need to be all that technical.
[0:22] And for that reason, this module will be 
focused on the basics so you can perform
[0:26] regular maintenance on your site and ensure 
that your pages can be discovered and indexed
[0:31] by search engines.
[0:32] Let's get started.
[0:34] Alright, so let's talk about why technical
SEO is important at the core.
[0:38] Basically, if search engines  can't properly
access, read, understand, or index your pages,
[0:45] then you won't rank or even be found
for that matter.
[0:48] So to avoid innocent mistakes like 
removing yourself from Google's index
[0:52] or diluting a page's backlinks, I want to discuss 
4 things that should help you avoid that.
[0:57] First is the noindex meta tag.
[1:00] By adding this piece of code to your page,
it's telling search engines not to add it to
[1:04] their index.
[1:06] And you probably don't want to do that.
[1:08] And this actually happens more 
often than you might think.
[1:11] For example, let's say you hire Design Inc 
to create or redesign a website for you.
[1:16] During the development phase, they may 
create it on a subdomain on their own site.
[1:21] So it actually makes sense for them to 
noindex the site they're working on.
[1:24] But what often happens is after you've
approved the design, they'll migrate it
[1:28] over to your domain.
[1:30] But they often forget to remove
the meta noindex tag.
[1:34] And as a result, your pages end up getting
removed from Google's search index or never
[1:39] making it in.
[1:40] Now, there are times when it actually
makes sense to noindex certain pages.
[1:44] For example, our authors pages are noindexed
because from an SEO perspective, these pages
[1:50] provide very little value to search engines.
[1:53] But from a user experience standpoint, it can 
be argued that it makes sense to be there.
[1:58] Some people may have their favorite authors
on a blog and want to read just their content.
[2:03] Generally speaking, for small sites, you won't 
need to worry about noindexing specific pages.
[2:09] Just keep your eye out for noindex tags on 
your pages, especially if after a redesign.
[2:14] The second point of discussion is robots.txt.
[2:17] Robots.txt is a file that usually lives
on your root domain.
[2:21] And you should be able to access
it at yourdomain.com/robots.txt.
[2:27] Now, the file itself includes a set of rules 
for search engine crawlers and tells them
[2:31] where they can and cannot go on your site.
[2:35] And it's important to note that a website
can have multiple robots files if you're
[2:39] using subdomains.
[2:40] For example, if you have a blog on domain.com,
then you'd have a robot.txt file for just
[2:46] the root domain.
[2:47] But you might also have an ecommerce 
store that lives on store.domain.com.
[2:52] So you could have a separate 
robots file for your online store.
[2:56] That means that crawlers could be given 
two different sets of rules depending on
[3:00] the domain they're trying to crawl.
[3:02] Now, the rules are created using
something called "directives."
[3:05] And while you probably don't need to know
what all of them are or what they do, there
[3:10] are two that you should know about
from an indexing standpoint.
[3:14] The first is User-agent, which defines 
the crawler that the rule applies to.
[3:18] And the value for this directive would 
be the name of the crawler.
[3:22] For example, Google's user-agent is
named Googlebot.
[3:25] And the second directive is Disallow.
[3:28] This is a page or directory on your domain
that you don't want the user-agent to crawl.
[3:33] For example, if you set the user agent to 
Googlebot and the disallow value to a slash,
[3:38] you're telling Google not to crawl 
any pages on your site.
[3:42] Not good.
[3:43] Now, if you were to set the user-agent to
an asterisk, that means your rule should
[3:47] apply to all crawlers.
[3:50] So if your robots file looks something like
this, then it's telling all crawlers, please
[3:55] don't crawl any pages on my site.
[3:58] While this might sound like something you
would never use, there are times when it
[4:02] makes sense to block certain parts of
your site or to block certain crawlers.
[4:07] For example, if you have a WordPress
website and you don't want your wp-admin
[4:11] folder to be crawled, then you can simply
set the user agent to "All crawlers," and set
[4:16] the disallow value to /wp-admin/.
[4:20] Now, if you're a beginner, I wouldn't 
worry too much about your robots file.
[4:23] But if you run into any indexing issues that 
need to be troubleshooted, robots.txt is one
[4:29] of the first places I'd check.
[4:31] Alright, the next thing to discuss are sitemaps.
[4:34] Sitemaps are usually XML files and they
list the important URLs on your website.
[4:39] So these can be pages, images, videos,
and other files.
[4:43] And sitemaps help search engines like
Google to more intelligently crawl your site.
[4:48] Now, creating an XML file can be complicated
if you don't know how to code and it's almost
[4:53] impossible to maintain manually.
[4:55] But if you're using a CMS like WordPress,
there are plugins like Yoast and Rank Math
[5:00] which will automatically generate
sitemaps for you.
[5:04] To help search engines find your sitemaps, you 
can use the Sitemap directive in your robots file
[5:09] and also submit it in Google search console.
[5:12] Next up are redirects.
[5:14] A redirect takes visitors and bots
from one URL to another.
[5:18] And their purpose is to consolidate signals.
[5:21] For example, let's say you have two pages
on your website on the best golf balls.
[5:25] An old one at domain.com/best-golf-balls-2018, 
and another at domain.com/best-golf-balls.
[5:34] Seeing as these are highly relevant to one
another, it would make sense to redirect
[5:38] the 2018 version to the current version.
[5:41] And by consolidating these pages, you're
telling search engines to pass the signals
[5:45] from the redirected URL to the destination URL.
[5:49] And the last point I want to talk about
is the canonical tag.
[5:53] A canonical tag is a snippet of
HTML code that looks like this.
[5:57] Its purpose is to tell search engines
what the preferred URL is for a page.
[6:02] And this helps to solve duplicate content issues.
[6:05] For example, let's say your website is 
accessible at both http://yourdomain.com
[6:12] and https://yourdomain.com.
[6:18] And for whatever reason, you weren't
able to use a redirect.
[6:21] These would be exact duplicates.
[6:24] But by setting a canonical URL, you're telling
search engines that there's a preferred version
[6:28] of the page.
[6:29] As a result, they'll pass signals such as
links to the canonical URL so they're not
[6:34] diluted across two different pages.
[6:37] Now, it's important to note that Google
may choose to ignore your canonical tag.
[6:42] Looking back at the previous example, if we set
the canonical tag to the insecure HTTP page,
[6:48] Google would probably choose the
secure HTTPS version instead.
[6:53] Now, if you're running a simple WordPress site,
you shouldn't have to worry about this too much.
[6:58] CMS's are pretty good out of the box
and will handle a lot of these basic
[7:02] technical issues for you.
[7:04] So these are some of the foundational things 
that are good to know when it comes to indexing,
[7:08] which is arguably the most important
part in SEO.
[7:11] Because again, if your pages aren't getting
indexed, nothing else really matters.
[7:17] Now, we won't really dig deeper into this
because you'll probably only have to worry
[7:20] about indexing issues if and when
you run into problems.
[7:24] Instead, we'll be focusing on technical SEO best 
practices to keep your website in good health.
[7:30] And that lesson will be published later on this 
week, so make sure to subscribe so you don't
[7:34] miss out on that.
[7:35] And if you're watching this at a later date,
then check the description because we'll
[7:39] have links to the rest of the course there.
[7:41] I'll see you in the next lesson.

本文档为站内渲染。原始文件本地路径：saas/source/seo-llm/raw-seo知识库-TXT整理-seo方法论-youtube-seo-scripts-ahrefs-scripts-w-c3b638.txt（仅本地保留，不入库不部署）