SE 机器人不会索引来自 sitemap.xml 的页面

SE robots don't index pages from sitemap.xml

我将站点地图上传到我的站点,但并非所有 url 都已编入索引。我有一堆 url 没有被 Google 索引。而且我不知道为什么会这样...

现在,我有 716 url 没有索引。

如果我看到哪些 url 没有被编入索引,我们有 url 的这个例子:

所有这些 url 都是完全可以访问的。如果您点击其中的一些,您可以正确访问该站点:

https://www.calzadosniza.es/es/mujer/zapatos-mujer/zapato-descubierto-puntera-charol-ancho-juan-mastre-108-7920#/62-tallas_grandes-40/116-color-azul
https://www.calzadosniza.es/es/mujer/sandalias-mujer/sandalia-cuna-pala-cruzada-combi-plata-glenda-porronet-6551-porronet-8751#/62-tallas_grandes-40/114-color-blanco
https://www.calzadosniza.es/es/mujer/botas-y-botines-mujer/bota-militar-cordon-piso-volumen-2670-tekila-3999#/63-tallas_grandes-41/113-color-negro

如果我检查其中一个,例如:https://www.calzadosniza.es/es/mujer/zapatos-mujer/zapato-descubierto-puntera-charol-ancho-juan-mastre-108-7920#/62-tallas_grandes-40/116-color-azul

我得到了这个结果:

我的 robot.txt 文件是:

# Allow Directives
Allow: */modules/*.css
Allow: */modules/*.js
Allow: */modules/*.png
Allow: */modules/*.jpg
# Private pages
Disallow: /*?orderby=
Disallow: /*?orderway=
Disallow: /*?tag=
Disallow: /*?id_currency=
Disallow: /*?search_query=
Disallow: /*?back=
Disallow: /*?n=
Disallow: /*&orderby=
Disallow: /*&orderway=
Disallow: /*&tag=
Disallow: /*&id_currency=
Disallow: /*&search_query=
Disallow: /*&back=
Disallow: /*&n=
Disallow: /*controller=addresses
Disallow: /*controller=address
Disallow: /*controller=authentication
Disallow: /*controller=cart
Disallow: /*controller=discount
Disallow: /*controller=footer
Disallow: /*controller=get-file
Disallow: /*controller=header
Disallow: /*controller=history
Disallow: /*controller=identity
Disallow: /*controller=images.inc
Disallow: /*controller=init
Disallow: /*controller=my-account
Disallow: /*controller=order
Disallow: /*controller=order-slip
Disallow: /*controller=order-detail
Disallow: /*controller=order-follow
Disallow: /*controller=order-return
Disallow: /*controller=order-confirmation
Disallow: /*controller=pagination
Disallow: /*controller=password
Disallow: /*controller=pdf-invoice
Disallow: /*controller=pdf-order-return
Disallow: /*controller=pdf-order-slip
Disallow: /*controller=product-sort
Disallow: /*controller=search
Disallow: /*controller=statistics
Disallow: /*controller=attachment
Disallow: /*controller=guest-tracking
# Directories
Disallow: */cache/
Disallow: */classes/
Disallow: */config/
Disallow: */controllers/
Disallow: */css/
Disallow: */download/
Disallow: */js/
Disallow: */localization/
Disallow: */log/
Disallow: */mails/
Disallow: */modules/
Disallow: */override/
Disallow: */pdf/
Disallow: */src/
Disallow: */tools/
Disallow: */translations/
Disallow: */upload/
Disallow: */vendor/
Disallow: */web/
Disallow: */webservice/
# Files
Disallow: /*es/password-recovery
Disallow: /*es/address
Disallow: /*es/addresses
Disallow: /*es/login
Disallow: /*es/cart
Disallow: /*es/discount
Disallow: /*es/order-history
Disallow: /*es/identity
Disallow: /*es/my-account
Disallow: /*es/order-follow
Disallow: /*es/credit-slip
Disallow: /*es/order
Disallow: /*es/search
Disallow: /*es/guest-tracking
Disallow: /*es/order-confirmation
Disallow: /*ca/password-recovery
Disallow: /*ca/address
Disallow: /*ca/addresses
Disallow: /*ca/login
Disallow: /*ca/cart
Disallow: /*ca/discount
Disallow: /*ca/order-history
Disallow: /*ca/identity
Disallow: /*ca/my-account
Disallow: /*ca/order-follow
Disallow: /*ca/credit-slip
Disallow: /*ca/order
Disallow: /*ca/search
Disallow: /*ca/guest-tracking
Disallow: /*ca/order-confirmation
Disallow: /*gl/password-recovery
Disallow: /*gl/address
Disallow: /*gl/addresses
Disallow: /*gl/login
Disallow: /*gl/cart
Disallow: /*gl/discount
Disallow: /*gl/order-history
Disallow: /*gl/identity
Disallow: /*gl/my-account
Disallow: /*gl/order-follow
Disallow: /*gl/credit-slip
Disallow: /*gl/order
Disallow: /*gl/search
Disallow: /*gl/guest-tracking
Disallow: /*gl/order-confirmation
Disallow: /*eu/password-recovery
Disallow: /*eu/address
Disallow: /*eu/addresses
Disallow: /*eu/login
Disallow: /*eu/cart
Disallow: /*eu/discount
Disallow: /*eu/order-history
Disallow: /*eu/identity
Disallow: /*eu/my-account
Disallow: /*eu/order-follow
Disallow: /*eu/credit-slip
Disallow: /*eu/order
Disallow: /*eu/search
Disallow: /*eu/guest-tracking
Disallow: /*eu/order-confirmation

那么,当我将我的站点地图上传到 Google 控制台搜索时,为什么所有这些 url 都没有被编入索引?

我是不是做错了什么?

站点地图不是针对搜索引擎的指令,它只是推荐。 SE 无法抓取所有页面,请在站点地图中使用 "Priority" 字段。

尝试手动检查 html 未索引的页面,可能有禁止标签:

<meta name="robots" content="noindex" />