Post by pappu723 on Mar 4, 2024 4:35:10 GMT -6
The pro what they mean that they have to have a robots.txt file. is if they request the robots.txt from their CDN it will give them a error. When they put a robots.txt there immediately the previews started appearing correctly and this involves crawling and putting on the static site. Operationally they found that adding the robots.txt file is what did the job in terms of repairing the indexing issues. John explained that from Googles perspective its not that a robots.txt file is required but a robots.txt file has to have the proper result code.
So if you dont have one it should return a error. If you do have one then Google can obviously read that. But if you return a server error for the robots.txt file then their systems will assume that perhaps theres an issue with a server and they wont crawl. And thats something thats been like that since the beginning. However these types of issues Czech Republic Mobile Number List especially when youre on a CDN and its on a separate hostname sometimes thats really hard to spot. And John imagines the rich results test as far as he knows focuses on the content thats on the HTML page. So the JSONLD markup that they have it probably doesnt check to see if the images are actually fetchable on the server.
If they cant be fetched then of course they cannot use them on the carousel. So this is something that Google may need to figure out better. This happens at approximately the mark in the video. vTBDEvwrM John Mueller Hangout Transcript SEO Professional Hi John Oh we ran into a bit of a tiger trap I would say in terms of rich recipe results. We have hundreds of thousands of recipes which are indexed and they have lots of traffic coming through from the recipe gallery. And then suddenly or not suddenly over a period of time it stopped. And all of.
So if you dont have one it should return a error. If you do have one then Google can obviously read that. But if you return a server error for the robots.txt file then their systems will assume that perhaps theres an issue with a server and they wont crawl. And thats something thats been like that since the beginning. However these types of issues Czech Republic Mobile Number List especially when youre on a CDN and its on a separate hostname sometimes thats really hard to spot. And John imagines the rich results test as far as he knows focuses on the content thats on the HTML page. So the JSONLD markup that they have it probably doesnt check to see if the images are actually fetchable on the server.
If they cant be fetched then of course they cannot use them on the carousel. So this is something that Google may need to figure out better. This happens at approximately the mark in the video. vTBDEvwrM John Mueller Hangout Transcript SEO Professional Hi John Oh we ran into a bit of a tiger trap I would say in terms of rich recipe results. We have hundreds of thousands of recipes which are indexed and they have lots of traffic coming through from the recipe gallery. And then suddenly or not suddenly over a period of time it stopped. And all of.