robots.txt

  1. A

    Please check my robot.txt .Anything wrong or all okay?

    Kindly check my robots.txt and say. Do I need to change anything?.. The problem occurs because of alicdn.com images...What do I have to change in robots.txt to not google scroll alicdn images? User-agent: * Disallow: /cgi-bin Allow: /wp-includes/js Allow: /wp-includes/css Disallow: /wp-includes...
    • Apruv
    • Thread
    • alicdn.com google search console robots.txt seo
    • Replies: 0
    • Forum: Ask Me Anything
  2. Freestyler86

    Googlebot access

    Hello, Anyone know how to fix the following issue? Here is the SEO Check website: https://varvy.com/ Resources blocked by robots.txt 23 CSS or javascript files are blocked Blocked page resources:
    • Freestyler86
    • Thread
    • #yoastseo #seo #alidropshipseo googlebot robo robots.txt seo
    • Replies: 4
    • Forum: SEO
  3. K

    Problem with search engines and robots.txt

    What I see in google when search inurl: mydomain A description for this result is not available because of this site's robots.txt - this shows for all results, I am not a tech guy is everything okay with robots.txt? in bing under my main domain in their search engine I see: We would like to...
Top