Beijing SEO whole site URL extraction tool ScreamingFrogSEOSpider download [free 1 year]

Beijing SEO today will introduce to you a tool that may not be familiar to you, but is very powerful, and only circulated among SEO gods: ScreamingFrogSEOSpider , ScreamingFrogSEOSpider official website & download address:

Official website  http://www.screamingfrog.co.uk/seo-spider/

 

ScreamingFrogSEOSpider function introduction

 

 ScreamingFrogSEOSpider Search Engine Spider Crawling Tools & Reports are as follows:

 HTTP error codes - client error etc. Broken link & server error (5 no response, 4 xx, xx).

 

Redirect - Permanent or temporary redirect (3 xx response).

 

External links, external links and their status codes.

 

Protocol - Whether the url is secure (HTTPS) or insecure (HTTP).

 

URI issues - non-ASCII characters, underscores, uppercase characters, parameters, or long urls.

 

Duplicate Pages - Hash value / MD5checksums algorithm checks exact duplicate pages.

 

Page title - missing, repeated, longer than 65 characters, shorter, pixel width truncated, h1 same, or more.

 

Meta description - missing, repeated, longer than 156 characters, short, truncated or multiple pixels wide.

 

Meta keywords - mostly for reference as they are not used by Google, Bing or Yahoo.

 

File Size - Size of URLs and images.

 

Response time.

 

last – modified头。

 

The level of page depth.

 

word count.

 

    H1 - missing, duplicated, more than 70 characters, multiple.

 

    H2 - missing, duplicated, over 70 characters, multiple.

 

    noindex metabots - index, emulate, nofollow, noarchive, nosnippet, noodp, noydir and more.

 

    Meta refresh - including target page and time delay.

 

    Canonical link element and canonical HTTP headers.

 

    X-Robots-Tag。

 

    rel = “下一个”和rel = “上一页”。

 

    AJAX的SEO AJAX爬行蜘蛛遵循谷歌的计划。

 

    Inlinks——所有页面链接到一个URI。

 

    Outlinks——所有页面链接到URI。

 

    锚文本,链接文本。Alt文本图像的链接。

 

    遵循& Nofollow——在页面和链接(真/假)。

 

    图像——所有uri与图像&所有图像从一个给定的页面的链接。图片大小超过100 kb,丢失的alt文本,alt文本超过100个字符。

 

    用户代理切换器——Googlebot爬行,Bingbot,雅虎!发出声音,移动用户代理或您自己的自定义UA。

 

    重定向链,发现重定向链和循环。

 

    自定义源代码搜索——搜索引擎蜘蛛可以找到任何你想要在一个网站的源代码!无论是谷歌分析代码,具体的文本,或代码等。(请注意,这不是一个数据提取或刮特性。)

 

    XML网站地图生成器——你可以创建一个XML站点地图和图像地图使用SEO蜘蛛。

 

ScreamingFrogSEOSpider使用方法

 

ScreamingFrogSEOSpider使用起来非常方便，只需要输入你网站首页的URL，然后点Start就行了，静待爬取完成，就可以看各种详细的数据了。

 

下图以提取我博客的整站URL为例子，给大家展示一下效果：

 

红框1处这些选项卡，依次给大家翻译一下吧：内部链接、外部链接、HTTP协议（HTTP或者HTTPS）、HTTP状态码（200、3XX、4XX、5XX）、URI（注意不是URL，URI是Uniform Resource Identifier，统一资源标识符；URL：Uniform Resource Locator，统一资源定位符；想知道更多自己百度去）、页面title标签、页面description标签、页面keywords标签、页面H1标签、页面H2标签、站内图像、页面链接指向、使用了AJAX技术的链接、用户自定义的过滤规则。

 

Red box 2: After clicking, you will see some information on our homepage, such as red box 4, what are the import links on the home page, red box 3, the number of links of the entire site extracted by ScreamingFrogSEOSpider, combined with site Instructions, you can know the general site inclusion of our website.

 

Through the above explanation, I believe you already understand the power of this tool! So the next thing you may care about is whether this tool is paid or free?

 

Through the introduction of the official website, we know that we can download and use the software freely, but the free version can only crawl 500 URLs of the entire site. If it is a small business site, it is enough. If it is a large site, you can consider it. Buying one starts at £99 a year, or about RMB 972 (thanks to seolabs for correcting the message:)), it is simply too cheap for friends who play big stations, haha!

 

Do you think the article should end here? If you think so, you are wrong! The method blog is only born to share valuable articles, so today, I will send a gift worth 694 yuan to friends who are lucky enough to see this article! That is: (eyes wide open!)

 

ScreamingFrogSEOSpider registration code! Can be used for a year!

Beijing SEO In order to facilitate everyone to COPY, I will paste it here:

 

Username：gn168

 

Licence Key:20D8E5C5AF-1467881526-81359030D5