Web page collector collection

Last updated on：2020-06-15 14:44:55

Collect web pages and data，Can quickly build a website。In addition to using a collector to collect，You can also customize the python crawler，But you need to know how to program。

The collector has independent software、Plug-ins and cloud collection, etc.。Standalone software requires a separate computer to be hung up，and corresponding CMS publishing interface。The plug-in version and the site are on the same server，Collection will slow down the website。It usually costs a lot of money to publish to your own website in the cloud.。The pocket is not bulging，Here we only mention those that can be used for free。

The collection plan also has rules such as filling in regular rules.，and WYSIWYG simulation browser mode。

Table of contents show

Collector software

  • train collector：Everyone likes to call it the locomotive collector.，Probably the most commonly used collector at present，It has been perfected through many years of upgrades.，There is a free version，All basic functions are available，enough。
    • There is a cracked version of Locomotive 7.6 Enterprise Edition circulating on the Internet、Locomotive collector V9 (High Speed ​​Rail Man) intranet dongle version cracked version，If funds are sufficient，Please support genuine。
    • Video tutorial
  • train browser：and the above manufacturer，Visual operation，The free version limits a single task to 30 minutes.。
  • ET acquisition software：It's also an old brand.，Fully automatic unattended work。There is a free version。
  • VG automation artifact：Original name: VG Browser,VG web page operation artifact，Focus on automated web page operations (automatic login、Automatic collection、autocommit、Automatic registration、 Automatically post、Automatically recognize verification codes。) has a free version， Limit a single task to run for 30 minutes。
  • Octopus collector：Need to download software，However, the collection work of the flagship version can be done in the cloud.，You can pick it when you see it，You can pick up whatever your browser can see.。There is a free version，The free version can only be collected locally，If you collect locally, it seems that exporting requires points.。
  • Houyi collector：WYSIWYG browser-based collection tool，Also supports Windows、Mac and Linux full operating system collector。Free crawler software，Basic functions required for collecting data，no restrictions，No points required，Free export of collection results。However, if you want to hang up and collect data regularly, you need the paid version.。

Collection plug-in

Plug-in collectors can publish data directly without publishing interfaces.，But it can only be used with a single CMS or BLOG。

WordPress collection plug-in

  • WP-AutoBlog：Original WP-AutoPost，Support translation into other languages，Can collect WeChat public accounts、We-media content such as headlines，Support downloading remote pictures to local server。There is a free version，But there are functional limitations。
    • There is a cracked version of WP-AutoPost circulating on the Internet
  • Fat rat collection：Free and open source，Use Html,Jquery syntax，Automatically collect and publish articles，
  • long legged spider（WP-CTSPIDER）：free to use，To use full functionality, you need toOfficial websiteFree license activation。It seems like it hasn’t been updated for a long time。Support pseudo-original，But you need to fill it out yourself。Support Baidu translation。

DEDECMS collection plug-in

Cloud collection

  • blue sky collector：The official flagship cloud automated data collection and release system，Can be connected to any CMS or blog，But it requires the corresponding publishing plug-in。It is said to be in the cloud but it needs to be on the same server as the publishing website.，Unable to publish remotely，I feel like it might be more appropriate to put it in the plug-in category.。
5 1 vote
Article Rating
subscription
remind
guest
0 Comment
inline feedback
View all comments