WP Content Material Crawler - Get content from nearly any site, mechanically!

Get content material from virtually any web page to your WordPress weblog, routinely!

For what it will possibly be used

• Create an individual web page which collects news, posts, and so on. out of your favorite websites to peer them in a single place
• Use it with WooCommerce to collect merchandise from shopping websites
• Collect products from associate programs to become profitable
• Gather posts to create a check surroundings on your plugin/topic
• Accumulate plugins, themes, apps, images from different websites to create a collection of them
• Keep track of competition

the way it works

It’s all approximately CSS selectors and you can learn the way to make use of them in mins by looking at the creation instructional.

See it in motion, be informed in minutes

Available in two languages, in a position for translation

Video tutorials

need to auto edit? take a look at WP Put Up Gear

Necessities:

PHP >= 5.FIVE, mbstring

Examined with WP variations:

4.7, 4.6.1, 4.5.THREE, 4.4.2, 4.THREE.THREE, 4.2.7, 4.1.10, 4.0.10, 3.9.11

Primary features:

• Retailer put up’s identify, excerpt and content material.
• Shop meta keywords and description.
• Retailer photographs in the posts in your website online.
• Keep featured image of objective post because the featured symbol of the publish created in your web page.
• Retailer the checklist in posts (extract the record from the publish).
• Save paginated posts. If goal post is paginated, the publish on your web site may also be paginated in addition.
• Keep anything from goal web page as put up meta.
• In Finding and exchange the rest within the goal web page’s HTML earlier than saving its content.
• In Finding and replace the use of common expressions.
• In Finding and change in symbol URLs earlier than saving them.
• Manipulate aim page’s HTML sooner than saving to make it appropriate for your wishes.
• Do Away With unnecessary components from objective page’s HTML.
• Map categories of your website online to focus on web page’s classes to keep posts organized.
• Routinely get class URLs for class mapping.
• Upload unlimited classes for a site and mechanically take a look at for brand new posts uniformly.
• Set choice CSS selectors for every setting. Through this way, get content from the pages of the similar site that are designed differently.
• Robotically retailer posts.
• Automatically check for new posts.
• Set maximum selection of class pages to be checked mechanically.
• Upload limitless sites.
• Import/export website online settings.
• Set put up kind. for instance, you'll be able to add posts as products when you use WooCommerce.
• Set a template for the put up.
• Set a template for every record merchandise.
• Set passwords for created posts.
• Keep notes for every site to maintain a changelog or anything you wish to have.
• Take A Look At any CSS selector and to find-and-substitute environment right away.
• Check a domain sooner than activating it for automatic crawling.
• Manually create posts via offering the URL of the posts.
• If you need, use settings different than general settings for every web site.
• Turn On/deactive each and every website online any time to start out/prevent computerized crawling.
• Either instantly post the posts or stay them as drafts to make changes earlier than publishing.
• On-Line documentation
• Video tutorials for a quick get started
• ready to translate (.po file)
• Get updates from your WordPress admin panel.
• Retailer photographs as gallery. If you utilize WooCommerce, you'll keep pictures from aim page as product gallery.
• Get anything from target page as a shortcode and use the shortcodes in templates to place any information any place you want.
• Save tags the usage of CSS selectors.
• In Finding and change in publish tags.
• Prohibit the collection of tags that can also be introduced to a submit.
• Use a proxy or proxies to get content from the sites to which your IP does not have get right of entry to.
• Put Up title and excerpt templates in which you'll use customized quick codes.
• In Finding and exchange in custom short code data.
• Add custom publish meta without a selector.
• Set what number of times URL collection and submit crawling events should run each time for a domain. as an example, you'll store 3 posts each minute, or run URL collection FIVE instances each and every 2 mins.
• Acquire publish URLs in reverse order for each class web page.
• Eliminate hyperlinks from the content material via just checking a checkbox. this will likely now not touch the links manually added to the templates.
• Notifications. Set CSS selectors whose values will not be empty for category and put up pages. While an empty price is found using the ones selectors, you'll be able to get an e-mail notification.

Changelog

v1.2.1 - 12 October 2016 * Development: Selectors for photographs that are supposed to be stored are searched within the brief code data to boot. * Growth: Partial French translation is delivered, thanks to @PECNET * Fastened: JS and CSS recordsdata aren't up to date after the plugin is up to date. (Provides variations to CSS and JS recordsdata) * Mounted: Template pointless component selectors don't work. * Fixed: When a relative URL does not start with a ahead lower, the overall URL should be prepared relative to the current URL. v1.2.0 - 30 August 2016 * New: You'll Be Able To now use proxy. * New: Set connection timeout in seconds. * New: Put Up identify and excerpt templates during which you can use custom brief codes. * New: To Find and change in customized quick code data. * New: Most choice of categories that will also be introduced robotically via CSS selectors to the class map higher. * New: Upload customized post meta with out a selector. * New: You'll Be Able To set what number of times URL assortment and put up crawling occasions will have to run on every occasion for a domain. for example, you can keep THREE posts each and every minute, or run URL assortment 5 occasions every 2 mins. * New: You'll Be Able To accumulate put up URLs in opposite order for each category web page. * New: Take Away hyperlinks from all brief code data. this may occasionally not contact the hyperlinks manually brought to the templates. * New: Notifications. You Can now set CSS selectors whose values is not going to be empty for category and post pages. While an empty price is found the usage of the ones selectors, you can get an electronic mail notification. * Fastened: Downloaded report's title doesn't have a proper report extension if the document on the target website is generated dynamically. * Fixed: Crawling stops if there may be a request exception. * Mounted: Crawling stops if goal page's HTML couldn't be retrieved. v1.1.3 - 26 June 2016 * Fastened: Fetching stops if there may be a URL that can't be fetched. * Mounted: JS error announcing that sortable is not a function. * Fastened: Tag selector effects are taken as unmarried results. Make it a couple of and get all of the results found by way of each and every selector. * Fixed: Garage directory's CHMOD have to be 755 to stop any safety breaches. * Improvement: License key enter field is now shown as password. * Improvement: Each And Every submit will now have _wpcc_post_url post meta that stores the URL of the post. * Development: in the event you leave any URL in category map empty, you'll get an mistakes. * Growth: Now you're going to get a notification whilst your PHP model is less than 5.5. * Improvement: Now you can correctly deactivate plugin from license key settings web page besides, which additionally gets rid of license key from your current domain and makes it to be had to be used on different domains. v1.1.2 - 21 May 2016 * Mounted: Crawler stops saving posts even if there are URLs within the queue. * Mounted: Crawler stops crawling if there's no category URL in an active website. v1.1.1 - SIXTEEN Might 2016 * New Feature: Keep tags using CSS selectors * New Feature: In Finding and substitute in publish tags * New Characteristic: Prohibit the selection of tags that can be introduced to a publish * Fixed: Export-settings field can not be send with the request. * Fastened: 'Failed to open stream for upgrade.php' blunders caused by DatabaseService.php * Fixed: Category checklist causes an errors when WooCommerce is not put in. v1.1.0 - 15 May 2016 * New Function: Create custom short codes for CSS selectors and position any component or attribute of any component at anywhere within the post template. * New Function: Dispose Of useless elements after the post template is set. * New Characteristic: Upload images as a gallery. You'll also add image gallery as a WooCommerce product's image gallery. * Improvement: Regex mistakes are actually proven at details phase in Tester page. * Growth: Content existence is managed in a smarter approach. * Improvement: You Can now use your license on another web site after you deactivate the plugin on the web site which the plugin is already put in. * Fixed: Firefox doesn't let copying texts from disabled textareas. * Mounted: Quick-edit deletes all settings. * Mounted: Make A Choice inputs in custom common settings don't seem to be assigned their worth from database. * Fixed: Export-settings textarea have to be "readonly". * Fixed: Exhausting-coded directories need to be defined dynamically. * Mounted: CHMOD of garage directory must be set as 777. * Fastened: The Effects of submit content selectors don't seem to be ordered through the positions of the discovered parts. * Mounted: Common expressions are not imported accurately whilst uploading settings. * Fixed: Regex errors cause complete template to be empty. * Fixed: Template editors put off HTML tags. * Fastened: Class of the post isn't assigned as selected whilst saving a URL more than once the use of manual crawling. * Fastened: Database tables aren't created on multisite. * Mounted: Some web sites don't seem to be available to select in equipment page. v1.0.1 - NINE Would Possibly 2016 * Mounted: MySQL doesn't let thumbnail_url be null.
FULL DOWNLOAD