Free Crawling Software

ETagFix by ISAPILabs

ETagFix is an ISAPI plugin for Internet Information Server (IIS) that changes the etag produced by IIS so that your etag does not change every time your computer reboots. This can result in web crawlers and user clients wanting to recache your web page when they don't need to.

isapi iis server etag http headers page expired cache reboot restart reduce need user clients recache web pages saving bandwidth

Language Identifier by Lextek International

Lextek Language Identifier is capable of automatically identifying that language that a piece of text is written in. Supporting over 260 different languages and encoding modules, the Language Identifier is capable of recognizing more languages and more character encodings than any other language identifier. Free for non-commercial use. SDK available for developers wishing to add language identification to their applications.

language identification language recognition character set identification encoding recognition unicode automatically recognize language document written

Auto Web Browser by Sekhol Technologies

Free browsing / searching tool. It automatically sends requests to major search engines, downloads the pages, filters and analyzes them and then surfs further downloading other potentially interesting pages using the links from the meaningful part of the relevant documents. The found pages and an annotated report with thumbnails are available for an instant offline preview by a user.

browsing search crawler offline keywords automation browsing searching tool web crawling offline preview features

7art Tropical Clock ScreenSaver by 7art-screensavers.com

Put a tropical island to your desktop! Sunny green palms, exotic birds, crawling crab and magical shell clock are going to cheer your moods and always tell the exact time. Let the clouds reflecting in crystall blue water to take you into amazing journey and fill your heart with miraculous dreams!

screen saver desktop image picture amazing screen flash clock watch time clock tropical clock crab palm

AXMEDIS GRID Content Processing Tools by AXMEDIS

AXMEDIS Content Production Tools: AXMEDIS editor and GRID AXCP tools, PnP, DRM editor, etc., all you need to create AXMEDIS objects and process any kind of content manually and automatically: SMIl, HTML, content adptation,, fingerprint, crawling, indexing, cms, search, retrieval, control of P2P, etc.

grid axmedis cross-media content processing automation interoperable drm