|
|
|
|
A1 Website Download
by Micro-Sys
Using simultaneous connections entire websites can be downloaded very quickly. Links can be checked and converted to HTTP or local disk file system. Take websites with you on the road on USB / CD / DVD or any portable media. Use a task scheduler to automate download of websites at times convenient to you. Filter file types and directories to download. Can perform login and maintain session. Can handle redirects, robots.txt etc. Builtin browser.
offline mirror copy store a1 website download download entire websites browse offline convert links handle logins
|
|
|
RoboGen ROBOTS.TXT Editor
by Rietta Solutions
RoboGen is a visual editor for Robot Exclusion Files. It allows the user to quickly and easily create the ROBOTS.TXT files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public. RoboGen does this by providing the user a way to log onto his FTP server and then select the documents and directories which are not to be made searchable.
robots.txt search engine robot exclusion robot meta tag martijn koster
|
|
|
Robots.txt
by NetPromoter Lab
With Robots.txt Editor you create robot exclusion files by selecting all robots or a specific user-agent and adding documents and/or directories by entering the path names manually or by selecting them using FTP.With Log Analyzer you can get the full statistics of robots visiting the pages of your website.
robotstxt spiders site search visits spider analyzer html robots-txt log analyzer visually generate industry standard robots txt files analize webservers log
|
|
|
Robot-Manager
by Website Management Tools
Manage and track visits by robots, spiders and crawlers to your website. Identify which spiders visited, when they visited, and what pages they indexed. Direct spiders to your most important pages, and exclude them from non-public pages. Maximizes effectiveness with search engines by avoiding over/under submitting. Excellent to improve search engine placements for users of automatic submission software such as WebPosition, TopDog, AddWeb, etc.
robots-txt robot spider crawler log file log file analysis log file analyzer search engine optimization seo spider tracking referrer logs identify which spiders visited website pages indexed
|
|
|
ASP Search Engine
by Educe Software
Indexing of the title, description, keywords and full content of all HTML, ASP and TXT documents using a recursive call to all pages in a web site and sub folders excluding those folders listed in the robots.txt file. Simple search of the index for your web pages or advanced search for the provided search page. ASP or HTML code to insert into you current web pages to provide the search facility.
asp search engine utility shareware software remote customise look find word asp catalogue web site store data access database search pages
|
|
|
Atomic Email Hunter
by AtomPark Software
Acquiring your potential customers e-mail addresses is a cornerstone of successful e-marketing. The possible ways of acquiring e-mail addresses are: purchasing e-mail databases from various companies on the Internet or getting them manually from the websites of interest. But there is a better way! This innovative software allows extracting e-mail addresses from your target-audience relevant web sites! Stop wasting money! Download free trial now!
email extractor extract grab grabber harvester collect e-mail emails stop wasting money extract e-mails web sites relevant business
|
|
|
Page Promoter
by NetPromoter
Page Promoter is an ultimate URL registration, search engine optimization and promotion tool for submitting Web sites to thousands search engines and directories as well as preliminary site optimization and effectiveness check. The software allows you to enhance sites` exposure on the Internet and draw maximum volume of targeted traffic. It contains a large and up-to-date submission database, which is updated on a regular basis. Free updates.
site optimization site submission seo optimization url registration site promotion search engine submission
|
