Version 4.9.4

• A new menu item has been added to the application's Grab menu for downloading the current browser URL and the resources it directly references. (This functionality is called "Download One Page" and compliments the other menu items which operate on the current browser URL.)

• A new application Services menu item named "Download One URL" has been implemented for downloading one URL (selected in the current application) and the resources it directly references. (This compliments the previous services for imaging a URL to a file and clipboard.) Note: the Services menu is system wide and appears in every application menu.

• Menu items in the application's Grab and Image menus have been renamed for clarity.

• Fixed an issue with imaging URLs to the clipboard in Leopard. The program now uses portable network graphics image format (PNG) rather than PICT, and a different technique for putting data on the clipboard is used.

• URLs with extension "flv" are not crawled with the default configuration Some servers seem to have been returning the wrong mime types for such files, and Blue Crab tries extracting URLs from them, causing the program to hang.

• For email notification functionality: the content-transfer encoding header was being duplicated and that could cause some mail servers to reject the message as spam.

• New minimum requirement is 10.4 (up from 10.3.9)

Version 4.9.3

• While downloading certain sites I discovered that web pages which do not use quotes in "src" links did not display images properly (offline) in some browsers. This version has a new preference option to fix this problem during the URL relinking process. By default this option is on. You might want to turn it off if your browser doesn't exhibit this behavior. (Example page: http://www.beatlesagain.com/)

• A new Preference pane tab named "Grabber" has been added. This pane contains options which pertain specifically to the grabbing process, and includes the new option listed above.

Version 4.9.2

• Various enhancements made to the "Batch Download" window:

- The destination folder does not need to be your internet download folder. The destination will default to that location, but you can now use the "Download Folder" button to set it to any folder you like. The display of the folder location (path) now properly handles unicode folder names. Moreover, Blue Crab saves the folder location alias, so if yo move it Blue Crab can still find it.

- The Batch Download window can now be opened for you automatically on program launch. Turn this option on in "Preferences." This is useful for those who use the Batch Downloader frequently.

- The functionality of the "import" and "export" buttons have been compacted into a popup button to save space in the window, making it less cluttered as more functionality is being added: A new function is now available to import all URLs from the frontmost window of your supported web browser (supported browsers are: Safari, FireFox, Camino and OmniWeb.)

- When importing URLs from files or web pages you can now apply filters to control which URLs are batched. This feature is implemented as a filter on the content type (MIME) of the URL. For example, if you only want to import JPEG URLs from the current web page, click the new "MIME Filter..." button to enter "image/jpg" as the MIME type of choice. Only URLs whose MIME type contains this string will be added to the batch window list. You can enter multiple strings separated by spaces. As long as any one of the strings matches the URL will pass through the filter.

- A new MIME Filter window has been implemented to enter match strings which the imported URLs MIME types must contain. This window also has a "Lookup MIME types..." button to help you find MIME strings to add to the filter.

- The contextual menu on the Blue Crab Dock icon now includes a command named "Batch Browser Window" which will cause the Batch Download window to display, importing all URLs on the current web browser page which match any MIME filters.

- Since the MIME filter needs to know the MIME type of each URL, filtering can take time as Blue Crab obtains that information by asking the server for it. In order to display progress console logging has been implemented. Select "Console Log..." from the file menu to display Blue Crab's console log. As each URL is filtered it is displayed in the console log, along with the filtering result.

Version 4.9.1

• Bug fix: Some users were complaining of sluggish text field's in the Configuration editor. This has been fixed by adding an option in Preferences to display full menu items in the "Grab" menu. This option is off by default. To edit the option select "Preferences..." from the Blue Crab menu, and then select the "Behavior" pane. Turn the option on by selecting the "Show full titles in "Grab current web page" menu items.

The current browser URL is displayed in certain menu items of the "Grab" menu if this option is on. As it turns out keyboard processing is related to menu updating, unfortunately, and that caused an overhead when the program was checking for the current URL in the your browser as characters were being typed.

Version 4.9.0

• Bug fix: Fixed a problem which could cause Blue Crab to crash when checking for software updates or using one of the "quicker" grabbers. (Memory in use was being released too soon.)

• Blue Crab will now automatically redirect the starting URL, if needed, and start the crawl with the redirected URL.

Version 4.8.9

• Added an "Export" item to the "Bookmarks" menu. This menu command will export all your bookmarks to a plain text file, with one URL per line, after prompting you for a filename and location.

• Added help tags to the "Image" menu items, and fixed broken help tags on some of the "newer" menu items elsewhere.

Version 4.8.8

• The image grabber has been turned into a "media grabber" capable of grabbing images or movies or PDFs.

• "Offsite URLs" are now grabbed when grabbing any type of media. (A URL is considered "offsite" if its host is different from the host of the starting URL.)

• File modification dates are always checked when grabbing media, to avoid re-loading large resources that have not been modified since the last download.

• Bug fix: file modification dates are now checked for re-driected URLs (if the configuration option to check modification dates is on.)

• Speed optimization: Blue Crab no longer crawls URLs on the level before the "terminal level," since those next level URLs will not be grabbed. (This results in better performance of the media grabber.)

Version 4.8.7

• The batch download window now uses the user name and password entered into the "Login" window when importing URLs from a URL.

• The URL prompt window and its text field is now resizable.

Version 4.8.6

• The batch download window now has a button to import URLs from a URL, and not just from a disk file. Access the batch download window by selecting "Batch Download..." from the "Grab" menu. When you do you will be prompted for a URL. When you click "OK" Blue Crab will extract all URLs from the given URL and populate the batch download list.

Version 4.8.5

• The "get url" AppleEvent has been implemented so that you can use an AppleScript to create a Grabber window with the "Starting URL" text field set to the given URL. Or create a "bookmarklet" in Safari to open a Grabber window with its "Starting URL" text field set to the current URL.

Go to the "Defaults" pane of the Preferences window to specify which type of grabber window to use for this feature: either a standard grabber, quick grabber or image grabber.

See the samples located in the "GetURL" folder of the software distribution. In particular drag the file named "BlueCrab.inetloc" into your Safari Bookmarks bar to create a bookmark that opens a Grabber window set to the current URL.

Version 4.8.4

• The menu items of the "Grab" and "Image" menus which grab and image the URL displayed by your current web browser have been fixed to support Firefox and Camino.

Version 4.8.3

• The option to generate a site map is now available on the "Behavior" tab of the Pereferences window. This option enables you to always generate a complete site map without creating a special configuration. (But if you want to filter the items in the site map by extension you need to create a special configuration.)

• Blue Crab was hanging while checking for re-direction if you started a grab with an empty starting URL.

Version 4.8.2

• The option to auto-redirect URLs using system software rather than Blue Crab's own mechanism is now available on the "Behavior" tab of the Pereferences window.

Version 4.8.1

• The "Batch Download" window now supports realm authentication. Click the window's "Authentication..." button to enter your username and password.

Version 4.7.9

• A new option has been added to the Behavior tab of the Preferences window named "Only search in text files." When this option is selected the Search window will restrict searches to files whose mime type is textual, such as "text/plain" or "text/html." The option is selected by default.

• Various minor enhancements to improve program performance.

Version 4.7.8

• You can now open items in the Batch Download window using the new contextual menu.

• You can now drag items out of the Batch Download window into other applications.

Version 4.7.7

• A new column, named "Status," has been added to the Batch Download table. This column will display the HTTP response code for the URL (i.e. 200, 404, etc.)

• Previously the program would stall while waiting to retry to download a URL, it now remains responsive.

• Status messages which are displayed during retrying to download a URL are more detailed.

Version 4.7.6

• The changes in the previous version introduced a small bug that prevented the "classic" grabber window from operating.

Version 4.7.5

• Network Timeout: this parameter is now configurable from the "Behavior" pane of the Preferences window and determines how long Blue Crab will wait before it terminates a stalled network connection. Defaults to 60 seconds.

• Retries: this is a new parameter that determines how many times Blue Crab will retry downloading a URL that suffers from a network error before it gives up on it. Specify it on the "Behavior" pane of the Preferences window. Defaults to 3 retries.

• Retry Interval: this is a new parameter that determines how long Blue Crab will wait between successive retries. Specify it on the "Behavior" pane of the Preferences window. Defaults to 3 seconds.

Version 4.7.4

• A new preference enables opening imaged URL files automatically in the default image viewer application.

Version 4.7.3

• "Software Update" is now disabled by default for new users. After launching the program for the first time Blue Crab will now display a prompt asking the user if Software Update should be enabled or disabled.

Version 4.7.2

• The option to remap URLs whose extension is "php" has been extended also to URLs with extensions "php3" and "phtml." (This option is for improved navigability of the downloaded files when using certain browsers.)

Version 4.7.1

• Improved Blue Crab's handling of malformed URLs (such as unquoted URLs.)

Version 4.7.0

• The "Batch Download" window has a new option to image URLs rather than download them. Use the "Image" checkbox to turn this option on.

Version 4.6.9

• The "Stay in folder" feature has been added to all the grabber windows. This feature enables you to just grab files that reside in the folder that contains the starting URL.

• A new option has been added to the "Defaults" pane of the "Preferences" window that enables you to specify the default value (on/off) of the "Stay in folder" checkboxes.

• Fixed a bug when remapping URLs in which a URL that contained an empty search (or path) argument would not be remapped. (Ex. "Index.php?")

Version 4.6.8

•  When imaging URLs the "Save" dialogue window now displays a QuickTime image description of each available file extension listed in the image format popup menu.

• When imaging URLs the "Save" dialogue window now attempts to use the URL's title as the default name of the image file. (Otherwise the URL's filename is used, if available, or it is named "Untitled.")

Version 4.6.7

•  Blue Crab now provides two Services menu items: "Image URL to Clipboard" and "Image URL to File." The first menu item creates a PICT format image of the URL on the clipboard, and the second prompts the user for the image format and file destination. These menu items require a fully qualified URL provided by the calling application.

Note: In order for the Services menu to update place Blue Crab into your Applications folder and then logout and login to your account.

• When imaging URLs to the clipboard Blue Crab now uses the PICT file format, as opposed to the JPEG file format, in order to improve compatibility with more applications.

Version 4.6.6

• All menu items in the "Grab" menu which pertain to imaging URLs into graphics files (jpeg, etc.) have been moved into their own menu named "Image."

Version 4.6.5

• Fixed a bug (introduced in version 4.5.1) which caused some edit text fields to become noticeably sluggish, such as the "Starting URL" field of grabber windows.

Version 4.6.4

• A checkbox labeled "Stay in folder" has been added to the classic grabber window. When checked Blue Crab will only grab URLs whose path begins with the path of the starting URL. This checkbox is a convenience so that you need not create a configuration file with a path filter.

Version 4.6.3

• The Image Grabber slideshow was not displaying images on sites which required user login because the image pane did not login when requesting the images from the server for display.

• The "file type" filter on the "Other Filters" panel of the configuration editor was not working on Intel Macs.

• The email notifier was not always working on Intel Macs because Blue Crab was not properly creating the "HELO" message.

• The password text field of the email notifier pane on the preferences window was not working on Intel Macs.

• The email notification now specifies the current level and current level percent complete in the email subject.

• All grabber windows are named after the host specified in the starting URL as opposed to the filename of that URL.

• Added additional progress messages during the URL extraction process; improved program responsiveness during intense extraction on large pages.

Version 4.6.2

• The batch download list of URLs can now be exported to a text file, which can then be imported again for re-use.

• URLs can now be added to the batch download list by importing them from plain text, as well as HTML files. The URL extraction method has also been improved.

• Fixed some problems with saving the batch download list after making changes.

• Clarified the help text for the "Hosts" button for grabbing offsite URLs.

Version 4.6.1

• Fixed a bug on Intel Macs only that caused Blue Crab to miss some URLs on certain types of web pages that it would ordinarily grab.

Version 4.6

• Built as a Universal Binary so Blue Crab now runs natively on Intel and PPC Macs.

• Minimum system requirement is now Mac OS X 10.3.9 and higher.

Version 4.5.1

• New menu item added to the "Grab" menu labelled "Image Browser URL to Clipboard:" images URLs to clipboard, rather than to a file.

• You can now image files on your computer, such as rich text. Specify them using the "file:///" protocol or by loading a file into your supported web browser and then selecting an appropriate "Image Browser URL" command.

Version 4.4.9

• An image quality popup menu has been added to the "Image URL" save panel.

• When imaging URLs the image file's comment is now set to the URL.

Version 4.4.8

• The "URL" column of the batch download window is editable.

• The batch download window now has a proxy icon in the title bar which points to the download folder.

• The title of the batch download window now matches the name of the download directory.

• A new button in the batch download window for setting the download location (which is the same as your internet download folder.)

• The batch download window now has a minimum size.

Version 4.4.7

• A new configuration option to ignore any URLs which contain path arguments or search arguments is available on the "Grabber" pane of the configuration editor. The new checkbox is labeled "Ignore dynamic URLs" and it is OFF by default.

Version 4.4.6

• A new configuration option to filter allowed "offsite" hosts is available when the "Grab offsite URLs" option is on. A URL is considered offsite when its root domain does not match that of the starting URL. If the list of allowed hosts is empty than all offsite hosts are allowed. This feature enables you to restrict Blue Crab to certain hosts.

• Blue Crab now recognizes if an HTML page contains a base URL tag in the HTML header and re-links the page's relative URLs accordingly.

• When submitting forms Blue Crab now includes a Content-Type header field in the HTTP POST header whose value is "application/x-www-form-urlencoded."

• The usage of form submission has changed. When you specify a form to submit in a configuration you no longer need to specify a "Starting URL" as Blue Crab automatically sets the Staring URL to the form "action" URL. After submitting the form Blue Crab starts its crawl with the server response to the form submission.

(Form submissions can be useful if you need to login to access a site, or you want to crawl a set of pages generated by a search query.)

• Form submission now supports the "GET" method (in addition to "POST".)

• A new checkbox option named "Use server content type" is available on the Advanced section of the Grabber pane of a configuration. If this option is on (its off by default) Blue Crab will add a content type tag to the header of the HTML (existing tags will be replaced.) The value of the tag will match the content type returned by the server. (This can improve the display of web pages with different character sets.)

• The "Image URL..." Grab menu item is now enabled all the time, not just when the web window is displaying a URL (the process of imaging web pages is now synchronous.)*

• A new Grab menu item named "Image Current URL..." images the current URL in the web window.*

• A new Grab menu item named "Image Browser URL" images the current URL displayed in supported browsers (such as Safari.)*

• An alert is displayed when imaging URLs if the installed version of Quicktime is under 6.4 (fixes compatibility problems with some early versions of Mac OS X, such as 10.2.8)

• The default name for saving imaged URLs is derived from the filename of the URL (if there is one.)

• Available image formats are determined by your Quicktime software.

Version 4.4.5

• When imaging a URL displayed in a Blue Crab web window the file save dialog now includes a popup menu for selecting the image format by extension (bmp, tif, jpg, etc.) This means you now know which extensions are available for use (namely all those supported by your Quicktime software.)

• In the "Open URL" dialog the URL no longer needs to be fully qualified (in which case it defaults to the "http://" protocol.)

• The application "Grab" menu now has a menu item to open the URL displayed in the current browser front window in a Blue Crab web window (which enables you to create an image of it.)

• Bug fix: Blue Crab was not always properly saving the keychain password for mail server authentication (for the "Notify by email" feature.)

Version 4.4.4

• A new menu item named "Image URL..." has been added to the "Grab" menu. When selected Blue Crab will create an image of the current web window contents, including portions not in view (web windows are displayed either when you select "Open URL..." from the "Grab" menu, or you are previewing a crawl inside Blue Crab.) Blue Crab prompts you for a filename and location.

Image formats include all those supported by your installed version of Quicktime (such as PNG, BMP, JPEG, PICT.) The image format created is determined by the extension of the filename you enter (.png, .jpg, .bmp, .psd, etc.)

• Help tags have been added to some menu items.

Version 4.4.3

• A new option for email notification is available in the Preferences window "Notify" pane. The email notification consists of a short message indicating the starting URL and elapsed time, as well as a graphic illustrating progress (identical to the dock badging.) Notifications are only sent when the "Recipient" field on the Notify pane contains an email address. You can specify the period delay between notifications in minutes.

• The documentation files now have a "Tiger optimized" index.

Version 4.4.2

• When using the Image Grabber a configuration's "save filter" is now applied.

• When using the Image Grabber relinking and remapping is now optional via the "Image Grabber" pane of the "Preferences Window"

• PHP URLs: A new option has been added to the "Grabber" pane of the configuration editor for remapping urls whose extension is "php" in order to improved navigability of the downloaded files.

• URLs with extension "wmv" are now not crawled (some servers have been returning "text/html" for such files causing Blue Crab to try and extract URLs from them, causing the program to hang.)

• A bug discovered in the "negative" filtering mechanism of a configuration has been fixed.

• A bug in the "flatten when saving" option in the Image Grabber window has been fixed.

• Help tag strings on some configuration panes have been edited for clarity.

Version 4.4.1

• An option to have Blue Crab compare the modification date of a URL to that of a corresponding disk file to determine if the file needs an update is now available on the "Grabber" pane of a configuration ("Advanced" section.) Only the modification dates of files which are not crawled are checked, such as images and PDFs. (This is because normally Blue Crab must have access to the server's copy of the contents of files its crawls, like HTML, since the disk version may have been remapped or relinked for offline navigation.)

This feature can possibly significantly improve the speed of updating a downloaded website because large resources which have not changed will not be downloaded again.

• Using the "Defaults" pane of the Preferences window you can specify if this behavior is on or off by default (i.e. if the corresponding checkbox of the default configuration is checked or not.)

Version 4.3.9

• The configuration settings for the logging of errors and offsite URLs has been moved from the "Grabber" pane to the more logical "Logs" pane of the configuration editor. All configuration settings for logging information during a crawl is now conveniently located in one place.

• Error and offsite URL logging implementation has been changed to conform with the site map and email extraction logging features. The logs are created as individual text files in the same location as the others, namely the location of the general log file. This location is specified on the Logs pane of the configuration editor.

• Fixed two URL relinking bugs improving the completeness and accuracy of website downloads when conducting crawls which are allowed to stray off the starting domain into related (or secondary) domains.

• Fixed a bug which could cause Blue Crab to miss relinking URLs which correspond to the "Index" file of the web server, damaging the navigability of the download. The Index file is the file returned when the URL specifies a directory.

Version 4.3.8

• Extension of page preview introduced in the previous version: Blue Crab can now preview pages in its own window, rather than in your default web browser, using Apple's WebKit. This improves performance. You still have the option of using your default web browser. Use the "Preview" pane of the Preferences window to configure this feature.

• A new menu item named "Open URL..." has been added to the Grab menu. This function opens a URL in a Blue Crab window.

Version 4.3.7

• Using your default web browser Blue Crab can now preview pages as it crawls. Turn this option ON in the Preferences window "Preview" pane; changes take effect immediately. Note: The preview is of the internet location, not the downloaded file.

You should have your browser configured to open links from other applications in the current window rather than a new window. (Safari and Omniweb support this feature.)

• Blue Crab now checks the starting URL for ambiguity: If the starting URL has no extension or trailing forward slash it could be either a file or a folder. If Blue Crab determines that it is a file an appropriate extension is appended. (Blue Crab already checks, and fixes, subsequent URLs for ambiguity.)

• Two new options relating to "secondary domains" have been added to the "Advanced settings" section of the "Grabber" pane: If the option to remap secondary domains is selected you can now also specify if you want Blue Crab to crawl pages in a secondary domain. You can also specify if Blue Crab should apply any filters to URLs in a secondary domain. Both of these new options are OFF by default. (These features are implicitly ON in previous versions.)

(Note: A secondary domain is any domain whose first level matches the first level of the starting URL. For example: "developer.apple.com" is a secondary domain for "www.apple.com" and "apple.com" because it's first level is "apple.com.")

• A new option to grab offsite URLs is available in the "Advanced settings" section of the "Grabber" pane. When this option is ON Blue Crab will grab all resources it finds that are not on the root domain of the starting URL. This option is OFF by default. Blue Crab will never crawl offsite pages (i.e. extract their URLs and grab them.)

• The "Reveal" button in the Grabber windows now opens the download folder specified in the selected configuration even before the crawl starts.

Version 4.3.6

• A new "Batch Download" window downloads multiple URLs at a time, providing detailed progress information during the download. (Select "Batch Download..." from the "Grab" menu to access this new window.)

Version 4.3.5

• Fixed non-ascii character encoding problems with the Search window's directory text field and search results outline display.

• Fixed non-ascii character encoding problems with file chooser and save dialogs.

• Fixed directory file iteration in the Search window.

• Added a progress bar to the Search window.

• You can now double click folders in the search results outline display to open the corresponding directory in the Finder.

Version 4.3.4

• Added a new command to the Grab menu which grabs the current front web page (of supported browsers) using the standard grabber.

• Bug fix: All the "grab current web page" menu commands now pick the preferred configuration file, rather than Blue Crab's default.

• The width of the standard grabber can bow be increased beyond the minimum width.

• Bug fix: URLs which contained double (triple, etc.) series of forward slashes (...//...) were not saved to disk by the correct filename.

Version 4.3.3

• The Dock icon is now animated to show progress by displaying the current level and a progress pie for the current level URL. (Mac OS X 10.3 and above.)

• An alert is displayed if you try to quit when downloads are in progress.

• You can now use the Preferences window ("Defaults" tab) to specify a configuration file to pre-select whenever a grabber window is opened. This enables you to create your own default configuration.

• Changes in configurations (renaming, adding, deleting, etc) are now reflected in the grabber windows without having to close the configuration editor.

• An alert is presented if you try to start a download without entering a URL.

• You can no longer open two or more Preference windows at the same time.

Version 4.3.2

• Site Maps. (a) There are now three options when generating site maps: List by Title only, List by URL only or List by Title and URL. (Turn on site map generation and specify the options using a configuration. ) (b) A "Site Map" button has been added to all grabber windows. This button is enabled when the chosen configuration has elected to generate a site map for the crawl. You can use the button to view the cumulative site map while the crawl is in progress.

Version 4.3.1

• Image grabber. (a) Slideshow images are displayed with maximum quality, rather than high quality for improved viewing pleasure. (b) Images were not always correctly cropped and positioned (depending on the sizes of the images.) © You can now start and stop the slide show, which can increase speed in cases there are very many images to draw.

Version 4.2.9

• Form submission. Blue Crab can now be configured to submit a form in order that you can log into a website or crawl a form submission result page. Form action URLs and name-value pairs for form input elements are specified on the new "Form" tab of a configuration.

• Added "Camino" web browser support to the Grab menu "grab front web page" commands.

• Determining suffix from MIME type during re-mapping is now OFF by default because it can be very time consuming, and an "html" suffix is most likely appropriate. (Blue Crab does a "HEAD" request from the server for each URL that requires re-mapping.)

• Configuration tables: you can now double click items to edit them. An alert is displayed when you try to delete items.

• You can option double click in the configuration column of a bookmark item to edit the associated configuration.

Version 4.2.8

• You can now add a bookmark by pasting text from the clipboard into the Bookmarks window. (Blue Crab does not verify the text is a genuine URL.)

• Pause-Resume functionality has been added to the rest of the downloader windows.

Version 4.2.7

• Feature Optimization: Blue Crab is now 20-30% faster when downloading in the "image grabber mode" (by removing irrelevant processing for this feature.)

(The Image Grabber makes it easy to download just the images on a web site or page.)

Version 4.2.6

• Bug fix: The URL finder has been adjusted to better deal with URL's referencing files that have no extension. Such URL's will now have an extension appended to them as determined by the content type of the data returned by the server (using the HTTP header.)

• Speed Improvement: When relinking with the "Checking for redirection" option turned on in the selected configuration Blue Crab now remembers which URL's it has processed for redirection. This avoids the need to do it again if the URL occurs again elsewhere, greatly improving download speed on certain websites.

• Blue Crab now presents an alert when you click the close box of a window which has a download in progress, rather than just terminating the download and closing the window.

Version 4.2.5

• Bug fix: The URL finder has an improved validity check.

• Bug fix: In some situations where a URL is redirected via the "HTTP-EQUIV=REFRESH" method Blue Crab was incorrectly determining the location if it didn't exist.

• The log file is no longer formatted as HTML so it can be viewed using Console.

• The default download folder is named "Blue Crab", and not "Grabbed Files" (still inside the users Documents folder.)

Version 4.2.4

• The name of the "Logging" pane of the configuration editor has been changed to "Logging/User Agent", and it has been slightly reorganized for clarity.

• The "Logging/User Agent" pane now has a popup button for selecting from various built-in user agents, and supports importing your own list of user agents.
(The ability to set the user agent can affect the download because servers often condition responses based on user agent.)

• The "Use cookies" checkbox has been moved from the "Logging/User Agent" pane to the advanced section of the "General pane", a more appropriate location.

• The user agent string for Blue Crab has been modified.

• The configuration editor dialog that asks if you want to save changes now offers the option to cancel.

• Apple Help Documentation fixed for Mac OS X 10.2.8 (images were not displaying). The documentation has also been updated for some changes.

• The last open pane of the configuration editor is now remembered.

Version 4.2.3

• Fixed a bug where the "New User Help" was not displaying on initial program launch when a demo password is entered.

Version 4.2.2

• A "Recent items" menu for the "Starting URL" is now available in all the downloader windows.

Version 4.2.1

• Saving downloaded files to disk is now optional. This is useful if, say, you only want to generate a site map, or collect email addresses.

• Bug fix: Redirections no longer counted as errors.

• Bug fix: Program could hang occasionally with dial-up internet connections.

Version 4.1.9

• Bug fix: Pressing the "Quit" button on the Software Update window could cause Blue Crab to "Unexpectedly Quit".

• After the updated software archive is downloaded Blue Crab now automatically mounts the disk image for you.

Version 4.1.8

• RSS feeds can now be crawled.

• URL finder improved for more complete downloads.

Version 4.1.7

• Internet Cookie support has been added. Cookies are on by default, since they provide for more accurate and complete downloads. Some sites even require that cookies be turned on.

For information about Cookies consult these resources:

http://en.wikipedia.org/wiki/HTTP_cookie
http://www.cookiecentral.com/faq/
http://www.howstuffworks.com/cookie.htm

• The title of the grabber windows now support long filenames.

• The Grabber window now shows the cumulative number of email address contacts and cookies encountered during a crawl (provided these options have been turned on in the associated configuration.)

• The default "creator" of downloaded files is now set to be the creator of your default internet browser. So if your default browser is Firefox then HTML documents downloaded by Blue Crab will open in Firefox and look like Firefox documents in the Finder. (Safari was previously always the default creator.)

• The configuration editor has been modified a bit. The "General" pane is now called "Grabber", and the "Log & Site Map" pane is now called "Logging". A checkbox has been added on the Logging pane to turn cookies on and off.

• Added an "Export" item to the "Bookmarks" menu. This menu command will export all your bookmarks to a plain text file, with one URL per line, after prompting you for a filename and location.
• Added help tags to the "Image" menu items, and fixed broken help tags on some of the "newer" menu items elsewhere.

• The image grabber has been turned into a "media grabber" capable of grabbing images or movies or PDFs.
• "Offsite URLs" are now grabbed when grabbing any type of media. (A URL is considered "offsite" if its host is different from the host of the starting URL.)
• File modification dates are always checked when grabbing media, to avoid re-loading large resources that have not been modified since the last download.
• Bug fix: file modification dates are now checked for re-directed URLs (if the configuration option to check modification dates is on.)
• Speed optimization: Blue Crab no longer crawls URLs on the level before the "terminal level," since those next level URLs will not be grabbed. (This results in better performance of the media grabber.)

• The batch download window now uses the user name and password entered into the "Login" window when importing URLs from a URL.
• The URL prompt window and its text field are now resizable.

*The "get url" AppleEvent has been implemented so that you can use an AppleScript to create a Grabber window with the "Starting URL" text field set to the given URL. Or create a "bookmarklet" in Safari to open a Grabber window with its "Starting URL" text field set to the current URL.
Go to the "Defaults" pane of the Preferences window to specify which type of grabber window to use for this feature: either a standard grabber, quick grabber or image grabber.
See the samples located in the "GetURL" folder of the software distribution. In particular drag the file named "BlueCrab.inetloc" into your Safari Bookmarks bar to create a bookmark that opens a Grabber window set to the current URL.

*The option to generate a site map is now available on the "Behavior" tab of the Pereferences window. This option enables you to always generate a complete site map without creating a special configuration. (But if you want to filter the items in the site map by extension you need to create a special configuration.)
*Blue Crab was hanging while checking for re-direction if you started a grab with an empty starting URL.