Review: Implementing the Google Search Appliance in an Intranet environment
Our corporate intranet is a non-framed environment with both Lotus Domino and IIS (.Net and classic ASP) applications and content. We have between 300,000-500,000 pages of web content and documents across more than 1200 "sites" on approximately 30 unique domains. We used to have Inktomi's UltraSeek Server 3.0 as our intranet search engine which was beginning to look like its age (purchased in 1998). The Inktomi product did not handle attachments well (DOC, PPT, PDF, etc.), would not crawl our secured sites, and was no longer supported by the vendor. We did a cursory review of the search vendors and were immediately attracted to Google's 30 day trial offer for their Google Search Appliance (GSA). After signing a standard agreement, they shipped us a brand new shiny yellow unit which we could test for 30 days before returning or purchasing. Product info The GSA is a "black box" 1U standard rack-mountable server. By "black box" I mean, Google gives you a web interface to administer the device but do not want you to access the Operating System (a heavily Google-customized version of Linux). In fact, the license agreement stipulates that you will not tamper with the hardware or OS of the appliance in any way. The device has no need for a keyboard, mouse or video ? all you need for normal operation is a network cable and standard power input. The GSA comes in different flavors to fit different needs varying by size of the hardware and correspondingly size of the license. (Licensing is based on the number of URLs crawled by the appliance.) There are 3 different hardware configurations; the GB-1001, GB-5005, and GB-800. These are broken down as follows;
- GB-1001 ? 150K documents for $28K, 300K documents for $50K
- GB-5005 ? 1.5M documents for $230K
- GB-8008 ? 4M documents for $450K
Why Google? As advertised, the GSA met all of our needs being able to index the large variety of filetypes we have in our environment, access secured content, having a documented API, etc. The Google brand power was another big selling factor. When we told our users that they were going to get a Google-based search engine they knew their days of troubled searching were over. Lastly, the 30-day trial run experience we had with the GSA sealed the deal. The appliance is the easiest enterprise solution I've ever had to install, configure and maintain. We were literally up and running within an hour of opening the shipping box. Installation The appliance has two network ports on the back panel; one for normal operation and the other used exclusively for network configuration. To configure the network settings we connected a laptop to the appliance via a special (some pin-outs are non-standard) orange Ethernet cable which is included. The installation process was about as easy as one can imagine for a "black box." First we plugged in the normal operation network cable and then the power. The power plug on the appliance IS the power switch; plug it in to turn on and unplug it to turn it off. After plugging it in, we waited about 5 minutes for the appliance to play a tune which is the signal to continue. Next, we hooked up our laptop (already set to DHCP mode) to the appliance and powered it up. After logging in to our laptop and making sure we had the correct IP assigned by the appliance's built-in DHCP server we are ready to configure the network settings. Total elapsed time (excluding rack mounting): 10 minutes. Configuration Network configuration, like normal administration, is done entirely through a browser and is a simple 5 step process. The first screens ask you for basic network information; IP address, subnet mask, default gateway, and DNS. Subsequent screens collect SMTP server, "From" address for GSA notification messages, time zone, NTP (time) servers and the admin account name/password. The last step is to test a few URLs which you will be crawling to make sure you've done the setup correctly. After a final settings review screen configuration is complete and you can then unplug your laptop and get to the good part; start crawling. Total elapsed time: 10 minutes. Crawling the site(s) Using the URL provided, all administration of the GSA is done remotely. After logging in with the ID/password we provided in the previous step, we were presented with the Administration console. We created a new collection to hold our index, put in the "Start crawling from" URL, copied that same URL into the "Follow and Crawl only URLs with the Following patterns" box and we were done. We saved our settings and then clicked the "Start crawling" button. We then went over to the "Crawl status" screen and watched the "Crawled URLs" counter increase. Google advertises that it can crawl about 4,000 URLs in about 15 minutes or so. We found the crawl time would increase significantly if there are documents (Word, PDF, Excel, etc.) linked to from those URLS. After the crawl is done the collection is automatically indexed and then checked against the Serving Prerequisites (any criteria you wish to use to determine whether to move an indexed collection to production) and the collection will either be moved to Production (and consequently searchable) or be moved to Staging. The Staging area lets you validate new crawls before letting users search against them. Crawling configuration After your first crawl you may find the need to go back and tweak the crawling parameters. Google gives you a good amount of control over how sites are crawled, the frequency, how many threads are used, etc. For sites with security, the GSA supports Basic Authentication and an additional security module is available which supports Forms Authentication. The most challenging configuration aspects for us were determining the right combination of URL patterns to exclude from the search. If you are a Domino shop and looking to use the GSA you may need to spend some time getting the crawler configuration just right to support the sometimes convoluted Domino query string parameters. After we got the crawl parameters tuned and the first complete crawl done we did some testing to see if the crawler grabbed all the content. Browsing our site and testing with some strings buried deep inside the taxonomy we always found the GSA had crawled them accurately. We also did some testing with strings inside PDF documents, PowerPoint presentations and the like. When we did come across something that hadn't been crawled a careful analysis led us to discover that we needed to do some more tweaking of the crawl settings. Other notable features Google also gives you a KeyMatch tool that allows you to specify which indexed documents should appear at the top of the results page for a given query. These manifest themselves almost identically to the Sponsored Links at the top of the results page of the Google we all use. A Synonym tool allows you to specify alternate words or phrases for search queries. For example, if someone searches for WCM, you can suggest "Web Content Management" at the top of the results page. An output format feature lets you control (via an XSLT) the presentation of the search results. You can use this for changing the fonts, colors, logo, header, etc. of the results page. We were able to easily remove the "Cached" feature on the results page with some XSLT modifications. The Reporting tool lets you run reports on search queries over various time ranges. It will show you the number of searches per day, per hour, the top 100 keywords and top 100 queries for the time period specified. Downsides The GSA is not for organizations looking to index their shared network drives as the appliance has no facility for crawling file systems. This is really too bad as many companies struggle with the huge quantities of unstructured content on stored on their networks. Of course, there are a plethora of other products out there for exactly this issue. Access directly to databases (e.g. SQL, Oracle, etc.) is another area which is off-limits for the GSA as well as any kind of integration with content or document management systems. Conclusion The Google Search Appliance (GSA) is an excellent search product for HTTP-accessible content. It gives great control over administrative features such as crawler configuration and results serving and sufficient reporting capabilities as well. Those looking for a solution to integrate directly with a content/document management system, databases, or indexing network drives should look to another product. However, if you have a intranet or intranet site with plenty of HTML-based content the GSA may be just what you need. Bryan Mjaanes is the creator/editor of Intranet101.com, a community-based forum for Intranet professionals.
Related News
|
 |
|
|
RELATED ARTICLES
Wireless Networking, Part 2: Setup and Security
The first installment in this two-part series of Tech Tips provided an introduction to the basic capabilities and hardware involved in wireless networking. In the final installment of this two-part series, we will look at some of the basic setup and security considerations that should be addressed. The physical installation of a wireless network may be easier than a wired network, but the more difficult part is setting up the software and security to make sure everything stays up and running without incident.
10 Solid Reasons To Make Your Next PC A Notebook
Notebook computers are becoming very popular. They seem
to be popping up everywhere: on tv shows, on airplanes,
in movies, or in your friend's lap. These sleek little
machines are invading our daily lives like never before...
and the invasion has just started. Find out why they have
become so popular with their users and why your next PC
should probably be a notebook computer.
Printer Cartridge Economics -- Four Ways To Make Your Ink Last Longer
Printer cartridge overheads can be a major expense for any busy office -- and even if you're working at home, it's important to factor in the amount you spend on your printer ink when assessing the cost of running a home-based business. And what you spent on that bargain-priced printer may turn out to be only a fraction of what you pay annually in printer supplies.
Best DVDs for Your Personal DVD Player
When bought personal DVD player, the very next thing to do is purchasing an important DVDs collection with your favourite movies, documentaries, shows, cartoons. Here are few hints before buying.
A Review of Refurbished Toshiba Laptops
Toshiba offers a few of their refurbished laptops in the "Clearance Store" of their official website toshibadirect.com. There you can purchase their laptops at 20-30% discounts, refurbished and as good as new. Toshiba inspects all returned and overstocked notebooks, replaces any defective parts, and resells them. You the consumer reap the benefits.
Used Laptop Computer: Your Quick Purchase Inspection Guide ? Part 3
Used laptop computers are everywhere these days. How can you sift through the mass of available used laptop computers to narrow your search down to the right laptop for you? This is the third part of a series of articles designed to give you a few suggestions for your next purchase.
Wireless Networking, Part 1: Capabilities and Hardware
Wireless Networking, Part 1: Capabilities and Hardware
RAID Disk Recovery
RAID is short for Redundant Array of Independent (or Inexpensive) Disks, a category of disk drives that employ two or more drives in combination for fault tolerance and performance. RAID disk drives are used frequently on servers and increasingly being employed on personal computers. Array is the operative word, which also dictates what the cure is going to be, when a RAID disk recovery situation arises.
The Right Way To Discharge Capacitor In Switch Mode Power Supplies
Switch mode power supply contain some large filter capacitors that can hold dangerous charges even if the unit has not been used for several days. Typical values of this type of filter capacitor are 220uf 250volt and 330uf 400volt! If you are going to work on the power supply circuits, it's a good idea to discharge that capacitor first.
Throw Away The Fax Machine ? A Guide To Online Fax
Have you ever felt like throwing the fax machine out the window? Well you may not know it but you can, but not literally please.
Setting up a Tape Backup Strategy for your Business
So you know a little bit about tape backup, but you're wondering how to set up a tape backup strategy for your business. Well, let's take a look at 3 simple steps to setting up a complete backup solution.
Pixel Disruption To Cause Nausea From User of Computer Screen
As we study the issues associated with teaching kids in the classroom we find that fluorescent lighting can plague the learning abilities. A slight flicker from such a light can cause disruption in normal brain patterns. Flickering lights at discos and in psychotherapy are used for proper mood enhancement. At a disco it can loosen up a dancer and put the mind in a certain transient state allowing for the movements, mood and mind to flow in the desired pattern. For psychotherapy it can be used to put a subject in a theta state of mind to remember old memories through hypnotic states, relax a patient or even change behavior through the art of suggestion permanently by putting certain commands into the subconscious.
Selecting an Ink Jet printer?With Low Operating Cost
Printer technology has made tremendous advances in the past five years. Speeds are up and print quality is great. Meanwhile, printer costs have declined.
Introduction to Dedicated Servers
A dedicated server is a single computer on a web-hosting network that is leased or rented, and dedicated to just one customer. A service provider monitors the computer's hardware, network connectivity, and routing equipment, while the customer generally controls and maintains the server software. Dedicated servers are most often used by those who've outgrown typical hosting accounts and now require massive amounts of data space and bandwidth, those with mission critical web sites, web hosting companies, or those who have special needs. Dedicated servers are housed in data centers, where service providers can monitor them close-up and have hands-on access to them.
Used Laptop Computer: Your Quick Purchase Inspection Guide ? Part 1
Used laptop computers are everywhere these days. How can you sift through the mass of available used laptop computers to narrow your search down to the right laptop for you? Here are a few suggestions to keep in mind.
To Upgrade or Not?
To upgrade or not? That is the question. At least, since the release of the new Athlon 64 FX-57, that is the question I have been pondering. Even though the FX-55, (which I am currently running), was everything I had hoped it would be, is the new FX-57 that much better? Well let's take a look.
Cisco CCNA Certification: Why You NEED Hands-On Practice !
CCNA and CCNP candidates hear it all the time: "you have to get some hands-on experience to pass the exams".
A Review of HP Laser Toners
Hewlett-Packard is, along with Brother and Samsung, one of the most readily available brands of laser toner. This is due, in part, to the fact that HP was first to release a laser toner inexpensive enough to catch the attention of the average consumer, in 1984.
Obsolete Is A Dirty Word (Intel Pentium 64 Bit Microchip)
Get ready everyone, home computers are about to set new LAN speed records! The Intel 64-bit microchip will soon be powering the new line of Pentium 4 computers. This long awaited sizzling fast release will be heading to store shelves across America just in time for the new blazing fast Windows 64-bit operating system. You'll get the 64-bit Pentium microchip, the 64-bit operating system, and that's not all, if you spend all your money, you'll also get all the new 64-bit stellar fast software programs that will leave current versions coughing in the rooster tail of their 64-bit micro-dust.
Printers: What Really Happens When You Hit ?Print?
You just poured hours upon hours into a lengthy research paper. All that's left to do is print it out. And that's the easy part, right? Sure looks easy from the user perspective, but it's actually quite complicated. A series of critical processes kick off as soon as you kit the OK button.
|
