The system works with search engines of Deutsche Bank in Intranet and Internet. Detailed analysis of search engines log files produces complex search engines statistics including subject, time, frequency, user, host, results, complexity statistics etc.
The system provides Web-based presentation of search engines statistics. MySQL database is used to store preprocessed data. With the search engine capacity of about 10,000 searches a day, a highly dependable system was built allowing to store more than 5,000,000 records.
Automatic update of the statistics was implemented by downloading log files from data center via HTTP interface. The system contains a set of tools for data processing: removing noise searches, importing data from older versions of software etc.
The system is highly configurable enabling system administrator to modify Web pages layout, add descriptive texts, and configure parsing processes. The possibility of adding new types of statistics into the existing framework is also provided.