Sizing Performance Analytics Engine instances
A Real User Analyzer component provides data to Performance Analytics Engine instances.
Key factors in the performance of a Performance Analytics Engine instance are:
- The I/O capacity of the disk array serving as its storage location
- The number of files that an instance opens
There is no limit to the number of Analyzer instances that can provide data to a
instance. However, consider the following guidance based on performance testing:- One instance can process up to 10,000 hits per second, using the low-profile configuration (as described in the following table). Medium- and high-profile configurations can process more than 10,000 hits per second, although formal test results are not currently available.
- Do not assign more than three high-profile Analyzer instances as data providers to a low-profile instance.
Compressing data on the Analyzer before providing it to a
instance results in higher CPU usage but requires less network bandwidth.
Performance Analytics Engine sizes
For each Analyzer that is feeding data to a instance, a minimum of three write-only files are opened on the disk array to insert object, page, and session data. As the time frame of the data crosses various time boundaries (hour, day, month, and so on), each instance might need to open additional files on a temporary basis. Typically, the number of open write-only files doubles during only a few minutes and then returns to normal. The same conditions might occur if the data being processed is heavily delayed or out of order due to network lag between Collector and Analyzer components.
Queries also open multiple files for simultaneous read-only processing, but only 20 read-only files can be opened.
When determining hardware requirements for a
instance, use the following considerations in your estimates:- Typical disk throughput is 50 megabytes per second. However, depending on your traffic, the amount of content that you are capturing, and the number of custom fields that you have defined, daily throughput could range from 100 gigabytes to 1 terabyte.
For each Analyzer instance that you add, the system maintains a steady state of three write-only files, spiking higher than that when necessary (up to double or more if the data is dramatically out of order). Files are closed and new ones are opened whenever a file reaches either the maximum allowable size or the maximum allowable duration. A file might also be closed when it stops receiving any data. These limits are controlled by system properties that can be accessed only by a BMC Software Consultant or Customer Support representative for the purposes of specialized tuning.
- A instance opens up to 20 read-only files for simultaneous processing. The system dedicates one thread for each open file. To improve the performance of your queries, you can improve the disk-array hardware or you can ask a BMC Software Consultant or Customer Support representative to raise the limit on the number of files that can be opened for reading.
- Because of fixed disk-array I/O limitations, increasing memory or processor resources is unlikely to have a dramatic effect on performance. However, the specifics of your hardware might be part of the issue.
Related topic