Troubleshooting Java memory management

This topic describes some of the issues and troubleshooting related to TrueSight Presentation Server Java memory management. The goal is to help you avoid potential performance impacts.

Java memory management - Useful links from BMC Communities

• Webinar Recording - Monitoring Java Memory Utilization in TrueSight Operations Management
• java.lang.OutOfMemoryError: unable to create new native thread error seen in the TrueSight.log on Linux TSPS Server 11.0
• TSIM jserver fails to start with java.lang.OutOfMemoryError: unable to create new native thread
• TSPS Server crashing with java.lang.OutOfMemoryError: GC Overhead limit exceeded errors

If you experience performance and/or memory issues, run the TrueSight Health Check Tool. See  TrueSight Health Check Tool.

Issue symptoms

TrueSight Presentation Server is slow to respond. You are not able to click around, it is taking a long time to load each page. This happens periodically over time.

• When the Process memory usage was checked for the CSR process, it is normal
• The OS also has free memory available
• Does not appear to be a heap space issue

A review of the Presentation Server - tssh dump export output shows the following error in the TrueSight.log.

[ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [] fatal error in thread [elasticsearch[Niv1l2z][refresh][T#2]], exiting
java.lang.OutOfMemoryError: unable to create new native thread

This happens because of constraint on processes. Following setting helps to increase the limit.
Get the CSR and index server process ID

tssh  server status  

ps –p processID –lfT |wc –l

The command above should show the threads usage. For CSR it is around 2000 and for indexserver it is around 200.  

ulimit –a

Look for max user processes (Default 2048)   Make it unlimited or higher value of 4096. 
ulimit –u unlimited    

1. Check the init files if this value is being changed.
2. Reboot the server
3. Test ulimit –a

Diagnosing and reporting an issue

After you identify the symptoms and scope of the issue, use the troubleshooting guide to help diagnose and resolve the issue or to contact Customer Support.