You may receive this error message when running System Console, due to the memory requirements of System Console exceeding the maximum heap size allocated to the Java VM. When you launch System Console it runs in a Java VM with a default maximum heap size of 512MB.
To avoid this error, increase the maximum heap size that is allocated to the Java VM by using the -jvm-max-heap-size <heap size> switch when you launch System Console in command line mode. To do this, run the following command:
/sopc_builder/bin/system-console -cli --jvm-max-heap-size=<heap size>
--jvm-max-heap-size defines the maximum memory size to be used for allocations when running System Console. This value is specified as <size><unit> where unit can be m (or M) for multiples of megabytes or g (or G) for multiples of gigabytes.