What are the most RAM consuming elements in SP2?

I recently upgraded my computer from 12 GB of RAM to 24 GB of RAM (new computer).

I expected a huge improvement in latency/buffer settings.

So far I get a lot of the same behaviors.

I have noticed some older simpler soundpacks play fine at 64 buffer, but most of the newer packs still needed at least medium or higher latency settings to avoid sound cutting out, especially cymbal kits.

What slows down processing most?

-Large sample sizes (high quality samples) vs. smaller compressed formats

-Quantity of Samples per drum/kit; repeated redundant samples with minor tweaks, excessive layered sounds

-Excessive active tweaks (sound modulation) upon single sample instances with high voicing counts

-Excessive overall layers of kit commands/elements

Or do I simply need maximum RAM hardware for faster latency on advanced kits?

Does processor type make a huge difference?