I'm running a site that is having performance issues and am seeking advice on some general Drupal best practices on performance, server configuration, basic best hardware, etc.
A bit of background: we're doing a Q&A mashup with Twitter and the heart of the site is using the FeedAPI module to create nodes out of all tweets at Twitter that have a question mark at the end. The result is sometimes dozens of nodes per minute, so it will be an intensive endeavor to say the least no matter what we do, but just trying to optimize.
So far, we've been on a VPS and our problems have included capping 100% on the processor, running out of memory and cron cycles timing out due to the load of the node-processing.
Clearly, our work is cut out for us by virtue of the endeavor, but any general "best practices" advice or documents/threads to look at on what in general to throttle, what modules to avoid or add to help performance, configuration settings, server requirements, etc would be greatly appreciated.
We're moving to a dedicated, managed server in the coming weeks so thought this was the best time to ask.