This week's book giveaway is in the OCAJP 8 forum. We're giving away four copies of OCA Java SE 8 Programmer I Study Guide and have Edward Finegan & Robert Liguori on-line! See this thread for details.
I'm running through some bulk loading SQL procedures that are taking hours to run. It might be they need to take hours, but one thing I've noticed is that MySQL never requests much memory (~50 megs) throughout the process.
I know there's a dozen or so variables to increase buffer sizes, and I've tried a lot of them with little to no change. Any suggested settings I should look at?
Nope it does not. I'm bulk loading a couple gigs of data, tried using INSERT and LOAD DATA INFILE, but it seems to grind after a certain point. It is a single threaded execution though,
Again, I don't need a list of system variables, there's too many as it is and I've read through everything you've sent all ready. I'm just trying to find out if anyone has seen cases where mysql's memory size stays so small and specific ways to improve it.
Found the variable to increase memory size for INNODB systems: innodb_buffer_pool_size
It was set at ~10 megs... increasing it to 800 megs definitely increased memory size. Not sure yet about performance though.
Just as an update, changing the InnoDB definitely fixed the issue. As a benchmark, one bulk load went from 4 hours to 15 minutes. Definitely an vital setting to set if you want MySQL to really use the memory it has available.