Most time there’s little time, sometime there’s NO TIME!<\/p>\n
A few days ago I had no time, and had to manipulate a badly exported database (2million+ single myisam insert statements) tuning mysqld was useless, insert delayed useless, increasing buffers useless… and so on… import was taking hours (many hours) on the target box due to impressively high disk io!<\/p>\n
So I just fired up a vmware instance with 32gb of ram, 10gb hdd and 8cpu cores (of a xeon L56xx) and did everything in ram.
\nWhat was going to take hours on the target box took just 2minutes on the vmware instance…
\nThen I did a proper “mysqldump –opt” and imported it back into the target box in just 20seconds \ud83d\ude00<\/p>\n
yum upgrade -y\r\nwget -q -O - http:\/\/www.atomicorp.com\/installers\/atomic | sh\r\nmkdir -p \/var\/lib\/mysql && mount -v -t tmpfs -o size=24G none \/var\/lib\/mysql\r\nyum install mysql mysql-server -y\r\nnano -w \/etc\/my.cnf\r\n<\/pre>\ntune it up a little, in my case<\/p>\n
thread_concurrency=16<\/pre>\nwas enough \ud83d\ude42<\/p>\n
service mysqld restart\r\nmysql_secure_installation<\/pre>\nand you are good to go!<\/p>\n
import the bad export and after that export it making use of all the proper settings (extended queries, locking and so on) … –opt handles all of them by default \ud83d\ude42<\/p>\n
So yes… sometime I make use of “the cloud” too :O<\/p>\n
PS: I do the same (storage on ramdisk) when I’ve to compile a linux kernel.<\/p>\n","protected":false},"excerpt":{"rendered":"
Most time there’s little time, sometime there’s NO TIME! A few days ago I had no time, and had to manipulate a badly exported database (2million+ single myisam insert statements) tuning mysqld was useless, insert delayed useless, increasing buffers useless… and so on… import was taking hours (many hours) on the target box due to … <\/p>\n