Basically I put this in here cos its mainly MySQL relate, but there is elements of PHP as well.
For Starters the system is currently running MySQL 4.1.20 and we won't be upgrading to 5+ until the new server goes in. PHP Version is 5.0.4.
Ok, in the MySQL server are 2 databases. 1 contains numerous (and potentially massive i.e. 1million records +) tables. The other contains general information tables, 1 of which at the moment stands at approximately 600'000 records called tracking. The CSV file needs to be a cross reference between the tracking table and any 1 of the other tables.
I've been using JOIN statments to get the data sets, and then attempting to write the whole thing to CSV, but I'm getting timeouts right left and center.
Anyone have any suggestions on how I could improve this so that in the few cases where data gets this big, we can still download it.
The CSV doesn't have to be created in real-time so using something trigger from CRON etc could also work
Thanks in advance to anyone who makes a suggestion