Opening XML files over 20GB
Posted: Thu Sep 20, 2007 3:54 am
Hi,
I'm about to receive an XML document that could be anywhere between 20GB and 30GB
I've got the task of importing specific data fields from this file into a MySQL 5.0 database. I haven't dealt with a file of this size before and am slightly lost as to the best way to go around processing it.
I have read one article that seems to offer a half-decent solution. I can't see any reason why the file size would make any difference to how this script performs... what do you guys think?
Also, if anybody has any other suggestions of how to deal with this file, it'd be most appreciated!
Cheers
Dave
I'm about to receive an XML document that could be anywhere between 20GB and 30GB
I've got the task of importing specific data fields from this file into a MySQL 5.0 database. I haven't dealt with a file of this size before and am slightly lost as to the best way to go around processing it.
I have read one article that seems to offer a half-decent solution. I can't see any reason why the file size would make any difference to how this script performs... what do you guys think?
Also, if anybody has any other suggestions of how to deal with this file, it'd be most appreciated!
Cheers
Dave