PHP Developers Network

A community of PHP developers offering assistance, advice, discussion, and friendship.
 
Loading
It is currently Thu Jun 04, 2020 7:18 am

All times are UTC - 5 hours




Post new topic Reply to topic  [ 3 posts ] 
Author Message
PostPosted: Thu Oct 16, 2014 12:25 pm 
Offline
Forum Regular
User avatar

Joined: Sat Mar 12, 2005 8:13 pm
Posts: 703
Location: US
I am potentially building a site for users to archive gigabytes of data at a time.

The way this would work is having a drag-and-drop space for complete archives that need to go into cold storage. These might range from a few gigabytes to half a terabyte in size. (We would also offer a mail-your-drive-to-us option.) After uploading the data, we would have a small local server poll the site, pull the data off, and put it on our cold storage system. Once properly archived and backed up, the system would remove the files from the website server, leaving only entries for the user that they had been archived. (To un-archive the data, we would have to pull it and upload or mail it to them.) So... If you're familiar with it, similar to Amazon Glacier. But on a smaller, more focused scale with a very specific market in mind.

My question is about what kind of server/hosting I should develop this on. Would someone like Bluehost have a solution available, or should I look into something like Heroku? What are my options here? And what (non-obvious) bottlenecks should I watch out for? To start this project off, I aim to develop in PHP/MySQL and, if a successful project, possibly later migrate to something else.

I would appreciate any thoughts or advice anyone has.

Thanks!


Top
 Profile  
 
PostPosted: Fri Oct 17, 2014 3:56 pm 
Offline
Site Administrator
User avatar

Joined: Wed Aug 25, 2004 7:54 pm
Posts: 13592
Location: New York, NY, US
Heroku or Cassandra (http://cassandra.apache.org/) would be the place to start. You probably want to find/write an upload manager to deal with large uploads. You also might look into various queue system or workers (e.g., Gearman) to offload time consuming processes like generating indexes, compressing archives or emailing to other servers.

_________________
(#10850)


Top
 Profile  
 
PostPosted: Thu Oct 23, 2014 9:56 am 
Offline
Forum Regular
User avatar

Joined: Sat Mar 12, 2005 8:13 pm
Posts: 703
Location: US
Thanks. Cassandar and Gearman look interesting.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 3 posts ] 

All times are UTC - 5 hours


Who is online

Users browsing this forum: No registered users and 3 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Jump to:  
Powered by phpBB® Forum Software © phpBB Group