How to move big data from a Shared hosting to a VPS?

JoeHamilton · Mar 3, 2016

I could not compress all files in Public_html folder because it was 5GB of data and it made my browser interrupted any time or stopping the process...I used compress function in cPanel.

For moving files from a VPS to a VPS, I can use this command via SSH

Code:

zip -r myfilename.zip * .htaccess

and it worked as well. But for a shared to a VPS then it was impossible, are there any fast ways to move big data from a shared to a VPS?

Any suggestions?

Developer · Mar 3, 2016

Having a few sites well in excess of 10GB (digital downloads, etc.), I always
found it best and quickest to compress folder by folder... This way, I could
even relocate folders as necessary...

You COULD do several folders per compressed file as well... It will take a little
longer, however, it will ensure you don't miss any files either.

Also, is there a specific reason you are "zipping" your files? I always use tar.gz
compression as I always found that to give better results (smaller file size).

Ron Killian · Mar 3, 2016

An even easier way would be to have your host move your stuff for you. If you have a quality host, they should be more than happy to do it for you.

My last move, my new host moved EVERYTHING for me, including cpanels, login's, ect. Over 100 gig and many, many, many files. Over 150 DB's as well.

Just my thought

ElixantTechnology · Mar 3, 2016

Do you have a control panel on the VPS, if so this is a very easy task. Otherwise, it can be a bit more difficult and without direct access (ssh) to each server you will have to do things the long way.

JoeHamilton · Mar 3, 2016

Developer said:
Having a few sites well in excess of 10GB (digital downloads, etc.), I always
found it best and quickest to compress folder by folder... This way, I could
even relocate folders as necessary...

This is not easy if you have a folder 4GB and 50 folders with 1GB...it still needs a new solution.

Ron Killian said:
An even easier way would be to have your host move your stuff for you. If you have a quality host, they should be more than happy to do it for you.

My last move, my new host moved EVERYTHING for me, including cpanels, login's, ect. Over 100 gig and many, many, many files. Over 150 DB's as well.

Just my thought

Yeah I submit ticket but as my experience, they could send me a download link around 3 to 4 days while I could not wait that.

ElixantTechnology said:
Do you have a control panel on the VPS, if so this is a very easy task. Otherwise, it can be a bit more difficult and without direct access (ssh) to each server you will have to do things the long way.

Of course, I have cPanel and they guided me to click on Backups icon to do a full backup but it failed more times...so I am finding other ways.

Ron Killian · Mar 3, 2016

Well, I hope this is to move away from that host. Though you probably don't want to hear it.

With all the hosts here, sure some one will come up with a good solution.

Developer · Mar 3, 2016

JoeHamilton said:
This is not easy if you have a folder 4GB and 50 folders with 1GB...it still needs a new solution.

1 GB folders would compress to movable size chunks. It is VERY doable, I have done it many times in the past.

JoeHamilton said:
Yeah I submit ticket but as my experience, they could send me a download link around 3 to 4 days while I could not wait that.

So, instead, you'll spend days on here looking for a solution? Why not just get it started and "get er done"? NOT trying to be sarcastic, just saying...

JoeHamilton said:
Of course, I have cPanel and they guided me to click on Backups icon to do a full backup but it failed more times...so I am finding other ways.

Another way would be, as I initially said, compress into tar.gz files and then using shell access and "wget" on the new server to grab the files from the old server.

1. If you have shell access on the OLD server, run ulimt -a to see if there is a file size limit
2. Run ulimt -a on the NEW server to see if there is a file size limit
3. Compress each folder on the OLD server making sure they do not exceed the limits

NOTE: Make sure all *.tar.gz files are in a publicly accessible folder ( www.old-server-domain.com/filename.tar.gz )

4. Make a list of all the files you just created and name the file list-of-files.txt
5. Upload the list-of-files.txt file to the new server
5. Run wget â€â€input list-of-files.txt on the new server
6. Uncompress and move on (file permissions and directory structures will remain intact)

How to move big data from a Shared hosting to a VPS?

JoeHamilton

Well-known member

Developer

Well-known member

Ron Killian

Well-known member

ElixantTechnology

Well-known member

JoeHamilton

Well-known member

Ron Killian

Well-known member

Developer

Well-known member

Latest posts New threads

Latest posts

New threads

Latest Hosting Offers New Reviews

Latest hosting offers

Popular Contributors - Past 30 Days

Sponsors

Tag Cloud