How to move big data from a Shared hosting to a VPS?

JoeHamilton

Well-known member
Registered
Joined
Aug 29, 2013
Messages
111
Points
18
I could not compress all files in Public_html folder because it was 5GB of data and it made my browser interrupted any time or stopping the process...I used compress function in cPanel.

For moving files from a VPS to a VPS, I can use this command via SSH

Code:
zip -r myfilename.zip * .htaccess
and it worked as well. But for a shared to a VPS then it was impossible, are there any fast ways to move big data from a shared to a VPS?

Any suggestions?
 

Developer

Well-known member
Registered
Joined
Dec 21, 2015
Messages
292
Points
43
Having a few sites well in excess of 10GB (digital downloads, etc.), I always
found it best and quickest to compress folder by folder... This way, I could
even relocate folders as necessary...

You COULD do several folders per compressed file as well... It will take a little
longer, however, it will ensure you don't miss any files either.

Also, is there a specific reason you are "zipping" your files? I always use tar.gz
compression as I always found that to give better results (smaller file size).
 

Ron Killian

Well-known member
Registered
Joined
Dec 3, 2015
Messages
363
Points
0
An even easier way would be to have your host move your stuff for you. If you have a quality host, they should be more than happy to do it for you.

My last move, my new host moved EVERYTHING for me, including cpanels, login's, ect. Over 100 gig and many, many, many files. Over 150 DB's as well.

Just my thought :)
 

ElixantTechnology

Well-known member
Registered
Joined
Nov 26, 2014
Messages
281
Points
43
Do you have a control panel on the VPS, if so this is a very easy task. Otherwise, it can be a bit more difficult and without direct access (ssh) to each server you will have to do things the long way.
 

JoeHamilton

Well-known member
Registered
Joined
Aug 29, 2013
Messages
111
Points
18
Having a few sites well in excess of 10GB (digital downloads, etc.), I always
found it best and quickest to compress folder by folder... This way, I could
even relocate folders as necessary...
This is not easy if you have a folder 4GB and 50 folders with 1GB...it still needs a new solution.

An even easier way would be to have your host move your stuff for you. If you have a quality host, they should be more than happy to do it for you.

My last move, my new host moved EVERYTHING for me, including cpanels, login's, ect. Over 100 gig and many, many, many files. Over 150 DB's as well.

Just my thought :)
Yeah I submit ticket but as my experience, they could send me a download link around 3 to 4 days while I could not wait that.

Do you have a control panel on the VPS, if so this is a very easy task. Otherwise, it can be a bit more difficult and without direct access (ssh) to each server you will have to do things the long way.
Of course, I have cPanel and they guided me to click on Backups icon to do a full backup but it failed more times...so I am finding other ways.
 

Ron Killian

Well-known member
Registered
Joined
Dec 3, 2015
Messages
363
Points
0
Well, I hope this is to move away from that host. Though you probably don't want to hear it. :)

With all the hosts here, sure some one will come up with a good solution.
 

Developer

Well-known member
Registered
Joined
Dec 21, 2015
Messages
292
Points
43
This is not easy if you have a folder 4GB and 50 folders with 1GB...it still needs a new solution.
1 GB folders would compress to movable size chunks. It is VERY doable, I have done it many times in the past.

Yeah I submit ticket but as my experience, they could send me a download link around 3 to 4 days while I could not wait that.
So, instead, you'll spend days on here looking for a solution? Why not just get it started and "get er done"? NOT trying to be sarcastic, just saying...

Of course, I have cPanel and they guided me to click on Backups icon to do a full backup but it failed more times...so I am finding other ways.
Another way would be, as I initially said, compress into tar.gz files and then using shell access and "wget" on the new server to grab the files from the old server.

1. If you have shell access on the OLD server, run ulimt -a to see if there is a file size limit
2. Run ulimt -a on the NEW server to see if there is a file size limit
3. Compress each folder on the OLD server making sure they do not exceed the limits

NOTE: Make sure all *.tar.gz files are in a publicly accessible folder ( www.old-server-domain.com/filename.tar.gz )

4. Make a list of all the files you just created and name the file list-of-files.txt
5. Upload the list-of-files.txt
file to the new server
5. Run wget ‐‐input list-of-files.txt on the new server
6. Uncompress and move on (file permissions and directory structures will remain intact)
 
Latest Threads
Recommended Threads
Similar Threads

Latest Hosting OffersNew Reviews

Sponsors

Tag Cloud

You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an alternative browser.

Top