Need to upload 50 Gigs of content!!!

[kgibson01]

I have about 50 gigs of content to upload, what do you guys suggest is the best way to get 'em on the server.

My upload speed is about 1.08mbps. I will be all month uploading. Any CREATIVE suggestions?

Thanks in advance.

[horney]

Is it your server? What sort of deal have you got?

The quickest, easiest and cheapest way if they're your people would be to copy it onto a portable HDD and get that to the data centre, so the techies there can simply transfer it for you. They should be able to put IDE on to whichever server hard drive format they're using easily enough.

Alternatives are to enquire how much it would cost for them to transfer if you sent them the HDD; and to take a cold hard look at how much of that you really need to have on the server.

There are other possible solutions. Several, in fact. Depends upon the hardware and software at your disposal. e.g. not many people use tapes now, but that's an option.

[kgibson01]

Originally posted by horney
Is it your server? What sort of deal have you got?

The quickest, easiest and cheapest way if they're your people would be to copy it onto a portable HDD and get that to the data centre, so the techies there can simply transfer it for you. They should be able to put IDE on to whichever server hard drive format they're using easily enough.

Alternatives are to enquire how much it would cost for them to transfer if you sent them the HDD; and to take a cold hard look at how much of that you really need to have on the server.

There are other possible solutions. Several, in fact. Depends upon the hardware and software at your disposal. e.g. not many people use tapes now, but that's an option.

Thanks, I also was told that I could zip the whole thing, upload to server, then unzip on the server.

I'll talk with Webair about it, but the simple solution seems to be just send the drive to them and have them transfer it to my server.

[horney]

Yes, you can zip it. I'd parcel it and do it as several zips. It's still humungous, even if you get it down to one tenth - if it's mostly pix and vids, you won't get it down anywhere near that far without ruining them.

Hey, on *nix with text, you can get it way below that and it will come out good. Just think about what you are dealing with and go from there. You could even split it between zip uploads and a hdd (or several dvd) package.

I'd send the hdd, if they can do it for you.

[Hammer]

Zipping it won't help reduce that size enough to be helpful.

video files are already compressed, uploading one 50gb file is suicide.

[kgibson01]

Originally posted by cinkciarz
video files are already compressed, uploading one 50gb file is suicide.

Its not one file...I wouldn't even know what one file could be so large! Its about 300 scenes. I'm sending the drive to webair...thanks for your help Horney.

[Hammer]

Originally posted by kgibson01
Its not one file...I wouldn't even know what one file could be so large! Its about 300 scenes. I'm sending the drive to webair...thanks for your help Horney.

It would have been one file if you followed the advice you said someone gave you to zip the whole thing up.

[horney]

Its about 300 scenes.

It would have been one file if you followed the advice you said someone gave you to zip the whole thing up.

And one very well mangled file at that, if you hadn't controlled the compression ratio, like 1:1 so not much use.

Zip is great with text and a number of other formats. Images, if created for web use, are already compressed, as cinkciarz said. Further compressing them will lower their quality and may even render them totally useless.

[crockett]

Originally posted by Hammer
Zipping it won't help reduce that size enough to be helpful.

exactly... jpeg is already a compressed format, so zipping it wont help much if any at all. As someone else posted the videos files are also already compressed.

The best bet is to send a HD with the content to your host, they have likely handeled this kinda thing before. Other wise you better start uploading now.

[kgibson01]

Sending the drive to Webair today!!! Thanks for all the help.

[kg2]

Originally posted by horney
Images, if created for web use, are already compressed, as cinkciarz said. Further compressing them will lower their quality and may even render them totally useless.

just to clarify, jpg is a lossy compression algorithm, which means that you DO lose information during the compression process. opening and resaving a jpg repeatedly will slowly and surely destroy it.

however, data compression (ie zip, tar, arc, cab, rar, etc.) is non-lossy and does NOT result in there being less and less information in subsequent generations.

using data compression on a jpg will not shrink the file size, but it won't damage the original content either.