NAS or 'server'?

[AraiBob]

Hi,

I have parts for a complete pc, including the case, and my intent is / was to put 12 hard drives in it from my existing 'piles' of USB backup devices (each holding 4 drives).

As I looked at different NAS systems, they all have a few things I don't like.

a. If you put a drive in the 'box', it is immediately overwritten. Never mind it already has the data.

b. It looks like the drives are always busy. e.g., the drives will die an early death.

c. It requires that all drives be the same size. [Not quite true, but any drive too large is not used to its full capacity].

d. adding a new drive to an existing system is made difficult, and you are likely to lose all the data already on the drive.

Lists of suggested OS and Filesystem choices are welcome. I have already looked at a bunch over the last two years, and I am not impressed.

Best regards, AraiBob

 

[YouWhat]

There is a myriad of choices out there, Amahi, Freenas, OpenMediaVault, NAS4Free, Windows (of various different flavours), Linux (of various different flavours also)

It depends on what and how you want to use the system, whether you plan on running it headless or not, whether or not you want external access to things eg streaming and ftp etc......

***EDIT***

A lot of you choices also depend on your knowledge level also, for example, you aren't going to be setting up a linux server with absolutely no knowledge of linux systems and commands.....

 

[TheDuke]

AraiBob

FreeNAS is a good choice IMO, as it Support ZFS file system.

A easy setup guide can be found here.. for yourself or for people trying it out for the fist time.

it's a old setup guide but the same principles apply for the up to date version.

http://www.howtogeek.com/190835/how-to-turn-an-old-pc-into-a-home-file-server/

 

[AraiBob]

YouWhat and TheDuke,

I am looking for someone 'else' who has considered the issues I bring up.

I have looked for 'unbiased' reviews and they are few are far between. It looks like the selection is based on 'history' [I have always used Windows, therefore I will use WIndows], or on 'faith' [ZFS is the best new thing, and I believe in it].

I am not a Fortune 500, eager to replace dead drives with my [not] unlimited budget. I saw a great speach in YouTube called "Open Storage Solutions at SpiceWorld 2010" in which the speaker tore up the high priced systems using 'ordinary, of the shelf' servers. I liked his descriptions and comparisons. Unfortunately, I don't know where to get the specs on what they actually did.

While I have used servers at work, I have never had to create and maintain one. I have a lot of experience with systems and programming, but this is a skill I did not have to acquire on the job.

A few years ago, I dumped Win 7 Ultimate, in favor of Ubuntu Linux. I love the fact that I don't have to worry about viruses, including those problems created by Windows Update! Each time I upgrade, I actually install from scratch, as it lets me make specifications based on what I learned the last time forward.

So, I am leaning towards a Linux Server (Ubuntu), with the zfs file system, but, but, but. I am looking for reliablility and safety of my data, but I don't like having the hard drives busy, doing nothing for the user [me]. I have adequate hardware to do the job, but continue to dither on the OS and FS, etc as I don't really want to experiment. Perhaps, I should experiment, then report back?

In addition to being a better backup (via the ethernet I have in the house), I want it to also 'serve' up music and videos to the 'crowd'. I have converted nearly all of my DVD's to video files and have been viewing them via Media Players for 3 years. Fabulous, no changing dvds just to watch a different movie, or episode. But this means I have at least 2 copies of every file. one on my main pc, my backups, and the USB drive used to show the movies via the media player (A C Ryan's Playon).

Guesses, advice, and actual experiences would be fabulous for me to consider and ponder. Yes, I do that.

 

[YouWhat]

Based on what you have said, I would recommend Ubuntu Server with desktop and Plex added on to it for streaming you media content.

If you want a basic Ubuntu server setup guide for the above, I can post you one on here.

 

[AraiBob]

YouWhat?

I have looked at a few 'installation' guides. YouTube, does the most basic, and without making any changes to the default. I assume I will have to change the default. I have also searched the Web and found a few install guides there, too. Also, most basic.

I appreciate any help, in knowing what 'non basic' options I should specify.

I have a whole PC available, including keyboard, mouse, and monitor. I just have not replaced the Motherboard, memory, etc. When I upgraded my main pc, I took the parts and put them back into their original boxes. An Intel I7-870, Asus motherboard, etc. Overkill for a lightly loaded server, but since I have already paid for it, good.

The case is the Antec 1200. So I should have plenty of room for all the drives I intend to put in. As I noted, my quandary has been what OS and filesystem. Perhaps I should stick with EXT4 as the file system?

 

[YouWhat]

I would personally stick with the EXT4 on Ubuntu as that will be the easiest for you to get to grips with if any issues occur.

I will knock something up (I got most of it in a script I use on few servers I run for a few sites so will just edit it into a step by step copy and paste guide for you)

 

[AraiBob]

YouWhat?

Thank you for the non-standard hints for the installation of Ubuntu Server. Greatly appreciated. Staying with EXT4 allows me to mount my drives without 'reformatting, etc'.

But, it looks like I need some PCI card(s) for the connecting of the many drives, as the motherboard only has 6 SATA connections.

I intend to let the android tablets in my home, already signed onto the wireless router, to get access to the music and videos, and pictures.

I use VLC on my main pc, and I am happy with it. It has options for streaming, but does it have a version for the Android?

OR... should I consider some other streaming product (free). Tiny Tom talks about Flex, and it does look good, but it is not completely free. I have also seen videos and writeups about XBMC. Do you have a suggestion?

Many thanks, AraiBob

 

[YouWhat]

VLC has a beta that has been running on Android for a while now which is fairly stable (I've have no issues with it), but for streaming, I personally use Plex myself like Tom and many others here.

Plex might not be completely free, but for your uses, you will only need the Plex app on android and the rest of it will be free (I have Plex Pass as I also use cloud storage), but if you are unwilling to pay, with android you don't need to do anything to it to install a paid or cracked app, I'm not advocating you do this (but if you are going to do it anyway then I am unable to stop you, but a quick google search will find the apk for you).

The server part of the Plex system, runs on windows, linux, nas boxes, Macs and more besides, you just point it to folders where your media is stored, it will scan through and index them, once you have setup the app to sign in to Plex website, you can then access your media anywhere where you have internet connection (most people get problems with port forwarding with this and firewalls that don't auto detect it's a safe app to let incoming requests).

My kids live over 100 miles away with their mother and frequent my server through XBox, PC's, iPad, Android Tablet and even iPhones, as well as my dad, he access stuff on there also through his laptop, and so does my other half and her gremlins when they are out and about, and also whilst at home.

I can't recommend Plex enough to people, its just whether it's for you or not, some people prefer XBMC, but setting up external connections is more of a pain in the rear on that platform as it not an automated thing like Plex is. Plex also has User restrictions in it which is brilliant to stop the kids access the films (18+) they shouldn't and also for some people, to hide their porn collection away from those they don't want to see it

At the end of the day though, the choice is yours, and what you are more comfortable in setting up and using.

 

[AraiBob]

YouWhat?

Thanks for the great recommendation. I have begun my research and analysis of Plex. I saw it is a split from XMBC, which has changed its name recently.

Looking forward to the installation in which the necessary options / changes from the 'usual' are noted.

AraiBob

 

[AraiBob]

major hickup. renaming files?

YouWhat?

I just got a rude awakening. In order to use PLEX (and probably others) I would have to rename almost every directory and file. Annoying, and tedious, at best.

Just in the PG type movies, I have 7,500 files, in these main directories: Movies (in which the latest movies and tv episodes are put for easy finding. PG1 and PG2. PG1 has movies starting with the letter a, thru movies starting with letter j, ignoring filler words like 'the' 'a' , etc. PG2 has movies starting with letter k, thru z. Movies starting with a number, are treated as if spelled out.

TV series are kept in PG1-TV and PG2-TV, split like the movies.

I also have a set just for the kids, /Kids,
and since the house also like Indian movies /India

Under each root / major name, is a set of directories for the alphabet. /a directory under PG1 holds movies like After The Sunset (2004.mkv notice the absence of the trailing parenthesis.

I also separated Science Fiction into separate directories, of similar form.

In the music category I have major directory names like /Blues /Country /JazzVocals /Lounge and more.

The Renaming of all these files, will take weeks. Yes, I know about renaming tools. I like and use PyRenamer. I consider it a necessary tool. But renaming just the Pop music directories holding over 40,000 files is a daunting task.

Further, To help find things, I put videos I have related to the artist in the same directory. Finding the movie "Two Sticks and a Drum" about Mick Fleetwood, could be a challenge without it being under /FleetwoodMac/videos directory.

Is there a better way? Do all 'media' servers have the same restrictions? Is there an option in which I can specify my own directory and file naming convention?

Best regards, AraiBob

 

[YouWhat]

Unfortunately you have come across the major downside to things, every system will have the same issue as they can't checksum the files, as they are your own conversions etc.

 

[AraiBob]

Unfortunately you have come across the major downside to things, every system will have the same issue as they can't checksum the files, as they are your own conversions etc.

Yes, they are my own conversions. I have used a number of DVD conversion tools over the years., Same with CD rippers.

So, this means I don't want / need checksums that are compared to outside content holders. Some files have the subtitles within the main movie file, others have .srt files, and others some other subtitle file system.

So, if FLEX is out, what is my 'next' choice?

AraiBob

 

[YouWhat]

Yes, they are my own conversions. I have used a number of DVD conversion tools over the years., Same with CD rippers.

So, this means I don't want / need checksums that are compared to outside content holders. Some files have the subtitles within the main movie file, others have .srt files, and others some other subtitle file system.

So, if FLEX is out, what is my 'next' choice?

AraiBob

XBMC, Plex, Windows Media Centre, they will all produce the same results, short of going through renaming your entire catalogue of things, the other option is to just put up with the files not being recognised and just played as is, there is no other way around it I'm afraid.

 

[AraiBob]

If I understand your posting, you are saying I do NOT need to rename.

This implies that people will have to 'navigate' to the movie or tv program they are interested in?

Renaming would allow searching?

If I could rename, over time, the task would not be so annoying. Is that your contention?

Regards, AraiBob

 

[YouWhat]

Renaming the files would allow for searching and the information on the video, for example it will pull up the episode information for 24 season 8, episode 6 (if that is the relavant video), and display a brief description of the episode and it will pull the information off the video itself of how it is encoded.

Below is example off my Plex server....

The main menu for server and web based login.

Below, an example of TV series episode

or as below, even a film...

That is what you see on the server and web based version of the Plex app, and also on the mobile device versions of the app (whether that is on a tablet or mobile phone).

Here are couple of examples of Plex app on my Nexus 7

And here is one of the films selected...

As you can see, having the files named properly enables the 'Extras' also for films, which are the out-takes, interviews, trailers etc and also simplifies and enhances the whole experience of using it for the end user.

The entirety of my Plex library spans several hard-drives and TB as probably does several other peoples on here, and I personally can't imagine how hard it will be to go through and rename all the files on my computer, but I know that the benefits of doing so greatly improve the experience.

 

[AraiBob]

Not quite what I need...

Hmmm.

Those display features are not what I need. or want.

I am using A. C. Ryan's Play On media players today. I plug in usb drives with the files in the form and order I described earlier. The media player has software that would do things for me, if I allowed it to.

It would go to the internet and download torrents... Originally, I had a ISP max of 200 kbps. Now it is max of 5,000 kbps. never connected it to my network. and will not, ever.
It would 'index' all the files - never stops scanning the hard drive, so I turned off this feature.

What I was looking for was a way for wireless things, like android tablets, to get to these programs and music, via the network I already have. Now that I have 'dug into it', it seems that Plex and Kodi do far more than I need. And demand I completely rename every file and directory. Not helpful.

I am back to 'server' with the files on hard drives that people can navigate through. got any ideas on that one?

 

[AraiBob]

Looking at Serviio, comments?

All,

One of my issues with Plex is its reported failure dealing with subtitle text files (.srt). These are important in my household.

I have continued looking and it appears Serviio handles this specific issue better.

Thanks, AraiBob

 

[Wombycat]

AraiBob

I am exactly in the same boat as you. I have a similar way that my media is sorted that has the same problem as you when using plex, xbmc/kodi. After a while of searching i just gave up and setup my NAS using cifs and search by folder on the device that i want to watch/listen on. I'm sure there are some people rolling eyes at that statement. Short of that i don't think I have any options other than rename my media, which I am slowly doing. I will be watching this thread closely hoping that a solution or even somewhat mild solution is possible.