Showing posts with label Proxmox. Show all posts
Showing posts with label Proxmox. Show all posts

05 November 2012

subject to change

/TECH
Tech changes a lot. A generation in technology is often only a few months to a couple years long depending on which technology you're talking about. In the case of servers, it's more often a couple years. This is because servers are supposed to be a more consistent resource, constantly providing data or services. But for me, servers on Doppelganger are more often going to be talked about at the month level of iterations. Here's a quick rundown of the various appliances and VM's I have running on Doppelganger, my Proxmox Virtual Environment:
  • Amarok
    Service: Plex Media Server
    Allocation: 2 cores, 2GB memory, 20GB storage
    Status: running, rarely used
  • Balrog
    Service: Minecraft server
    Allocation: 2 cores, 6GB memory, 8GB storage
    Status: offline, merged to Gryphon
  • Faoladh
    Service: LAMP for developing a Dungeons & Dragons character tracking web app
    Allocation: 1 core, 1GB memory, 10GB storage
    Status: running, not used
  • Gryphon
    Service: Minecraft server and Tekkit server
    Allocation: 3 cores, 8GB memory, 8GB storage
    Status: running, frequently used
  • Kitsune
    Service: WordPress
    Allocation: 1 core, 512MB memory, 4GB storage
    Status: running, untested
  • Naga
    Service: Ubuntu 12.04 server
    Allocation: 2 core, 6GB memory, 6GB storage
    Status: offline, waiting re-purposing
  • Raven
    Service: TeamSpeak
    Allocation: 1 core, 2GB memory, 8GB storage
    Status: running, frequently used
  • Siren
    Service: Icecast
    Allocation: 1 core, 512MB RAM, and 10GB storage
    Status: offline, not working
  • Warg
    Service: Windows 2008 R2 Server running Terraria server
    Allocation: 2 cores, 8GB memory, 32GB storage
    Status: offline

At the beginning of summer I had an idea and an overly simple plan that allowed for exploration. I never imagined I would have all the things above set up and I'm still exploring different possibilities of things to do. Looking back I now see a trail of projects--some working, some failed, some in between--and a series of decisions that were made on a thought. Naga had a very short lived purpose to serving as a remote platform for a friend to finish a school assignment. I set it up in about 30 minutes. It still sits in the list of servers hoping to someday become something else. Balrog had a long-term plan, but has since been incorporated into Gryphon, a more stable appliance. I maintain a spreadsheet online with a list of all the computer names I'm using or might want to use, what purpose that machine might serve, and various details about ones that are in use such as IP address and machine number. There are a lot more names on that list than I gave here, some of them being the names of my personal computer (Phoenix) and other active devices, some being undetermined, and some being machines that will be setup in the future.

Perhaps the most interesting machine on my list is the one that sits at the top and has never been implemented in any way but has gone through the most iterations: Cerberus, my eventual router and firewall. Although its name and eventual IP have never changed, my ideas of how it's to be implemented have been in constant flux. And unlike most of my machines that are virtual, Cerberus has to be a physical box to be its best. The hardware I want to use for it has gone from using an old Pentium 3 or 4 with 3 network adapters, a 24-port switch, and a wireless access point to buying a specialized integrated device that minimizes power consumption and physical space requirements. My thoughts on Cerberus could be an entire post for that matter and probably will be one when the time comes that I finally build it.

In the end, I discovered that my initial plans weren't that good and that there was a better way. I now have an asterisk next to the whole plan that refers to a footnote stating: subject to change. And in the end this was and is the best way to approach Doppelganger.

Until next time:
Work hard. Play harder.

30 August 2012

failed to start

I would first like to apologize for my tardiness on this entry. I've been a bit busy at work and when I get home I have often been collapsing into a chair and watching old episodes of Top Gear UK. And now without further ado, my entry...

/TECH

"Failed to start"
This is an error that SharePoint workflows give sometimes. But unless you dive into some deeply buried log file, it gives you nothing else. Absolutely nothing. So we've developed a list of things to check when we receive this wonderfully informative error: check all referenced fields to make sure they're being published; confirm email addresses; make sure it gets some kind of data; clear your SharePoint Designer website cache (hate doing this); and confirm your username has been changed on that site. It was this last one for me on the most recent failure. You see, in May I went from being a student worker here to a regular employee. This meant that a lot about my account changed.

Speaking of changes and failures, another recent change caused some problems on Doppelganger. As stated last time, one of Serenity's hard drives gave up the ghost and took several of Andy's services with it. So he kindly setup backups on Doppelganger for me. I was quite grateful. The morning after the first backup ran I noticed a problem: only my Mumble server was running. Apparently I wasn't diligent enough with getting my startup scripts working properly and thus TeamSpeak and both Minecraft servers never started up properly. These have since been remedied.

I've also been trying to remedy Phoenix's performance issues. My poor personal computer is having a terrible time keeping up with the things I throw at it lately. It isn't that the hardware is going bad, or that Windows needs to be cleared, it's that my demands of performance have been increasing. One of those performance demands is actually with Minecraft. For what ever reason, the incredibly simple looking Minecraft requires a ton of resources. But the old Athlon 64 X2 with its paltry 6GB of RAM (not that paltry actually) just doesn't like running it. Then there's the games that actually justifies the need of high performance hardware.

So after having run Doppelganger on my newer, beefier hardware for a while, I've noticed something: it benefits greatly from the greater amount of RAM but not as much with the CPU. I could better utilize the CPU if I ran more process intensive servers. But the fact is I'm quite content with TeamSpeak and one Minecraft server. If I just rein it back to just the two services. I think I'll keep Proxmox, but I think consolidating services is a good idea.

It now comes down to, where do I want my hardware? I could purchase new hardware leaving Doppelganger as it is, but I'd rather purchase a tablet next. In fact in addition to wanting the tablet, I want to run a media server so that I can then stream my personal media to the device along with being able to use my various subscriptions. Having a tablet would also allow me to leave my computer and PS3 off too, thus reducing my power consumption and heat production.

Well, I'll have to consider those things while I'm on vacation and perhaps I'll have some things done in this vein by September 10.

Until next time:
Work hard. Play harder.

13 August 2012

exercise

/TECH
I went to move a temporary Minecraft server to a permanent home on a Linux VM and I realized, I couldn't remember how I setup Balrog (my original Minecraft server). It took me longer than I anticipated to set up the new server, Gryphon to act as our survival mode Minecraft server and thus I was up until 2am last Friday night/Saturday morning. But I did it much cleaner than my setup for Balrog. In fact, Balrog needs to get an upgrade to a 64-bit OS so that I can allocate more RAM to it.

So yeah, I realized that since I've been slacking off on my Linux skills, I have once again lost them to a certain degree. Now, it was much easier to find reminders this time since the knowledge was already in my brain but just not accessible. What probably took me 6 hours the first time took a mere 2 hours the second time. And I presume that now that I have a few tricks up my sleeve and haven't taken quite as much of a vacation from it, I should be able to rebuild Balrog in a quick 30 minutes.

My friend Andy, who is way better with Linux than I am, is the one who got me into Proxmox and has a server of his own. In fact it was his project and encouragement that inspired me to set up my server. He sadly informed me today that the 300GB hard drive in Serenity (his Proxmox server) died and took with it several of his virtual machines. He lost his blog, FOG server, his brother's Minecraft server, and I think one other service. A moment of silence for the lost bits. ... ...

But his loss has inspired me once again, and this time it will be a collaborative effort between us. Of course my first question was if we needed to obtain some new hard drives. The answer was of course "yes". So hopefully by the end of the year both of us will have obtained at least one of Western Digital's new Red drives. These drives are designed to be used in storage systems and run 24/7. At said point, or perhaps before, we will also endeavor to set up a back up system between our servers. Doppelganger will back up all critical files to Serenity and vice-versa. Once we accomplish this, our data will be more secure. Eventually we will probably even have them synchronize our storage drives. It's win-win.

/EXISTENCE
My blog entry isn't just about exercising our knowledge however, as I have recently set out to get more physical exercise. I need this too as I have reached too many extra ranks in circumference recently and need to lose those ranks. And like my Linux skills, if I slack off I lose the benefits of exercise. So here's my goal: to walk for fitness 1 mile everyday. So far I'm walking about to every other day. In fact I need only about 17 minutes for the actual walking. And my new Saucony shoes mean my feet won't be crying at the end.

Until next time:
Work hard. Play harder.

30 July 2012

digging

I did a little bit on Doppelganger last week, namely setting up Warg which is running Windows Server 2008 R2. But most of my tinkering has been at work with a form and on Balrog playing more Minecraft.

/TECH
But let's talk about my tinkering at work first. I need to begin by describing a form that I'm working on migrating from SharePoint 2007 to SharePoint 2010. The form in question deals with allocating a funds to an employee for cell phones. As such, the form needs to be able to do several things right off: recognize the employee filling out the form (that's easy); query a list of current allocations and find all that pertain to said employee (hmm... okay); and check to see if the employee has submitted any forms for allocations during the current fiscal year (right).

The first part requires using the userName() function and then querying the user profile service to get their name and ID number. No problem.

The next part requires finding all the current allocations for the employee queried. All current allocations sit in a custom list which is easy enough to get to with a data connection, but how does one get just that employee's entries? Well with SharePoint and InfoPath 2010 it is now much easier to query list data connections that you receive data from. So by creating some rules that trigger on Form Load I set a field in the connection to equal the employee and then tell the form to query the connection. Boom! List of lots of allocations is now just 0 to 2 entries. This short list gives me information about each allocation along with how many allocations an employee already has. The form then presents pertinent information to set up a new allocation, update a current one, or renew an expiring one.

The last trick actually requires receiving data from the very library submitted to. This action allows us to see what other forms the employee has already submitted. But we only want to see ones submitted in the same fiscal year. Like the current allocations query, we query the forms library using the employee and also add in the fiscal year we want.

It's interesting to note that when I first modified and expanded this form that the data connection would return ALL information in the list or library and we used filters via rules and default values to get the information desired. When I looked at it this time, it just didn't make much sense to do it that way. It also helped that every one of those default values exploded in the conversion from 2007 to 2010.

Overall, I have to admit that I like SharePoint 2010 much better than SharePoint 2007. There are a few things we've had to adjust, some more annoying than others. For instance in InfoPath 2007 you could set a rule to check a condition and then do nothing except prevent any further rules from running. InfoPath 2010 doesn't allow this, but rather then just marking the rule as invalid it completely removes it without a trace. This is but a small pain though in comparison to the benefits that 2010 offers, like having a data connection sort the data returned by the field you specify. Drop-downs are now alphabetized even if the ID numbers of the queried data are out of order. The fact that data connections also have a separate set of "fields" for querying is also incredibly useful and is what inspired my recent redesign of the form mentioned above.

/EXISTENCE
As I mentioned in my intro, I haven't done much on Doppelganger recently except get one VM setup. It has really been running smoothly and I hardly have needed to mess with it since getting things set up. I guess I did move my TeamSpeak server to a new container called Raven where I now also run a Mumble (Murmur) server. But it wasn't hard and I didn't really learn much.

What I have noticed however, is that I get home from work in varying degrees of worn out--mildly to exhausted--and frequently just want to relax and not think about much. Enter Minecraft. Though it can be a very deep game with basic computer architecture simulation ability using redstone, it can also be one of the most mindless experiences out there.

It's such a strange game in that regard. it just places you near the center of 60 million square meters of blocks with a max build height of 256 meters and says, "Do something." At first you just stand there going, "WTF?" Then you move around and try punching something. You collect some dirt. If there are animals around, you might punch them a bit. Then you punch a tree and get wood. Eventually you're building a replica of Neuschwanstein castle before you come out of your stupor realizing you just spent 3 days of your life playing a game. All at once. Even forgetting to eat or sleep. (I'm exaggerating, but only a little.)

Only just today have I come up for air and realized that I need to get off my butt and get some exercise. At an embarrassing but not ungodly weight I realized that work is not going to get me moving around, rather it will keep me firmly planted in front of a computer so that I can earn strange pieces of paper-fabric which I can trade for silly and entertaining things like Minecraft, which is just more sitting in front of a computer. So today I actually went for a walk after work and managed to make it nearly a mile in 18 min. I don't know how many calories I burned, but I have a new sense of accomplishment and have set a goal down to get to 190 lbs again.

Until next time:
Work hard. Play harder.

18 July 2012

expansion

/PERSONAL
I'm a little late posting this entry, but I've actually been quite busy recently and when Monday evening came around all I wanted to do was relax. Even now, two days later I'm tired and kinda want to go back to bed. But today is a special day and I decided that I needed to get stuff done, this being one of those things on my list. Now on to the tech talk that I normally spout.

/TECH
After some deliberation about where my best hardware should be I finally decided to put my better hardware in Doppelganger. So as part of my Independence Day festivities I took down Doppelganger and Phoenix and swapped their hardware. I made backups of Pegasus (my current TeamSpeak server) and Balrog storing them on my external HDD. At first I thought I'd just swap the HDDs between the cases, but then I remembered a critical detail: my video card, the only part not going in Doppelganger, doesn't fit in one of my cases. Motherboard switch it was! Later I realized another small detail that the Sabertooth 990FX motherboard doesn't have on-board video. Low-powered NVidia video card to the rescue once again! I always knew it was good to keep that.

Now Doppelganger has a beautiful rich-featured motherboard, a quad-core AMD FX processor, and 16 glorious GB of DDR3 RAM. I'm especially happy about the RAM. Eventually I'll get another server named Raven setup where it will automatically boot with Doppelganger and launch TeamSpeak Server, Ventrilo Server, and Murmur Server giving me and my friends a full range of voice-over-IP choices. Balrog is happily running along with several scripts I wrote to help me manage it more easily including a pretty sweet update script that downloads the given update, replaces the server jar, updates the message of the day in the server settings, and automatically restarts the server. But between the two VMs I'm hardly utilizing Doppelganger. There must be more. More! MOAR I SEZ! …ahem… Sorry, I devolved for a second there.

After a recent gaming session in EYE: Divine Cybermancy with friends, I decided I needed to setup another dedicated server for the game. It's pretty awesome and it's a Source engine game. Since Source engine games can be run using the same dedicated server application I realized that I could get it running using a Linux server. Since the Source engine is made by Valve and published to the Steam platform, I decided that my Source engine dedicated server would be named Golem. Sadly, I have not spent the time getting it running yet and really need to experiment with the Source dedicated server before I jump into running it on Linux.

My real next task is to setup two VMs for experimentation. One will be a Linux playground and the other a Windows playground. With so many distros of Linux, I'm not sure which flavor I'll use, but I'm thinking just a standard one, like Debian. Windows I have fewer choices, but it tends to be more of a hog and so I'm not sure which version I'll install. Anyway, once those are installed I'll make snapshot backups of each and then I can experiment on the system and mess it up as much as I like. And if I can't fix them, I can just restore from the snapshots.

Besides the Source dedicated server, I've thought about playing with include a private Internet radio server, DNS server, file server, web server, and a SQL server. I'm also hoping that I can buy some large capacity HDDs within the next year to put into Doppelganger and expand the storage to ridiculous sizes. If you have any ideas of what I should experiment with let me know in the comments and I'll see what I can manage.

Until next time:
Work hard. Play harder.

02 July 2012

doppelganger

/TECH
Doppelganger lives. It is quite gratifying actually, to finally have a server that I can run a combination of production systems as well as test systems on. Proxmox is a sweet system. The Linux based hosting environment is quite powerful and comes with my favorite price tag of free. Currently Doppelganger is running two other systems constantly: Pegasus and Balrog.

Pegasus is my current system for hosting TeamSpeak, but I'm trying to get it moved to another system called Raven. The reasoning behind this is that Pegasus is currently setup as a VM whereas Raven is setup as a container. The difference between the two is that a container is more isolated thus increasing security plus they are way easier to manage. Eventually I'll figure out my hang ups on Raven as I'm also trying to set it up to auto start TeamSpeak. I also hope to install both Murmur (Mumble server) and Ventrilo server applications on Raven so that I can have a more complete voice conferencing solution.

I thought Balrog was an appropriate Minecraft server name. Yes, I play Minecraft and I've dedicated a ridiculous amount of effort to maintaining the dedicated server for it. One of the things I've distinctly learned about Minecraft is that it likes RAM. It likes a lot of RAM. I've caught it using 1.5GB of RAM on my computer several times. It also likes a decent CPU speed, fast upload speed, and fast download speed. As it stands, I can only have about 5 people logged into my server simultaneously. But it's loads of fun and often worth the effort.

My first week with Doppelganger has been good, but I've discovered that the hardware I'm running it on is a bit… lacking. As a result I've been looking for ways to upgrade it without spending additional money. Solution: swap my hardware from Phoenix, my personal computer, to Doppelganger. This would then net me a much more powerful machine for the server but set Phoenix back a little. All in all, I think it will be worth the effort to swap the hardware to result in a more stable virtual environment.

It's good timing to do this transition right now too. Phoenix is having issues lately and Windows needs to be re-installed. Yeah, when your computer can't find Google.com, you know there's a problem with either your service, your router, or your computer, and since all other devices were connecting to the Internet just fine, it's the computer. So Phoenix will once again die and be reborn. Phoenix will take a step back in performance, but ultimately it will be better. Once I settle on hardware, I'll post the specifications.

Until next time:
Work hard. Play harder.