Sumo Logic Makes Logs Fun

Ok that title may be a bit much but anything to make sifting through logs is a good thing in my book. I’m trying out Sumo Logic as my new log aggregator, not that I’ve had one before, but it’s been on my list of things to check out for a while now. So far… Read more »

Lambda deployed in VPC

Here’s another gotcha that I discovered for myself this week. When you deploy a lambda in your vpc it uses up an IP address whenever it runs. If your lambda runs more than one instance at the same time it will use up multiple IP addresses. As you can guess with a heavy used lambda… Read more »

Elasticsearch: Round Two

So round two of Elasticsearch fun, my previous attempt was to use users and roles to secure Elasticsearch but that didn’t work as I’d hoped…. My plan was to use nginx to proxy reqests to elasticsearch. I setup a nginx box with an elastic IP and then configured elasticsearch to only allow access from that IP…. Read more »

Securing AWS ElasticSearch

So this was a fun problem, ElasticSearch on AWS in it’s current form is completely public and not secured within my VPC. It appears that first you have to put in a deny statement to lock off access and then you add in the roles / users that have access. But once you do this you now… Read more »

The restaurant at the (other) end of the universe — Rusty Experiments

After a long day, there is nothing like a fun cocktail and this is a post I started last year and never posted. I’m a big fan of whisky and a friend of mine sent me his blog posting on a few of his favorite drinks. I’m finally posting this in hopes that I’ll actually… Read more »

Grovy Jenkins

So if you are like me you’ve been searching the web for how to write Jenkins DSL and you’ve realized this is a larger and more vague task then you realized. Jenkins DSL (Groovy) sucks, make peace with that now and the rest will be easier.  You may have stumbled across the Jenkins DSL Plugin and started messing… Read more »

RDS Aurora Scaling

This week we found ourselves in the wonderful but awful spot of having a lot of traffic hitting our DB servers. Its good because we are getting our customers moved over to AWS but bad since that means we need to scale up our RDS instances. After some panicked moments and a couple of hot fixes,… Read more »

Apache 2.4 + Opcache + APCu = 502?

So last week we had a puzzling bug relating to PHP and it’s modules. We have the following setup on AWS: Ext ELB -> Nginx (rate limiting, multiple SSL termination) -> internal ELB -> Apache / PHP We have multiple stores on these apache boxes along side our admin interface and what was puzzling was… Read more »

Zabbix Warning: Less than 25% free in the configuration cache

Because I always forget how to fix this issue and have to research it every time I come across it, I thought it was time to blog about it. So this morning I got the error on our new-ish zabbix server that our config cache was getting full. This didn’t surprise me since we’ve been adding… Read more »

Foreman 1.8 and Puppet Run

I’ve had a lot of trouble getting The Foreman to do a Puppet run when I click on the gui button. Finally figured it out and wanted to document it in case someone else is struggling with this issue too.   My /etc/foreman-proxy/settings.d/puppet.yml:

The biggest issue I finally realized was that when foreman tried to… Read more »

  • Zabbix & OSX 10.5

    Quick link for a zabbix 1.8 agent for OSX 10.5 zabbix_agents_1.8.13.macosx.amd64.tar —— Update —- Couldn’t actually get this running but I’m going to keep tinkering with it. I couldn’t get OS X to actually load the agent.

  • Installing System Center 2012 R2

    When I told my boss that I’d test System Center 2012 R2 I didn’t realize how many prerequisites needed to be install. Thankfully someone else has posted a great blog posting on how to configure this product. Check it out here

  • Nginx Proxy_pass and gzip

    So on Friday I deployed a new set of HA nginx proxy servers for our application and we quickly discovered that we were having issues with headers in regards to a cookie. After some research and trial & error I found that by default gzip is not enabled. Our application is using gzip and nginx didn’t… Read more »

  • My keepalived wrrp_script lessons

    So I’ve been working with keepalived for a quick and dirty HA setup and wanted to record the issues I had while setting this up. So the install of keepalived is really easy with apt-get, what I ran into was when I wanted to run a script to check to see if nginx was alive…. Read more »

  • Puppet on Windows Server 2012

    I’ve been pondering the idea of running puppet on my Windows servers since I learned about it at PuppetConf last fall and today I had a few moments to dive in. I started with something simple, I wanted to copy a PowerShell script to all my Windows boxes. I was honestly a little nervous and… Read more »

  • Puppet and Bareos make great backups

    I’ve been searching for a replacement for our Arconis backup solution. Not only has Acronis failed me on multiple occasions to backup it’s clients but it also failed during critical moments when I needed to restore a machine or at least files on that machine. So for the past couple months I’ve looked into alternatives… Read more »

  • PassCore: A Self-Service AD Password Change Utility – Home

    I’ve been struggling to find an easy way to allow my mac users to change their windows server password. I’ve tried some commercial products and even Microsoft’s free Sharepoint foundation server. They all pretty much worked but were overkill for accomplishing a simple password change. I finally found PassCore in my google searches and so… Read more »

  • OS X 10.9 + Indesign CC + Server 2012

    This is a follow up post to my previous post on Server 2012 and OS X 10.9. My fix did work partially. SMB speeds were fast and my sales team was much happier. What we unfortunately did not see in our early testing was Indesign CC has issues with Server 2012’s deduplication. It appears that… Read more »

  • How to make OS X 10.9 + work with Server 2012

    So for the past year I’ve been looking for a way to make OS X play nice with Server 2012. I’ve got over 8 TB of data on our Files servers and our OS X clients are frustratingly sluggish in accessing the data. In an earlier post I talk about ExtremeZ-IP which implement’s AFP on… Read more »

  • Postgres + Java + FLASH = 2 Months from Hell!

    I’m coming off two of the longest and most frustrating month’s in my IT career. My company decided to migrate our aging back office MIS system to a more recent offering by the same vendor. I walk into a meeting to find out that we have purchased the system and we committed to rolling it out. We are also unable… Read more »