I’ve seen a couple of automated remediation tools get some coverage lately: FBAR Stack Storm And both have received interesting threads on Hacker News. One HN commenter that stood out (bigdubs): I don’t like being the voice of the purist in this, but this seems like a bandaid on a bullet wound. For most of the cases where this would seem to be useful there is probably a failure upstream of that usage that should really be fixed....
At the OpenStack Operators meetup the question was asked about monitoring issues that are related to RabbitMQ. Lots of OpenStack components use a message broker and the most commonly used one among operators is RabbitMQ. For this post I’m going to concentrate on Nova and a couple of scenarios I’ve seen in production. It’s important to understand the flow of messages amongst the various components and break things down into a couple of categories:...
There’s a good talk given by Gabe Westmaas at the HK OpenStack Summit: The talk describes what Rackspace monitors in the public cloud OpenStack deployment, how responses are handled, and some of the integration points that are used. I recommend watching it for OpenStack specific monitoring and a little context around this post. In this post I am going to discuss how the sausage gets made - how the underlying Nagios configuration is managed....
Ever have an exchange like this? Q: What happened on this service? A: We can’t keep logs on the server past 2 months. Those logs are gone. Just about every IaaS out there has an object store. Amazon offers S3 and OpenStack providers have Swift. Why not just point logrotate at one of those object stores? That’s just what I’ve done with Swiftrotate. It’s a simple shell script to use with logrotate....
Hardware: Dell XPS 8500 Intel i5 RAM + SSD upgrades from Crucial Local Storage (1T) Software: Fedora Core 18 (base OS) VirtualBox Vagrant DevStack XenServer 6 I’m setting up a home lab to do some light coding on OpenStack and for testing implementations of next generation software/hardware deployment tools like BOSH and Razor.
Based on currently available code (nova: a77c0c50166aac04f0707af25946557fbd43ad44 2012-11-02/python-glanceclient: 16aafa728e4b8309b16bcc120b10bc20372883f4 2012-11-07/glance: 9dae32d60fc285d03fdb5586e3368d229485fdb4) This is a deep dive into what happens (and where in the code) during image creation with a Nova/Glance configuration that is backed by XenServer/XenAPI. Hopefully the methods used in Glance/Nova’s code will not change over time, and this guide will remain good starting point. Disclaimer: I am _not_ a developer, and these are really just best guesses. Corrections are welcome....
Based on currently available code ( a77c0c50166aac04f0707af25946557fbd43ad44 2012-11-02) This is a deep dive into what happens (and where in the code) during a rescue/unrescue scenario with a Nova configuration that is backed by XenServer/XenAPI. Hopefully the methods used in Nova’s code will not change over time, and this guide will remain good starting point. Rescue nova-api receives a rescue request. A new admin password is generated via utils.generate_password meeting FLAGS.password_length length requirement....
Based on the currently available code ( commit 114109dbf4094ae6b6333d41c84bebf6f85c4e48 – 2012-09-13) This is a deep dive into what happens (and where in the code) during a resize down (e.g., flavor 4 to flavor 2) with a Nova configuration that is backed by XenServer/XenAPI. Hopefully the methods used in Nova’s code will not change over time, and this guide will remain good starting point. Steps 1-6a are identical to my previous entry " Deep dive: OpenStack Nova Resize Up with XenAPI/Xenserver"....
Nova is the Compute engine of the OpenStack project. Based on the currently available code ( commit 114109dbf4094ae6b6333d41c84bebf6f85c4e48 - 2012-09-13) This is a deep dive into what happens (and where in the code) during a resize up (e.g., flavor 2 to flavor 4) with a Nova configuration that is backed by XenServer/XenAPI. Hopefully the methods used in Nova’s code will not change over time, and this guide will remain good starting point....