How to use Ansible to document procedures

In Ansible, the documentation is the playbook, so the documentation naturally evolves alongside the code
178 readers like this.
We don't make software for free, we make it for freedom

Opensource.com

"Documentation is a love letter that you write to your future self." —Damian Conway

I use Ansible as my personal notebook for documenting coding procedures—both the ones I use often and the ones I rarely use. This process facilitates my work and reduces the time it takes to do repetitive tasks, the ones where specific commands in a certain sequence are executed to accomplish a specific result.

By documenting with Ansible, I don't need to memorize all the parameters for each command or all the steps involved with a specific procedure, and it's easy to share the details with my teammates.

Traditional approaches for documentation, like wikis or shared drives, are useful for general documents, but inevitably they become outdated and can't keep pace with the rapid changes in infrastructure and environments. For specific procedures, it's better to document directly into the code using a tool like Ansible.

Ansible's advantages

Before we begin, let's recap some basic Ansible concepts: a playbook is a high-level organization of procedures using plays; plays are specific procedures for a group of hosts; tasks are specific actions, modules are units of code, and inventory is a list of managed nodes.

Ansible's great advantage is that the documentation is the playbook itself, so it evolves with and is contained inside the code. This is not only useful; it's also practical because, more than just documenting solutions with Ansible, you're also coding a playbook that permits you to write your procedures and commands, reproduce them, and automate them. This way, you can look back in six months and be able to quickly understand and execute them again.

It's true that this way of resolving problems could take more time at first, but it will definitely save a lot of time in the long term. By being courageous and disciplined to adopt these new habits, you will improve your skills in each iteration.

Following are some other important elements and support tools that will facilitate your process.

Use source code control

"First do it, then do it right, then do it better." —Addy Osmani

When working with Ansible playbooks, it's very important to implement a playbook-as-code strategy. A good way to accomplish this is to use a source code control repository that will permit to you start with a simple solution and iterate to improve it.

A source code control repository provides many advantages as you collaborate with other developers, restore previous versions, and back up your work. But in creating documentation, its main advantages are that you get traceability about what are you doing and can iterate around small changes to improve your work.

The most popular source control system is Git, but there are others like Subversion, Bazaar, BitKeeper, and Mercurial.

Keep idempotency in mind

In infrastructure automation, idempotency means to reach a specific end state that remains the same, no matter how many times the process is executed. So when you are preparing to automate your procedures, keep the desired result in mind and write scripts and commands that will achieve them consistently.

This concept exists in most Ansible modules because after you specify the desired final state, Ansible will accomplish it. For instance, there are modules for creating filesystems, modifying iptables, and managing cron entries. All of these modules are idempotent by default, so you should give them preference.

If you are using some of the lower-level modules, like command or shell, or developing your own modules, be careful to write code that will be idempotent and safe to repeat many times to get the same result.

The idempotency concept is important when you prepare procedures for automation because it permits you to evaluate several scenarios and incorporate the ones that will make your code safer and create an abstraction level that points to the desired result.

Test it!

Testing your deployment workflow creates fewer surprises when your code arrives in production. Ansible's belief that you shouldn't need another framework to validate basic things in your infrastructure is true. But your focus should be on application testing, not infrastructure testing.

Ansible's documentation offers several testing strategies for your procedures. For testing Ansible playbooks, you can use Molecule, which is designed to aid in the development and testing of Ansible roles. Molecule supports testing with multiple instances, operating systems/distributions, virtualization providers, test frameworks, and testing scenarios. This means Molecule will run through all the testing steps: linting verifications, checking playbook syntax, building Docker environments, running playbooks against Docker environments, running the playbook again to verify idempotence, and cleaning everything up afterward. Testing Ansible roles with Molecule is a good introduction to Molecule.

Run it!

Running Ansible playbooks can create logs that are formatted in an unfriendly and difficult-to-read way. In those cases, the Ansible Run Analysis (ARA) is a great complementary tool for running Ansible playbooks, as it provides an intuitive interface to browse them. Read Analyzing Ansible runs using ARA for more information.

Remember to protect your passwords and other sensitive information with Ansible Vault. Vault can encrypt binary files, group_vars, host_vars, include_vars, and var_files. But this encrypted data is exposed when you run a playbook in -v (verbose) mode, so it's a good idea to combine it with the keyword no_log set to true to hide any task's information, as it indicates that the value of the argument should not be logged or displayed.

A basic example

Do you need to connect to a server to produce a report file and copy the file to another server? Or do you need a lot of specific parameters to connect? Maybe you're not sure where to store the parameters. Or are your procedures are taking a long time because you need to collect all the parameters from several sources?

Suppose you have a network topology with some restrictions and you need to copy a file from a server that you can access (server1) to another server that is managed by a third party (server2). The parameters to connect are:

Source server: server1
Target server: server2
  Port: 2202
  User: transfers
  SSH Key: transfers_key
  File to copy: file.log
  Remote directory: /logs/server1/

In this scenario, you need to connect to server1 and copy the file using these parameters. You can accomplish this using a one-line command:

ssh server1 "scp -P 2202 -oUser=transfers -i ~/.ssh/transfers_key file.log server2:/logs/server1/"

Now your playbook can do the procedure.

Useful combinations

If you produce a lot of Ansible playbooks, you can organize all your procedures with other tools like AWX (Ansible Works Project), which provides a web-based user interface, a REST API, and a task engine built on top of Ansible so that users can better control their Ansible project use in IT environments.

Other interesting combinations are Ansible with Rundeck, which provides procedures as self-service jobs, and Jenkins for continuous integration and continuous delivery processes.

Conclusion

I hope that these tips for using Ansible will help you improve your automation processes, coding, and documentation. If you have more interest, dive in and learn more. And I would like to hear your ideas or questions, so please share them in the comments below.

Marco Bravo's photo
I'm working as DevOps System Administrator for OVHcloud in Canada, my interests are related to information technology (IT), in particular information security, development, operations, and cloud computing. You can reach me on Twitter @marcobravoram. Let's start the conversation. If you don't know, ask – if you know, share! ~ opensource mindset

2 Comments

I find Doxygen better for development documentation since it is embedded in the code. With programmers, out of sight is out of mind. Still there's only about a 30% chance the documentation will be updated when the code is changed.

Thanks for your comment Shawn, I really appreciate it! I didn't know Doxygen but just reading about it, and as you mention, Doxygen is a development documentation tool. The approach I want to use is more process and procedures documentation, for this reason I find Ansible could be a good option. This might help sysadmins and DevOps organizations. A great advantage that Ansible provides is that can be used by developers, sysadmin, infosece teams and also business people could read it and use it. I'm taking note of Doxygen to continue reading and figure out how can I take advantage of it, thanks!

In reply to by Shawn H Corey

Creative Commons LicenseThis work is licensed under a Creative Commons Attribution-Share Alike 4.0 International License.