descriptionTools for creating deployable scripts/programs
ownerflavio@polettix.it
last changeTue, 17 Apr 2018 07:59:43 +0000 (17 09:59 +0200)
content tags
add:
readme

OVERVIEW

deployable is a suite of programs that help easing the system administrator life.

It is based upon the following workflow to distribute changes in a molteplicity of servers:

  • first of all, produce a self-contained script that, once executed in each target server, will make all the needed changes;
  • secondly, transfer the given script in each server and execute it.

For the first issue, you'll probably have various files/scripts/programs that you will need to perform a given activity. The deployable script helps you select all the needed components that you need in the target server, and bundles them all inside a single, self-contained script that is ready to be run in the target machine. In this way, you'll only have to worry about taking one single file. Think about making an archive, but adding some logic to make it executable and instruct it to execute some specific programs.

For the second issue, it's mainly a matter of handling the transfer of the deploy script to the target servers, and execute them. This is obviously only a matter of sftp/ssh, but if you have more than 2 servers you'll quickly get tired of writing shell commands and passwords. To ease your life in this field, deploy is your friend: just tell it which is the script, and the list of target servers.

CONTENTS

The deployable project contains the following files:

deployable (the script)
generates self-contained scripts with all the files that you want to ship as part of your deployment task;
deploy
helps you distribute and execute the deploy script generated with deployable above in all the relevant servers;
mobundle
bundles Perl modules inside a Perl script, in order to ensure that those modules will be available in the target system (works only for Pure Perl modules);
remote
script that is used by deployable to generate the self-contained scripts that can be distributed like advanced tarballs;
Makefile
support file for embedding Archive::Tar inside remote

TYPICAL USAGE

In a typical usage, you check some upgrade procedure in a staging environment, and come up with:

  • files that have to be installed in certain locations;
  • scripts that have to be executed;
  • support files needed by the scripts in bullet 2.

Suppose that you come up with the following situation:

  # files that must be simply installed under "/", after stripping
  # the initial "/project/target-root/" part
  /project/target-root/etc/apache2/httpd.conf
  /project/target-root/etc/hosts
  /project/target-root/etc/HOSTNAME
  /project/target-root/opt/project/project.pl
  
  # scripts to be executed in the target directory, set as executable
  /project/01-check-network.sh
  /project/02-ntpdate.sh
  /project/03-create-users.sh
  
  # files to support scripts, not set as executable
  /project/userlist

In order to put all this stuff into a single executable perl file you use deployable. In particular, you can instruct this program about where you would like to put all the relevant stuff:

  cd /project
  deployable --all-exec -o deploy-script.pl --root target-root *.sh userlist

This command produces the deploy-script.pl script that is compound of two parts:

  • the Perl code in the remote contained in the distribution;
  • (immediately after __END__) a tarball containing all the files you want to ship.

The tarball is organised as follows:

  • stuff that must be installed at fixed paths is put inside the root directory;
  • scripts to be executed and support files are put inside the here directory;
  • a configuration file is put inside the deployable/config.pl file.

In the example above, all the suff in target-root is placed under root; all the other files (the three scripts and the support file) are put inside the here directory:

  deployable/config.pl
  here/01-check-network.sh
  here/02-ntpdate.sh
  here/03-create-users.sh
  here/userlist
  root/etc/apache2/httpd.conf
  root/etc/hosts
  root/etc/HOSTNAME
  root/opt/project/project.pl

The first part of the produced script is able to extract this tarball from itself and figure out where the different pieces have to be put. In particular, stuff under the root directory will be installed in /, and the other files in a temporary directory for further processing.

After the extraction is completed, the produced script checks if any program should be executed. Having passed the --all-exec, all executable files in the temporary directory will be executed; the order will be that resulting froma lexicographical sorting of the file names, so it's a good idea to put a leading number in order to control the execution closely.

Once you have this single script containing all what you need, plus the logic to start the deploy process in the target machine, you can put it in the target and execute it. If it's a matter of one-two servers, you can upload it, login and execute it. If you have more servers, you can use deploy:

   deploy -s deployable-script.pl host1 host2 host3

Calling this program will initially ask you for a password if you pass an empty password on the command line. If you're relying on SSH certificates, just hit return. After this, it will begin uploading and executing in all the given servers.

Thus, in a matter of two commands, you can pack all your stuff and deploy it!

shortlog
2018-04-17 Flavio PolettiCope with absence of IO::Promptmaster
2018-04-17 Flavio PolettiBump version of deployable
2018-04-17 Flavio PolettiAdd JSON::PP as requirement
2018-04-17 Flavio PolettiDocument json
2018-04-17 Flavio PolettiUpdate bundled deployable
2018-04-17 Flavio PolettiAvoid shelling out to perldoc
2018-04-17 Flavio PolettiChange spaces in Makefile
2018-04-17 Flavio PolettiAdd cpanfileno-sftp
2018-04-17 Flavio PolettiWork around SFTP unavailability
2016-07-13 Flavio PolettiIgnore remote-at in git
2016-07-13 Flavio PolettiAdded missing module in remote-at build
2016-02-12 Flavio Polettiregenerated bundled version
2016-02-12 Flavio Polettiadded --xform
2016-01-19 Flavio Polettiprettier, Archive::Tar in bundled version
2016-01-04 Flavio Polettipre-pending include dirs, not appending
2015-10-15 Flavio Polettigot rid of extra underscore in file marker
...
heads
6 years ago master
6 years ago no-sftp
10 years ago generic-remote
10 years ago better-tar