Presentation

Experimaestro is an experiment manager, and is composed of

  1. A job scheduler that handles dependencies between jobs and provides locking mechanisms The job scheduler can be controlled via command line (experimaestro script) or via the web (where you can easily monitor jobs in real time)
  2. A modular experiment description framework, that allows easy description of the various parts of experiments:
    • Experiments are written in JavaScript or Python
    • Tasks describe the components that can be used
    • Composition: tasks take as input json and output json
    • Tasks can be composed through the definition of an experimental plan

Both modules can be used independently even though they were designed to work together.

Experimaestro is in a beta state - which means that you might experience some bugs while using it; but as I use it on a daily basis, there number and importance is going down each day.

Installation

Experimaestro is implemented using several languages and thus, you have to install multiple ecosystem with the right version.

Python 3

You need a working python3 interpreter on your system along with pip3.

To install required python's modules type:

pip3 install -r server/scripts/requirements.txt

Java (≥ 8)

You need a working Java installation (version ≥ 1.8) on your machine. Gradle is used for building but is not a requirement.

# From the project's root directory.
./gradlew installDist

gradlew.bat installDist

This will build and install all the dependencies into server/build/install/experimaestro-server. The command experimaestro is located in server/build/install/experimaestro-server/bin/experimaestro.

Note that on a Linux box if you are not root and the alternative link is not set to the proper version (you can inspect that using update-alternatives --display java), you won't have the permission to update the link manually using update-alternatives --config java. The work around is to set the environment variable JAVA_HOME when calling maven. For example:

To locate the path of to set to JAVA_HOME you can do locate jdk | less.

shell completion

To enable shell completion follow instructions in argcomplete documentation.

ZSH

Add to .zshrc:

  # Register python completion
  if type register-python-argcomplete &> /dev/null
  then
    eval "$(register-python-argcomplete 'experimaestro')"
  fi
  • Re-launch your shell: exec zsh

Test your installation

To test your installation is working properly you can try to start a server like this:

experimaestro --verbose --debug start-server

You should get something like:

INFO:root:Starting with gradle
INFO:root:Waiting for server to start (PID=37851)...
INFO:root:Server started...