Hooks

Hook is a utility tool for training. All hooks are derived from nnabla_rl.hook.Hook

Hook

class nnabla_rl.hook.Hook(timing=1000)

Base class of hooks for Algorithm classes.

Hook is called at every ‘timing’ iterations during the training. ‘timing’ is specified at the beginning of the class instantiation.

abstract on_hook_called(algorithm)

Called every “timing” iteration which is set on Hook’s instance creation. Will run additional periodical operation (see each class’ documentation) during the training.

Parameters

algorithm (nnabla_rl.algorithm.Algorithm) – Algorithm instance to perform additional operation.

List of Hooks

class nnabla_rl.hooks.EvaluationHook(env, evaluator=<nnabla_rl.utils.evaluator.EpisodicEvaluator object>, timing=1000, writer=None)

Bases: Hook

Hook to run evaluation during training.

Parameters

• env (gym.Env) – Environment to run the evaluation

• evaluator (Callable[[nnabla_rl.algorithm.Algorithm, gym.Env], List[float]]) – Evaluator which runs the actual evaluation. Defaults to EpisodicEvaluator.

• timing (int) – Evaluation interval. Defaults to 1000 iteration.

• writer (nnabla_rl.writer.Writer, optional) – Writer instance to save/print the evaluation results. Defaults to None.

on_hook_called(algorithm)

Called every “timing” iteration which is set on Hook’s instance creation. Will run additional periodical operation (see each class’ documentation) during the training.

Parameters

algorithm (nnabla_rl.algorithm.Algorithm) – Algorithm instance to perform additional operation.

class nnabla_rl.hooks.IterationNumHook(timing=1)

Bases: Hook

Hook to print the iteration number periodically. This hook just prints the iteration number of training.

Parameters

timing (int) – Printing interval. Defaults to 1 iteration.

on_hook_called(algorithm)

Called every “timing” iteration which is set on Hook’s instance creation. Will run additional periodical operation (see each class’ documentation) during the training.

Parameters

algorithm (nnabla_rl.algorithm.Algorithm) – Algorithm instance to perform additional operation.

class nnabla_rl.hooks.IterationStateHook(writer=None, timing=1000)

Bases: Hook

Hook which retrieves the iteration state to print/save the training status through writer.

Parameters

• timing (int) – Retriving interval. Defaults to 1000 iteration.

• writer (nnabla_rl.writer.Writer, optional) – Writer instance to save/print the iteration states. Defaults to None.

on_hook_called(algorithm)

Called every “timing” iteration which is set on Hook’s instance creation. Will run additional periodical operation (see each class’ documentation) during the training.

Parameters

algorithm (nnabla_rl.algorithm.Algorithm) – Algorithm instance to perform additional operation.

class nnabla_rl.hooks.SaveSnapshotHook(outdir, timing=1000)

Bases: Hook

Hook to save the training snapshot of current algorithm.

Parameters

timing (int) – Saving interval. Defaults to 1000 iteration.

on_hook_called(algorithm)

Called every “timing” iteration which is set on Hook’s instance creation. Will run additional periodical operation (see each class’ documentation) during the training.

Parameters

algorithm (nnabla_rl.algorithm.Algorithm) – Algorithm instance to perform additional operation.

class nnabla_rl.hooks.TimeMeasuringHook(timing=1)

Bases: Hook

Hook to measure and print the actual time spent to run the iteration(s).

Parameters

timing (int) – Measuring interval. Defaults to 1 iteration.

on_hook_called(algorithm)

Called every “timing” iteration which is set on Hook’s instance creation. Will run additional periodical operation (see each class’ documentation) during the training.

Parameters

algorithm (nnabla_rl.algorithm.Algorithm) – Algorithm instance to perform additional operation.