hyper_opt_naswot

Hyperparameter optimizer working without training.

class HyperOptNASWOT(params: Parameters, data=None, use_pkl_checkpoints=False)

Bases: HyperOpt

Hyperparameter optimizer that does not require training networks.

Networks are analysed using the Jacobian.

Parameters:

• params (mala.common.parametes.Parameters) – Parameters used to create this hyperparameter optimizer.

• data (mala.datahandling.data_handler.DataHandler) – DataHandler holding the data for the hyperparameter optimization.

get_best_trial_results()

Get the best trial out of the list, including the value.

perform_study(trial_list=None)

Perform the study, i.e. the optimization.

This is done by sampling a certain subset of network architectures. Currently it is mandatory to provide a trial_list, although it will be optional later on.

Parameters:

trial_list (list) – A list containing trials from either HyperOptOptuna or HyperOptOAT.

set_optimal_parameters()

Set the optimal parameters found in the present study.

The parameters will be written to the parameter object with which the hyperparameter optimizer was created.