Evaluate a single run

Evaluation

After running a pipeline, typically the first thing to do is to evaluate it. You can do this by running:

cengine pipeline evaluate <pipeline_id>

Tensorboard

Tensorboard is probably one of the best visualization tools around for evaluating machine learning trainings. The Core Engine has Tensorboard support built-in.

ce_tensorboard

Tensorboard Model Analysis

Tensorflow Model Analysis (TFMA) is another tool that lets you evaluate a single pipeline run. It not only lets you see the overall performance metrics of your pipelines, but also the slicing metrics that you specified in the Evaluator key in your config.

Statistics
warning

The TFMA visualization requires additional dependencies.

jupyter nbextension install --py --symlink tensorflow_model_analysis
jupyter nbextension enable --py tensorflow_model_analysis