Evaluate a single run


After running a pipeline, typically the first thing to do is to evaluate it. You can do this by running:

cengine pipeline evaluate <pipeline_id>


Tensorboard is probably one of the best visualization tools around for evaluating machine learning trainings. The Core Engine has Tensorboard support built-in.


Tensorboard Model Analysis

Tensorflow Model Analysis (TFMA) is another tool that lets you evaluate a single pipeline run. It not only lets you see the overall performance metrics of your pipelines, but also the slicing metrics that you specified in the Evaluator key in your config.


The TFMA visualization requires additional dependencies.

jupyter nbextension install --py --symlink tensorflow_model_analysis
jupyter nbextension enable --py tensorflow_model_analysis