Repository

h2o-genai-model-validation-training

H2O Model Validation Training

Artifact
Version
h2o-mrm
0.3.4
h2o-eval-studio-client
1.0.0
Topic
Slides

Specs

  • ArtifactVersion
  • h2o-mrm0.3.4
  • h2o-eval-studio-client1.0.0
  • TopicSlides
  • Generative AI Model Validation01_genai_model_validation.pdf
  • Human Calibration02_human_calibration.pdf
  • Summary metrics03_summary_evaluations.pdf

README

H2O GenAI Model Validation Training

Requirements

Artifact Version
h2o-mrm 0.3.4
h2o-eval-studio-client 1.0.0

Usage

  1. Go to https://h2oworld.h2o.ai/
  2. Login with assign credentials
  3. Open Jupyter lab
  4. Load notebook from H2O World folder.

Slides

Topic Slides Notebooks
Generative AI Model Validation 01_genai_model_validation.pdf notebooks/h2o_mrm_full.ipynb and notebooks/eval-studio-walkthrough.ipynb
Human Calibration 02_human_calibration.pdf notebooks/h2o_mrm_full.ipynb
Summary metrics 03_summary_evaluations.pdf ---