- Artifact
- Version
- h2o-mrm
- 0.3.4
- h2o-eval-studio-client
- 1.0.0
- Topic
- Slides
Specs
- ArtifactVersion
- h2o-mrm0.3.4
- h2o-eval-studio-client1.0.0
- TopicSlides
- Generative AI Model Validation01_genai_model_validation.pdf
- Human Calibration02_human_calibration.pdf
- Summary metrics03_summary_evaluations.pdf
README
H2O GenAI Model Validation Training
Requirements
| Artifact | Version |
|---|---|
| h2o-mrm | 0.3.4 |
| h2o-eval-studio-client | 1.0.0 |
Usage
- Go to https://h2oworld.h2o.ai/
- Login with assign credentials
- Open Jupyter lab
- Load notebook from
H2O Worldfolder.
Slides
| Topic | Slides | Notebooks |
|---|---|---|
| Generative AI Model Validation | 01_genai_model_validation.pdf | notebooks/h2o_mrm_full.ipynb and notebooks/eval-studio-walkthrough.ipynb |
| Human Calibration | 02_human_calibration.pdf | notebooks/h2o_mrm_full.ipynb |
| Summary metrics | 03_summary_evaluations.pdf | --- |