feedback_forensics.app.model_annotators#
Functionality for creating virtual model identity annotators.
Module Contents#
Functions#
Generate model identity annotators for target models compared against reference models. |
API#
- feedback_forensics.app.model_annotators.generate_model_identity_annotators(df: pandas.DataFrame, target_models: list, reference_models: list) tuple#
Generate model identity annotators for target models compared against reference models.
Args: df: DataFrame containing the dataset target_models: List of model names to use as target models. Empty list means all models are used as targets. reference_models: List of model names to use as reference models. Empty list means all models are used as references.
Returns: Tuple of (annotator_metadata, df_with_annotators)