From 4d020ba4391b1db29e578b8460e38f34a7c83424 Mon Sep 17 00:00:00 2001 From: Andreas Troxler Date: Sat, 7 Oct 2023 11:20:44 +0200 Subject: [PATCH] update library versions, add notebook 3 --- ...Actuarial_Applications_of_NLP_Part_1.ipynb | 74949 ++++++---------- ...Actuarial_Applications_of_NLP_Part_2.ipynb | 74325 +++++---------- ...Actuarial_Applications_of_NLP_Part_3.ipynb | 1896 + 3 files changed, 50600 insertions(+), 100570 deletions(-) create mode 100644 12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_3.ipynb diff --git a/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_1.ipynb b/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_1.ipynb index ed3ec21..bb7f761 100644 --- a/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_1.ipynb +++ b/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_1.ipynb @@ -1,49132 +1,26841 @@ { - "cells": [ - { - "cell_type": "markdown", - "metadata": { - "id": "OnFQmduQWNvE" - }, - "source": [ - "# Actuarial Applications of Natural Language Processing Using Transformers\n", - "### A Case Study for Processing Text Features in an Actuarial Context\n", - "### Part I – Introduction and Case Studies on Car Accident Descriptions\n", - "\n", - "By Andreas Troxler, June 2022\n", - "\n", - "An abundant amount of information is available to insurance companies in the form of text.\n", - "However, language data is unstructured, sometimes multilingual,\n", - "and single words or phrases taken out of context can be highly ambiguous.\n", - "By the help of transformer models, text data can be converted into structured data and then\n", - "used as input to predictive models.\n", - "\n", - "In this Part I of tutorial, you will discover the use of transformer models for text classification.\n", - "Throughout this tutorial, the [HuggingFace](https://huggingface.co/docs/transformers/index)\n", - "Transformers library will be used.\n", - "\n", - "This notebook serves as a companion to the tutorial\n", - "[\"Actuarial Applications of Natural Language Processing Using Transformers”](https://github.com/JSchelldorfer/ActuarialDataScience/tree/master/12%20-%20NLP%20Using%20Transformers).\n", - "The tutorial explains the underlying concepts, and this notebook illustrates the implementation.\n", - "This tutorial, the dataset and the notebooks are available on [github](https://github.com/JSchelldorfer/ActuarialDataScience/tree/master/12%20-%20NLP%20Using%20Transformers).\n", - "\n", - "After competing this tutorial, you will know:\n", - "* How to use a transformer model to convert multi-lingual text features into embeddings - simply put, into a vector of real numbers.\n", - "* How to use this structured data to perform a text classification task.\n", - "* How to improve model performance by fine-tuning the NLP model with your own data.\n", - "* How to perform error analysis and interpret model predictions.\n", - "* How to deal with long input sequences.\n", - "\n", - "Let’s get started.\n", - "\n" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "TDCiMy_fWNvK" - }, - "source": [ - "## Notebook Overview\n", - "\n", - "This notebook is divided into into seven parts; they are:\n", - "\n", - "1. [Introduction](#intro)\n", - "\n", - " 1.1 [Prerequisites](#prerequisites)\n", - "\n", - " [1.2 Exploring the data](#dataexploration)

\n", - "\n", - "2. [A brief introduction to the HuggingFace ecosystem](#huggingface)\n", - "\n", - " 2.1 [Loading the data into a DataSet](#dataset)\n", - "\n", - " 2.2 [Tokenization – splitting the raw text](#tokenize)\n", - "\n", - " 2.3 [The transformer model](#transformer)

\n", - "\n", - "3. [Using transformers to extract features for classification or regression tasks](#feature_extraction)\n", - "\n", - " 3.1 [Extracting the encoded text ...](#extract_encoding)\n", - "\n", - " 3.2 [... and using it in a classification model](#classification)\n", - "\n", - " 3.3 [Case study: use accident descriptions to predict the number of vehicles involved](#case_study_nvehicles)\n", - "\n", - " 3.4 [Cross-lingual transfer](#cross_lingual_transfer)\n", - "\n", - " 3.5 [Multi-lingual training](#multi_lingual_training)

\n", - "\n", - "4. [Fine-tuning – improving the model](#finetuning)\n", - "\n", - " 4.1. [Domain-specific finetuning](#domain_finetuning)\n", - "\n", - " 4.2. [Task-specific finetuning](#task_finetuning)

\n", - "\n", - "5. [Understand predictions errors and interpret predictions](#understand)\n", - "\n", - " 5.1. [Case study: use accident descriptions to identify bodily injury](#case_study_injuries)\n", - "\n", - " 5.2. [Investigate false positives and false negatives](#investigate)\n", - "\n", - " 5.3. [Use Captum and `transformers-interpret` to interpret predictions](#interpret)

\n", - "\n", - "6. [Using extractive question answering to process longer texts](#qna)

\n", - "\n", - "7. [Conclusion](#conclusion)\n" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "dnU_Y0gcWNvM" - }, - "source": [ - "\n", - "\n", - "## 1. Introduction" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "bTFN7kK4WNvN" - }, - "source": [ - "\n", - "\n", - "### 1.1. Prerequisites" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Z2xX3ICs0AAo" - }, - "source": [ - "#### Computing Power\n", - "This notebook is computationally intensive. We recommend using a platform with GPU support.\n", - "\n", - "We have run this notebook on Google Colab and on an Amazon EC2 p2.xlarge instance (an older generation of GPU-based instances).\n", - "\n", - "Please note that the results may not be reproducible across platforms and versions." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "qc3FaMEFDWwh" - }, - "source": [ - "#### Local files\n", - "Make sure the following files are available in the directory of the notebook:\n", - "* `tutorial_utils.py` - a collection of utility functions used throughout this notebook, explained in Section [3.2](#classification)\n", - "* `NHTSA_NMVCCS_extract.parquet.gzip` - the data\n", - "\n", - "This notebook will create the following subdirectories:\n", - "* `datasets` - pre-processed datasets\n", - "* `models` - trained Transformer models\n", - "* `results` - figures and Excel files" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "uLmmA-fQWNvN" - }, - "source": [ - "#### Getting started with Python and Jupyter Notebook\n", - "\n", - "For this tutorial, we assume that you are already familiar with Python and Jupyter Notebook.\n", - "\n", - "In this section, Jupyter Notebook and Python settings are initialized.\n", - "For code in Python, the [PEP8 standard](https://www.python.org/dev/peps/pep-0008/)\n", - "(\"PEP = Python Enhancement Proposal\") is enforced with minor variations to improve readability.\n" - ] - }, - { - "cell_type": "code", - "execution_count": 1, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 17 - }, - "id": "E7grvuz8WNvQ", - "outputId": "cfe1efde-b6c7-4df9-f744-0b611fae3399", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ + "cells": [ { - "data": { - "text/html": [ - "" - ], - "text/plain": [ - "" + "cell_type": "markdown", + "metadata": { + "id": "OnFQmduQWNvE" + }, + "source": [ + "# Actuarial Applications of Natural Language Processing Using Transformers\n", + "### A Case Study for Processing Text Features in an Actuarial Context\n", + "### Part I – Introduction and Case Studies on Car Accident Descriptions\n", + "\n", + "By Andreas Troxler, June 2022\n", + "\n", + "An abundant amount of information is available to insurance companies in the form of text.\n", + "However, language data is unstructured, sometimes multilingual,\n", + "and single words or phrases taken out of context can be highly ambiguous.\n", + "By the help of transformer models, text data can be converted into structured data and then\n", + "used as input to predictive models.\n", + "\n", + "In this Part I of tutorial, you will discover the use of transformer models for text classification.\n", + "Throughout this tutorial, the [HuggingFace](https://huggingface.co/docs/transformers/index)\n", + "Transformers library will be used.\n", + "\n", + "This notebook serves as a companion to the tutorial\n", + "[\"Actuarial Applications of Natural Language Processing Using Transformers”](https://github.com/JSchelldorfer/ActuarialDataScience/tree/master/12%20-%20NLP%20Using%20Transformers).\n", + "The tutorial explains the underlying concepts, and this notebook illustrates the implementation.\n", + "This tutorial, the dataset and the notebooks are available on [github](https://github.com/JSchelldorfer/ActuarialDataScience/tree/master/12%20-%20NLP%20Using%20Transformers).\n", + "\n", + "After competing this tutorial, you will know:\n", + "* How to use a transformer model to convert multi-lingual text features into embeddings - simply put, into a vector of real numbers.\n", + "* How to use this structured data to perform a text classification task.\n", + "* How to improve model performance by fine-tuning the NLP model with your own data.\n", + "* How to perform error analysis and interpret model predictions.\n", + "* How to deal with long input sequences.\n", + "\n", + "Let’s get started.\n", + "\n" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# Notebook settings\n", - "\n", - "# clear the namespace variables\n", - "from IPython import get_ipython\n", - "get_ipython().run_line_magic(\"reset\", \"-sf\")\n", - "\n", - "# formatting: cell width\n", - "from IPython.display import display, HTML\n", - "display(HTML(\"\"))" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "FGxBx9MVWNvS" - }, - "source": [ - "#### Importing Required Libraries\n", - "\n", - "The following libraries are required:" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" }, - "id": "PFZRb_nWZnG5", - "outputId": "2c9bcb1d-0ebb-4413-b06e-584bbef0a709" - }, - "outputs": [], - "source": [ - "!pip install transformers" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "HDmc_CXBZmQz", - "outputId": "a028a40c-4a64-4aab-eeda-64661d82d935" - }, - "outputs": [], - "source": [ - "!pip install datasets" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "fap9tsxwa5QR", - "outputId": "e742c528-71ea-444d-f7a1-0a193623221c" - }, - "outputs": [], - "source": [ - "!pip install transformers_interpret" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "PzHnOM3JZq7G", - "outputId": "e119834a-fd1f-4c5a-9e0d-60b5e65dfc6f" - }, - "outputs": [], - "source": [ - "!pip install plotly" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "cFmU2CO5Zxe-", - "outputId": "5e26145d-0c87-450f-e257-cda799e9f895" - }, - "outputs": [], - "source": [ - "!pip install kaleido" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" + { + "cell_type": "markdown", + "metadata": { + "id": "TDCiMy_fWNvK" + }, + "source": [ + "## Notebook Overview\n", + "\n", + "This notebook is divided into into seven parts; they are:\n", + "\n", + "1. [Introduction](#intro)\n", + "\n", + " 1.1 [Prerequisites](#prerequisites)\n", + "\n", + " [1.2 Exploring the data](#dataexploration)

\n", + "\n", + "2. [A brief introduction to the HuggingFace ecosystem](#huggingface)\n", + "\n", + " 2.1 [Loading the data into a DataSet](#dataset)\n", + "\n", + " 2.2 [Tokenization – splitting the raw text](#tokenize)\n", + "\n", + " 2.3 [The transformer model](#transformer)

\n", + "\n", + "3. [Using transformers to extract features for classification or regression tasks](#feature_extraction)\n", + "\n", + " 3.1 [Extracting the encoded text ...](#extract_encoding)\n", + "\n", + " 3.2 [... and using it in a classification model](#classification)\n", + "\n", + " 3.3 [Case study: use accident descriptions to predict the number of vehicles involved](#case_study_nvehicles)\n", + "\n", + " 3.4 [Cross-lingual transfer](#cross_lingual_transfer)\n", + "\n", + " 3.5 [Multi-lingual training](#multi_lingual_training)

\n", + "\n", + "4. [Fine-tuning – improving the model](#finetuning)\n", + "\n", + " 4.1. [Domain-specific finetuning](#domain_finetuning)\n", + "\n", + " 4.2. [Task-specific finetuning](#task_finetuning)

\n", + "\n", + "5. [Understand predictions errors and interpret predictions](#understand)\n", + "\n", + " 5.1. [Case study: use accident descriptions to identify bodily injury](#case_study_injuries)\n", + "\n", + " 5.2. [Investigate false positives and false negatives](#investigate)\n", + "\n", + " 5.3. [Use Captum and `transformers-interpret` to interpret predictions](#interpret)

\n", + "\n", + "6. [Using extractive question answering to process longer texts](#qna)

\n", + "\n", + "7. [Conclusion](#conclusion)\n" + ] }, - "id": "JgoxGJH-bW84", - "outputId": "778bad51-692b-491d-8376-13f5fe16477e" - }, - "outputs": [], - "source": [ - "!pip install pyyaml==5.4.1 ## https://github.com/yaml/pyyaml/issues/576" - ] - }, - { - "cell_type": "code", - "execution_count": 2, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" + { + "cell_type": "markdown", + "metadata": { + "id": "dnU_Y0gcWNvM" + }, + "source": [ + "\n", + "\n", + "## 1. Introduction" + ] }, - "id": "_z92uLSKWNvS", - "outputId": "83969d4b-83c3-4640-bbe6-a2604472a8de", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [], - "source": [ - "from datasets import Dataset, DatasetDict, load_from_disk\n", - "from transformers import AutoTokenizer, AutoModel, Trainer, TrainingArguments, trainer_utils, AutoModelForMaskedLM,\\\n", - " DataCollatorForLanguageModeling, AutoModelForSequenceClassification, pipeline\n", - "from transformers_interpret import SequenceClassificationExplainer\n", - "import torch\n", - "import pandas as pd\n", - "import numpy as np\n", - "from scipy.special import softmax\n", - "from sklearn.linear_model import LogisticRegression\n", - "from sklearn.dummy import DummyClassifier\n", - "from sklearn.metrics import classification_report, confusion_matrix, accuracy_score, f1_score\n", - "import plotly.express as px\n", - "from wordcloud import WordCloud\n", - "\n", - "from tutorial_utils import extract_sequence_encoding, get_xy, dummy_classifier, logistic_regression_classifier, evaluate_classifier" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "ut5VN51xWNvT" - }, - "source": [ - "In addition, we require `openpyxl` to enable export from Pandas to Excel." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "u8MaU-VkWNvU" - }, - "source": [ - "\n", - "\n", - "### 1.2. Exploring the Data\n", - "\n", - "The data used throughout this tutorial is derived from data of a vehicle crash causation study performed\n", - "in the United States from 2005 to 2007.\n", - "The dataset has almost 7'000 records, each relating to one accident.\n", - "For each case, a verbal description of the accident is available in English,\n", - "which summarizes road and weather conditions,\n", - "vehicles, drivers and passengers involved, preconditions, injury severities, etc.\n", - "The same information is also encoded in tabular form,\n", - "so that we can apply supervised learning techniques to train the NLP models and\n", - "compare the information extracted from the verbal descriptions with the encoded data.\n", - "\n", - "The original data consists of multiple tables. For this tutorial, we have aggregated it into a single dataset\n", - "and added German translations of the English accident descriptions.\n", - "The translations were generated using the new\n", - "[DeepL python API](https://pypi.org/project/deepl/).\n", - "\n", - "To explore the data, let's load it into a Pandas DataFrame and examine its shape, columns and data types:" - ] - }, - { - "cell_type": "code", - "execution_count": 3, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" + { + "cell_type": "markdown", + "metadata": { + "id": "bTFN7kK4WNvN" + }, + "source": [ + "\n", + "\n", + "### 1.1. Prerequisites" + ] }, - "id": "RJDyLey0WNvU", - "outputId": "886a4e98-eba3-4c8c-bf9f-26212dcea1e5", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "shape of DataFrame: (6949, 16)\n", - "('level_0', dtype('int64'))\n", - "('index', dtype('int64'))\n", - "('SCASEID', dtype('int64'))\n", - "('SUMMARY_EN', dtype('O'))\n", - "('SUMMARY_GE', dtype('O'))\n", - "('INJSEVA', dtype('int64'))\n", - "('NUMTOTV', dtype('int64'))\n", - "('WEATHER1', dtype('int64'))\n", - "('WEATHER2', dtype('int64'))\n", - "('WEATHER3', dtype('int64'))\n", - "('WEATHER4', dtype('int64'))\n", - "('WEATHER5', dtype('int64'))\n", - "('WEATHER6', dtype('int64'))\n", - "('WEATHER7', dtype('int64'))\n", - "('WEATHER8', dtype('int64'))\n", - "('INJSEVB', dtype('int64'))\n" - ] - } - ], - "source": [ - "df = pd.read_parquet(\"NHTSA_NMVCCS_extract.parquet.gzip\")\n", - "print(f\"shape of DataFrame: {df.shape}\")\n", - "print(*list(zip(df.columns, df.dtypes)), sep=\"\\n\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "k2Ee4mjtWNvW" - }, - "source": [ - "The column `SCASEID` is a unique case identifier.\n", - "\n", - "The columns `SUMMARY_EN` and `SUMMARY_GE` are strings representing the verbal descriptions of the accident\n", - "in English and German, respectively.\n", - "\n", - "`NUMTOTV` is the number of vehicles involved in the case. Let's have a look at the distribution of this feature:" - ] - }, - { - "cell_type": "code", - "execution_count": 4, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 542 + "cell_type": "markdown", + "metadata": { + "id": "Z2xX3ICs0AAo" + }, + "source": [ + "#### Computing Power\n", + "This notebook is computationally intensive. We recommend using a platform with GPU support.\n", + "\n", + "We have run this notebook on Google Colab and on an Amazon EC2 p2.xlarge instance (an older generation of GPU-based instances).\n", + "\n", + "Please note that the results may not be reproducible across platforms and versions." + ] }, - "id": "wx8Bp2n-WNvW", - "outputId": "d74f1f13-7540-444d-f656-e255f7c7231f", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "text/html": [ - " \n", - " " + "cell_type": "markdown", + "metadata": { + "id": "qc3FaMEFDWwh" + }, + "source": [ + "#### Local files\n", + "Make sure the following files are available in the directory of the notebook:\n", + "* `tutorial_utils.py` - a collection of utility functions used throughout this notebook, explained in Section [3.2](#classification)\n", + "* `NHTSA_NMVCCS_extract.parquet.gzip` - the data\n", + "\n", + "This notebook will create the following subdirectories:\n", + "* `datasets` - pre-processed datasets\n", + "* `models` - trained Transformer models\n", + "* `results` - figures and Excel files" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "num_vehicles", - "format": "svg" - } - }, - "data": [ - { - "alignmentgroup": "True", - "hovertemplate": "variable=NUMTOTV
index=%{x}
value=%{y}", - "legendgroup": "NUMTOTV", - "marker": { - "color": "#636efa", - "pattern": { - "shape": "" - } - }, - "name": "NUMTOTV", - "offsetgroup": "NUMTOTV", - "orientation": "v", - "showlegend": true, - "textposition": "auto", - "type": "bar", - "x": [ - 1, - 2, - 3, - 4, - 5, - 6, - 7, - 8, - 9 - ], - "xaxis": "x", - "y": [ - 1822, - 4151, - 783, - 150, - 34, - 5, - 2, - 1, - 1 - ], - "yaxis": "y" - } - ], - "layout": { - "barmode": "relative", - "legend": { - "title": { - "text": "variable" - }, - "tracegroupgap": 0 - }, - "margin": { - "t": 60 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "number of cases by number of vehicles" - }, - "width": 640, - "xaxis": { - "anchor": "y", - "domain": [ - 0, - 1 - ], - "title": { - "text": "number of vehicles" - } - }, - "yaxis": { - "anchor": "x", - "domain": [ - 0, - 1 - ], - "title": { - "text": "number of cases" - } - } - } + "cell_type": "markdown", + "metadata": { + "id": "uLmmA-fQWNvN" }, - "text/html": [ - "
" + "source": [ + "#### Getting started with Python and Jupyter Notebook\n", + "\n", + "For this tutorial, we assume that you are already familiar with Python and Jupyter Notebook.\n", + "\n", + "In this section, Jupyter Notebook and Python settings are initialized.\n", + "For code in Python, the [PEP8 standard](https://www.python.org/dev/peps/pep-0008/)\n", + "(\"PEP = Python Enhancement Proposal\") is enforced with minor variations to improve readability.\n" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "fig = px.bar(df[\"NUMTOTV\"].value_counts().sort_index(), width=640)\n", - "fig.update_layout(title=\"number of cases by number of vehicles\", xaxis_title=\"number of vehicles\",\n", - " yaxis_title=\"number of cases\")\n", - "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"num_vehicles\"}})" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "pwcfXawvWNvX" - }, - "source": [ - "Most cases involve two vehicles, and only very few accidents involve more than three vehicles.\n", - "\n", - "Each of the columns `WEATHER1` to `WEATHER8` indicates the presence of a specific weather condition\n", - "(1: weather condition present, 9999: presence of weather condition unknown, 0 otherwise):\n", - "\n", - "| column | meaning | count |\n", - "|---|---|---|\n", - "| `WEATHER1` | cloudy | 1112 |\n", - "| `WEATHER2` | snow | 114 |\n", - "| `WEATHER3` | fog, smog, smoke | 28 |\n", - "| `WEATHER4` | rain | 624 |\n", - "| `WEATHER5` | sleet, hail (freezing drizzle or rain) | 25 |\n", - "| `WEATHER6` | blowing snow | 38 |\n", - "| `WEATHER7` | severe crosswinds | 20 |\n", - "| `WEATHER8` | other | 25 |\n", - "\n", - "These weather conditions are not mutually exclusive, i.e., more than one condition can be present in a single case.\n", - "The frequency distribution looks as follows:" - ] - }, - { - "cell_type": "code", - "execution_count": 5, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 542 }, - "id": "DD17G3B9WNvY", - "outputId": "90ff1035-709a-4cd4-e677-a8f169105301", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "weather", - "format": "svg" + "cell_type": "code", + "execution_count": 1, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 17 + }, + "id": "E7grvuz8WNvQ", + "outputId": "d3dec457-8e5c-45a6-a9d9-264d8d10b127", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "alignmentgroup": "True", - "hovertemplate": "x=%{x}
y=%{y}", - "legendgroup": "", - "marker": { - "color": "#636efa", - "pattern": { - "shape": "" - } - }, - "name": "", - "offsetgroup": "", - "orientation": "v", - "showlegend": false, - "textposition": "auto", - "type": "bar", - "x": [ - 1, - 2, - 3, - 4, - 5, - 6, - 7, - 8 - ], - "xaxis": "x", - "y": [ - 1112, - 114, - 28, - 624, - 25, - 38, - 20, - 25 - ], - "yaxis": "y" - } - ], - "layout": { - "barmode": "relative", - "legend": { - "tracegroupgap": 0 - }, - "margin": { - "t": 60 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" + "output_type": "display_data", + "data": { + "text/plain": [ + "" ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + "text/html": [ + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "number of cases by weather condition" - }, - "width": 640, - "xaxis": { - "anchor": "y", - "domain": [ - 0, - 1 - ], - "title": { - "text": "weather condition" - } - }, - "yaxis": { - "anchor": "x", - "domain": [ - 0, - 1 - ], - "title": { - "text": "number of cases" - } + "metadata": {} } - } - }, - "text/html": [ - "
" + ], + "source": [ + "# Notebook settings\n", + "\n", + "# clear the namespace variables\n", + "from IPython import get_ipython\n", + "get_ipython().run_line_magic(\"reset\", \"-sf\")\n", + "\n", + "# formatting: cell width\n", + "from IPython.display import display, HTML\n", + "display(HTML(\"\"))" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "fig=px.bar(x=range(1,9), y=[(df[\"WEATHER\"+str(i)]==1).sum() for i in range(1,9)], width=640)\n", - "fig.update_layout(title=\"number of cases by weather condition\", xaxis_title=\"weather condition\",\n", - " yaxis_title=\"number of cases\")\n", - "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"weather\"}})" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "gVwOVGouWNvY" - }, - "source": [ - "The most frequently recorded weather conditions are \"cloudy\" (`WEATHER1`) and \"rain\" (`WEATHER4`).\n", - "\n", - "`INJSEVA` indicates the most serious sustained injury in the accident.\n", - "For instance, if one person was not injured, and another person suffered a non-incapacitating injury,\n", - "injury class 2 was assigned to the case.\n", - "\n", - "Information on injury severity has been taken from police accident reports, which are not available in the data.\n", - "Unfortunately, this information does not necessarily align with the case description:\n", - "There are many cases for which the case description indicates the presence of an injury,\n", - "but `INJSEVA` does not, and vice versa.\n", - "\n", - "For this reason, we created manually an additional column `INJSEVB` based on the case description,\n", - "to indicate the presence of a (possible) bodily injury.\n", - "The table below shows the distribution of number of cases by the two variables.\n", - "\n", - "| `INJSEVA` | meaning | count | `INJSEVB`=0 | `INJSEVB`=1 \n", - "|---|---|---|---|---|\n", - "| 0 | O - No injury | 1'458 | 96| 1'554 |\n", - "| 1 | C - Possible injury | 1'112 | 1'298 | 2'410 |\n", - "| 2 | B - Non-incapacitating injury | 729 | 945 | 1'674 |\n", - "| 3 | A - Incapacitating injury | 304 | 373 | 677 |\n", - "| 4 | K - Killed | 5 | 114 | 119 |\n", - "| 5 | U - Injury, severity unknown | 44 | 122 | 166 |\n", - "| 6 | Died prior to crash | 0 | 0| 0 |\n", - "| 9 | Unknown if injured | 51 | 16 | 67 |\n", - "| 10 | No person in crash | 1 | 0| 1 |\n", - "| 11 | No PAR (police accident report) obtained | 231 | 50 | 281 |\n", - "|**Total**| | **3'935** | **3'014**| **6'949**|\n", - "\n" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Mi0yKfm2WNvZ" - }, - "source": [ - "Now we turn to the verbal accident descriptions.\n", - "First, we examine the length of the English texts, `SUMMARY_EN`.\n", - "To this end, we split the texts into words, with blank spaces as separator,\n", - "and show a box plot of the text length by number of vehicles involved in the accident:" - ] - }, - { - "cell_type": "code", - "execution_count": 6, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 559 }, - "id": "70q6pUwuWNvZ", - "outputId": "9dcead0e-d1b9-46fa-dfef-dc4e29084a4e", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "Overall number of words by case summary: min 60, average 419, max 1248\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "FGxBx9MVWNvS" + }, + "source": [ + "#### Importing Required Libraries\n", + "\n", + "The following libraries are required:" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "text_length", - "format": "svg" - } - }, - "data": [ + "cell_type": "code", + "execution_count": 2, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "PFZRb_nWZnG5", + "outputId": "805e7052-ed79-4aa4-8daa-3f2dec75c3b5" + }, + "outputs": [ { - "alignmentgroup": "True", - "hovertemplate": "NUMTOTV=%{x}
words per case summary=%{y}", - "legendgroup": "", - "marker": { - "color": "#636efa" - }, - "name": "", - "notched": false, - "offsetgroup": "", - "orientation": "v", - "showlegend": false, - "type": "box", - "x": [ - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 8, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 3, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 1, - 2, - 1, - 2, - 4, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 3, - 1, - 3, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 3, - 2, - 2, - 1, - 3, - 1, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 3, - 2, - 4, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 5, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 4, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 4, - 2, - 2, - 3, - 1, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 3, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 1, - 2, - 3, - 1, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 4, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 4, - 2, - 1, - 2, - 3, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 1, - 1, - 3, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 3, - 2, - 1, - 3, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 3, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 3, - 1, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 3, - 2, - 3, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 3, - 2, - 2, - 2, - 1, - 1, - 2, - 3, - 3, - 3, - 2, - 2, - 4, - 3, - 4, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 4, - 2, - 2, - 2, - 3, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 4, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 4, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 3, - 3, - 1, - 2, - 3, - 2, - 2, - 2, - 2, - 5, - 2, - 2, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 3, - 2, - 2, - 3, - 2, - 2, - 4, - 2, - 3, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 3, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 4, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 3, - 3, - 2, - 1, - 1, - 2, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 4, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 5, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 4, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 4, - 1, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 2, - 1, - 3, - 3, - 2, - 2, - 3, - 2, - 2, - 2, - 4, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 3, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 1, - 1, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 3, - 1, - 3, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 1, - 4, - 2, - 1, - 2, - 3, - 3, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 4, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 3, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 3, - 1, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 3, - 2, - 2, - 5, - 4, - 2, - 3, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 1, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 4, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 6, - 2, - 2, - 1, - 3, - 4, - 3, - 3, - 3, - 2, - 2, - 2, - 2, - 3, - 3, - 1, - 2, - 2, - 3, - 1, - 1, - 2, - 2, - 3, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 5, - 2, - 4, - 1, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 3, - 1, - 2, - 2, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 3, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 6, - 1, - 3, - 2, - 1, - 2, - 2, - 4, - 1, - 1, - 2, - 2, - 2, - 3, - 1, - 1, - 7, - 3, - 1, - 1, - 3, - 1, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 3, - 3, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 3, - 2, - 2, - 3, - 1, - 2, - 3, - 3, - 2, - 5, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 4, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 4, - 2, - 1, - 2, - 2, - 4, - 1, - 1, - 3, - 4, - 2, - 3, - 2, - 3, - 2, - 3, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 3, - 3, - 3, - 3, - 2, - 2, - 2, - 3, - 2, - 3, - 3, - 2, - 2, - 2, - 3, - 3, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 3, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 4, - 2, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 2, - 4, - 1, - 1, - 3, - 2, - 4, - 3, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 4, - 3, - 3, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 1, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 4, - 2, - 2, - 1, - 4, - 2, - 1, - 2, - 4, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 3, - 1, - 3, - 2, - 2, - 2, - 5, - 2, - 1, - 2, - 1, - 1, - 2, - 1, - 3, - 1, - 2, - 1, - 1, - 1, - 1, - 1, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 1, - 1, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 1, - 1, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 1, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 1, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 1, - 2, - 3, - 1, - 3, - 2, - 2, - 2, - 2, - 4, - 1, - 1, - 3, - 1, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 4, - 4, - 2, - 1, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 2, - 2, - 3, - 2, - 4, - 2, - 2, - 1, - 3, - 1, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 1, - 1, - 3, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 3, - 1, - 3, - 2, - 3, - 2, - 2, - 3, - 3, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 3, - 3, - 4, - 2, - 2, - 2, - 2, - 4, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 3, - 1, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 3, - 1, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 2, - 2, - 4, - 2, - 2, - 4, - 1, - 3, - 2, - 3, - 3, - 4, - 3, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 4, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 4, - 2, - 2, - 2, - 2, - 4, - 1, - 2, - 2, - 3, - 3, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 4, - 2, - 2, - 2, - 1, - 3, - 2, - 4, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 2, - 3, - 3, - 1, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 1, - 1, - 3, - 5, - 3, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 4, - 1, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 4, - 2, - 1, - 1, - 1, - 4, - 2, - 3, - 1, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 1, - 4, - 2, - 1, - 1, - 1, - 2, - 1, - 1, - 1, - 3, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 3, - 2, - 3, - 2, - 5, - 2, - 3, - 2, - 2, - 2, - 4, - 4, - 2, - 2, - 5, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 3, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 5, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 4, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 3, - 2, - 3, - 3, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 3, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 3, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 4, - 2, - 4, - 2, - 4, - 2, - 1, - 1, - 2, - 2, - 2, - 3, - 3, - 1, - 2, - 3, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 5, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 3, - 1, - 2, - 2, - 3, - 1, - 4, - 2, - 3, - 2, - 2, - 3, - 3, - 4, - 2, - 3, - 4, - 2, - 1, - 2, - 2, - 3, - 4, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 4, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 4, - 2, - 2, - 3, - 1, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 1, - 1, - 2, - 1, - 3, - 2, - 3, - 1, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 1, - 2, - 3, - 1, - 2, - 2, - 1, - 3, - 2, - 4, - 2, - 1, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 1, - 2, - 1, - 2, - 3, - 3, - 1, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 4, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 3, - 5, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 3, - 3, - 3, - 1, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 1, - 2, - 2, - 1, - 1, - 2, - 3, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 3, - 2, - 1, - 1, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 1, - 1, - 1, - 4, - 1, - 1, - 2, - 3, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 3, - 3, - 1, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 1, - 2, - 4, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 6, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 3, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 1, - 2, - 3, - 4, - 3, - 2, - 3, - 2, - 2, - 1, - 3, - 3, - 2, - 2, - 1, - 3, - 3, - 2, - 2, - 2, - 1, - 3, - 1, - 2, - 1, - 3, - 2, - 2, - 2, - 1, - 1, - 3, - 1, - 1, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 1, - 4, - 1, - 4, - 3, - 3, - 2, - 1, - 2, - 1, - 2, - 1, - 3, - 3, - 2, - 2, - 2, - 3, - 2, - 2, - 4, - 1, - 1, - 2, - 1, - 3, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 1, - 1, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 3, - 3, - 2, - 2, - 3, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 4, - 2, - 2, - 2, - 3, - 2, - 1, - 1, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 2, - 3, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 3, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 3, - 2, - 3, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 4, - 2, - 2, - 1, - 3, - 2, - 2, - 2, - 1, - 2, - 5, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 3, - 3, - 1, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 2, - 4, - 2, - 2, - 2, - 1, - 3, - 3, - 1, - 1, - 2, - 3, - 2, - 3, - 1, - 1, - 1, - 1, - 1, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 3, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 4, - 3, - 1, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 1, - 1, - 3, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 3, - 4, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 1, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 2, - 1, - 2, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 1, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 3, - 3, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 1, - 2, - 4, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 1, - 2, - 1, - 3, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 4, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 3, - 2, - 1, - 1, - 1, - 3, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 2, - 3, - 2, - 3, - 1, - 1, - 2, - 3, - 2, - 2, - 3, - 2, - 1, - 1, - 3, - 4, - 4, - 2, - 1, - 3, - 1, - 2, - 5, - 1, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 3, - 3, - 1, - 1, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 1, - 2, - 1, - 1, - 3, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 4, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 3, - 3, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 4, - 2, - 2, - 2, - 2, - 2, - 5, - 3, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 3, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 3, - 3, - 1, - 3, - 2, - 2, - 1, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 3, - 3, - 2, - 6, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 4, - 3, - 2, - 1, - 3, - 2, - 2, - 2, - 3, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 4, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 4, - 2, - 2, - 1, - 3, - 4, - 3, - 3, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 4, - 2, - 3, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 3, - 2, - 1, - 1, - 2, - 3, - 4, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 3, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 3, - 2, - 1, - 3, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 1, - 4, - 1, - 3, - 5, - 4, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 1, - 2, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 4, - 1, - 1, - 2, - 1, - 4, - 3, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 1, - 1, - 3, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 1, - 1, - 1, - 3, - 1, - 1, - 1, - 1, - 1, - 1, - 1, - 1, - 1, - 3, - 1, - 1, - 1, - 2, - 1, - 2, - 2, - 3, - 2, - 1, - 1, - 1, - 2, - 3, - 1, - 2, - 2, - 1, - 1, - 1, - 1, - 2, - 3, - 3, - 2, - 1, - 1, - 3, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 3, - 1, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 3, - 1, - 1, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 4, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 4, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 3, - 1, - 3, - 2, - 1, - 2, - 3, - 2, - 3, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 3, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 3, - 2, - 2, - 4, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 1, - 4, - 3, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 3, - 1, - 3, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 4, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 3, - 2, - 3, - 1, - 3, - 2, - 3, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 1, - 1, - 2, - 3, - 1, - 2, - 1, - 2, - 1, - 3, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 3, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 4, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 4, - 1, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 3, - 3, - 2, - 2, - 2, - 4, - 3, - 3, - 2, - 3, - 2, - 2, - 3, - 2, - 4, - 2, - 4, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 5, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 5, - 1, - 1, - 3, - 3, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 3, - 2, - 2, - 1, - 5, - 3, - 2, - 3, - 2, - 3, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 4, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 5, - 2, - 1, - 1, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 4, - 1, - 2, - 1, - 3, - 1, - 1, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 1, - 1, - 1, - 4, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 5, - 2, - 2, - 4, - 2, - 1, - 2, - 3, - 4, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 3, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 1, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 4, - 2, - 2, - 3, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 4, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 4, - 2, - 1, - 1, - 1, - 1, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 3, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 3, - 3, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 3, - 1, - 3, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 3, - 1, - 2, - 2, - 2, - 3, - 2, - 1, - 3, - 1, - 1, - 3, - 4, - 3, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 3, - 1, - 2, - 1, - 1, - 1, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 4, - 1, - 3, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 1, - 2, - 4, - 1, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 5, - 3, - 3, - 4, - 3, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 1, - 1, - 3, - 2, - 3, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 1, - 3, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 1, - 1, - 1, - 1, - 3, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 3, - 1, - 1, - 2, - 1, - 4, - 2, - 1, - 1, - 1, - 2, - 1, - 1, - 2, - 3, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 1, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 3, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 3, - 2, - 3, - 2, - 2, - 3, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 1, - 2, - 3, - 1, - 2, - 2, - 1, - 1, - 1, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 3, - 2, - 1, - 1, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 1, - 3, - 3, - 1, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 1, - 1, - 2, - 1, - 3, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 5, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 1, - 2, - 3, - 3, - 2, - 2, - 4, - 2, - 3, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 3, - 3, - 3, - 1, - 2, - 2, - 1, - 4, - 2, - 3, - 1, - 5, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 4, - 2, - 3, - 2, - 1, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 4, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 1, - 2, - 2, - 3, - 4, - 2, - 1, - 2, - 1, - 2, - 5, - 3, - 2, - 2, - 5, - 1, - 2, - 1, - 2, - 1, - 2, - 3, - 3, - 2, - 2, - 3, - 1, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 7, - 1, - 2, - 3, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 4, - 1, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 3, - 3, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 4, - 3, - 1, - 1, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 1, - 3, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 1, - 1, - 1, - 1, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 2, - 3, - 3, - 2, - 2, - 2, - 3, - 1, - 3, - 3, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 1, - 3, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 1, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 1, - 3, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 3, - 2, - 2, - 3, - 1, - 1, - 1, - 2, - 4, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 3, - 1, - 2, - 1, - 4, - 2, - 1, - 2, - 2, - 3, - 3, - 1, - 2, - 1, - 2, - 1, - 2, - 3, - 2, - 2, - 1, - 2, - 3, - 1, - 3, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 3, - 2, - 2, - 1, - 2, - 2, - 3, - 1, - 3, - 2, - 1, - 2, - 2, - 1, - 3, - 3, - 1, - 1, - 2, - 3, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 4, - 1, - 2, - 1, - 1, - 2, - 2, - 3, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 3, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 4, - 1, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 3, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 4, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 3, - 1, - 1, - 2, - 2, - 1, - 3, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 1, - 2, - 3, - 2, - 2, - 4, - 1, - 4, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 2, - 3, - 1, - 1, - 1, - 3, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 1, - 3, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 4, - 4, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 1, - 3, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 1, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 4, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 3, - 1, - 1, - 3, - 2, - 4, - 1, - 2, - 2, - 3, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 3, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 4, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 3, - 1, - 3, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 4, - 3, - 3, - 2, - 2, - 2, - 3, - 1, - 5, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 3, - 2, - 2, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 3, - 2, - 2, - 1, - 5, - 2, - 1, - 2, - 1, - 1, - 2, - 1, - 3, - 2, - 1, - 3, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 3, - 3, - 3, - 1, - 2, - 2, - 1, - 2, - 2, - 3, - 1, - 2, - 1, - 3, - 9, - 1, - 2, - 4, - 1, - 2, - 3, - 2, - 2, - 1, - 3, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 2, - 5, - 1, - 2, - 3, - 2, - 1, - 1, - 2, - 1, - 2, - 1, - 1, - 1, - 3, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 2, - 1, - 3, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 1, - 2, - 3, - 2, - 2, - 3, - 2, - 1, - 2, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 2, - 5, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 1, - 3, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 3, - 1, - 1, - 2, - 1, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 1, - 1, - 1, - 1, - 1, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 1, - 3, - 1, - 1, - 2, - 2, - 1, - 1, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 3, - 1, - 1, - 2, - 1, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 1, - 1, - 1, - 3, - 2, - 2, - 1, - 3, - 1, - 1, - 2, - 1, - 2, - 3, - 2, - 1, - 1, - 2, - 1, - 2, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 1, - 1, - 2, - 3, - 1, - 4, - 2, - 1, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 4, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 1, - 2, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 1, - 2, - 3, - 2, - 2, - 2, - 3, - 1, - 2, - 3, - 3, - 1, - 4, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 2, - 2, - 1, - 1, - 1, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 3, - 1, - 2, - 2, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 4, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 1, - 1, - 2, - 6, - 3, - 2, - 2, - 2, - 2, - 2, - 4, - 1, - 2, - 1, - 1, - 2, - 1, - 2, - 2, - 2, - 2, - 1, - 1, - 1, - 5, - 2, - 2, - 2, - 2, - 1, - 4, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 3, - 1, - 2, - 1, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 1, - 1, - 2, - 3, - 1, - 2, - 1, - 1, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 1, - 3, - 2, - 1, - 1, - 2, - 3, - 1, - 2, - 1, - 2, - 2, - 1, - 3, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 2, - 1, - 3, - 2, - 2, - 2, - 2, - 2, - 3, - 4, - 2, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 2, - 2, - 1, - 2, - 2, - 4, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 2, - 2, - 2, - 3, - 3, - 1, - 2, - 2, - 2, - 2, - 4, - 3, - 2, - 2, - 1, - 2, - 1, - 2, - 3, - 2, - 1, - 2, - 5, - 2, - 2, - 2, - 3, - 2, - 1, - 2, - 2, - 2, - 2, - 2, - 4, - 2, - 2, - 4, - 2, - 2, - 1, - 2, - 2, - 2, - 1, - 5, - 2, - 3, - 1, - 2, - 2, - 1, - 1, - 2, - 2, - 3, - 3, - 4, - 1, - 2 - ], - "x0": " ", - "xaxis": "x", - "y": [ - 426, - 321, - 510, - 254, - 423, - 645, - 466, - 319, - 535, - 403, - 352, - 611, - 280, - 334, - 477, - 588, - 370, - 399, - 479, - 491, - 318, - 349, - 378, - 446, - 480, - 243, - 362, - 348, - 318, - 477, - 432, - 229, - 501, - 256, - 368, - 436, - 369, - 311, - 260, - 257, - 491, - 325, - 310, - 528, - 536, - 481, - 488, - 588, - 505, - 452, - 486, - 288, - 504, - 436, - 361, - 304, - 668, - 525, - 467, - 297, - 461, - 212, - 228, - 447, - 401, - 307, - 374, - 353, - 321, - 355, - 418, - 354, - 404, - 301, - 373, - 243, - 326, - 288, - 347, - 302, - 234, - 161, - 371, - 333, - 355, - 344, - 395, - 375, - 351, - 383, - 416, - 497, - 340, - 351, - 428, - 662, - 417, - 389, - 197, - 262, - 374, - 396, - 412, - 537, - 257, - 383, - 169, - 410, - 274, - 229, - 315, - 409, - 415, - 257, - 439, - 597, - 348, - 401, - 576, - 374, - 587, - 323, - 270, - 259, - 249, - 365, - 302, - 285, - 395, - 305, - 226, - 261, - 194, - 428, - 288, - 445, - 370, - 342, - 224, - 480, - 425, - 288, - 354, - 317, - 376, - 346, - 350, - 350, - 249, - 201, - 316, - 493, - 415, - 365, - 252, - 532, - 262, - 282, - 356, - 512, - 474, - 351, - 532, - 629, - 508, - 578, - 433, - 488, - 445, - 469, - 387, - 651, - 445, - 505, - 566, - 472, - 377, - 474, - 441, - 292, - 425, - 334, - 359, - 704, - 326, - 378, - 378, - 419, - 223, - 402, - 263, - 610, - 360, - 521, - 261, - 440, - 246, - 285, - 707, - 524, - 352, - 417, - 225, - 475, - 380, - 336, - 412, - 465, - 488, - 378, - 330, - 312, - 483, - 315, - 293, - 332, - 291, - 534, - 240, - 523, - 444, - 327, - 355, - 358, - 329, - 404, - 424, - 457, - 396, - 220, - 331, - 336, - 256, - 211, - 360, - 445, - 365, - 416, - 410, - 293, - 340, - 248, - 504, - 371, - 388, - 324, - 403, - 410, - 478, - 252, - 472, - 377, - 303, - 335, - 392, - 368, - 401, - 376, - 354, - 366, - 337, - 456, - 160, - 143, - 257, - 236, - 225, - 136, - 409, - 99, - 162, - 102, - 225, - 452, - 388, - 554, - 237, - 152, - 169, - 208, - 329, - 141, - 167, - 274, - 158, - 235, - 284, - 319, - 199, - 201, - 209, - 181, - 210, - 276, - 192, - 398, - 201, - 334, - 260, - 388, - 331, - 380, - 286, - 287, - 337, - 270, - 233, - 323, - 201, - 163, - 246, - 118, - 320, - 142, - 241, - 357, - 182, - 354, - 96, - 131, - 303, - 307, - 273, - 181, - 217, - 224, - 251, - 137, - 166, - 60, - 125, - 64, - 84, - 141, - 351, - 295, - 279, - 346, - 269, - 246, - 273, - 229, - 274, - 342, - 506, - 340, - 241, - 452, - 748, - 536, - 733, - 723, - 374, - 928, - 995, - 568, - 536, - 516, - 962, - 387, - 667, - 709, - 674, - 296, - 730, - 612, - 612, - 315, - 688, - 690, - 625, - 617, - 403, - 513, - 312, - 526, - 351, - 151, - 408, - 142, - 781, - 468, - 302, - 486, - 275, - 246, - 212, - 387, - 212, - 481, - 328, - 408, - 301, - 247, - 391, - 219, - 693, - 234, - 321, - 395, - 277, - 287, - 510, - 307, - 454, - 284, - 359, - 249, - 551, - 231, - 418, - 196, - 423, - 301, - 440, - 312, - 400, - 462, - 362, - 377, - 386, - 355, - 308, - 218, - 736, - 356, - 483, - 367, - 777, - 394, - 487, - 863, - 375, - 439, - 257, - 129, - 199, - 180, - 348, - 549, - 595, - 400, - 428, - 370, - 431, - 358, - 395, - 295, - 468, - 354, - 571, - 504, - 615, - 487, - 433, - 325, - 505, - 538, - 379, - 473, - 486, - 560, - 342, - 542, - 531, - 499, - 503, - 641, - 318, - 399, - 446, - 655, - 665, - 546, - 543, - 589, - 599, - 800, - 794, - 462, - 423, - 809, - 213, - 385, - 496, - 344, - 446, - 609, - 182, - 362, - 531, - 450, - 685, - 736, - 422, - 473, - 320, - 447, - 669, - 396, - 293, - 581, - 586, - 707, - 240, - 418, - 221, - 406, - 359, - 389, - 256, - 410, - 381, - 213, - 288, - 307, - 380, - 164, - 354, - 333, - 178, - 357, - 317, - 171, - 415, - 414, - 319, - 356, - 436, - 428, - 431, - 234, - 617, - 468, - 265, - 328, - 423, - 289, - 272, - 362, - 482, - 351, - 187, - 210, - 310, - 228, - 366, - 286, - 426, - 344, - 298, - 337, - 208, - 351, - 542, - 245, - 593, - 650, - 278, - 399, - 264, - 578, - 515, - 406, - 240, - 417, - 345, - 271, - 361, - 582, - 336, - 452, - 438, - 433, - 242, - 290, - 255, - 253, - 323, - 292, - 304, - 294, - 245, - 282, - 164, - 262, - 252, - 242, - 213, - 169, - 240, - 319, - 337, - 336, - 519, - 663, - 452, - 438, - 923, - 439, - 612, - 469, - 352, - 600, - 650, - 669, - 410, - 415, - 626, - 532, - 589, - 546, - 487, - 567, - 532, - 360, - 498, - 509, - 311, - 569, - 655, - 602, - 553, - 613, - 545, - 314, - 431, - 280, - 600, - 361, - 524, - 709, - 549, - 517, - 641, - 486, - 572, - 579, - 500, - 450, - 370, - 398, - 450, - 445, - 455, - 421, - 450, - 226, - 317, - 394, - 423, - 368, - 376, - 195, - 270, - 364, - 414, - 331, - 376, - 445, - 393, - 409, - 345, - 237, - 447, - 416, - 412, - 217, - 316, - 302, - 314, - 269, - 346, - 229, - 290, - 410, - 481, - 425, - 331, - 279, - 236, - 367, - 311, - 529, - 469, - 592, - 379, - 493, - 661, - 411, - 326, - 469, - 480, - 661, - 222, - 411, - 473, - 720, - 448, - 431, - 398, - 476, - 669, - 450, - 702, - 445, - 639, - 367, - 428, - 504, - 474, - 408, - 533, - 591, - 588, - 683, - 462, - 326, - 510, - 368, - 493, - 456, - 617, - 616, - 458, - 316, - 597, - 430, - 299, - 547, - 427, - 398, - 506, - 427, - 433, - 480, - 557, - 551, - 263, - 274, - 440, - 379, - 674, - 591, - 454, - 650, - 718, - 556, - 360, - 449, - 634, - 451, - 526, - 539, - 442, - 474, - 367, - 380, - 371, - 420, - 357, - 385, - 369, - 386, - 422, - 469, - 454, - 290, - 281, - 350, - 337, - 304, - 463, - 373, - 311, - 493, - 396, - 278, - 374, - 209, - 528, - 396, - 311, - 398, - 545, - 396, - 437, - 389, - 714, - 347, - 414, - 364, - 368, - 409, - 363, - 364, - 457, - 327, - 261, - 385, - 386, - 442, - 293, - 380, - 367, - 349, - 262, - 318, - 265, - 453, - 753, - 393, - 794, - 599, - 388, - 680, - 483, - 630, - 397, - 493, - 613, - 401, - 337, - 350, - 491, - 496, - 380, - 435, - 533, - 533, - 528, - 479, - 643, - 426, - 564, - 531, - 565, - 542, - 447, - 281, - 548, - 331, - 461, - 380, - 423, - 384, - 389, - 453, - 483, - 306, - 449, - 278, - 364, - 298, - 328, - 358, - 334, - 302, - 495, - 463, - 437, - 395, - 422, - 372, - 310, - 432, - 380, - 359, - 352, - 845, - 337, - 557, - 306, - 475, - 434, - 526, - 317, - 383, - 500, - 409, - 469, - 447, - 371, - 382, - 642, - 363, - 437, - 479, - 303, - 464, - 567, - 562, - 460, - 426, - 385, - 475, - 307, - 565, - 368, - 592, - 540, - 553, - 519, - 374, - 629, - 447, - 450, - 499, - 507, - 548, - 542, - 586, - 659, - 635, - 334, - 609, - 748, - 537, - 509, - 613, - 425, - 622, - 719, - 378, - 759, - 526, - 544, - 438, - 602, - 490, - 534, - 644, - 706, - 574, - 477, - 533, - 511, - 456, - 550, - 402, - 383, - 382, - 363, - 422, - 501, - 430, - 501, - 467, - 398, - 255, - 450, - 453, - 496, - 422, - 388, - 307, - 398, - 328, - 326, - 534, - 389, - 845, - 403, - 430, - 320, - 492, - 399, - 521, - 399, - 400, - 528, - 477, - 451, - 640, - 559, - 397, - 227, - 338, - 208, - 563, - 406, - 568, - 383, - 170, - 394, - 454, - 271, - 419, - 227, - 292, - 432, - 296, - 255, - 368, - 314, - 336, - 386, - 554, - 505, - 307, - 357, - 251, - 234, - 485, - 353, - 305, - 238, - 223, - 504, - 398, - 381, - 410, - 438, - 232, - 357, - 422, - 428, - 406, - 443, - 301, - 304, - 320, - 327, - 377, - 303, - 322, - 410, - 445, - 389, - 370, - 240, - 359, - 433, - 388, - 488, - 249, - 335, - 501, - 248, - 181, - 335, - 250, - 249, - 279, - 267, - 531, - 384, - 345, - 287, - 529, - 371, - 281, - 298, - 373, - 307, - 366, - 402, - 419, - 234, - 325, - 325, - 392, - 412, - 352, - 361, - 281, - 353, - 269, - 260, - 379, - 254, - 220, - 347, - 336, - 309, - 283, - 367, - 374, - 330, - 294, - 220, - 231, - 258, - 243, - 260, - 205, - 161, - 254, - 362, - 403, - 218, - 482, - 204, - 215, - 156, - 406, - 382, - 334, - 425, - 360, - 287, - 293, - 307, - 257, - 332, - 302, - 215, - 328, - 271, - 323, - 218, - 218, - 303, - 236, - 272, - 219, - 162, - 270, - 248, - 262, - 285, - 266, - 286, - 221, - 301, - 215, - 151, - 364, - 538, - 533, - 520, - 416, - 530, - 282, - 762, - 601, - 582, - 592, - 582, - 827, - 363, - 390, - 368, - 460, - 786, - 556, - 291, - 617, - 440, - 380, - 384, - 285, - 516, - 710, - 319, - 360, - 698, - 317, - 276, - 377, - 242, - 250, - 429, - 317, - 314, - 362, - 343, - 221, - 265, - 447, - 243, - 343, - 369, - 307, - 241, - 342, - 340, - 363, - 272, - 335, - 323, - 320, - 376, - 179, - 304, - 217, - 265, - 371, - 371, - 381, - 285, - 503, - 444, - 326, - 355, - 291, - 299, - 454, - 219, - 434, - 316, - 320, - 447, - 323, - 495, - 367, - 322, - 458, - 669, - 317, - 368, - 623, - 456, - 707, - 573, - 359, - 359, - 432, - 247, - 394, - 564, - 542, - 536, - 370, - 379, - 557, - 301, - 426, - 233, - 288, - 419, - 358, - 388, - 386, - 484, - 289, - 216, - 366, - 743, - 448, - 453, - 463, - 453, - 490, - 501, - 222, - 345, - 326, - 385, - 275, - 247, - 303, - 287, - 247, - 475, - 497, - 335, - 332, - 554, - 344, - 575, - 301, - 296, - 280, - 798, - 414, - 509, - 357, - 316, - 175, - 404, - 367, - 558, - 449, - 474, - 535, - 460, - 500, - 352, - 505, - 319, - 561, - 453, - 303, - 294, - 374, - 342, - 427, - 310, - 394, - 421, - 412, - 351, - 511, - 380, - 441, - 784, - 576, - 302, - 334, - 417, - 275, - 435, - 327, - 317, - 357, - 304, - 299, - 459, - 364, - 623, - 428, - 263, - 185, - 377, - 207, - 380, - 256, - 350, - 306, - 222, - 415, - 419, - 565, - 378, - 457, - 293, - 404, - 650, - 379, - 302, - 542, - 441, - 368, - 377, - 326, - 431, - 336, - 356, - 516, - 530, - 433, - 180, - 313, - 520, - 236, - 472, - 417, - 287, - 329, - 261, - 508, - 620, - 242, - 342, - 586, - 438, - 455, - 320, - 385, - 279, - 452, - 344, - 338, - 366, - 373, - 375, - 488, - 403, - 372, - 354, - 474, - 398, - 388, - 238, - 225, - 278, - 311, - 241, - 259, - 255, - 488, - 496, - 246, - 374, - 320, - 285, - 632, - 543, - 406, - 387, - 421, - 512, - 318, - 471, - 276, - 270, - 511, - 525, - 377, - 250, - 396, - 212, - 424, - 333, - 296, - 362, - 340, - 325, - 353, - 522, - 420, - 306, - 466, - 417, - 370, - 817, - 172, - 276, - 334, - 242, - 365, - 424, - 259, - 310, - 339, - 307, - 260, - 250, - 375, - 215, - 274, - 308, - 258, - 338, - 320, - 229, - 336, - 262, - 294, - 326, - 249, - 293, - 296, - 334, - 301, - 215, - 287, - 353, - 283, - 403, - 298, - 276, - 455, - 530, - 339, - 339, - 397, - 335, - 419, - 594, - 280, - 248, - 261, - 221, - 260, - 243, - 296, - 299, - 362, - 257, - 272, - 382, - 328, - 275, - 210, - 418, - 297, - 231, - 255, - 317, - 234, - 305, - 283, - 257, - 303, - 368, - 382, - 429, - 333, - 323, - 436, - 294, - 329, - 253, - 266, - 346, - 417, - 318, - 381, - 330, - 347, - 315, - 286, - 450, - 346, - 323, - 413, - 279, - 379, - 363, - 287, - 364, - 388, - 378, - 371, - 909, - 332, - 517, - 295, - 230, - 190, - 369, - 178, - 293, - 231, - 371, - 294, - 428, - 170, - 359, - 230, - 355, - 417, - 281, - 292, - 230, - 190, - 328, - 350, - 246, - 320, - 459, - 282, - 416, - 416, - 388, - 307, - 393, - 274, - 330, - 252, - 288, - 301, - 262, - 505, - 797, - 336, - 311, - 208, - 353, - 262, - 244, - 322, - 247, - 301, - 322, - 277, - 280, - 361, - 195, - 322, - 321, - 337, - 187, - 173, - 284, - 254, - 357, - 385, - 351, - 297, - 235, - 287, - 613, - 292, - 347, - 284, - 254, - 269, - 302, - 329, - 348, - 310, - 342, - 420, - 230, - 280, - 298, - 306, - 314, - 272, - 351, - 339, - 317, - 364, - 343, - 368, - 319, - 412, - 300, - 281, - 324, - 335, - 346, - 369, - 530, - 366, - 466, - 381, - 387, - 560, - 449, - 262, - 465, - 319, - 406, - 398, - 416, - 303, - 334, - 377, - 567, - 491, - 404, - 682, - 311, - 338, - 287, - 333, - 484, - 433, - 312, - 364, - 373, - 531, - 351, - 606, - 429, - 639, - 539, - 584, - 390, - 565, - 320, - 545, - 527, - 435, - 435, - 649, - 666, - 579, - 479, - 527, - 328, - 326, - 502, - 464, - 510, - 442, - 678, - 575, - 529, - 293, - 527, - 520, - 444, - 727, - 768, - 384, - 549, - 547, - 639, - 389, - 339, - 438, - 230, - 419, - 268, - 226, - 220, - 353, - 296, - 239, - 294, - 271, - 229, - 243, - 514, - 320, - 445, - 426, - 538, - 286, - 523, - 478, - 495, - 531, - 399, - 360, - 351, - 219, - 331, - 369, - 296, - 330, - 458, - 370, - 311, - 321, - 379, - 353, - 384, - 282, - 409, - 266, - 295, - 231, - 333, - 407, - 473, - 365, - 282, - 304, - 354, - 334, - 308, - 238, - 256, - 315, - 431, - 292, - 579, - 306, - 419, - 388, - 387, - 236, - 280, - 409, - 329, - 479, - 309, - 484, - 416, - 231, - 397, - 454, - 360, - 430, - 482, - 500, - 399, - 375, - 451, - 405, - 390, - 527, - 610, - 331, - 360, - 362, - 382, - 328, - 409, - 465, - 384, - 423, - 367, - 892, - 260, - 243, - 303, - 354, - 333, - 619, - 323, - 370, - 289, - 365, - 334, - 382, - 426, - 427, - 209, - 400, - 563, - 239, - 399, - 469, - 475, - 233, - 354, - 297, - 616, - 366, - 258, - 451, - 364, - 332, - 265, - 285, - 330, - 586, - 386, - 327, - 395, - 344, - 234, - 595, - 436, - 327, - 315, - 358, - 272, - 489, - 238, - 312, - 364, - 254, - 288, - 378, - 372, - 274, - 326, - 270, - 322, - 278, - 319, - 406, - 299, - 439, - 300, - 317, - 381, - 257, - 462, - 392, - 333, - 547, - 306, - 340, - 201, - 386, - 271, - 368, - 284, - 226, - 293, - 165, - 293, - 340, - 251, - 341, - 215, - 237, - 319, - 354, - 401, - 206, - 377, - 251, - 521, - 281, - 326, - 204, - 301, - 252, - 215, - 331, - 313, - 304, - 373, - 340, - 339, - 296, - 300, - 330, - 344, - 360, - 241, - 371, - 341, - 315, - 384, - 317, - 345, - 339, - 383, - 277, - 406, - 271, - 315, - 474, - 456, - 441, - 493, - 408, - 325, - 404, - 344, - 444, - 494, - 472, - 331, - 320, - 331, - 209, - 347, - 443, - 299, - 287, - 361, - 243, - 310, - 339, - 250, - 284, - 298, - 402, - 312, - 251, - 374, - 333, - 404, - 307, - 429, - 348, - 353, - 348, - 232, - 347, - 536, - 274, - 315, - 427, - 343, - 373, - 391, - 421, - 241, - 384, - 399, - 584, - 417, - 420, - 542, - 420, - 280, - 466, - 207, - 489, - 453, - 515, - 387, - 237, - 439, - 406, - 342, - 226, - 360, - 568, - 526, - 577, - 290, - 279, - 421, - 542, - 485, - 447, - 449, - 831, - 390, - 362, - 394, - 589, - 263, - 550, - 497, - 366, - 445, - 345, - 388, - 493, - 506, - 400, - 430, - 598, - 178, - 205, - 447, - 513, - 375, - 445, - 328, - 287, - 363, - 228, - 337, - 278, - 266, - 340, - 373, - 269, - 269, - 297, - 300, - 427, - 374, - 305, - 352, - 225, - 284, - 317, - 314, - 377, - 439, - 380, - 440, - 324, - 305, - 371, - 344, - 360, - 271, - 351, - 257, - 348, - 432, - 319, - 316, - 368, - 434, - 415, - 321, - 373, - 489, - 363, - 734, - 413, - 675, - 694, - 537, - 612, - 798, - 904, - 648, - 1071, - 865, - 867, - 378, - 819, - 676, - 651, - 483, - 350, - 705, - 913, - 592, - 641, - 622, - 381, - 282, - 671, - 683, - 338, - 250, - 488, - 380, - 303, - 362, - 524, - 397, - 407, - 330, - 386, - 436, - 381, - 322, - 296, - 435, - 237, - 435, - 295, - 361, - 384, - 401, - 249, - 350, - 385, - 405, - 605, - 518, - 464, - 480, - 530, - 314, - 253, - 405, - 351, - 440, - 290, - 415, - 386, - 484, - 340, - 431, - 302, - 379, - 355, - 467, - 445, - 415, - 594, - 748, - 442, - 682, - 383, - 420, - 753, - 619, - 401, - 447, - 337, - 436, - 299, - 501, - 358, - 442, - 424, - 387, - 384, - 445, - 290, - 354, - 487, - 407, - 553, - 425, - 505, - 426, - 480, - 494, - 425, - 426, - 484, - 604, - 463, - 433, - 490, - 420, - 543, - 496, - 767, - 654, - 1088, - 613, - 1006, - 556, - 912, - 598, - 842, - 845, - 724, - 429, - 992, - 645, - 722, - 989, - 1082, - 413, - 974, - 735, - 921, - 770, - 462, - 476, - 429, - 418, - 461, - 488, - 462, - 714, - 875, - 495, - 596, - 667, - 576, - 358, - 762, - 803, - 591, - 476, - 827, - 716, - 761, - 638, - 746, - 437, - 923, - 679, - 588, - 559, - 512, - 547, - 461, - 691, - 730, - 467, - 443, - 514, - 580, - 466, - 610, - 411, - 537, - 777, - 765, - 555, - 403, - 492, - 562, - 629, - 452, - 638, - 507, - 712, - 522, - 462, - 404, - 488, - 355, - 254, - 622, - 419, - 507, - 381, - 680, - 310, - 440, - 570, - 528, - 624, - 479, - 564, - 303, - 375, - 556, - 441, - 552, - 588, - 474, - 517, - 526, - 531, - 538, - 437, - 463, - 213, - 361, - 461, - 382, - 251, - 474, - 416, - 194, - 312, - 271, - 331, - 357, - 213, - 226, - 364, - 204, - 277, - 427, - 251, - 346, - 316, - 444, - 337, - 375, - 294, - 469, - 455, - 353, - 511, - 273, - 408, - 413, - 365, - 361, - 360, - 413, - 395, - 418, - 497, - 280, - 222, - 485, - 365, - 187, - 282, - 251, - 435, - 307, - 289, - 385, - 419, - 245, - 301, - 250, - 373, - 383, - 293, - 395, - 349, - 244, - 330, - 376, - 191, - 320, - 314, - 346, - 371, - 257, - 264, - 301, - 354, - 398, - 265, - 396, - 490, - 291, - 322, - 455, - 324, - 359, - 330, - 369, - 299, - 404, - 701, - 265, - 300, - 228, - 250, - 367, - 306, - 205, - 378, - 330, - 547, - 400, - 382, - 118, - 481, - 587, - 248, - 329, - 402, - 541, - 529, - 503, - 589, - 447, - 503, - 426, - 634, - 618, - 445, - 357, - 340, - 487, - 529, - 559, - 493, - 344, - 670, - 428, - 408, - 256, - 224, - 247, - 322, - 239, - 296, - 208, - 366, - 198, - 199, - 329, - 323, - 472, - 255, - 226, - 423, - 259, - 368, - 362, - 407, - 606, - 536, - 344, - 356, - 296, - 481, - 645, - 423, - 309, - 472, - 427, - 246, - 459, - 419, - 434, - 433, - 550, - 307, - 294, - 455, - 561, - 529, - 448, - 267, - 377, - 265, - 425, - 505, - 336, - 349, - 277, - 528, - 391, - 401, - 453, - 290, - 240, - 503, - 666, - 366, - 427, - 331, - 465, - 437, - 326, - 450, - 404, - 198, - 656, - 342, - 351, - 296, - 415, - 568, - 464, - 470, - 376, - 444, - 242, - 429, - 326, - 419, - 522, - 860, - 298, - 369, - 545, - 465, - 582, - 497, - 349, - 586, - 352, - 492, - 474, - 468, - 353, - 497, - 361, - 276, - 390, - 378, - 319, - 310, - 276, - 517, - 216, - 346, - 402, - 637, - 578, - 354, - 294, - 430, - 439, - 377, - 313, - 791, - 1077, - 713, - 633, - 480, - 704, - 482, - 503, - 560, - 472, - 515, - 821, - 624, - 357, - 562, - 361, - 801, - 598, - 503, - 322, - 686, - 763, - 460, - 691, - 617, - 568, - 558, - 598, - 614, - 605, - 674, - 482, - 577, - 456, - 529, - 737, - 363, - 802, - 787, - 413, - 676, - 677, - 619, - 513, - 348, - 395, - 307, - 387, - 298, - 472, - 521, - 447, - 379, - 487, - 536, - 225, - 461, - 388, - 460, - 284, - 377, - 334, - 531, - 336, - 425, - 626, - 661, - 308, - 659, - 360, - 698, - 390, - 472, - 466, - 465, - 601, - 399, - 594, - 516, - 305, - 877, - 500, - 373, - 509, - 424, - 449, - 265, - 427, - 367, - 410, - 465, - 789, - 413, - 614, - 680, - 412, - 306, - 983, - 504, - 342, - 270, - 436, - 441, - 275, - 225, - 396, - 418, - 280, - 451, - 394, - 317, - 324, - 453, - 338, - 292, - 226, - 250, - 438, - 371, - 443, - 433, - 424, - 451, - 584, - 492, - 392, - 347, - 378, - 327, - 518, - 532, - 399, - 459, - 394, - 439, - 399, - 312, - 473, - 602, - 398, - 447, - 539, - 371, - 244, - 602, - 364, - 446, - 325, - 335, - 255, - 268, - 340, - 254, - 267, - 273, - 435, - 256, - 299, - 281, - 217, - 226, - 347, - 242, - 235, - 270, - 244, - 300, - 291, - 197, - 244, - 154, - 295, - 221, - 295, - 402, - 371, - 444, - 891, - 487, - 206, - 780, - 481, - 336, - 365, - 560, - 310, - 387, - 331, - 626, - 353, - 414, - 463, - 320, - 273, - 440, - 426, - 521, - 270, - 904, - 388, - 432, - 452, - 429, - 385, - 463, - 532, - 555, - 532, - 508, - 453, - 367, - 427, - 369, - 369, - 820, - 710, - 435, - 532, - 524, - 319, - 639, - 492, - 441, - 674, - 299, - 444, - 253, - 544, - 522, - 358, - 529, - 431, - 337, - 536, - 311, - 386, - 364, - 492, - 375, - 500, - 451, - 374, - 291, - 846, - 313, - 287, - 430, - 322, - 585, - 392, - 344, - 539, - 413, - 301, - 417, - 551, - 276, - 567, - 537, - 691, - 517, - 489, - 617, - 566, - 483, - 597, - 343, - 488, - 494, - 412, - 927, - 328, - 714, - 567, - 588, - 570, - 424, - 540, - 419, - 444, - 344, - 566, - 692, - 443, - 402, - 432, - 540, - 317, - 293, - 466, - 311, - 290, - 399, - 325, - 727, - 452, - 395, - 474, - 613, - 506, - 388, - 373, - 562, - 453, - 388, - 486, - 284, - 526, - 335, - 244, - 318, - 367, - 353, - 400, - 330, - 662, - 358, - 493, - 575, - 402, - 346, - 558, - 285, - 394, - 814, - 509, - 688, - 420, - 373, - 844, - 349, - 555, - 576, - 228, - 489, - 548, - 470, - 488, - 602, - 609, - 355, - 355, - 263, - 560, - 485, - 343, - 639, - 214, - 485, - 477, - 630, - 505, - 465, - 275, - 650, - 550, - 527, - 443, - 567, - 924, - 333, - 420, - 443, - 587, - 607, - 593, - 594, - 372, - 354, - 410, - 375, - 487, - 647, - 453, - 196, - 327, - 432, - 289, - 254, - 382, - 422, - 422, - 452, - 411, - 312, - 621, - 419, - 314, - 487, - 538, - 294, - 397, - 498, - 381, - 527, - 393, - 372, - 311, - 500, - 381, - 413, - 258, - 601, - 463, - 519, - 479, - 399, - 469, - 425, - 302, - 421, - 349, - 398, - 276, - 424, - 269, - 299, - 332, - 484, - 321, - 430, - 336, - 425, - 320, - 387, - 447, - 501, - 810, - 610, - 473, - 728, - 688, - 610, - 404, - 580, - 533, - 606, - 671, - 289, - 387, - 506, - 506, - 621, - 480, - 564, - 592, - 453, - 664, - 746, - 653, - 577, - 824, - 815, - 652, - 804, - 624, - 567, - 665, - 626, - 447, - 872, - 888, - 731, - 710, - 517, - 420, - 329, - 934, - 637, - 555, - 348, - 778, - 479, - 512, - 656, - 325, - 497, - 927, - 552, - 625, - 493, - 631, - 400, - 390, - 380, - 565, - 636, - 811, - 637, - 553, - 569, - 470, - 399, - 421, - 560, - 521, - 365, - 371, - 423, - 548, - 812, - 417, - 666, - 589, - 342, - 969, - 721, - 354, - 387, - 634, - 765, - 563, - 674, - 390, - 432, - 372, - 361, - 357, - 315, - 473, - 333, - 250, - 590, - 433, - 555, - 302, - 598, - 291, - 366, - 420, - 412, - 381, - 487, - 368, - 394, - 327, - 659, - 410, - 255, - 188, - 384, - 468, - 468, - 235, - 299, - 648, - 414, - 363, - 481, - 585, - 503, - 335, - 455, - 441, - 432, - 312, - 462, - 501, - 501, - 531, - 390, - 502, - 284, - 623, - 495, - 368, - 496, - 657, - 600, - 339, - 318, - 483, - 270, - 448, - 295, - 649, - 537, - 505, - 455, - 415, - 376, - 410, - 466, - 491, - 418, - 571, - 549, - 692, - 542, - 309, - 465, - 423, - 604, - 356, - 617, - 638, - 347, - 261, - 476, - 408, - 420, - 362, - 557, - 624, - 570, - 397, - 440, - 452, - 370, - 488, - 335, - 449, - 351, - 357, - 402, - 397, - 449, - 629, - 418, - 583, - 392, - 518, - 446, - 313, - 354, - 433, - 619, - 492, - 624, - 474, - 548, - 645, - 488, - 626, - 346, - 240, - 488, - 364, - 603, - 339, - 281, - 297, - 333, - 379, - 388, - 334, - 317, - 348, - 220, - 302, - 218, - 419, - 382, - 417, - 321, - 425, - 318, - 358, - 266, - 251, - 633, - 256, - 313, - 534, - 338, - 419, - 256, - 234, - 233, - 273, - 495, - 379, - 232, - 222, - 339, - 334, - 409, - 254, - 447, - 322, - 268, - 406, - 270, - 374, - 432, - 438, - 271, - 297, - 314, - 304, - 263, - 262, - 192, - 331, - 285, - 236, - 208, - 247, - 210, - 195, - 300, - 432, - 510, - 318, - 328, - 308, - 204, - 427, - 221, - 286, - 420, - 321, - 235, - 356, - 353, - 357, - 643, - 495, - 230, - 318, - 367, - 362, - 304, - 301, - 375, - 305, - 280, - 265, - 252, - 256, - 259, - 311, - 285, - 244, - 213, - 428, - 202, - 248, - 243, - 396, - 267, - 385, - 293, - 347, - 234, - 398, - 299, - 337, - 236, - 336, - 197, - 327, - 316, - 370, - 368, - 378, - 197, - 367, - 281, - 494, - 284, - 372, - 421, - 429, - 505, - 456, - 499, - 317, - 324, - 186, - 445, - 456, - 465, - 401, - 252, - 320, - 422, - 376, - 302, - 439, - 266, - 398, - 384, - 412, - 318, - 385, - 426, - 609, - 317, - 227, - 357, - 381, - 291, - 277, - 377, - 250, - 269, - 310, - 318, - 323, - 405, - 523, - 376, - 280, - 277, - 341, - 347, - 229, - 224, - 218, - 285, - 226, - 240, - 391, - 268, - 221, - 229, - 339, - 241, - 231, - 256, - 271, - 270, - 235, - 231, - 429, - 306, - 393, - 420, - 304, - 642, - 364, - 333, - 378, - 371, - 426, - 300, - 264, - 337, - 275, - 259, - 371, - 299, - 202, - 535, - 336, - 284, - 336, - 271, - 435, - 342, - 321, - 378, - 398, - 568, - 591, - 479, - 595, - 538, - 859, - 590, - 411, - 529, - 441, - 604, - 426, - 568, - 470, - 549, - 420, - 459, - 402, - 523, - 776, - 425, - 355, - 719, - 377, - 339, - 270, - 225, - 308, - 342, - 389, - 282, - 397, - 451, - 268, - 493, - 371, - 677, - 340, - 360, - 275, - 307, - 410, - 386, - 283, - 505, - 287, - 403, - 309, - 253, - 353, - 440, - 499, - 420, - 346, - 292, - 355, - 361, - 462, - 325, - 327, - 317, - 325, - 435, - 333, - 381, - 342, - 451, - 348, - 395, - 277, - 620, - 285, - 306, - 540, - 337, - 350, - 449, - 409, - 240, - 487, - 462, - 596, - 258, - 265, - 284, - 344, - 338, - 405, - 365, - 282, - 329, - 379, - 354, - 469, - 481, - 358, - 377, - 315, - 520, - 293, - 373, - 432, - 501, - 611, - 162, - 394, - 479, - 295, - 462, - 353, - 353, - 382, - 712, - 664, - 663, - 247, - 233, - 412, - 328, - 483, - 456, - 253, - 286, - 335, - 324, - 335, - 360, - 311, - 257, - 269, - 295, - 390, - 350, - 345, - 324, - 593, - 248, - 372, - 330, - 261, - 473, - 356, - 442, - 197, - 301, - 450, - 243, - 507, - 489, - 287, - 307, - 643, - 583, - 563, - 278, - 370, - 323, - 281, - 462, - 444, - 293, - 570, - 346, - 454, - 397, - 376, - 322, - 360, - 426, - 281, - 491, - 378, - 368, - 427, - 209, - 388, - 387, - 766, - 634, - 560, - 366, - 501, - 322, - 419, - 246, - 332, - 397, - 403, - 446, - 239, - 270, - 520, - 274, - 557, - 313, - 485, - 409, - 412, - 332, - 492, - 278, - 461, - 228, - 274, - 364, - 370, - 542, - 528, - 430, - 495, - 417, - 391, - 519, - 429, - 354, - 354, - 441, - 377, - 440, - 433, - 423, - 452, - 346, - 366, - 492, - 471, - 502, - 465, - 554, - 245, - 365, - 422, - 440, - 463, - 823, - 489, - 474, - 401, - 422, - 388, - 407, - 443, - 598, - 484, - 488, - 237, - 278, - 404, - 380, - 348, - 413, - 296, - 401, - 513, - 354, - 347, - 400, - 272, - 375, - 399, - 374, - 266, - 348, - 414, - 399, - 437, - 592, - 305, - 605, - 578, - 267, - 361, - 375, - 322, - 333, - 444, - 474, - 428, - 193, - 393, - 371, - 430, - 232, - 393, - 469, - 454, - 581, - 421, - 466, - 374, - 425, - 232, - 479, - 455, - 245, - 706, - 411, - 350, - 266, - 389, - 277, - 336, - 311, - 520, - 476, - 350, - 315, - 254, - 454, - 385, - 776, - 555, - 492, - 543, - 330, - 443, - 380, - 320, - 414, - 322, - 245, - 412, - 380, - 422, - 370, - 282, - 341, - 428, - 507, - 300, - 222, - 294, - 448, - 356, - 283, - 396, - 353, - 276, - 322, - 372, - 596, - 523, - 230, - 570, - 353, - 373, - 546, - 503, - 763, - 424, - 270, - 561, - 486, - 368, - 457, - 542, - 397, - 488, - 253, - 352, - 390, - 387, - 379, - 427, - 565, - 442, - 337, - 342, - 337, - 381, - 414, - 391, - 316, - 227, - 396, - 449, - 513, - 754, - 484, - 614, - 581, - 478, - 259, - 544, - 912, - 515, - 389, - 457, - 483, - 307, - 274, - 603, - 271, - 545, - 364, - 447, - 369, - 654, - 411, - 347, - 380, - 302, - 442, - 486, - 627, - 406, - 632, - 497, - 428, - 405, - 549, - 531, - 767, - 447, - 603, - 598, - 416, - 621, - 594, - 656, - 335, - 398, - 484, - 482, - 267, - 389, - 285, - 498, - 276, - 431, - 328, - 263, - 366, - 288, - 583, - 741, - 470, - 423, - 404, - 417, - 469, - 227, - 479, - 583, - 258, - 254, - 480, - 780, - 446, - 637, - 786, - 699, - 392, - 543, - 568, - 530, - 385, - 483, - 479, - 349, - 596, - 485, - 328, - 285, - 433, - 406, - 435, - 266, - 426, - 492, - 297, - 460, - 325, - 478, - 560, - 415, - 385, - 427, - 411, - 467, - 434, - 403, - 425, - 320, - 420, - 470, - 341, - 289, - 360, - 286, - 522, - 634, - 662, - 537, - 552, - 451, - 528, - 596, - 587, - 297, - 518, - 529, - 370, - 324, - 387, - 260, - 243, - 531, - 561, - 292, - 265, - 442, - 360, - 291, - 287, - 249, - 544, - 261, - 289, - 468, - 313, - 381, - 250, - 266, - 438, - 408, - 383, - 205, - 496, - 285, - 359, - 224, - 385, - 403, - 360, - 314, - 424, - 579, - 471, - 302, - 325, - 387, - 447, - 331, - 389, - 432, - 396, - 537, - 387, - 324, - 356, - 516, - 667, - 328, - 524, - 410, - 371, - 274, - 292, - 350, - 507, - 490, - 448, - 445, - 322, - 217, - 365, - 285, - 492, - 358, - 447, - 395, - 567, - 462, - 405, - 449, - 606, - 487, - 479, - 457, - 436, - 432, - 436, - 351, - 213, - 507, - 455, - 369, - 324, - 365, - 394, - 470, - 438, - 273, - 261, - 352, - 368, - 301, - 268, - 462, - 557, - 236, - 244, - 579, - 555, - 312, - 507, - 409, - 324, - 269, - 396, - 389, - 352, - 527, - 799, - 475, - 371, - 461, - 574, - 602, - 578, - 609, - 316, - 649, - 608, - 284, - 466, - 612, - 637, - 766, - 667, - 374, - 347, - 361, - 214, - 284, - 453, - 367, - 317, - 401, - 517, - 185, - 352, - 489, - 376, - 239, - 263, - 325, - 366, - 303, - 623, - 588, - 461, - 339, - 321, - 334, - 601, - 341, - 326, - 416, - 382, - 315, - 356, - 262, - 417, - 446, - 371, - 551, - 436, - 567, - 312, - 239, - 419, - 325, - 296, - 467, - 909, - 492, - 329, - 193, - 614, - 333, - 421, - 309, - 441, - 418, - 594, - 608, - 384, - 533, - 492, - 535, - 484, - 587, - 470, - 429, - 484, - 289, - 489, - 519, - 387, - 297, - 297, - 210, - 277, - 349, - 225, - 356, - 363, - 344, - 462, - 847, - 359, - 378, - 444, - 404, - 374, - 542, - 415, - 568, - 482, - 434, - 477, - 392, - 349, - 421, - 246, - 381, - 257, - 311, - 357, - 283, - 179, - 273, - 342, - 432, - 180, - 354, - 363, - 293, - 241, - 356, - 253, - 388, - 368, - 407, - 523, - 509, - 508, - 476, - 276, - 428, - 273, - 310, - 426, - 377, - 375, - 321, - 708, - 473, - 332, - 430, - 358, - 404, - 274, - 363, - 250, - 391, - 279, - 376, - 452, - 511, - 249, - 345, - 183, - 382, - 412, - 282, - 311, - 387, - 396, - 647, - 456, - 306, - 376, - 521, - 471, - 284, - 320, - 417, - 651, - 338, - 361, - 353, - 278, - 261, - 550, - 468, - 379, - 272, - 361, - 274, - 352, - 358, - 388, - 320, - 492, - 701, - 450, - 549, - 372, - 416, - 441, - 300, - 639, - 293, - 548, - 244, - 558, - 549, - 642, - 346, - 555, - 560, - 239, - 370, - 390, - 486, - 568, - 349, - 388, - 364, - 504, - 755, - 315, - 364, - 574, - 439, - 337, - 409, - 317, - 436, - 402, - 501, - 573, - 416, - 497, - 487, - 409, - 350, - 279, - 375, - 303, - 260, - 456, - 393, - 354, - 420, - 368, - 287, - 689, - 438, - 292, - 433, - 523, - 359, - 437, - 460, - 637, - 196, - 482, - 485, - 471, - 279, - 370, - 466, - 462, - 498, - 362, - 368, - 490, - 464, - 578, - 311, - 348, - 203, - 389, - 406, - 228, - 276, - 339, - 308, - 504, - 711, - 503, - 689, - 213, - 412, - 529, - 526, - 318, - 428, - 312, - 480, - 239, - 588, - 336, - 786, - 224, - 419, - 532, - 317, - 215, - 298, - 299, - 381, - 237, - 348, - 332, - 252, - 375, - 218, - 362, - 269, - 534, - 516, - 388, - 341, - 398, - 688, - 784, - 509, - 494, - 694, - 592, - 654, - 441, - 251, - 223, - 407, - 434, - 418, - 277, - 271, - 464, - 499, - 455, - 453, - 308, - 187, - 337, - 567, - 412, - 201, - 438, - 590, - 634, - 871, - 238, - 288, - 423, - 310, - 376, - 365, - 402, - 780, - 529, - 261, - 499, - 225, - 394, - 484, - 506, - 509, - 592, - 627, - 314, - 571, - 640, - 451, - 401, - 473, - 607, - 330, - 643, - 306, - 498, - 375, - 395, - 316, - 388, - 514, - 303, - 447, - 420, - 362, - 510, - 408, - 347, - 466, - 428, - 266, - 623, - 434, - 425, - 350, - 381, - 478, - 507, - 511, - 594, - 509, - 304, - 386, - 621, - 471, - 423, - 291, - 391, - 208, - 346, - 294, - 219, - 334, - 277, - 357, - 386, - 286, - 250, - 449, - 304, - 407, - 304, - 359, - 463, - 310, - 355, - 376, - 249, - 309, - 458, - 444, - 381, - 346, - 333, - 236, - 306, - 251, - 255, - 196, - 600, - 468, - 235, - 308, - 338, - 265, - 383, - 432, - 262, - 340, - 542, - 280, - 322, - 272, - 262, - 410, - 352, - 305, - 432, - 365, - 349, - 375, - 384, - 419, - 225, - 560, - 353, - 297, - 436, - 325, - 394, - 319, - 380, - 398, - 310, - 309, - 263, - 418, - 612, - 505, - 689, - 500, - 532, - 541, - 542, - 508, - 638, - 448, - 330, - 559, - 934, - 964, - 470, - 645, - 818, - 725, - 596, - 683, - 425, - 718, - 543, - 486, - 830, - 558, - 457, - 426, - 418, - 493, - 773, - 498, - 275, - 306, - 513, - 277, - 319, - 274, - 378, - 249, - 332, - 607, - 385, - 388, - 435, - 344, - 451, - 446, - 430, - 265, - 305, - 292, - 277, - 252, - 431, - 420, - 267, - 589, - 283, - 337, - 280, - 319, - 390, - 516, - 260, - 470, - 322, - 489, - 345, - 447, - 471, - 364, - 356, - 646, - 276, - 388, - 460, - 614, - 462, - 226, - 503, - 705, - 204, - 570, - 571, - 391, - 389, - 240, - 346, - 388, - 321, - 309, - 413, - 348, - 403, - 327, - 327, - 342, - 318, - 425, - 313, - 378, - 324, - 323, - 501, - 195, - 386, - 363, - 319, - 347, - 300, - 389, - 429, - 484, - 415, - 227, - 425, - 308, - 264, - 464, - 368, - 224, - 302, - 404, - 345, - 402, - 250, - 387, - 428, - 971, - 454, - 300, - 624, - 410, - 338, - 283, - 336, - 404, - 410, - 376, - 320, - 334, - 321, - 327, - 345, - 349, - 407, - 358, - 285, - 394, - 436, - 495, - 358, - 672, - 624, - 285, - 481, - 463, - 529, - 901, - 643, - 560, - 269, - 606, - 449, - 742, - 719, - 590, - 582, - 413, - 485, - 700, - 517, - 516, - 707, - 257, - 508, - 295, - 463, - 481, - 634, - 632, - 688, - 408, - 562, - 653, - 656, - 415, - 608, - 563, - 848, - 414, - 532, - 390, - 363, - 232, - 340, - 369, - 377, - 316, - 402, - 258, - 361, - 434, - 369, - 517, - 422, - 465, - 349, - 259, - 367, - 298, - 320, - 362, - 465, - 300, - 364, - 437, - 283, - 328, - 364, - 385, - 349, - 284, - 300, - 374, - 337, - 363, - 367, - 360, - 274, - 335, - 261, - 295, - 291, - 404, - 293, - 321, - 425, - 530, - 627, - 614, - 607, - 872, - 525, - 281, - 439, - 267, - 378, - 642, - 600, - 553, - 579, - 333, - 287, - 543, - 400, - 654, - 370, - 945, - 654, - 552, - 418, - 683, - 423, - 615, - 746, - 647, - 542, - 474, - 556, - 318, - 487, - 488, - 848, - 770, - 404, - 631, - 964, - 510, - 528, - 330, - 694, - 372, - 612, - 427, - 333, - 351, - 539, - 226, - 387, - 471, - 272, - 468, - 587, - 348, - 291, - 788, - 322, - 553, - 835, - 788, - 880, - 512, - 709, - 435, - 524, - 498, - 455, - 453, - 374, - 389, - 499, - 499, - 508, - 530, - 489, - 540, - 506, - 999, - 748, - 536, - 605, - 569, - 576, - 770, - 589, - 598, - 331, - 450, - 625, - 401, - 705, - 458, - 480, - 523, - 627, - 656, - 405, - 723, - 625, - 206, - 323, - 457, - 357, - 262, - 311, - 314, - 415, - 316, - 542, - 288, - 275, - 357, - 478, - 378, - 400, - 311, - 364, - 228, - 359, - 297, - 237, - 223, - 408, - 332, - 234, - 273, - 372, - 313, - 312, - 380, - 386, - 308, - 366, - 221, - 333, - 352, - 494, - 490, - 263, - 198, - 312, - 362, - 369, - 334, - 237, - 200, - 216, - 224, - 302, - 465, - 424, - 254, - 305, - 391, - 183, - 402, - 398, - 334, - 363, - 342, - 229, - 362, - 334, - 398, - 306, - 354, - 360, - 229, - 242, - 225, - 376, - 310, - 298, - 280, - 219, - 283, - 319, - 294, - 279, - 264, - 466, - 328, - 293, - 518, - 314, - 406, - 336, - 521, - 468, - 403, - 403, - 377, - 904, - 405, - 416, - 379, - 419, - 448, - 493, - 447, - 671, - 551, - 500, - 677, - 522, - 440, - 435, - 420, - 304, - 408, - 556, - 339, - 405, - 408, - 392, - 422, - 517, - 483, - 450, - 435, - 440, - 495, - 423, - 527, - 472, - 301, - 553, - 425, - 270, - 530, - 566, - 713, - 474, - 518, - 566, - 273, - 787, - 699, - 804, - 878, - 413, - 512, - 755, - 543, - 394, - 589, - 747, - 472, - 610, - 290, - 376, - 877, - 298, - 674, - 629, - 332, - 834, - 458, - 217, - 523, - 471, - 432, - 521, - 615, - 1085, - 649, - 730, - 521, - 859, - 933, - 688, - 784, - 485, - 472, - 477, - 455, - 407, - 304, - 297, - 546, - 483, - 718, - 611, - 636, - 1150, - 473, - 428, - 592, - 386, - 488, - 397, - 700, - 250, - 375, - 428, - 469, - 793, - 233, - 481, - 532, - 416, - 390, - 512, - 320, - 304, - 385, - 444, - 537, - 291, - 353, - 460, - 496, - 550, - 362, - 453, - 464, - 330, - 259, - 512, - 425, - 515, - 424, - 237, - 276, - 442, - 380, - 378, - 242, - 285, - 587, - 243, - 499, - 245, - 473, - 256, - 236, - 421, - 622, - 289, - 395, - 526, - 647, - 481, - 355, - 355, - 1188, - 632, - 434, - 347, - 583, - 438, - 571, - 472, - 540, - 544, - 306, - 321, - 464, - 330, - 746, - 519, - 365, - 383, - 434, - 498, - 326, - 374, - 504, - 940, - 468, - 359, - 424, - 373, - 392, - 352, - 461, - 552, - 394, - 354, - 416, - 490, - 347, - 384, - 482, - 356, - 396, - 498, - 455, - 828, - 486, - 583, - 495, - 304, - 632, - 313, - 431, - 566, - 557, - 511, - 597, - 499, - 564, - 326, - 935, - 958, - 768, - 652, - 489, - 632, - 726, - 1032, - 493, - 579, - 777, - 722, - 926, - 702, - 680, - 902, - 392, - 763, - 989, - 345, - 819, - 900, - 681, - 388, - 437, - 581, - 595, - 697, - 673, - 364, - 665, - 473, - 495, - 471, - 571, - 984, - 596, - 748, - 803, - 592, - 299, - 409, - 742, - 428, - 1129, - 876, - 1092, - 758, - 635, - 323, - 696, - 842, - 781, - 768, - 768, - 618, - 463, - 241, - 235, - 454, - 640, - 284, - 489, - 533, - 573, - 474, - 419, - 352, - 544, - 659, - 400, - 487, - 487, - 450, - 503, - 463, - 455, - 416, - 622, - 409, - 335, - 300, - 335, - 456, - 548, - 455, - 280, - 300, - 406, - 497, - 506, - 446, - 489, - 312, - 409, - 456, - 428, - 515, - 364, - 565, - 334, - 504, - 546, - 425, - 563, - 286, - 490, - 518, - 387, - 603, - 630, - 540, - 382, - 466, - 446, - 449, - 450, - 453, - 445, - 217, - 296, - 334, - 336, - 201, - 311, - 404, - 386, - 284, - 353, - 268, - 296, - 212, - 327, - 341, - 377, - 336, - 195, - 221, - 421, - 439, - 249, - 404, - 270, - 325, - 163, - 222, - 262, - 273, - 252, - 175, - 229, - 194, - 200, - 327, - 564, - 536, - 682, - 309, - 570, - 623, - 517, - 515, - 494, - 526, - 337, - 568, - 565, - 562, - 476, - 813, - 567, - 595, - 567, - 322, - 556, - 957, - 403, - 483, - 473, - 477, - 462, - 507, - 537, - 293, - 641, - 702, - 476, - 430, - 585, - 289, - 456, - 413, - 558, - 416, - 482, - 410, - 384, - 765, - 394, - 321, - 549, - 355, - 456, - 540, - 705, - 557, - 421, - 260, - 573, - 356, - 528, - 484, - 538, - 526, - 418, - 352, - 608, - 541, - 523, - 680, - 394, - 644, - 714, - 507, - 437, - 367, - 711, - 580, - 704, - 540, - 324, - 589, - 723, - 573, - 420, - 667, - 1027, - 484, - 635, - 485, - 521, - 758, - 540, - 542, - 404, - 310, - 529, - 819, - 396, - 624, - 560, - 691, - 393, - 565, - 438, - 306, - 676, - 439, - 563, - 482, - 1023, - 558, - 625, - 551, - 417, - 518, - 452, - 410, - 425, - 597, - 472, - 635, - 475, - 485, - 496, - 420, - 491, - 402, - 391, - 462, - 643, - 405, - 401, - 671, - 783, - 438, - 409, - 415, - 481, - 488, - 530, - 542, - 512, - 356, - 444, - 567, - 480, - 417, - 458, - 415, - 483, - 584, - 570, - 416, - 658, - 344, - 727, - 774, - 527, - 446, - 581, - 409, - 280, - 516, - 715, - 739, - 491, - 613, - 293, - 509, - 233, - 428, - 251, - 440, - 512, - 599, - 496, - 567, - 536, - 243, - 281, - 442, - 303, - 406, - 360, - 388, - 381, - 728, - 439, - 571, - 489, - 371, - 418, - 413, - 302, - 373, - 879, - 394, - 419, - 583, - 408, - 471, - 387, - 350, - 469, - 323, - 395, - 255, - 252, - 261, - 419, - 427, - 442, - 355, - 431, - 448, - 490, - 464, - 302, - 597, - 373, - 292, - 491, - 380, - 467, - 649, - 403, - 387, - 417, - 319, - 383, - 800, - 970, - 1242, - 879, - 825, - 915, - 739, - 599, - 957, - 693, - 1186, - 753, - 807, - 737, - 821, - 841, - 810, - 722, - 591, - 1136, - 1197, - 541, - 1050, - 889, - 895, - 603, - 612, - 659, - 769, - 526, - 474, - 987, - 906, - 556, - 684, - 1238, - 600, - 769, - 817, - 845, - 801, - 713, - 694, - 1201, - 685, - 823, - 1187, - 792, - 541, - 556, - 731, - 700, - 994, - 850, - 582, - 830, - 991, - 658, - 555, - 646, - 759, - 588, - 971, - 613, - 779, - 710, - 671, - 703, - 844, - 826, - 660, - 847, - 965, - 794, - 961, - 726, - 686, - 509, - 306, - 185, - 237, - 304, - 524, - 291, - 449, - 355, - 411, - 493, - 756, - 499, - 238, - 221, - 300, - 446, - 477, - 331, - 603, - 449, - 304, - 251, - 173, - 498, - 406, - 294, - 278, - 160, - 258, - 413, - 336, - 451, - 328, - 178, - 377, - 320, - 207, - 412, - 449, - 241, - 429, - 583, - 502, - 853, - 588, - 656, - 589, - 644, - 389, - 564, - 913, - 566, - 518, - 695, - 672, - 498, - 357, - 457, - 494, - 694, - 255, - 606, - 468, - 632, - 372, - 474, - 672, - 471, - 568, - 655, - 638, - 484, - 368, - 694, - 387, - 638, - 317, - 625, - 678, - 600, - 595, - 555, - 397, - 440, - 537, - 366, - 385, - 486, - 500, - 695, - 568, - 491, - 728, - 436, - 541, - 654, - 481, - 407, - 517, - 263, - 263, - 456, - 456, - 518, - 348, - 268, - 579, - 643, - 337, - 461, - 276, - 730, - 296, - 447, - 464, - 484, - 442, - 351, - 553, - 544, - 588, - 449, - 415, - 435, - 448, - 465, - 510, - 381, - 519, - 335, - 326, - 491, - 378, - 711, - 474, - 275, - 313, - 353, - 606, - 495, - 469, - 376, - 429, - 384, - 340, - 238, - 427, - 539, - 461, - 486, - 466, - 452, - 615, - 459, - 550, - 403, - 304, - 317, - 512, - 882, - 457, - 484, - 409, - 428, - 775, - 646, - 432, - 768, - 399, - 633, - 544, - 896, - 665, - 324, - 551, - 674, - 749, - 683, - 409, - 577, - 398, - 532, - 395, - 616, - 678, - 429, - 578, - 508, - 530, - 886, - 556, - 844, - 321, - 425, - 492, - 591, - 841, - 556, - 584, - 716, - 872, - 760, - 748, - 620, - 360, - 556, - 345, - 387, - 228, - 509, - 348, - 246, - 310, - 314, - 247, - 407, - 423, - 231, - 196, - 334, - 398, - 196, - 249, - 365, - 245, - 188, - 273, - 351, - 334, - 403, - 161, - 366, - 148, - 227, - 418, - 355, - 500, - 249, - 222, - 371, - 398, - 382, - 332, - 335, - 328, - 382, - 215, - 356, - 246, - 297, - 353, - 250, - 361, - 273, - 323, - 302, - 248, - 180, - 234, - 341, - 344, - 267, - 413, - 222, - 439, - 211, - 251, - 209, - 390, - 340, - 365, - 176, - 208, - 410, - 355, - 308, - 258, - 308, - 339, - 409, - 291, - 388, - 336, - 220, - 191, - 258, - 257, - 298, - 234, - 497, - 275, - 203, - 345, - 267, - 297, - 340, - 413, - 297, - 351, - 219, - 212, - 209, - 232, - 309, - 263, - 285, - 379, - 216, - 532, - 341, - 273, - 345, - 195, - 448, - 454, - 316, - 254, - 257, - 263, - 394, - 428, - 450, - 277, - 410, - 268, - 347, - 452, - 343, - 347, - 342, - 207, - 347, - 313, - 391, - 412, - 398, - 373, - 285, - 228, - 336, - 318, - 429, - 427, - 371, - 439, - 324, - 368, - 718, - 382, - 260, - 379, - 331, - 340, - 404, - 357, - 408, - 334, - 290, - 284, - 272, - 374, - 354, - 217, - 415, - 385, - 472, - 481, - 367, - 252, - 351, - 456, - 337, - 399, - 411, - 310, - 221, - 294, - 466, - 281, - 529, - 397, - 383, - 330, - 484, - 254, - 334, - 199, - 363, - 473, - 271, - 418, - 455, - 382, - 338, - 545, - 421, - 444, - 397, - 533, - 339, - 673, - 257, - 535, - 365, - 486, - 247, - 298, - 408, - 204, - 540, - 476, - 484, - 442, - 358, - 358, - 435, - 313, - 418, - 348, - 321, - 300, - 591, - 591, - 364, - 425, - 561, - 367, - 692, - 557, - 404, - 506, - 369, - 358, - 513, - 387, - 545, - 346, - 524, - 298, - 459, - 605, - 378, - 290, - 742, - 338, - 216, - 349, - 588, - 478, - 407, - 329, - 353, - 582, - 405, - 572, - 364, - 366, - 409, - 611, - 535, - 334, - 423, - 186, - 449, - 353, - 232, - 431, - 655, - 476, - 408, - 279, - 648, - 270, - 279, - 420, - 572, - 249, - 235, - 303, - 252, - 350, - 217, - 265, - 305, - 186, - 258, - 202, - 259, - 588, - 192, - 206, - 293, - 241, - 338, - 198, - 343, - 300, - 247, - 226, - 267, - 294, - 276, - 336, - 310, - 244, - 302, - 300, - 409, - 331, - 376, - 423, - 435, - 347, - 241, - 300, - 316, - 257, - 308, - 398, - 230, - 359, - 300, - 286, - 163, - 144, - 251, - 195, - 348, - 292, - 255, - 333, - 263, - 158, - 282, - 277, - 365, - 199, - 426, - 284, - 437, - 328, - 296, - 272, - 348, - 338, - 249, - 243, - 280, - 323, - 292, - 363, - 297, - 299, - 341, - 346, - 205, - 332, - 335, - 307, - 184, - 186, - 215, - 305, - 296, - 357, - 410, - 399, - 300, - 377, - 466, - 290, - 367, - 324, - 297, - 432, - 380, - 386, - 338, - 370, - 296, - 227, - 368, - 231, - 365, - 321, - 408, - 342, - 360, - 438, - 369, - 419, - 308, - 520, - 347, - 240, - 228, - 350, - 413, - 296, - 375, - 333, - 433, - 497, - 337, - 266, - 331, - 395, - 365, - 422, - 369, - 330, - 384, - 265, - 213, - 581, - 369, - 492, - 231, - 315, - 227, - 395, - 183, - 386, - 353, - 243, - 382, - 316, - 356, - 295, - 321, - 358, - 313, - 336, - 339, - 349, - 488, - 385, - 347, - 289, - 347, - 474, - 299, - 361, - 289, - 434, - 378, - 340, - 364, - 409, - 371, - 482, - 384, - 458, - 499, - 282, - 383, - 290, - 470, - 356, - 382, - 194, - 345, - 330, - 310, - 397, - 462, - 540, - 262, - 304, - 284, - 349, - 321, - 400, - 353, - 391, - 245, - 359, - 375, - 352, - 292, - 255, - 243, - 422, - 412, - 299, - 290, - 419, - 323, - 414, - 322, - 359, - 348, - 312, - 250, - 373, - 212, - 296, - 191, - 436, - 559, - 459, - 424, - 348, - 302, - 491, - 152, - 568, - 394, - 207, - 372, - 462, - 245, - 406, - 753, - 299, - 446, - 397, - 419, - 408, - 329, - 254, - 636, - 343, - 305, - 440, - 366, - 400, - 225, - 395, - 380, - 336, - 395, - 244, - 365, - 330, - 425, - 390, - 367, - 378, - 392, - 450, - 298, - 349, - 410, - 432, - 419, - 366, - 359, - 382, - 422, - 466, - 417, - 361, - 364, - 410, - 402, - 372, - 243, - 327, - 394, - 277, - 359, - 336, - 300, - 292, - 325, - 300, - 429, - 464, - 276, - 450, - 405, - 434, - 504, - 505, - 381, - 653, - 489, - 303, - 446, - 304, - 346, - 502, - 347, - 491, - 435, - 211, - 556, - 300, - 298, - 537, - 479, - 302, - 326, - 323, - 576, - 520, - 473, - 459, - 353, - 415, - 444, - 364, - 474, - 515, - 374, - 406, - 514, - 663, - 878, - 283, - 554, - 613, - 558, - 428, - 625, - 483, - 468, - 408, - 504, - 409, - 633, - 380, - 557, - 492, - 521, - 442, - 319, - 682, - 337, - 433, - 550, - 448, - 321, - 529, - 412, - 194, - 537, - 763, - 438, - 488, - 478, - 626, - 402, - 536, - 625, - 453, - 498, - 428, - 452, - 238, - 595, - 245, - 289, - 601, - 501, - 475, - 554, - 477, - 431, - 351, - 682, - 600, - 319, - 380, - 681, - 588, - 348, - 295, - 246, - 510, - 516, - 505, - 488, - 395, - 546, - 430, - 272, - 797, - 603, - 441, - 527, - 292, - 471, - 427, - 614, - 408, - 406, - 404, - 441, - 575, - 362, - 506, - 221, - 368, - 448, - 332, - 491, - 417, - 459, - 392, - 538, - 303, - 466, - 527, - 477, - 381, - 294, - 588, - 464, - 355, - 443, - 383, - 503, - 600, - 512, - 404, - 391, - 370, - 399, - 559, - 705, - 286, - 411, - 531, - 628, - 652, - 511, - 541, - 385, - 421, - 562, - 181, - 213, - 257, - 417, - 263, - 657, - 394, - 540, - 440, - 341, - 310, - 269, - 384, - 310, - 434, - 535, - 290, - 327, - 346, - 345, - 275, - 484, - 285, - 249, - 286, - 328, - 383, - 311, - 398, - 285, - 247, - 252, - 269, - 241, - 259, - 316, - 434, - 336, - 244, - 242, - 382, - 409, - 315, - 240, - 458, - 231, - 221, - 389, - 430, - 282, - 345, - 307, - 354, - 366, - 430, - 531, - 334, - 364, - 257, - 566, - 343, - 306, - 423, - 321, - 343, - 349, - 379, - 265, - 370, - 378, - 351, - 319, - 239, - 374, - 213, - 605, - 231, - 382, - 427, - 281, - 466, - 342, - 410, - 290, - 328, - 461, - 571, - 421, - 327, - 256, - 377, - 547, - 370, - 217, - 317, - 430, - 355, - 345, - 218, - 471, - 565, - 157, - 791, - 482, - 367, - 445, - 387, - 309, - 356, - 393, - 351, - 632, - 475, - 512, - 484, - 520, - 221, - 490, - 501, - 440, - 545, - 505, - 398, - 442, - 607, - 438, - 514, - 746, - 688, - 760, - 623, - 613, - 825, - 814, - 717, - 499, - 350, - 254, - 306, - 409, - 512, - 419, - 525, - 438, - 457, - 572, - 295, - 419, - 533, - 466, - 914, - 616, - 242, - 599, - 334, - 702, - 596, - 378, - 712, - 216, - 800, - 504, - 329, - 425, - 682, - 728, - 303, - 592, - 191, - 332, - 232, - 217, - 549, - 307, - 355, - 541, - 219, - 303, - 223, - 295, - 330, - 404, - 291, - 416, - 346, - 277, - 452, - 325, - 285, - 406, - 447, - 520, - 380, - 420, - 232, - 390, - 360, - 380, - 368, - 426, - 229, - 357, - 344, - 235, - 387, - 304, - 265, - 422, - 268, - 380, - 290, - 301, - 441, - 197, - 393, - 358, - 277, - 326, - 308, - 317, - 473, - 363, - 399, - 316, - 252, - 329, - 487, - 375, - 473, - 333, - 353, - 424, - 264, - 331, - 210, - 294, - 309, - 339, - 261, - 309, - 301, - 231, - 384, - 332, - 395, - 341, - 340, - 348, - 377, - 270, - 318, - 316, - 261, - 307, - 424, - 321, - 272, - 261, - 239, - 283, - 374, - 359, - 320, - 227, - 298, - 303, - 292, - 247, - 308, - 232, - 385, - 509, - 425, - 317, - 348, - 301, - 323, - 274, - 331, - 574, - 295, - 308, - 223, - 294, - 334, - 230, - 331, - 345, - 431, - 486, - 307, - 298, - 245, - 422, - 362, - 378, - 309, - 274, - 260, - 427, - 251, - 338, - 286, - 432, - 783, - 336, - 390, - 436, - 434, - 226, - 306, - 331, - 322, - 235, - 266, - 267, - 314, - 461, - 376, - 502, - 397, - 422, - 458, - 342, - 225, - 210, - 255, - 317, - 244, - 254, - 223, - 524, - 169, - 357, - 279, - 402, - 444, - 267, - 318, - 387, - 413, - 375, - 324, - 279, - 353, - 520, - 218, - 313, - 260, - 400, - 280, - 299, - 245, - 394, - 446, - 239, - 359, - 295, - 299, - 273, - 251, - 244, - 280, - 285, - 267, - 281, - 282, - 334, - 311, - 271, - 293, - 371, - 290, - 329, - 337, - 334, - 290, - 328, - 397, - 319, - 393, - 285, - 374, - 425, - 264, - 320, - 388, - 277, - 274, - 281, - 260, - 346, - 506, - 391, - 243, - 391, - 286, - 313, - 279, - 289, - 248, - 259, - 524, - 419, - 605, - 454, - 486, - 311, - 262, - 379, - 340, - 336, - 315, - 425, - 439, - 337, - 354, - 241, - 383, - 270, - 490, - 1248, - 896, - 486, - 709, - 692, - 603, - 602, - 517, - 728, - 599, - 444, - 555, - 698, - 502, - 476, - 547, - 710, - 535, - 559, - 733, - 506, - 568, - 448, - 649, - 681, - 593, - 545, - 294, - 704, - 396, - 327, - 507, - 442, - 336, - 249, - 490, - 364, - 717, - 710, - 556, - 235, - 302 - ], - "y0": " ", - "yaxis": "y" - } - ], - "layout": { - "boxmode": "group", - "legend": { - "tracegroupgap": 0 - }, - "margin": { - "t": 60 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } + "output_type": "stream", + "name": "stdout", + "text": [ + "Collecting transformers[torch]\n", + " Downloading transformers-4.32.1-py3-none-any.whl (7.5 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m7.5/7.5 MB\u001b[0m \u001b[31m17.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (3.12.2)\n", + "Collecting huggingface-hub<1.0,>=0.15.1 (from transformers[torch])\n", + " Downloading huggingface_hub-0.16.4-py3-none-any.whl (268 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m268.8/268.8 kB\u001b[0m \u001b[31m27.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (1.23.5)\n", + "Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (23.1)\n", + "Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (6.0.1)\n", + "Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (2023.6.3)\n", + "Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (2.31.0)\n", + "Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers[torch])\n", + " Downloading tokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m7.8/7.8 MB\u001b[0m \u001b[31m43.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hCollecting safetensors>=0.3.1 (from transformers[torch])\n", + " Downloading safetensors-0.3.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.3/1.3 MB\u001b[0m \u001b[31m44.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (4.66.1)\n", + "Requirement already satisfied: torch!=1.12.0,>=1.9 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (2.0.1+cu118)\n", + "Collecting accelerate>=0.20.3 (from transformers[torch])\n", + " Downloading accelerate-0.22.0-py3-none-any.whl (251 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m251.2/251.2 kB\u001b[0m \u001b[31m32.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: psutil in /usr/local/lib/python3.10/dist-packages (from accelerate>=0.20.3->transformers[torch]) (5.9.5)\n", + "Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.15.1->transformers[torch]) (2023.6.0)\n", + "Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.15.1->transformers[torch]) (4.7.1)\n", + "Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from torch!=1.12.0,>=1.9->transformers[torch]) (1.12)\n", + "Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch!=1.12.0,>=1.9->transformers[torch]) (3.1)\n", + "Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch!=1.12.0,>=1.9->transformers[torch]) (3.1.2)\n", + "Requirement already satisfied: triton==2.0.0 in /usr/local/lib/python3.10/dist-packages (from torch!=1.12.0,>=1.9->transformers[torch]) (2.0.0)\n", + "Requirement already satisfied: cmake in /usr/local/lib/python3.10/dist-packages (from triton==2.0.0->torch!=1.12.0,>=1.9->transformers[torch]) (3.27.2)\n", + "Requirement already satisfied: lit in /usr/local/lib/python3.10/dist-packages (from triton==2.0.0->torch!=1.12.0,>=1.9->transformers[torch]) (16.0.6)\n", + "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->transformers[torch]) (3.2.0)\n", + "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->transformers[torch]) (3.4)\n", + "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->transformers[torch]) (2.0.4)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->transformers[torch]) (2023.7.22)\n", + "Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch!=1.12.0,>=1.9->transformers[torch]) (2.1.3)\n", + "Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy->torch!=1.12.0,>=1.9->transformers[torch]) (1.3.0)\n", + "Installing collected packages: tokenizers, safetensors, huggingface-hub, transformers, accelerate\n", + "Successfully installed accelerate-0.22.0 huggingface-hub-0.16.4 safetensors-0.3.3 tokenizers-0.13.3 transformers-4.32.1\n" ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "width": 640, - "xaxis": { - "anchor": "y", - "domain": [ - 0, - 1 - ], - "title": { - "text": "NUMTOTV" - } - }, - "yaxis": { - "anchor": "x", - "domain": [ - 0, - 1 - ], - "title": { - "text": "words per case summary" - } } - } - }, - "text/html": [ - "
" + ], + "source": [ + "!pip install transformers[torch]" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# statistics of summary length\n", - "df[\"words per case summary\"] = df[\"SUMMARY_EN\"].str.split().apply(len)\n", - "print(f\"Overall number of words by case summary: min {df['words per case summary'].min()}, \"\n", - " f\"average {df['words per case summary'].mean():.0f}, max {df['words per case summary'].max()}\")\n", - "fig = px.box(df, x=\"NUMTOTV\", y=\"words per case summary\", width=640)\n", - "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"text_length\"}})" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "mrk7jvqtWNvZ" - }, - "source": [ - "Not surprisingly, the length of the descriptions correlates with the number of vehicles involved.\n", - "\n", - "The average length is above 400 words.\n", - "As we will see later in this notebook, this poses some challenges with the NLP models that we are using in this notebook,\n", - "because these are limited to text up to a length of 512 so-called \"tokens\" (vocabulary items).\n", - "Since a single word may be tokenized into more than one token, some accident descriptions will be truncated.\n", - "\n", - "Let's examine one of the English texts and its German translation:" - ] - }, - { - "cell_type": "code", - "execution_count": 7, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 138 }, - "id": "A-eL7RyAWNva", - "outputId": "f55d85be-49e2-4221-ff01-b6b1c4ba7c5a", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "text/html": [ - "V1, a 2000 Pontiac Montana minivan, made a left turn from a private driveway onto a northbound 5-lane two-way, dry asphalt roadway on a downhill grade. The posted speed limit on this roadway was 80 kmph (50 MPH). V1 entered the roadway by crossing over the two southbound lanes and then entering the third northbound lane, which was a left turn-only lane at a 4-way intersection. The driver of V1 intended to travel straight through the intersection, and so he began to change lanes to the right. He did not see V2, a 1994 Pontiac Grand Am, that was traveling in the second northbound lane. The northbound roadway had curved to the right prior to the private driveway that V1 had exited. As V1 began to change lanes to the right, the front of V1 contacted the left rear of V2 before coming to final rest on the roadway.\r", - " \r", - " The driver of V1 was a 60-year old male who reported that he had been traveling between 2-17 kmph (1-10 mph) prior to the crash. He had no health-related problems, and had taken no medication prior to the crash. He was rested and traveling back home. He was wearing his prescribed lenses that corrected a myopic (nearsighted) condition. He did not sustain any injuries from the crash and refused treatment.\r", - " \r", - " The Critical Precrash Event for the driver of V1 was when he began to travel over the lane line on the right side of the travel lane. The Critical Reason for the Critical Precrash Event was inadequate surveillance (failed to look, looked but did not see). Associated factors coded to the driver of V1 include an illegal use of a left turn lane (cited by police) and an unfamiliarity with the roadway. As per the driver of V1, this was the first time he had driven on this roadway. \r", - " \r", - " The driver of V2 was a 28-year old woman who reported that she had been traveling between 66-80 kmph (41-50 mph) prior to the crash. She had no health-related problems, and had taken no medication prior to the crash. She was rested and on her way home. She does not wear corrective lenses. She sustained minor injuries and was transported to a local trauma facility.\r", - " \r", - " The Critical Precrash Event for the driver of V2 was when the other vehicle encroached into her lane, from an adjacent lane (same direction) over the left lane line. The Critical Reason for the Critical Precrash Event was not coded to the driver of V2 and no associated factors were coded to her." + "cell_type": "code", + "execution_count": 3, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "HDmc_CXBZmQz", + "outputId": "c6634041-ec17-42a0-de9d-95d21682dc7b" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Collecting datasets\n", + " Downloading datasets-2.14.4-py3-none-any.whl (519 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m519.3/519.3 kB\u001b[0m \u001b[31m6.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.10/dist-packages (from datasets) (1.23.5)\n", + "Requirement already satisfied: pyarrow>=8.0.0 in /usr/local/lib/python3.10/dist-packages (from datasets) (9.0.0)\n", + "Collecting dill<0.3.8,>=0.3.0 (from datasets)\n", + " Downloading dill-0.3.7-py3-none-any.whl (115 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m115.3/115.3 kB\u001b[0m \u001b[31m9.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: pandas in /usr/local/lib/python3.10/dist-packages (from datasets) (1.5.3)\n", + "Requirement already satisfied: requests>=2.19.0 in /usr/local/lib/python3.10/dist-packages (from datasets) (2.31.0)\n", + "Requirement already satisfied: tqdm>=4.62.1 in /usr/local/lib/python3.10/dist-packages (from datasets) (4.66.1)\n", + "Collecting xxhash (from datasets)\n", + " Downloading xxhash-3.3.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (194 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m194.1/194.1 kB\u001b[0m \u001b[31m8.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hCollecting multiprocess (from datasets)\n", + " Downloading multiprocess-0.70.15-py310-none-any.whl (134 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m134.8/134.8 kB\u001b[0m \u001b[31m6.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: fsspec[http]>=2021.11.1 in /usr/local/lib/python3.10/dist-packages (from datasets) (2023.6.0)\n", + "Requirement already satisfied: aiohttp in /usr/local/lib/python3.10/dist-packages (from datasets) (3.8.5)\n", + "Requirement already satisfied: huggingface-hub<1.0.0,>=0.14.0 in /usr/local/lib/python3.10/dist-packages (from datasets) (0.16.4)\n", + "Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from datasets) (23.1)\n", + "Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from datasets) (6.0.1)\n", + "Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (23.1.0)\n", + "Requirement already satisfied: charset-normalizer<4.0,>=2.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (3.2.0)\n", + "Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (6.0.4)\n", + "Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (4.0.3)\n", + "Requirement already satisfied: yarl<2.0,>=1.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (1.9.2)\n", + "Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (1.4.0)\n", + "Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (1.3.1)\n", + "Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0.0,>=0.14.0->datasets) (3.12.2)\n", + "Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0.0,>=0.14.0->datasets) (4.7.1)\n", + "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests>=2.19.0->datasets) (3.4)\n", + "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests>=2.19.0->datasets) (2.0.4)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests>=2.19.0->datasets) (2023.7.22)\n", + "Requirement already satisfied: python-dateutil>=2.8.1 in /usr/local/lib/python3.10/dist-packages (from pandas->datasets) (2.8.2)\n", + "Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas->datasets) (2023.3)\n", + "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil>=2.8.1->pandas->datasets) (1.16.0)\n", + "Installing collected packages: xxhash, dill, multiprocess, datasets\n", + "Successfully installed datasets-2.14.4 dill-0.3.7 multiprocess-0.70.15 xxhash-3.3.0\n" + ] + } ], - "text/plain": [ - "" + "source": [ + "!pip install datasets" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "display(HTML(df.loc[0, \"SUMMARY_EN\"]))" - ] - }, - { - "cell_type": "code", - "execution_count": 8, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 156 }, - "id": "74OyQip6WNva", - "outputId": "8ba860d0-896b-45c9-bbf3-591576815eda", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "text/html": [ - "V1, ein Minivan der Marke Pontiac Montana aus dem Jahr 2000, bog von einer privaten Einfahrt nach links auf eine zweispurige, trockene Asphaltstraße mit 5 Fahrspuren in nördlicher Richtung und einem Gefälle ab. Die zulässige Höchstgeschwindigkeit auf dieser Fahrbahn betrug 80 km/h (50 MPH). V1 fuhr auf die Fahrbahn, indem er die beiden Fahrspuren in Richtung Süden überquerte und dann auf die dritte Fahrspur in Richtung Norden einfuhr, die an einer Kreuzung mit vier Fahrspuren nur für Linksabbieger vorgesehen war. Der Fahrer von V1 beabsichtigte, geradeaus über die Kreuzung zu fahren, und begann daher, die Spur nach rechts zu wechseln. Dabei übersah er V2, einen Pontiac Grand Am von 1994, der auf der zweiten Fahrspur in Richtung Norden unterwegs war. Die Fahrbahn in nördlicher Richtung war vor der privaten Einfahrt, aus der V1 herausgefahren war, nach rechts gebogen. Als V1 begann, die Spur nach rechts zu wechseln, berührte die Front von V1 das linke Heck von V2, bevor er auf der Fahrbahn zum Stehen kam. Der Fahrer von V1 war ein 60-jähriger Mann, der angab, vor dem Unfall mit einer Geschwindigkeit von 2 bis 17 km/h unterwegs gewesen zu sein. Er hatte keine gesundheitlichen Probleme und hatte vor dem Unfall keine Medikamente eingenommen. Er war ausgeruht und auf dem Weg nach Hause. Er trug die ihm verschriebenen Kontaktlinsen, die eine Kurzsichtigkeit korrigieren. Er zog sich bei dem Unfall keine Verletzungen zu und lehnte eine Behandlung ab. Das kritische Ereignis vor dem Unfall war für den Fahrer von V1, als er begann, die Fahrspurlinie auf der rechten Seite der Fahrbahn zu überfahren. Der kritische Grund für das kritische Ereignis vor dem Unfall war unzureichende Überwachung (nicht hingesehen, hingesehen, aber nicht gesehen). Zu den assoziierten Faktoren, die dem Fahrer von V1 zugeschrieben werden, gehören das illegale Benutzen einer Linksabbiegerspur (von der Polizei verwarnt) und die Unkenntnis der Fahrbahn. Für den Fahrer von V1 war es das erste Mal, dass er diese Fahrbahn befuhr. \r", - " \r", - " Bei der Fahrerin von V2 handelte es sich um eine 28-jährige Frau, die angab, vor dem Unfall mit einer Geschwindigkeit von 66-80 km/h unterwegs gewesen zu sein. Sie hatte keine gesundheitlichen Probleme und hatte vor dem Unfall keine Medikamente eingenommen. Sie war ausgeruht und befand sich auf dem Heimweg. Sie trägt keine Korrekturgläser. Sie erlitt leichte Verletzungen und wurde in eine örtliche Unfallklinik gebracht. Das kritische Ereignis vor dem Unfall war für die Fahrerin von V2, als das andere Fahrzeug von einer benachbarten Fahrspur (gleiche Richtung) über die linke Fahrspurlinie in ihre Spur eindrang. Der kritische Grund für das kritische Vorunfallereignis wurde der Fahrerin von V2 nicht zugeordnet, und es wurden ihr keine zugehörigen Faktoren zugeordnet." + "cell_type": "code", + "execution_count": 4, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "fap9tsxwa5QR", + "outputId": "aeedeeb5-7779-4ed8-f34e-6e0d3526c601" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Collecting transformers_interpret\n", + " Downloading transformers_interpret-0.10.0-py3-none-any.whl (45 kB)\n", + "\u001b[?25l \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m0.0/45.8 kB\u001b[0m \u001b[31m?\u001b[0m eta \u001b[36m-:--:--\u001b[0m\r\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m45.8/45.8 kB\u001b[0m \u001b[31m1.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hCollecting captum>=0.3.1 (from transformers_interpret)\n", + " Downloading captum-0.6.0-py3-none-any.whl (1.3 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.3/1.3 MB\u001b[0m \u001b[31m19.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: ipython<8.0.0,>=7.31.1 in /usr/local/lib/python3.10/dist-packages (from transformers_interpret) (7.34.0)\n", + "Requirement already satisfied: transformers>=3.0.0 in /usr/local/lib/python3.10/dist-packages (from transformers_interpret) (4.32.1)\n", + "Requirement already satisfied: matplotlib in /usr/local/lib/python3.10/dist-packages (from captum>=0.3.1->transformers_interpret) (3.7.1)\n", + "Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from captum>=0.3.1->transformers_interpret) (1.23.5)\n", + "Requirement already satisfied: torch>=1.6 in /usr/local/lib/python3.10/dist-packages (from captum>=0.3.1->transformers_interpret) (2.0.1+cu118)\n", + "Requirement already satisfied: setuptools>=18.5 in /usr/local/lib/python3.10/dist-packages (from ipython<8.0.0,>=7.31.1->transformers_interpret) (67.7.2)\n", + "Collecting jedi>=0.16 (from ipython<8.0.0,>=7.31.1->transformers_interpret)\n", + " Downloading jedi-0.19.0-py2.py3-none-any.whl (1.6 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.6/1.6 MB\u001b[0m \u001b[31m71.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: decorator in /usr/local/lib/python3.10/dist-packages (from ipython<8.0.0,>=7.31.1->transformers_interpret) (4.4.2)\n", + "Requirement already satisfied: pickleshare in /usr/local/lib/python3.10/dist-packages (from ipython<8.0.0,>=7.31.1->transformers_interpret) (0.7.5)\n", + "Requirement already satisfied: traitlets>=4.2 in /usr/local/lib/python3.10/dist-packages (from ipython<8.0.0,>=7.31.1->transformers_interpret) (5.7.1)\n", + "Requirement already satisfied: prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0 in /usr/local/lib/python3.10/dist-packages (from ipython<8.0.0,>=7.31.1->transformers_interpret) (3.0.39)\n", + "Requirement already satisfied: pygments in /usr/local/lib/python3.10/dist-packages (from ipython<8.0.0,>=7.31.1->transformers_interpret) (2.16.1)\n", + "Requirement already satisfied: backcall in /usr/local/lib/python3.10/dist-packages (from ipython<8.0.0,>=7.31.1->transformers_interpret) (0.2.0)\n", + "Requirement already satisfied: matplotlib-inline in /usr/local/lib/python3.10/dist-packages (from ipython<8.0.0,>=7.31.1->transformers_interpret) (0.1.6)\n", + "Requirement already satisfied: pexpect>4.3 in /usr/local/lib/python3.10/dist-packages (from ipython<8.0.0,>=7.31.1->transformers_interpret) (4.8.0)\n", + "Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from transformers>=3.0.0->transformers_interpret) (3.12.2)\n", + "Requirement already satisfied: huggingface-hub<1.0,>=0.15.1 in /usr/local/lib/python3.10/dist-packages (from transformers>=3.0.0->transformers_interpret) (0.16.4)\n", + "Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.10/dist-packages (from transformers>=3.0.0->transformers_interpret) (23.1)\n", + "Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from transformers>=3.0.0->transformers_interpret) (6.0.1)\n", + "Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from transformers>=3.0.0->transformers_interpret) (2023.6.3)\n", + "Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from transformers>=3.0.0->transformers_interpret) (2.31.0)\n", + "Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /usr/local/lib/python3.10/dist-packages (from transformers>=3.0.0->transformers_interpret) (0.13.3)\n", + "Requirement already satisfied: safetensors>=0.3.1 in /usr/local/lib/python3.10/dist-packages (from transformers>=3.0.0->transformers_interpret) (0.3.3)\n", + "Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.10/dist-packages (from transformers>=3.0.0->transformers_interpret) (4.66.1)\n", + "Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.15.1->transformers>=3.0.0->transformers_interpret) (2023.6.0)\n", + "Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.15.1->transformers>=3.0.0->transformers_interpret) (4.7.1)\n", + "Requirement already satisfied: parso<0.9.0,>=0.8.3 in /usr/local/lib/python3.10/dist-packages (from jedi>=0.16->ipython<8.0.0,>=7.31.1->transformers_interpret) (0.8.3)\n", + "Requirement already satisfied: ptyprocess>=0.5 in /usr/local/lib/python3.10/dist-packages (from pexpect>4.3->ipython<8.0.0,>=7.31.1->transformers_interpret) (0.7.0)\n", + "Requirement already satisfied: wcwidth in /usr/local/lib/python3.10/dist-packages (from prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0->ipython<8.0.0,>=7.31.1->transformers_interpret) (0.2.6)\n", + "Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from torch>=1.6->captum>=0.3.1->transformers_interpret) (1.12)\n", + "Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch>=1.6->captum>=0.3.1->transformers_interpret) (3.1)\n", + "Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch>=1.6->captum>=0.3.1->transformers_interpret) (3.1.2)\n", + "Requirement already satisfied: triton==2.0.0 in /usr/local/lib/python3.10/dist-packages (from torch>=1.6->captum>=0.3.1->transformers_interpret) (2.0.0)\n", + "Requirement already satisfied: cmake in /usr/local/lib/python3.10/dist-packages (from triton==2.0.0->torch>=1.6->captum>=0.3.1->transformers_interpret) (3.27.2)\n", + "Requirement already satisfied: lit in /usr/local/lib/python3.10/dist-packages (from triton==2.0.0->torch>=1.6->captum>=0.3.1->transformers_interpret) (16.0.6)\n", + "Requirement already satisfied: contourpy>=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->captum>=0.3.1->transformers_interpret) (1.1.0)\n", + "Requirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.10/dist-packages (from matplotlib->captum>=0.3.1->transformers_interpret) (0.11.0)\n", + "Requirement already satisfied: fonttools>=4.22.0 in /usr/local/lib/python3.10/dist-packages (from matplotlib->captum>=0.3.1->transformers_interpret) (4.42.1)\n", + "Requirement already satisfied: kiwisolver>=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->captum>=0.3.1->transformers_interpret) (1.4.4)\n", + "Requirement already satisfied: pillow>=6.2.0 in /usr/local/lib/python3.10/dist-packages (from matplotlib->captum>=0.3.1->transformers_interpret) (9.4.0)\n", + "Requirement already satisfied: pyparsing>=2.3.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->captum>=0.3.1->transformers_interpret) (3.1.1)\n", + "Requirement already satisfied: python-dateutil>=2.7 in /usr/local/lib/python3.10/dist-packages (from matplotlib->captum>=0.3.1->transformers_interpret) (2.8.2)\n", + "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->transformers>=3.0.0->transformers_interpret) (3.2.0)\n", + "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->transformers>=3.0.0->transformers_interpret) (3.4)\n", + "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->transformers>=3.0.0->transformers_interpret) (2.0.4)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->transformers>=3.0.0->transformers_interpret) (2023.7.22)\n", + "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil>=2.7->matplotlib->captum>=0.3.1->transformers_interpret) (1.16.0)\n", + "Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch>=1.6->captum>=0.3.1->transformers_interpret) (2.1.3)\n", + "Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy->torch>=1.6->captum>=0.3.1->transformers_interpret) (1.3.0)\n", + "Installing collected packages: jedi, captum, transformers_interpret\n", + "Successfully installed captum-0.6.0 jedi-0.19.0 transformers_interpret-0.10.0\n" + ] + } ], - "text/plain": [ - "" + "source": [ + "!pip install transformers_interpret" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "display(HTML(df.loc[0, \"SUMMARY_GE\"]))" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "2Gb03bROWNva" - }, - "source": [ - "To get an impression of the most frequent words, we generate a simple word cloud form all English case descriptions.\n", - "By default, the word cloud excludes so-called stop words (such as articles, prepositions, pronouns, conjunctions, etc.),\n", - "which are the most common words and do not add much information to the text." - ] - }, - { - "cell_type": "code", - "execution_count": 9, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 542 }, - "id": "fUhYGO10WNvb", - "outputId": "12256faa-ccc0-4689-d1e3-84e69bc35dda", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "word_cloud", - "format": "svg" - } - }, - "data": [ + "cell_type": "code", + "execution_count": 5, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "PzHnOM3JZq7G", + "outputId": "5b67ae59-6d9e-4442-a2e6-6eaf1abe0529" + }, + "outputs": [ { - "hovertemplate": "x: %{x}
y: %{y}
color: [%{z[0]}, %{z[1]}, %{z[2]}]", - "name": "0", - "source": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAADICAIAAABJdyC1AADxxklEQVR4XuyddXjcVtbwjzQaZvKYmSlxHCaHqWmStilzt7ClLW3bLWy72227pe2WGVPGpG2YOQ44cWJmZs94GAXfH3LGGo3GHjvUfb/+njx5RueCpGvp6J5zz70XoSgK/uAP/uAP/hdA2YJzwLMHdjeZB9hSBi0WM1sURJ/Tccv6tWwpAAC8XLz/to2/vFy8n50QmnDO+PvEaXnM3BnHlv7BH4QNQZH+/4eBON2XwUlyxMxjxucjuvusPh/RZ7LTh/SPUGBswTngyRlz2CIGfU7Hp6eO/2PWPHZC2Oxtbf7tiuvY0tCc+Rn/4Kzgsb/Dl1yOonp2wu+JY31tV+74gi0F+EvurPtyZ7Glvw+8JNHnsmtFUqvXHSGWOXEviqDtDrPF6y7Uxf7SUj7DkHSgp2mGIUkpEDPzEBRp93kMYrmL8O3sqJscEa8XyYwex+He1hUJOS7C5/B5xRifzuMliQGP0yCWs09/mnCabs/ROgEfa2zr7+qz/uWGOT9sOk7/kIoFgYUGCVBYFMBD2zd5CaLf5Xy2aEGqWvP03p1Gt9Ptw++eOKXAEAUATMl4Q9Tf92w3e9wenHh8+uwklRoAfq6p/K2uWsjD5iQkXZWd92Hpsa8rTr23dEWGRhdcf1V/35vHimtM/Q/t2LwwKWVJctpLxftbrWaXz/fItFkZGh0APLprq8PrVYlEzEulqR8wfXbqeLvN+tCOzdNj4i7LzAk+Bet6WGdcnJwWfAu3rF+bb4hstZgnRcdcnZ3PPusfnA0oyu6yvoyJ5gOXwvLixL665jSDNl6jYiVRFBxoaJEK+AXx0aykUHhxwuhwRimHXq3Krt7sqAhGlv9TbG2vEfJ4XU6bFBPMjU7d292oF0kpClAEAYAup21HZ53F697ZWecjSWaeUmOnWihemZD7W2uFG/fRtRnEcrpgk830XcOJCLGczvNZ7ZF2h+WJ8QtkfCHz7KMiIVqz71hDpF6REq8Ti/gRWjn9g53vNAEKCwF4dcFSANjSWLe5oe7uiVMOdbR+s+oKrVhCZ6AAmJKtjfUqkejZogVtVssz+3d9uGyVye36svzkj5deRd8hANw2fmK1sZ+z/nsmTsnS6W8rmLi2pvKZ2fMBoKS70+H1vrVoeZN54PmDez9ctvJYVwcC8Nbi5Yc62j48cYyux0+qWvNs0YKTPd3/mb+ElrBOcU1uPut6WGcMvgUAaLGan5o1N1Gpoov8wbkA9+wDwNnS02A8lIciu2sab5g2gZW0s6ahode4OCedPtxcUbswK42HDv59OXH7fH02B1NhfXHoxL8vXczI8n+KZIV2R0etTiQ1e118lEeQ5OHe1suTxx3saQaAGKlSL5KeMnVZvG6lQMTMk6zQ6kVSJ+7FENTq89C1NViNtZY+giKP9bWKMT5d3Il7oySKDGWEBOPuCoVJWmJESoIeRRCSolAEWVaUQ/9g5ztNgMKyeT1P7d2hFIp6HPYUtQYBeH7Owkd3blUKhU/NmqsUiliSRvNAmloLAHEKZZvVCgBtFku6RhvqfKz62ckADQOmo10d92xdDwCpag0AtFmtdK8nTPXBOsXw1wMAwbcAAGKMP/zpcG+xx/4u7j1OUXYUUfME+WLlsygvlk51mO4ABJGoXnVbn/W6NgJlR3mJUs2HKJY0WNr5o9f1C+mrIakBFI3gixaJFH9DECldnCJNbturPvcOkuxFEAUPSxJIrhBIrho8NwAAj8DrXZZ/EN6jgIgwQaFY8ffTlYcH5XPb3/Q6fyLJThTV88XLRfKHEUQMACTRZe2ZKpTdKlb8nVnC3r+KJHoUhoMAyDDFAcBpeYz0VYpV/wl1hS7rv33uzSTeDAC23gWnzwCq6Cb/A4kiSKRS3moyA4Dd4/1w31EfQawYlwUAv5ZWaaTiLos1Qauq6Oz59EBJi9E8MSGmMCHGX5XN7Xlj50EUQVaOz06L0K4pPpGoVefHRpqd7jd3HTTIZQiCsGrOjOTo6P2Pkq0yZCoj/FrgsqR8+sflSeMAYFVCLgDMMCTRQlYeuobVSeP8hykK7YN5RQBwfdok5ot0aWJAkTFD1+CvZ/gKA5zuO5obE5Tqf8yaNyM2gZZMjIr56KJVBZHR31aWBUtSNZpakxEA2qyWOIUCAGIVijqTMdS4Y3D9AMBHUadvsPOZotbk6CPeWrT8rUXLH502CwBi5PJmsxkA2qwWf5FhYJ2C83qYZwy+BQAYrsEAvK6f7P1XEniDUHq7RPWKQHojRblR1MDMQxHdDtOtJGkSKx4RKZ5CsUSU53+dMI/jSwRVCeV3SZQvY8KZHsdnbuvz/rIO0+1e1wah9AaJ6j8i2Z0IqiCJHn8qAACCOoxXoahWrPyXUHoz7jlkN90IVMjeShCUY+AOj/09vni5RPkyX7zK61jjMN0IQAIAyovChNN9rl/oQxqSaMO9JQLJpQDI8MVpCF+Nw3h1qCsUiJdLlC8IpdcDgET1H5n2e/ofAM9fA5Ofj1cY5LJpyfEf7D2SGamflZa4PD9zanI8AOREG9IidLfOnMjUVgBgcbltbu+fZk7Mjorg83jL8jK6LDYA+KW08pLxOVdPHufBcVbNzOIXhLZe82VPfsqWjhVOLcDSBZx5WKlM2MeBecoau25/+XtG4jkhoIc1KSrmi7LSTptVyMOUIqHJ7Xpo+yapQODwemnHOUuSrNbsbW2+Z8t6D4E/Pr0IALRiyRVZuTev/1nK50+PiV+Wmv760UPHuztfP3JoVnzC7LhEZv30SdM1uh6H/a7Nv12WmTM/MXlfa/Ndm38DgLkJSZdn5U6Ojv2+qvyeLevjFMrhu/00rFtgXc+1ueOAfcYU1i0MD0XZXZa/o1iSXL8RQQYtZYD7mHkAAPeWiGR3ixR/ow+F0huYqXL9ev9vgWQ1SXT43FvEyucAgKI8uPeISH6vUHYnnUEIt/szD0L5+KLlYuU/6CMElbks/8R9xzHB5IBsIfC5N/vc26Sa9/miZbQE5UW6LE/73Nv5okUAIBBf5jQ/gHsOYcIZdAavcx0tD6c4AFCUQyC6KtQV8vh5AEDgFQDAE4zjYRl0tlA4PN5olVyIYbfP5rjBoNcKACBWrbx//vSP9x+bnZY0I3Xo6+j0+aRCgUQg4CEIjFTzH/wOCVBYMXLFT5ddzZR8uvxS5qFGJGZJaE8Qkyuz867MzvMfsgbjWPUDgIDH+2LFav/h/ZOnMxIBAF457Z8KBXOIMPgWWNcDQWcMvoVhxhxxzwGKtIkVTzC0FTdC2W1sUQh4WBbuOQBAAPAQRMjDUrzOb3n8HL5ocahOh0B6rf83jz8OAEiiDSCst87n2oAgEr5oyIODCWcDAO45SGscvngpYnnC61rrV1g+1888QQGKJYdTnOZMrhAAmvoH1p6obDWZk/XaleOz3t5VHKtR5kYbgg23nGjDy1v3Lc5OY/rg63qNWyvqfARJAbSazD+VlNf1GtMNukXZae/uLk7SaUR8PgAMX3M49A7YX/p6Z3uf2YcTq2blXb94IgC89NXO9Hj9lsM1Zrtr4aT0Wy6a8sGvh7Yfq8V4qEIqeuHPy1UyMQDsKW348LdDJEnhBPmPW5bIJUKKgn9+uqWuvY8kqX/dujQlRsc+32kOljW9u+4gQZKJkZrHrl8glwg5r4QlnFOQev8ba3969mYAKK3r+ODXQ+88tBq4LphTWNbY9eaP+5wer1wseuLGBbF6FQDsPlH/1k/7FVJhdmIk8wrDweY+aHL8TPfNE7SvspO5CFBYfzAiJN4CACiWxk4IBEFkCKplS09D+E55HGsIbylJ9gHlpCjauzlouUo0HzgHHnCY7kB5EQLxFQLpzSiPPZ7l95cBAIIIAQAor18yPATeTFFOc2ciS06RZvoHgkj5oiU+90aKeg5BhISvnMDr6Q4ghFGc5kyuEACSdOrHlg51eJ+7ZBFOkBgPBYDVhblD+QCumpTvxQkBFqDZ0yK0iVoViiA8FAWAhxfP9if9+9IlKEK7sCBapWDWPAae+WzLrPzkV+5eAQBu75BVvvlw9Wt/uUQkwHCCBIDLivJvu3gagsBbP+3feKjymoWFAPDZxiNP3LAwK8Hg9uIYD+0yWlt7Bp66adH4tJgfdp1cs+XYP2/h/lSbbM7nv9j++RPXaJXSr7cdf/2HvU/euJDzSljCPrOdWQ8T1gUHC70+/MWvdrz70OVyiXD7sdqXvt71xn2XuDy+59ds//Txq2P0yle+2cWoLywGnOvjNM+iCEcAQCj+UFijhVYrIz3fSMhxWZ9nl8N4C4+fI5TfxcPSEFTptr3ldX7jz8DD0uT69bjnoNf5tdvxvsfxiUT9Nl805JwGAL+He0yQCKqVnFZAflBsSMUIJJd5XT/jnh180TKvay0gfIH44tOJIxeHM71CAAAfQfB5Q2poGJ3C0lY0zLJMSIrkoQFJdM0nW7ridSq1dBSXTZDk8dqO1++7hD4UCYbepjkFqfQhXfmB8uZNh6okIn5Hv2X2uBQ6z+Vzxz3xwcYlUzIvLcrXKaUAEKGWjU+LAYC0WN2uE3X+2liUN3RlJ0ZqlVIAWDo169pnvuC8Ek5hKFgXHCysbOtr7R6447SXir7gpi6TQSOP0SsBYNa45Nr2Pn/Z4SFIu5fo4KESh+cYxtMDgJg/gmeAZrh7+INgUCwOAEi8EQQT2Wnh4bF/iCCYTPctgsgGRZQzIAcAAGDC6Zhwuohotxuvdln+zlJYZwKKJRK+Kr5oISAhB6Qx4UyUZ/A61/FFy3yuDXzhPARV00nhFA8PLufTaUx258e7ji3KTxuXEOX0+FxeX7vJkh0bUdbaHaVWRKnkfVaHy+sjKSpRr67t6hdgvES9ut/msLu9Qj4WpZIDQEV7j0EpkwgEdPG8uEiz0+WvtqqjVyOTGJQyADjV2n2qtUstFY9KYdGR4AjXjTC1Q2vPwPu/HPzhmRslIsFH64u9PoKWL5uWPTM/+bcDFbf8+5tnb7tILReLhYzv3GCHmwOE4cylgIIQVxIsZPr7nJ7BcScaTnUWKKSidMqvn76eIQEAyl/nMF+UYHCy3+rajaF6p7eCloxFYR2rbttQXEVSFAD88+aAKJUvP9m75sM9TAnNn+9fdOmVU9jSs8RDd35eVtrKlgL865WrpswYwSgLk9bm/n/+7Ye2ln6mcOKUlOdfu4Yp8YMJZiKI1OP4iC9eOWjpjBocQeR+bUWRAz7PfkYqxXyTUV4sJpjkdf3CyHCmCEQX+Vy/eRyfCWUsdz7z1ChffInX8RnuPUwSHX73OYRbfGQQVAMAFNELXE53H0FaXW4hHwOAuu7+X0uqFuWnmewunCRf33TghauXfH2wNDNaf6CmZcm49MYeU3q0LlGv/upAaW5s5KG6lvuXztxYWh2plG8qrVmYl0YXRxDEX+3641UIgvxwuOzexdN3ljeopOKK9t6irGT2dQwLxkPzU6LW7Su7tCgfAJxur0TEocRtTo9cIpSIBF4fvre0cWpOAi3vM9v1Ktm1iwqNVsephs6i8YM9rxHJT45++etd/RaHTindXFw9JTuB80qChRq5xGhxWp1uhUS0+0Q9u95hSYnW2Zye47XtE9JjKQoGbE6NQpIYpe0yWjv7rdE6RXFFC7tMaIRYokFxh9NbLhHkWt17h1PPgQQorG3Hav927Tz6KWFRND+bU2Ht3119jhSWxeysONXGlgJIZcLCyaN7sEKxZ0flq8/95nKNwreCoAqx8mmn+VF731KBZDXCi6SIHp9nv0T5HIolsnNzgQlnuz2HXJanMNE8iuhw2z9AeXqCNNKphLfUaXmEL1yAYgmA8Alvmdf5s0C8KqCKM4MvXsZ3X+SyPkvg1ZhgMgBJ4M0+9xaZ9luUF+XPJpCs9tjfc1tfQFAVXzg0LhFm8RHBBJMRROSyPC2U3QGIkCLNQulN/lSDUqaRSTKjBx3h09Lip6TG7axo6DRZbS4PAJAktSgv3eJwJ+jVDT3Gky1dk1PiSJIqykqyutzdFlu70XLF1Hw6fIEuzqz215LKKJU8TqP04URz/8BDU3L7bXb/2cPn6ZsXv/jVzh92nSQpavn0bNrVzSI7MTI1Rnf9v76SiYVTsuP98ufXbO/ot2A8VKeSPbNkks1JuzJHRikTPXnDwgffXIcTZKxe9fgNCyDElQQLb7lo8vX/+kqrkMwen9Lea2bVPAxCAfbK3Ste/W630+0lKeqaBRNWzMyVCPmPXbfg3td+UsslM/OT2GVGwuT4kc/TW107KconF81AwjD4AnJEauSl9Z06hRQAUmICfMZxCbqklIimhl6mEAAqTrWZBxwqtZQlP3MO7q0hSQ69O31WBsbndk+ED0GQH765/efvDrMTwkAguRrlxbjt77ltb1LgQVENj1+IoEp2vhCIpH+mSIvPtc7j/BLlxYmkt6H8DHv/pXQqgsWiWIrX9SNJ9COIAOXFihQPi6ThDjiGByJVv+MRfOZ1fudz/QrAR3kxfNFCBFUxM/GwDB4/B/ceE0qvD3TJhVV8RFBejETzgdv6ssvydwAU5acxFRYA4AT5Q3HZ5VPzAIB2krcbLXT3n4Y2RswOFwJIh8kKACiCfLn/RGOvafmEzCmp8R/uONJvcywryBz0sQPA6Wrn5aQeqmuRCgU6uXRKatwbmw+29A1MSxvs+4RPlFbx2l9WsYSPXDuPeYgg8OxtgyEgTP4bWFAlE9PjdwAwPi2GHr8LxeTs+DXZQ+OwEOJKgoU3LJl0w5JJ9O+blg4O2rIuOJQwO9Hw0aNXsoTzCtPmFQ6aO/4Kw4QCqsP8QrTqYaP9O6CocDroCHN5ma1Ha3pOT5W+fnGhX07z1Sf7Pv9wN0sIAPc/etGyVRPY0jPmiQe/OXqIo9d65vagqd/+ryd+5Oy+0XCahD4SLzWXx0tiDKKxjH//wRhg+d0BgCBJeuCPiceH02bBaxv3/2XJDOT0ICBnZjhdLUlSgAyGPobKCeHN4P0DTkZsOoK0EaRZgMW5fDW0D8uG2534kEvXIGKPjwf0sBZN4vAm+ClakM2psPbvrh6DwiJJyv9gBeN0eE4ca2JLAWQy0Rnag6dOtDz35E8DJgc7YSQwlMdDeCUDp5ZFDdlHo6LYWDJZU4Ai3C/GHwQTPNLHqVb8Toyi7GSU4ZDmzAynqw0n5x+cU7xEh8W5lQICABUrMwCgx91bb29odrSkyVIrrdX3pv2ZVSRAYe04Xjd/QsjOS2y8NjnV0FgfOE0EoLSkyWH3SGVCu909YHRo9XKX06PVyW1WV1+vNSpGjaIon8/zeXGrxaXSSC1mp1wuOrS/Lr8gXqM9PVIWyOGDdfjpwRQm04vOyB784atDH7+zg9PSHBEEEI1A1e3uBQCLz7aha7sddyyJnNvu6up19/d7TNO0hTnKDBfhXtexGaeI2bopCdKhkf5GR+tvndu73L1ZirRWZ0eiJLbT1aPgyxOlcRu7dlAA8yNmRosNQ+f7g9FTkDgUO3o+KTV1CFFeliryu6bjlyaM4weGTfxBKPpsn8mEU3iowuk9RUtSZckIgF6oK1QXDPgGCIrkBX7gAxTWqYauYRQWAMyelxWssHCcPHygdt7iPBRF62q69u2qUijF8xbn8XhoVUVHU0OvWiNLTNYf3FuTmhG1ddOpni5zZk6Mxx0wqsriwO4atggAAIrmZ7NF4eFyel/+1y/7d1ezE8aEki9fZCiqttUfM53ko/wUWcKyqPkfN32To8zY1XtQI1AZRPq1HZvuTx/yPSVL4+Ml0SuiF/MQ9MRAuYfw+khfj6e/wd680FCkE2o+avzqjhTWmPEf/A/gI4lN7ZVWn1srlPhI8g9tFT48VCkTTh5wrvcRvRTlQxA+AKTIknf37vu29cdsRSZLWwFLYcnFwic/2mRQywHg3stmMpNoZs/P/uyD3WwpwP7d1fMW5xn7ba3N/XEJWrVG5nZ5NVqZSMQncPLUiZbEZL1YIsjMjm5t7k9KibBZXXabm13LabxenNN7JVeICyaNxR5saez752M/tLcOjsQxUaokFjNHGNTw7Os7bPZZY8SRBEXyAVR8pQDl095AF+HSC7UClL8qJjhMedAGEaICCigEQXjAcxFuMU/IQ1B8FLOX/7/G5fC4nV61Xs5OuEDwUd7tGdN9JBEpVrDT/mBYDPLbMZ6Wz9MLsGhaWwGAyTvQ5GiJEOnaXO15qhxWcFmAwrpi7jgfzmGI+YmN1yanGRrr2J2so8UNHg8eF6+96fY5fmF1RQefj81fnEWRFIIi8xfnAcCiZfn0If2/PzOTksONnKEG02dnYBhb447Irm3l//33ereLo0OnNyge+fvKh+/h8AsG0+nq2dNX3O3ujRFH8VBet7vXQ3qCZ7TP1k/7sX29QahLlrGHnJJl8V+1/DRVOyFCpDN5zVGiiDZn57yIGd+1/SpEBVO17FGOESEpqsbSd8rYWTHQ3e6wdDqtJo/Thfs8hI+HoBJMIMb4UkwQLVXESVVxMlWqQlegjVEJRxEbOVr63I4jva0l/e1NNmOr3Wz2upw+L0FREoyvFIjiZepkhXaSPm5qRIJONJaRZWOPtXh7eXSibrQKq97av6+r8YSxo8Fq7HHZHT4PBSDlC7RCSbJCm6uOnBWZnKeJCv6DjujeMnocKsEIE0vDpNlmKu5tPWnsaLYNtDnMdp/HifswFBXz+FqRJE6mylBGFOpipxoSpGe2CtWoOHdNZ/ccVkmWaaSXMoU2ny1DkWb1We24g6Iolp87QGH9vLesqduEE6RYwH/yhgXMJD+z52UHKyyP23esuH5GUSZTmJkTk5kTAxAQmOs/DKWtAODAHm7DrWjB6OxBHCc/eGPruh+OshMAACA6VvPim9f5GPO/hidabLgx8XL/4WTNeAwJaL27Um8EAL1Qc2fKDQRF8BC2abDQMNtH4nwUS5en0BJaSd2afA1FUaNyxhf3tvzaUrGjo67fzT16QFCE1+sye10AUG8NCItNkmsm6GLnRacWRaeIecx4hbHjI4l1zeVrm8uO9LZyOghtPo/N52l3WA72NH9ZV4IiyNSIhCuSxy2Lz6YXTggTiUxoG3AOSG3shBCQFPVLS/nntcfKTF3sNACzx2X2uBqsxm3ttf8t2xsnVV2bNuHa1EIJNtQsspFUw0/NJyfp4kU8LEs16tm/NFav+7vGk2uby2rM7LAhACAI0kPgZq+rwWrc3dkAAEIeNjc69Ya0wikR7I/iWeQ8NJ3De1wlYQd8JEjj212dRo+pkGuEKuCVu2npJAAgSPKD34opinvhjqL52Z+9v4stBTiwp4alsMYGQZDF+2vZUgCFUlwwMYktDU1/n+3Zx3+sLG9nJwAAQFpm1HOvXq1SS4OVb5iwtBWLYG1Fw0c5SiEQerg0EArgl+by96oO1VnCnbQVTJPN1GQz/dR0SsTD5kWnvT59VfC3MXxIivq24cRbFQd6XOEqEQAgKepgT/PBnubXy/f9NX/OkrhwnxyXw6ONVJr77cP00P2UGjufPLqxiksLcNLmML9QuvPTmqNPFMy/KH7w66gUjNAhnR2Z8lHtIT7K0wolAPDX3FEMIntJ4sOq4o9qDlu9IT0kwXgIfHNb9ea26kJd7D8KF2erz/5YzflpOhSRNxvv4/MiASBG9ZhfPkM3dYZu6lA+BgHvT0e/xe3BcZJs6jQRJPcU9pg4DadVWLyvFsfJMZhsLMpOtFotLrYUYEZRJo/rejg5WdL83N9/Ng9w9z6mzkx//JlLRWI+AHjD7mFdcMpN3U8e28T5uRsbbgL3UcSZaKsmm+nhw7+d6O9gJ4RNk81094GfF8VmPDdpqUY4smElU4hdTo9IIhhRW31Sc+TFkztxcmjtgTDpcdn+cnDdwZ7mpwsXC1DeiFeVqTT8LX8hSZERotFZqadMXQ8X/8bq/46Kkv72VVs/+XPW9PvzZp/J35HFeWs6vfxGimL7aurtjXyUnyCJ29W7d5Z+OqtnEHBQ0dTdY7IjKFy3qJBTW9EUzeewCu1298mS5sIpY3GKM9m/p4otAoBRjg+eKGkOpa1WXzP1trsX+B93H1fwxO+Qj6oPv3Jqt488y1d7VXIBWxQ2e7oa7ju4znZ65e8zYWt7TcVA9wezLs9UsQMFWQhE/BU3zMSH9bQCwAulOz+sLmZLR8O3DaWdTut7M1cLeZhCIBq+B6QTSgc8zh6XTSeShWnhrm0uf/zIBu8Z/0EJinq78kDZQNfbMy5jmmNj5nw2HRY0OwKn8COmYw7coeArCIoItmMCtFKEWnb94sLrFhbSU8BDEUp37N/NrWvCh6Lg4B6OgAalSjKuMJEtDc2NtxZNmpbKEvL5vIefWnn7vQuZH+fwfVgXCoKiHjuy4d+lO866toqSKGZHjfEDs7618ra9358VbUXT4bBcsX3N8X5uE95PW0Pvrl+Of/36VnYCg7crDpzhK0ezt6vx3oNrSYrSCUcYH+h2WV+r3P1bW/kndYeYk4dC8XHN4b8W/3rm2srP3q7Gm/d868C97IRRcp6bzuLafvrHNvoHhmDLo5ZeFrvqyrjLrom/YijraYYUGElSx2s78pKjAGBHSV1WgoFzmSEAiI7VpKRFNtR1s+SH9tX+5eFlI/bVh6GmsqO/j8MVMmPOKOxBAEBQ5LFnLrnnpo86OwZoiUYn+8cLV9CDAEx+5z0sCuCBQ79saK1kJ3CBIohOJNWJpEIeBhTYfB6L19UXwisPAKuT8sdmR2zvqH3w0K9E6DcTAchURWSrI2OlSilfAAAOn7fdYak291aZe0K90g7ce/Oe776ce02eJoqddhqNXj51QU5a3lBELovtHbX/LdvDljLgIcg4bUyO2hApUYh4mJvA+1z2JpvpeH97sP7d0VH379IdIoz9nWdh8jgn6uKNHofZ4+K+NwbfNpQ+f2IHW8pAyMMKdbGJco1aKFYJxA7ca/I4Ox2Ww72twVfo51hf230H130w6/Kx/U3hQjSdzX1IKV4AAE7vKYVoLoJgAKDgD2dZD1W383jdntKGjj4LIDCMtqIpWpAdrLBMRntleXtOfhxLHj6hAjtD9emGQSYTPf3iFffd9onb5cvIiv7HS1dodRwNMaJxcWF5sXTHiNqqUBe7MDZjkj4uW20QBEUtOnBvnaW/2txzsKflUE+zyTMYdIYiyOXJ4wLzhkW9tf/BQ7+G2gpYJ5LemjnlksS8UFELAx7nuubyj2oOdzs5vkx2n+eOfT/+uviWUMVbaru9Hry73RiTqA/+NJo8zsePbgqlMsQ8/q2ZU65PK9RyVU5Q1P7uxg+rDx/qaWbKP6k5wjzkJFsVWWft63JaFkRnDm8SHu9vf7pkM1t6msn6+D9nT5sakSDkcbznBEWd6G9/p/Lgnq4GdhoAAOzqrH+9fN8DeUPLq4bPBWk6FBEZHT9iqMaDt9DaCgCMXtMPbT/TMwofzPhLQAGmwlowMT1Gr8xKCGvEYfb87E/e3cmWAuzfXX0mCoszoEGllo6bkMiWhkFSSsRDT6wo3l/7wGPLBVzrkwEAjnO/eL8HtrXXflh9mC1lcHFCzt3Z09OUenYCAykmGK+NHq+NviqlgAKoMHWvb61Y31qVptTFSJXs3COBk+S9B9aGMj2uTi14fPyC4T0paqHk5ozJ16ROeLVsz8fVh4PfENpx+9W8aznfe5lS0t9jGT89PVhbAcALpTuNIXqU6Ur9+7NWx8vU7ITT8BCkKCqlKCplY1vV40c2BncZQuHAvU7cOz0iaXpE0m9t5ZN0QwvIsLB63fccWMvpzFYLJa9OXTG8hc5DkIn6uE+KrjzY03zvgbV0zAqLdysPLoxJz9VEshNG4oI0XbTqIYtrN0nZ4tTP+YVGj3G2fmabs52gyOCpOQEHYWorAIiOUaemczQKp8YJk+bG3o42E1sKMHNOJnOe6qgomp/96NOrQmkrACB+rz0ss8f15LFNbOlpdCLpF3OveW3ayuG1FQsEIFcT+bfx8/etuOe/01ayk8Pg/apDtVwRFQjA04WLnp24dHht5UfIwx4bP/8/01YEz70AgMO9Ld/UH2dLAQAAQRGL0b71ew49XmfpW9tcxpYCAECGKuK7+dcP88oxWRaX9fW865QCETshBF82HN3QXkH/O2kabsD05VO7OYM/UhTatQtvGl5bMZluSPxuwfWce8QTFPmPki1s6UhcqKZzeatNjh9FWKrDW+IXJsuSIkUGvVCHIkjw48E+Dp/ZXGZad6e5vpZtKobJWZ8/GA7noodVY+1kiwAgtJyTNyv2hwoKTZCpf1l0y3RDIjshbBAA1UgxMsH0uR3vVB5gSwEA4N7cWTekTWRLR2JlQu5TExaypQAA8NLJXZw9CNqHNe8SjlkB71dxO7ylmOD9masVYb9FAJCtNrw2bRVbGoIrEgtuSp1C/7snK6Q5VmXu/bbhBFsKIOMLP5p9RZxMxU4YllSF7tVpKzg/4yeMHTs7OWa2DcOFajqT82et7AqctDo9p6jTU9OaHa023D5BPV6ICoPnq51lhQWh/VAjwllQrZHmFySwpWcPkqt/TrOju4wM4akZnu9buN/qUPJgup22r0N0MTRCyVfzro2UsL+uNY3sQJOzzgdVh9wE+wECgAm62HtzOGaehsN1aYULY9PZUgCbz/NxkDlMUZTXg7udXqmcrW0HPM4NrdyD1PfnzR6tOgCA2VHJKxNy2VIu1IxoozRFyA7v2xX7OZXC85OWhdl/YTE1IuHKlAK2FADCcB4xuYBNhwDf42vxEZ0evJX2YdFhDVu7t3/X9lOXu3uEsIZRER2jTs3gGM0Zm1XY02UO9uIDwMy5WZzeirMFSXA8QwBQbe34unnfmqY9JweazV7HmzUb36jZ2OLo+7mtuMzcsr6jZH9fdZ/b6sA979ZteaNmY52ty+JzvlL16+eNu1lTBJjy7d2nOl0DALCmaTcAMIszi3xZXxJqzPs/U1dESRRsKcAPmzi+3mcRJ+7l7CAAwD8KF415ZAoAnpqwiHOFg89rjzkDnWUUSZUdbtiz/sTGrw9SgWsErW+t4myxCLHs+jSO7lg43JM7Y+x3FUirfWBLO4cBkaeJuig+iy0Nm9syp7BFAABQ3NPcah9gS0NwAZvOoLibAsKDt0cpH6AlowhrAIDS+o7xqTEAcLKhc1xKNDOJk6L52fU17MDrlsa+9lZjbLyWJR8ezu4VnGN7EAA4P3oAkKmISZEbrk8q4iHoh/XbL42fGilSvVi5VsWXuQifl/B1uEzTdRk/tB7UCxWxEu1njbtzVXEXxUyIk+herFzHrGpj53G/vMdtSZIZAKDF3gcA6zuO+Ys/N+5qOj9BUT83nWLW4GdZXBbL02GxuT7+/qBeI0MABizOb9eXWO3u1UsLSivb2rvMkXqFw+W95fJpzCSdWrrm58Muty8pTrtsbu4Xa4/gOLFkdnZqYsjeAQBsbKt24uygZACYE52So+bwZoZPtERxaVLedw2lLLkD9/7WUnllyni/BOWhU+Zn7/rluEQmYn3GtnKpAwC4KqWAUxuGQ7JcO9WQyBr5Ghs/NZVxPml3Zk9ni0ZDolwzWR9/pK+VJacAtrbX3hpCnbG4gE1nc++NkN/CEg4f1jDUw6LjsAiSJEhyR0mdNwxv9Ox53B+HUNpnGDiLaHSyvHEhx1zOPYOvhIvwSnlCHoL6SELM45MUhSAIhqAogjhwjwQTClDsxuQ5btwr4QklPAEauCAGU44CQo994BQJAMzi/vxHelt6XHb/oR8E4C+5bMtr857KZXNyL1k83usj1ErJpYvHFWTH7jta39jav6Qom8/nudxeAGAmldd05mZEz56cqlFJN+wq12tkE/MTPl/Ltr9Y/NZSwRYBAMCVyePZotFzVQjT5ucgT7Dd6iYIUh+tYgqduO9wL/ulpbk44Yw+eMvCm+Ro9blpY9lLEhVm9iccAH5pLmeLAFRC8cIYDnN4VMyPSWOLAABgd4jQBxYXtukcXg6/R7e7p9Ja/Vvnxk+a1rDTwo/DCh5fBICoGHVaZlRdNfsvdGB39VU3zGAJh2HA5OCcpTxrzrm1B4cnUxHzVs2meZG5K2Invle3VcwTzI/Mc+CePrc1TqJrtPcAwLLoCR81bI8Ra7KUsXMjcz9p2Jkg1YsCl0BgynNV8Z827EySRdB5mMVBPmhfh4qymWpIDB4TdHl8EjFfIhKgKLJlb5XR7EiI0RAEKeBjfIwnEvLp7zozaUJu/DNvbsxOi1q9pODb9SWReoWQz7vhksmsmpm4CfxoXxtbCiDm8YuiUtjS0ZOviYqWKDqdVpb8RH+7xetmjjpxrtZwytTJGRcWL1Mny0fX02cR5shGo834TWNJlsrAR3gClGfyOGcZhpql0WZsc5iHcp9mpiHpTExpmpwQM59PGjtJihqx/gvbdJyTn32kr83Zzkf5MeJoL+kVoAFLPoSMwxrw2gBAggmduEctkO/rK52my0UBtfgcOqHSX6pofnawwqqt7uzrseoNHK4WTg7urWG5JGhC2YM+H2GyOAw6dv3t3WaNUiIRj7CoRZhcGjeFXg0GAB7NWcVaAWY+5AFApFj1ZO5qnCIwhAcAT+ddjiAIa8mxRGkEU/6vcVfxEJT+zSpOs7+7yf+bycWnJ8EzmTM1/dMfi+OjNSIhH8PQju4Bt8eHBq1DxExyur1mq8s44DhV3bG0KPuTHw5FG5SZKZHcX2oAACjpb/NwudsnR8RzhjiOgdlRKcE+MoKiDvQ0LYsb6siLpcKl10zFAneiOx5i9vWUiDPtnifKNWqhZOB0tG0oKIpaGJ1xtL91wOv8V8FFa1sCLPoD3c3MQz/hxzEMQyh73Il7m2ymFMUISufCNh3n5Oc4SazZZ8mSZ7S52lnaClg+LGYc1oH+U52u/vmGiZu6Dt2TttpNenf3njB6LD1u0x2pqyS8wY/e7HnZH729w1+KhqLgwN6aVZdPYslDcYDLHtTq5KFiUN0en3GAQ2HtO1w3pSApOV5HH+46WFM0NX3MMVzAWA1m+BVg/OoGoZA1b+/0eHz5E5My82J//uKgzeJcefXUUyXNnW2miCil0+657s9znQ7Pd5/sw33E/OXjktMjmdrKSxK1Fu7p+5x9mcQYzd/vWerfzmP25FQ+o2vsb4r50zP8SW98tvuFR1YqZOLn39n8xN1LHr9rMU5wr8zhp8zEMR4CAOO1Izs6w2S8NjpYYQHASWMnU2GZeq0le2tsZuclt8z2977rQ7RYqJd5VGQo9cW9LWxpIAXa2F9by1bG5+Ek+UblnmtSAiI8Qq1mkaXi7hyNCoVAJObxXQT7tQeAFvvAiArrAjbdgPM3s3OLWrIseEmsPGUOACRJE1ly8Cuskw2darmk22idnDWoWTUCBQJQbmkQ8gQAgCE8BEAvUiVJo8Q8ob98ZLQqPSuqtordyTqwuypMheWwe0pLOPoUs+YN2YNWu/vnTSfsTk9uRvSMiSk/bDgeF63OTouy2Fxf/HTY6fYmxekuv2gCAGzcVe72+OZNz5CKhd/8eqytyzw+OzY/iz2F8Bxx9EBddIJ24cXj6cPlV04uP95yaHd1X4912WUTq8vaTC4bAGxdd1wXIY+K1Xz70d7HXwoYCqk193F20WOlyuBQBhqmRmZqKxb+pCVF2d+uL8F46OXLJtCS4bUVAFSHWBfpLK7EFOoNqRwICNfgXF6m0WZkZBkiXTmor8+ERLlmmLfOz9yodKvPBQAP581nJVVbuFsvQa5mi8aEXCB0cS2o2x1kYgdzAZvO6tqTpHur1fQ3lWRJ+OEKgwrL6fYdr6ntNtkEp/ekmZ6aBwAUULTxssAwqH38Ej+z52UHK6yy0laL2alUDYWohOLwgVrO6E2mPYjjRGun6an7LqIP58/M3HekDgDKazpzMqLFQr7D5aGTphYk5WXGvPrh9sfuXpIcr7t21aRRzZo+Q5x2j/+Wd244aeq3xyXpCIIUCDGMzxOKBj1KTocnIkolEGJX/mk2szgANIV4gDJGWnclfNKTItKTRldbqKtKGFMAESfxIeJ9WMtFGXusuROTuttMJEGip/+yHQ4LM4+fGKmKLRo90VxBJCyabMaPag/lqqMA4OrkQmYSSVENXCteaUXSs7XMsZwv7OUapfHPGx2GC9h0JOW2e44CUFb3XhSRyoRh9W8GFdbU7ASPD69q6W3uGgzfoOMbWLqJU1I0n8MqJEnq0L6aJRcXsOTBcI4P6iIU2XkB9qBey9G/mJAb/8zrG3LSoy5bOthZ0KikQgFGb+QV2oY7V0yalfbWc+ury9rTs6N5GK+zzeR2eYNt0gUXj//yvV1RsZq07GjICOhZdHM9eQCQLNewReeRHq6JygDAGRE2NmR8IefaSf1uB3PAxxCr3vrjEb4A82srgqI4Y+IBIJJr8spoCTUNmwmKIDMNyUtis9l/aYB+t4Nz8qDR7Uj59nm29KzCGeXL5MI2nVw0w+2rlwjGe/EuAPArLJIigx3Bfk77aBCYMz4lSqvIiGOPQ42IIUqVkRVdU9XJku/fXT2iwvJ48KPFHINis+dmhVI37d3m9TvKGlv7k+P1mSkGv/94yvhEVs6M5Mh3vtgzZ1pGXsZZc7UMj1QmevTfq3GcwDAeAMyYl8XcRTExdbBfExGlevCfl/izMeGcawYAerFswOX6rqzs+vHjpYJRfJlZpU51dyeq1QrhkFE/IiRFGbm+1RiKyvijqGdEVAJxsMIiKarXZfdrRpSHLrlyKjPDgMfJGeIkxQRY0ODDGAhnYooEE1RZeuiABtYSyZx9n/MD5zgJkwvbdDrZYOAhi0ZHk5f0ZSsy2QkAwHK6IwB/e3/DzcsmGy2O6bmJzKThmT0/O1hhnTja5HJ6xZLh3q6Sww2cGxSy5v1oVNI7rxu0nmIjVXffUET/fuPTXS/8bZVCJv7325unjE+8euWgkn7i3qUAsGrxOJ+P4J/Bxqtjw6+Ght/zNVhbAYAt6I2l0QqlarFYyMOcPp9UIPARxMnu7mi5AuOhLp+PIKlkjRoAKnt7NWJxpHzo88gs5fT5XD6fkMfrdTiGL8XETfg4H2s5f7jHcQzIQ6i/UItD0Li4wlkBQC7grm20hGO46UWyB3PmAoA9aKECi4+7C3Me4PyrMfk9NF0weqF+bcevTtyJIEihmt3jCdCjG4qrVszIsTs9lS09OMHRjw0F57xCn484fKCOLQ2E0x7UGxRZubFsKRdL5uR899uxT78/uPqiQZOQxfnXVmeIh2uSBACIAqMHjE4nTpL/2b//ixOlFb29Hx47avN41lVV1RtNbx8+PODifkkwFN3X0tLndI6qVCjLQnA2PsJMBEEb09O48aELoDd/ZAbBeEjuyxtzlDYL/ki3afW5PQTe4TR3OM1fNR5jpTIv/vfGBW86ToSocKZuukqgUvKHwqf8BLwGfIzX3meRiPgdfZYRR46YGCKVGdnRNZXsTtb+3dVzFuawhH5CbZAzK7Q9yGIM/uPfOd4Q2oH1DJX39LZbLVaPx0CRS9PTzS63xeOp6OmNlsvjlSovwa31BDxehFQGAMRoSnG6YAAgOJD4DOGH2GqIuTZ0d6vJ5XB3t5mmLsih3VihLg87S5eHjfT2tthNTty3v6fBIJZXWwLGNCG0Uvg9cMGbjhMRT2gQReCkb2SFdfOSSb8erOg22m6/OMBNEA6z52UHK6yjh+q9XjzUclQnS5o5938umh9Sx/2fJ5QWICiyzmg83tlJUNQ14/JbLWZ/J8Ov2xempuxvaZEJBDrpkLOTWarLZivp7HD6vCOWYhK8iikNPbvoLBJq0XpmzyvY6R7K2zKiQRQmI34689TRLtyXrYq0+lzTI5JYqaH+oL8HLnjTcWLyDvzSsSFCpAOAZVGLh9v5WSoWXD2/AAAOVbREaUc3ADR7fvaHb21nCV0ub8nhxmmz0llyGs51HSIMyuCV1///QRjCLPIQeJpW++bFy+nDWwoLCZK8dWIhfXjNuHwAiFUoCmNiEADmhAxmqRSN5vWLBkNDYNhSTAQhYtlD9cjGTKjOCDOYvqO5XygStNUPdWRC6dNQ6m+0kMNuyELT7bL6wxqS5QERTEKunSgBIEMVcRVjXve5IHukwNTfQ9PRWN17FKJBx3RYOz+395n3nmz0S49UtU3LSfAfhkMoq/DAnmpOhUVRcHAvhz04e3649uDvFi9J7O2uS1ca4qVqdtpIiEP4KS1BznjOfcCHX1A8FMOXEmN8PsoLfohtPjfF+Iq6PT6rza1WSsxWl14r8/kIo9nhdvtsDndeZlhfoOAhQhqmMz54EwrWzE0/nGtLjIFwnFDDhDWIQyzBquSLxrDk4dnlAjadB2/xb5kDADb3fr/C0gl1I+/8XN9ujItQRagHx4m6jLahLGFTND8nWGEd2ldLEGRw9GZVRbuxn+Msv0N7cHNH5cLorOHfaiYYgmIouqur9sbUKey0kQgVujLM5jfnGgQgQiwLjjAkKMrKmJm8eXdlRnLEpl0V3b2We26eW3y8UcDHRCJ+qI5bMAMeDq8/iiA6kcx/KJGLEASJTR5yXIbardMaqE85H8JwGH6MkmaYsIYI8dDFMwknqvNcE2bTjZlhms7lqxZiiQLeYBCiF2/3J/EQ1OKz8BCe1cehHwYV1vS8RIyH+p8tUVH+UJawmT0/68O3trHsX5vVVXaidfzExABpiPmDhihVRvZ5ipkKkwpz16d1h1rspom6+FpLb6bS0GQ3aoSSLGXU5/XFFMAViROSAue1owhiECta7AMAYPQ4Pqsrtnhd16VOrrf2tTsGOp2WpbE5OaqoD2oP+EhiZXx+pnKo6865UDcAhL8e27kgSqIIVlgA0OGw+BWWRMTPSotqbjelJOjEYn58jObA0YbFRdklp1oDC3Fj9ro4n2+9SMr8VPR3W0y91gzGokMYinJGnJIU1e926E9/AHZuKpswJVko4g8Y7XGJutamPpvVnTMuLrAQB6G2ZmCiEUofyJnL+YaHiq0NDm3zkcRoh+cGPM7vGk5en1ZI76U2WsJsujEzTNMpBzf1GvyE6JChEBkRTzRLN/2w6ViZpXyyZtDp4WewgADjMb+ECZGjtmUAIMKgzMjm6Pwf3FfDFgEc2sdlD4ZYYOsCkqOKSlNE3Jo+vVAb3+WynDC197hsJ00d3zeXXJ088a+58z+uO8guw0ArlF6TPHGSPmFHZ023y5qrjv5b/uJfWk/93FJqEMunRyS9X7OPmT9OxjEyAgB1XFs/nDdSFQF+GT+0UqZZVJQNAEvn5kyflIIiSFpSxA2XT40yKJctyB0qEJpWu5ktAgCA5MBTK1SS+vL2netKmMJQU0DaGYu69Pdai/fW8HhofXUXAPT32rzh7aHb67azRUGcMnUc7mtmSwEAQMTDOD9CZo+TqSmMbsdLJ3fT06S7nFZa4sS9/W7H8f4OgqJ6XfYW20Cj1egvAgBqoUTA4zkJHwD4SOJYX1un08rKWTHQw7mjGk04TTdmhmk6BBEAoC5fdbfljS7Lfwec6/1J/R7j7r5941X5f0q6kVFikLF0koeBc0GY4NiF1ub+9taApqc5F/bg80+vpWfq/OuJn0iS+vqz/W+8somdaVj8ilzME9BrDGEIz4n7pNjgqn7MzCx+bS3b1FEp5wvpKc16kUzEw0ig7LhHigmFKHZ7xkxm/lAz+GstfcFBieeNUIsuVQ50s0UM5z39I0yTsCLEghBZgZMo7RZXXVmbWCpkhmKFWrmJuRRBRJQyOk5j7LO1NvfjOBkdp+k+vcnu8LTYRs4WJ1Nvbq/c2lG9vZPj28y56RYFcMI4tIqDjyQtXhc9vPBFXQkAbG6vqTH3vV6+z0P4UARZU3esYqD7g+riUJtoGd1OH0m+cnI3M+e65vIGa//bFQdCLfMSTtONmRGbrs/2mQCLkwjyAYZGnHVC7cXRy3RCrYvgchGwBWfG7HnZwc9nd6e5pSmgg3BwL8ffNSpGnZ4VxZYGYjE7P3hr+/tvbm9rNe7eXvnNmgOvv7yp9Hiz0+H55L1d77+5vZExfkRTUJh46kSLxexUa2U+Lz6jKHO0g7Y56uiXy7afMLbFSdUIQIJMQwK5OrHgtcqdL5zauiSGraObbMZ1LScP9Tbt72nAULTFbiof6GK9t6vixx3pay4xtvUHfoU0QgnnB5mgqOIQK0OeBwp0Q05uJqFWUxoDpYy3lwlrF2iFRmqI1TisLuZqDaEWUWGu9DB/aX7B5OTYBO2Nf56LYWhktGrJigJG3pCwZl9zIuHxVyWMixDLme42P/khNrIu6Rty3ERK5DqRlLn6BR1bMNOQNM2QiACQFLU0PitPExU8/EJTZuqqNvdafW5mznJTd7/bESdThQpIDqfpxsyITcdDlTLhZLev3kf00gtjOQmnj/T1e/r7Pf3be3azC7DCGs4cvUGRmRNTVc5++EoONyYkDc1SDO5zQXj24Lofj158aWGEQfn6SxvjEnQZWdGXXjnlzVc2NdX36vTyqBj1158fePJflzKLzJyT+eWn+7o6zTPnZAhF/Nh4DYxSY12VVOglCQHKK9AOujxoJfXPguUkRQU745Pk2sfyF/sPF0ZnsnwTLxSuBIDnC1fgJBkcCzPNkLCOa0Xdja1VC0Ksh3uuyVJFRIhlwdPiSvrbnbhXEmJkc1Ts6x4apPaDAMwIXLiSL8BW3Tzb7QzwdhXoOBwRAHA4aLFzJuEsZusifOEY4y7CV2XuJinqaH/ra1MCHj8AmB2V8t+yvSwhAOzrbnwwv8h/6CPJb+pPXJ1akKUy/OfUnhbbQK46kjmoH3y5dZa+4/0dJEVdkzqhzWH2x0/5cy6KTd/f3STlC/VcmhTG2nThEE7TGeS3Yzwtn6cXYNEIwgeAbnevh/CUWSrUAlWrs41d4KwrLAAomp8TrLCOFTdcetXgkJnd5q6uYGeAEOYkC7fLJ5EIeTzU5yMAQKOVCYUYRVEOh8cQqRQIsKuDlmaWK8Qup7emsnPxReNYSeHDGbGCjBQQQDOMJzVYWwFAUVQKp8La0l5t8iwINbJzrpkTlfJ940mW0EcS2zpqw9zTaRiO9bVxLmOfrY5k7Y1u7LEWby+PTtSp9UP90AJtDIogweGOtebeLqc1lNs7HI70thJB1QajFUrpVWV63bbgj1CeJkovkgaP854ydZ0ydfn7X08UzKfdCxcnZAdX8si4uQBwbeoEpjBNqX9rxiX071syJhMU6d94gs4ZK1UW6uOQ0Ib5hW06h/eEUrxAI73U4tpGS5KliR7SkyZLwVAsR8GhEDhemDOEc2JNWWkLrWIAoORwA+1UYhJq0zAWSy8e/+n7u997Y1vRvICbWbg0/+TxlvJTbSYjx3OflRsrEGLBy7wMA075yizH+j1noWM8WuZEpbBmDtK4CTx4q77zxiVJeWwRAAAE73YzBr4NUcnKxACfJkGQJ/bX2AacA30BXmSFQDRey9FToADWt1aypaNhazuHKRBMl8v6SvmO/5TvTFdEBH+EEICVidw6/bOao8xD/7ctuJJw4Iyq5yFIKG0FF7rpbO5D9A+nd2gj1TZne629HgCixRy+P447PEP0BkVWDtvl4fHg/l7VkUMNgYkAIaZPBxOfqLvvkWW337Ng6sy0y6+ZmpisB4CHn1xhiFT+9YmLr7xu+qSpKewyAEsvHn/X/Yvo3zweet8jywLTOeAhGApoueU4O+HcoxCIloTYceTjmiOhlog810zWx3M6aA/3th7j2p8ifNoc5l+5tuTBUHRVYN+Nx0MLZqQrNNL+LjNrE4BFXLuxAsCXdSUjfudD4cR9G8J7aaPEir/mzn8od95FcdyjRtekTuDUGetbK0uN7NDF88wFbDoUERkdP1pcOz14C72RKgDohfojpmPHTMdLBk4EZgc4FwoLAGYv4NA+pSXN9I8Tx5oCEgAAoIirCCcIErAoMBMMO2u3gwCiEgy+nzbc+lvnN9+2ftjpajsxcGhbzy/ft31cZ68AADfhWt/57bqOLztcLcziDtz2S8dX6zq+7PV0MouEys8iVAy0jyTuPbCWcwHv88Cfs6exRQAA8M/jWzmXdQ6TZ0q4i1+WlM+yBwFALBM6bC6CIPesD3iaVyTkcJrn7Q7Ld1xLxYfDF3XHQg3JsSg1dVSZuwHgu6bjnKPGCTI150eIoMj7D627gOO/cEGbLlr1EIZqSMoWp37OLxx+tYaz9oYz4Vx+72RJMwC0txr7e62spJg4TUoaR/fvd4IcU8zULUyVZ5VZjg34jPGS5Etirj9q2g8Ah027lXxNhjxvW886ZpG9fVtm6hauiL56R896ZpFQ+VmM00aH2m+u2tx7x94fQy35ck5ZlZiXxLXwaeVAzwulO9nS8FhTd2xnZz1bCoChKOcmo3aLKzZJT5FU0fICptwgli8IscffK6d205FNo6LNYX6r4gBbyoWPJDa1V65pOPpK+Y5GmzGUy/Kh/DmcJlub3XzvwbVnazbMGLiATQeAKsXz1JKVds+gaWzD7RafRY7J6H+BmQHOkcLSRXAsaFVV3u7zESeONbPkEJ67/QJyzLT/hLlYjEpIigAABV/FRwUURQKAm3CJeCI+yl9oWMUs4iHdQp4IRXgEhTOLhMofzCPj5nJ6+gHgQE/TFdvXtIWItAyfDodlmFjkYHgI8szEJWwpAAB8UnPk3crhAmg5+aWl/Nnj29lSAAC4LXNqHNey4mq93OvBpy7ICR7j+zOXggMAi9f95/0/jqoX0+Oy3bDrGydX5H0wfJR3e8b0+7KL/po7/7H8hezk0yTJNbdnTWVLAQBgb1fjlTvWDBPeGSYWr/vLupJLtn46WlPu/DedF+9weEtNjnXd1ne6re/02T6j5T3u3hPmk2s7fi23VH7f9nNAGQA4RwoLuEJAfT6itqqzrJTDFArTgXU+6fV0HjHtqbWXV1tP8RBev6e7zdUUPBVzkmZ2nb2qwV5j9ZmZ8mnauRu6vl/b8cV4VcAzGip/MKkK3f15s9nS01QMdC/Z9MFrZXtDrck9DA1W44fVxZdu+2z2b2+H2tAlFNMNicy945m8cmr3X4t/DccQAAAvSbxQuvOhQ79yGoOJcs29OTPZUgAA4Auw8TPSDHEc3rR8TdRSLrMLAMpN3Vfv/LKda3ZRMCeMHdfs/GpUc6G0QmmkeOQBtftyZ4XaZ6hyoGfp5g/frNgfZgMy6XJaf24qu/fA2qnrXn+6ZMspUxeEvUwCzflvOj5PL8KSPHiTSrxYJV4sFmTQ8lRZcposZZKmcL5hTpTYEPx4IPQSjgBwoqcrQanSiMT+tJO93UlK9vrfnMJg+vts1658jaXo/3TX/F9/OtrXE9DJjI3XfvLdXUzJ+WT92pI3XtrIEk6ckvL8a9cwJQSF8047BYMhKIIXtPgcBRRr71U/nPmDISnq9n0/7OKymPyIefx5ManzY9ImaGPjuDaeISiq02Fpspnqrf0l/e1H+9qYvao1c6+eYUhiZB8ZD4Ffvn1NBVeMOwCohOJb0ievTs7nDH8FALPX9WtLxYdVxcH7PNOIefyfFt4Yapcgzn0J/XQ7bUs2fRDqnRfz+LdmTrkurZBzhjlBUSeNHV/UlfzWUsF8bAUoj6DI4D7LX3Jn3Zc7iyUckXaH5bJtn/WH7tjK+cIlcZlTIxKmGRI425AC6HJaG63GRpuxxtxX3NvSbDOx8tRe+TdO83MYLkjTUZSPDr/y4M1CLNGfYXfvvm53T7YiM1/FHl0dfAlLe7pOdHeqRWIhD3P5fK1Wc6ZW7/L5hBgPADps1hi5wuHz4iTpF/Y6HU6fj6TIZJUGAI53dyIIkqLS0LpMp5dn58VVnAoYP9q1rZylreC0u91HEPwQS0ExqR8wpao1HgLvczojpbID7a3JKnWcgsM5d3YZRlsBAKf2qWjrTdCp5GIOzc6Zn4bZDiiCvDF91VU7vgylHQDARfg2tFZtaK0CABEPi5IoFAKRAOV5CNyBex241+h2crqBx4yQh70/a/UV29dwahyzx/Vq2Z7/lu1JU+pz1JFxMpWML0ABceDeTqe1aqCnYqA7+An2w0OQV6ZeHEpbQYh9Cf1ESuT/nLj4wUO/shMAAMBF+N6s2P9O5YF8bXSuOjJKohDyMIvXPeBxdjltR/taOYPI35xx6XuVB5nTaM6EWKnyo9lXXL/r61Cqwebz/NB48ofGkwAgwfgqgVglFEswgRP3OnxeJ+61+jwj7i4xBi5I0zm8pfRmOThhZCqsOREhvwQYAHxbWaYRi8v6euYlptSa+n+qqViWko6h6N625liFIlau/KWu6qqsvB9rKlalZ/uFn5cdz9ZF7G1tfnLGnB3NjRI+f0tj3XNFQzb87HnZLIXVWMcR1lQ0P9vocr57/MhFqRkFhqgeh50C0IrEAx53t90eJZPpJUNK/dvKU49PL9rR3KgTS1w+n04see3oof/M53asXEBcXp/L66M3eey3OSxON0lRaqnY7vYK+ViUSu4jiLK27iiVIkolbzWaLU53TqzB7HB9vPvYovy0cfGDIWkSTPDl3Gtu3ft9Sf/QNI5QuAm8Kehjey6Ikii+mnftVTu+DLXHDwVQa+mrHSnQmQWKIC9PvZhzNM2Pw+7ubTdFJejYCadZmZBbNdD7YXUxO+E0BEWd6O8ItRszizuzpy+ISdvT1TDMWzda8jRRX8+77qY9347oQHTiPifu4/wwnAvOc9NRQNg9h6XCAgAYcG6QCPIQZOQpEygANFlMi5JSCyOjadHM2ITpMfECHs8gHfTSr0zLWt9QY3Q5IyRSv5AkqWUpGfkRkRaPO02jPdLZnqOLEGFDPZFwluKLT9QlJkd4CcLi8dCLbf5cU/lFWWlxZ/vG+tp+l+ODE8cG3ENuminRsce7O0t7uiZGxaRptJk6vVIoGqrudwMPRQ/WtvTbnADwwY4jXx88ub+m+asDpQ29po93HbW7vSa7CyfI1zcfOFzftr2s3uHxIoD4CNLqdAsZbQgACoHo87lXXxoibvNCES9T/7zwplDbNY8BGV/4wazLwwmaj4rXaRhh7sE8Mm7u1akBY4hj45rUCX/NnwNBE7DPnGy14eeFN43TDr5xvx/OZ9OZnZstzm2tpsfbTE+I+MnhaCugFdb0mPhXDu8/1DHYG6LjYhsGTMe6O36rq7Z7vTFyRWV/77iIKKYQGFOWcJIYcLswHspcNlerk+fkx/kPOaHHB6Nkcp1Ykq2LAAAhD4uWybc21nc7bPMSkidERjeZh3x4RfFJ+9tahDyMvsi3Sw7fMm6CP9UfLHvBEWA8vXKwY6iVSxJ1qmlpCSRJFWUm5cQaui22ivae2q5+m8tT0d6zojBramo8goBBKdPIJJnR+sDKQMzjvzzl4temrTzzJYrOIpES+XcLrr82REjkqCjQxqxddNPc6FR2QhBqnfyi66ZPWzSc+kYR5NmJSx/Imz1MhPfwIAD35c7yD4lmhfCUnwmxUuX382+4N2cmcwHos4KYx+eadxgW57Pp1JKL4jTPJmheite8qJNdx04OAQoARfFJ90+a/vbiixOVqgJD1KKkVABIUWveXLj8zglTZAIBALwwZ/GylHSm8NFpswHg2pxxsXLlpoa65+csFKBYramfWfvswAk0wfjHB30k8XXFKQAQ8ngRUmm/yzE9Jv7tksOHO9toRUYj4PH6XM5ZcQkA8E3lqXqTcW1Npc3rAQA33l038CpBubyEEQBIyuvGOx2+BrP7AkSrN/WaTjR3biqtsbuHxndRBPly/4kTLZ0JOlW7yULvWTIrM+nDXUc/21tC76uGk+QPh8v8RZhcnJCzY/md9+TMVAmGBkbGDA9B58ekJco07ITRIObxn5m45Kt514VakGBEDGLZPwsXf7/gBs4w+mAqjzWVHqjb/F0xK9I9mHtyZn4599pQqxEMQ4JM/dmcq/+SO8v/ymaqIsb8Ag8DhqL3583esuz2VYm5Y5uLw2KcNvq5SUsPX3IfZyBo+Jy3ppMIhvvwcDI0SngmdNise1qbYuXK2fGJTLmx33bNytdDPVsJyfoPv/qz/zDY7x48BXQYHL4mi+ekXJDZYfs+U/tUt2Mjigh5iBgBVCMOiC1gEuYo4VnhtU37/7J4BoIMzsAnSJJel52igKIof/h+cDuwcBP4by0VG9uqDvW0jNahLsH4BdrYoujklQm5nCM+Y2Z3Z8M3Dcd3dTYED0UHgwAU6uMuTcy7JCkvVLgZJ611Pf09lugEXWRcWKqWoMgfG0+tqTtWbR45gCNRrrkpfdKVKeODL2nhhvdZk6LGNkoYih6X7fvGkxtaq0Zc4YCFBBNM0sfNiEwsikoJtc7i2DifTWdx7VSK5zEloUAoirL57Dt6DyyOLBLzAvxBzY72UnPl3IhpSr4cp3Bs2JGyUDx45+flpa1sKQAA3HBb0XW3hAw1Gi0+YsDqLXf6Wlx4V7rmYZu3us+5M0q2wuQqjpGvZuc+zflUWCeaOwsSw3JbVDZ2x0Wq5ZLBEcby+q5Yg0olZ3esHLj3RH/HKVNXraWvw2HpdlrtuNeF+wiKFPEwEY8vwfgKgShOqoqXqeJl6mx1ZJ4mcrQD3qPC7HUd7m090ttab+1vsQ2YvS4n7kMRhL6SeKk6WaGZoIudEpFgCLHY+fAM9Nu+fmOrUCS49fGL2WnDUm3u3dfddNLYUW819rnsdtwDAFJMoBVKU5TaPHVUUVRKjiYyZGfgfNHmMB/vbz9p7Gq2mdodZpPH5cK9XpIQopiUL5BgAhlfECdVJSu0SXJNikKXq44M/6M+Ns5F03nxDh/Z5/E1e4lOALC7i1Mj1rAzcYEBgJwv46N8D+mlFVaTo03Bl2EI79fObUsii+SY1OKzrevYOk07IV2exK5gJGbPyw6lsM5ugDufp9aKZ2nFM2kDXi7IlAnSEUCj5Zeys14gOLVVfVufgI/FR6p9OFHZ2G3QKpQykdvjE57es7qioau8oUslFwcrLCkmmBmZNDNydH8UHCcRBJg7MuA4yZqGGZwnTFQC8eLYjMWxg3GAZx2JVLj0qqnlRxuDN4AankxVRGZoBzANSVHHK9qKTzSV13Z19JitdjcCiFIu0mlkeenRk8clTi1IGs05x0KcVBUnVYUz+HDeCKfpRgufp+ehMqtrl1qyAgAIcshPPTzsTtPeviMogmzvqV8duwxDeAJUAAA4hTtwhwDlszKHw+y5We++tiXYKkxKiYgLPTh9Bgw9UAig/v9/nxwub2nuMKbG6+Mj1QNWJ06Q7/2w//FbFxWXt0TplVE6xS+7y1RycXVTz8zxyezCY8VsdpwqbZ1VlGmxOHU6eV+f7ecfjixZNs5uc+ec3j6LzjNjZrrT5VWrpU6n1+X0KpRiukhgfWcfjxdfdss7bs/g9DqpWLDhk7v4GA8AhGJBcnZMMtfWAZxc9ZdP2rqGXoaPX7guM4XDDez14Wu3nPx2fUlv0H5RfSZ7n8leVd/9/cbjiTGaO6+bPXNiCivPH4wWBBHwEEGk4h46cFQnu5adIwRshdXkaNUJNQahjgJKyZcnSmMBQCtQ+3+PFo1OtuXAk2zp74bllxQuv6SQLT1fFGTGNnUYy+u7CrPiqpt7u/osNqdHgPH0qkFzqbV7YOWcvH7zCAE7o0KnkyMI8v03xd3d5jvvXuB2eZOSI/r7bUznKJ2nvd204bfSvzyweO1PRxUKsdXiootIpBzRsGcRoQCbUZi842ANfehweY+dap02YXQdSQBobjcytVVUhJJTWxWXNr/ywbauPis7IYjmDtOjL667annhPTfMOdddLRrXwN0C6U08wSR2AoDX8bHP+SMmWiqU/8UvxN3bCLxOKLuLkZFNcB7ccwgTTmNkOU9YXNtUkmUAwIwaHR4MANqcXTXWBpIiFxlmTdKMO2WuEvNEKn7A3CicIrf37F9gmMkUjg0KqPuPv9XjHnhv4oMqwVgcGSzOeoXh4CXxpXseYUo2Fb0kCLHNbyga2voRgM4+CwB09A7uPt/cZTpZ1+H0eFfPHz8xO/69Hw+0dg9MyU1glR0zba3G5ua+mBhNUrJeLBYolGK1RhoToz5e0lwQmMdicYpEGAAYDEqNVioU8ukijMrOFfOnZ/gVFgDsPlw3BoW1+3Ad83DetHTmIQCQJPXOl3u/+e0YS07D46Eogvhw9rDGt+tLREL+bVfNYMnPMwLpnwCEFBkQKoyJFmIwFLzNSXAej+0VTPgTUzI8PpygO7yjIriUw3ucVljhwzFKSFIkgiCsLe0BYMx+dxY23LVq3xMA8PL4Oyeo09jJp2mwdyIAyTIOvw+LMCs8u5AU+VvnQYvPYfbaf+k4AGNSWADg8eJCwWApzs0+OYVnBYqkmBNcWIcAQFHA6kcE5zlHeLz4RX96x+UetApVCvFvH94Zah20UNzy6Jc1jUOTKz558bqM5IAe1qbdFc++vZkpEQn5RVNSiyan5aRHaVRSFEGMA46DxxvXrD3c2WNh5nzz6Ssm5LLDDD32twjPfooiUSxBrHqZ8B712D9AEAFJdGDCWUL5QwDgdX6Nu36lKAITTg0l8dj+i3v2oLxIkugXKR7l7GEBgNfxJUWa/D0sr+Nzn/MHTDhDqHgMANzWZ4FyEd4STLTY59ooUv4TE05n5SHxGo/tbZ97MyacDgASzScAaE1Lr1oujtDIfThR0dgdqVVEauV+Z+uA1fn5hqMLJqfnpgzFsvSZ7UCBSi622N06ldRfw/Cluiyve/BGPi8SAGJUj/nlw8DxgnHO1wWAs6KtAECGiXKVSSavNU02nCfiP9XfJcui/5p5JTshiDArPLugCLoyZiYAeEmcVlhjw6+tALid3JzCswJL9QRromCrJzjPOUIowGYUpmw/UE0fmq2uk1XtBTlsBTEMPf1WpraKMahY2goAlhTlFJc202dBUWT5vLw/XTFNpw7opGvV0ovn582fnvHYy78cKxsaPnrvm30fPMceSvY5fxKr3+Lxc/z7VpF4syxiCwA4+lbwxasAMJ9znVT3HQDiNF5N+E4iiCpIIsPdO6T6XwEoe+8CZv3DI5DeiKBy0jfUM+UJZ6JYMkVaRcqnCc8eTDidlQfFMsTqV4meoxLNZ7Rk08EqFEHW1rb/+dIZXh9OEOS7P+5fNiO7qdOYFqenR4dsDreAH6ANNh2ocri8EzJjW7pMcqmIrmFuYdrwpfTyG+nNcsLnXL0Mw4AA8vqEe7+Y+oScL2GnncaGu2rt7WxpCMKp8A/+52BZcCz7bkRGtAcBAEHgybuX5GfGaNXSN566/NE7FrK0lR+JWPDsQxdr1UORaxW1Xa2d7JmbEs2HXsenTuOVuHs3LeFhKQAoAIryM0i8hcTrSKLZabzGabwaACjSwSVpQfmZACgAj4dxXHb4oKgWQSQIqkcQIUV52Mlc1DT3mqzOGL3KhxNVzb11bX02p6cgM5aioKyhCwAiNHK1QpIeHzAfQ8DnGTTyPcfrk2O0/hqSY7ShS1Ed5n9jqIrP0/N5epPjZ0Zlw3EBFFY4lJhqgm3VP/j/imkTksSioYHpvUfqR/VE7D1SzzycN5070oLP573wyMrPX75hxO6bXCq6fNkEpuToqRbmIQCgvASx6hWx+n2X+a+0hMBrAQgAkvRVo1gCiqWhvBiJ9kuJ9huJ5gtMOJVLEk/6qgFIAJLAGwLPMFrC6RGjFOX2dwmLClMsdhdQlFYp7egzEwQFtLMVGXS2AgBOkGt3n/KXBwABhmlVUpPFmZlk8NfQb3aEKsWaRYeTpjDn1Q1n5Rm91p/a9hwxVne7TQRFKPmyBKlhpi7v4pjp/jy073m2ftzTuTfW2drXNG+psDS7CI9eqJoTMf6W5ACP2op9jztwt//wq2lPRoo0jHQ4ZW74sW1Pvb2jxz0AAJu6Dm/qOuxPvTZhwWgrZBLO7XhI366eE/v7y2ptbWavXYDyo8Xamfq8K+PmCnnn1tk8qpakgNrWfWxDZ3Gjo4sgiWixbp6h4LK4ImFg6MmobseJu3/rPLirt7THPeAhvGqBPEaim6bNWRA5UY6J/dnchPfHtj27e0s73UYegqbKYlbGzJgTMX6oIoAaW9tdx/57dcL8axMWfNG8dW/fqT6PWcwT5imTbkxakhqe5S7gB1iFvUZbdUN3VmpkYC5uzFbXqeoO/2FclDo9KWQkkTIowC0U08YnvffVPv9hC3vvaNJhvAJBhBRFCqQ30iIEVbkG7iGJTkw0D8VSAEAgudZpvAYABaDEmk9RLCFIkooJZzv6L0F5cSjGPdhCUQ63+XESr6EoL4nXCxWPojyDa+CvJF5HUXaS6BTK72eXAQDAWXlQLAUA5YsvdvRdjPLixJr3CjJix6XFAAIoglyzuJAgyGuXFgJAcozW7764/+oi1ljEpfPyAaBoQgoAMGsIVQpB+Dg5YHZuFAty3L56L97p34RieEJmOmmuf6rsUzvuEvEEqbIYDOV1OPuPmWqixVp2VgCT13rS3PDYyQ9kfHGKLNqGu5ocXRYfezD+ztSV/R6L1ef4rfOQj+RQqDhFKPjSCer0Fkd3pbUlThKRq0zyp2Yo2N/AESv0E+btbO06+lrtjwAQKdLkKpNdhLve3tlg7zwxUP9qwV3BAxFnnXBakqTI5yq/3N1bKuIJEqWRKII22bs+bty4r+/UfwrulvCGYg7Cvx0n7r6r5LU2Z6+CL02SRpJAdbtMJabak+aGuYYCf7YBr+3h0veaHF0yTJytSPCQvkpr8ylzQ4mp9sHMy1ntU2tre6j03VpbW6osJkKobnJ0HeyvKDHVvj3x/iTpkOd1GOZNT/crLADYc7guTIW172g9cyu5uVz24BiINiiZh2ark3kIgEp1awMlgPKixOq3mRK+ZDVfsnp4iVDxyPCRIwgiFatfZwnF6teYhyLFkwDgd9jTP1h5aETKZ5iHzMENvwuV6WwFgOFHCf01DFMqXv2cybnWaP9GgMUlaF9k5BoOboVl9FifLvvUjrsujZ31p+SLRKe/xvX2DhnjY+un3dX378qv7kpbdVH0VPqptfgcLoJtMy+NmkL/2N5znFO/TFCnT1CnA8BPbXsrrS25yqThne4jVkgT/u0sipxox11zDQX+nlqTo+svx988ZW4oHagvOPdDkOG05Hetu3b3lk7UZDyefZ2SLwUAq8/xj/LPT5rr36//9YGMy/05w7+dbT0lbc7eqdrsf+bdjJ1eX7Dd2dfk6FLxh9w6L1d/2+TomhtR8HDmlXQfrc9jfuLURxu7ilNk0atiZ/pzAkCJqVYlkL038UG6S+UiPE+VfXp8oPbL5m1/z7mBmTMU0wqSxCK+f6xw9+G6P18b1vS9PUcCHFjzp3Hbg6NFEPj6EeTIsybPM3aP1+H1KkQih9erk0q8BNFnd+hl0j67I0ap8BLEgNMlEwocHq9aIu6wWKOVCgAYcLoUIpHZ5YpUyM/5N/k0CMLXSq9gS0eC24f1U/seG+6apMm8O+0S/+sNAKmyGE6by+y1T9RkLI+e5v/GKvlSzpwXhPBvR8gTXJ0wnylMkkYtMEwAgFpbuIMAZ8KILekhfd+17RKg2GNZ19LaCgAUfOm96ZcAwObuI27C688c/u0MeG0AkKNM9GsrAIiV6Gfp8/2Hdbb2w8YqlUDm11YAoBeq/pZ1DQB80bI1+JtxR8oKvwEo5glvTl4KAGXmxoBMoRHwMWZYeVvXQFNbwDRaTpwuL3M4Ly5KnZoY4CEeMzb7kP8BAJQyjo83E55gEqt7da755vipXXWNzaaBt/cVA8C26vqq7j76fwD46NCxN/YcWnPkxI7axvUVNbvqmngIQgvXnarsszvOm7YaM9wKq9hYCQArYmawE0JzUfRUtuh3wxhuh4leqAYAJxHwsJ47hm/JCkuzzedMl8exQmQTpZECFMNJot4+5LvhhPN2cpSJAPB92+49vSdDDXccNlYBwDRtDsv/lSyLjpcYzF57pbWFKUcQZDZD3wFAvCQCAAZ8dqZweFjWXDhjhQePN/q3GQeA+SHc7WOgpSNgWDAh9vfySfbjIwiL23OstYNeSjNZp6nu7aP/B4AohXxuenK0UpGgUfFQVMDjoShKCyUCfn50WOb2iFyVdO9i6Q3+f1u/HPL6hcnbD65ZLL3hg8e+YSdwmoQUUG3OPgBIk4flHKWJEevYot8Ho72dLpdxS/fRCktTt9tkw11ewuclcQAI9RqfdYZvyRZHNwCUW5rm73qQnQYAADZfgGMlzNuZpMlcHj1tfeehZyo+jxCpF0dOuih6ql6oYuZpc/YCQJwkgimkiZdGtDp7mh3d41RDHSKdQMnszwIAPR2VDGP9GT/TCpIkYoHTNdht3HO47ubVwyl0ANgT3vjgGCir7WQe5mWE9USdT+LVqmXZ6adXMIIsgz4jQociSEaEDgAuyc8mKYqeg7XuVCUAWFxupvCscO1jq3pb+y1GW/GGE5aguZlnCIfC8hA++pGSBK42MzxSLt/W74FR3c6mrsOv1f6Ik0SC1DBOlaoTKqWY6MRAHd25OD8M35JOwgMAeqEqJcQcACWj5zWq23kg4/J5hglft2wvMdV+0bz165btiyIn3ZFysT+6zUV4AYClg2hEqAAAWL42zpyjRcDHZhQmb9s/6Hqva+7t6rVERQQ4v5n4fETxiSb/YUKMJiV+uA/AqNhxoMb/W6uSZqWcnS7JWWR5Dls705rIr4/8P1blZ7PynC0uvn0+/ePBBf+yHDr3CkuI8hFAKKBchEeKjfyS/84J/3a6XMbXan7EKeKvmVf63fkAYMddnG/4BYFWDVmKhKdzBwfOQzGG2xmnShmnSul0Gdd3HlrfeXBT1+FKa/P7Ex/ioxgASDEhADB9ZH5oXRbOJ2EMzJuW4VdYALDnSP1VywsZ6QEcOdXi744BwLyz5G4HgKOnWuqae/2Hy+bknNXX/A/CgsOHhSBItFgHAE2OLnba/yDh384RUzVOEZmKeObrDQDdLnZA8wUkXhoBYdwLnMHtRIu1t6csXzPl8XhJRIujZ0/fSVqeII0EgFZnT0BuAABoc/YAQIKUw1o8c6YWJEoYM673DOvGYqWG6cAiRjL4CYJ858u9/kM+xrtk8ThG+h+cJzh6WAAwWZu5tr1vQ2fxJE0mO+28IOTxAYAZFHomhHk7dN9BK1CwhKXmAJ/IhSVfmSzHxG3O3gpLM+0pD8UZ3o5KIJuhz2tt2UEH8QLAdF3Ohw3ri/sr3YSXae412Dtbnb0KvjRLkegXnkUEfGxmYcrW/YO9wvKaTqPZoVUNjpAyIUlq/7Gh0PDEWG1SnBYAXLjPgXvFPL6Qh5EURQJl9bpFPH6fy56i1Lpw3472+imGeL2Yo06aNWuP1DYNda8uXzbBoAtoWAC4Y9LjzZXtD394+4JrAsI7AMDj8l6VdK/T5np1+99zpg1FkxzfWb7una3VRxocVqdKrxg3O+vyBy9KCoq5p0jqyJaTe38+Unm4rr/DRFGUOkKZNSX1snuXZkxMZmW+Kulevoj/RdWrdrPjy+fXHVxfYuo2SxWSlPz4256/OilownaYEDixZc3e7V/vb67o8Hq8hnj99OUTrnhouZwxXWkMeJze715dv/uH4t62fplKWjg/78anLuMLufUScPawAGB1XJGYJ9zXd+rTpk04Y9Vwk9d2MrzH/QxJlEYCwPGB2j6PmZ02esK8nQSpAQDKLU3+QE0n4Xml+rt+j8Wf54Ij5AmuTVwIAM9XftloH/IBU0CdMjfs7i31S0Z1O1u7j5ZbmijGFuf9Hsv+vjIA8Ad5xksM8wwTzD77y9Xfek4bhn0e84tVXwPA1fHzxrBYRZgwxwpJitoX6Fb3c7Kq3WJz+Q/93asm68DrJw9sbq3d2dGAU+R3daf2djbhJFFu6gGAdU2Vva6A0FwWpZXtn/xw0H8YG6n60xXTGOmDLL9tPgBs+HgXOwHg4G8lTpsrJjWSqa0+fvK7xy5+6cjmk3wRPzE71u3w7Pj24D0zn9639iijKABA8aYTT61+dfvX+/vajRFxuti0KEu/bc+Phx+Y/68TuytYmQHA1DUw0GO5d/Y/fnlvm0gijEuPdjs9JTvKpcpBd+Rocdndf1v+0uv3flpZXK+NVidmxxq7Br7/74Y7Jj3eUjXCqPQweFzeRy964at/r+ts6IlONmgMyt0/Ft89/e+mbo5HlIb7CYsUaZ7Muf6ZijVfNm9b174/RRaDINDntnS6+qdos8apUtkFwmBf36lOV78DdzsIN+2d/axps1agkGIiCU90UfRU2lFCk6NMzFYkVFpbbj78Yro8joegVp/j4pjpy6OHHpTwKwzzdiZpMlNk0Q32zlsOvzheneoiPNXWVh+J35C4eE3zFv95abZ2HzN5rQ7cZcMH35C369bK+RIpTyTDxMzpPmed1XFFHa7+3zoO3n70P8myKLVAPuC19bgH7LhrvqHQP0tmVLezs+fEUVO1DBNHijRKgdTmczbYOwmKnKzNmqYb8s7en766y2Xc3Vt6zFSTJo/1kXi1rRUnifmGwsvj5gxVd7ahrUK/c2r34bpVizgsMvaE59MK60hvmxjjJys0J41dEozPR1Gzx232uustRpwkMQS1egOGC5gYBxxPvbbeHzeP8dCn/7JMJOQH5gIAWHDNjI///l1lcV1LVUdCVsAA4o5vDgDAwmuHel47vjnw/X83RCbqH//8brqXRBLkD69t/OSp71++7f2MwqQIxljB1KUFq+5aNGlR/oR5uSgPBQDbgOPfN75dsqP8y+fWFszJ8eekwX3Ek5e8kpIf/+r2J9URSgDwun3Hd5ZHxAXM6wifdx764tS+qqTcuL9/dW9MaiQAeFzeT5/+Ye3bW56+/L/vFj8rlo3FffnNi79WHalXG5T//vURuutnMdpevPndXd8fYmc9DbfCAoCp2uyPJz38Y/ueY6aaamsLIIiKL52uy10WHeAQCZ/vWndVBcbpbOs+5v8911CgZCgsBJDnx93+SeOGQ/2V5ZZGIcqPFGvVArk/A4yywnBuh4egrxbc/XnT5mJj5f7+MjkmKVCn3ZS0RCWQf9G81Z+N5uPGDayuyvrOwVZGEfScKiwEkPvTV8/Q5f7acaDS2tLi6JHzJdFibaEmY6Fhoj/bqG7n8rg5Yp6wzt7e5uxtcOASnjBLkTDPMIEZwgoAUkz034K7f27fu627pMLShKFYliJhefS0+YYJ53TeEssqPFHRZnO45VL2S8Kc8JwUp02MGYyTujGzkL64An00AFyTPp4eyH9o/CwAuDw1L9S4vseLP/rSOuPAUP/rrutmZ6cNdjlZiGWieVdO2/Dxro2f7Lrz5ev88oFey/GdFQiK+E1FiqTWPPszADz47q1+mw7loVc+tPzIlpPlB2rWf7Tzlmeu8NeAoAizQgCQq6W3PHNFyY7ymhLuKFySpB777C7e6akwAhF/6rKCwCzh0tXYu+3r/QiK+LUVAAjFgj+/dG1NSWNlcd36j3Zefv+ywEIjg/uI9R/tAIDb/z1kqCq18oc/uuO69PtxRiQdk5AKCwCixNp70y5lSwMRoNiOua+ypVy8VXgfWzQsckx8X/rq+4ZMATajrTCc25Fh4rvTLrk77RKWfPvc/7Ak301/miUZhj09r1aYf7srg8NY8CNAsW+n3bmh49E2x+FEGYfFwWKSJpPpktvS+XSD7ZUN7QAAy2NfjJdOhtHcTqEmvVATuq0Z8FHsyvh5V8bPYycwyJDH0U8FSVL+bc1gNE9LMPOmp/sVFk6Q+481Li0a6voBQFV9N3NFdqa7PVgVsdQTp7aiKHju7c1V9d1+yaKZWVeGHqAEgOW3zd/w8a7tXx/407+uFJxeamLXd4cInCiYm6M/HWjaWN7W3dwnU0ryZ7GdqlmTUsoP1FQOO7BAE5moBwCfB/d58GCnz9Kbivza6gw5vLmUIqmsKal+beVnwTUzK4vrDvxybAwKq6m8zTbgQFBkemCTqiOUmZNSyg/WMoV+Au6zwtLhxD2FmiQviYt4HJ3eM8fhaxPyNBh6Ro66/9tQwP1tGZ65kY9M1v2p0bbvcP9H7LQx4fHhNpdHLOA7PN4Ipczh9jo8XqVEZHN5dAqpFyeMVodMLOy3OiiKsjo945OjvThhdrgilIOBYG4vvqe8oTA11ubyRKkVZofLoJL7CMLscOnk0g6TJVarauoxWp2elChtv9WRZNAMnlTId7q9+tP10EwdnyQVCxyMCFKWwmLHi55xQMO7X+1lLtOcnRr52F2LGOkcJOfFZ09Nqyyu27f2yPyrZ9DC7V/vB4BF18/yZ2uubAcAu8W5RMYdm2LptwdJbNu/PlC2v7q9rss24PC4vJ7TTcE5whmXEc0WjZW22i4ASMyOZSecFjZVtLETwqCrqRcA9DEaUdAWAVFJESMrrHdrd5wcaAWAgskJ9x374vFsVZ/rCA8RRoinx8gWD5U4M7qcOyPEMxSCQbcRkz7X4Trzp3JBilqYGytbyk4OQadjW5R0/u95a5zw0YvSbkr5mS0NDwEqFQikKgHHUzU2fj5ULhHyTTaXXCy4aFLW9/tPycUCH0FKhPzZOcmHa1sFGDYlI66qrVctE9Oz8z/bcazTZH34kiKpSAAAG45Vub04AFS19R6ra8+Ki4hUy+k8+YlROfEGBIEesx1FERRFqtp6kwwa+qS9FrtKIl42KVMqHBqL5PN5MyambN032Mk6crLZ7fExfUl7GROeU+J1CaftwbHx85bSr34Zcn5HRShf/NslrAUzOVl+2/zK4roNH++kFVZzZXvDqVaJXDxjxZC17rA4AUAsEyXncY/ZRcQNObAAoHjjiRduftdld8vV0qwpafmxGplSAgDf/Wc9MxsTPpeXbWy4bC4ACFYrACCWCQHA7fCQBEk718LH7fQAgOj05ptMOM9FM/QHKDE1fTT11j8f/hRDeLQ/IklxpVZUcKz3b3rJ1CbLdzhpV4vyI8TTas2fUJQvVr5cKUingKw2vUNQHp14okY03p9NK5rQYPnCS1iSlVeLsajqgbcB0HjZcgBos/2KU64Y6SKdeJL/7DSxsmXx8hUA0GT9Nk52MYZK68wfJymu8p/R7m1y4u1OvJsubvZU1pvX2H0tWlGhVjRGE/0POOHzUKvT7SMIq9OD8VD6h0IitDrdfB6aZNDsLmtIjtQ09ZjGJeUcrm0DgEi1PC1aJz79qvBQ1Oby2N3eph5TYoQ6NyHSn8fh9nYYLWnRuni96nBtm0Elb+ox4QRJnzRardAqpC6Pj6mwAGDetHS/wvJ48cOlzUVTBgfdWjpMzIl+ZzgdZ8/huv9+vNN/qJSL//P4pZrwhthmXzL5/Ue+qjhU11rdEZ8Zs+PrAwBQdNkUISOUjHZR62M0r27/u18YCku/jdZWK/688I5/X42dXjHC0m8bRmGdRSQKMQC47RzjEk6bGwCEEsFotRWcVlUe92A/kYn39PocwQwpLB6C0qPaJEWSQAJAm+23Nttv0dL5FOWz+5oLI54HgEbLV2IsQorF1g18NNHwUq/zgIyfECe/GAA8RL8/GwAkKa40uo93O3bHypf5SHu25i8inr7PfSRCMkMjGn+q//lghdXh2GLz1kdIZsgFaR2OrSpBJg8Rt9rW+c+oEuWohLnJyuvo4iphtkKQmqa8GWGsMXB2seN9XzRcOU5z+XT9nUz5z633OHDj9clf0x4SksJLjF/WWLfa8T4JT50inzNF9ycMHfpQIIAOeFsO9L7d5SrjIcJIcc4M/Z3K0x2iXd0vV1k20r8XRD2erljoL+in03nyhOmbbnelj3SJeAq9MH224T45n+1WCMWIV8hi9Yx8kqK2HK9dPCEdRZA4nYr+QfunM2L0adE6FEHuvmg6AKyaqgCAFZMDZqWtmppDH9J5aPx5SJJCESRGq1w1VeHPQ5+U06MEQVbhvqP1foW192iAPRhmvCgnJyrbn359A3nazhIJ+S//7ZLw+2t8Ibbo+lk/vLZx8+d7b3v+qt0/FgPAwuuG7EEAoMcQOxt73A7PML0JmuM7y112t1Qhuevl65hr6g/0Whi5ziG03UebsSxaKtsBICFrLP162gfX127yuLxMbQ4AvaHX5BjSi4uj8m4v/qTZ0XdL8UcXx0wAgGjp/HH6J6OlCwFAjBnobD7SgSESFBGmqf8EAD7SLuCp/JX4s7XZN3Q4tmCojARCgsVkqe+uM3/W6zoEAEKelocIqdNLsjKJkS7O0T6oF0/RiSaY3KUdjm2xsotYZwwqzv1wny1kmD5GUlBn3cGMUbL6urpdFRmKhafPTm3ufPrEwLcp8jlzIx9OU8wvN/+yoeNvzCIIgv7a9pCIp5oV8Zd89aUdztL1HY+Rp5eFnRlx9zVJa2Yb7vfnZ1Fj3fpL2wNmb9t49RVzIx/OVa3EKY8UCzAchmXkKwwGRZClhRm0+vD/8GsTplrhFAYfMoX+Nd7CKUJDW4X+w4PHm/xqZR9DYaUm6uOi1P7DUVHf3Pe3F9f5F3vAeOhzf12Rk849LBiKi26dhyDInh+Lq4809LYZWeFXAJA2PtGQoMN9xObP9zDlnLgdHgBQGxSsHUCCw7XOEVOXFfAwXvWxhva6LlbStq/3A8D05RNY8nBIzo2TqaQkQR5af5wpt1ucw4w5DCmsS+MnPZ1/yeO5K54dt/ri2AIA4KGSYN9QnPzifvcxk/uEB+8HAINkVrt9Y/XAO93O3cxsKGAOX5vFU4kAavXWt9rWUZQPhn09AKDdvrHM+HK7fRMAIuXHEZRLwFOyzshCJcyqMP3X5D7JTjh7ZCgXO3Bjp7PUL6mz7gCAdMWgC7bRtr/ZfnB+5OPT9LdnKBZN098xTX9Hh7O02X7QX4Sk8BT5nAVRj2cql07U3jBZd7PF297jrqRT+ahEJYhTCxL8+Zn4SOe+njeUgtgrEj8u1F6XoVg0UXvDyrhX0fBWlYXwrvB/AmbXyWJz1Tb20j+q6obG8sa8XF9nj+XB536yOwdtHxRBnv7LsqnjEwMyhUFUUkThgrz+zoEf39gEgeFXNAiK/OmZKwHgk6e+3/HNAea+6M2V7Z8+/YORsf8r3cHpbOytOj2qQJHUho93ffvyr/485xRdjGbFHQsokvrXNW92nB4z9bp97z3yVdXhem2U2j/beVRgAmzZLXMB4IPHvvF336wm+79vfMfj5LATaQKe+FiJJlaiAYAulzlBPhQBIOTpsjWDMQQSLKpA/0+Swum3hY/KCiP+7T/0Z4uRLY6SzkORQXeGjJ+AAIogvAjxoHUwQf8v+ocfvXiKXjzFf5iuupX+wTxjBAyOvPiLJyouJykvigR0KRtMpkWffsaU+MnS69ffcD1bOizJsll70f/WWrfFSApoSa11u0GU5fdwN9j38FFRsnzouYyTFgJAh/NEkmzwggEgR3Wx/3eEKBMArL7uKHG+XxiKdudxL+mYrv4zH2VHHoVJmFcIAB4c//zEiQ01tY0mk48k9VLJ1Li4OyZPTtWEaxOFD0EagfLxeOFatQAwZVwi0yo8eqo5M8Vw+GSzv6sFY3VgDVicDzz7o5GxyfZfb18wtqoAYPlt845tO3Xgl2PM8CsmRaun9LYbP/77dy/d+v67D38ZlWxw2Vz9nQMuuxsAFt8w258za0pqwdycE7sqHlr4XM60NIyPtVR1GLsGrnl05f5fjrUylq4/d/zpX1d2N/cd2nD8T+MfjUuPEkmFbbVdLrtbqZP/4/v7ZYxpUju+OdBR3+2wuhwWZ3ttNwBs+Ghn5aE6iUIsVYgnzMvNmpLqz3zdY6tK91TWljT+efITidmxuA/vbOxVaGWX37/sh9cGPSQsuD/Rb9Vs+3vOJTa3R0KPaitkXpwYcLoMChmdwYuDze3QSCWdA5ZotbJzwB6rUbl8PhRBcJJ0eLwGhcyLIw6PU8THHB6vze2xujwFCWMfah2mN8HSVmcdPipOks1qsO2dbbifhwj6PXUD3ham+WbxdvhI97s17O+MhxgKCwIAOTb0ZvIQPgAQ4W3KZvF2AoBaGM9OCJswr9CD49d+/8OJrqGef6fV9nNF5aba2k8vvWxSbAwjLwcO129S8TKAcP2JXl8FSZikklXshNDw+byZk1K27K2iD0vK266/ZMqRky3+DOlJEbGRKv9hmDhd3gef+6m92+yX3HntrJULRv6WhGLKkvERcdreNmPBnKHwKxaX379swrzcde9sPbWvqqm8VSAU6KLVKeMSZqyYyAxzB4Bnfnzwx9c37vq+uPpoA1/AT86Pu+uV62aummTqNp8fhcUXYk9/e9/2bw5s/mx3Y1mbz+szxOumLC24/IFldCS9n7Vvb6k70cyUVB9tqD7aQP8mSYqpsIQSwcubHvvuP+t3/1jcVtclV0nnXzX9xqdXdzZ0D6ewPqrfzZJWWzt/PlYuEfB7rHaVRLx8fOYXB050DlgfWV4kEwoAgE7FSSo31rC2pCI31oAgsKOiXieXVnb2yoWCiwuyWozmH4+U6RVSlUQcp1GOdtve3xUZikW11m3N9uIU+exa63YUwVLlc/2pFJBinirYAyXnD3r0aIbxcI8EBQBI2IogmDCv8OOSEqa28uPy4Y9t3brtlptZf0KStJqtLwGgMunlQFFW23s43igUTBPw0632T0nKKhJMlIgvcjh/EQoKMCzeYntTKb97wPoSRblFwukIIgIAr6/M56uTSoZ69MMzb1qGX2GV1XTiBFnCWBB5DH0in4949KV1zLnN166cdN2qyYwsowbloTw+DwLDr4JJyY9/6L1BS2IYSAx5O67nv+vvnhwV4N5+4J0/PfDOn5gSAPi26U36hxvH53//yX/nLmOVGgN2r3faV+/bvB5YLfrhi6cmRYb8dL21/xm2aFhEUuGNT11241OXMYW6aPUWxxqmxA8GADu6Ky6LDxiw46M8DEUtLne0SqGTS11eX5RKnh6pkwgGTTw6VS2VtJssAozXbrKkR+oIkjzW1M7n8aykB+OhJU0dIj5G1xCnVRbXt8GQw/R/jFhpoRTT1tm2p8hn19t2J0iningKf6qSH230NCTKptP9prOOnB8FAGZva6Q4h50WHmFe4a9V1WzRaZoGBip6enINAQqOJM0kaVUrH6fNOj4/UyG/GwGMIHp9eL1e8zadDSc6+VQGAPh89S73Tj6WLJNcAQAuz16vr9rrq1YrH2XUOgJMq9Dt8e06VBsQ4D5KBxZJUf98Y+Px8ja/ZMWC/LuuG7LIxkb10Yauxl5W+NWYocdG+CjHF8vicfN5PAnG8WcdptRokQkEZTff22Gzzvj6A3ba+QUDgItjClbHB3xPSk0tV4wPGGBeOSFgxPqKKYOpBEnxUIQgKRRBVhXmkBS1+VTtkvx0FEGumTaeOeBz6cShN/x/DgSQdMXCsoG1na5Tdl/vzIh7mKkp8jn1tt1lA2vHa65gygGoszKIGSudwEfFJwd+TFPM543J/g3nCkmKajANhTIFU9tvZCksDItXKf9msb0jFs0Xi4qY0wkx3pD5jwAKQFCAU4CTpI2HDplIBNmHADKqhmJZhczwzoxkA2snrhF59aMdu4pr/Yfzpmc8fPsCRvoYWffOVgBYeN1M1oD92BBj/APX3M6WAgDA0wd2LEvOWJQ4ZGf5GabU2Pg9GEkYAFyTNBQmQ/N43koIGmDmPOShQ//TwmXjBj9xrOHpYYar/yfIUCw6Yfq2uO8DIU+eKA2Y65cin50iLzrY957R2xgtzqeAtHg7muz7V8S9KsP0zJyckBTuxE0e0j7gbQYAs7e939MgQCUSnoa2IoWobEbE3bu7//N98+2ZysVSTOfAje3OktkR9ysFMQBAUD4nbvSSTrO3DQAGvC1STCdAJRJMQyu4cK7QjeNM13UwDh977Mbrq3a6NlDgpY1WgSB/wPwvqWQ5xktgZhMKC83W/wr46SgiFovmG82PebzHBfxxCCoWC2dhWILZ+rJKMYpO1nyGVchcBXS04Vcff39w7daT/sNIveKyxeOZA47hkJ4UwecH9GJ2fX9o9w/FQongigcuYsrPOiRF7W9vWZY8urv+nybAk00BRT+ywnO2sNH/Lhphkk6Y2u2qyFWtDBoBQBZFP102sLbasrHeuouHYDK+IVE2Q4SG1ansdJ38te2v/sNjxjXHjGsAYLr+z+M1V9LCbOVFcsxwwvRtifFLnPKKecpIcY6QJ6dTG+37tnX+y1/Dgd536B/zIh/NVC4BgHCuUMzn8xCECK2zlEL2GKWAn8nHUgBBEMAAQC69gaK8CCIAALXyCX82oWCiXvMugmB0N0qveZuifAjDOBUKCvy/w2Hy+ESZROiPP/Azb5Qbpn7+82HmYXef9e6nv2NKwuG7N/9Eu/n/ful/zP02q9HW3dwHAHe+dJ0uMNy00Wx6+ej+Qx2tDp8vQiq9OXfCrfkTAcDq9eR/+uaha+949diBTU21FAW35E14aNLg2OK4z96yetwUwMdLLpmfMORVufyXbyqNvQ6f7/Yt62jJPROm/nWkUhD6MposA6+XHDzc2W50Ow0S2dVZ+XcVTGEWHC3zvvvkrvGTd7c172hpkPD512ePv2/idLrbMvwt/1pf/dbx4mbrQIxMcVVW/q35E3mnuztDL967tTt+bS+x+dwkUGnyyM+n3+FP+gOaKxI/ZItOgwCSr740X83tOS4yPFhkeJApWbOp54qZa+OVKgCIlRQyF3LYW95Y0dZz59KgBRtcqSviXmELAQAgTT4vLWMeS/jK2r0SzdA4FwJING/xB1vQt+5YNZSJAQKQptNV9/WxE06TFxlgD9Iw9Q4A0NqKBU6SGMrKxuFzCR8+xps5MWXz3kqmMCs1cpjNKTjhnDY8ZlAe2lnf7XZ5U8clXPHg8qLVAW97j8O++pdvsrT69xatNEhltaZ+jVjCzHDX9l9XpWb/efxko8vJQ1G//ORN9zhxX/bHrzPyAgB8ftFqD44XfP72m/OXz0tIAQABY35MqFLDXIaML4iUyl+ff1GERHasu/3RPVuydRFz4pICKxgd/zi48/Gpcx6cOL2kp/OJfdti5YrVGbn+VM5b3tvW/Njerc/PXpivj2w0mx7dswUnybtPq84hhXWov27D3L/+q+yX+7OWvF692S/3U1PZ6XJ6xk1I9Hpx4emlM84Qo6dWKxzdVzEUZ7Gq88BfLxmdW7ff6vhq94m/rZ7LTgjNaE8BACsyM0MprKlxcUlqNVsaHusaKmfFJCqFIqvHHSGR9bscAKAQiEweV6RkMFBmtMybls5SWGe+PMMZ8s8fHmCLGHxddRIA+WDxJVI+HwCSlOzGnB4df2NuAQCkqNhhEP7+BRMJxqflQgyj62TBWWqYy9BLpH+bMvjMJCpVn5QdL+/rOUOFNTMm4ZqsfABIVmkOd7WvqShlKizOW3695OCNuQUrU7MAIEmpvjZ73JeVpRwKS8wToAjqJXElX9zvHhp2ofn8/d2Vp9oAIHd8wpMPfPPyuzewMoSiybYrUV4UHDFPUznww6zIIdvhTDiLVZ117nl/XW58ZFu/eUJKzGXT89bsLPnhwKn/3roiNUoLACRFPf3VVoKiDlW3FOUmz8tLKW3sfHzNpk6T7a5l0yanx9V09H245XB9l/HvX26Zk5cyfxzbw/rCj7tMdpfb67t10eT8xCgAYJ3iH99sc7i9KqnYX+SN3w60Gy0ur+++i2fSeQDg5sIJOxobSjo6/dloElSq/yylTcux0OW0bWutJ0hSwhfMi0ve1FLbYjUrBaI2u+WpKfNkfI5O2YgEW4WjtQfPMxX9veMiIjk1C02BYexRiuEzzGU4fL6PTh3b0dLQbrOSFGnzeuYlJLMzjZI09eCjBQDZWv2WpjpGIvctV5v6S3o63zkRYK3jJImhKDAVVrxU6yMJMSZ45Pg3tqDdH04db/nP+zc+evcXGIaiKNJk22H3dTvw3gzlCjGmKzN9SQGVoVwhxjTH+z9CECRVsVQrTO9315QPfGP1tUWKx2uEKadMXxKUL1WxRIrpjxs/lmB61tiQl7QzizPPIuNH+ovL+VEjVvW7or3f8silc+L1KvrwhnmFdZ39/tQes93idL9x+8r3NxcnGTQAIBUJnr9haX2X8YMthyenx2XE6G+YV7jhaNVjl7PtPgCgKDhS1/bRPas18iETg3mK0sZOBODlmy86Wtf2+c4SACht6nR6vC/dtKy1z/zqur2v3baCzing8b68/PLPj59YX1NDR7rHK5VL09NvmzRRJhiLWqGJlSn0YlmLdcDscQlQXoRYhgAi4mEZGh3neHw48DHels8DxmrHwL7vAuz0cwo10rgTvVfzuWaYy3ho18a6AeMLRYvzdAYRhl300xp2jtGDk6T/N0WxX9HgWyYpyoX7Hpo0c3VGQAQPra2AqbCeyF0JAI9kX3TE2JirZEeaoShC2/skSZEkZcd7I8T5OlHGod5XJZg+U3WJFDMc7H15nOZGL2mfqPuzBNMBgE6UoRYm56mvRRFexcAPEkwv58ecNK2JEOWkKZYpBLEHewKcMh7CxizOPItakMIonjdiVRcKn/kvPMkNqGAiUygSYH5tFUykSs5D0X98s81sd10xc1xZc1dKlBYA5GKh08MemAsGQeCpKxf845ttConokUuLFBK2a7zDaEmIUANAvH6w/9/cM3C8oeORzzYCQFJkgAEi4PFumzTxtkkB13+GXJKSAwAzoxPoUJjFCWm0nBkoMwxtTqNWIJNgQr/ES+Imjz1SrBrKBOAl8YN9tanySHp62TmCdRbOK+EkXa37sbbcjePBb+mY4SEoEqgURmSYy9jd1vS3KbPpoFAvQbRaLawMY6DePLTuQqWxN9gQZoEiSJZWXzvQHyUdHFBiMWSpHTU2vlGz9Y3qLcV9dR/VD/mAaeYuyn34zs/bmvsfvO3TRcvHAQCGCnkIn6R8OOnioxIU4ZGUT86PKtTdXjbwVYfzyOmig0+kj3TwUQkPEYzTXO+j3HxUwkclCBJgKgYX958loHgYVf2uGH69cwQBL44/tnrua7etUMvEwPUN5PN4Li/OEvoZnxz9xu0r8xMjfz5Uzk4DiNIoWvvMANBhHHwEEw3qrLiIl25a9tJNy+67eHBo5jzAGRkzInt6KrtcZqbETfiMXjtTAgAYwuMh6L7ewXCHYdjeXUZvBj4GWGfhvBJOrs8Z58bxu7b9WtLT2Wwx72tvYdlHw0CrpOABXAxFE5XqtXUVTZaBJstAr9PBTOUsNcxlxMtV+9pbehz2RrPpwV0bg/XgYIVB8mE40N66puJEo9n0Q035bw3V1+WMZ+cI4v7CGRsbat44fqh2oL/a1P9rffXPtUPOyiEt+3Llhoeylgl5bL1Ls+ySCeMnJbU29cUn6aNj1WUDlTWW3wAgQTZHKYgr6f8AQ8WJ8nkDnsZm+26CwuF0M+lEGUf730mSzUlVLDlh/FQuiNYJMxNlRaWmz5T8eAwJ6A4EF/efRStM8xcPp6ox4zP9CRVOJ73HgOzjaz4HRErY3yI9+wEAFc3nSW8DANzyJIU3UZQTFc7G5A8AAGF/nXTvBV4kkEO2Hidmh/u9TYdKmzpdmw5Ny0y4bHpev9WBAPL3r7b6cCIlUpufyDEZOCVK22ux//WT9SsmZ8/ODfAsmB2uJ7/YIhEJnG7vQ5fMBq5TrCuuePjTDbFaJT0WMz4p+lB1y18/WQ8AM7OTVk0N6H6PSJOjPEk65DoFgGrrkV5P+2z9pUzhaPm+5dDymAkSTPhZw+7LE6Z91rgHJ/FlMQUAsL6jxEX4FkTmTdQm+0ji2+aD8VJdjjKWpKj367Z7SF+hJnlWRKZBpGx3GgHAgXv8xdPkAYvDVFk6vmra3+YwFmgSk2WG71sOOXB3nip+vCbx66YDFp/zyoRpx01NnFeSJo9CEcR/FuaVbOs61eE0dbstCyLz0hSRnzbsduLeZHnEVQmDQY7RMsUPK69++ci+Gzf+6MGJSKnsjvGTmBfGyStH93906pgbxwHg9i3rMBRNU2s3rb7Rn+HlOUue2r9jyQ+fq0WihyfPuiw9Z/hSw1zGy3OXPLF326xvPtSKJbePmxQhkfrP8vSBHd9WlXkIHACu+u07DEULDTHfrRiMuRmGW/ILj3S1/7t4rxjD/jxuMtPjHoqFiSkfLrnkzeOH3j5+GEPRFJXmzvGT/amIf2T3/bqdAKAVDo7asGLfKQpam/qcp32ceMy+eOkMOT8GHVw5j6KAoj3rJOUDQE/LAQAIyuefEeJf14ECEgEk2PHELF428E3gWYaKM38HV3UmqzX4TH9CRXN5kuvoQ9JbQtjf4ms+AQCf6Rae/D6UPx4oHyB8AMLbO0sQcYDCm3zmBwS6tQCUt28xpnyBZRIOz7ubDk1MjZ2UFkeQ5C1v/PD5/cM9B7urG+dkDims8vaeBJ1KLhoylwYcrh+PlV8zdRxruc4xwDqXn48aH781+Xm29Iw5bmpqcxozFNGlA81AAQ9BYyWaXztKcpSx6YqocaqEFyt/fSrvMgBodvTt7qm8Kblof1+N2etYHjOBrqHW2lViarw6cca3zQf9xf89/uqA0wA8W/bzY7mreAhq9Nheq970r3FX0PJul7l0oLnDNVCgTuS8Eroq/1mAcSVfNu3zX+RcQ46XxMU8gQN3L4zKZ576rOMjCD5v6F0bLbvqG+emDv6JT3X1JKpVCsazBAADLtf3J8uvmzBOOnon5rzvPrk0LfueCVPZCWfAUH9qV0/lipgJvBCG1YtP/dzbY1VrBpXujU/G8lExQyshfqvHv6SMH+b8Nb+6CTVuyCyu5LPOMlSc+TtUVWMG5Q+pGwqvQ/h5tDZE+LmUrxqwLNz6DEU5EERIkVYAkiJaUH4GbV8j2KCDJnzm5ae+teHgb0eqbC73DXML/fJOszVapXB4vARJKsSiqs5ejVRyoqUzWa8hKCpJp3Z5fU6vT4DxAKDVaLa43DkxBrVULMR4Lu/g+sJ0KUPghg505pQIrcvrazNZ8mIjSYosa+uOUimiVHIAqOnuF2I85rnogj3u1r19P3W6Gr5sfhYArk18AgHksHHTiYGdybL8RZHXA8Dmrs98lKfVUZ2tnFphObgs6tZkWd4x09ZT5v0UkInSnPkGtgahKdAkru843u4wXpc864eW4iixWsDDbk6ec8RYrxXIhTx+cNiUA3erBEMdAT923O0vzk4DGNrGB8AgUtI/NnWWGj22BKmeIMlQV+IvxYn/Igu1yU+f/D5HFXdFQlAw3VjpczgsLjdBUak6LQ9Byrp7IuUyFEE+KD62NDNtfHQUANBCKV/g9PnazJb86EhmZEOHxRqjVDi8XpwkOyxWjUQSKZeVtHcmazUkRUXKZS6fT3h6o52WAbPF7c6NNKjFYiGP5/T5pAJBZU8vXcpf54iw/2BnzND7P04VHylWqQUS5p/TT0+35b8f3syWnmPiZcPNdD+HMLQ2ws8g3Zvplqd8p1DhXNJ7iCLNfPXbQJoJ13oAQHhxpK8GgAQACm/0lw2TjBj9m7evZEsB1pdWr56U98vxyuXjM38rrUIQ5PujZQqRsKqzd39dyyPLZgsx7GB9S4xa0W6ylHf05MREsJxl/lJ/WTBdfTqm4XBDG525rqf/l+NVi3PTUATpt7l8JPna1gMvXrHkQF1LY58pPVIHAP5z0Z04gyj+sti//Lem6rrEJ/1nmaJdKuJJetytfkmKbJxWEO0mHEujbqm3l6oE+pPmvbck/wsB5NOmpztc9THiVH9mPwggcRKt0WNT8iUXxUz4sH5HjESTrYhhZWtzGn9pO9Zg70mVR87QZ7xY8UuFuS1LGZMg1a/vON7uNCbKIgKLB5iEAJCpiH6jetP8yLwYyaAiBgAMQdscRhfhRREk9JVEtTj6/WeJlWj8V8KoHly4Z8DrMLptJwdapulG/QHj5N2DRwiSilMpuqy2bpstUi7fUFlz06QJFrebduN8W3qKFi7JTFtbVrUkM43lIvytsvqKcXk/l1XqZRIUQb4tLXtg9nQAqOzp3dfU8ti82fubWmKVihil4lBLW3lXT05kBFMV/FJR5S+lFg/Fx5xnhhSWiCegd82hGa9O8P8GALVG5vMSfMHYO5//o6D8AkowxWe8GoBChXNQwQSKHADyLZ/pFoQXgWKZAIBgqahwlq9/NWBxCBbQbmfC8vGZm8tqjXanXi6t7OiNUsnjNEqz070oN93sdFtdnhi1UC+XAkB5R8/KgiydnN3X8JfyEoRf6M98sq1rWmr8lJQ4AKjo6OkwW21uDwBMSopt6DWebO2iAPznYlqdIyLlKVyojY8KMESAU95ed5vJ2/1Z0z/oVA/hCsjN4OaUOfSPKLHqqbzLcIrAEN40/WCA1dP5qwEgTqK9L3Pp6RLwr3FX0tkA4MGsi/xyf3G/xM9l8VO8JC5AMQC4J2MxLVwYlT/HkONf24DzSgAgQapjnsV/JTP1g2GrT+evfrVqw38Kr1fwxc+c+ulsKSydVCLh86fExzWYTK1my1Xj8z043mW1aSWSLIMeAPxCioIZifHTEuJYNVycnbmxutbodPba7dEKebxK6cUJCmBJZrrZ5ba6PRGyweenvKtnVV6WXhrwOFV09/pLMeXnmSGF9UDWcJGBBEHecvlbKelRPB4CAH9/4XJ2jv8r8DUfsyQ82Z082Z3+QwRV87U/MtIBADD5X4F7HHbsRKsU1V29M9MSAWB+durB+hbayvN/9hr7TCdaOp1e35zM5A/2HI1Sya+fVtDcP3CitYugqKsm5/tL6U4/iwAwOyOJzjwhIdr/EW4bsPhnPtf29CMI0jFgVUpEwb1tBEF9lJcCatihz4CkCFGckq+7MfFpFEEJikBDuB2C4VQ3wYTKFkoOALS2YjHMSizDVBXMRTEFXzXtxxDeVYnsZQXOCtMS4t89dKTf7nh47qzNNXXflpZdNT7PL7w4J5PTSIpRKqp6emclJWqlkv1NLTLB4FNBZ/Xg+PH2TqfPd23BuKKUpPcOHY1WyG+cWNBkGjje0UVQ1ML0VGapcNh55S1s0Rkz5HQfnqryduZhVm4s8/D3xpk43X+3ECSFICFDASgKSIryL5vhh7MUZ2aCJP3zudw+XBR6D771nR+2OWvUgoir4h8hKeLn9jf7PO0e0hkjTp0bceUx07YsxZR+TzsJZIQwvsJ6cFnUn04M7DoxsBNBUIqirk98gj/2tQz/ACDwj+X3uzOFw0NQFDJsWAkFQFIUa3LPiKXOA+EqLACoLu9orO9JTInIzvtdayv4P6qw/sDPwSMN0yensKUMqmq6Ig1KtSpgdvEf/B8g5FeUxQ9fHio92pSWGbVvR9W4woSrbjp/0YbngurW3m92nkAQxOPDeSgiEvCfvG4BO9Mf/F6pqOyIi1ELBJhBr3C5vG6Pr7PLkp5mqK7piohQGPSK5tb/1955x8dRXA/87fXeT6fei9Vlyb3JvYMLNr1jAgRCCyH0JJBCKqEltNDBNjYu2Ma927JkS7J679Kp3J10vd/u/v5YeXXaKzrJMjj58f3448/ee7Nzq925tzNv3rwZ5PNYOI7zuKxu9ZBEzFMqJnvE/hM/BqEarOKzTX977x4EARyHXz706TU1WCan80JX18UeddvQULteb3Y6LS4XDUH4LJaYw0mUSpPkspnR0bNiYrkBhi3MsTrGU2LDfnfvio8PXrx5YS6PzfrPwYs4Ts04eC2wud1nOzpqBjRNg7qOIb3J6bS4XE6Ph8NkClgsMYcTKxbHSSQpCnlBZFSiTEo9/yeu0NE1WHq542f3FnZ26Q4dr104L9VgsHlQ7KPPzr74zBoA6OkztHdolQohjYbsO1j5wN3zxaIfbW6LBMXxeo3mYk9Pk26wy2BQm0wWl8vmdqM4zmUw+CyWSiCIEYtS5IqpkRFTIyImEP30w/NDtmr/P/jg+HXpXT04wOn29q8rK0+1tfuuQgAAl92ut9s79PoTbW0fXipl0enLkpPvysvz3c0lxMesMVi6NAYeh9U5MITjeIh/V+o/3vC9vD+vWLEpK5Mi9OZUe/uXFZXnOzu9J+xIrC6X1eUasFiadCOB8jIud3Zs7MrUlIUJCTx/y+tD57fHT3xRUUGVjoc1aWlvrR2ZHZtEbt62zTc/BMGTc+b8YrafsEMMx2dPTzKbHRqtCQCm5cXl58adK27uHzBZLMPr9r8/XHXP7XOOnKgNU4oiwiXk3qgUDA7HrPfed/t7KADw6U03zY+fnGnfkp6ePXV1h5qaTc7h6GsKFpfL4nINWCxV/f0ATQDApNPnxcWtnZK2JjX1aqJDQ+G/pVUzAKBC30kV+4Q1FMxMfOnJr1PSI5rqeqfPDuY+mBilavUfT52u7O+nKgLjQtEDjY0HGhtnx8a+smhhqkJBqsSckJbpPHLjnP0X6uwu9wOrZnrnqz7Y3rQqYXy5SvotZqroChe6uv54+kydZiSTb4gM2e3EH8hmMM4+uEXO+9/0yGzOygpksHbV1fk1WGwWY+fe0q6eoWWLM5pbBogtkXv7jN4O2Z/du+Dw8dp5s1NKL3fwuCyZ1P/c1v6GxkDWKlwonBsXS5WOExzgWEvLWxcu1Gm0VN1YuFH0ZFvbyba2v5w5e39BwT1T86612aJwHbZqBgBs6ygGAK3TrHdaEoVhnRZdNF+WVzDKYN1+//zayu7Odu3MeSlBpgj77NUR3GwA6LPXRoS2xYsHw/569ux/Ssuo5j1kLnR1rf38i6fmzn145gzC6jBoNAGLZXGNkepAzOfcsTSfKgUo0/SO12D1mS1UEYDT4/nL2XOflZdP+E8jiBGJxvtc/4tYk5b26omTNrebqgDoMhjK1L0FUdSsSffeMRfDcARBEAQypgxrb94wDUWxWzZOB4BVy7IA4MF7FwBAdkY0+MyTkuyuG1lYS+GmjIxAZ4VIp8Hw/OEjJT2jZtgnwIDF8qfTp7dVVb26dMmc2Ku1oaFzHbZqBgC8PvUWAHi2fOuHM++nITQMx1+s3EEtCJCZG5OZS41G8wYHTG2rUnEyAKDVfDqMkxp8UykAMDmdW3bvDvSCDR0Ux/927tzlvt631q4l8mZIudwxDVZTj/Y/By/ev3LGoMk6JzOelItY7CdOHSASXDw3fQEpD0K/mfouMjgcW3bt9rvN33hZlJhIFV3fkOnWQoHHZK5MTdlV699w7Kqr9TVYAP53cKF75Qgm8VuSoF2vrwj8gG66MhrCcAxBkKBxZ37YXl396omTxArkSaFdr79n57ePzJzxxJw5frOJTjrXYaseecADDhMZ76e2DZHy0Gk1n223FJ0aeOPUwD8lrJgxrdWQ3X7b9m+u3lqRHG9t27J7j93tAQBFCMb7QHH9ujmZZruzrnPAg44kzbg7Y+pLMxc+kFXwQFaBV/Fg9FtGvYsGLJZbt22flOcKAIuSJvJorwV2t6fPZHah6IDZAgAuFO01mlq0g+XdIw+x32T5+/FzdrdbZ7UBAIrjXXqDyeFs0w0BgNXl0pgtbhTtGNSTjo/NWVnk6RQONDY5J+83T2F3ACsJADOio+MkEgBwoq4z2iq9y6J1GnDAbajTg6NuLNgloTj+6smTLxw5OonWigDD8XeLSx79bp9fn9Gkcx226hGn+xxlyt1F7yULVS3mgdmKZK8yoZIsLBQxI8I4IQ2mnB7PQ3v2BsogPmEudHX9Yv/+D9avk/PHNlhMBr1Ha+RxmD1aI8Pr5Szx2R5mTLzfRVaX6/5du5sHB730E0fEZk+L9NPF+FHYU1WXGR62u7JObTA9v7zwdEs7m87gshjeQye7250apugYNHxTXv2b1Yt3VdRmRajkfF5tvyZRIfu85LKEx+UwGEa7464ZecQp06OjYyWSLoOBrITE7HQea21dkza88GUSwQH21NdTpVcgnc3HBsqdmOu8tjpFGK1kS85pq/gM7jRpwEaO4fivDx0OMtK8eo62tDy4e89HG9Zfa5fWddiqRwzWQymLV0TmdFsH70mcnyBQepUZByFaKwB48eix8t6x+1ZMOj03PDxFLlfweVwG04l6zE5Xt9FYr9H0mEzU0gAAcLKt7a9nz4UyAXHfyul7z9f2DZofWjvKs9tmHHqv6qIbxdYkpi2NDWmGweBwEFkcURx/bN/+MQ0xj8kUstkcBsPh8ZidTr8eHIIFCfEhhi8H4aVFCx+ZOUNvt+vt9iG7Q2+3Gxz2Ibv9imT4gOicBoHPYuZEhbfqhtLCFDwWM1EuO9HUui4n/UJ7N1lGwuUo+LzSLjURdMKi03sMRg6T0aYd8mBYlESk4PMHrTYmnU678nchAJsyM/9x/jxZiTe7auuuhcG62N2tDtCEeEzmqtThlkxHaBaPPZKrmCKKBYBUYcyloQa2ImCX8OVjx0KxVlwmIzc8IkIolHA5Ug4XxTG93WFw2NuH9HUaje+EHYVznZ3PHT7y99UjayqvBddhqx4V1hDPV8TzFQDQZzdEhJD11ZceW0Wj8QixR/bSiF9T1Vc41Nw85kNNVSgenDZtZWpKINPTYzLtb2j4oqLSd6T9waVLFIlfmnu0ty+ZCgCVrb0RchEp/7qh6o9zlzNotNeKTy6KSQzRX9BvNsdLpX87e+5MRwdVB8Ck02fFRBfGJ+SEhyfJZBLuqE6cze1u0ukatLqyXvXZjk6t1UqqAg31UdxDp26PGBAGjaYSCFQCAVUxmkPNzY9+t48q9eLG7HQA2JA7vA14ergyTaWgIchNeSN3T8rjzk+On3fFv7AuJx3FcTqCPLFoDlnDnqo6BAGj3UHeh42ZGf8sKiLXM3pztqNDZ7OFMsYfF7sCt8DVaalkq1sZMcM75GXQaZomC2g9Pyu/vK2qmir1gsdk3pqTszo1NTtcFcjNZ3G5Lvb0fHG5wm9DItlTX58eFrZlWqhei4nxA7fqMfHf4t9pPPqHvIksb24xnSwMf4KBBFspZnI6Xzp6jCr1gkGj/Wr+/PsK8oNbimiR6OEZM+4vKPiotPTNogu+GV2Dg2F4WbM6OzECAI6VN6fHqYjEUgCAAPRaTXwmy+Zxhz5P1G+xDFitH5WWUuRiDueBaQW35+QEScrBYzLzIiLyIiJuzcnGAeo1mu8aGvbU1Q/ZbAvjE6ilASwe0/GBvXmSWXH8FKNbD4ALGCKrx2J0D0mYMiFTQpb01vIZgk5bi5SpkLIUepdOylI4MTuKYzz68JR/8BvuDXlbiAPfu+T92bfa9TkZFEmEUDg3LvZsRydFDgAoju+tr3+gYDJ/mQ6P51BTM1V6BYpPzTtAr0AWcAxxubfvj6dPU6VXoCHIQzOmPzht2pgxNwIWa3Fi4uLExMr+/peOHgsSOvD3c+cWxMd5B/RMOj9kqw4FBgB81HKKIm0w+RmshbIvoZCp6rPV8BgyAJCz/V/Tv0su6u0BE4xwmYwP16+fHfLcLYtO//nMmbNjYh/YvdvoGA4aDIXjl5tPV7aqtUYEAW9rBQCP5M78tLbc5nE/kFVA/akFprKv/8vKCkof4abMzBcWFkrGaqPeIAAZYWEZYWG/mj+/sq+P8tYi8OAeG2oldict1Z91oLZkQabGoZazVeWGoqVh6/iM4ZUo3tpsyQwMR7/v235H3KMVhuIC6bwy/bkC6Ty4tp6QUNmUmeXXYAHA7tq6yTVYR5pbAk0ix0kk06KiqNKxcKPoc4cPB3prSrncf65ZPS9uVKjQmOSGh2+/9ZZfHjx4pLmFqgMAABeKvnj02I7bbqUqJo8fslWHAgMAjvfX3hQ73Vvqm2cjxH0JRcwInbMVnK0QwGBprdbPL1+mSq+AALy9dm3o1opkamTEJzdtvG37N6HPKC0rSI1WiNPjVFQFQKth8OmCuQBQNqCm6gLzl7NnvT/SabQ/LlsWPFA4OHQEyQ/gmJQwZUKGKIobDwBMhMllyquNl9g0znzlSjfm0jr7SINFanMlM3tsbUMurR21AsB02YLSoTMWj0nk1R37cVmWnCRis/0GgtdrtfVabbpygq5VX4J4JCb2yD64VNoy5H9uXchmb7/1liSZjKoIAR6T+a8bb7x357fnOv2b8vLe3qMtLcuSJzJLFgo/ZKsOBRoA3BA1dVPsDO9/yQLqz7iqvPPP794FAMS+hBQtiZQdO2BviOHly9nxVB0AAGytqgoy17tl2rQJD25zw8NfXFhIlQaFyaB/9H3J+/sufHighBSiOF7S3+PBMA+Gfd/eNLH5YxqCvL12zdU81zFBcfTC4HEAYCAMEVNq8RhThJnHBva0WusJQ0ZAamO4CYMuDYYP/zkChsjoMcTxr1VDnwBsBuOGKVOo0isECUEYLxqr9XyA3z8NQTZmUIerY2JwON4P4DalIcg/16yemLUiQAD+umplkJHXO8Ujrfea8gO06jFhAMDtCXMo0hey11EklH0JKVqSRuPRDMlKJ2YZcDRF8/K9U7ADAIphQVySKoHg8TmzqdLxcHtu7o7qmuqBAaoiANtOVuSnRAu5rLquETfBoY6mY10tXWYDAki2QsWa0Mzxs/Pnr0hJoUonlXVRd6G4BwDmKJYBQJZ4GgCkCrK8U+BTtIXK1RiOLgxbCwAYjtIReqZoMsdZV8/m7KyvKiupUgAA2Ftf/+vCBb7usAmwt74+0DTcvLi4cOFw5zR0Pi4rswYYYN6Rm7swwc9QY1yE8flPzZ3zyrHjVAUAANQMDFT09eVFRFAVk80P0KrHZNQ8RY2hZ1d3aZW+i0dnecvB376EfqEhDKOr1+zWmFy9FGsFAMXdPQOjQ9G8eWj69EATgiGCADw6ayZVGhgRj5OfEtXer9cZre4riV/XJKS9NmfZX+av/PP8FXem5406ITRmREdvmdSNSAPhO0tIsVa+kAUazdUzZYvoY5WfRNzY2H3VbJUqkAtZZ7Od9TdRNQH21AUJvwoYrxAIF4p+WeHfyLIZjJ+Pp0EGYUNGRpDNt7+traWKJpsfrFUHZ8Rgfd527r3m4312w/vNJz5uPe1VBgBg9Yb8p1+68fHn1jz7uw3L1gQ0WAXy2zFAze6BGYp7qDqAIy0B52V4TObm7HG3FV+WJCWNOXlPcuey/HCZUCHmTU+LZno53Qdsw1b1aKd/Z2cQEIDfLF40Cd2Aa0y6KE/JDqdKJ5uGQW27QQ8Ag3bbny+cvTzQBwBVmn6tzQoAWpu13aDvtYwKhgoy4tg1GT/LOo02UDyRmMNZlpxElY7F0ZbWQLM9t+Zkh43OjD5heEzm+ox0qvQKx1vbqKJJ5fpp1SMG64ym4e3pdz+auvSdGfec1/qxLJHR0lnzUyOjpQN9RqruCtX6PQBItnSdkEn1ggHAibaAt3VZcvJVdq8IaAhChvyNiUzIA4DVM9OFo+csivu6iIMqXX+geZ9ALE1OnjJ5vuHrls6uQQBwuTz9A0a73XWhpHVAQw3CPNvdUaTu7reaAcCFokang02nf11bqbPbPqi4pHfYP60ub9YP/rv8oveE3fr09EABSsda2/y65MdFEHf7jVOmTMADEKTCIC65CTArJoYqusKAxRLICk8K10+r9t8ygpvST/7lfywNAAXy2yO52ZeHtp8ZeJui6jObe01mipBkAm+2QCwIIYFRj9bw9fFy8t+2UxXeWg6dsbO55kR3W6fJEOjHE4hbc7Kpov9FDhyqxHH8QkmrRmvu7TNEhIs/++IcpczMyBjAcaJXFSEQKri8DEVYl8m4OC4xXxXZbtBjGL44LjFbqfLuZMl5vEATL06P5/vGRqp0PKA4/l3g5ThBljQGwunxFHUNv94oyHm83PDJ7MPmhgfzUo0rNdN4GW+rbjQ3UEU+hFKG4P22fzdbmojjESfILEXyLy59niGOqjWq5yhHXGtffzxqXhMAWhoD3hoXZtM6mm0evZhFjWQJssgZCfr2GC/To6NpCOI3ZpqkWT0Yo5SESYfdq72Doyzp0wXzTvW0m13OP8xd5i0fEyGbPX+csTb/peRmx9TWqesbeh/ashBBkK+2FcfFUX1PDYNaQJBu03B/3I1hX9dVzYmKfbesRGuzPjd7wbGO1o+rylr1QxvSRk3MbcrKPNrifzC+q67u1pwcqjRkzrS362w2qhQAAKYolZmqMKp0LC72qANF0iyIj/eNp70aIkVCGZc7FCCGsbp/4Jbs8ZmVEJlAq96j3vXrKS9QpaMJpYwvIwZrS/LCCn1nm0U7PywtWzJiPs6eqF+zcdRcEoMZsNvcYDwiZydkSFb59tJqNAEn7xJk0iCztuOFx2TGSSTtej1V4cXcrHgGnUa2JzZr1G+gSa+r1Q14cKzTZHh86jgmLmfHxoy5Qurm83/8Zu74nlOtsXNb1+nXsv3HvoXOZNUDADOmJX617QKLxSCiwG/dPOO9D086nW42e2RcnxMWnipTENl+AOCluQvdGMqk0edExxL9VhzggdxpNJ9Mr4sSEhQ8nl/LUqbu7TIYYiUSqiI0ggzfNmUG9J0FoaSnmyq6wrUYQ8l5vEAGq8Pf0vFJIXirPtC3r95UhwOuZCvvjX9Abe/5vm9/p63jreY3AOAXKU8igHzR+dmAo9+JOTNFWeujNvotc0Z76uJQCQZYqiBtfdRGAPiud0+NsVrKkpncIz6oUdNMedI4SqJRAFi2JnftaINVU+G/D9xkOp4jXd9jLQdAmkzHU0VLvLVtAcLqAGCKYpIf7RSlMrjBIuLavfNhxaukpPbTuvJZ4TFCFrtaF9DI+mVyhwDXM0wmXa+3LVmUDgDFF1v7+40eFGOxqF5I0loREAHJ5Ch7SZz/dZp0Gm19RvpHpWVUBQAA7Kqre3IONRAnFMxO57EAzmkGjbYusEs7CLUDAdfNJEhHWtRkIQq8nW1vgIXcV0/wVn1h8PzPEh+J5cURK4ijuNEPJDz4fPWzj6c8RZa5LfYOBsLAcOzX1c+si9rgW0br1JQMFT+T9msEkL83/aXD2s6hc6uMlS+mv4Lj+Cu1Iy946ry4Lxtvo87LPvHcGoqEYMDekCpa0mm9GM3PJ469tW1DAS1IklxGFV0d0WIRVeQP73xYM6bEkhlmJGzujPDo/e2NGpuF6BSMPi8gob9U2yx9/2za83z6Lbt6ipyYq8bQOT8s65Sm6onUdQyEvr3rDJNGH3AYpslSHkhcAQB6l+WV6i8GXSYVW/py1m2+yeTebd4/KfWEzlOPLycOZs1Icjo9bPbYbYnCtAiq34Bkc1ZWIIO1p67+iTlzJnDdQVJrLUlKkk2ojx/E1X1NDFbgxEfeS4snl+Ct+tHkxw/1H9Q5tSvCV+WI/cQPuDH31u6vnKiDSWPaPDYcxxCfYJpee6/GOfCPpr8SHx2Yw+QxRXGjEUAQBInkjrSTUBuZ3ebi8lgAgOOAeuW682bI1VFvPDTo7Kg3HhpydVC0QfJDR4lCsi+hE2KFgfJhPZg1Tc7lKbn8CL4wdGsFABEhxBwyaPQ6U9cX7cd/n32PiMkDgGnSlBie0uK2/yLlxkuDTbMV6T123SczngaAh0vfWqaaCgAah+GNqT9j0hiPlf2rw6pJ4PuZhJ2seibABKxVcJLl8tzwcL+O5G6j8VJPz4zoaKpiLIKNBwPHUgTB4nJpApuJZZ98QhVdS4IsILlKgrdqJTvsvvgHrB7ry7XP/yP3LQBAEJoLc5N7gzeY660e6yNJj1o91otDw0H5lDKR3EgZS/5UyjPk3uD9jj61vYfotfU7RppBqO3s14998dbHDwAAgsArv9z2jw/upZYAyJfdCgBTZZvJYxKb2x0k11K4INgdmQAyLo8q8odvPqyyAbWMw+u1muZy4zYkj3uJRihBN07U/ef6HctV+YS1AgAJS2Dy2Fg0BovGcGIeAIjlKQn/WgI/XG0fFDF5KcIoJo0BAFKWwObxH/UzWfVcJ2zKyvJrsABgd13deA1Wt9FYplZTpQAAoOTzC+PjqdIQoCTk/HHBcNyFohMIyxiTIK0aB/yvja8zESYO+OKwpYQQAWS6bMbv636nYCseSXosgZ+wv++7N5v/IWFKornDznFKGSU7rFC58O9Nf6EhNBzHH095KoITmSnK+lP97xVsRRh7ZDIkVIPF4YxE2TK8Yiy9ieGPcnV5M+jPgUoy4aXbgRAHHup7w+ewiHxYJBa3q7i/u9diZl3pWE0PH8cPgxtCKBkNQT6e8dRLVZ8dG7i8VDXq20k6rAMYjgEgbZb+O+IXm922ic03TVY9Pwo3TEn7w6lTfjsO3zc2/WbxYoqDLDi76+oCTRuvz0gP4lQOApEn+vrBg2HXwmAFadUIIM9PeYkqBbg99k7yWMAQjlkGAObI582Rz/OWbIi6aUPUTd4S8I3Dqm5Ql1V17TtWTQkLQFFMpzUDwNCgxR24rxSIQCutCETskOxL6AhDq/B4OTU+dkF0QopEMeiwtRqHiH+UAsFhh/ATQgChI7TfZt+5T11yWd9KVQMAgIjJ+13NVz8vfWeWYkosL5gHITiTVc+PgpDNXp6STJUCAIDF5QoU9xCIyV2OQxAkS9L/EqG06h8M6qUI+Ryt0zItO5byKr77Z4VPbflYKOaZDLanXlzrrQqF4DkP2JP9WgjR8VTV1rckfyTiDAAQgOVxydECUYZ83CE54BvK4Q8ipoFNY76Z/zAATJUmAUCOJIHQ5kgSqgztSrb4t1kj759McRwZixAoKOHRlLUwGfWMiwZT6YmB7Rw6f7Hq5nj+uEfQJO2WmgSBH6uxKTPru3r/4YW7autCjyMvU/d2Bpj1nxoRkewvlYLZ4TQ5nAAQJQnoD/Xb+/vfI5RW/YNBNVjxMXKlXMjlUjuBuQXxn+1+fFBrlsoFDAa1XzYmwQ0WY9INlr/tnnwRcNkvfXwwTCIEgMc3jnRHJ2at/h9yWX9yTeQDcfxQDUcgjg5s/ZngD1QpwJy42EiR0O8CifOdnRqrNYh7xZsg2ZD9utvbdfr/nCvNilIBwK3Tc6jqKzjR/xcG67qCarC0Q5b/bDs/d1rS3OlJlE4WjYYoVSIA6OkcjI6Te6vGJGjYuZ8Eu1dJiBXevDDXE9SS/ijkSBLIjtLVMFn1+GXI1X+0f2uHtd7sMXDovJtjnuTQ+Z93/CGJn91pazC79fcmvsKmcU9qdrSYKwFgimj6fOW6blvTac23NIRu8RgkTOXm2Cc1ju7Tmm977a2fd/wBAO6Kf8E70gIB2JiR+U5xMSkhIfImPzhtGlXhgwtFAy3o4TAYa/110+g0ZF5K3IqM1ODtCB3nOtP/AXZ2/3WGfE0sz39vutF8UevonqekOp4mEarBkgi5EUqxxeoM8pv/4qPTz7+2kSodTZf1Uix/OvnROwGxL4H2Cr/WiPmT7Oz//4OMFX5L7FNfdry+SLU5iptEyhk01u1xzxLHndaGLmvDlqTXAODz9t/H89MBoM/R8VTaOwyE+WHrS1pHj4oTuynm8b83/vzu+BfJSrzZlJX5bnGx3/fdrtq6UAzWsdbWQEumV6ak+M3ZwmUyG/q0tb0aAPjlslGeYG+CeLiFbPa4Mh1NCkGu54chTTgjTTiDKp1UqAbLYLb3aY2JcQpiWxQA2PbZ+Vvvmfufd46TZZrqekdOuILR3dthvkB+7LaVexus4E4l92S/qf4fvvquE+L4I/HiGmd3FDf5SqBNUr+jM5wTF8lJZCBMAOAzxE5sbKd1jFg8IyampLubqgBo0unqNJqMsDHG70FSlfodDwIAh8l4uHAmh8lwedC6Pk1GhP+vCOKNptOQUIzpfwunNNtaLOUihtyKGgjJ152vJfBzumz1Fo/+zvjfsmnci0PfV+iPJwpyl6ruBoAy/RGTW7co7HYAODbwuYwVkS9dVjZ0uMZ4FgMsnp+1KOz2HlvjWe1OGkK3egxilnJj9NNjRjJT77hvDysuQQEAly+1b7h1+I1RfrGNLE8y6GgTsyIFjOGpKJNnVAQNj0n9Im/MAV6AEybIhmg/cU3xbnDhnLha4wUi9k9tb0kTFQAAglDdiwhCc2MuMobQl81ZmX4NFgB8W1sX3GAN2mynA6T9ixaJZgXYPaBNO7TtUlV6hJJBo7MY9CGrfV4ydckaAPCZfnpnBFbXuFtgb/eQVC4gwrMJ3C5UP2QJCxd7lQK3C71U1JyQrIqIlnrLrx06p7rJfOnBpL/hOP6vlsdIOYPGvCX2OfLjDNlqDo2ncQ6v28sWL/iw9ZeFylsB8AZT8UNJbwy5+quNZ+5J+D0CyOcdr6jtzQAw4Oh4LPVfDIT5SfvzWmd3GNv/EyGh2hEGg37P5uEoSoLZC9IAYPna3CWrhteClxb7mVGOE8ykIQyyzWXRRgUWyINuKhco/9mEmUBzIajRDXxSW44g4EQ9NITGZTBen7eCWugnQiOGl5rAz/yo9WUASBVOjeWldduaqIUAEECyxXP/3fyshBV2e9yvqGqAlSmpvzl+wm9kzL6GhhcKFwSJovquviFQd/umrEz/BhIAB1ianlzaqdbb7L+7ccmey/77aGGCgC5/N4oaHA6/+8q8/tK3z766kUZDfv/cjhf+uIncIaHodMO02cnxSSP21+lw6wepBovBoNHptOKzjRtuG/U79eXMsbp5i9OD7MAQIkOuPhUnjlglo/QyKIE8WQQsGieen9NkvoQDnijIY9LYWmf3kKvvi47fEAVcmJ2JsMO5V3rcdIkLHbvHTTVY2kGzTm/JSKFm3rlx88j47plX1nlphqEjTAAYdLa1WYpwHEWANl1xF6kVstksOj3QXKHGYqWKro7gcaokx8ubKWENWQrV3wtXvVtZfHf6VB6T9W5FMT5J07qflJXvqqldmZr66Gyqa+OJfQfumpo3LXpkwZQ3J1rb3i66IGKzH5sza/o4w7tJgnz71XBn/MgLFgB8/VCFYTcVho24YGN4qaRJ8rZNN0RtIY994TIZa9PStldXUxVXOlCLA+TPAoB9Df6jIhCAjYHTM+TFROyrargxd4obxd4+ceH2GX6WyAFAZNAVYH1ms1+DlTstoaqsIyFZJZULHHbX9k/PuT3o0tW5AHBkf4XD7i5cmpk7Ld7jRndvK46OladlRuEY/tn7J11OT05B/Kz5qQqVqLdnCABsVid5emKKyvtbmuv7vv2qSN09mD01rqNFk5iq6ukcFEt4SVMidn9djAO+en1BiFNnUlb4gKOT6CkPOtWkPFCPmGS6bOUJzVcAyGLVHQCgZMeImco7435Lrr9R25poPqGgwaEaLJGQU1TW1t2rX1E4ynziOHS1a2224bFbepb/X06VfnckL5dN42sc1HepSiDoNhopQoJAO4YT4OBBfK7Tr5CEyMA7Jr5xWAT9Vku7SS9gslqNQxiO+80oMF7uK8hn0xkTCDXcVVv30uJFBVGRVMV4mPC3Xydsysr0a7AAYE9dXSCDpTaZAi3umRUbGx3A3JgdThaDnh8bCQDfVzc+s3w+tcQVlHw+m8EItKC6dXDI775k8xanf/XRmf5ew7xF6Yf3VcjDRJHR0q0fn03LjJw+OzkjN/adPx/InRbPYNIXLs8qOtUAAJeKWqJi5Mt89lLwPv3FP23yVqWkR8Qnhd1891w6nXbxfLPD4XI5PX1qfWNd79pN08LCxW/9af9TL93ofUoglOzoJMHU/7Q+K2GppKxwqhoAADAc3aN+S+fsdqJ2o0tbGHargh0VxolzYQ4EEGKgJ2OFF8hWfN7xMg2h4zh2e9zL1FpCgPqbb27XxERIezVG0ulO8Poru7QDJqlsuA/88uubSZU3bLookpvTYj5l8wxR9lJPkEoDGazgqWAstl1c9gI6TYxhFjpdCYC6Pd1OVwWfuwKAgSBM6gkA3Qb/X0QhUBzW0wVzv22utbvdv8ibNTFr9e6FknMdnQCwJDkxUOr+t4ounGnvCBcKBwMsoO0yGN44V1Ta06OzWoUs9t/XrhKx2dsqq/Y3NKIYPjMm+sl5c/506rTD7Snv7V2WknyosfnlJQtnx8a+fORYu15vd7vnx8c/OW8OtV4AAKDUQ1UHYFy5KwgMLtuu7tJb4mbyGSNeAr/CIORHRibKpH4TfhxrbTM7nX7XNnzfRH1rkgRytwNAx6DB7nKfb+0ME/Ib+rVUtRcIQLpSWdHXR1UAAECdVrN2ShpVCiAUce02Z2OtevkNeTUVXaoIMYvFuPW+eZcvtknlAjabgfsEAVmtTrHEj1PFZnGSp1N1MLJhNYfDxDAcoSEMBs1qdfJ4bDqd5nb7H+74ZYnqTlCNRCADAMXc0BD6xuinvCUEd8e/6v0xT7I4T7KY/BjNS7s59tfEMXkQHKrBChTpruk3vvHhfd4Sv0yVbebSJTyGVMBQUvZ0SZTJzgRwf9YHztEBACjab3Mc5bDyTdYvFZI/ma3b2Kw8HLdZbHuE/NuopQEAoMPgp2X7EigOq99qvqzpfTR3Vo/FlCwJqdvsTZm6t0yt/vq2mwHggZ27pkdH5fpswdQ2pD/Z2vbtnbfjAKs+/pSiJYiVSN5Yu/rh3XsfnT0rO1wFAF0Gw3f1DV/dejMCcPc3O6v6+wFgTlxsvExqdjhfXLzwXEfn7NjYV5YsYtLpKI4Xvv/RE/P8ZGLxrScnaM4jgiGX9ZPWs8siMnMkMTaPy4661DZ9ujiyxtATwZWEc8V9dkMEV2L1OFEc67UbpCy+iiOSsHhsGsOOur1tk7fQjaFEDQwaze5xo4DF8xUA0GDqI2ogTtmUmUXZ1JPA6fEcbm7xa4AONvo3WAIWa2Xg7aqyo1R2lzsvJoLFoM9OGsMHnK1SBTJYF3t6qKIrpGfHdLQM0GjIsjW5X3x4KiJKmppB7UH3dg8d2nu5o1WTkKyaMTfl7T8faKjtSUmPjIlTHN1f2dszFBOvDHI6AKRMifjoraPzl2REREl1WnNUjLyjVbPyxvxP/32Cw2UuWOrnjl3/UA0Wh8N0ONyHTtfds3mWt82SKYRuF8pkjfF27bfXJwhmp4mWtVuKKCq/3WOCJp3O5nYH2YQCwwx2ZzGCcAEAQdhuTxcgTAQQHLcTQgo1gdOqeTOgN5MJ/OZkjjhQv22u25yabXI5q7X98yLjxpvWvWVwMDtcRdy7LJWqQavzNVidBn2aUkHc4ZQAG1v50jI41Kk33PPNTuIj4YeW8XhGh4NNZ7DpdKcHdXo8r504ZXO52AyGyenAMMzXJ+23njFxY6jJbWfTGADQYhnY31OxNCJzyGX14NjbjUf/kLfpe3XVxtiC73ouK9hCGoJ8O3Tp0dSlEpafroE3ZA0RXEmaKLxI2/LLjJWnBxopNWzIzPj7uXN+9xP8rqHe12AFGQ+unTIl+MJp7pVMhIkKP6t2vCmIivyiooIqBQCAqr5+k9Ppd53synVTiYOwCPEvX1nn8WAMBm3a7GRC+Mxv1gNAZIzswSeWXTkDnnttI1EMAB5+egUpJ08nJSRrbppG/GYzcmIIyYKlGQDw+PNrcRy/Gmd8r72z3lw5U7ZQwBB12VqV7HAu3c/8g9VjLh48MU+5nE3z8yMNAmVw5g1VKpfwa9yeeV5h7q89twMA9EPW+ze/k5QaQacjEHhIqLZVJAhmA4DG0RjHn+G9NWEQL4wHw0rV6gUBUnxIhI8DYAAI4f4W8DYBoAABTWeXwRCisyZQAj8Wjd5lMvCZrC6zcbzWCgDSFIpDTc3ED6uqv39Rkh8PS6xY0qjVESvMg+RipZAsl0WKhJ9svomOIB4MoyHIqbZ2Sru70NVtcDjeuXGtweHYH8Dl7FsPtYQ/VByRjMVPEw0b35mKpBnyxFMD9Wqbwex2AMDqqJwjfTVDTqvWYY7giqN5Mhfm37/jTb1RTdQQxsGWRmQaXHaT21Fv7KXUEMbnz4+PP9XePvpsAIDirm6dzaYYPRN9sKnZ+6M3vtaNQsegfsBkqezu69GbXl23lKr2YkF8PJ1G8zsRieL4942NoWSg92tufAlULJAcAPz2MBBkZLQ4Acwe4wnNvnmK5Ty6wIU5XZiTibBMboMLc2CAhbEjUdzTaWuRMhVSloJBY7pQJ8VgOTGHC3MOOgdiecl9ji4+QyRhygCg197FpDG5dP7xgb15kllxfD+9YKrBYjLpS+dN8ZZsunO298fgMBB2g/Ewhy42+mykmiCVynm8QPN3R1taAhksAPDJKuHnMZAEirvxJVACv5/nzfymsVptMT2ZH6pzx5u8yIiZ0dG3b/0GAC9MSJgaGWFzuV8+eqxJp3OhaOvg4C8XzEuSy+bFx2/+aluMWBR6hvJYieS23Ny7t++k0xAMxz/cuIFaAiA3IvxfxSVbvt2t5PPTlEoA8P1233q4QQPlSDw49m1X6U2x0wCABggA9Nj0ZGKPCK6k0dg3W5kiY/OLta18BkvBFrSaNRX6bhTHN8dN517ZoNdb6F0DOfG0KDydrIGQAMCmrEy/BgvF8YNNTXfl5XkLDwVwYCXLZFN9OrwUnB60sV/HYTKSw+QOt4cT+OaIOZzpUVHFAcLEtlfXhGKw/rvAcIyOMJg0FgDQEFqjuUrGUl4YPB7FjW80V66LvMuBOTAc/b5v+x1xj1JPBgCAfnv3Jf2ZXMmscsN5GtBarcdXh9/cY28fcKgjubFMGtuGWhk0/+MtxNfDF4jGul67zZmbH+9yedgc/9XhgHdaSlyYLV4wk0Wj9hJ/dejQrgBhx1Iu98JDP2NOxtqCO3fsvBBg5yUASFcq9989HG9hdbj2nq+1OlxrZ6VHyEfmjC719xBpsMoG1AWqKFJOkPqPN/wOTACg9ZdPU0X/VRxtaXl473dUKQAArElLe2vtGvDnd0dxjO4TDkrk4Qqx7xZiDW4UnfX++wa7n6i9GdHRW2+5mfw4YLHMff8Dvw/puQULHgwwDeLN+ZbO6fHRTQM6Ygl0EL6trX320GGq9Aqfbbpp3ji3nPlRGFer3t/79drI24njs7rDmaL8It3RNZG3XdAdmyLK67V3Drm0TebqLYnPntZ+ny+ZI2RKvE/vtDYbPfoc8Yw96s+lLAWKowXSuXyG8LzuqBtzLVWt966fArWVuN0oimI4DkbzqFHVZ++f+vjd41s/OYdi+EtPbfVWeYMAEi+YlSpa3GvzMwm9IrCnU2+37wm8YVzodBuNxYGtFYXtJysQBG5emOttrVAcL+nv8WCYB8O+b28KFDs2Jk53NQDguMuDqqm6kLnK068FvrOEFFtDZNDGsTGWoGMoRrwsPR4U/IyogIaMbGtEwKTT16WPLP3xplSt9u68H25u8fvjoyNIkP2TvZmbHMdi0Me0VgCwNi0tSAbKP5w6Pd69eCcGigdsqCiOYoG1V4PG0dtubbysLwKv3vGgS0N8Xb+jp8PaVKY/58KGw6FIiMLZ4uk2jwUAFzIkffZuBJAhlxYAUBy9MHiccgoBta/brzUVlbUxGTQEQTaszCPlVeWdf3//nl8/+gWDQfPrrjO7NTZ0yOhSm90aAFDbKuMF1Ejc+XFxEg7HECCu/V8lF9elp1/lAs5/l1z021L9cv+qGQ1dms+PlNqd7mdvXUQID3U0Hetq6TIbEECyFaoJX4/J/JFS9iaO21FUw6BTu2lBsNr38bmriWHvBE7/AbBbnTarUyjiWswOmVLotLtNBpvd6rSY7Bn5cSe/uzx1bsrl881T56QIxcNl7DYXnYagKGazOuVhIqfdXXKyPntGglQhNA5aqy62Lbohz2l326xODpdJlHG7PCa9Ta4aeZcAwKbMrM/KL3tLCDAcP9rSSu73ebjZvwOrMCFBGVpGmtBhMxh35Oa+W1xCVQAAQJNO98+iomfm+Qk7mERM7sEi3b7FqltdmEPAkFg8BgBgIEyzx6BkR1k9hg5rbaqwwOwxSJgKJ2YXMCRuzGlDzSKmfMz4T1/I7k8YJ/LuuMdJ+RzFMgAoVK7GcHRh2FoAuCf+SVJLQjqnkgTpCfw0BEEQQGJ4ieGcaGKkuS7qLhT37/2kGqzwMJFIwKHTadjo1wKNhhAdRgzDMcyPTeAxpCwat9NSkiJaBAAO1EgtAcBmMDZnZX1YWkpVAABAl8Hw75KLT8wZh8uMQu2AZmdtLVUaGKvD1dCtGTTZYsIkpHBNQlqsUJKtGPvV6hcU0+tNf2XQwwFBcNxttHzIZCSyWVMxzGC0fILhJg5rGp+7BsPMBvM7OLiEvE0sZvqQ6S847uCy59Bp4Qbze25PG4c1m82aSp6OYkMG8zsAuIh/J5ORZLHt9aCdHo+az7uRy55LvYhrzN7PzwslfBRFuTz2jIVTzh2uSc6MtJodxJtM128sPl5vMdlKTtZ7PMNlys41SRXCxsouoYS/+Ma80wcqHQ43UZtcJSJOVHdoD35zSR4mJMrs+ez8gFr/s+fX8gQjE20ZYcqMMGWdRktKSI63Dhssg8NxKUBIwZju9onxs+nTt1ZWBdox8N8lF5Pl8vUB+oaTggtzqDhxg66+0qGjN0T+rM5YPOTqz5Mu1Di6lOwoEVOOAA1BaH32Vg/uIspUGE5FcBLFTAW1rsmA5rMvTiBoXt1zwloRBJolpA4JmQx64ayUaTmxKxeOerSLlmf96pHPujt0Tz/4yXKfiFsAoCNMNl1YIL9DyoqVsmKzJDdQSwAAwJ1T83xn2UneLS4O4n4KjsnpfPr77/3O1wRi/4W6GKXkN3cvf2DVDG85k0Z7+/KFN8rPv3X5grc8FCy2HULeLSL+vTjuRBCmgLeeGNPhuMvtaZGLf8PnrgEAs20bgx7OZS/Qm96yOU4wGYly8W95nOVsVg6LOUUsfJTDnuF9usnyHxH/Hpn4RYP5XwCAor1sVp5c8juLbTg04YckLEoaGSdnMOhmo43BpHP5rLScmMg4eX+PntQCgMVkJ8ugHqz6UhuhcthdNDrNahr+eXe3aTtbBlAUqyntYHOZZBllhHjm4nTvxcAEgTaUL+rqIoLOT7S2+XXHSLncJUlJVGkALE5Xi2YwxMRHAhbrybnB5meePXgoUKT+1WBzu3fX1VldLh5dKGBIOq11LIQNAEKmVM6OcGMurbMHxVGtU61xdpndQ1pnD1mGReNE8wK6aK5bqGZMN2Q5d6k1OkIik4zqOa/ekJ83PaGrXRuboIwMvExc46iP4GYDgA01iMHPQCZaJLolO+vryiqqAgAAUBx/aO93H2/cMC3Kz7lBMNgdD+7Z0xJyfADBLYvyqCIAuIqNVAEAw2w0moBG4/u+DBj0kcAODLMwGNEIwpaKHne5m+g0mVdBP110DLfRaAIEGDg+HDNFp4UhCAfwcRjoyWLxjVMBYOqcZBzDERpCfAyPlq24SeqrJf5ftrGAOCBqWH7TNPJjTKLy7ieWA8ANd872nm5fumHUKSQ3Tkn/4+kzvqbE4fFcUqvnxcUda22lqAjWZ6SHGKTSZzR/ePZSZqTq06Ly19YtC+qLG+b23NxDTc1FAV63KI6/cORoeW/vC4WFYn8LDMcFDnCpp+fb2trvG5tsbnfxww8p+aIU4dRkyCPGd+mimUTJGF4qACjZUUtUtwPAEtXtZFaMXEnhSI3/PVCfH4/LMprtg3orKXnt+Z1nj9c5nZ7IaOms+alBrBUOmNpWheEohqOt5tMoPtznp/D47Nl8f1nTCKwu1507dn5aXu73JemXMx0dN375ZXlvL1URMmer270/EhupthqHiI1UvVVjIuCu0Zv+oTe9hSBct6fdZP3a4bxgcxyjFBPyNzucRQ7nRQ+q4XGWWGy79aa/2OyHAYDNyhkyvOZwXfI+XcS7XW98fdDwGwHPf9f1R4FiTfx+JIV+taMkPobBtwwASLicpQE6SkVdXW4UPdfZSVUAwHg2o3d6PHOT4tblpicqZZTdWAKBAPxt1cog3ncA2FlTu/jjj/9VUuJ3onNM+szmXbV1zxw8NPf9D27b/s3OmlpKGqVQvFGhlLmeofawtEOWSJW4o2eQlKxeP/Xi+Zatn52PjZMXLsucPjuZwfQ/QG01n223FJncfQBIGCeVyN/gi5LPf6Gw8MWjR6mKK7hR9LWTp76prnlgWsGq1NRAEfAWl+t4a+vWqqpLPdR5NCK8OFCeSQDoHzLrTNZujaF/yAwAZU0987MTSO2EN1IFACYzJUz2FgCN6CjJxa+QKpn4RfKYQY9WSt/AcTexFjJM9i55LOLfjeMuBGHB6NMV0r8AYIQzXix8hBAqZW+SBa6eIPNZxJTeddLYN2VlHvQXZnWpR13W2+s3cD9TFRZ8B2NvBGxWtbq/oqePhiBvHj+/MC2RWAsdHJVA8OH69Xfu2BloOTQAGOyOv587/9aF4tkxMYUJ8bnhEYkyqW+fy4NhZqezy2hsGxpqH9K36fV1Gk2gfTQAAMXxHqtBxRWaXI4wrkDnsAIAi0bXOqxJIrnV7bJ4XDI2t8dijBKIyS3s/huhGiy5hD93WlJa4ojLuWBmUsHMJADo7R66WNTyt1f3iqX8R7wWB5AkCwtFzIgwTipV4cOtOdkn29oCdd0JGnW6Zw8dfuHI0dyI8BS5XMnn85hMN4pZXK4+s7llcLBJp/PbC0MA3ly75rv6hiA7/cpEPB6Heb66fcX0NAAwWke5S+VcHgBMYCPVK4TaIBCE6UZRJp1+srltUUqil9xvDxTxrZk4HQAoNQCAB8MGbTaz02l2ucxOp9npMjudZpfT7HRaqBIXIfQdZ5EcbGpK/ccbfBZLwGIJ2Wzv/4VUCUvAZgtZLAGbTYk+nyzmx8erBIIBn31M6zSaok7/g7JAni+/KAT8e+cUdAzqp4Qrg0SN+pIfGfnP1asf278/uC/VjaJnOjrIpbU8JlPE4bDpdBTDLG6X1eUO8iD8srO1Klse/o26ksdkLo5KPtTd2GU2bEjIajJqk0TyTxpLpWwuh84wuOz3po0dg3YtcGLWC9pPEKCli5cpOcnF2k89uDOKlxvNyy0d3IrinnTxUgU7qcl0yujuM7s1qaLCME6qt4qoh/owLDZnc5umpVNLWUsIAAgNQRCETqcFWQoQirUi+MfqVTdv294QdNkzAHgwrEzdW6Yex3DvF7NnL4iPbx4c3B3QXgGLQWcx6PevmsFk0AHgpvk51BIAAHC6p70weqTnNV60FqvN5cZwPEEuBYCavgGVUMBnsWxud7femBMVbrDZPygqXZWRUt7dmyiXkSW9adTo2Ax6vExKnK4U8PtM5giRcNBqAwDi9LyoCN8airq67vt216i6rg4Mx81Op9np7DObqboAND31ZJA5FpI6Y3cEVypljQS1B4eOIBsyMt67eJEid3g8vkIAYNHpoe8JBgA6i/Xj82V5MREHqhteXL2Iqg7K8pTkD9ave2zfviBbnVOwud1XmSOXRad3W4wMGs3gdDBp9DCOAAHEgbpbjIMeDIvmi5RcgdZhZdLo3rNyPyRO1OzCrHOVW/gMebulRMKKShcvB4AK/S4+QyFhRV7Ufb066mWLR6PipE2VbTzZ/7bO2eatIuqhGizftYTlF9suFrXUXO6KipUVLs1cvT7f7wIlCh2WYt84LG/4LNZ/Nqy//ZsdQTq6E+DOvFwiMCLIWmuSM1VtRD4sMqyh02Q41jXS7zvf23k1BuuLSxXp4cpzrZ3PLVtwoLYxXCTcX9u4Mj1lT1X9yvQUGoK4UczkcBCpwesGNERJ70wp59o6W3VDaWGK4o5u4vSH5874qrTymcXzjjS0LEiKJ08PVMP1gM5pwgEkTL7RbVOwhfWmnjC2mMdg21FXr20oQxzdbtXwGRwMx3kMNrl8JzibsjL92ia/ne5lyUl+c+kFot9omZkQU5ia0K7To/5WjwdnYULCl5s3P7Zvf+iW/SrZkJCF4jgdQTAcpyHI8pjhfsNURRQArE/IAoBdbdUIIAanXcoetbLvh0HEDJ+tuL90cHuCYIYLs3LoYkLuQm1CpoqOsKbLh2O7+AwZA2HjgPmqwNdg+a4l3P9t2cLlmfc9spjNphb2JpTAUQrhQuH2W2+579tdwdPLhM59BfkvLlxIHIdisHwT+DXotfEiSQRfSHxUW4ze2vGC4fjK9FSDzWGyO7v1xlvzc5weD47DnITYWfExABAuEsj5vHSV8kBtI1nS29zMiItu0Q1WqvtMDidxevugnniTEM5g4nQAwAH81nA9cLD3stXjyJcldlq1TBpdyRYf669cpMo+2Fu+SJVN+Np7bLpWy8BdCaFOXSVIpfmRkSHOtIx3b+esKNX2S1V/O3J2VmLseK0VQV5ExP6773ru8JHx7lA9YYjEbUFWF2xMzKaKfkAGnR0t5jMY7sYB4gUzT/a/2e+oV3FS08XLinVfiFkRKk4qwKi5FL8qqg3q15ooQ8JX/ryZUsYvoQSO+qLk83fcdtvvT53cVlVN1Y0HLpPx2tKlGzJGvE5SLtevm8Mb3wR+i6ITGbSRFSF3MvK8ik8EsvnMio997/xFrcV6Q9aU0evjsO3l1d4lvWnS6BBAug2mFVNSiNN/tWR+r9H0xqmiziHDwuQE4vRb8rMhQA3XAyw6Q8CQnNHULVRlleia1kfPdGEewGG6LHmabLghfqcufSBpybjmsDZnZYVisFQCwXhX81V29+XGRNwyPeeb0mrSSzheJBzOe+tuPNba+sdTpyd3GEESxudvzMz09dlfh8jZ8RJWNAIIEVO6MvIFDPcQ+RGWRTxDHufLbibKL494lqIioBos3yFhiNARJp3OLJDfQYSoBgoc9YXLZPxh2bKVKamvnzkzpkvLL8uSk19ZtChSNNwtIpmiVAY3WL4J/IiFOPVDmncqih/NnaWxWxPF3hFS4+OZxfMA4LaCHACIkojmJMT4vq6fX7aA/EkQJb3JilAlK+VE8iby9DWZaSswjAgpIk6H0d91vcFCGHK28NJQ8xRRFIqjn7WfHHSal0fkebexn6es/L63XMYSKtjU5xiINWmpr508Oab356bMzHE1ZjeKHqptNtkdMgHPg2ITs1YkS5OSCuPj99TXf1JW3qjTUdUTgkGjLUxMuDkre2FiwsQy4v4oUILXvc0QJbOLNxQVtZzJ4nC5PGXVXUnxynE9ZoIOS1GScAEAiFnji/ycHx83N+7OYy2tW6uqznV2hhL8wmUyVqak3l+QH2ijp3Sl8rS/bCQA0NCl2XriMoIgTreHTkM4LOZLdy4ltVeZwC8QvtaKIPhPgkw153269yUFP/16YEPMTABYEJYBADPlqdNkyZT10msiCwDgkRQ/U89B4LNYK1JSgswFE9yUOb7ZXiadvmX+NDeKhYtCnQQIDpNO35yVtTkrq0zde7C56XBzc69p3L4tBCBNqZwbGzsnLnZGdHSgWJ//eajpZZwuz/5j1QwGbd3yXG95iJzXvDc37GGqdJzo7fairq5Stbp1aKjLYDQ6HDa3G0EQPosp4XATpNJUhXxmdPSsmJggO1mGwscHL968MJfHZv3n4MUtq2eS9vkvl86G8wV8Jqu4r/uvC1aOOscf55s6n/5q/+yUuH/euZaq+4kfiev5oXQbjRV9fTUDA11Go9pk0lltNrfb7nbjADwmk89i8ZlMPoulEggSZdJEqSxRJk2SycY19MNwjFhUTFVMHh4cRQAhQud9swNdI6g/eBaTcdPqqRRh6LBo/KO9f+QzlQAwR/kgVR0aUi53TVramrQ0qmKy0RgsXRoDj8PqHBjCcZyMtB5vAr+i5k6Lw3WyLlhY2U/8wFzNQwk94+jEiBGLY8TicUVaBMLscQw5zUq2yIY6FWyRA3XbUCePzj6nrZ8qTRAxuQaXTcjkmt12AZNDA4RJo7sw1IY6jS6b2WPPkcS5MY/BZVNyRADgxjyDTks4V2JHXTRAcACj2xbGEdk9LhadgeM4UZL4Uh6dXa5vy5cmluvbVkTkEV/NoTGJK8FwrM+uD+OIyconBarBCrQvYYhkS9djAVbkXCNQHKf5rukIjUdunLP/Qp3d5X5g1UzvnDlnezruzyrwKjgGc1Lidl6sXpKZTFVcHQNGy4cnLz60ZKZSyKfq/v8x3rtxNQ8l9IyjPzp0QBpM6pP2GhGTtzIir8c+tLfnYqow0oG6AODL9jN9Dn2mONaBusRMnpwtTBSoBl2WvT0XC8MyEKCRZZ5IW8tnsE8N1LLozHCu5PRArZwt7LYNThFFqjjik5paAYPTZu4nShJfuiIijwaIkiMics922XR7ey4q2SLiSo71V00RR3tXTrnyiUHtyImEnKY2zeHTY/gF/IEXaT/g0IU8hozHkDWaqKvnxsTucfdZTS4U7beZAcDidvbbzA7Uo7FbSG2zUVeq6SHL2D3ug50NOruVUhUAeFxjh+2J+Zw7luZvWT3T0TVo1I24Fco0Y889eTM3Na7kd4/+8ebxuWDG5ExD+9YLlQbrRNad/e8x3rtxNQ8lTaVIUspunZ6bHxt5PVsrANA6TR1WbThHEsOT21FXpb6dQ2PSEZrZ4wCAMK5knjKdjtBMbjuKY+X6dgAgykTzFH32IbIMEf4WJwhrMfcBAFGYR2dliGMAII6n0DgMZEniSzut2jarhvgfxTGiWvJKmDRGr23Iu3KSFy8eSvjqT96S0KE+jEG9NTM1ok9jxLDx7auB4qj3xLodNVLmI8dkV1tNlix8Z2tNj8X48vTFXzZViJhsN4bxmczFUUkHuxqzZOEmt5MGyPu1JUSZfR0Ndo+fDp1BY9r+170LNs1Kn5kCAE1lbYooGY7hOI5LlCLToEUWIWmp6JAoRIpoWcPFlvqSZrFCKFYMz0+JWOwnTh0gorGem77Au+YfkqLmTqro/zE/8N2YmxwHAKFkHP1xieMrH0peRn7cFDub8FsREaRrIvOJg0uDLUnCcAmTT0MQsszaqGkAQJYBgFRhRLIgHADWRBWQQgDIksRmSWLJaskv9f6frJZgVeRUDMdoCM27nquHalAiwsQHTtSwmPRxWSsAoCMMB2psNZ9RcJL1zk6Le8DXWrUa3uuz7JsXfYAiJ+AxWLmKiBbj4BSpksdguVHUiDvELA6x2oDQdluM5/s6IvkiogwDoZlcflY4e1wei97K4jAB4MCHxxRR8lPbi8RKkc1kyy3M7GpUCyV8hEb7/tzxlIIEsVzYXN4+a00+efrdGVPHm6Rh0nGj6MXWbqr0/ys/3Y0QIU0GaSOIg+nykaFxoDJBhCR+hQS+Dn5iGVCQUyYA1abQaMgNSycYEVuoerLJdKzOcEDIDF8U/gxVPRYbEjMB4KakrGErLpSsjU+nXVltQGhjBOKbk3NI4ebkbL/2WxEtk4SJknLjAaCvTbPmwaUuh0unHuKL5ef3Xpq/cWbxgbKwWEVEYlhPU9+q1xcP9hu8T5ewQ5qOefLL/Uerm8mPySr53qfv9tIPY3O5p7/8DqG91Nbz8enS6u5+s8MpF/BmJsU8tGRmvEJKFu7UGT48ebGhV9syMJw9bv0bn4/UBfDAwulPr5rnLQGApn7dp2fKLrZ268w2DouRFq5YV5C5flqG75257d2tVV395155WMzjbLtQuae0rkOnx3E8Uipanp3y6LJR6V5xHA5WNu4tr6tXaww2B5/NUor4aeGKRZlJizOSfMdKoV8GAKAYdqiq6fuKxjq1xmCzsxh0GZ+XFqlclJ64rmA4EGECdyPEh0Jyqr7tm5Lq6u5+k90h5nKmxkfeOXfq9MRo7zLjeoI/cU2htrmrgY4w0sVjBwGMCdG+b0wYbrWU5k58DP4eAACPG/3+o+OrtyzJW5S59fU9+n5DbEaULFx6+XhNSn4CnUErO1bNE3LyFmV9+sr2nua+gvGb6WVZyTI+V2+1t2qGWgcGqerRdOoMe8vqXtxxGAFEJRZgOD5gtHxXXn+8tnXro7cmqeREMb3V3jNkFHBY2THh5R1qAMiMVvGu7OsJADGy4UVYJDtKql/bcxzFcDqNFibi66320nZ1abv6YFXju/esYzH8RGn1Gkwv7zxKzKBxmAyH29MyMJgeSQ1ne3HH4b1ldQAg4LAiJEKDzd46MNg6MHikpvnECw9SDNa4LmPQYnv88+8qOvuIj2wGw+5ydzkMXYMGFp1OGqwJ3I3QHwqK4S/tOPxdeT0A8NmscLFw0GI7VtNyrKblgcJpT6+eTykf4hMck+eKv281Df5h5qrflR4p16p5DNba+PTn8hZxGSN/18/P7gJA/jZ77Z/KT3zf1WD1uOKE0vcXbIwXDocxuzH03Zqi3e01vTaTgsNfG5f+dM4C7xrGpETT9X5t8WVdr8XjlLK52bKI301fHs0fvp/BLwDFsZ1t1fs66pqMWr3TruQIlsWk/DpvIY8x4qvSO+3/rDp7Qt2isVuELHaCULYpKeeWpOFgKTqCtBgHXys7VqrtZtMZ+YrolwoWk39dEKhxWNeUNsP7vZbvAg0JJx2Py8NgMQAA9aB0n98thmIIgiA0xK92XOy8WPObb48GepkT72cAQBBYkzfl2bWFcgEPAC539D7xxb5Bi21pVvKbd90Q6Kw9T92dEh7wx1DS2r3lw28ZdNoLNy7aMC2T2F2xqLnzhe2HtWbrnXOnPn/jQu/yRA8rIyqs32D+1drCxRlJAg7L5nJfauuR8bnZMeFkyYZe7U1vfsli0N+9d93s5DjivTBksZ1uaB+y2B5YOJ0sCeO8DAzH7/zX9squPj6b9Yvlc1bmpiqFfBTDeoZMZxvbp8ZHZvp4jkK8G94EfygA8PaRoveOlwg4rN9vWr44M5lOQ1AMO1zV/Jtvj9pc7pfWL75t9vCva2JPMBDPFX9/oKtByGSvjUtPlSjKteqtLRWrYtP+NX8jWebnZ3cN2CxcBlPE4iyISHBj2Ln+9rfnrSdSWeEAD57aWTTQcU9qQYpY0WTUfdpYOlUR+dWS2wO9vynsbq955sL+GL5kU1JOFF/UYzEWazo/XXQLmf0t+AUAwLpDn0bzxQXKaAmLU6zp2tFadVdq/qvTR6Y4bjn6Zatp8MH0meE8ocZuKR7oypNH/iJ7LgC8ePHQjtYqGZs7Ozx+jiquz2b6oL5EyREcXfvgmEHao16SHsx8vHNmYcyJFsPbA9ajAHic6K5k6eOEttP0RZfpS7unj8uIShDfHy3cTMht7s4Ww7t6xyUXqmfTw6KFmxIlP7tSJd6i/1e3eSuK2ZS8Qh4zjpCe6Jw9VfW2lDNNYzt5eeDRvLB/qvjLDc6K8v5HFsddCFShyVV3Qb1pTtRuIWs4RMvsaixSb5gduUPEzrzyjSMQ1goA/Noj2pWdU/1qrwUZUao/3bKSbFJT4yMfXjLzD3tPlrRM3Dvzj+/PYjj+xIq5m2eO9BDnpMQ9u7bwV1u/315c9djy2UIOdUa5qV+34/E7UsMVxEcei1k4JWF0EdCZrQCgEPLnpAw/NQCQCXgbpvm51eO6jCPVzZVdfTQE+eCBDXlxkYSQTqPFKSRxiqnk6dcUg83x6ZkyAPjNxqXLslMIIZ1GW52X5kbRF745/Nbhohvz0/nsUdNbk/UELW7nM7kL7kmbBgCbEnMYNNoXTeW1+oFM6YilLtepH8mc/WzeQuLjXakjPtbD3Y3H1c3/mr9xVezwDyGcJ/xd6dHj6pZl0cN/SxCsbtdvLh2JF8r2rbqPd6VT9guYO7pUsAsAgL0r7yWPNyZmq63GI91NpMFyop5Lmu5Hs+Y+lDGcAeHB9JlkeQBwY+jquPRXCpYSHwVM9mtlxy7r1NPDYryL+eLHnlVqnhKxMmZFbstX/VvBHe4Yd5m+btG/kyR5bG7U3iTJw41Df+kybSVUdBqfQ1flKP82N+q7JOkjLfq3dfazhEpt2dNu/DBV+vTsqJ0STkGncdgBIWJnml2NAGBwlPOYcQZnBQCYnQ1idnaQCkWsDAk7t9u8nagEANTm3QJWsl9rdR1y0/QsygswI0oFAGaHM0iOyiD0G8w1PQMAsCp3uOGSFCREAYAbRau7+ikqAFiYnkhaq0BkRKu4LGav3vTyziO9ehNV7cV4L+NYTQsAzEuLJ63VD8+5xg6H2yPiclZkp1JUa/Km8Nksk91xobmLoprEJ7giZuReEelfivo7SAnBlvQZFAnBwa4GHoNJ5pABgHnhCQBwYaBzpFBgzvd3mN3OLekzSGsViEAX4MsUSdiA3ULm9mHTGYki+TetlQe7Gv0m/AGA25LzyOMceQQA9FiNpCQQfnxYMu7MWNEdAMBnJpLCVsO/E8QPRApuAAA+M8Hm7mkz/DtWdBsAsOmKVNkviWI8Zmyn8QuTs46wdN2mreH81VHCjURtg/bzNncXAIjZWWZXAwDonZdjhDcPWI8CgMlVT5ieIBXGiG6vH3w1TfoMncbDcbTPuj9efD9R8vrH10aQL3DU385pY9LYpyUOFv/xw9GaEYg8fxQyoqjuKl9kfO7vNy9/eceRXZdq95TWTU+MXjN1ysqcVEqnA8Z/Gc39OgDIj//RrBUAtAwMAkCSSkb3mQ1n0GmJYbLq7v6mft3SrGRv1WQ9QQRAyR1ZqBjJEwFAn808UgKAz2TJ2DxvCUmHWW/zuJO/fp0iNzjtFIlfOi16AEgWjTGyDnIBAFA92Pdl8+WKwV6t3WL3uJ0oYa9xMrbp3ws2PnNh/8/P7grjCjYlZt+TNi3M608GANJfBgBsGh0AQtm02I/BkrCHh+4kLnTIhQ6K2VmkRMzObjW860Q1bHoYitk6TJ9qbKccnl4cRz2YBeUVEsWs7s4IwchKLgEzmTBYInZWu+EDDHebXQ1Tw95u0b+N4W6zqz5R8jAABKkwnL+ycejPfdYD0cLNWvsZN2okbOh/BXwO9ad+lZgdLgCgIUicQkLVXYHrb5Us18tvHYSVOanTE6O/OHd5d2ltSWt3SWv3n/edvm127sNLZnrXMN7LMDucACDmhTQVe42wOl3gZW4oEHKznRoxM1lPEB89WYQDDj7ZgYJkXsdxXMbm/X7GiMOIIMrLBIzJmN6uIBdwqrd1y6mdmTLVIxmzksQKMYvzr9qi7S2V3mVSxIq9K++9MNC5raXiw/qLnzaWvj1v/eKokRfAuKYISPwYLBpCbUkYTjw573cIDgB0hAsA1brnLa7WTMWrInYGHeFcUN/kVQy8HwTtyrYUYla2xd1mdtXzmYksupTHjDO76i2uFqKHFaRCGsKMFm7qNn8TLdzca9kr585h05Wk9jrHN1DlKuGzmQCAIPDdL+8Zs/1NDLmA9+TKub9YPruouWvnxeoTta0fnbpU3NL11c9vJTzrMP7L4LFYcMXM/VgQDjXCbPlCyAU+5mkSn2C/zRTBG15hp7aaACCcJxxVIjCxQmmdXrMkOiWITQlCNF8CAG2moQLlqOiN0PlPwyUmjfb1ktv5zOFb5Dd+GwBmq+Jmq+KezTPecXzrby4d8TZYE8OPD8sXDiOcRZcZnNWkxOis5jDCGTQhAOhsZ2NFt0k5+XSEg+Eum6eHLMZjxhJDPwKLu5U44DBUDISntZ2WsqcCgJidq7GdYNCEHLoKglYIADHC28zOBr2jXGs7FSVc762aRFoqOqii64+UcAUAoBje0Ds8KLtG0Gm0+Wnxb951w7Zf3CbksGt6Bg5WNZLa8V5GkkoGAJWdvVTFD0hqhAIAWgYGfXeL8KBYm2YI/A0AJ5GDXSM3cG97LQDMDY8nJcFZEzsFxbHPGksp8hAHpXPD43gM1scNl66M48aNB0OFLDZprfRO+7m+Du8ClCuJ4ounKaOJNXZXSUgGCwBJlDzcYfy417LP6m7vtXzXafosWfIYoeMyo3X2805UY3W3V2ufw70WP8cIb+mzHFBbdlvd7T3mHYP2YlIlYmf1Ww9KOQUAIGHn9lsPi64MOYNUCAAchiqMt6hh6E80hB3GW+ytIjiz+yKGUlvheNnz76NU0Q8L+8rcpd6fE4ogWiYmIgD+c+oSVXdtyIxSTY2PBICewRH/6HgvY3FGEgCcqm+vU2uougCEcjfGxdzUOAGHZbY7D1Y2UVQHKhqsThefzZqVEktRTRYcOuPdmqJXy47tbKt68eKhL5vLV8WmZXhNEQZnZeyUVbFT/lR+4pkL+7e3Vm5rqXj98snF+94fGO0FC4SIxXmlYGmjQXPDwU/eqyve017zfl3x3Se2dZr11KIBmB+RqLVbf1t69HRv29aWipuOfK7k8r0LVOp6Vx746K8Vp7a3Vu5ur3m17Nie9po1ceneZSaGnyGhX+JEd9KA0Wp4x+7p4zIiU6RPEa50AMhS/LFO99sz3ctZdFm8+H7vMVqUcKPd09M09DcUs4fxl6bLn28zDPtlxewsre2UhDMVACScXJuuk/RGBamQIFZ0x6X++2KEN9MQNgBYTfbPXv2WRkOW3j4Xx+Hbtw6pWway56XFpEZ8848DOA6r7yuMTok4/W3JQJdO2zO0+v5FXQ1q8lgVK9/+9/1uF7r0tjmKKNkXv98tj5RONAHEpEGn0RKUsnbt0H9Ol2ZEqcjhCSVj77M3FN7/wc5DVU0MOu3BRTOSVXIAMNgcPUPGk3WtDBrtkaXD88rjZUdJ9aDFtigjMSVcQQz0PCh2sq71UlsPAKSPdtuP6zLW5E359GxZU59uy0ffPr1q3rKsFDGPg2K4zmwta1frrfY75uaRhQlCvBuhI+Swf7501l/2n3l193EmnbY0K4VOQ1AMP1Ld9Ps9JwDgocUzfMNBJgsagny55LZXy45ubb7MZTDvTi14buoiaqHAIADvzFv/eVPZN62V+zvrmTR6JF+0NCpFzKI6cwJxS3JuJF/0fl3xuzVFTtQjY3PzlVGikE//WfpMo8vxXUft182XowXiLVNmpEqUm498QRaI4osTRfJd7TVau5VNp0fzxb/MLXwg5DnHIIw7cNTtQYmtsSZG0cXWOTOSiOOGpr7oKJmAP9IsjCb7/kOVG27I53Gp7gNvjM7q4t5bZkZ+LWHnAUB/h/aLP+6+/3c3yyMkAPDGox8//uY9dAb98z/sXnb7vLAY2VtPfPbUu/fvfPNg+szklLz4d3/5RUxqBHkcnxlNZ9AiE1SHvziTPiM5a05qVHL4W49/+vynj4z+2lGcrGstae02O1wWh7Ndq28dGOSymNMTowUclpDDFnDYDy6cLuSyIWjQY3P/ILHW5NJrj3kHcBPsv9zw620HAYDFoIeJBG4U1Vvtj6+Ye9+CAu9ih6qaXtpxxO5yAwCDTkMAIXe1Wzt1yp9vXeVdmAgc/fUNhXfPy/eW+/LW4aL3T5QAAJvBUIr4KIbprXaH2wMAq3LT/nrbaopJH9dl9BnMP/90T1OfjvjIYTJcHhTDcQCYmxr3wQPD70JvQrkboT8Ugtf3nfri3GUA4LNZUj5Xb7UT3qtbZuW8vH4J+QdO+An65bni73e2VbXc/hxV4UPJyfqZi0Z6JU3VPVFxcr6IS0pMeuuhHZduuGM21+tHdI2gXExwPG400HbLV0moPSwCvcH29Y6SRfPTMqZE6gYtACAWc00mu27QolQIZdKRbuGAxqQKE9nsLhTFhAJOc+uARMxTKoQ1deq4aBmK4WEKocPhZl35q9S9epPZkZYazmIxHA43YbDIs8hqCfosBwTMJMJaAUB4vPLeVzbteOPA9BW5BUuyyHbmsDp5Qg6dQXdfSTXD5jCZbAbxkTy2meyqWAWLw7z1mRtKDlbwhBwun02jj9HDOtPQ8U1JlbfE7nKfaWgnP94yK8f7tzEB1k6dwmMzPz9bXt+r6TOYBRxWargiMUxGKbYyJzUvNuKroopzTR09g0YUw6OkoiiZuHBKwoqcVErh0NkwLcPudpe3q7uHjH0GM4KAlMedkRRzQ376qpw03w7ouC4jQiLc/tjt35XXHa5qbujVmBxOPoelEPByYiPIdTkUQrkb430oz92wsHBK4tdFFRVdff1Gs5jLmZkUc8usnHlp8WSZHwZNrz4sUmq3OlEUE4i4rXW9Yhm/rrwzJjEMw7DoBKXD7nLYXUw2EwB6OwfNRltqVrRIymexGQ67izBYxFmK8FFzhYSQRqc5bC6iKu8aHA63w+bq7x5Ky4lure9VhIulCqHHjTZWdSsjJGGRErKk98XodWazwY5hWGxSWHtjP/GlQ1oz8RUCEXfHh6fnr8yekjf5Y+rx9bC0OvN/vji3aV1BcmLY1ztKrDbn1JzYru6hiHDx5aquO2+eJbpi/r/8pnjtipxDx2qWLcooq+ik0ZCqmp4H7p6/fdel1CTVxfL2R7cs+npHyQ2rcsNV4vLKzsbm/tTk8PzcuJ17S5cUpsuk/CMnasmzxCIuAKC43YXqTK7Gas2zmYrXIgRriO/qqOs5t6dUrzHOXps/bWn2gY9O9LT0z98wXSDh7373MIfHzl2QPmv11J1vHuxr1wBAwZKs3jYNeZycG/fFn/ZExIel5ieExcq3/uW76JQIrXroybfvG/6zQ4PY533MtQVjcjX1eK5sTkEe+EKoPBiGIBBKZlsPiiEA9Ctzgv97YBiGIIi3E8DjQYk9g71KAYpifm9CIHkg/Pawtr9/cuXmGcd2ly26cWrFhRYEQWrL2vlCbnJmVNnZpgefW8NiM7565/iqW2b0dw811fSkZEblzkpCEGTPZ+cK1+RKFcIT310mzrr7ieWiK10HUigU8xLTI4mqWmrVZA2Nld3H9pTPX5mt7tApwsVVJa03P7TI5XCrO3VHdpYuv2kaWfLTfxwmL+bzfx5BUSw8WiYLE5JfuvvTc8RX3PmLpV+8dXTdXXMS0yc/1G58PSylQiiV8JITwwCAxWLw+eyzF5q5HNbGG/NdbrRbrc+8YrCWLcw4ebbBYLTJZYLm1oEwpSgiXOJ2oziOF85LM5rtZotDLh8OJGts7l+xJMu7gwYA3mcREpOzvmzgZ3SEkyDZQlorAIjPiI5ODkdoCLHIZs2WxW6nh8lmAMDjb96LYzi5CmfDo8sjEsLoDPrONw+SxwDwy39vITuxv/rgZ8Qe12T9IaJz2Er6u5bHpljdLgWXb3W7LG6XlM0dctrDecN/abNh0OhyZMrCDE5HOF/o8LitbheXwWTTGcSAaMhpB4CS/q5F0UlauyVJLCfqkXG4PRZjFF9M7OvTatYaXY4MSbjBZVdxRU7UbfW43Bj6eWvxL9IXGV32z1uLH0lboHVY4gRytc0Qw5cSf0+/3USUMbkcl3QdSyPTzW6HgMlGcYyO0Lj0UYMaDMP7NEYWk1FZ2710QbrbjRpMdqGAbbe7pBK+w+k2mR1KuXD8twoAwOx26JyWMI7Q6nGFcYStZq3Jbc+UROpdNhVH5EDdBpdNyOSwaQw76tY5LQkChQvz6F02EZNDbBoa4parwXE63MWnG3IKEgABqVxgtzqZbIZxyFpV2rFodY7F7NDrzBHRsoFefV1ld/7sZLlS2NWmMZscmVe6DycOVObPThaKOBazg8tj0+kIg0l3u1CTwaZQiUJsSItuyDtzsMowZJEphS216rBISXi03GSwzluRZdLbLCa7KkoqCxMCQFNNz9L1+VKfYQd5lts1En7ptypKDVPnJOfOSio727T61pkup0fdrjMMWQbUeqvZ4V0Sx3GyBolcwOWzcmYkHttTTn4pimJEARTFxDL+tbBWEPIs4QgeD7bvYCUAMJl0uYyv11vzc2O/3F5cUd2VnDTiiFWFiVpaNVNSIwBg3uwUk9kOgBMmiXiCLpenpk59/HS91eaaNT3py2+Kt++61N6pq6lXHz1Z53C4KWcBgJSTvzSudFHsuSTJz8kvImCwGN5LAglrBQAIgpDWKipJxeFziGLexwTkkJtGp4XYyCiE8wQ0BGk36d+sKAKAT+rKjnW1vF9z8Y3L5yzu4XiffpvZiXp2tdRqbBYEgCh8qLPpRE+rB8eIwgImi4YgdASpGRwg6/murf5EdxsZ5TRgN7swz56uSo3DjAB0WAbfbThtR92pIhWHziQOaAitztC3u/OyzeMk/x6yjIorpCHIt53l5zQt29tL93ZVVg6NCh8BgO+PV9vsLqVcQNyQrbsvfrz1XHev/tPtFwDg8MnaQb1lQrcKAICGIHWGvi/bSk72N1o9zgGHyYl6Pm4perfhlMXj3NtdqXVYjvXVnx5oJkoCAKH9pqPsu+7KKr2aWuOEOHGgUq+zDA2av3r/JACcO1536WyTQMQl8sHRaUhLfd/Jg1UlZ5p0A6biUw12q1M3YHY7RwICCPmhXeVl51sunKyvvdxlHLId21cxpDP7bUivz1rt68AKi5S21fem5cQAwJylmSaDbTia9EoN3W3auvLO0wcqpxdO2f7+qW8/PuvxoJ3NA3XlnSe+q3DYXeRZUsVIQLnfqrxrAADiL82dnbTtvZPVl9qS0iP6u4dQD+Zb0vfPScuJ8f5SsgDqwQ5uvziq6CQxviEhga/ffcxeMYbhgAQLrsVxwHFqjtMxz7quaDUO7mmtk3P5vRbTC9MX7m6tVXIFAzaziMVeEpNM/BXdZuP5vk42nb4hKRMAPq0v77WYVsWnVur6703P/7alRsRiJ4ple1rrNiRl7m6tfSJv7r72eiVXoLNbTS7HXen5xL3osRmKNW0sOuPGmBwA+LL1Yp/duCV1bo2+d74qWe+y1eh7o/nSfV1V8QI5j8FaHJFGXAChmq9KbjPr9ndXq7giO+oyu51SFu+GmGwxa8ShCwCHT9Zyuaz4aPmR03X33Trn6Ok6AZ8zoDUN6Ew/v3fhkVN1yxf69zeFQrtFt7+7Kl6gUHAEKaIwB+ou1rYzaTQhk7NQlXagp/qGmJxKfU+NXj0nLGl/d9UjaYUH1NVCJqfO0Cdl8dZG51CudmIc2VOu6TcKxVxtn3HL0ys6WzWl55tnzE898X3VnQ8v6useOn6gMiZeYTU7+EKOVC6IT1Y5ne6KkraVG4ed/ScOVErlgr6eIYfdJRTxenuGbrxl5uWS1sVrckd/1TggU4lQFQAAgOO497iBxO9ZfoV+a/D+FZPHfkt647d+uGZ+94kYrJ8IAg7UaGhKikHvj2MWJvm2pdbmca1NmCJlD/9Kg9fjDTGAokqvEOgbCSiZsjEcR/y8aCcH4krGuJ6g2omBYzhc+avKL7TKFIL4FJV3gWP7Khw214IVWSIJjzzF9ydKCP2qfmKy+Mlg/cRP/MR/DQF7ej/xEz/xE9cb/wfL/dVE26OBWwAAAABJRU5ErkJggg==", - "type": "image", - "xaxis": "x", - "yaxis": "y" - } - ], - "layout": { - "margin": { - "t": 60 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } + "output_type": "stream", + "name": "stdout", + "text": [ + "Requirement already satisfied: plotly in /usr/local/lib/python3.10/dist-packages (5.15.0)\n", + "Requirement already satisfied: tenacity>=6.2.0 in /usr/local/lib/python3.10/dist-packages (from plotly) (8.2.3)\n", + "Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from plotly) (23.1)\n" ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "width": 640, - "xaxis": { - "anchor": "y", - "domain": [ - 0, - 1 - ], - "showticklabels": false - }, - "yaxis": { - "anchor": "x", - "domain": [ - 0, - 1 - ], - "showticklabels": false } - } - }, - "text/html": [ - "
" + ], + "source": [ + "!pip install plotly" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "text = df[\"SUMMARY_EN\"].str.cat(sep=\" \")\n", - "\n", - "# Create and generate a word cloud image:\n", - "word_cloud = WordCloud(max_words=100, background_color=\"white\").generate(text)\n", - "\n", - "# Display the generated image:\n", - "fig = px.imshow(word_cloud, width=640)\n", - "fig.update_layout(xaxis_showticklabels=False, yaxis_showticklabels=False)\n", - "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"word_cloud\"}})" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "n8NkwCGKWNvb" - }, - "source": [ - "\n", - "\n", - "## 2. A Brief Introduction to the HuggingFace Ecosystem\n", - "\n", - "This tutorial uses NLP models provided by [*HuggingFace*](https://huggingface.co/).\n", - "\n", - "HuggingFace is a community that builds, trains and deploys state-of-the-art models for natural language processing,\n", - "audio, computer vision etc. HuggingFace's model hub provides thousands of pre-trained models for these applications.\n", - "The [Transformers](https://huggingface.co/docs/transformers/index) library offers functionality to\n", - "quickly download and use those pre-trained models on a given input, fine-tune them on the own datasets\n", - "and then share them with the community.\n", - "The library is backed by the three most popular deep learning libraries — Jax, PyTorch and TensorFlow.\n", - "\n", - "In this notebook, the following elements of the HuggingFace ecosystem will be used:\n", - "\n", - "* datasets – a library to load and process inputs and outputs of the NLP model\n", - "* tokenizers – translating the raw input text into tokens, which are the vocabulary items of a given NLP model\n", - "* models – loading and saving models\n", - "* trainer - training of models, making predictions\n", - "\n", - "In the next sections we will briefly explore the first three components in turn.\n", - "The trainer functionality will be used in [Section 4](#finetuning) of this notebook." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "iBkzTtL6WNvb" - }, - "source": [ - "\n", - "\n", - "### 2.1. Loading the Data into a Dataset\n", - "\n", - "[*Datasets*](https://huggingface.co/docs/datasets/) is a library for easily accessing and sharing datasets,\n", - "and evaluation of metrics for NLP, computer vision, and audio tasks.\n", - "\n", - "A dataset can be loaded in a single line of code, in our case directly from the pandas DataFrame.\n", - "At the same time, we split the dataset into a training (80%) and a test dataset (20%).\n", - "We fix the random seed for the sake of reproducibility." - ] - }, - { - "cell_type": "code", - "execution_count": 10, - "metadata": { - "id": "g5EUHu8NWNvc", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [], - "source": [ - "dataset = Dataset.from_pandas(df).train_test_split(test_size=0.2, seed=0)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "xJQZP6vFWNvc" - }, - "source": [ - "Since the texts are relatively long, some parts of this notebook require computing resources. Uncomment the following line to reduce the size of the dataset." - ] - }, - { - "cell_type": "code", - "execution_count": 11, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" }, - "id": "Nw7H4keYWNvc", - "outputId": "2e1aa222-0c72-43b4-ed5e-c28780139651" - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "DatasetDict({\n", - " train: Dataset({\n", - " features: ['level_0', 'index', 'SCASEID', 'SUMMARY_EN', 'SUMMARY_GE', 'INJSEVA', 'NUMTOTV', 'WEATHER1', 'WEATHER2', 'WEATHER3', 'WEATHER4', 'WEATHER5', 'WEATHER6', 'WEATHER7', 'WEATHER8', 'INJSEVB', 'words per case summary'],\n", - " num_rows: 5559\n", - " })\n", - " test: Dataset({\n", - " features: ['level_0', 'index', 'SCASEID', 'SUMMARY_EN', 'SUMMARY_GE', 'INJSEVA', 'NUMTOTV', 'WEATHER1', 'WEATHER2', 'WEATHER3', 'WEATHER4', 'WEATHER5', 'WEATHER6', 'WEATHER7', 'WEATHER8', 'INJSEVB', 'words per case summary'],\n", - " num_rows: 1390\n", - " })\n", - "})\n" - ] - } - ], - "source": [ - "# dataset = DatasetDict({\"train\": dataset[\"train\"].select(range(1000)), \"test\": dataset[\"train\"].select(range(250))})\n", - "print(dataset)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "GEYz-kTWWNvc" - }, - "source": [ - "The resulting `DatasetDict` behaves like a Python dictionary.\n", - "Therefore, you can access the `Dataset` corresponding to each split by" - ] - }, - { - "cell_type": "code", - "execution_count": 12, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "XJZ211STWNvd", - "outputId": "1cce6d42-a64e-4b5a-9b0f-e92e29d92223", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Dataset({\n", - " features: ['level_0', 'index', 'SCASEID', 'SUMMARY_EN', 'SUMMARY_GE', 'INJSEVA', 'NUMTOTV', 'WEATHER1', 'WEATHER2', 'WEATHER3', 'WEATHER4', 'WEATHER5', 'WEATHER6', 'WEATHER7', 'WEATHER8', 'INJSEVB', 'words per case summary'],\n", - " num_rows: 5559\n", - "})\n" - ] - } - ], - "source": [ - "ds_train = dataset[\"train\"]\n", - "print(ds_train)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "RL4dLtZ5WNvd" - }, - "source": [ - "The `Dataset` object behaves like a normal Python container.\n", - "You can query its length, get rows or columns, etc. For instance, its length is:" - ] - }, - { - "cell_type": "code", - "execution_count": 13, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "V5KYuXD7WNvd", - "outputId": "1b72a9e6-135e-474e-9f2f-e17aa486114e", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ - { - "data": { - "text/plain": [ - "5559" + "cell_type": "code", + "execution_count": 6, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "cFmU2CO5Zxe-", + "outputId": "eb908e7d-8147-4661-a391-7e59a086d4d6" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Collecting kaleido\n", + " Downloading kaleido-0.2.1-py2.py3-none-manylinux1_x86_64.whl (79.9 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m79.9/79.9 MB\u001b[0m \u001b[31m21.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hInstalling collected packages: kaleido\n", + "Successfully installed kaleido-0.2.1\n" + ] + } + ], + "source": [ + "!pip install kaleido" ] - }, - "execution_count": 13, - "metadata": {}, - "output_type": "execute_result" - } - ], - "source": [ - "len(ds_train)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "rYPGO6cBWNvd" - }, - "source": [ - "To query a single row, you can use its index, like in a list: `ds_train[0]`.\n", - "This returns a dictionary representing the row.\n", - "Its elements can be accessed by the column names as keys,\n", - "e.g. `ds_train[0][\"SCASEID\"]`.\n", - "Multiple rows can be accessed by index slices, e.g. `dataset[\"train\"][:2]`,\n", - "or by a list of indices, e.g. `dataset[\"train\"][0, 2]`.\n", - "\n", - "You can list the column names and get their detailed types (called features):" - ] - }, - { - "cell_type": "code", - "execution_count": 14, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" }, - "id": "m6RObDO1WNve", - "outputId": "489cbfbb-0a6f-4352-982c-e0f23f13088c", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "text/plain": [ - "{'level_0': Value(dtype='int64', id=None),\n", - " 'index': Value(dtype='int64', id=None),\n", - " 'SCASEID': Value(dtype='int64', id=None),\n", - " 'SUMMARY_EN': Value(dtype='string', id=None),\n", - " 'SUMMARY_GE': Value(dtype='string', id=None),\n", - " 'INJSEVA': Value(dtype='int64', id=None),\n", - " 'NUMTOTV': Value(dtype='int64', id=None),\n", - " 'WEATHER1': Value(dtype='int64', id=None),\n", - " 'WEATHER2': Value(dtype='int64', id=None),\n", - " 'WEATHER3': Value(dtype='int64', id=None),\n", - " 'WEATHER4': Value(dtype='int64', id=None),\n", - " 'WEATHER5': Value(dtype='int64', id=None),\n", - " 'WEATHER6': Value(dtype='int64', id=None),\n", - " 'WEATHER7': Value(dtype='int64', id=None),\n", - " 'WEATHER8': Value(dtype='int64', id=None),\n", - " 'INJSEVB': Value(dtype='int64', id=None),\n", - " 'words per case summary': Value(dtype='int64', id=None)}" + "cell_type": "code", + "execution_count": 7, + "metadata": { + "id": "_z92uLSKWNvS", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [], + "source": [ + "from datasets import Dataset, DatasetDict, load_from_disk\n", + "from transformers import AutoTokenizer, AutoModel, Trainer, TrainingArguments, trainer_utils, AutoModelForMaskedLM,\\\n", + " DataCollatorForLanguageModeling, AutoModelForSequenceClassification, pipeline\n", + "from transformers_interpret import SequenceClassificationExplainer\n", + "import torch\n", + "import pandas as pd\n", + "import numpy as np\n", + "from scipy.special import softmax\n", + "from sklearn.linear_model import LogisticRegression\n", + "from sklearn.dummy import DummyClassifier\n", + "from sklearn.metrics import classification_report, confusion_matrix, accuracy_score, f1_score\n", + "import plotly.express as px\n", + "from wordcloud import WordCloud\n", + "\n", + "from tutorial_utils import extract_sequence_encoding, get_xy, dummy_classifier, logistic_regression_classifier, evaluate_classifier" ] - }, - "execution_count": 14, - "metadata": {}, - "output_type": "execute_result" - } - ], - "source": [ - "ds_train.features" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "yWaiHGOCWNve" - }, - "source": [ - "Later in this tutorial we will get to know methods to process datasets,\n", - "such as filtering the rows based on conditions, and processing the data in each row.\n", - "\n", - "\n", - "\n" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "ZTm6W4KUWNve" - }, - "source": [ - "\n", - "\n", - "### 2.2 Tokenization: Split Raw Text into Vocabulary Items\n", - "\n", - "Next, we convert the summary texts into tokens,\n", - "i.e., the text strings are split into elements of the vocabulary of the NLP model.\n", - "\n", - "As such, the tokenizer and the NLP model need to be aligned.\n", - "Changing the tokenizer after training the model would produce unpredictable results.\n", - "\n", - "Let's start with the model\n", - "[`distilbert-base-multilingual-cased`](https://huggingface.co/distilbert-base-multilingual-cased).\n", - "As the name implies, this model is cased: it does make a difference between \"english\" and \"English\".\n", - "\n", - "The model is trained on the concatenation of Wikipedia in 104 different languages listed\n", - "[here](https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages).\n", - "The model has 6 layers, 768 dimensions and 12 heads, totalizing 134 million parameters.\n", - "This model is a distilled version of the\n", - "[BERT base multilingual model](https://huggingface.co/bert-base-multilingual-cased)\n", - "which has 177 million parameters.\n", - "On average, the distilled model is twice as fast as the original model.\n", - "\n", - "**If you want to use another model throughout this notebook, please feel free to simply change the following line!**" - ] - }, - { - "cell_type": "code", - "execution_count": 15, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" }, - "id": "Irl_VYLSWNve", - "outputId": "bff2c06d-4edf-43e8-ff41-f7607bba108f", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "c41d4c566c594fa489612f9f492e0806", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "ut5VN51xWNvT" }, - "text/plain": [ - "Downloading: 0%| | 0.00/29.0 [00:00\n", + "\n", + "### 1.2. Exploring the Data\n", + "\n", + "The data used throughout this tutorial is derived from data of a vehicle crash causation study performed\n", + "in the United States from 2005 to 2007.\n", + "The dataset has almost 7'000 records, each relating to one accident.\n", + "For each case, a verbal description of the accident is available in English,\n", + "which summarizes road and weather conditions,\n", + "vehicles, drivers and passengers involved, preconditions, injury severities, etc.\n", + "The same information is also encoded in tabular form,\n", + "so that we can apply supervised learning techniques to train the NLP models and\n", + "compare the information extracted from the verbal descriptions with the encoded data.\n", + "\n", + "The original data consists of multiple tables. For this tutorial, we have aggregated it into a single dataset\n", + "and added German translations of the English accident descriptions.\n", + "The translations were generated using the new\n", + "[DeepL python API](https://pypi.org/project/deepl/).\n", + "\n", + "To explore the data, let's load it into a Pandas DataFrame and examine its shape, columns and data types:" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "0fc13388a3db46259b6e2c9d034067ed", - "version_major": 2, - "version_minor": 0 + "cell_type": "code", + "execution_count": 8, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "RJDyLey0WNvU", + "outputId": "ad5d39e6-986e-4884-d738-f1a4b745813a", + "pycharm": { + "name": "#%%\n" + } }, - "text/plain": [ - "Downloading: 0%| | 0.00/972k [00:00\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "fig = px.bar(df[\"NUMTOTV\"].value_counts().sort_index(), width=640)\n", + "fig.update_layout(title=\"number of cases by number of vehicles\", xaxis_title=\"number of vehicles\",\n", + " yaxis_title=\"number of cases\")\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"num_vehicles\"}})" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "367f9396563741b3b2243f027eb039e6", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "pwcfXawvWNvX" }, - "text/plain": [ - " 0%| | 0/2 [00:00\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "fig=px.bar(x=range(1,9), y=[(df[\"WEATHER\"+str(i)]==1).sum() for i in range(1,9)], width=640)\n", + "fig.update_layout(title=\"number of cases by weather condition\", xaxis_title=\"weather condition\",\n", + " yaxis_title=\"number of cases\")\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"weather\"}})" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "a34add77047a4d38b88a76b96916b5f7", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "gVwOVGouWNvY" }, - "text/plain": [ - " 0%| | 0/2 [00:00\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "# statistics of summary length\n", + "df[\"words per case summary\"] = df[\"SUMMARY_EN\"].str.split().apply(len)\n", + "print(f\"Overall number of words by case summary: min {df['words per case summary'].min()}, \"\n", + " f\"average {df['words per case summary'].mean():.0f}, max {df['words per case summary'].max()}\")\n", + "fig = px.box(df, x=\"NUMTOTV\", y=\"words per case summary\", width=640)\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"text_length\"}})" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "fba24976bb6a463cb0f12f0e5e6175fc", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "mrk7jvqtWNvZ" }, - "text/plain": [ - " 0%| | 0/6 [00:00" + ], + "text/html": [ + "V1, a 2000 Pontiac Montana minivan, made a left turn from a private driveway onto a northbound 5-lane two-way, dry asphalt roadway on a downhill grade. The posted speed limit on this roadway was 80 kmph (50 MPH). V1 entered the roadway by crossing over the two southbound lanes and then entering the third northbound lane, which was a left turn-only lane at a 4-way intersection. The driver of V1 intended to travel straight through the intersection, and so he began to change lanes to the right. He did not see V2, a 1994 Pontiac Grand Am, that was traveling in the second northbound lane. The northbound roadway had curved to the right prior to the private driveway that V1 had exited. As V1 began to change lanes to the right, the front of V1 contacted the left rear of V2 before coming to final rest on the roadway.\r \r The driver of V1 was a 60-year old male who reported that he had been traveling between 2-17 kmph (1-10 mph) prior to the crash. He had no health-related problems, and had taken no medication prior to the crash. He was rested and traveling back home. He was wearing his prescribed lenses that corrected a myopic (nearsighted) condition. He did not sustain any injuries from the crash and refused treatment.\r \r The Critical Precrash Event for the driver of V1 was when he began to travel over the lane line on the right side of the travel lane. The Critical Reason for the Critical Precrash Event was inadequate surveillance (failed to look, looked but did not see). Associated factors coded to the driver of V1 include an illegal use of a left turn lane (cited by police) and an unfamiliarity with the roadway. As per the driver of V1, this was the first time he had driven on this roadway. \r \r The driver of V2 was a 28-year old woman who reported that she had been traveling between 66-80 kmph (41-50 mph) prior to the crash. She had no health-related problems, and had taken no medication prior to the crash. She was rested and on her way home. She does not wear corrective lenses. She sustained minor injuries and was transported to a local trauma facility.\r \r The Critical Precrash Event for the driver of V2 was when the other vehicle encroached into her lane, from an adjacent lane (same direction) over the left lane line. The Critical Reason for the Critical Precrash Event was not coded to the driver of V2 and no associated factors were coded to her." + ] + }, + "metadata": {} + } + ], + "source": [ + "display(HTML(df.loc[0, \"SUMMARY_EN\"]))" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "def map_mixed(x, idx):\n", - " return {\"SUMMARY_MX\" : x[\"SUMMARY_GE\"] if idx % 5 == 0 else x[\"SUMMARY_EN\"]}\n", - "dataset = dataset.map(map_mixed, batched=False, with_indices=True)\n", - "dataset_mx = dataset.map(tokenize, batched=True, fn_kwargs={\"column\": \"SUMMARY_MX\"})" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "ItDUbmVvWNvi" - }, - "source": [ - "Now we have created three datasets - with the tokenized English, German and mixed language texts, respectively.\n", - "\n", - "We could have stored the results in a single dataset (with different column names),\n", - "but keeping languages separately will make it easier to convince ourselves in the following examples\n", - "that the languages have not been mixed up!" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "CMoSQ04TWNvi" - }, - "source": [ - "\n", - "\n", - "### 2.3. Transformer model\n", - "\n", - "After completing the tokenization of the raw texts, we are ready to apply the transformer model,\n", - "in our case the multilingual DistilBERT model.\n", - "\n", - "First, we load the model.\n", - "To speed up the following calculations, we opt for GPU support if available.\n" - ] - }, - { - "cell_type": "code", - "execution_count": 23, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" }, - "id": "-iKVTkH_WNvi", - "outputId": "fb57c9a2-6c21-4d5d-c854-91446083b71c", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "78af46f672764221a9a83c9d8b3fbd5c", - "version_major": 2, - "version_minor": 0 + "cell_type": "code", + "execution_count": 13, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 173 + }, + "id": "74OyQip6WNva", + "outputId": "e96ea679-9fa9-4e56-c666-6318cf34310d", + "pycharm": { + "name": "#%%\n" + } }, - "text/plain": [ - "Downloading: 0%| | 0.00/517M [00:00" + ], + "text/html": [ + "V1, ein Minivan der Marke Pontiac Montana aus dem Jahr 2000, bog von einer privaten Einfahrt nach links auf eine zweispurige, trockene Asphaltstraße mit 5 Fahrspuren in nördlicher Richtung und einem Gefälle ab. Die zulässige Höchstgeschwindigkeit auf dieser Fahrbahn betrug 80 km/h (50 MPH). V1 fuhr auf die Fahrbahn, indem er die beiden Fahrspuren in Richtung Süden überquerte und dann auf die dritte Fahrspur in Richtung Norden einfuhr, die an einer Kreuzung mit vier Fahrspuren nur für Linksabbieger vorgesehen war. Der Fahrer von V1 beabsichtigte, geradeaus über die Kreuzung zu fahren, und begann daher, die Spur nach rechts zu wechseln. Dabei übersah er V2, einen Pontiac Grand Am von 1994, der auf der zweiten Fahrspur in Richtung Norden unterwegs war. Die Fahrbahn in nördlicher Richtung war vor der privaten Einfahrt, aus der V1 herausgefahren war, nach rechts gebogen. Als V1 begann, die Spur nach rechts zu wechseln, berührte die Front von V1 das linke Heck von V2, bevor er auf der Fahrbahn zum Stehen kam. Der Fahrer von V1 war ein 60-jähriger Mann, der angab, vor dem Unfall mit einer Geschwindigkeit von 2 bis 17 km/h unterwegs gewesen zu sein. Er hatte keine gesundheitlichen Probleme und hatte vor dem Unfall keine Medikamente eingenommen. Er war ausgeruht und auf dem Weg nach Hause. Er trug die ihm verschriebenen Kontaktlinsen, die eine Kurzsichtigkeit korrigieren. Er zog sich bei dem Unfall keine Verletzungen zu und lehnte eine Behandlung ab. Das kritische Ereignis vor dem Unfall war für den Fahrer von V1, als er begann, die Fahrspurlinie auf der rechten Seite der Fahrbahn zu überfahren. Der kritische Grund für das kritische Ereignis vor dem Unfall war unzureichende Überwachung (nicht hingesehen, hingesehen, aber nicht gesehen). Zu den assoziierten Faktoren, die dem Fahrer von V1 zugeschrieben werden, gehören das illegale Benutzen einer Linksabbiegerspur (von der Polizei verwarnt) und die Unkenntnis der Fahrbahn. Für den Fahrer von V1 war es das erste Mal, dass er diese Fahrbahn befuhr. \r \r Bei der Fahrerin von V2 handelte es sich um eine 28-jährige Frau, die angab, vor dem Unfall mit einer Geschwindigkeit von 66-80 km/h unterwegs gewesen zu sein. Sie hatte keine gesundheitlichen Probleme und hatte vor dem Unfall keine Medikamente eingenommen. Sie war ausgeruht und befand sich auf dem Heimweg. Sie trägt keine Korrekturgläser. Sie erlitt leichte Verletzungen und wurde in eine örtliche Unfallklinik gebracht. Das kritische Ereignis vor dem Unfall war für die Fahrerin von V2, als das andere Fahrzeug von einer benachbarten Fahrspur (gleiche Richtung) über die linke Fahrspurlinie in ihre Spur eindrang. Der kritische Grund für das kritische Vorunfallereignis wurde der Fahrerin von V2 nicht zugeordnet, und es wurden ihr keine zugehörigen Faktoren zugeordnet." + ] + }, + "metadata": {} + } + ], + "source": [ + "display(HTML(df.loc[0, \"SUMMARY_GE\"]))" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stderr", - "output_type": "stream", - "text": [ - "Some weights of the model checkpoint at distilbert-base-multilingual-cased were not used when initializing DistilBertModel: ['vocab_transform.weight', 'vocab_layer_norm.bias', 'vocab_transform.bias', 'vocab_projector.weight', 'vocab_layer_norm.weight', 'vocab_projector.bias']\n", - "- This IS expected if you are initializing DistilBertModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).\n", - "- This IS NOT expected if you are initializing DistilBertModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).\n" - ] - } - ], - "source": [ - "# load model\n", - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model \n", - "model = AutoModel.from_pretrained(model_name).to(device)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "6SjLBsnHWNvi" - }, - "source": [ - "The warning message can be ignored for our application.\n", - "\n", - "Let's examine the model structure:" - ] - }, - { - "cell_type": "code", - "execution_count": 24, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "G9_RcTV-WNvj", - "outputId": "ddf78938-3405-4237-b229-81a0d42edd06", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ - { - "data": { - "text/plain": [ - "DistilBertModel(\n", - " (embeddings): Embeddings(\n", - " (word_embeddings): Embedding(119547, 768, padding_idx=0)\n", - " (position_embeddings): Embedding(512, 768)\n", - " (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " )\n", - " (transformer): Transformer(\n", - " (layer): ModuleList(\n", - " (0): TransformerBlock(\n", - " (attention): MultiHeadSelfAttention(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (q_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (k_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (v_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (out_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " )\n", - " (sa_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " (ffn): FFN(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (lin1): Linear(in_features=768, out_features=3072, bias=True)\n", - " (lin2): Linear(in_features=3072, out_features=768, bias=True)\n", - " (activation): GELUActivation()\n", - " )\n", - " (output_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " )\n", - " (1): TransformerBlock(\n", - " (attention): MultiHeadSelfAttention(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (q_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (k_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (v_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (out_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " )\n", - " (sa_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " (ffn): FFN(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (lin1): Linear(in_features=768, out_features=3072, bias=True)\n", - " (lin2): Linear(in_features=3072, out_features=768, bias=True)\n", - " (activation): GELUActivation()\n", - " )\n", - " (output_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " )\n", - " (2): TransformerBlock(\n", - " (attention): MultiHeadSelfAttention(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (q_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (k_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (v_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (out_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " )\n", - " (sa_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " (ffn): FFN(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (lin1): Linear(in_features=768, out_features=3072, bias=True)\n", - " (lin2): Linear(in_features=3072, out_features=768, bias=True)\n", - " (activation): GELUActivation()\n", - " )\n", - " (output_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " )\n", - " (3): TransformerBlock(\n", - " (attention): MultiHeadSelfAttention(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (q_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (k_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (v_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (out_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " )\n", - " (sa_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " (ffn): FFN(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (lin1): Linear(in_features=768, out_features=3072, bias=True)\n", - " (lin2): Linear(in_features=3072, out_features=768, bias=True)\n", - " (activation): GELUActivation()\n", - " )\n", - " (output_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " )\n", - " (4): TransformerBlock(\n", - " (attention): MultiHeadSelfAttention(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (q_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (k_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (v_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (out_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " )\n", - " (sa_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " (ffn): FFN(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (lin1): Linear(in_features=768, out_features=3072, bias=True)\n", - " (lin2): Linear(in_features=3072, out_features=768, bias=True)\n", - " (activation): GELUActivation()\n", - " )\n", - " (output_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " )\n", - " (5): TransformerBlock(\n", - " (attention): MultiHeadSelfAttention(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (q_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (k_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (v_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " (out_lin): Linear(in_features=768, out_features=768, bias=True)\n", - " )\n", - " (sa_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " (ffn): FFN(\n", - " (dropout): Dropout(p=0.1, inplace=False)\n", - " (lin1): Linear(in_features=768, out_features=3072, bias=True)\n", - " (lin2): Linear(in_features=3072, out_features=768, bias=True)\n", - " (activation): GELUActivation()\n", - " )\n", - " (output_layer_norm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n", - " )\n", - " )\n", - " )\n", - ")" + "cell_type": "markdown", + "metadata": { + "id": "2Gb03bROWNva" + }, + "source": [ + "To get an impression of the most frequent words, we generate a simple word cloud form all English case descriptions.\n", + "By default, the word cloud excludes so-called stop words (such as articles, prepositions, pronouns, conjunctions, etc.),\n", + "which are the most common words and do not add much information to the text." ] - }, - "execution_count": 24, - "metadata": {}, - "output_type": "execute_result" - } - ], - "source": [ - "model" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "X3lhtdAsWNvj", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "As we can see, the first block of the model deals with embeddings, with the word embedding as the first layer.\n", - "This is followed by the transformer which consists of 6 transformer blocks.\n", - "\n", - "Let's first explore the word embedding.\n", - "\n", - "The goal of the word embedding layer is to assign each element of the vocabulary a vector of length $E$.\n", - "\n", - "The multilingual DistilBERT model has a vocabulary of size $V=119'547$ and a word embedding size of $E=768$.\n", - "We can confirm this by looking at the dimension of the word embedding weight tensor:" - ] - }, - { - "cell_type": "code", - "execution_count": 25, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" }, - "id": "k9yHSGD0WNvj", - "outputId": "8c3ea6f3-0b8a-48a6-8a59-c79d03c7f7c1" - }, - "outputs": [ { - "data": { - "text/plain": [ - "Embedding(119547, 768, padding_idx=0)" + "cell_type": "code", + "execution_count": 14, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 542 + }, + "id": "fUhYGO10WNvb", + "outputId": "6e65c641-c672-4f47-dabd-b3fe523e63ec", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "text = df[\"SUMMARY_EN\"].str.cat(sep=\" \")\n", + "\n", + "# Create and generate a word cloud image:\n", + "word_cloud = WordCloud(max_words=100, background_color=\"white\").generate(text)\n", + "\n", + "# Display the generated image:\n", + "fig = px.imshow(word_cloud, width=640)\n", + "fig.update_layout(xaxis_showticklabels=False, yaxis_showticklabels=False)\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"word_cloud\"}})" ] - }, - "execution_count": 25, - "metadata": {}, - "output_type": "execute_result" - } - ], - "source": [ - "model.embeddings.word_embeddings" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "zPHwjjcAWNvj" - }, - "source": [ - "To see the outputs of the transformer encoder, let's apply the transformer to the first record of the dataset,\n", - "more precisely to its columns `input_ids` and `attention_mask`, the outputs of the tokenizer:" - ] - }, - { - "cell_type": "code", - "execution_count": 26, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "S7E9tRVZWNvk", - "outputId": "d943aa09-e288-4b2a-a233-6627faf829a7", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "BaseModelOutput(last_hidden_state=tensor([[[ 0.1148, -0.0254, 0.1447, ..., 0.1937, 0.0804, -0.2158],\n", - " [ 0.1216, -0.5199, 0.6924, ..., 0.2711, -0.2492, -0.0172],\n", - " [-0.4065, -0.0786, 0.3362, ..., -0.2183, 0.0278, 0.1635],\n", - " ...,\n", - " [-0.1276, -0.4791, -0.1539, ..., 0.0442, -0.2272, 0.1089],\n", - " [-0.1577, -0.4097, -0.2176, ..., 0.0154, -0.2008, -0.1374],\n", - " [-0.1855, -0.4261, -0.1884, ..., -0.0515, -0.0600, -0.3426]]],\n", - " device='cuda:0'), hidden_states=None, attentions=None)\n" - ] - } - ], - "source": [ - "example = dataset_en[\"train\"][:1]\n", - "\n", - "input_ids = torch.tensor(example[\"input_ids\"]).to(device)\n", - "attention_mask = torch.tensor(example[\"attention_mask\"]).to(device)\n", - "with torch.no_grad():\n", - " output = model(input_ids, attention_mask)\n", - "print(output)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "U9cBNUetWNvk", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "This produces a `BaseModelOutput` object which has a named property `last_hidden_state`,\n", - "a tensor that represents the hidden state of the final transformer block, i.e. the encoded text sequence!\n", - "\n", - "The dimension of the last hidden state is:" - ] - }, - { - "cell_type": "code", - "execution_count": 27, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "hkenZ_7pWNvk", - "outputId": "eaa565c5-abc7-4b3d-8ddc-dc32f465cff1", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "dimensions of last hidden state: torch.Size([1, 512, 768])\n" - ] - } - ], - "source": [ - "print(\"dimensions of last hidden state: \", output.last_hidden_state.size())" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "ImR3xLwLWNvl" - }, - "source": [ - "i.e., \\[number of samples (1), sequence length $T$ (maximum 512 tokens), embedding size $E$ (768)\\].\n", - "\n", - "In what follows, we will use the information contained in this tensor to make predictions.\n" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "4D2hUjC1WNvl", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "\n", - "\n", - "## 3. Using Transformers to Extract Features for Classification or Regression Tasks \n", - "\n", - "In this section you will learn how transformers can be used to extract features from text data for a classification\n", - "or regression problem.\n", - "\n", - "The idea is simple: The tokenized raw text data is encoded by the transformer model,\n", - "and the features are extracted from the last hidden state.\n" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "yowxi5sPWNvl" - }, - "source": [ - "\n", - "\n", - "### 3.1. Extracting the Encoded Text\n", - "\n", - "Before we have seen that the DistilBERT model encodes *each token* of each input sample into a tensor\n", - "of length $E=768$.\n", - "As such, the output of the transformer model depends on the length of the input sequences.\n", - "To make predictions, we would prefer having a single vector per input sample, independent of the sequence length.\n", - "\n", - "Different approaches are available to achieve this goal:\n", - "* Use the tensor corresponding to the `CLS` token, which is the first token of the input sequence in BERT models.\n", - "* *Mean pooling*: Taking the average of the tensors over all elements of the sequence.\n", - " Here, the tensors corresponding to a `PAD` token should be excluded because they don't carry any information.\n", - "\n", - "We will implement both techniques and compare results.\n", - "\n", - "In the following cell we display a short function which applies the NLP model to a batch of encoded input samples,\n", - "extracts the last hidden state, and returns two tensors of length 768 for each input sample,\n", - "corresponding to the two methods explained before.\n", - "\n", - "The cell is not executable, because the function is already defined in the module `tutorial_utils` we imported initially." - ] - }, - { - "cell_type": "raw", - "metadata": { - "id": "b31jpyUBWNvl", - "pycharm": { - "name": "#%%\n" - } - }, - "source": [ - "```\n", - "def extract_sequence_encoding(batch, model):\n", - " input_ids = torch.tensor(batch[\"input_ids\"]).to(model.device)\n", - " attention_mask = torch.tensor(batch[\"attention_mask\"]).to(model.device)\n", - " with torch.no_grad():\n", - " # apply transformer model and extract last hidden state\n", - " model_output = model(input_ids, attention_mask)\n", - " last_hidden_state = model_output.last_hidden_state\n", - "\n", - " # extract the tensor corresponding to the CLS token, i.e. the first element in the encoded sequence\n", - " batch[\"cls_hidden_state\"] = last_hidden_state[:,0,:].cpu().numpy()\n", - "\n", - " # mean pooling: take average over input sequence, but mask sequence elements corresponding to the PAD token\n", - " last_hidden_state = last_hidden_state.cpu().numpy()\n", - " lhs_shape = last_hidden_state.shape\n", - " boolean_mask = ~np.array(batch[\"attention_mask\"]).astype(bool)\n", - " boolean_mask = np.repeat(boolean_mask, lhs_shape[-1], axis=-1)\n", - " boolean_mask = boolean_mask.reshape(lhs_shape)\n", - " masked_mean = np.ma.array(last_hidden_state, mask=boolean_mask).mean(axis=1)\n", - " batch[\"mean_hidden_state\"] = masked_mean.data\n", - " return batch\n", - "```" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "ikSaZs83WNvm" - }, - "source": [ - "Let's apply this function to the first sample of the training data:" - ] - }, - { - "cell_type": "code", - "execution_count": 28, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" }, - "id": "n8tYVkL4WNvn", - "outputId": "ce8f5a48-c248-4b77-bda0-d80ac2ed829b", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "dict_keys(['level_0', 'index', 'SCASEID', 'SUMMARY_EN', 'SUMMARY_GE', 'INJSEVA', 'NUMTOTV', 'WEATHER1', 'WEATHER2', 'WEATHER3', 'WEATHER4', 'WEATHER5', 'WEATHER6', 'WEATHER7', 'WEATHER8', 'INJSEVB', 'words per case summary', 'input_ids', 'attention_mask', 'cls_hidden_state', 'mean_hidden_state'])\n" - ] - } - ], - "source": [ - "example = dataset_en[\"train\"][:1]\n", - "result = extract_sequence_encoding(example, model)\n", - "print(result.keys())" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Fly05NyXWNvo" - }, - "source": [ - "As desired, two additional columns `cls_hidden_state` and `mean_hidden_state` were appended.\n", - "\n", - "Therefore, the function can be supplied to the familiar `map` function\n", - "to add corresponding columns to the original dataset.\n", - "The following lines do this for the full datasets.\n", - "\n", - "On an AWS EC2 p2.xlarge instance, the run time is amore than 10 minutes.\n", - "We save the resulting datasets to disk." - ] - }, - { - "cell_type": "code", - "execution_count": 29, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 209, - "referenced_widgets": [ - "1e350ddc7a184e9fb01ec7f490836576", - "3094d38a8ac9479d92caaa5444ecb62a", - "d5e05cd88ad14e41980d1b253f93c542", - "cf01bb4ec1144cacb886b25b44af67ed", - "281149b222b045c991ab3c9fea53ceec", - "b13d3704f3c6432a9408375be0556c97", - "267f7d6137de4e1b88240e6483da2dad", - "9a441cf6f75747eeac6310b9e0fe08cc", - "7824dc97640847608bb97da2db2d6aa4", - "5d9e94a4feb34784b24bc513599d4a54", - "1bb5e367be52440fb8add911e22eeb83", - "7ce2f7d8bc6a44618688936353a37330", - "e966521802074ba68f04424740130e08", - "69633d2fa8234b52bb3f3eb4dbd87d08", - "9b59a70648a14c4cbf6b1e6df6383ab8", - "265f5fc84e73428691c772ce3426b6f6", - "60d39ea12b874769a4d223296d67152c", - "cd550bcf6961407bb6c8f75577f7ca08", - "ff9ac90ff816467d963f9b51f2effef4", - "d06add58c8164c1ebffa2b65c1e87ad7", - "c5e7f5e9f939416cb2af307a98c83bb1", - "7347cba438154bc8aed73868dc35c445", - "2353cbea224443e5b5c36ab284fd13ef", - "a32b4fb588d84aceac9704d835a7bf72", - "18ab3dfbab15469b9fda4a07deea726a", - "07cabc97a6344587b695bc1db82eb0d9", - "4d6de2caee2842778b91db4d8ee24679", - "cfce1c3c74d64cc4a9c4cb7f0c371d9d", - "4bbdb34f5c334aeca6e644ce38beeab5", - "2a0c5948df1546eca18eb1cb27471210", - "494d49177a3342b19f7a73b4269a8caa", - "046ba28d144d4f0487e62d2b80b9391d", - "32096c15964a435bb3f070d98ce14d35", - "ac9f6b5594c648008dca380d0149defc", - "e392ec75d57e4e29a217381936effffe", - "3fe0965263de4256ad37e812299876dd", - "70e0eef3de3e4df793d40ec2e9351edc", - "3f59b5c329444641bf18458306413f5d", - "e04b516ce7564b08aa97d9b160d3e130", - "e677db525c604d3dab52d6f136eb392a", - "bcb79ae229064500a151d4a8ecab751f", - "7eb43988b32d4f24a307ff02a806b632", - "5f39226ffc4048fc856499f43a13b39b", - "59784aba641549b7b11f2973cadc9f86", - "77015a5bca3842babc35a6c65c7bff7e", - "3c5344baa2334f52abf6d78bd89a6fc8", - "cccf48967d2c44efa89c29a2f9de402e", - "5a78a1ea17394ed6962c0c7c32ae19c6", - "a15544954d0e4baba31c152d42dadc8c", - "b75b3ba25009492bbad854d7112f1346", - "99b1f562cb6c4003adf1bdfa4f398305", - "0e0a1ba9359c485b8061285dedb6e13f", - "75407e9f3abb40069a72eecd51786b5d", - "1c73d68385a748de8346f790a31502c1", - "63cd13ae90fa44d1901adc868f181c0a", - "9e2d45e11af74aec8a296d945421c994", - "ad627b80e74c4416b41e6fb27a9c7b30", - "ebf4686e27b1464daea3bb1972ee2b78", - "95ddaeea7f3b4865878ec58175504159", - "3e1551afeac1478f9099ffd6e61ac492", - "b8280e22b8b744ef9029cf61b4708227", - "f4338786226b43fa9a74e856ad80e100", - "c37f24466c254b0bbb33fff09d4ddb30", - "c90825a6812347f7bc1d17a917e95c2a", - "7ef7f55f8af64a23be8ca73bee56cf04", - "3c54d43506f24c9198f2900c01869613" - ] + "cell_type": "markdown", + "metadata": { + "id": "n8NkwCGKWNvb" + }, + "source": [ + "\n", + "\n", + "## 2. A Brief Introduction to the HuggingFace Ecosystem\n", + "\n", + "This tutorial uses NLP models provided by [*HuggingFace*](https://huggingface.co/).\n", + "\n", + "HuggingFace is a community that builds, trains and deploys state-of-the-art models for natural language processing,\n", + "audio, computer vision etc. HuggingFace's model hub provides thousands of pre-trained models for these applications.\n", + "The [Transformers](https://huggingface.co/docs/transformers/index) library offers functionality to\n", + "quickly download and use those pre-trained models on a given input, fine-tune them on the own datasets\n", + "and then share them with the community.\n", + "The library is backed by the three most popular deep learning libraries — Jax, PyTorch and TensorFlow.\n", + "\n", + "In this notebook, the following elements of the HuggingFace ecosystem will be used:\n", + "\n", + "* datasets – a library to load and process inputs and outputs of the NLP model\n", + "* tokenizers – translating the raw input text into tokens, which are the vocabulary items of a given NLP model\n", + "* models – loading and saving models\n", + "* trainer - training of models, making predictions\n", + "\n", + "In the next sections we will briefly explore the first three components in turn.\n", + "The trainer functionality will be used in [Section 4](#finetuning) of this notebook." + ] }, - "id": "B6vH7oZ8WNvo", - "outputId": "a7c06bb5-b8b0-41de-eeb3-e4b49cd56c23", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "06561ab395c642038aa26010867a695f", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "iBkzTtL6WNvb" }, - "text/plain": [ - " 0%| | 0/348 [00:00\n", + "\n", + "### 2.1. Loading the Data into a Dataset\n", + "\n", + "[*Datasets*](https://huggingface.co/docs/datasets/) is a library for easily accessing and sharing datasets,\n", + "and evaluation of metrics for NLP, computer vision, and audio tasks.\n", + "\n", + "A dataset can be loaded in a single line of code, in our case directly from the pandas DataFrame.\n", + "At the same time, we split the dataset into a training (80%) and a test dataset (20%).\n", + "We fix the random seed for the sake of reproducibility." ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "5af5a48ac97c4376b105eabb22067904", - "version_major": 2, - "version_minor": 0 + "cell_type": "code", + "execution_count": 15, + "metadata": { + "id": "g5EUHu8NWNvc", + "pycharm": { + "name": "#%%\n" + } }, - "text/plain": [ - " 0%| | 0/87 [00:00\n", - "\n", - "### 3.2. ... and Using It in a Classification Model\n", - "\n", - "We will now use the encoded texts as features to predict labels taken from certain tabular information available in the dataset.\n", - "\n", - "To this end, we use the following convenience functions implemented in `tutorial_utils.py`:\n", - "\n", - "* `x_train, y_train, x_test, y_test = get_xy(dataset, features, label)`
\n", - " get numpy arrays corresponding features (x) and label (y) corresponding to the train and test split of the `dataset`where the encoded sentences are stored in the column `features` and the labels in the column `label`.

\n", - " \n", - "* `clf = logistic_regression_classifier(x, y, c=1)`
\n", - " fit and return a multinomial [Logistic Regression classifier](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) to features `x`, and labels `y`. L2-penalty is controlled by the hyper-parameter `c`.

\n", - " \n", - "* `clf = dummy_classifier(x, y):`
\n", - " fit and return a [Dummy classifier](https://scikit-learn.org/stable/modules/generated/sklearn.dummy.DummyClassifier.html) to features `x`, and labels `y`. This classifier predicts always the most frequent class and `predict_proba` always returns the empirical class distribution of `y`.

\n", - " \n", - "* `score_accuracy, score_log, score_brier, confusion_matrix, fig = evaluate_classifier(y_true, y_pred, p_pred, target_names, display_title_string, file_name)`
\n", - " Calculate and display performance metrics of a classifier. The return value `fig` is a ploty figure representing the confusion matrix plot. The following inputs are expected:
\n", - " * the true labels `y_true` (array-like);\n", - " * either the predicted labels `y_pred` (array_like), in which case the log loss and Brier score are not evaluated;\n", - " * or the predicted probabilities `p_pred` (array_like);\n", - " * a display title string;\n", - " * a file name for exporting the figure, or `None`.\n", - "\n", - "Now the toolbox is ready!\n", - "\n", - "Next, we apply it to a simple classification task." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "XKHtvwGHWNvp" - }, - "source": [ - "\n", - "\n", - "### 3.3. Case Study: Use Accident Descriptions to Predict the Number of Vehicles Involved\n", - "\n", - "In this case study, we will predict the number of vehicles involved in an accident from the verbal accident description.\n", - "\n", - "Since the data set contains the column `NUMTOTV`, we can adopt a supervised learning approach.\n", - "\n", - "We might consider framing the problem as a regression task, e.g. using Poisson regression. However, looking at the frequenca distribution of `NUMTOTV`, it apears unlikely that the Poisson distribution is a good reflection of reality. First, there are no accidents with zero vehicles involved - it takes at least one. So we might consider using a zero-truncated Poisson model. However, the empirical frequency distribution has low mass at high vehicle counts, so that this would not be a plausible model either.\n", - "\n", - "Therefore, we frame the prediction task as multinomial classification. Given that only a small fraction of cases involves four or more vehicles,\n", - "and to avoid a heavily imbalanced classification problem, we map these cases to an aggregated class \"3+\".\n", - "\n", - "To achieve this, we map the column `NUMTOTV` to a new column `labels`, with levels 0 (1 vehicle), 1 (2 vehicles) and 2 (3 or more vehicles).\n", - "We choose the column name `labels` because this is expected by the sequence classification model which we fit in Section [4.2](#task_finetuning)." - ] - }, - { - "cell_type": "code", - "execution_count": 30, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 244, - "referenced_widgets": [ - "430bf1b21606472aa541e6423c0ac43b", - "42145c3ccc5e48b4bb23d974715d0b11", - "5a4b4b1adb4e4bb188dd1f7ed71f089f", - "1c00c9c5fd234c54a3ab8756699b4d40", - "d6825d6f10924739bf10d81edfd5c84a", - "a73186191ecf4353b3f5e3bb7f2d94d3", - "1e62dbd1fa1745ab908c9a8d5db0f750", - "86f94bad311044eb8066703b39e40121", - "a6c33606d46d400e98e46fafb586c5d2", - "35344cd7a45b44128daad7df28986f37", - "517772e266044ac1a1e1407dc5d12227", - "763ffc72756941a1854763b294b5c871", - "d5f1c97cdad848068fed6b0f06c07afb", - "6d59e06f5db94fe4818dc85ffc8c3089", - "3e34eba0f8e34c8f814433e24e07d436", - "b3eb57f4e79f4f3c9d6d62efae5da1d3", - "3618eac4a80a4e2e9677d19b544135c5", - "439e2eee786f4272aed8b684a17cdafa", - "028a6d6a89c447b7bba4753295476731", - "257d359deb9a4cdb83eb2164ce48083a", - "cf988d969ef04a3aa5bbcde0d7ac09e2", - "5d719c4d45f141fa8b328bbce59b5d98", - "141f11d2514341c3bd399fadf7d429ae", - "73ca783459a646d5aec2d5eee52265f4", - "56ffb36a4f8948d48e747a9cbe3db97c", - "131900aa273a480c852f75ec3caf9378", - "7b2870dee15b445ea4498915a6c4543f", - "85f11446b83142ec8415fa1f04899c75", - "8243f6ee3d974869bbb22616367e64c4", - "0db71979d1ad44e3a1e519ddf5763b99", - "95ca6fa48aa44adaa25d982f1b214d46", - "db62481b1ae647c5a122f5359c51b40a", - "04a9331c6058401bb5dd23d473347658", - "4bd82d5e76dc43c89cce1a002ae082e5", - "99b9e940f3d1401ca2532b4ec64eeb93", - "d79c62b38d814bc7b63c8a91b427aa09", - "84273afd4621449dbd6c0229e439764a", - "975e6ad2a3644593ae306df519065845", - "e894b1842a64465987af3b474b77bf36", - "e30939ad29f04037b8d878488d9a99e4", - "cc371b372fd44de0931a6758dd815034", - "e4c534694dbd42d3a1384bcae064f07b", - "d518b8cb9c094af2ac47fc6df5909433", - "e893479db5354115a76f1f25c9ff8457", - "18d026f74f9949b2b3ac898b17b03cb4", - "071a8d5ef72341c8ad8bbc5c9d4d3cf5", - "29efaa3369d34f53a4b2a62c3d7cfcad", - "5d25939a166e46268687e1f00cafbcae", - "a83cdbe2f5e9405585a5149de379d4fe", - "4038760426604230ab1b194ce03ab272", - "4524d9dd9ba04c309532068036c14d14", - "4d50610424d44ed49053b14220c36f13", - "b00ae04a358d44d0982defa9376db171", - "2829641b00e348d897f413a85a71a50c", - "fe65a6feeb894beb9c5739b11d87ec02", - "3c5bd797dd4b4b03a43bc549500e1e4c", - "10aea956d59c47168b714d45e5cf5594", - "f7ade8392b1642c99f15a0d86211a8d4", - "1236b2afd7f2459ba184a0595fdc9873", - "62ffc944ecfa45c0ae0e9eb9cd699be0", - "94595135c7ad457fa6188a66d4c03ec1", - "9f44c5ab3c5241dcbf6d28983e940b09", - "8b1ed8c83a104aacb955b714661de181", - "2487db3328ab4c0d96a883f58ab66a1e", - "c1561595e0744aa3a9eb5a4aa2f1cca6", - "1d17eacf5f8343cb82e645d31134d145" - ] + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Dataset({\n", + " features: ['level_0', 'index', 'SCASEID', 'SUMMARY_EN', 'SUMMARY_GE', 'INJSEVA', 'NUMTOTV', 'WEATHER1', 'WEATHER2', 'WEATHER3', 'WEATHER4', 'WEATHER5', 'WEATHER6', 'WEATHER7', 'WEATHER8', 'INJSEVB', 'words per case summary'],\n", + " num_rows: 5559\n", + "})\n" + ] + } + ], + "source": [ + "ds_train = dataset[\"train\"]\n", + "print(ds_train)" + ] }, - "id": "LFE7syyMWNvp", - "outputId": "54d674fb-de07-4428-d7b1-a76ba8b1bc61", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "a2d31bc0bade498daee30b90900905b3", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "RL4dLtZ5WNvd" }, - "text/plain": [ - " 0%| | 0/5559 [00:00\n", + "\n", + "### 2.2 Tokenization: Split Raw Text into Vocabulary Items\n", + "\n", + "Next, we convert the summary texts into tokens,\n", + "i.e., the text strings are split into elements of the vocabulary of the NLP model.\n", + "\n", + "As such, the tokenizer and the NLP model need to be aligned.\n", + "Changing the tokenizer after training the model would produce unpredictable results.\n", + "\n", + "Let's start with the model\n", + "[`distilbert-base-multilingual-cased`](https://huggingface.co/distilbert-base-multilingual-cased).\n", + "As the name implies, this model is cased: it does make a difference between \"english\" and \"English\".\n", + "\n", + "The model is trained on the concatenation of Wikipedia in 104 different languages listed\n", + "[here](https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages).\n", + "The model has 6 layers, 768 dimensions and 12 heads, totalizing 134 million parameters.\n", + "This model is a distilled version of the\n", + "[BERT base multilingual model](https://huggingface.co/bert-base-multilingual-cased)\n", + "which has 177 million parameters.\n", + "On average, the distilled model is twice as fast as the original model.\n", + "\n", + "**If you want to use another model throughout this notebook, please feel free to simply change the following line!**" ] - }, - "metadata": {}, - "output_type": "display_data" - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "[2, 1, 2, 2, 2, 2, 2, 1, 2, 3, 2, 3, 2, 1, 3, 4, 1, 3, 1, 2, 1, 2, 2, 4, 2, 2, 2, 4, 3, 2, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2]\n", - "[1, 0, 1, 1, 1, 1, 1, 0, 1, 2, 1, 2, 1, 0, 2, 2, 0, 2, 0, 1, 0, 1, 1, 2, 1, 1, 1, 2, 2, 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1]\n" - ] - } - ], - "source": [ - "dataset_en = load_from_disk(\"./datasets/dataset_en\")\n", - "dataset_ge = load_from_disk(\"./datasets/dataset_ge\")\n", - "dataset_mx = load_from_disk(\"./datasets/dataset_mx\")\n", - "\n", - "# map number of vehicles to a new column \"labels\"\n", - "labels = [\"1\", \"2\", \"3+\"]\n", - "d = {i: min(i-1, 2) for i in range(1,10)}\n", - "dataset_en = dataset_en.map(lambda x: {\"labels\": d[x[\"NUMTOTV\"]]}) \n", - "dataset_ge = dataset_ge.map(lambda x: {\"labels\": d[x[\"NUMTOTV\"]]})\n", - "dataset_mx = dataset_mx.map(lambda x: {\"labels\": d[x[\"NUMTOTV\"]]})\n", - "print(dataset_en[\"train\"][\"NUMTOTV\"][:40])\n", - "print(dataset_en[\"train\"][\"labels\"][:40])" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Tpr-a2TqWNvp", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "As explained in Section [3.1](#extract_encoding), we will explore two different ways to use encoded texts:\n", - "1. Use the hidden state corresponding to the `CLS` token, which is the first token of the input sequence in BERT models.\n", - "2. *Mean pooling*: Taking the average of the tensors over all elements of the sequence.\n", - "\n", - "Let's start with the first approach by using the feature `cls_hidden_state` produced in Section [3.1](#extract_encoding).\n", - "\n", - "Using the toolbox developed before we fit a dummy classifier and a logistic regression classifier to the features and\n", - "labels of the English dataset." - ] - }, - { - "cell_type": "code", - "execution_count": 31, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 768 - }, - "id": "fnUHw7xVWNvp", - "outputId": "b0a346e9-3c0e-4f59-be6d-8b2fe5be0a72", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Dummy classifier\n", - "accuracy score = 57.2%, log loss = 0.961, Brier loss = 0.574\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.00 0.00 0.00 389\n", - " 2 0.57 1.00 0.73 795\n", - " 3+ 0.00 0.00 0.00 206\n", - "\n", - " accuracy 0.57 1390\n", - " macro avg 0.19 0.33 0.24 1390\n", - "weighted avg 0.33 0.57 0.42 1390\n", - "\n" - ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_dummy", - "format": "svg" + "cell_type": "code", + "execution_count": 20, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 180, + "referenced_widgets": [ + "98b5663a1ddb40c6981d40238ed75f0a", + "cf5434b668cd4c1ea48d50451781aa2c", + "5f51063c060747c29258f3397d95cd41", + "f1f57bc9762a474c8c5f58a1a3382432", + "9f6b3d091fac4b73a7abf40d2330ea8d", + "fbda555247024cd88ba591b185de48b9", + "551c0cda446244f0aee1623fe4de7b71", + "9bfa5a1f66f84deba2e358a2b6cb286b", + "b825b5d945624e7c946f6a0411343f49", + "f2f1d5051b414acd8b940e078f255cdf", + "5aa9ca17b85f4170b7515fca94a27c04", + "9e025774336d41f99202cc8e783f2aa9", + "fda84d00961941af87410431b8f12a63", + "3a6351a4a95b46e6b1b527bb2a62082e", + "530508480403461687b31c9e3c9092d0", + "a3c3f1d46daa46089c29e6367db80e32", + "eb1ad44d35c0469a9f234c159ac8874a", + "455195e642434214baf41acf37e91cf4", + "e70f13f1083845deade56d7911329d53", + "f5c739f99241476990b02cf2630239ef", + "4d748059485244c0bacdcea2f4978d41", + "2f7ede5d9a41405882ad73c0299c129e", + "0a31ec3ef0b042dd8683584ca8c6aec7", + "e9f6a793519c4fb6ae4eeb74752e80ac", + "ee58735741864d3c9bb2cf67bdac6cf7", + "36e0caf7c4c44f46bc96f17ac11464e5", + "5c53b40e78354a6da75ef6dce51fd203", + "05f7ce05e9894d6bb49b5d259328fb9d", + "765d8c6396f448868fae13a882772d7d", + "aa6d0b49af9f45569e9988d38992cbf2", + "7a2e04cb21e342f38852298090a4506f", + "5a94aa5351724f14a53395b48709222f", + "029dc684cefb4c629e7897330a60dec0", + "f152d155899045b48182b775041a6a27", + "0e3d52305d8d4c0f85eb090fe00e5cde", + "6ba99193f9bf4838b35bae8493283a44", + "6c1f962313024cb28cde3bee68f4c9a2", + "3675a709a80d45e8aa9c29183c65f1f9", + "aa5e0dd4211048029a6e6846ae26d91f", + "5d16e5d516d44604974be29732afd396", + "fd7fde3740594e89b5ee68e9bc5d7a13", + "d18d23296a904667ab6a7f85f599e79f", + "085f58f3e0d043f8b5b2831a1e2a1b54", + "fcec0374bfd3446cbc183057a3f8e28f" + ] + }, + "id": "Irl_VYLSWNve", + "outputId": "775f3917-2423-4cf0-b860-22d70b3411e9", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Downloading (…)okenizer_config.json: 0%| | 0.00/29.0 [00:00y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 0, - 389, - 0 - ], - [ - 0, - 795, - 0 - ], - [ - 0, - 206, - 0 + "output_type": "display_data", + "data": { + "text/plain": [ + "Downloading (…)lve/main/config.json: 0%| | 0.00/466 [00:00predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + ], + "source": [ + "model_name = \"distilbert-base-multilingual-cased\"\n", + "\n", + "# load tokenizer\n", + "tokenizer = AutoTokenizer.from_pretrained(model_name)\n", + "print(f\"Tokenizer vocab_size: {tokenizer.vocab_size}\")\n", + "print(f\"Tokenizer model_max_length (maximum context size): {tokenizer.model_max_length}\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "O0vvS4YIWNvf" + }, + "source": [ + "As we can see, the tokenizer has a vocabulary of size 119'547.\n", + "The maximum sequence length of the model is 512 tokens.\n", + "\n", + "To see the tokenizer in action, we tokenize the first sentence of an accident description:" + ] + }, + { + "cell_type": "code", + "execution_count": 21, + "metadata": { + "id": "x8B8xjQMWNvf", + "pycharm": { + "name": "#%%\n" } - } }, - "text/html": [ - "
" + "outputs": [], + "source": [ + "text = \"V1, a 2000 Pontiac Montana minivan, made a left turn from a private driveway onto a northbound 5-lane two-way, dry asphalt roadway on a downhill grade.\"\n", + "result = tokenizer(text)" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# extract the transformer encoding corresponding to the the CLS token\n", - "x_train_en, y_train_en, x_test_en, y_test_en = get_xy(dataset_en, \"cls_hidden_state\", \"labels\")\n", - "\n", - "# fit dummy classifier\n", - "clf_dummy = dummy_classifier(x_train_en, y_train_en)\n", - "_ = evaluate_classifier(y_test_en, None, clf_dummy.predict_proba(x_test_en), labels, \"Dummy classifier\", \"cm_nv_dummy\")" - ] - }, - { - "cell_type": "code", - "execution_count": 32, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 768 }, - "id": "lIzPeTfEWNvq", - "outputId": "97c2cefb-ad14-4732-9113-8d37f523a079", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "Logistic regression (a)\n", - "accuracy score = 90.9%, log loss = 0.275, Brier loss = 0.146\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.94 0.93 0.93 389\n", - " 2 0.89 0.96 0.92 795\n", - " 3+ 0.92 0.68 0.78 206\n", - "\n", - " accuracy 0.91 1390\n", - " macro avg 0.92 0.85 0.88 1390\n", - "weighted avg 0.91 0.91 0.91 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "kIlaAMtDWNvf" + }, + "source": [ + "Calling the tokenizer returns a `BatchEncoding` object,\n", + "which behaves just like a standard Python dictionary that holds input items used by the NP model.\n", + "`input_ids` is the list of token IDs for each token.\n", + "`attention_mask` is a list containing 1 for all elements that corresponds to tokens of the input text,\n", + "and 0 for padding tokens that are appended to attain a specified sequence length.\n", + "\n", + "To illustrate the meaning of the input IDs, we convert them back to token strings:" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_lr_a", - "format": "svg" + "cell_type": "code", + "execution_count": 22, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "qrGAeN6tWNvf", + "outputId": "17c35b1e-5bad-4d72-ccbd-bd838f52e124", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 360, - 29, - 0 - ], - [ - 20, - 763, - 12 - ], - [ - 2, - 64, - 140 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } + "output_type": "stream", + "name": "stdout", + "text": [ + "{'input_ids': [101, 159, 10759, 117, 169, 10180, 23986, 46917, 24408, 25103, 12955, 117, 11019, 169, 12153, 18923, 10188, 169, 14591, 23806, 14132, 31095, 169, 12756, 47755, 126, 118, 23636, 10551, 118, 13170, 117, 36796, 28438, 27015, 15485, 14132, 10135, 169, 12935, 32049, 21958, 119, 102], 'attention_mask': [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]}\n", + "['[CLS]', 'V', '##1', ',', 'a', '2000', 'Pont', '##iac', 'Montana', 'mini', '##van', ',', 'made', 'a', 'left', 'turn', 'from', 'a', 'private', 'drive', '##way', 'onto', 'a', 'north', '##bound', '5', '-', 'lane', 'two', '-', 'way', ',', 'dry', 'asp', '##halt', 'road', '##way', 'on', 'a', 'down', '##hill', 'grade', '.', '[SEP]']\n" ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Logistic regression (a)" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } } - } - }, - "text/html": [ - "
" + ], + "source": [ + "print(result)\n", + "print(tokenizer.convert_ids_to_tokens(result[\"input_ids\"]))" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# fit a classifier to the encoded English texts\n", - "clf_en = logistic_regression_classifier(x_train_en, y_train_en, c=10)\n", - "_ = evaluate_classifier(y_test_en, None, clf_en.predict_proba(x_test_en), labels, \"Logistic regression (a)\", \"cm_nv_lr_a\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "qED73tnMWNvq" - }, - "source": [ - "We obtain an accuracy score of 91%, compared to 57% with the dummy classifier.\n", - "This is already a very good result!\n", - "\n", - "Remember, we have just used the DistilBERT transformer off the shelf, with no tuning whatsoever,\n", - "to extract a vector of length 768 representing the information contained in the accident descriptions.\n", - "During this entire text encoding, the transformer model was unaware that its output was going to be used to predict the number of vehicles.\n", - "\n", - "How about the second approach, which uses the feature `mean_hidden_state` that was extracted\n", - "by mean pooling over the entire encoded sequence?\n", - "\n", - "Let's see:" - ] - }, - { - "cell_type": "code", - "execution_count": 33, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 768 }, - "id": "Vx1LdIg5WNvq", - "outputId": "f40f2287-caaa-4f8a-cd6a-f87df2d9f3e2", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "Logistic regression (b), train EN, test EN\n", - "accuracy score = 96.0%, log loss = 0.127, Brier loss = 0.063\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.96 0.97 0.97 389\n", - " 2 0.95 0.98 0.97 795\n", - " 3+ 0.99 0.86 0.92 206\n", - "\n", - " accuracy 0.96 1390\n", - " macro avg 0.97 0.94 0.95 1390\n", - "weighted avg 0.96 0.96 0.96 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "6iRVhlrDWNvf", + "pycharm": { + "name": "#%% md\n" + } + }, + "source": [ + "We observe that words like \"V1\", \"Pontiac\", \"minivan\", \"driveway\" etc. are split into multiple tokens each.\n", + "This is typical for WordPiece tokenization adopted by BERT, an approach designed to reduce vocabulary size.\n", + "This tokenizer marks sub-words by the prefix `##`.\n", + "\n", + "It is interesting to note that `2000` is a separate element of the vocabulary.\n", + "\n", + "The first and last tokens of the tokenized sequence are `CLS` and `SEP`, respectively.\n", + "* `CLS` stands for \"classification\".\n", + "The output of the BERT encoder corresponding to this input token is sometimes interpreted to represent the meaning of\n", + "the entire sequence (we will check this in [Section 3.2](#classification) of this notebook).\n", + "* `SEP` stands for \"separation\".\n", + "In next-sequence prediction tasks, it is used to separate the first from the second sequence.\n", + "\n", + "Here is a list of other special tokens used by the BERT tokenizer:\n", + "* The `UNK` token is used to represent tokens that are not available in the dictionary.\n", + "* The `PAD` token is used to pad the length of the tokenized sequence to a fixed length.\n", + "A fixed length is required when multiple sequences of different length are tokenized and fed into a BERT model\n", + "at the same time.\n", + "* The `MASK` token is used for pre-training the BERT model by masked language modeling.\n", + "For this task, the model is used to predict the masked token." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_EN_EN", - "format": "svg" + "cell_type": "code", + "execution_count": 23, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "e7HqEAAUWNvg", + "outputId": "7bddf89d-104e-4bd0-e6b1-b2d3d5455408", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 379, - 10, - 0 - ], - [ - 15, - 778, - 2 - ], - [ - 1, - 28, - 177 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } + "output_type": "stream", + "name": "stdout", + "text": [ + "Tokenizer special_tokens_map: {'unk_token': '[UNK]', 'sep_token': '[SEP]', 'pad_token': '[PAD]', 'cls_token': '[CLS]', 'mask_token': '[MASK]'}\n" ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Logistic regression (b), train EN, test EN" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } } - } - }, - "text/html": [ - "
" + ], + "source": [ + "print(f\"Tokenizer special_tokens_map: {tokenizer.special_tokens_map}\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "x_train_en, y_train_en, x_test_en, y_test_en = get_xy(dataset_en, \"mean_hidden_state\", \"labels\")\n", - "clf_en = logistic_regression_classifier(x_train_en, y_train_en, c=10)\n", - "_ = evaluate_classifier(y_test_en, None, clf_en.predict_proba(x_test_en), labels, \"Logistic regression (b), train EN, test EN\", \"cm_nv_EN_EN\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "SB0K-NinWNvq" - }, - "source": [ - "Again, we have used DistilBERT without any fine-tuning.\n", - "\n", - "For the present task, by any of the considered scores, mean pooling performs much better than using the encoding of the `CLS` token.\n", - "For this reason, we use mean pooling in what follows.\n", - "\n", - "What would you guess - will the classifier model exhibit a similar performance when trained on the encoded German dataset?\n", - "\n", - "Let's check:" - ] - }, - { - "cell_type": "code", - "execution_count": 34, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 768 }, - "id": "oLaoeTQgWNvr", - "outputId": "578b6a8b-d8c8-4a90-c760-2268d7f985e4", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "train GE, test GE\n", - "accuracy score = 96.0%, log loss = 0.120, Brier loss = 0.062\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.97 0.98 0.97 389\n", - " 2 0.95 0.98 0.97 795\n", - " 3+ 0.96 0.86 0.91 206\n", - "\n", - " accuracy 0.96 1390\n", - " macro avg 0.96 0.94 0.95 1390\n", - "weighted avg 0.96 0.96 0.96 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "PwVPgPCJWNvg" + }, + "source": [ + "It is instructive to look at the tokenization of the German translation of the same text:" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_GE_GE", - "format": "svg" + "cell_type": "code", + "execution_count": 24, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "6r2vF-hyWNvg", + "outputId": "9f7cb543-aaaa-4073-eb94-d0cd054bcbcf", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 380, - 9, - 0 - ], - [ - 10, - 778, - 7 - ], - [ - 1, - 28, - 177 + "output_type": "stream", + "name": "stdout", + "text": [ + "{'input_ids': [101, 159, 10759, 117, 10290, 32930, 12955, 10118, 73879, 23986, 46917, 24408, 10441, 10268, 11218, 10180, 117, 66298, 10166, 10599, 73655, 12210, 25131, 10496, 23608, 10329, 10359, 11615, 54609, 13091, 10525, 117, 42169, 21181, 10112, 10882, 37590, 72847, 43968, 10221, 126, 44271, 16757, 54609, 30064, 10106, 28253, 10165, 20139, 10130, 10745, 144, 16822, 38064, 11357, 119, 102], 'attention_mask': [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]}\n", + "['[CLS]', 'V', '##1', ',', 'ein', 'Mini', '##van', 'der', 'Marke', 'Pont', '##iac', 'Montana', 'aus', 'dem', 'Jahr', '2000', ',', 'bog', 'von', 'einer', 'privaten', 'Ein', '##fahrt', 'nach', 'links', 'auf', 'eine', 'zwei', '##sp', '##uri', '##ge', ',', 'tro', '##cken', '##e', 'As', '##pha', '##lts', '##traße', 'mit', '5', 'Fa', '##hr', '##sp', '##uren', 'in', 'nördlich', '##er', 'Richtung', 'und', 'einem', 'G', '##ef', '##älle', 'ab', '.', '[SEP]']\n" ] - ] } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" + ], + "source": [ + "text = \"V1, ein Minivan der Marke Pontiac Montana aus dem Jahr 2000, bog von einer privaten Einfahrt nach links auf eine zweispurige, trockene Asphaltstraße mit 5 Fahrspuren in nördlicher Richtung und einem Gefälle ab.\"\n", + "result = tokenizer(text)\n", + "print(result)\n", + "print(tokenizer.convert_ids_to_tokens(result[\"input_ids\"]))" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "wGEujP4IWNvg" + }, + "source": [ + "Tokenizers of multi-lingual models use the same vocabulary for all languages.\n", + "Obviously, the tokenizer simply splits the input string into pieces and does not perform any translation:\n", + "the English pronoun \"a\" (169) is a different token than the equivalent German \"ein\" (10290).\n", + "\n", + "We observe that the tokenizer is case-sensitive:\n", + "It differentiates between the tokens `mini` (25103) and `Mini` (32930).\n", + "\n", + "So far, we have tokenized single sentences only.\n", + "Next, we want to tokenize the entire dataset.\n", + "This is easily achieved by applying the `map` function to the dataset.\n", + "\n", + "All we need to provide to the `map` function is a function that takes a record or a batch of records from the dataset,\n", + "applies an operation to it, and returns a `DataSet` or a `dict` which defines the columns to be added or updated.\n", + "\n", + "In our case, we supply a function that calls the `tokenizer` as shown before.\n", + "As we have seen, calling the tokenizer returns a dict with the keys `input_ids` and `attention_mask`.\n", + "Therefore, the `map` function will add columns with these names to the original dataset.\n", + "\n", + "Since we plan to feed the tokenized sequences into a transformer model,\n", + "we need to truncate their length to the maximum length accepted by the transformer.\n", + "Moreover, the shorter sequences need to be padded at the end, so that all tokenized sequences have the same length.\n", + "\n", + "Overall, only a few lines of code are required to complete the tokenization:" + ] + }, + { + "cell_type": "code", + "execution_count": 25, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 98, + "referenced_widgets": [ + "7ce0b5785c2448cea7d0d1f1a87ebc2d", + "89e3a11241384650b8965245dbd3792c", + "a34a732dd35742e4a4824c8d8a3ad802", + "df639efa669d4f79aacb986358d51ce3", + "348702e795c84a73962c96b921e50717", + "edb157f92e984a01a21ae2b06f3498ab", + "9999a4e4578d41b2a26ed13be0828f9f", + "e9958a996eed4d56b4ba278d1d0636d6", + "eaf861a0c98d40be96de756da12c5c8a", + "00c02c2cc2784e42b04c439efd858d6e", + "5ae6713d303d4e8cb40d1bb8193d2808", + "2ff3aa3cbc084b018e532313e3a62868", + "df5bdc4dbbc24f518a9b6a729b0e4465", + "8190c12611bd4b1181d109f8b266d12e", + "fbcc9f281d42422f8c584dbc7248cf25", + "d82ebc1918b04278aaa7a3424876d512", + "215db69430ac4835b14a0208ee8e4c2a", + "f6a251a9d3a8407b9bd5bdd849ce3e7e", + "791078cacb4740fabdaf8eae3b5bb7f1", + "8906283631694146b18824265be2b6f6", + "bad4ae381c224f108ace413c9af946b0", + "34063b2bc88a4ae7a965d1d882104b32" ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train GE, test GE" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + }, + "id": "JVZoXdpWWNvh", + "outputId": "38ccfac1-b504-4cac-a0c3-3ed5574d6092", + "pycharm": { + "name": "#%%\n" } - } }, - "text/html": [ - "
" + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Map: 0%| | 0/5559 [00:00\n", - "\n", - "### 3.4. Cross-Lingual Transfer\n", - "\n", - "In practice, it might happen that training data is available (predominantly) in one language,\n", - "but we would like to apply the model to test data in another language.\n", - "Translating the test data to the language of the training data would be an option,\n", - "but let's see how the multilingual transformer model performs.\n", - "\n", - "In our small experiment, we simply switch the languages of the test sets.\n", - "This might be hard for the models, since in the entire training process each model has seen only encoded input\n", - "from text samples in one language!\n", - "\n", - "First, use the German test set for the model trained on English input:" - ] - }, - { - "cell_type": "code", - "execution_count": 35, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 768 }, - "id": "247Aj4I5WNvr", - "outputId": "329569ba-d582-47aa-af64-4b398356935f", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "train EN, test GE\n", - "accuracy score = 66.0%, log loss = 1.083, Brier loss = 0.527\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 1.00 0.16 0.27 389\n", - " 2 0.67 0.86 0.75 795\n", - " 3+ 0.57 0.85 0.68 206\n", - "\n", - " accuracy 0.66 1390\n", - " macro avg 0.75 0.62 0.57 1390\n", - "weighted avg 0.75 0.66 0.61 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "GUQ2SaowWNvh" + }, + "source": [ + "The additional argument `column` is passed to `tokenize` via the the dictionary `fn_kwargs`.\n", + "As we can see from the progress bars, the map function gets called twice - once for each split.\n", + "As expected, new columns `input_ids` and `attention_mask` have been added to the dataset.\n", + "\n", + "We repeat the same procedure for the German texts." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_EN_GE", - "format": "svg" + "cell_type": "code", + "execution_count": 26, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 81, + "referenced_widgets": [ + "9c43faef3dbd4919b84622bf311a055f", + "8940ed6274f1413cb57b9823131be494", + "c2fdcaeb805f41a9aafad35cee5f0d4e", + "f1dcb8ed4eeb470fb6802d72fdfaab5a", + "3d0f159182e3457492d6f1b70d6f04c2", + "b287cbb03a264654968d10d85d32e365", + "7e761125a9684685b8b845bbab01b297", + "bf1053a919fb47aebc4971c1b86fcab8", + "c5799a3b73464728afc0f23b2b25188a", + "791c1687dc4b47928e8075658f238f7b", + "1814292c69d34a758378760127308ef9", + "010ec2102cb64726b037d15a26a88b65", + "b200a63fc8d24eafb67958aea139b90f", + "6008d614d11c4120add33abdb91a8985", + "df0d33aaf9a54f1fbdd0f785cb6ca7c6", + "557d06369ad04c63aec623d8fc1fa218", + "607fd46718fa41dfacdbc6341623c8e8", + "f61c59bab83a442c87d5f2e16ded8f1d", + "8eb37a97384a4b6f811f51b4de9c9a32", + "449fb956db964fa98a6a1c8b530fd218", + "baef974696724608a22aca48f4b9c846", + "b2c3a629122d454dafea780c3722666f" + ] + }, + "id": "v6O4XM7vWNvh", + "outputId": "c2862cbf-281b-4b6a-f548-dd9146d69610", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 62, - 310, - 17 - ], - [ - 0, - 680, - 115 - ], - [ - 0, - 31, - 175 - ] - ] + "output_type": "display_data", + "data": { + "text/plain": [ + "Map: 0%| | 0/5559 [00:00predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + }, + "id": "J_Mve0bUWNvh", + "outputId": "da7de7c3-5beb-49e9-a9c3-b7d4f9676c44" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Map: 0%| | 0/5559 [00:00
" + "source": [ + "Now we have created three datasets - with the tokenized English, German and mixed language texts, respectively.\n", + "\n", + "We could have stored the results in a single dataset (with different column names),\n", + "but keeping languages separately will make it easier to convince ourselves in the following examples\n", + "that the languages have not been mixed up!" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "_ = evaluate_classifier(y_test_ge, None, clf_en.predict_proba(x_test_ge), labels, \"train EN, test GE\", \"cm_nv_EN_GE\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "rQQ0Ql2bWNvr" - }, - "source": [ - "From these rather poor results, we conclude that this approach to cross-language transferability does not work.\n", - "\n", - "Vice versa, use the English test set for the model based on German input:" - ] - }, - { - "cell_type": "code", - "execution_count": 36, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 768 }, - "id": "j90XLzGZWNvr", - "outputId": "31d2d902-e336-42e2-807e-2f2d77ba5257", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "train GE, test EN\n", - "accuracy score = 24.3%, log loss = 8.053, Brier loss = 1.361\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.00 0.00 0.00 389\n", - " 2 0.40 0.17 0.24 795\n", - " 3+ 0.19 0.99 0.32 206\n", - "\n", - " accuracy 0.24 1390\n", - " macro avg 0.20 0.39 0.19 1390\n", - "weighted avg 0.26 0.24 0.18 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "CMoSQ04TWNvi" + }, + "source": [ + "\n", + "\n", + "### 2.3. Transformer model\n", + "\n", + "After completing the tokenization of the raw texts, we are ready to apply the transformer model,\n", + "in our case the multilingual DistilBERT model.\n", + "\n", + "First, we load the model.\n", + "To speed up the following calculations, we opt for GPU support if available.\n" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_GE_EN", - "format": "svg" + "cell_type": "code", + "execution_count": 28, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 49, + "referenced_widgets": [ + "8f0d224cfe294944a7bd161d995d7bda", + "42f3a829c2fb45749368dbee5e490a35", + "867649fd4e3341ab9ce5a6926b10ce78", + "433519f7276b4fddb38e862c414df5fd", + "5b80083779a54d34954d8af7a8a9fcd6", + "f3e243c3c2224641babb7629a42f0248", + "2f6e3c1bab9b43d49976e890255d7c28", + "3cf4034994f24ca6be2a1a24ded77627", + "b98d787fb58d4c00b277999cb4e81a6d", + "5fac8e3703a54610a862d115063debdd", + "8579b0149f574b36bcf9641481e2f834" + ] + }, + "id": "-iKVTkH_WNvi", + "outputId": "e4888dba-ef62-415c-ad31-e184259857c8", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 0, - 201, - 188 - ], - [ - 0, - 135, - 660 - ], - [ - 0, - 3, - 203 - ] - ] + "output_type": "display_data", + "data": { + "text/plain": [ + "Downloading model.safetensors: 0%| | 0.00/542M [00:00predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {}, + "execution_count": 29 + } + ], + "source": [ + "model" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "X3lhtdAsWNvj", + "pycharm": { + "name": "#%% md\n" } - } }, - "text/html": [ - "
" + "source": [ + "As we can see, the first block of the model deals with embeddings, with the word embedding as the first layer.\n", + "This is followed by the transformer which consists of 6 transformer blocks.\n", + "\n", + "Let's first explore the word embedding.\n", + "\n", + "The goal of the word embedding layer is to assign each element of the vocabulary a vector of length $E$.\n", + "\n", + "The multilingual DistilBERT model has a vocabulary of size $V=119'547$ and a word embedding size of $E=768$.\n", + "We can confirm this by looking at the dimension of the word embedding weight tensor:" + ] + }, + { + "cell_type": "code", + "execution_count": 30, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "k9yHSGD0WNvj", + "outputId": "261e9e7a-f773-4546-c22b-f5453aaf10da" + }, + "outputs": [ + { + "output_type": "execute_result", + "data": { + "text/plain": [ + "Embedding(119547, 768, padding_idx=0)" + ] + }, + "metadata": {}, + "execution_count": 30 + } + ], + "source": [ + "model.embeddings.word_embeddings" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "_ = evaluate_classifier(y_test_en, None, clf_ge.predict_proba(x_test_en), labels, \"train GE, test EN\", \"cm_nv_GE_EN\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "5FFjmHzBWNvs" - }, - "source": [ - "Again, performance is unsatisfactory.\n", - "\n", - "To improve results, we need to change the approach.\n", - "\n", - "\n", - "\n", - "\n", - "### 3.5. Multi-Lingual Training\n", - "\n", - "In a multilingual situation, a possible approach is to train the classifier with a training set consisting\n", - "of encoded samples from both languages.\n", - "This can always be achieved by translating a fraction of the text data and then use it to train the model.\n", - "\n", - "This is exactly what we are going to do next.\n", - "In order to simulate a situation where one language is underrepresented, we create a mixed-language dataset\n", - "with about 80% English and 20% German samples, our dataset `dataset_mx` produced in [Section 2.2](#tokenize).\n", - "\n", - "Since we are already using a multilingual transformer model, no further changes are required." - ] - }, - { - "cell_type": "code", - "execution_count": 37, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000 }, - "id": "BdCe6OIDWNvs", - "outputId": "32fe4681-c6e7-401a-91e7-fc0862159c3d", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "train EN/GE, test EN\n", - "accuracy score = 95.7%, log loss = 0.136, Brier loss = 0.068\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.96 0.98 0.97 389\n", - " 2 0.95 0.97 0.96 795\n", - " 3+ 0.97 0.85 0.90 206\n", - "\n", - " accuracy 0.96 1390\n", - " macro avg 0.96 0.93 0.95 1390\n", - "weighted avg 0.96 0.96 0.96 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "zPHwjjcAWNvj" + }, + "source": [ + "To see the outputs of the transformer encoder, let's apply the transformer to the first record of the dataset,\n", + "more precisely to its columns `input_ids` and `attention_mask`, the outputs of the tokenizer:" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_MX_EN", - "format": "svg" + "cell_type": "code", + "execution_count": 31, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "S7E9tRVZWNvk", + "outputId": "a44caa27-b257-4f48-a0e7-97719e3a3ed2", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 380, - 9, - 0 - ], - [ - 14, - 775, - 6 - ], - [ - 1, - 30, - 175 + "output_type": "stream", + "name": "stdout", + "text": [ + "BaseModelOutput(last_hidden_state=tensor([[[ 0.1148, -0.0254, 0.1447, ..., 0.1937, 0.0804, -0.2158],\n", + " [ 0.1216, -0.5199, 0.6924, ..., 0.2711, -0.2492, -0.0172],\n", + " [-0.4065, -0.0786, 0.3362, ..., -0.2183, 0.0278, 0.1635],\n", + " ...,\n", + " [-0.1276, -0.4791, -0.1539, ..., 0.0442, -0.2272, 0.1089],\n", + " [-0.1577, -0.4097, -0.2176, ..., 0.0154, -0.2008, -0.1374],\n", + " [-0.1855, -0.4261, -0.1884, ..., -0.0515, -0.0600, -0.3426]]],\n", + " device='cuda:0'), hidden_states=None, attentions=None)\n" ] - ] } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" + ], + "source": [ + "example = dataset_en[\"train\"][:1]\n", + "\n", + "input_ids = torch.tensor(example[\"input_ids\"]).to(device)\n", + "attention_mask = torch.tensor(example[\"attention_mask\"]).to(device)\n", + "with torch.no_grad():\n", + " output = model(input_ids, attention_mask)\n", + "print(output)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "U9cBNUetWNvk", + "pycharm": { + "name": "#%% md\n" + } + }, + "source": [ + "This produces a `BaseModelOutput` object which has a named property `last_hidden_state`,\n", + "a tensor that represents the hidden state of the final transformer block, i.e. the encoded text sequence!\n", + "\n", + "The dimension of the last hidden state is:" + ] + }, + { + "cell_type": "code", + "execution_count": 32, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "hkenZ_7pWNvk", + "outputId": "e5520d4d-178a-4ba8-a65b-710ba68e39e7", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "dimensions of last hidden state: torch.Size([1, 512, 768])\n" ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train EN/GE, test EN" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } } - } - }, - "text/html": [ - "
" + ], + "source": [ + "print(\"dimensions of last hidden state: \", output.last_hidden_state.size())" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stdout", - "output_type": "stream", - "text": [ - "train EN/GE, test GE\n", - "accuracy score = 95.2%, log loss = 0.160, Brier loss = 0.080\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.96 0.97 0.97 389\n", - " 2 0.95 0.97 0.96 795\n", - " 3+ 0.94 0.85 0.90 206\n", - "\n", - " accuracy 0.95 1390\n", - " macro avg 0.95 0.93 0.94 1390\n", - "weighted avg 0.95 0.95 0.95 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "ImR3xLwLWNvl" + }, + "source": [ + "i.e., \\[number of samples (1), sequence length $T$ (maximum 512 tokens), embedding size $E$ (768)\\].\n", + "\n", + "In what follows, we will use the information contained in this tensor to make predictions.\n" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_MX_GE", - "format": "svg" - } - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 379, - 10, - 0 - ], - [ - 16, - 768, - 11 - ], - [ - 1, - 29, - 176 - ] - ] + "cell_type": "markdown", + "metadata": { + "id": "4D2hUjC1WNvl", + "pycharm": { + "name": "#%% md\n" } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train EN/GE, test GE" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + }, + "source": [ + "\n", + "\n", + "## 3. Using Transformers to Extract Features for Classification or Regression Tasks\n", + "\n", + "In this section you will learn how transformers can be used to extract features from text data for a classification\n", + "or regression problem.\n", + "\n", + "The idea is simple: The tokenized raw text data is encoded by the transformer model,\n", + "and the features are extracted from the last hidden state.\n" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "yowxi5sPWNvl" + }, + "source": [ + "\n", + "\n", + "### 3.1. Extracting the Encoded Text\n", + "\n", + "Before we have seen that the DistilBERT model encodes *each token* of each input sample into a tensor\n", + "of length $E=768$.\n", + "As such, the output of the transformer model depends on the length of the input sequences.\n", + "To make predictions, we would prefer having a single vector per input sample, independent of the sequence length.\n", + "\n", + "Different approaches are available to achieve this goal:\n", + "* Use the tensor corresponding to the `CLS` token, which is the first token of the input sequence in BERT models.\n", + "* *Mean pooling*: Taking the average of the tensors over all elements of the sequence.\n", + " Here, the tensors corresponding to a `PAD` token should be excluded because they don't carry any information.\n", + "\n", + "We will implement both techniques and compare results.\n", + "\n", + "In the following cell we display a short function which applies the NLP model to a batch of encoded input samples,\n", + "extracts the last hidden state, and returns two tensors of length 768 for each input sample,\n", + "corresponding to the two methods explained before.\n", + "\n", + "The cell is not executable, because the function is already defined in the module `tutorial_utils` we imported initially." + ] + }, + { + "cell_type": "raw", + "metadata": { + "id": "b31jpyUBWNvl", + "pycharm": { + "name": "#%%\n" } - } }, - "text/html": [ - "
" + "source": [ + "```\n", + "def extract_sequence_encoding(batch, model):\n", + " input_ids = torch.tensor(batch[\"input_ids\"]).to(model.device)\n", + " attention_mask = torch.tensor(batch[\"attention_mask\"]).to(model.device)\n", + " with torch.no_grad():\n", + " # apply transformer model and extract last hidden state\n", + " model_output = model(input_ids, attention_mask)\n", + " last_hidden_state = model_output.last_hidden_state\n", + "\n", + " # extract the tensor corresponding to the CLS token, i.e. the first element in the encoded sequence\n", + " batch[\"cls_hidden_state\"] = last_hidden_state[:,0,:].cpu().numpy()\n", + "\n", + " # mean pooling: take average over input sequence, but mask sequence elements corresponding to the PAD token\n", + " last_hidden_state = last_hidden_state.cpu().numpy()\n", + " lhs_shape = last_hidden_state.shape\n", + " boolean_mask = ~np.array(batch[\"attention_mask\"]).astype(bool)\n", + " boolean_mask = np.repeat(boolean_mask, lhs_shape[-1], axis=-1)\n", + " boolean_mask = boolean_mask.reshape(lhs_shape)\n", + " masked_mean = np.ma.array(last_hidden_state, mask=boolean_mask).mean(axis=1)\n", + " batch[\"mean_hidden_state\"] = masked_mean.data\n", + " return batch\n", + "```" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "x_train_mx, y_train_mx, x_test_mx, y_test_mx = get_xy(dataset_mx, \"mean_hidden_state\", \"labels\")\n", - "clf_mx = logistic_regression_classifier(x_train_mx, y_train_mx, c=10)\n", - "_ = evaluate_classifier(y_test_en, None, clf_mx.predict_proba(x_test_en), labels, \"train EN/GE, test EN\", \"cm_nv_MX_EN\")\n", - "_ = evaluate_classifier(y_test_ge, None, clf_mx.predict_proba(x_test_ge), labels, \"train EN/GE, test GE\", \"cm_nv_MX_GE\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "0Ew5aqySWNvs" - }, - "source": [ - "This is a very good outcome. The scores are close to those achieved in the situation with a single-language!\n", - "\n", - "To conclude, a multi-lingual situation can be handled by a multi-lingual transformer model. For the best performance, the classifier should be trained on the encoded sequences from all languages." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "C_CEp4ShWNvs", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "\n", - "\n", - "## 4. Fine-Tuning – Improving the Model\n", - "\n", - "In the previous case study, we have used the DistilBERT model without any adaptation to the text data at hand,\n", - "simply by using the sequence encoding produced by the model.\n", - "As such, the language representation, which the model has learned from a large corpus of multilingual data, is transferred\n", - "to the text data at hand.\n", - "This approach is called transfer learning.\n", - "The advantage of transfer learning is that a powerful (but relatively complex) model can be trained on a large corpus\n", - "of data, using large-scale computing power, and then be applied to situations where availability of data or computing\n", - "power would not allow for such complex models.\n", - "\n", - "For the task at hand, the results are already very good.\n", - "However, in certain situations it might be required to further improve model performance.\n", - "\n", - "In the following sections you will learn how to fine-tune a transformer model.\n", - "We will explore two approaches to fine-tuning:\n", - "\n", - "* *Domain-specific fine-tuning* involves updating the parameters of the transformer model using text data which is\n", - " relevant to the domain where the model will be applied.\n", - " However, the model is not necessarily tuned for a specific downstream task of interest.\n", - "* *Task-specific fine-tuning* uses domain-specific text data and tunes the parameters of the transformer model\n", - " while training it for a given downstream task of interest.\n", - "\n", - "The advantage of the first approach is that it can be performed in an unsupervised fashion,\n", - "i.e., it does not require labeled data.\n", - "\n", - "On the other hand, task-specific fine-tuning is expected to produce better performance on the particular task\n", - "which the model was tuned for, so it might be the method of choice if there is a single down-stream task\n", - "and sufficient labeled data.\n", - "\n", - "Let's explore these two fine-tuning approaches in turn." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "I1pU2x-JWNvs" - }, - "source": [ - "\n", - "\n", - "### 4.1. Domain-specific fine-tuning\n", - "\n", - "Domain-specific fine-tuning can be achieved by applying the model to a \"masked language modeling\" task.\n", - "This involves taking a sentence, randomly masking a certain percentage of the words in the input,\n", - "and then running the entire masked sentence through the model which has to predict the masked words.\n", - "This self-supervised approach is an automatic process to generate inputs and labels from the texts and does not require\n", - "any humans labelling in any way.\n", - "\n", - "This is very easy to implement using the Transformers library.\n", - "You will see three new elements of the Transformer library in action:\n", - "\n", - "* the `AutoModelForMaskedLM` class loads the DistilBERT model with a model head suitable for the masked language\n", - " modeling task.\n", - "* The `DataCollatorForLanguageModeling` class forms training batches from the dataset and handles the masking.\n", - "* The `Trainer` class provides the interface to train the model.\n", - "\n", - "Depending on the hardware available, training might take a rather long time.\n", - "Therefore, if available, we use GPU support.\n", - "On an AWS EC2 p2.xlarge instance, the run time is about 55 minutes.\n", - "We store the trained model for later use.\n", - "\n", - "If you do not have enough time to perform this step right now, you can skip this section and return later. The remainder of this notebook does not depend on it." - ] - }, - { - "cell_type": "code", - "execution_count": 38, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 530 }, - "id": "R5-TPov4WNvt", - "outputId": "8e6828ea-0fbb-475d-abbe-e821528896a8", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "The following columns in the training set don't have a corresponding argument in `DistilBertForMaskedLM.forward` and have been ignored: WEATHER7, WEATHER4, SUMMARY_GE, cls_hidden_state, WEATHER1, WEATHER6, SUMMARY_MX, INJSEVA, SCASEID, mean_hidden_state, NUMTOTV, WEATHER8, SUMMARY_EN, WEATHER3, index, words per case summary, WEATHER2, INJSEVB, level_0, WEATHER5. If WEATHER7, WEATHER4, SUMMARY_GE, cls_hidden_state, WEATHER1, WEATHER6, SUMMARY_MX, INJSEVA, SCASEID, mean_hidden_state, NUMTOTV, WEATHER8, SUMMARY_EN, WEATHER3, index, words per case summary, WEATHER2, INJSEVB, level_0, WEATHER5 are not expected by `DistilBertForMaskedLM.forward`, you can safely ignore this message.\n", - "/home/ubuntu/anaconda3/envs/pytorch_latest_p37/lib/python3.7/site-packages/transformers/optimization.py:309: FutureWarning:\n", - "\n", - "This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning\n", - "\n", - "***** Running training *****\n", - " Num examples = 5559\n", - " Num Epochs = 2\n", - " Instantaneous batch size per device = 4\n", - " Total train batch size (w. parallel, distributed & accumulation) = 4\n", - " Gradient Accumulation steps = 1\n", - " Total optimization steps = 2780\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "ikSaZs83WNvm" + }, + "source": [ + "Let's apply this function to the first sample of the training data:" + ] }, { - "data": { - "text/html": [ - "\n", - "
\n", - " \n", - " \n", - " [2780/2780 08:20, Epoch 2/2]\n", - "
\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
StepTraining Loss
5001.414500
10001.119100
15001.020200
20000.938100
25000.877800

" + "cell_type": "code", + "execution_count": 33, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "n8tYVkL4WNvn", + "outputId": "9d67c353-eeb2-4558-f6a3-99de7c2d7b99", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "dict_keys(['level_0', 'index', 'SCASEID', 'SUMMARY_EN', 'SUMMARY_GE', 'INJSEVA', 'NUMTOTV', 'WEATHER1', 'WEATHER2', 'WEATHER3', 'WEATHER4', 'WEATHER5', 'WEATHER6', 'WEATHER7', 'WEATHER8', 'INJSEVB', 'words per case summary', 'input_ids', 'attention_mask', 'cls_hidden_state', 'mean_hidden_state'])\n" + ] + } ], - "text/plain": [ - "" + "source": [ + "example = dataset_en[\"train\"][:1]\n", + "result = extract_sequence_encoding(example, model)\n", + "print(result.keys())" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stderr", - "output_type": "stream", - "text": [ - "\n", - "\n", - "Training completed. Do not forget to share your model on huggingface.co/models =)\n", - "\n", - "\n", - "Saving model checkpoint to models/distilbert-base-multilingual-cased_mlm\n", - "Configuration saved in models/distilbert-base-multilingual-cased_mlm/config.json\n", - "Model weights saved in models/distilbert-base-multilingual-cased_mlm/pytorch_model.bin\n" - ] - } - ], - "source": [ - "# load model and tokenizer and define the DataCollator\n", - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model \n", - "model_mlm = AutoModelForMaskedLM.from_pretrained(model_name).to(device)\n", - "tokenizer = AutoTokenizer.from_pretrained(model_name)\n", - "data_collator = DataCollatorForLanguageModeling(tokenizer=tokenizer, mlm=True, mlm_probability=0.15)\n", - "dataset_mx = load_from_disk(\"./datasets/dataset_mx\")\n", - "\n", - "# define training arguments\n", - "training_args = TrainingArguments(\n", - " output_dir=\"models/\" + model_name + \"_mlm_epochs\",\n", - " overwrite_output_dir=True,\n", - " num_train_epochs=2,\n", - " per_device_train_batch_size=4,\n", - " save_strategy=trainer_utils.IntervalStrategy.NO,\n", - ")\n", - "trainer = Trainer(\n", - " model=model_mlm,\n", - " args=training_args,\n", - " data_collator=data_collator,\n", - " train_dataset=dataset_mx[\"train\"]\n", - ")\n", - "trainer.train()\n", - "trainer.save_model(\"models/\" + model_name + \"_mlm\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "n8if8dfPWNvt" - }, - "source": [ - "Now, `model_mlm` holds the DistilBERT model, fine-tuned to the mixed-language accident descriptions\n", - "using masked-language-modeling.\n", - "\n", - "Next, we apply this model to all input sequences and extract the last hidden state.\n", - "The procedure is the same as in section [3.1](#extract_encoding).\n", - "To avoid confusion, we create new datasets, and store them on disk for later use,\n", - "so that this step does not need to be repeated all over when this notebook is re-run." - ] - }, - { - "cell_type": "code", - "execution_count": 39, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 782, - "referenced_widgets": [ - "b830796e9a7b4b51872e5e133ffd6385", - "9894bc1c506d4cdd829de89303aba5dd", - "995c886eb30b402dab3075d8172e9a42", - "3fb8621386ab443c8fdbac113695a033", - "0eb299bd75f24074bdf56f83cf128964", - "174e6e93f84d481f90ac2e37c0874ded", - "c6eda87cd5854a4fbf29e92598db7ce8", - "ceed53741c6b4fb6ad06a24e931bbc25", - "a4dc6b9ab25a41f393f007d05a4ace6e", - "8715c68bc26f4815a6644aa6573f0765", - "e640a164272c486ab9b3fb0d9f3848ba", - "456b7d4baa2c427a96831b081843bb6d", - "c04c80a33b3b4e03bf7641f53f24c08e", - "1eeaf4e87c944989ade794ccfe98424e", - "ef477427275a4b07b3c00a85e73dfdf4", - "08572971e55140b28147066fbb7828fd", - "f4fcea01a9694d64b2a3d81e3347db4d", - "8787bad12eba4ced80f770dbd028e500", - "a4df33335f0c4a888a67baa8611d6ef6", - "7559f44cafa0438b8fb90ed5f5573406", - "ee77df6293664a51bc6c0580fd2b8e2c", - "7cc76a2a5a70454d81ac2153aed7498b", - "6d01fecfaa764097991c334de8a85e7d", - "59abb7ecd3924913bd7084138cc4c7c3", - "4c6346ccc35148df8790a4f48f6949dd", - "675d8962e93a41389baa051168a6c28e", - "473eeeedd3b14a348af13eed50af826c", - "34d2be270be84cb79a75315c4b11041b", - "8b341bbf1518496eb707aba6263b523c", - "96314a4ceeae470d9c26965c56d3490e", - "d7f43494330348f79161842b68658325", - "5d350041565f42cd93fc6fd9f2d243ce", - "6b2c065c4f0640f3a994f40728ad5938", - "d2b44643fe8948eeaf21eef08ded9fed", - "e8d26f87aec1422b8d4da624a34fb05d", - "93f90634559347f4b4fce4f7ca390dcf", - "13503be2fdf246e9a30950aa0c2d09f8", - "e114366faf864294a333be4bf1dbe834", - "3d14bc34a374496c9b3ac127aca7cc40", - "ac0b73c4cd9b429281384a6fe8cb24e0", - "c59b01390fa2453585b5463adcad6fc4", - "9ebb0d96722140c0a84c12996bb2d0b8", - "cc775b0ea3e1413aadeaf96faedc3aa0", - "089d11c10a90488fa0e2bae2d30db364", - "6e2e75bcc4bd4007b1144f6184c11dcc", - "1f4c163682a24e8386474e0691289196", - "d50fc7e0a2444d24a8c9027953cc965f", - "9ab237cdfad847f3bb05b724b1f84ccd", - "a6e376972605447b87958296183f6e3a", - "af86f2f0f0f1404da3be037467a04ad7", - "b513367b741f446a99d50e15527428ab", - "4aec86337b92412f8fae2380f4f0ebbb", - "6c16e528db4d4795bad8ed6e52e2c6fb", - "55e3cfb117a146fba4648576dac8dd43", - "93ecb5d4179d4d60923bc03f3db1bb39", - "aeffe4c1a7fc402b89c89f836d7e3666", - "1163753548f74cf49ed4dbdb6fe7c590", - "107422e02ead438c8450a25165f850e8", - "9871f24a7bfd40a5851e246921a4a0ea", - "37e246298d2a459ca3ed31d5c81cf5fd", - "c4968307f9dc4c64b016a7944f5179c1", - "bf7bf86c9a364966a3188685888f9742", - "f99c9ddacd6d4429890e7e86c9b372ae", - "c3171dd2f43040749bb37f0581cce1f0", - "b48a4e7bebbb48698de3cba03407c6a2", - "e88e61a013df46068de3c0196644cab0" - ] + "cell_type": "markdown", + "metadata": { + "id": "Fly05NyXWNvo" + }, + "source": [ + "As desired, two additional columns `cls_hidden_state` and `mean_hidden_state` were appended.\n", + "\n", + "Therefore, the function can be supplied to the familiar `map` function\n", + "to add corresponding columns to the original dataset.\n", + "The following lines do this for the full datasets.\n", + "\n", + "On an AWS EC2 p2.xlarge instance, the run time is more than 10 minutes.\n", + "We save the resulting datasets to disk." + ] }, - "id": "ULV0Ffx4WNvt", - "outputId": "cc20315a-8f1b-4560-b8eb-55ae802e1c07", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "loading configuration file models/distilbert-base-multilingual-cased_mlm/config.json\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"models/distilbert-base-multilingual-cased_mlm\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"initializer_range\": 0.02,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"output_past\": true,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"torch_dtype\": \"float32\",\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 119547\n", - "}\n", - "\n", - "loading weights file models/distilbert-base-multilingual-cased_mlm/pytorch_model.bin\n", - "Some weights of the model checkpoint at models/distilbert-base-multilingual-cased_mlm were not used when initializing DistilBertModel: ['vocab_transform.weight', 'vocab_layer_norm.bias', 'vocab_transform.bias', 'vocab_projector.weight', 'vocab_layer_norm.weight', 'vocab_projector.bias']\n", - "- This IS expected if you are initializing DistilBertModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).\n", - "- This IS NOT expected if you are initializing DistilBertModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).\n", - "All the weights of DistilBertModel were initialized from the model checkpoint at models/distilbert-base-multilingual-cased_mlm.\n", - "If your task is similar to the task the model of the checkpoint was trained on, you can already use DistilBertModel for predictions without further training.\n" - ] + "cell_type": "code", + "execution_count": 34, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 401, + "referenced_widgets": [ + "8ed80abd5ea7459580c458fff0089acc", + "d855649c9dcd4b4e9c4b377616d527a7", + "d8a740862ec0449e9a9ea38eadf6549e", + "cc2a4ba35e0e4d55a96715545f60cbf0", + "d14760dd70124ceab4a356f3ea480ef9", + "e4c79a204fd142b6a307c72d7dc10a38", + "694ecf5bbe544e228a98e8caa343a9e7", + "22a3dbd954e343229d64b8b6e81697d3", + "3ea26ec5e4474ede9bfa10cf598f622d", + "308a0ac18d7549e69572e3dd810494e5", + "d2900942f9df47b28947c30c92de734f", + "85f532274aa34a19a5cadf440768d30b", + "844681227c484b3398e7efb9fea80ee1", + "a5a2bfe6a8464279b8cc5e0e6ebb1082", + "521033f81bdb4bc5b841095d1441f8dc", + "8b7cac926a404a8c975a1b534254d6b5", + "b115e3e3a6c74950ac1531366d3d1335", + "222842b061834510af99839d3b2310f1", + "d3b19d20d3394eb088c6fa1e88e00b8b", + "2daeb74a35b34ddfb932960196636047", + "7a098858446147ccac3d996486da40ac", + "9c70d0b152df49e5827eaf7c4c680b2e", + "a2cf47da7e8a450aa8d5c77881873287", + "47b97501f50d4fd793af73e5f7ceaa4a", + "2dfda44036cb4cb88a24f0cb7d34804c", + "56a31f46d7554b3da300d363edc1b8dc", + "751fe4e50bdb4cc29bc615a7b212bf3a", + "8ca31c08b7da43819df07badc22a179e", + "d72b1c4807db42d2a3969e57e8e9a636", + "a484c9d090fb4cecaf781a0ae5f43f3e", + "0bcbc8fe0861455f99c5a0784ae64c7a", + "259af91263c2451c8835deb8764a9241", + "9d7a6e1b52474cb884814647469ee6d5", + "5976809ff3b649b4a501c31a5679ac4e", + "50a5071b535a47a0b88b728a47b89d11", + "93dde85e17294ddd9e601f5bea74cbb6", + "2b92e8b310de4efd8cec36f3552c9a6c", + "8c6f897388704644a23244153179b827", + "584fb7f0e37e4f07be0065d76e908606", + "f22f1a8cbed842afadde3eac96a11c44", + "8628e5935fb84f3593602277332ade4a", + "91f304d326d7495e9556161390588d27", + "5c6167eaa65b45d68fba432b79090a59", + "62494f3d853b4398b57450d9990f9f91", + "94e9b0b82ef24d50bcd22a69d330b8e3", + "04c38476fb474cfca97cd39ba4d7b7d6", + "ea57a35d4bec43dfb17bc720f66760ef", + "ed7412d2d61241169f992d269eade30a", + "4263e489831f4695915a85d63e155f78", + "0c260d91e8c541d0800dab48c561532f", + "291c668611224d0bbe003d4afdb940d0", + "3595004ad04e440596caf9a909d0cb3a", + "633543a5e3474380a4dc02f1705e6381", + "9ac77dbf03b1450390506cf95bcaa6e4", + "08dc380285794f59bf458b3c7553f7fb", + "fe3b8ce1b4804ba69782b7a9266496fb", + "5668f91584334ed5b07509969388b7f2", + "e9aa55c59bf7444aa2e2abe71eb6f134", + "37662a39e78f4cb1b601f0a32ad6e65c", + "42931f45c63e48b1a99b7820a9ce4a4e", + "78fe6770e8f144279c6be6200b79ecfd", + "7bd734cbe6c6497a9b21ed39c5da686d", + "5d2c1928ecb04230bc15718f0da5245b", + "55e730f7626749079541f5ed86db447e", + "f4af04ec1e2f4e5d94b667119fa68f8c", + "f7d2f7967b9348e793c9d250bda79da9", + "c0c0c6952f1d48f7be957066bac19ed5", + "90b5ffd8825a4a1c9fc243723652a4d6", + "af3079f2882443b79eb737a209c1787a", + "acfbfccc008248c6b74509cddc0e2fe7", + "5f1db7f024f847bd93618601750b474c", + "ca72995210bd43408f96cc36f7577b92", + "959ae0c6077548e9bd64fd7a4bf9b7f5", + "a03f8f70ac384db29225f51790acf56c", + "b0c5f79e2d2e4851918c1ed2c2b33064", + "7be8a5052a174fa9b05e53b0c07117fe", + "364ed0dfa11d496a81e3e2d95455b5cb", + "6ddeec81eeab4e60b7426bf313960252", + "6caf1b50b88940c78df8ffaed4075c82", + "c88e1931c8774b1a98dfb91eef23a56c", + "200c49e4925246a7a92969be34dc80de", + "98253db133754a49a1ac090560140e33", + "b2ff5b74b18c4c20ac24649c94f89d6b", + "54d8348db2c348aa8148fe990ed1b33a", + "dd0e419bf01340b8b3350490ab322439", + "85478fcd7ee04a2f8a1fe891d3818c3a", + "efe396a9fce84ddfb95794d1d6e5ab54", + "ece09fe9319e45aa8fc925360be92e09", + "6e0ff75463754489a5174cac1d9b5822", + "738a0639d9bc40fc8f69f0c766038536", + "7edb817203b449f68ff239b8712c592d", + "3c8040823b5343f8aa1988035358d62e", + "545359cafd1048ffa7c815ed5534aa79", + "380ad081adba47d087ff581aaae181b0", + "88ace3f672e04c1d9999692ff85ba4ea", + "91afd40d9d1a48f58d3178c049fe0af7", + "4183d077fe4a4a60a67bf93c051ea600", + "92feef36eed0474696c5fd819a30e8ea", + "da2a9434bb7f4d08bed438e2360be212", + "d17de88295f24936bb07e02bdde1ef18", + "e91ff5ce47b64722a011e3d227c1e5d8", + "62960d7214e549e4aa236dae77b3adcc", + "2534601ee1494d0ea3ed3fdeee9e409c", + "c695710cb07048549d1c0ee460798838", + "680fa3c642974c18ba47e1c4f4ff8a0e", + "72d551809cbc4b2eb497db44c5adc46c", + "19ab9163969d4ba1aedd890e8456b3f2", + "d65c3ae998494d1fa592052257e66c58", + "9258f33f48714db0856c57e8efccba3e", + "967d9e918cdc44f8a6a1afebe8f35049", + "9aba4419261f433babdbacf2cddbaaae", + "c4d27da25d7b46fe98a95b5f6f0c0ce8", + "2df81efc712b4533acf87f15de43714d", + "1d3171780d8e42988102b4cca3c113c6", + "e260174df0ad4d47864ed4ec99b25fea", + "0c0a76b141ce4c48b951c3f4e8406ce0", + "f15f80503f43492fba9c88cd3c624edb", + "ea01494848f64ee197d761be6236273c", + "7769aa1581144b6db3198fc9c6c94927", + "3f5ba3ff8b474e2780ce0f87edd73d26", + "af395a656b45411784c0f53579de2e4a", + "c69bc5a9ef494ff1be688d3345b47951", + "047ca1cddbe74f378ce360e1df50937b", + "283e7d7c9610439696622eac021cb1fa", + "c29cd6ad1acb4a0d883ec60ac23ec295", + "c57ea7deb5b143b99e06357c41528cf1", + "6e889c250ea94043bad8867ddc10ec92", + "85e59a7172294e76b4e2f83bd60c1f2e", + "914c186c1d5e4353b0881142cd23c52e", + "b79e41c92a56412a824ef3b87636694f", + "56f7bd66913546b790cac64698f47d1f", + "e8dd5c4ec763417c9c01fda0e23af7dc" + ] + }, + "id": "B6vH7oZ8WNvo", + "outputId": "492b56db-b77e-4b9f-a72e-be3916308c01", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Map: 0%| | 0/5559 [00:00\n", + "\n", + "### 3.2. ... and Using It in a Classification Model\n", + "\n", + "We will now use the encoded texts as features to predict labels taken from certain tabular information available in the dataset.\n", + "\n", + "To this end, we use the following convenience functions implemented in `tutorial_utils.py`:\n", + "\n", + "* `x_train, y_train, x_test, y_test = get_xy(dataset, features, label)`
\n", + " get numpy arrays corresponding features (x) and label (y) corresponding to the train and test split of the `dataset`where the encoded sentences are stored in the column `features` and the labels in the column `label`.

\n", + " \n", + "* `clf = logistic_regression_classifier(x, y, c=1)`
\n", + " fit and return a multinomial [Logistic Regression classifier](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) to features `x`, and labels `y`. L2-penalty is controlled by the hyper-parameter `c`.

\n", + " \n", + "* `clf = dummy_classifier(x, y):`
\n", + " fit and return a [Dummy classifier](https://scikit-learn.org/stable/modules/generated/sklearn.dummy.DummyClassifier.html) to features `x`, and labels `y`. This classifier predicts always the most frequent class and `predict_proba` always returns the empirical class distribution of `y`.

\n", + " \n", + "* `score_accuracy, score_log, score_brier, confusion_matrix, fig = evaluate_classifier(y_true, y_pred, p_pred, target_names, display_title_string, file_name)`
\n", + " Calculate and display performance metrics of a classifier. The return value `fig` is a ploty figure representing the confusion matrix plot. The following inputs are expected:
\n", + " * the true labels `y_true` (array-like);\n", + " * either the predicted labels `y_pred` (array_like), in which case the log loss and Brier score are not evaluated;\n", + " * or the predicted probabilities `p_pred` (array_like);\n", + " * a display title string;\n", + " * a file name for exporting the figure, or `None`.\n", + "\n", + "Now the toolbox is ready!\n", + "\n", + "Next, we apply it to a simple classification task." ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "6e4514e8397841fc82ab54554e3a8932", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "XKHtvwGHWNvp" }, - "text/plain": [ - " 0%| | 0/87 [00:00\n", + "\n", + "### 3.3. Case Study: Use Accident Descriptions to Predict the Number of Vehicles Involved\n", + "\n", + "In this case study, we will predict the number of vehicles involved in an accident from the verbal accident description.\n", + "\n", + "Since the data set contains the column `NUMTOTV`, we can adopt a supervised learning approach.\n", + "\n", + "We might consider framing the problem as a regression task, e.g. using Poisson regression. However, looking at the frequenca distribution of `NUMTOTV`, it apears unlikely that the Poisson distribution is a good reflection of reality. First, there are no accidents with zero vehicles involved - it takes at least one. So we might consider using a zero-truncated Poisson model. However, the empirical frequency distribution has low mass at high vehicle counts, so that this would not be a plausible model either.\n", + "\n", + "Therefore, we frame the prediction task as multinomial classification. Given that only a small fraction of cases involves four or more vehicles,\n", + "and to avoid a heavily imbalanced classification problem, we map these cases to an aggregated class \"3+\".\n", + "\n", + "To achieve this, we map the column `NUMTOTV` to a new column `labels`, with levels 0 (1 vehicle), 1 (2 vehicles) and 2 (3 or more vehicles).\n", + "We choose the column name `labels` because this is expected by the sequence classification model which we fit in Section [4.2](#task_finetuning)." ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "57f2c2d7d49f4d2dbabd2d8b1930d082", - "version_major": 2, - "version_minor": 0 + "cell_type": "code", + "execution_count": 35, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 244, + "referenced_widgets": [ + "8859929b31c548eaa0fceb367568af33", + "f0f547acc2c44f10be2f6c7ffd5db923", + "815ca085199c4f6a9dc202d3a174fdd5", + "dc0772cdfd4d42ac9211675e32f48f44", + "c4703cc30b76400cbb482ef52d6d3791", + "3ecfc0861d334e8391ad99b43ab7b723", + "514b6b97e18e4dd897b082cfe5b36bcf", + "da418dbc160c4b82a1c35722798a28e4", + "f9e8fbba70044acfa947d2dd6e4c2d43", + "8b97e9202169463792af0302a19f6af8", + "2c347ab097bb4170908b355dd7b71d9f", + "37bb3b9cd750470580d42d0792ea8e3b", + "c457da46eced414bab1662ca2953b86f", + "f762156b82c5482a878a0c1c42da6836", + "5c7f3a804425438da85a57efc4521a2e", + "da3addaf251f48cbb48533d0a115bef2", + "9459bb2fa5574d7fbed332a76760365e", + "ad926e85837b43f7b23dd42b1c8e977c", + "c18d64ce39c643beb6dfec5cbb1034c9", + "96b808e296584cd6b405d92bacb33857", + "a78fc8e06cd84d3d93000149a0f8b783", + "c7f80157d6f84c239ea6ee339354101c", + "a38d4960d8b347d5a27e3b6e4e1fb113", + "e778619f05884fc6a625a4b4d791324c", + "f4b2e06f854044a2b39d3c44f2e581c8", + "3ae6c793683f4204a6c0a2e94c8c0f38", + "d09b95acf723434d8efc0441bb70c42b", + "cf0d5b8201ab49d193edb2699eb83ec5", + "031029d1c7154f67aa36703d8c500d81", + "202292e0000146dda5d3d4947d912a0c", + "7d10f210fd1245c59a0339e183c515cf", + "ebdcd3076e304521aff61740d639b38f", + "ec6167948240441b9261d5448b3237ec", + "0c3537ff57e04d7db9262aab594bcd5f", + "2d74142f04f349e19e808a98746390f2", + "f6221bb71bc34c918db36e1aebe1aac4", + "6206181637814e5b8e4213187a9dedb0", + "ee6b155dd8744028b375e56594d2b48a", + "8ce81913402e4ea49de86a20651add07", + "9ec9ef006d004103907e24442f7c80fe", + "dff32c0ac16d4f14a39096288f1aa8b8", + "fad7778daf544f62bd8d74cbb1b015dc", + "db1d68dfb3fe437f9b8c67268f5a4ab2", + "f34edd60534c4f17b75fcff5fba45589", + "ac73a156c46644d7970e16e7781a5183", + "b688e34e55b94fdb9d2cabb20fef3053", + "775a6250bd854c1aa0247923d97ff9fd", + "93549c8a61fa4894b4a19c3fca99a118", + "fec529325496499c94c6177b5d54c3eb", + "557d9c1161664117a7cf83affd6d3980", + "a501b1086d6a4d8ab3518b23cf02789d", + "6c8190f1fcdc45f0939a82f9eefc5cad", + "acac3bd9c181437eade41fca54c92646", + "575523c10a5f40de80d8135c76fccb76", + "ca7e438ad5904494809d67935892bb2d", + "56ab07e2da3340d7a5548ad251b507fa", + "5981828186cd4cfc8c4d9965b22d3718", + "d84b745464254fcabdfd97422f03ee50", + "fdfc7556cc4c4d1588fa53412a33a7ca", + "f822c415536240868446e730383ab21d", + "061e5070e4d44f79b35a87f07647c265", + "756f1da19f454852af074af6e9767b16", + "df7ced2045694585bf5caab44d2219de", + "3680dc3182db4b0994d21e70d86a9fb1", + "ca4efa3ede794e85b856adbf87edb53b", + "9da06a1fcd77401e926701eb80bd7619" + ] + }, + "id": "LFE7syyMWNvp", + "outputId": "8662795c-6dbe-4db1-9d43-0a651db6a02a", + "pycharm": { + "name": "#%%\n" + } }, - "text/plain": [ - " 0%| | 0/348 [00:00\n", + "\n", + "\n", + "

\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "# extract the transformer encoding corresponding to the the CLS token\n", + "x_train_en, y_train_en, x_test_en, y_test_en = get_xy(dataset_en, \"cls_hidden_state\", \"labels\")\n", + "\n", + "# fit dummy classifier\n", + "clf_dummy = dummy_classifier(x_train_en, y_train_en)\n", + "_ = evaluate_classifier(y_test_en, None, clf_dummy.predict_proba(x_test_en), labels, \"Dummy classifier\", \"cm_nv_dummy\")" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "c951b413644740a2b6548a1cb1732a22", - "version_major": 2, - "version_minor": 0 + "cell_type": "code", + "execution_count": 37, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 768 + }, + "id": "lIzPeTfEWNvq", + "outputId": "091df1a2-7414-45ee-89da-d4ed4f4d8028", + "pycharm": { + "name": "#%%\n" + } }, - "text/plain": [ - " 0%| | 0/87 [00:00\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "# fit a classifier to the encoded English texts\n", + "clf_en = logistic_regression_classifier(x_train_en, y_train_en, c=10)\n", + "_ = evaluate_classifier(y_test_en, None, clf_en.predict_proba(x_test_en), labels, \"Logistic regression (a)\", \"cm_nv_lr_a\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "dataset_en = load_from_disk(\"./datasets/dataset_en\")\n", - "dataset_ge = load_from_disk(\"./datasets/dataset_ge\")\n", - "dataset_mx = load_from_disk(\"./datasets/dataset_mx\")\n", - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "model = AutoModel.from_pretrained(\"models/\" + model_name + \"_mlm\").to(device)\n", - "dataset_en_pretrained = dataset_en.map(extract_sequence_encoding, fn_kwargs={\"model\": model}, batched=True, batch_size=16)\n", - "dataset_ge_pretrained = dataset_ge.map(extract_sequence_encoding, fn_kwargs={\"model\": model}, batched=True, batch_size=16)\n", - "dataset_mx_pretrained = dataset_mx.map(extract_sequence_encoding, fn_kwargs={\"model\": model}, batched=True, batch_size=16)\n", - "dataset_en_pretrained.save_to_disk(\"./datasets/dataset_en_pretrained\")\n", - "dataset_ge_pretrained.save_to_disk(\"./datasets/dataset_ge_pretrained\")\n", - "dataset_mx_pretrained.save_to_disk(\"./datasets/dataset_mx_pretrained\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "BKct-oVhWNvt", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "Now let's see to what extent domain-specific fine-tuning is able to improve the performance of the classification model.\n", - "\n", - "To this end, we perform the same steps as in Sections [3.3](#case_study_nvehicles)-[3.5](#multi_lingual_training):" - ] - }, - { - "cell_type": "code", - "execution_count": 40, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 209, - "referenced_widgets": [ - "a8ac2436045a4563ae3486bdb87c1dfc", - "a79f1d8d86f24cf79827ee87c25464af", - "99b919698526404f9649193c29ba0369", - "025f58ef2eb34c2788a81330856c3550", - "4270b211964347489aac78ed936b72b9", - "d381ba546b2a462cb7c2bba2548f4aeb", - "e7405686adac427896e009dcffd7e7bf", - "f5987015973545138492026a9a477f8d", - "94469cf42d06456789448ac7762087c7", - "ec3609c9a6a94ab28c12886ece2950ef", - "991092a330274e498caa71a8e8568299", - "7674895db83c4975ac943ad6cd8b3a7d", - "8af626b74e1a42f79526f8e9431c0e57", - "cfab1677de114ed6809b1d80e54ca0c1", - "f1a4a3b05b8d489b92765eb91eb98a7b", - "454707c78bb44c0fa0e6cbdddd6fbc22", - "62cea98127e4435f8dee9b9e08f89d2e", - "3afa79ae4c524f16af14a8645e1e6b65", - "bdea16c1d7914ef2a5ce667d09214471", - "42ba3f4756ba4857a1bf43b1d040a329", - "13c3298103f64f5d957d6966c88fa260", - "2c06aec09c874cc6b28adcf5953e4f84", - "bae2ab858a344334ac9aab135fdea558", - "0ef1ec02312d45a98e1375526b408d89", - "39f4abeb66b4468880961db6e7342b07", - "d840f155f4c1469f96c71247ec94528e", - "8a89d66b69054f4db3272c2be5fb1431", - "2785da2491d14c5894b8fd67d0e0bb47", - "aee3b8f33eb84e27b10394459d14a3dc", - "b109a334d560490ab46976a506ed0c18", - "01f20b23a70841348756a4828c15e0b2", - "82a50e05623b451d8177406bc4fef1d4", - "6ca8b6d28a054650b07c1010ea732995", - "144920dfe3b646b1aa6a4159c02bc0b1", - "6f10df8509ce49a48aea26206f66ad40", - "d1df9aa896b44c259b01478290c1cb9b", - "c62c355fb8de48a7bdc2807ea185e9ba", - "586ca98ec28f46e38cfcbd22224f6b26", - "833fa49649f547b8885d4e83aeab34e8", - "9e438c2b755d4022b9b54d8fdc2a19c2", - "dd46029c8ff74c95b3dcbe8d365c2357", - "1828be6b5d7b402b80002147b72767e6", - "d28aa9842ac6468b9e8c7adaeed7a4df", - "825a2e865b8d4ac696a467105c2f725a", - "3044bf0757b0429a979a967e11ee723d", - "7a23dd3abaeb4f49b071c024e077639a", - "6fa4ba0653d2410e90d91bdf13b557c9", - "5419a464ac25425f89e7fde2a727091a", - "4943b4c6a96947ecb7c1d5f0ddadeb27", - "07d6482f951f46d7bb40f0b773cbb047", - "fb73dc3c0b6a45b99a69d7dd09602c8b", - "bbc5f76f188349e5b812de73ab844ea0", - "dbd8f871a6fe4a98abff08db47a7aa67", - "cecc68219c5a479e9792c72e4fde2bdc", - "b908cbe4105046beba03abfe1b2600d0", - "406d1b30996f4f899db4253eb0000fd2", - "df40f0dc5577447992a6b0bf24d75527", - "11d5e2fc6dca4b2da83ca69c1597eeb7", - "86c5d4ab9b234240bb26560a28f2138a", - "d9fe8aa27e694187b244165228c4a7f7", - "18bf213b47ef4bb487bbc0d38ce800df", - "f7acee00f37545969425d3c507de87ea", - "ef4e1ee660e548c2a60bd1b20fcb6ffc", - "7f951eed18b740179218b3361ca082d7", - "2bf8c6aef5f749358039f2b0ad89ec0a", - "2833ed36ab7f4c2bb4abbb117b6c4396" - ] }, - "id": "JD6cDqXDWNvt", - "outputId": "b570ff43-49d9-46db-8028-52065b53cb81", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "91f9913d451c4690991760e2928c6c26", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "qED73tnMWNvq" }, - "text/plain": [ - " 0%| | 0/5559 [00:00\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "x_train_en, y_train_en, x_test_en, y_test_en = get_xy(dataset_en, \"mean_hidden_state\", \"labels\")\n", + "clf_en = logistic_regression_classifier(x_train_en, y_train_en, c=10)\n", + "_ = evaluate_classifier(y_test_en, None, clf_en.predict_proba(x_test_en), labels, \"Logistic regression (b), train EN, test EN\", \"cm_nv_EN_EN\")" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "ab3d67551e20490fa7002af5b4427d98", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "SB0K-NinWNvq" }, - "text/plain": [ - " 0%| | 0/5559 [00:00\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "x_train_ge, y_train_ge, x_test_ge, y_test_ge = get_xy(dataset_ge, \"mean_hidden_state\", \"labels\")\n", + "clf_ge = logistic_regression_classifier(x_train_ge, y_train_ge, c=10)\n", + "_, _, _, _, _ = evaluate_classifier(y_test_ge, None, clf_ge.predict_proba(x_test_ge), labels, \"train GE, test GE\", \"cm_nv_GE_GE\")" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "5f4e44590ca64c65b98ce4c4ed6b5190", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "fYKoqK3eWNvr" }, - "text/plain": [ - " 0%| | 0/5559 [00:00\n", + "\n", + "### 3.4. Cross-Lingual Transfer\n", + "\n", + "In practice, it might happen that training data is available (predominantly) in one language,\n", + "but we would like to apply the model to test data in another language.\n", + "Translating the test data to the language of the training data would be an option,\n", + "but let's see how the multilingual transformer model performs.\n", + "\n", + "In our small experiment, we simply switch the languages of the test sets.\n", + "This might be hard for the models, since in the entire training process each model has seen only encoded input\n", + "from text samples in one language!\n", + "\n", + "First, use the German test set for the model trained on English input:" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "dc2726fde54748a9a9e2e57bdaf9b5a3", - "version_major": 2, - "version_minor": 0 + "cell_type": "code", + "execution_count": 40, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 768 + }, + "id": "247Aj4I5WNvr", + "outputId": "f111a82a-bf4b-4480-b7f2-c8c959b33efe", + "pycharm": { + "name": "#%%\n" + } }, - "text/plain": [ - " 0%| | 0/1390 [00:00\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "_ = evaluate_classifier(y_test_ge, None, clf_en.predict_proba(x_test_ge), labels, \"train EN, test GE\", \"cm_nv_EN_GE\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "dataset_en_pretrained = load_from_disk(\"./datasets/dataset_en_pretrained\")\n", - "dataset_ge_pretrained = load_from_disk(\"./datasets/dataset_ge_pretrained\")\n", - "dataset_mx_pretrained = load_from_disk(\"./datasets/dataset_mx_pretrained\")\n", - "\n", - "# map number of vehicles to a new column \"labels\"\n", - "labels = [\"1\", \"2\", \"3+\"]\n", - "d = {i: min(i-1, 2) for i in range(1,10)}\n", - "dataset_en = dataset_en_pretrained.map(lambda x: {\"labels\": d[x[\"NUMTOTV\"]]})\n", - "dataset_ge = dataset_ge_pretrained.map(lambda x: {\"labels\": d[x[\"NUMTOTV\"]]})\n", - "dataset_mx = dataset_mx_pretrained.map(lambda x: {\"labels\": d[x[\"NUMTOTV\"]]})\n", - "\n", - "# extract features and labels and creade multi-lingual dataset\n", - "x_train_en, y_train_en, x_test_en, y_test_en = get_xy(dataset_en, \"mean_hidden_state\", \"labels\")\n", - "x_train_ge, y_train_ge, x_test_ge, y_test_ge = get_xy(dataset_ge, \"mean_hidden_state\", \"labels\")\n", - "x_train_mx, y_train_mx, x_test_mx, y_test_mx = get_xy(dataset_mx, \"mean_hidden_state\", \"labels\")" - ] - }, - { - "cell_type": "code", - "execution_count": 41, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000 }, - "id": "jmGm2stNWNvu", - "outputId": "08a4ed7e-db6a-4af2-db14-3de971671ebd", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "train EN, test EN\n", - "accuracy score = 97.1%, log loss = 0.091, Brier loss = 0.044\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.96 0.99 0.97 389\n", - " 2 0.97 0.98 0.97 795\n", - " 3+ 0.98 0.91 0.94 206\n", - "\n", - " accuracy 0.97 1390\n", - " macro avg 0.97 0.96 0.96 1390\n", - "weighted avg 0.97 0.97 0.97 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "rQQ0Ql2bWNvr" + }, + "source": [ + "From these rather poor results, we conclude that this approach to cross-language transferability does not work.\n", + "\n", + "Vice versa, use the English test set for the model based on German input:" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_pr_EN_EN", - "format": "svg" + "cell_type": "code", + "execution_count": 41, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 768 + }, + "id": "j90XLzGZWNvr", + "outputId": "d55a168a-c348-439b-f53f-f44755f48ff6", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 384, - 5, - 0 - ], - [ - 14, - 777, - 4 - ], - [ - 1, - 17, - 188 + "output_type": "stream", + "name": "stdout", + "text": [ + "train GE, test EN\n", + "accuracy score = 24.3%, log loss = 8.052, Brier loss = 1.360\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 0.00 0.00 0.00 389\n", + " 2 0.40 0.17 0.24 795\n", + " 3+ 0.19 0.99 0.32 206\n", + "\n", + " accuracy 0.24 1390\n", + " macro avg 0.20 0.39 0.19 1390\n", + "weighted avg 0.26 0.24 0.18 1390\n", + "\n" ] - ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train EN, test EN" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } - } - } - }, - "text/html": [ - "
" + ], + "source": [ + "_ = evaluate_classifier(y_test_en, None, clf_ge.predict_proba(x_test_en), labels, \"train GE, test EN\", \"cm_nv_GE_EN\")" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stdout", - "output_type": "stream", - "text": [ - "train EN, test GE\n", - "accuracy score = 41.4%, log loss = 1.801, Brier loss = 0.890\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 1.00 0.08 0.16 389\n", - " 2 0.58 0.43 0.49 795\n", - " 3+ 0.26 0.99 0.42 206\n", - "\n", - " accuracy 0.41 1390\n", - " macro avg 0.61 0.50 0.35 1390\n", - "weighted avg 0.65 0.41 0.39 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "5FFjmHzBWNvs" + }, + "source": [ + "Again, performance is unsatisfactory.\n", + "\n", + "To improve results, we need to change the approach.\n", + "\n", + "\n", + "\n", + "\n", + "### 3.5. Multi-Lingual Training\n", + "\n", + "In a multilingual situation, a possible approach is to train the classifier with a training set consisting\n", + "of encoded samples from both languages.\n", + "This can always be achieved by translating a fraction of the text data and then use it to train the model.\n", + "\n", + "This is exactly what we are going to do next.\n", + "In order to simulate a situation where one language is underrepresented, we create a mixed-language dataset\n", + "with about 80% English and 20% German samples, our dataset `dataset_mx` produced in [Section 2.2](#tokenize).\n", + "\n", + "Since we are already using a multilingual transformer model, no further changes are required." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_pr_EN_GE", - "format": "svg" + "cell_type": "code", + "execution_count": 42, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000 + }, + "id": "BdCe6OIDWNvs", + "outputId": "ac237125-2c4f-4cad-9ce0-376c900307db", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 33, - 245, - 111 - ], - [ - 0, - 340, - 455 - ], - [ - 0, - 3, - 203 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } + "output_type": "stream", + "name": "stdout", + "text": [ + "train EN/GE, test EN\n", + "accuracy score = 95.7%, log loss = 0.136, Brier loss = 0.068\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 0.96 0.98 0.97 389\n", + " 2 0.95 0.97 0.96 795\n", + " 3+ 0.97 0.85 0.90 206\n", + "\n", + " accuracy 0.96 1390\n", + " macro avg 0.96 0.93 0.95 1390\n", + "weighted avg 0.96 0.96 0.96 1390\n", + "\n" ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "train EN/GE, test GE\n", + "accuracy score = 95.2%, log loss = 0.160, Brier loss = 0.080\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 0.96 0.97 0.97 389\n", + " 2 0.95 0.97 0.96 795\n", + " 3+ 0.94 0.85 0.90 206\n", + "\n", + " accuracy 0.95 1390\n", + " macro avg 0.95 0.93 0.94 1390\n", + "weighted avg 0.95 0.95 0.95 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train EN, test GE" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } - }, - "text/html": [ - "
" + ], + "source": [ + "x_train_mx, y_train_mx, x_test_mx, y_test_mx = get_xy(dataset_mx, \"mean_hidden_state\", \"labels\")\n", + "clf_mx = logistic_regression_classifier(x_train_mx, y_train_mx, c=10)\n", + "_ = evaluate_classifier(y_test_en, None, clf_mx.predict_proba(x_test_en), labels, \"train EN/GE, test EN\", \"cm_nv_MX_EN\")\n", + "_ = evaluate_classifier(y_test_ge, None, clf_mx.predict_proba(x_test_ge), labels, \"train EN/GE, test GE\", \"cm_nv_MX_GE\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# fit logistic regression classifiers to each of the three datasets and (cross-) evaluate them\n", - "clf_en = logistic_regression_classifier(x_train_en, y_train_en, c=10)\n", - "_ = evaluate_classifier(y_test_en, None, clf_en.predict_proba(x_test_en), labels, \"train EN, test EN\", \"cm_nv_pr_EN_EN\")\n", - "_ = evaluate_classifier(y_test_ge, None, clf_en.predict_proba(x_test_ge), labels, \"train EN, test GE\", \"cm_nv_pr_EN_GE\")" - ] - }, - { - "cell_type": "code", - "execution_count": 42, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000 }, - "id": "L5NPXt8VWNvu", - "outputId": "53eadf84-902c-4b75-c17c-62e9a6dc3ee3", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "train GE, test GE\n", - "accuracy score = 96.9%, log loss = 0.104, Brier loss = 0.051\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.97 0.98 0.98 389\n", - " 2 0.97 0.98 0.97 795\n", - " 3+ 0.96 0.91 0.94 206\n", - "\n", - " accuracy 0.97 1390\n", - " macro avg 0.97 0.96 0.96 1390\n", - "weighted avg 0.97 0.97 0.97 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "0Ew5aqySWNvs" + }, + "source": [ + "This is a very good outcome. The scores are close to those achieved in the situation with a single-language!\n", + "\n", + "To conclude, a multi-lingual situation can be handled by a multi-lingual transformer model. For the best performance, the classifier should be trained on the encoded sequences from all languages." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_pr_GE_GE", - "format": "svg" - } - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 382, - 7, - 0 - ], - [ - 10, - 778, - 7 - ], - [ - 1, - 18, - 187 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train GE, test GE" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "cell_type": "markdown", + "metadata": { + "id": "C_CEp4ShWNvs", + "pycharm": { + "name": "#%% md\n" } - } }, - "text/html": [ - "
" + "source": [ + "\n", + "\n", + "## 4. Fine-Tuning – Improving the Model\n", + "\n", + "In the previous case study, we have used the DistilBERT model without any adaptation to the text data at hand,\n", + "simply by using the sequence encoding produced by the model.\n", + "As such, the language representation, which the model has learned from a large corpus of multilingual data, is transferred\n", + "to the text data at hand.\n", + "This approach is called transfer learning.\n", + "The advantage of transfer learning is that a powerful (but relatively complex) model can be trained on a large corpus\n", + "of data, using large-scale computing power, and then be applied to situations where availability of data or computing\n", + "power would not allow for such complex models.\n", + "\n", + "For the task at hand, the results are already very good.\n", + "However, in certain situations it might be required to further improve model performance.\n", + "\n", + "In the following sections you will learn how to fine-tune a transformer model.\n", + "We will explore two approaches to fine-tuning:\n", + "\n", + "* *Domain-specific fine-tuning* involves updating the parameters of the transformer model using text data which is\n", + " relevant to the domain where the model will be applied.\n", + " However, the model is not necessarily tuned for a specific downstream task of interest.\n", + "* *Task-specific fine-tuning* uses domain-specific text data and tunes the parameters of the transformer model\n", + " while training it for a given downstream task of interest.\n", + "\n", + "The advantage of the first approach is that it can be performed in an unsupervised fashion,\n", + "i.e., it does not require labeled data.\n", + "\n", + "On the other hand, task-specific fine-tuning is expected to produce better performance on the particular task\n", + "which the model was tuned for, so it might be the method of choice if there is a single down-stream task\n", + "and sufficient labeled data.\n", + "\n", + "Let's explore these two fine-tuning approaches in turn." ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stdout", - "output_type": "stream", - "text": [ - "train GE, test EN\n", - "accuracy score = 64.3%, log loss = 3.640, Brier loss = 0.687\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.00 0.00 0.00 389\n", - " 2 0.62 1.00 0.76 795\n", - " 3+ 0.99 0.49 0.65 206\n", - "\n", - " accuracy 0.64 1390\n", - " macro avg 0.54 0.49 0.47 1390\n", - "weighted avg 0.50 0.64 0.53 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "I1pU2x-JWNvs" + }, + "source": [ + "\n", + "\n", + "### 4.1. Domain-specific fine-tuning\n", + "\n", + "Domain-specific fine-tuning can be achieved by applying the model to a \"masked language modeling\" task.\n", + "This involves taking a sentence, randomly masking a certain percentage of the words in the input,\n", + "and then running the entire masked sentence through the model which has to predict the masked words.\n", + "This self-supervised approach is an automatic process to generate inputs and labels from the texts and does not require\n", + "any humans labelling in any way.\n", + "\n", + "This is very easy to implement using the Transformers library.\n", + "You will see three new elements of the Transformer library in action:\n", + "\n", + "* the `AutoModelForMaskedLM` class loads the DistilBERT model with a model head suitable for the masked language\n", + " modeling task.\n", + "* The `DataCollatorForLanguageModeling` class forms training batches from the dataset and handles the masking.\n", + "* The `Trainer` class provides the interface to train the model.\n", + "\n", + "Depending on the hardware available, training might take a rather long time.\n", + "Therefore, if available, we use GPU support.\n", + "On an AWS EC2 p2.xlarge instance, the run time is about 55 minutes.\n", + "We store the trained model for later use.\n", + "\n", + "If you do not have enough time to perform this step right now, you can skip this section and return later. The remainder of this notebook does not depend on it." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_pr_GE_EN", - "format": "svg" + "cell_type": "code", + "execution_count": 43, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 249 + }, + "id": "R5-TPov4WNvt", + "outputId": "0f0635c3-822c-4da9-d03d-c9473f4d9403", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 0, - 389, - 0 - ], - [ - 0, - 794, - 1 - ], - [ - 0, - 106, - 100 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } + "output_type": "stream", + "name": "stderr", + "text": [ + "You're using a DistilBertTokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.\n" ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "\n", + "
\n", + " \n", + " \n", + " [2780/2780 25:09, Epoch 2/2]\n", + "
\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
StepTraining Loss
5001.435100
10001.116400
15001.001500
20000.941800
25000.891200

" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train GE, test EN" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } - }, - "text/html": [ - "

" + ], + "source": [ + "# load model and tokenizer and define the DataCollator\n", + "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", + "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model\n", + "model_mlm = AutoModelForMaskedLM.from_pretrained(model_name).to(device)\n", + "tokenizer = AutoTokenizer.from_pretrained(model_name)\n", + "data_collator = DataCollatorForLanguageModeling(tokenizer=tokenizer, mlm=True, mlm_probability=0.15)\n", + "dataset_mx = load_from_disk(\"./datasets/dataset_mx\")\n", + "\n", + "# define training arguments\n", + "training_args = TrainingArguments(\n", + " output_dir=\"models/\" + model_name + \"_mlm_epochs\",\n", + " overwrite_output_dir=True,\n", + " num_train_epochs=2,\n", + " per_device_train_batch_size=4,\n", + " save_strategy=trainer_utils.IntervalStrategy.NO,\n", + ")\n", + "trainer = Trainer(\n", + " model=model_mlm,\n", + " args=training_args,\n", + " data_collator=data_collator,\n", + " train_dataset=dataset_mx[\"train\"]\n", + ")\n", + "trainer.train()\n", + "trainer.save_model(\"models/\" + model_name + \"_mlm\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "clf_ge = logistic_regression_classifier(x_train_ge, y_train_ge, c=10)\n", - "_ = evaluate_classifier(y_test_ge, None, clf_ge.predict_proba(x_test_ge), labels, \"train GE, test GE\", \"cm_nv_pr_GE_GE\")\n", - "_ = evaluate_classifier(y_test_en, None, clf_ge.predict_proba(x_test_en), labels, \"train GE, test EN\", \"cm_nv_pr_GE_EN\")" - ] - }, - { - "cell_type": "code", - "execution_count": 43, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000 }, - "id": "ysYstLT2WNvu", - "outputId": "97bde4ef-7a27-4005-ce69-78f4899ee0b2", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "train EN/GE, test EN\n", - "accuracy score = 97.1%, log loss = 0.095, Brier loss = 0.046\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.97 0.99 0.98 389\n", - " 2 0.97 0.98 0.98 795\n", - " 3+ 0.98 0.90 0.94 206\n", - "\n", - " accuracy 0.97 1390\n", - " macro avg 0.97 0.96 0.96 1390\n", - "weighted avg 0.97 0.97 0.97 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "n8if8dfPWNvt" + }, + "source": [ + "Now, `model_mlm` holds the DistilBERT model, fine-tuned to the mixed-language accident descriptions\n", + "using masked-language-modeling.\n", + "\n", + "Next, we apply this model to all input sequences and extract the last hidden state.\n", + "The procedure is the same as in section [3.1](#extract_encoding).\n", + "To avoid confusion, we create new datasets, and store them on disk for later use,\n", + "so that this step does not need to be repeated all over when this notebook is re-run." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_pr_MX_EN", - "format": "svg" - } - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 385, - 4, - 0 - ], - [ - 12, - 780, - 3 - ], - [ - 1, - 20, - 185 + "cell_type": "code", + "execution_count": 44, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 401, + "referenced_widgets": [ + "338d1ffeb8364875b1e3eba99eb75d0a", + "7275f894b10449d2b00a494e7a109f87", + "ce54d113c2944f0c961501a967028b30", + "ff0f15dcd86e49338cee6af7ef89395b", + "d1022bbf6fd149638383529c47051f93", + "fe30bd2fe55140ec9a61a55b72615524", + "b5db735f399d490eabfeb025a0dad1c3", + "708703e4fd9246f1ae61126f2be90578", + "410d2908686b4039b5e00d427644a576", + "1262a69f9f5448c38112759d637102b7", + "b7e157b1383a4c92b9ab4dc8a8d07e91", + "e3da77ab25d548fbbb1ad74b532f8c7d", + "b1ad913a10fd4c14801c68d6b5e31bc8", + "d2746a51c2a643a68b813dc9d100721b", + "2f490e9dab4b44d59f9b8d148911ae79", + "74bb44ca631a4f6cb832269a39518cd3", + "6cf7db0b71144e7b915f1c569386e834", + "dee4dd1ec2ea41a7be94073e291002c3", + "2f99de0601824cee8f0a7525f58c4726", + "db2642b85eb048a1853c061567ea01fa", + "51228ddf46e9405685247b445ec55dfe", + "133b07406b014ebc9ff41a244838a23a", + "88ab9b0630634433a38ec1a1041b6793", + "a69938d2b5ef4b8e99d9a1b1c20f1d55", + "e5e254c3143540998ac5a90294dbe490", + "35578a8ace994593b59e7404e49c1fe1", + "403503061ca6475eab164690ed0a35de", + "3915829c49f948119803ec5ba3ac6bbf", + "1b06a7cb6a7a49918ff546c21d7208f5", + "3e4f5d3074514aa58216884ad9a054e9", + "fc325bb097f04411b1e46bc9a0adc7b9", + "72c126b0b7284c9f9d0d851c7037a2d1", + "9bdeaef34b28447aaadc6bdc6faeed57", + "6b5c8a5a7934422a903a7d0ecc91f321", + "05e2dc79509649588adc10d0e27a5ab1", + "29c9dc340f4a422ea0a4b21513b89ddb", + "7ecb6a88b5754c0abc125b054eba7389", + "2a17ba043fb74a0b9581f32208a74732", + "9ef9ed8d47154ff495177e3ce6f0ccab", + "2f8cab7a7e584b75b4dcd027512e7ae8", + "f7332463f4da4e598d0c76a7cf0e1160", + "3636683727324018a5472386ed6990ca", + "84e62572b55b418fa40d3cb3c1ce0f14", + "77a56d8ee48e46a08e2ecaa5d676be0b", + "ffcb83603765474d9379a90187bc3a27", + "aeaed39127bf45a1acfa3632224babd1", + "21d9e3e2ebb540c5bf7649b10a0258ea", + "8297e4bda30b4e8cb9ac8ed97defc75b", + "a074133c31d2406c8b68f4881acb0f62", + "ff8f39d347ca4672b691a38d34bf0dd1", + "8eca63e0ea5b4e578dffc3f10212d558", + "51ba5660537f4a1cb8e1fc430652b051", + "67327719377c4fc691be3f72f5a36747", + "3b1109fb54d84f179d202759e8b66495", + "a1cec3a032bc4ef08f921d9be506c9de", + "84f23c987e614f0992dbdae071fb6314", + "0a148286887b421bbfb2579c3eab211d", + "bea4705f37d9422c875d9fa13669950a", + "39a2d7b0750e4f84ab56ca52b66b94be", + "98e36923b3f948bcabcbe2c3d950d82b", + "5914f98fb60341deb7966b634faa360b", + "73017793c9394f818104215972655c2b", + "5def40185d6543e091aa714c9b891ac9", + "0112437a720846dca2e16f634c862ce8", + "16e007cf72174f60a0edd1bd3735549b", + "2d2ed668b80547dca68771be04264059", + "25171061d90a40068fdd9cc385050aeb", + "95a3e9f6b0c24aa5976042ce50e669f7", + "3789d006f67e48aeb3c41504caafa634", + "ede8b23198334ae9a16d06ee134d1023", + "a6a8d8cb31604e6caca980432245ef7f", + "6fdafd894d354b9abed9c335d1d6e943", + "069398105c3d47ccb215475d097fccae", + "7a5896e66d084ccda618082d735dcba9", + "d3ace19af72b4c91a96535ee74353cca", + "c831615c79d847c0b84179cb86720b78", + "0f6f967388174a3ca14eaec5b5cece38", + "d3b0ab351fe24f6c8c94db179bddfe82", + "3763230ceae34b57ab800df9f52fb4c3", + "fe19f45121c940a09d4f6ca7203d14f3", + "c9d9ad64c1744e70baa2d9fcba04381d", + "a17542b65b2f489d918d5c2ea0efbf14", + "5573793fd299467eb4258e27b3629a9d", + "68c2bc2ea11a4d6893ec9a400c7072df", + "a33e610f4b064359a78d639632b91228", + "169684652ce9425db5d0ed190749fdf7", + "5cba2d1c85ad4e82933bf92fb8154885", + "5c2755ed53f84c8382ca67d7b25985db", + "e27d3f29de024968b35a25d755a9abf6", + "5a7908d105174393987c8c8a5461a4c0", + "53b343b183e14c398f4f96fc7efcb017", + "47a96c0b881747529b37bbaf4d31c66d", + "73c86ddeb50f49a0b81bf07a598b4442", + "252a7cd731bf40a7959a370d6146a95f", + "7036a7d40faf42498db22dd68212bd15", + "1345735c960a40179f21f9950386f24e", + "7f33c98181574426bf5526db319b50d3", + "bafa736d2fca4004be822dfab9916ae1", + "525bda7c29214bd09981186d4e39cde4", + "92d69515e6c246ffba8dbc9389875efb", + "4402d0c3b2b2409d8aca3bfa87b3bb2c", + "3132cbb00d16405a996c2efdb4fb86ef", + "16bfa0ea08c4484f8be77b3fa76d98b1", + "be7d33d41de74c20a195a2e9a96ffa80", + "f9920508dbb94df98a1d328cd967769c", + "ffc90b0962284848a7d393f8b328b805", + "31f5a53161ad4ccbb5bbd4b18e17ff09", + "cc26324bc67f437fb91e53565dd00afe", + "0e28586042ac4be4a3d8d84d412ea3a3", + "84a7817fb46549608bfa8b8f5d3b5aa8", + "7b7cfee0c19a418ca5a8892796d1764d", + "671416fe8ccf49d2bcbb86a4b1f34e37", + "b846f21cadb2441bb8c0176577e6e4ac", + "2f6c5e2f216649f295b42870dd47ed4a", + "b5f605db39c3468d8ee0cd12fb57fbfe", + "96583fa6a2974012a68a03a68a50a51a", + "68091e0a86b24f07926dc12d0b6d81f8", + "1f8574ed99f840e597c36e3a9e464827", + "14b195ddb341465d93c140ee4fec3eae", + "f0b49fb723c74a709a559ceab47e2298", + "14bd51b1afda4fb6aa21a99cbecd0477", + "c17f3526e8cf4d4f909fb45e980c405e", + "c1a5cc55d3d3426396a06ec7dd2851f1", + "b59c4ee41345481c98115ab079a4c915", + "b5e9b9d525a4487d81266b47451e6e20", + "a26a7799687545758d0057168ea00aaf", + "0be030a620ab4eaf89f3f25bed03c0cd", + "66771ce5d79d439d88cb8095e7f58dc4", + "789591a72e9046139927b9d4d2d85ae1", + "6706374cb7d1452cbf198207f5eeb1ae", + "eb441c0cf54241cca31fc0e47a38f457", + "32905dd3bba94d9a8034c9d7a2892493" ] - ] + }, + "id": "ULV0Ffx4WNvt", + "outputId": "14c3b8e6-edc4-4cd9-bb71-18c534c4e8d3", + "pycharm": { + "name": "#%%\n" } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Map: 0%| | 0/5559 [00:00\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "train EN, test GE\n", + "accuracy score = 88.5%, log loss = 0.308, Brier loss = 0.174\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 0.96 0.78 0.86 389\n", + " 2 0.85 0.98 0.91 795\n", + " 3+ 0.96 0.73 0.83 206\n", + "\n", + " accuracy 0.88 1390\n", + " macro avg 0.92 0.83 0.87 1390\n", + "weighted avg 0.89 0.88 0.88 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } + "metadata": {} + } + ], + "source": [ + "# fit logistic regression classifiers to each of the three datasets and (cross-) evaluate them\n", + "clf_en = logistic_regression_classifier(x_train_en, y_train_en, c=10)\n", + "_ = evaluate_classifier(y_test_en, None, clf_en.predict_proba(x_test_en), labels, \"train EN, test EN\", \"cm_nv_pr_EN_EN\")\n", + "_ = evaluate_classifier(y_test_ge, None, clf_en.predict_proba(x_test_ge), labels, \"train EN, test GE\", \"cm_nv_pr_EN_GE\")" + ] + }, + { + "cell_type": "code", + "execution_count": 47, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000 + }, + "id": "L5NPXt8VWNvu", + "outputId": "502a8f95-0800-4f8b-ed7c-caf6023b8af7", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "train GE, test GE\n", + "accuracy score = 96.8%, log loss = 0.115, Brier loss = 0.055\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 0.98 0.98 0.98 389\n", + " 2 0.96 0.98 0.97 795\n", + " 3+ 0.97 0.89 0.93 206\n", + "\n", + " accuracy 0.97 1390\n", + " macro avg 0.97 0.95 0.96 1390\n", + "weighted avg 0.97 0.97 0.97 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "train GE, test EN\n", + "accuracy score = 65.1%, log loss = 3.024, Brier loss = 0.665\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 1.00 0.00 0.01 389\n", + " 2 0.62 1.00 0.77 795\n", + " 3+ 0.99 0.53 0.69 206\n", + "\n", + " accuracy 0.65 1390\n", + " macro avg 0.87 0.51 0.49 1390\n", + "weighted avg 0.78 0.65 0.54 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] }, - "title": { - "x": 0.05 + "metadata": {} + } + ], + "source": [ + "clf_ge = logistic_regression_classifier(x_train_ge, y_train_ge, c=10)\n", + "_ = evaluate_classifier(y_test_ge, None, clf_ge.predict_proba(x_test_ge), labels, \"train GE, test GE\", \"cm_nv_pr_GE_GE\")\n", + "_ = evaluate_classifier(y_test_en, None, clf_ge.predict_proba(x_test_en), labels, \"train GE, test EN\", \"cm_nv_pr_GE_EN\")" + ] + }, + { + "cell_type": "code", + "execution_count": 48, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000 + }, + "id": "ysYstLT2WNvu", + "outputId": "a86187be-a4b6-4be9-f81e-39902fcc6886", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "train EN/GE, test EN\n", + "accuracy score = 96.9%, log loss = 0.098, Brier loss = 0.049\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 0.97 0.99 0.98 389\n", + " 2 0.97 0.98 0.97 795\n", + " 3+ 0.98 0.87 0.92 206\n", + "\n", + " accuracy 0.97 1390\n", + " macro avg 0.97 0.95 0.96 1390\n", + "weighted avg 0.97 0.97 0.97 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "train EN/GE, test GE\n", + "accuracy score = 95.8%, log loss = 0.146, Brier loss = 0.070\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 0.97 0.97 0.97 389\n", + " 2 0.96 0.97 0.96 795\n", + " 3+ 0.94 0.89 0.92 206\n", + "\n", + " accuracy 0.96 1390\n", + " macro avg 0.96 0.94 0.95 1390\n", + "weighted avg 0.96 0.96 0.96 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train EN/GE, test EN" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } + ], + "source": [ + "clf_mx = logistic_regression_classifier(x_train_mx, y_train_mx, c=10)\n", + "_ = evaluate_classifier(y_test_en, None, clf_mx.predict_proba(x_test_en), labels, \"train EN/GE, test EN\", \"cm_nv_pr_MX_EN\")\n", + "_ = evaluate_classifier(y_test_ge, None, clf_mx.predict_proba(x_test_ge), labels, \"train EN/GE, test GE\", \"cm_nv_pr_MX_GE\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "9ehbi38DWNvu" }, - "text/html": [ - "
" + "source": [ + "By comparing to the above results, we observe that the domain-specific fine-tuning on the English training set has improved the scores, but not to a satisfactory level for the cross-language transfer cases." ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stdout", - "output_type": "stream", - "text": [ - "train EN/GE, test GE\n", - "accuracy score = 96.3%, log loss = 0.133, Brier loss = 0.063\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.97 0.97 0.97 389\n", - " 2 0.96 0.97 0.97 795\n", - " 3+ 0.94 0.90 0.92 206\n", - "\n", - " accuracy 0.96 1390\n", - " macro avg 0.96 0.95 0.95 1390\n", - "weighted avg 0.96 0.96 0.96 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "kSuSXjMDWNvv" + }, + "source": [ + "\n", + "\n", + "### 4.2. Task-specific fine-tuning\n", + "\n", + "An alternative to domain-specific fine-tuning is task-specific fine-tuning.\n", + "\n", + "The idea is to train a transformer model directly on the task at hand, in our case a sequence classification task.\n", + "The process is very similar to the masked language modeling used for domain-specific pre-training, except that\n", + "we load a sequence classification model using the class `AutoModelForSequenceClassification`.\n", + "\n", + "The following code tunes a sequence classification model that uses the English accident descriptions to predict\n", + "the number of vehicles involved.\n", + "On an AWS EC2 p2.xlarge instance, the run time is about 20 minutes." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_pr_MX_GE", - "format": "svg" + "cell_type": "code", + "execution_count": 49, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 172 + }, + "id": "N-aQe_a1WNvz", + "outputId": "f01eeb07-41de-401a-d7f8-b98781076f82", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 378, - 11, - 0 - ], - [ - 9, - 775, - 11 - ], - [ - 1, - 20, - 185 + "output_type": "stream", + "name": "stderr", + "text": [ + "Some weights of DistilBertForSequenceClassification were not initialized from the model checkpoint at distilbert-base-multilingual-cased and are newly initialized: ['pre_classifier.weight', 'classifier.weight', 'classifier.bias', 'pre_classifier.bias']\n", + "You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n" ] - ] + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "\n", + "
\n", + " \n", + " \n", + " [1390/1390 09:49, Epoch 2/2]\n", + "
\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
StepTraining Loss
6940.154100
13880.052800

" + ] + }, + "metadata": {} } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] + ], + "source": [ + "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", + "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model\n", + "model_cls = AutoModelForSequenceClassification.from_pretrained(model_name, num_labels=len(labels)).to(device)\n", + "\n", + "def compute_metrics(pred):\n", + " labels = pred.label_ids\n", + " preds = pred.predictions.argmax(-1)\n", + " f1 = f1_score(labels, preds, average=\"weighted\")\n", + " acc = accuracy_score(labels, preds)\n", + " return {\"accuracy\": acc, \"f1\": f1}\n", + "\n", + "# train the model\n", + "batch_size = 8\n", + "logging_steps = len(dataset_en[\"train\"]) // batch_size\n", + "training_args = TrainingArguments(\n", + " output_dir=\"models/\" + model_name + \"nv_epochs\",\n", + " num_train_epochs=2,\n", + " per_device_train_batch_size=batch_size,\n", + " per_device_eval_batch_size=batch_size,\n", + " metric_for_best_model=\"f1\",\n", + " logging_steps=logging_steps,\n", + " save_strategy=trainer_utils.IntervalStrategy.NO,\n", + ")\n", + "trainer = Trainer(model=model_cls, args=training_args,\n", + " compute_metrics=compute_metrics, train_dataset=dataset_en[\"train\"],\n", + " eval_dataset=dataset_en[\"test\"])\n", + "trainer.train();\n", + "trainer.save_model(\"models/\" + model_name + \"_nv\")" + ] + }, + { + "cell_type": "code", + "execution_count": 50, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 768 + }, + "id": "xkUclLPlWNv0", + "outputId": "ff7b4358-1252-43ae-ac27-1f3309b63bc2", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 + "text/html": [] }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "train EN, test EN\n", + "accuracy score = 99.6%, log loss = 0.025, Brier loss = 0.007\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 0.99 1.00 0.99 389\n", + " 2 1.00 1.00 1.00 795\n", + " 3+ 1.00 0.99 1.00 206\n", + "\n", + " accuracy 1.00 1390\n", + " macro avg 1.00 1.00 1.00 1390\n", + "weighted avg 1.00 1.00 1.00 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "

\n", + "
\n", + "\n", + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train EN/GE, test GE" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } - }, - "text/html": [ - "
" + ], + "source": [ + "# evaluate model performance using predictions on the English test set\n", + "predictions_en = trainer.predict(dataset_en[\"test\"])\n", + "_ = evaluate_classifier(predictions_en.label_ids, None, softmax(predictions_en.predictions, axis=1), labels, \"train EN, test EN\", \"cm_nv_tsk_EN_EN\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "clf_mx = logistic_regression_classifier(x_train_mx, y_train_mx, c=10)\n", - "_ = evaluate_classifier(y_test_en, None, clf_mx.predict_proba(x_test_en), labels, \"train EN/GE, test EN\", \"cm_nv_pr_MX_EN\")\n", - "_ = evaluate_classifier(y_test_ge, None, clf_mx.predict_proba(x_test_ge), labels, \"train EN/GE, test GE\", \"cm_nv_pr_MX_GE\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "9ehbi38DWNvu" - }, - "source": [ - "By comparing to the above results, we observe that the domain-specific fine-tuning on the English training set has improved the scores, but not to a satisfactory level for the cross-language transfer cases." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "kSuSXjMDWNvv" - }, - "source": [ - "\n", - "\n", - "### 4.2. Task-specific fine-tuning\n", - "\n", - "An alternative to domain-specific fine-tuning is task-specific fine-tuning.\n", - "\n", - "The idea is to train a transformer model directly on the task at hand, in our case a sequence classification task.\n", - "The process is very similar to the masked language modeling used for domain-specific pre-training, except that\n", - "we load a sequence classification model using the class `AutoModelForSequenceClassification`.\n", - "\n", - "The following code tunes a sequence classification model that uses the English accident descriptions to predict\n", - "the number of vehicles involved.\n", - "On an AWS EC2 p2.xlarge instance, the run time is about 20 minutes." - ] - }, - { - "cell_type": "code", - "execution_count": 44, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000 - }, - "id": "N-aQe_a1WNvz", - "outputId": "03d0c5d2-cfd7-410f-d7e7-ab0fb13ffd18", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "loading configuration file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/cf37a9dc282a679f121734d06f003625d14cfdaf55c14358c4c0b8e7e2b89ac9.7a727bd85e40715bec919a39cdd6f0aba27a8cd488f2d4e0f512448dcd02bf0f\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"distilbert-base-multilingual-cased\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"id2label\": {\n", - " \"0\": \"LABEL_0\",\n", - " \"1\": \"LABEL_1\",\n", - " \"2\": \"LABEL_2\"\n", - " },\n", - " \"initializer_range\": 0.02,\n", - " \"label2id\": {\n", - " \"LABEL_0\": 0,\n", - " \"LABEL_1\": 1,\n", - " \"LABEL_2\": 2\n", - " },\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"output_past\": true,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 119547\n", - "}\n", - "\n", - "loading weights file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/pytorch_model.bin from cache at /home/ubuntu/.cache/huggingface/transformers/7b48683e2e7ba71cd1d7d6551ac325eceee01db5c2f3e81cfbfd1ee7bb7877f2.c24097b0cf91dbc66977325325fd03112f0f13d0e3579abbffc8d1e45f8d0619\n", - "Some weights of the model checkpoint at distilbert-base-multilingual-cased were not used when initializing DistilBertForSequenceClassification: ['vocab_transform.weight', 'vocab_layer_norm.bias', 'vocab_transform.bias', 'vocab_projector.weight', 'vocab_layer_norm.weight', 'vocab_projector.bias']\n", - "- This IS expected if you are initializing DistilBertForSequenceClassification from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).\n", - "- This IS NOT expected if you are initializing DistilBertForSequenceClassification from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).\n", - "Some weights of DistilBertForSequenceClassification were not initialized from the model checkpoint at distilbert-base-multilingual-cased and are newly initialized: ['pre_classifier.bias', 'classifier.weight', 'pre_classifier.weight', 'classifier.bias']\n", - "You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n", - "PyTorch: setting up devices\n", - "The default value for the training argument `--report_to` will change in v5 (from all installed integrations to none). In v5, you will need to use `--report_to all` to get the same behavior as now. You should start updating your code and make this info disappear :-).\n", - "The following columns in the training set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: WEATHER7, WEATHER4, SUMMARY_GE, cls_hidden_state, WEATHER1, WEATHER6, INJSEVA, SCASEID, mean_hidden_state, NUMTOTV, WEATHER8, SUMMARY_EN, WEATHER3, index, words per case summary, WEATHER2, INJSEVB, level_0, WEATHER5. If WEATHER7, WEATHER4, SUMMARY_GE, cls_hidden_state, WEATHER1, WEATHER6, INJSEVA, SCASEID, mean_hidden_state, NUMTOTV, WEATHER8, SUMMARY_EN, WEATHER3, index, words per case summary, WEATHER2, INJSEVB, level_0, WEATHER5 are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "/home/ubuntu/anaconda3/envs/pytorch_latest_p37/lib/python3.7/site-packages/transformers/optimization.py:309: FutureWarning:\n", - "\n", - "This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning\n", - "\n", - "***** Running training *****\n", - " Num examples = 5559\n", - " Num Epochs = 2\n", - " Instantaneous batch size per device = 8\n", - " Total train batch size (w. parallel, distributed & accumulation) = 8\n", - " Gradient Accumulation steps = 1\n", - " Total optimization steps = 1390\n" - ] }, { - "data": { - "text/html": [ - "\n", - "
\n", - " \n", - " \n", - " [1390/1390 03:17, Epoch 2/2]\n", - "
\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
StepTraining Loss
6940.319600
13880.079000

" + "cell_type": "code", + "execution_count": 51, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 768 + }, + "id": "AOQnMgLKWNv0", + "outputId": "669511ab-ace8-4c29-a862-84582363c360", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [] + }, + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "train EN, test GE\n", + "accuracy score = 99.6%, log loss = 0.025, Brier loss = 0.007\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 0.99 1.00 0.99 389\n", + " 2 1.00 1.00 1.00 795\n", + " 3+ 1.00 0.99 1.00 206\n", + "\n", + " accuracy 1.00 1390\n", + " macro avg 1.00 1.00 1.00 1390\n", + "weighted avg 1.00 1.00 1.00 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "

\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } ], - "text/plain": [ - "" + "source": [ + "# evaluate model performance using predictions on the German test set (cross-lingual test)\n", + "predictions_ge = trainer.predict(dataset_ge[\"test\"])\n", + "_ = evaluate_classifier(predictions_ge.label_ids, None, softmax(predictions_ge.predictions, axis=1), labels, \"train EN, test GE\", \"cm_nv_task_EN_GE\")" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stderr", - "output_type": "stream", - "text": [ - "\n", - "\n", - "Training completed. Do not forget to share your model on huggingface.co/models =)\n", - "\n", - "\n", - "Saving model checkpoint to models/distilbert-base-multilingual-cased_nv\n", - "Configuration saved in models/distilbert-base-multilingual-cased_nv/config.json\n", - "Model weights saved in models/distilbert-base-multilingual-cased_nv/pytorch_model.bin\n" - ] - } - ], - "source": [ - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model\n", - "model_cls = AutoModelForSequenceClassification.from_pretrained(model_name, num_labels=len(labels)).to(device)\n", - "\n", - "def compute_metrics(pred):\n", - " labels = pred.label_ids\n", - " preds = pred.predictions.argmax(-1)\n", - " f1 = f1_score(labels, preds, average=\"weighted\")\n", - " acc = accuracy_score(labels, preds)\n", - " return {\"accuracy\": acc, \"f1\": f1}\n", - "\n", - "# train the model\n", - "batch_size = 8\n", - "logging_steps = len(dataset_en[\"train\"]) // batch_size\n", - "training_args = TrainingArguments(\n", - " output_dir=\"models/\" + model_name + \"nv_epochs\",\n", - " num_train_epochs=2,\n", - " per_device_train_batch_size=batch_size,\n", - " per_device_eval_batch_size=batch_size,\n", - " metric_for_best_model=\"f1\",\n", - " logging_steps=logging_steps,\n", - " save_strategy=trainer_utils.IntervalStrategy.NO,\n", - ")\n", - "trainer = Trainer(model=model_cls, args=training_args,\n", - " compute_metrics=compute_metrics, train_dataset=dataset_en[\"train\"],\n", - " eval_dataset=dataset_en[\"test\"])\n", - "trainer.train();\n", - "trainer.save_model(\"models/\" + model_name + \"_nv\")" - ] - }, - { - "cell_type": "code", - "execution_count": 45, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 877 + "cell_type": "markdown", + "metadata": { + "id": "073wX0bfWNv0", + "pycharm": { + "name": "#%% md\n" + } + }, + "source": [ + "The scores on the English test set have improved to fantastic levels.\n", + "\n", + "What is even more impressive is the performance on cross-lingual transfer:\n", + "Despite the fact that the model has been trained on English texts only,\n", + "its performance scores on the German test set are very good.\n", + "\n", + "This is an excellent result!" + ] }, - "id": "xkUclLPlWNv0", - "outputId": "f87528cd-a5c1-422b-c509-4950b15c6128", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "The following columns in the test set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: WEATHER7, WEATHER4, SUMMARY_GE, cls_hidden_state, WEATHER1, WEATHER6, INJSEVA, SCASEID, mean_hidden_state, NUMTOTV, WEATHER8, SUMMARY_EN, WEATHER3, index, words per case summary, WEATHER2, INJSEVB, level_0, WEATHER5. If WEATHER7, WEATHER4, SUMMARY_GE, cls_hidden_state, WEATHER1, WEATHER6, INJSEVA, SCASEID, mean_hidden_state, NUMTOTV, WEATHER8, SUMMARY_EN, WEATHER3, index, words per case summary, WEATHER2, INJSEVB, level_0, WEATHER5 are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "***** Running Prediction *****\n", - " Num examples = 1390\n", - " Batch size = 8\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "F0fTUwd7WNv0", + "pycharm": { + "name": "#%% md\n" + } + }, + "source": [ + "\n", + "\n", + "## 5. Understand Predictions Errors and Interpret Predictions\n", + "\n", + "In this section you will learn how to analyze prediction errors and how to interpret predictions.\n", + "\n", + "We will study a more challenging example.\n" + ] }, { - "data": { - "text/html": [ - "\n", - "
\n", - " \n", - " \n", - " [174/174 00:15]\n", - "
\n", - " " - ], - "text/plain": [ - "" + "cell_type": "markdown", + "metadata": { + "id": "brifr977WNv0" + }, + "source": [ + "\n", + "\n", + "### 5.1 Case Study: Use Accident Descriptions to Identify Bodily Injury\n", + "\n", + "As seen in the previous section,\n", + "predicting the number of vehicles from the available accident descriptions is a\n", + "relatively easy task for the transformer model, even in a multi-lingual situation.\n", + "\n", + "Therefore, we will turn to a somewhat more difficult task: identifying cases which lead to bodily injuries. We cuse the column `INJSEVB` as label.\n", + "\n", + "The process is identical to the previous case study:\n", + "* Start from the original dataset, enrich it with hidden states produced by the original transformer model\n", + " (before domain-specific fine-tuning).\n", + " Given the experience from the previous task, we use the mean pooling output.\n", + "* For comparison, we also load the encodings produced by the transformer model after domain-specific fine-tuning.\n", + "* Define the labels.\n", + "* Fit a dummy classifier, which always predicts the most frequent class.\n", + "* Fit a regression classifier, and evaluate its performance.\n", + "\n", + "In case you have skipped Section [4.1 Domain-specific finetuning](#domain_finetuning), the dataset `../datasets/dataset_en_pretrained` will not be available.\n", + "In this case simply comment out the last lines of each block below." ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stdout", - "output_type": "stream", - "text": [ - "train EN, test EN\n", - "accuracy score = 99.4%, log loss = 0.032, Brier loss = 0.012\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.99 1.00 0.99 389\n", - " 2 1.00 0.99 0.99 795\n", - " 3+ 0.99 0.99 0.99 206\n", - "\n", - " accuracy 0.99 1390\n", - " macro avg 0.99 0.99 0.99 1390\n", - "weighted avg 0.99 0.99 0.99 1390\n", - "\n" - ] + "cell_type": "code", + "execution_count": 52, + "metadata": { + "id": "k8StUs-DWNv1", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [], + "source": [ + "dataset_en = load_from_disk(\"./datasets/dataset_en\")\n", + "dataset_ge = load_from_disk(\"./datasets/dataset_ge\")\n", + "dataset_mx = load_from_disk(\"./datasets/dataset_mx\")\n", + "#dataset_pr = load_from_disk(\"./datasets/dataset_en_pretrained\")\n", + "\n", + "# map injuries\n", + "labels = [\"0\", \"1\"]\n", + "dataset_en = dataset_en.rename_column(\"INJSEVB\", \"labels\")\n", + "dataset_ge = dataset_ge.rename_column(\"INJSEVB\", \"labels\")\n", + "dataset_mx = dataset_mx.rename_column(\"INJSEVB\", \"labels\")\n", + "#dataset_pr = dataset_pr.rename_column(\"INJSEVB\", \"labels\")\n", + "\n", + "x_train_en, y_train_en, x_test_en, y_test_en = get_xy(dataset_en, \"mean_hidden_state\", \"labels\")\n", + "x_train_ge, y_train_ge, x_test_ge, y_test_ge = get_xy(dataset_ge, \"mean_hidden_state\", \"labels\")\n", + "x_train_mx, y_train_mx, x_test_mx, y_test_mx = get_xy(dataset_mx, \"mean_hidden_state\", \"labels\")\n", + "#x_train_pr, y_train_pr, x_test_pr, y_test_pr = get_xy(dataset_pr, \"mean_hidden_state\", \"labels\")" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_tsk_EN_EN", - "format": "svg" + "cell_type": "code", + "execution_count": 53, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 750 + }, + "id": "19S0Ps_2WNv1", + "outputId": "5f5d7919-094a-4279-bf6c-7a494a0249e1", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 389, - 0, - 0 - ], - [ - 4, - 789, - 2 - ], - [ - 1, - 2, - 203 + "output_type": "stream", + "name": "stdout", + "text": [ + "Dummy classifier\n", + "accuracy score = 58.7%, log loss = 0.679, Brier loss = 0.486\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 0 0.59 1.00 0.74 816\n", + " 1 0.00 0.00 0.00 574\n", + "\n", + " accuracy 0.59 1390\n", + " macro avg 0.29 0.50 0.37 1390\n", + "weighted avg 0.34 0.59 0.43 1390\n", + "\n" ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 + "metadata": {} + } + ], + "source": [ + "# fit dummy classifier\n", + "clf_dummy = dummy_classifier(x_train_en, y_train_en)\n", + "_ = evaluate_classifier(y_test_en, None, clf_dummy.predict_proba(x_test_en), labels, \"Dummy classifier\", \"cm_inj_dummy\")" + ] + }, + { + "cell_type": "code", + "execution_count": 54, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 750 + }, + "id": "1-OxWef7WNv1", + "outputId": "993423cc-8507-43cc-f684-ea58d9f76a0f", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Logistic regression, DistilBERT\n", + "accuracy score = 80.1%, log loss = 0.400, Brier loss = 0.259\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 0 0.83 0.83 0.83 816\n", + " 1 0.76 0.75 0.76 574\n", + "\n", + " accuracy 0.80 1390\n", + " macro avg 0.79 0.79 0.79 1390\n", + "weighted avg 0.80 0.80 0.80 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train EN, test EN" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } + ], + "source": [ + "# fit logistic regression classifier to the encoded English texts (by the original DistilBERT model)\n", + "clf_en = logistic_regression_classifier(x_train_en, y_train_en, c=10)\n", + "_ = evaluate_classifier(y_test_en, None, clf_en.predict_proba(x_test_en), labels, \"Logistic regression, DistilBERT\", \"cm_inj_lr\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "yXv_i1aWWNv1" }, - "text/html": [ - "
" + "source": [ + "In case you have skipped Section [4.1 Domain-specific finetuning](#domain_finetuning), please also skip the following cell." ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# evaluate model performance using predictions on the English test set\n", - "predictions_en = trainer.predict(dataset_en[\"test\"])\n", - "_ = evaluate_classifier(predictions_en.label_ids, None, softmax(predictions_en.predictions, axis=1), labels, \"train EN, test EN\", \"cm_nv_tsk_EN_EN\")" - ] - }, - { - "cell_type": "code", - "execution_count": 46, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 877 }, - "id": "AOQnMgLKWNv0", - "outputId": "938df424-299f-4ee1-ab6e-537c0e1e754d", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "The following columns in the test set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: WEATHER7, WEATHER4, SUMMARY_GE, cls_hidden_state, WEATHER1, WEATHER6, INJSEVA, SCASEID, mean_hidden_state, NUMTOTV, WEATHER8, SUMMARY_EN, WEATHER3, index, words per case summary, WEATHER2, INJSEVB, level_0, WEATHER5. If WEATHER7, WEATHER4, SUMMARY_GE, cls_hidden_state, WEATHER1, WEATHER6, INJSEVA, SCASEID, mean_hidden_state, NUMTOTV, WEATHER8, SUMMARY_EN, WEATHER3, index, words per case summary, WEATHER2, INJSEVB, level_0, WEATHER5 are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "***** Running Prediction *****\n", - " Num examples = 1390\n", - " Batch size = 8\n" - ] + "cell_type": "code", + "execution_count": 55, + "metadata": { + "id": "dqrYOaCAWNv1", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [], + "source": [ + "# fit logistic regression classifier to the encoded English texts (by the fine-tuned DistilBERT model)\n", + "#clf_pr = logistic_regression_classifier(x_train_pr, y_train_pr, c=10)\n", + "#_ = evaluate_classifier(y_test_pr, None, clf_pr.predict_proba(x_test_pr), labels, \"Logistic regression - 2 epochs pre-training\", \"cm_inj_pr\")" + ] }, { - "name": "stdout", - "output_type": "stream", - "text": [ - "train EN, test GE\n", - "accuracy score = 98.9%, log loss = 0.046, Brier loss = 0.019\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 1 0.99 1.00 0.99 389\n", - " 2 0.99 0.99 0.99 795\n", - " 3+ 0.97 0.97 0.97 206\n", - "\n", - " accuracy 0.99 1390\n", - " macro avg 0.98 0.99 0.99 1390\n", - "weighted avg 0.99 0.99 0.99 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "nzhkQaHsWNv2", + "pycharm": { + "name": "#%% md\n" + } + }, + "source": [ + "We observe the following:\n", + "* The accuracy score of the dummy classifier is 59%.\n", + "* Using the logistic regression classifier on the outputs of the DistilBERT model with two epochs of domain-specific fine-tuning improves the scores compared to using the outputs of the plain DistilBERT model.\n", + "* The performance on the class `0` is better than on the class `1` because of a large number of false positives.\n", + "\n", + "Next, we perform task-specific fine-tuning.\n", + "On an AWS EC2 p2.xlarge instance, the run time is about 20 minutes." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_nv_task_EN_GE", - "format": "svg" + "cell_type": "code", + "execution_count": 56, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 172 + }, + "id": "D2usIbC0WNv2", + "outputId": "fc6142fe-7b50-4f29-a1ad-0ede7f341a97", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 1 ", - " 2 ", - " 3+ " - ], - "xaxis": "x", - "y": [ - " 1 ", - " 2 ", - " 3+ " - ], - "yaxis": "y", - "z": [ - [ - 389, - 0, - 0 - ], - [ - 3, - 786, - 6 - ], - [ - 1, - 5, - 200 + "output_type": "stream", + "name": "stderr", + "text": [ + "Some weights of DistilBertForSequenceClassification were not initialized from the model checkpoint at distilbert-base-multilingual-cased and are newly initialized: ['pre_classifier.weight', 'classifier.weight', 'classifier.bias', 'pre_classifier.bias']\n", + "You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n" ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "\n", + "
\n", + " \n", + " \n", + " [1390/1390 09:47, Epoch 2/2]\n", + "
\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
StepTraining Loss
6940.548600
13880.353900

" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "train EN, test GE" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } - }, - "text/html": [ - "

" + ], + "source": [ + "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", + "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model\n", + "model_cls_inj = AutoModelForSequenceClassification.from_pretrained(model_name, num_labels=len(labels)).to(device)\n", + "batch_size = 8\n", + "logging_steps = len(dataset_en[\"train\"]) // batch_size\n", + "training_args = TrainingArguments(\n", + " output_dir=\"models/\" + model_name + \"inj_epochs\",\n", + " num_train_epochs= 2,\n", + " per_device_train_batch_size=batch_size,\n", + " per_device_eval_batch_size=batch_size,\n", + " metric_for_best_model=\"f1\",\n", + " disable_tqdm=False,\n", + " logging_steps=logging_steps,\n", + " save_strategy=trainer_utils.IntervalStrategy.NO,\n", + ")\n", + "def compute_metrics(pred):\n", + " labels = pred.label_ids\n", + " preds = pred.predictions.argmax(-1)\n", + " f1 = f1_score(labels, preds, average=\"weighted\")\n", + " acc = accuracy_score(labels, preds)\n", + " return {\"accuracy\": acc, \"f1\": f1}\n", + "trainer = Trainer(model=model_cls_inj, args=training_args,\n", + " compute_metrics=compute_metrics, train_dataset=dataset_en[\"train\"], eval_dataset=dataset_en[\"test\"])\n", + "trainer.train();\n", + "trainer.save_model(\"models/\" + model_name + \"_inj\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# evaluate model performance using predictions on the German test set (cross-lingual test)\n", - "predictions_ge = trainer.predict(dataset_ge[\"test\"])\n", - "_ = evaluate_classifier(predictions_ge.label_ids, None, softmax(predictions_ge.predictions, axis=1), labels, \"train EN, test GE\", \"cm_nv_task_EN_GE\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "073wX0bfWNv0", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "The scores on the English test set have improved to fantastic levels.\n", - "\n", - "What is even more impressive is the performance on cross-lingual transfer:\n", - "Despite the fact that the model has been trained on English texts only,\n", - "its performance scores on the German test set are very good.\n", - "\n", - "This is an excellent result!" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "F0fTUwd7WNv0", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "\n", - "\n", - "## 5. Understand Predictions Errors and Interpret Predictions\n", - "\n", - "In this section you will learn how to analyze prediction errors and how to interpret predictions.\n", - "\n", - "We will study a more challenging example.\n" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "brifr977WNv0" - }, - "source": [ - "\n", - "\n", - "### 5.1 Case Study: Use Accident Descriptions to Identify Bodily Injury\n", - "\n", - "As seen in the previous section,\n", - "predicting the number of vehicles from the available accident descriptions is a\n", - "relatively easy task for the transformer model, even in a multi-lingual situation.\n", - "\n", - "Therefore, we will turn to a somewhat more difficult task: identifying cases which lead to bodily injuries. We cuse the column `INJSEVB` as label.\n", - "\n", - "The process is identical to the previous case study:\n", - "* Start from the original dataset, enrich it with hidden states produced by the original transformer model\n", - " (before domain-specific fine-tuning).\n", - " Given the experience from the previous task, we use the mean pooling output.\n", - "* For comparison, we also load the encodings produced by the transformer model after domain-specific fine-tuning. \n", - "* Define the labels.\n", - "* Fit a dummy classifier, which always predicts the most frequent class.\n", - "* Fit a regression classifier, and evaluate its performance.\n", - "\n", - "In case you have skipped Section [4.1 Domain-specific finetuning](#domain_finetuning), the dataset `../datasets/dataset_en_pretrained` will not be available.\n", - "In this case simply comment out the last lines of each block below." - ] - }, - { - "cell_type": "code", - "execution_count": 47, - "metadata": { - "id": "k8StUs-DWNv1", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [], - "source": [ - "dataset_en = load_from_disk(\"./datasets/dataset_en\")\n", - "dataset_ge = load_from_disk(\"./datasets/dataset_ge\")\n", - "dataset_mx = load_from_disk(\"./datasets/dataset_mx\")\n", - "dataset_pr = load_from_disk(\"./datasets/dataset_en_pretrained\")\n", - "\n", - "# map injuries\n", - "labels = [\"0\", \"1\"]\n", - "dataset_en = dataset_en.rename_column(\"INJSEVB\", \"labels\")\n", - "dataset_ge = dataset_ge.rename_column(\"INJSEVB\", \"labels\")\n", - "dataset_mx = dataset_mx.rename_column(\"INJSEVB\", \"labels\")\n", - "dataset_pr = dataset_pr.rename_column(\"INJSEVB\", \"labels\")\n", - "\n", - "x_train_en, y_train_en, x_test_en, y_test_en = get_xy(dataset_en, \"mean_hidden_state\", \"labels\")\n", - "x_train_ge, y_train_ge, x_test_ge, y_test_ge = get_xy(dataset_ge, \"mean_hidden_state\", \"labels\")\n", - "x_train_mx, y_train_mx, x_test_mx, y_test_mx = get_xy(dataset_mx, \"mean_hidden_state\", \"labels\")\n", - "x_train_pr, y_train_pr, x_test_pr, y_test_pr = get_xy(dataset_pr, \"mean_hidden_state\", \"labels\")" - ] - }, - { - "cell_type": "code", - "execution_count": 48, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 750 }, - "id": "19S0Ps_2WNv1", - "outputId": "e0d46046-ece0-4a63-ff38-5cc21603d4cc", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "Dummy classifier\n", - "accuracy score = 58.7%, log loss = 0.679, Brier loss = 0.486\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 0 0.59 1.00 0.74 816\n", - " 1 0.00 0.00 0.00 574\n", - "\n", - " accuracy 0.59 1390\n", - " macro avg 0.29 0.50 0.37 1390\n", - "weighted avg 0.34 0.59 0.43 1390\n", - "\n" - ] + "cell_type": "code", + "execution_count": 57, + "metadata": { + "id": "7ejzOSBWWNv2" + }, + "outputs": [], + "source": [ + "# Execute the following line to load the trained model from disk.\n", + "# trainer = Trainer(AutoModelForSequenceClassification.from_pretrained(model_name+\"_inj\", num_labels=len(labels)).to(torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")))" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_inj_dummy", - "format": "svg" + "cell_type": "code", + "execution_count": 58, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 750 + }, + "id": "mvIWMTR2WNv2", + "outputId": "2fb46630-ecf3-4ae1-ca8e-323628f2171c", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 0 ", - " 1 " - ], - "xaxis": "x", - "y": [ - " 0 ", - " 1 " - ], - "yaxis": "y", - "z": [ - [ - 816, - 0 - ], - [ - 574, - 0 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] + "output_type": "display_data", + "data": { + "text/plain": [ + "" ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } + "text/html": [] }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "DistilBERT classifier - 2 epochs task-specific\n", + "accuracy score = 89.1%, log loss = 0.297, Brier loss = 0.174\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 0 0.91 0.90 0.91 816\n", + " 1 0.86 0.87 0.87 574\n", + "\n", + " accuracy 0.89 1390\n", + " macro avg 0.89 0.89 0.89 1390\n", + "weighted avg 0.89 0.89 0.89 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Dummy classifier" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } - }, - "text/html": [ - "
" + ], + "source": [ + "# evaluate model performance using predictions on the English test set\n", + "predictions_en = trainer.predict(dataset_en[\"test\"])\n", + "_ = evaluate_classifier(predictions_en.label_ids, None, softmax(predictions_en.predictions, axis=1), labels,\n", + " \"DistilBERT classifier - 2 epochs task-specific\", \"cm_inj_tsk\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# fit dummy classifier\n", - "clf_dummy = dummy_classifier(x_train_en, y_train_en)\n", - "_ = evaluate_classifier(y_test_en, None, clf_dummy.predict_proba(x_test_en), labels, \"Dummy classifier\", \"cm_inj_dummy\")" - ] - }, - { - "cell_type": "code", - "execution_count": 49, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 750 }, - "id": "1-OxWef7WNv1", - "outputId": "727ad5e8-d16a-4b14-c522-34ca1074d18c", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "Logistic regression, DistilBERT\n", - "accuracy score = 80.1%, log loss = 0.400, Brier loss = 0.259\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 0 0.83 0.83 0.83 816\n", - " 1 0.76 0.75 0.76 574\n", - "\n", - " accuracy 0.80 1390\n", - " macro avg 0.79 0.79 0.79 1390\n", - "weighted avg 0.80 0.80 0.80 1390\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "OcogYs7wWNv2" + }, + "source": [ + "We observe the following:\n", + "* Task-specific fine-tuning has further improved all scores.\n", + "* There is still a relatively large number of false positives." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_inj_lr", - "format": "svg" + "cell_type": "markdown", + "metadata": { + "id": "udjhQrSpWNv2", + "pycharm": { + "name": "#%% md\n" } - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 0 ", - " 1 " - ], - "xaxis": "x", - "y": [ - " 0 ", - " 1 " - ], - "yaxis": "y", - "z": [ - [ - 680, - 136 - ], - [ - 141, - 433 + }, + "source": [ + "\n", + "\n", + "### 5.2. Investigate False Positives and False Negatives\n", + "\n", + "To investigate the prediction errors, we export the predictions into an Excel file with the following columns:\n", + "\n", + "| column | meaning |\n", + "|---|---|\n", + "| `SCASEID` | unique identification number of the case |\n", + "| `SUMMARY_EN` | description of the accident, in English |\n", + "| `SUMMARY_TRUNCATED` | description of the accident, in English, truncated to a length of 512 tokens |\n", + "| `INJSEVA` | most serious injury sustained in the case, as per Police Accident Report |\n", + "| `labels` | indicator of odily injury `INJSEVB` (true label) |\n", + "| `pred` | predicted label |\n", + "| `0` | probability of negative label |\n", + "| `1` | probability of positive label |" + ] + }, + { + "cell_type": "code", + "execution_count": 59, + "metadata": { + "id": "ZAfQV892WNv3" + }, + "outputs": [], + "source": [ + "# export prediction results for error analysis\n", + "dataset_en.set_format(type=\"pandas\")\n", + "df_res = pd.concat([dataset_en[\"test\"].to_pandas(),\n", + " pd.DataFrame(data=softmax(predictions_en.predictions, axis=1), columns=[\"0\", \"1\"]),\n", + " pd.DataFrame(data=np.argmax(predictions_en.predictions, -1).reshape((-1,1)), columns=['pred'])\n", + " ], axis=1)\n", + "df_res = df_res[[\"SCASEID\", \"SUMMARY_EN\", \"INJSEVA\", \"labels\", \"pred\", \"0\", \"1\"]]\n", + "dataset_en.set_format()\n", + "for i in range(df_res.shape[0]):\n", + " df_res.loc[i, \"SUMMARY_TRUNCATED\"] = tokenizer.convert_tokens_to_string(tokenizer.tokenize(df_res.loc[i, \"SUMMARY_EN\"], truncation=True))\n", + "df_res.to_excel(\"./results/error_analysis_inj.xlsx\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "OR2KmOV2WNv3" + }, + "source": [ + "The first step of the error analysis is to inspect the samples producing false negative and false positive predictions.\n", + "Reading every single text would be very tedious, therefore it is worthwhile focusing on those examples where the probability assigned to the false prediction was high,\n", + "i.e., cases where the model was confident but wrong.\n", + "\n", + "Looking at the false negatives, we observe that there are many cases where the model assigns a high probability to negative.\n", + "We suspect that truncation is responsible for many of the false negatives – the relevant part of the text was discarded.\n", + "\n", + "To address this issue, we split the text into slightly overlapping chunks,\n", + "run the prediction on each chunk and apply the logical OR-function to the results.\n", + "We implement this functionality in a simple function that returns an additional column `pred`,\n", + "containing a list of predicted labels, with one element for each chunk." + ] + }, + { + "cell_type": "code", + "execution_count": 60, + "metadata": { + "id": "oEKN3riTWNv3" + }, + "outputs": [], + "source": [ + "def predict_with_overflow(x, model, feature):\n", + " t = tokenizer(x[feature], truncation=True, padding=True, return_overflowing_tokens=True)\n", + " input_ids = torch.tensor(t[\"input_ids\"]).to(model.device)\n", + " attention_mask = torch.tensor(t[\"attention_mask\"]).to(model.device)\n", + " with torch.no_grad():\n", + " preds = np.argmax(model(input_ids, attention_mask).logits.cpu(), -1)\n", + " return {\"preds\": preds}" + ] + }, + { + "cell_type": "code", + "execution_count": 61, + "metadata": { + "id": "ubKYwONYWNv3" + }, + "outputs": [], + "source": [ + "# Execute the following lines to load the trained model and the okenizer from disk.\n", + "# model_cls_inj = AutoModelForSequenceClassification.from_pretrained(\"models/\" + model_name + \"_inj\", num_labels=len(labels)).to(torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\"))\n", + "# tokenizer = AutoTokenizer.from_pretrained(model_name)" + ] + }, + { + "cell_type": "code", + "execution_count": 62, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 81, + "referenced_widgets": [ + "417140ff131946deb837591bcd4798c0", + "d2840413cb3647918dd209ed02f8adbd", + "16b8498863764a08a77f8ac777a87436", + "e1a7fdf268d94e34ad6a16435504d532", + "2ac6537fe9114614a24a3f66d05dad95", + "3919bfdaf9da46368520911822adb2fc", + "a60d72a71f0540178966c622ec56f736", + "f00bed838d0f4c3ab299ce5262b6a798", + "cdde89a5a3fc4f43868f2f6015c2c2e9", + "1bdb39a03e4648929713a5cc06398640", + "51815cc800eb43809ffda39f1189659b", + "7673cb93bbdb4a6b892b16fd4d1ce652", + "564ac17789894c88a217ffcd9ba0ca76", + "1365493485fa468ea3349de592e3907f", + "94da900685a34397b689f7304710126b", + "7078410ec64a478f9719b2f6668e814a", + "325997139c4140b39c3fd1b7d2052bd9", + "0b65902e95034eeab6c6ef9405d9548c", + "d85bc144efd54d62aba3878f87a6f990", + "3e621df89e934cbf8362c79cb02e9eb5", + "ad168d9ef0f6401d86983bb577b76dd5", + "82ec607265204206a33103ecf0e98d21" ] - ] + }, + "id": "hMoqL5aHWNv3", + "outputId": "d42f5c6f-a386-423c-aab2-c58967005836" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Map: 0%| | 0/1390 [00:00\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Logistic regression, DistilBERT" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } - }, - "text/html": [ - "
" + ], + "source": [ + "_ = evaluate_classifier(predictions_en.label_ids, dataset_en_overflow[\"pred\"], None, labels,\n", + " \"DistilBERT classifier - split inputs\", \"cm_inj_split\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# fit logistic regression classifier to the encoded English texts (by the original DistilBERT model)\n", - "clf_en = logistic_regression_classifier(x_train_en, y_train_en, c=10)\n", - "_ = evaluate_classifier(y_test_en, None, clf_en.predict_proba(x_test_en), labels, \"Logistic regression, DistilBERT\", \"cm_inj_lr\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "yXv_i1aWWNv1" - }, - "source": [ - "In case you have skipped Section [4.1 Domain-specific finetuning](#domain_finetuning), please also skip the following cell." - ] - }, - { - "cell_type": "code", - "execution_count": 50, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 750 - }, - "id": "dqrYOaCAWNv1", - "outputId": "0fc5f048-6a88-4b78-d0ec-51167b6f2773", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Logistic regression - 2 epochs pre-training\n", - "accuracy score = 82.7%, log loss = 0.375, Brier loss = 0.238\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 0 0.85 0.86 0.85 816\n", - " 1 0.79 0.79 0.79 574\n", - "\n", - " accuracy 0.83 1390\n", - " macro avg 0.82 0.82 0.82 1390\n", - "weighted avg 0.83 0.83 0.83 1390\n", - "\n" - ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_inj_pr", - "format": "svg" - } - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 0 ", - " 1 " - ], - "xaxis": "x", - "y": [ - " 0 ", - " 1 " - ], - "yaxis": "y", - "z": [ - [ - 698, - 118 - ], - [ - 122, - 452 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Logistic regression - 2 epochs pre-training" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } - } - } + "cell_type": "code", + "execution_count": 64, + "metadata": { + "id": "mOG699NKWNv4" }, - "text/html": [ - "
" + "outputs": [], + "source": [ + "dataset_en_overflow.set_format(type=\"pandas\")\n", + "df_res = dataset_en_overflow.to_pandas()\n", + "df_res = df_res[[\"SCASEID\", \"SUMMARY_EN\", \"INJSEVA\", \"labels\", \"pred\"]]\n", + "dataset_en.set_format()\n", + "for i in range(df_res.shape[0]):\n", + " df_res.loc[i, \"SUMMARY_TRUNCATED\"] = tokenizer.convert_tokens_to_string(tokenizer.tokenize(df_res.loc[i, \"SUMMARY_EN\"], truncation=True))\n", + "df_res.to_excel(\"./results/error_analysis_inj_overflow.xlsx\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# fit logistic regression classifier to the encoded English texts (by the fine-tuned DistilBERT model)\n", - "clf_pr = logistic_regression_classifier(x_train_pr, y_train_pr, c=10)\n", - "_ = evaluate_classifier(y_test_pr, None, clf_pr.predict_proba(x_test_pr), labels, \"Logistic regression - 2 epochs pre-training\", \"cm_inj_pr\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "nzhkQaHsWNv2", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "We observe the following:\n", - "* The accuracy score of the dummy classifier is 59%.\n", - "* Using the logistic regression classifier on the outputs of the DistilBERT model with two epochs of domain-specific fine-tuning improves the scores compared to using the outputs of the plain DistilBERT model.\n", - "* The performance on the class `0` is better than on the class `1` because of a large number of false positives.\n", - "\n", - "Next, we perform task-specific fine-tuning.\n", - "On an AWS EC2 p2.xlarge instance, the run time is about 20 minutes." - ] - }, - { - "cell_type": "code", - "execution_count": 51, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000 - }, - "id": "D2usIbC0WNv2", - "outputId": "935fcaa6-35e4-4fe0-a920-428303c764c6", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "loading configuration file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/cf37a9dc282a679f121734d06f003625d14cfdaf55c14358c4c0b8e7e2b89ac9.7a727bd85e40715bec919a39cdd6f0aba27a8cd488f2d4e0f512448dcd02bf0f\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"distilbert-base-multilingual-cased\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"initializer_range\": 0.02,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"output_past\": true,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 119547\n", - "}\n", - "\n", - "loading weights file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/pytorch_model.bin from cache at /home/ubuntu/.cache/huggingface/transformers/7b48683e2e7ba71cd1d7d6551ac325eceee01db5c2f3e81cfbfd1ee7bb7877f2.c24097b0cf91dbc66977325325fd03112f0f13d0e3579abbffc8d1e45f8d0619\n", - "Some weights of the model checkpoint at distilbert-base-multilingual-cased were not used when initializing DistilBertForSequenceClassification: ['vocab_transform.weight', 'vocab_layer_norm.bias', 'vocab_transform.bias', 'vocab_projector.weight', 'vocab_layer_norm.weight', 'vocab_projector.bias']\n", - "- This IS expected if you are initializing DistilBertForSequenceClassification from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).\n", - "- This IS NOT expected if you are initializing DistilBertForSequenceClassification from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).\n", - "Some weights of DistilBertForSequenceClassification were not initialized from the model checkpoint at distilbert-base-multilingual-cased and are newly initialized: ['pre_classifier.bias', 'classifier.weight', 'pre_classifier.weight', 'classifier.bias']\n", - "You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n", - "PyTorch: setting up devices\n", - "The default value for the training argument `--report_to` will change in v5 (from all installed integrations to none). In v5, you will need to use `--report_to all` to get the same behavior as now. You should start updating your code and make this info disappear :-).\n", - "The following columns in the training set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: mean_hidden_state, words per case summary, WEATHER7, WEATHER2, WEATHER4, NUMTOTV, SUMMARY_GE, WEATHER8, INJSEVA, SCASEID, SUMMARY_EN, index, WEATHER3, level_0, cls_hidden_state, WEATHER5, WEATHER1, WEATHER6. If mean_hidden_state, words per case summary, WEATHER7, WEATHER2, WEATHER4, NUMTOTV, SUMMARY_GE, WEATHER8, INJSEVA, SCASEID, SUMMARY_EN, index, WEATHER3, level_0, cls_hidden_state, WEATHER5, WEATHER1, WEATHER6 are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "/home/ubuntu/anaconda3/envs/pytorch_latest_p37/lib/python3.7/site-packages/transformers/optimization.py:309: FutureWarning:\n", - "\n", - "This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning\n", - "\n", - "***** Running training *****\n", - " Num examples = 5559\n", - " Num Epochs = 2\n", - " Instantaneous batch size per device = 8\n", - " Total train batch size (w. parallel, distributed & accumulation) = 8\n", - " Gradient Accumulation steps = 1\n", - " Total optimization steps = 1390\n" - ] }, { - "data": { - "text/html": [ - "\n", - "
\n", - " \n", - " \n", - " [1390/1390 03:17, Epoch 2/2]\n", - "
\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
StepTraining Loss
6940.537200
13880.316700

" - ], - "text/plain": [ - "" + "cell_type": "markdown", + "metadata": { + "id": "MNP9SIeHWNv4" + }, + "source": [ + "The number of false negatives has reduced significantly, as expected, and the accuracy score has improved.\n", + "Since we have not implemented a logic to combine the predicted probabilities of the different chunks, the log loss and Brier loss cannot be evaluated in this case." ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stderr", - "output_type": "stream", - "text": [ - "\n", - "\n", - "Training completed. Do not forget to share your model on huggingface.co/models =)\n", - "\n", - "\n", - "Saving model checkpoint to models/distilbert-base-multilingual-cased_inj\n", - "Configuration saved in models/distilbert-base-multilingual-cased_inj/config.json\n", - "Model weights saved in models/distilbert-base-multilingual-cased_inj/pytorch_model.bin\n" - ] - } - ], - "source": [ - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model \n", - "model_cls_inj = AutoModelForSequenceClassification.from_pretrained(model_name, num_labels=len(labels)).to(device)\n", - "batch_size = 8\n", - "logging_steps = len(dataset_en[\"train\"]) // batch_size\n", - "training_args = TrainingArguments(\n", - " output_dir=\"models/\" + model_name + \"inj_epochs\",\n", - " num_train_epochs= 2,\n", - " per_device_train_batch_size=batch_size,\n", - " per_device_eval_batch_size=batch_size,\n", - " metric_for_best_model=\"f1\",\n", - " disable_tqdm=False,\n", - " logging_steps=logging_steps,\n", - " save_strategy=trainer_utils.IntervalStrategy.NO,\n", - ")\n", - "def compute_metrics(pred):\n", - " labels = pred.label_ids\n", - " preds = pred.predictions.argmax(-1)\n", - " f1 = f1_score(labels, preds, average=\"weighted\")\n", - " acc = accuracy_score(labels, preds)\n", - " return {\"accuracy\": acc, \"f1\": f1}\n", - "trainer = Trainer(model=model_cls_inj, args=training_args,\n", - " compute_metrics=compute_metrics, train_dataset=dataset_en[\"train\"], eval_dataset=dataset_en[\"test\"])\n", - "trainer.train();\n", - "trainer.save_model(\"models/\" + model_name + \"_inj\")" - ] - }, - { - "cell_type": "code", - "execution_count": 52, - "metadata": { - "id": "7ejzOSBWWNv2" - }, - "outputs": [], - "source": [ - "# Execute the following line to load the trained model from disk.\n", - "# trainer = Trainer(AutoModelForSequenceClassification.from_pretrained(model_name+\"_inj\", num_labels=len(labels)).to(torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")))" - ] - }, - { - "cell_type": "code", - "execution_count": 53, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 860 + "cell_type": "markdown", + "metadata": { + "id": "ZC7QButQWNv4" + }, + "source": [ + "\n", + "\n", + "### 5.3. Use Captum and `transformers-interpret` to Interpret Predictions\n", + "\n", + "\n", + "Transformer models are quite complex, and therefore, interpreting model output can be difficult.\n", + "\n", + "Our main interest is in knowing which parts of the input text cause the classifier to arrive at a particular prediction.\n", + "One way to answer this question is the so-called integrated gradients method.\n", + "It is provided conveniently by the library [transformers_interpret](https://github.com/cdpierse/transformers-interpret)\n", + "which provides a convenient interface to the library [Captum](https://captum.ai/),\n", + "an open source, extensible library for model interpretability built on PyTorch.\n", + "\n", + "With just a few lines of code, we can run this on individual examples, and receive a graphical output as shown below.\n", + "Of course, the output is also available in numerical form.\n", + "We run this on CPU because on the AWS p2.xlarge instance, the GPU ran out of memory." + ] }, - "id": "mvIWMTR2WNv2", - "outputId": "6f43c861-36eb-4166-a5a4-f492f7f8f54f", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "The following columns in the test set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: mean_hidden_state, words per case summary, WEATHER7, WEATHER2, WEATHER4, NUMTOTV, SUMMARY_GE, WEATHER8, INJSEVA, SCASEID, SUMMARY_EN, index, WEATHER3, level_0, cls_hidden_state, WEATHER5, WEATHER1, WEATHER6. If mean_hidden_state, words per case summary, WEATHER7, WEATHER2, WEATHER4, NUMTOTV, SUMMARY_GE, WEATHER8, INJSEVA, SCASEID, SUMMARY_EN, index, WEATHER3, level_0, cls_hidden_state, WEATHER5, WEATHER1, WEATHER6 are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "***** Running Prediction *****\n", - " Num examples = 1390\n", - " Batch size = 8\n" - ] + "cell_type": "code", + "execution_count": 65, + "metadata": { + "id": "qk8aeppCWNv4" + }, + "outputs": [], + "source": [ + "device = torch.device(\"cpu\")\n", + "tokenizer = AutoTokenizer.from_pretrained(model_name)\n", + "model = model_cls_inj.to(device)\n", + "cls_explainer = SequenceClassificationExplainer(model, tokenizer)" + ] }, { - "data": { - "text/html": [ - "\n", - "

\n", - " \n", - " \n", - " [174/174 00:07]\n", - "
\n", - " " + "cell_type": "code", + "execution_count": 66, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 312 + }, + "id": "5-OUMWc4WNv5", + "outputId": "2df1256e-17c4-4127-f104-8431a1322151" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "
Legend: Negative Neutral Positive
True LabelPredicted LabelAttribution LabelAttribution ScoreWord Importance
1LABEL_1 (0.97)LABEL_12.32 [CLS] This three - vehicle crash occurred in the morning of a weekend on a multi - lane highway near an entrance ra ##mp . The highway runs east and west and divided by a high - tension cable guard ##rail . The bit ##umi ##nou ##s road ##way is dry , level and curve ##d to the left at the location of this crash . The posted speed limit 89 km ##ph ( 65 mph ) and there were no ad ##verse weather conditions . V ##1 , a 2006 Je ##ep Liberty with two occupa ##nts , was west ##bound in lane three inte ##nding to go straight . V ##2 , a 1992 Mitsubishi Dia ##mante with one occupa ##nt , was west ##bound in lane four inte ##nding to go straight . V ##3 , a 1996 Nissan pick ##up with one occupa ##nt , was west ##bound in lane one ( ac ##cel ##eration ra ##mp ) inte ##nding to merge left . An unknown vehicle traveling behind V ##3 switched lane ##s and cut in front of V ##1 . V ##1 attempted to avoid this unknown vehicle by changing lane ##s and striking V ##2 ( event # 1 ) . Subsequently , V ##1 and V ##2 sp ##un across all travel lane ##s and departed the right side of the road . V ##1 was struck in the right side by V ##3 as it sp ##un across the ac ##cel ##eration lane and came to final rest on the right roads ##ide . After V ##2 entered the right roads ##ide it sp ##un into an em ##bank ##ment and rolle ##d ( est . 6 - quarter turns ) and came to final rest on its roof . V ##3 drove off the right side of the road after striking V ##1 . The driver of V ##1 is a 45 - year - old female that refused to be interviewed . She was not injured in the crash and her Je ##ep was driven from the scene . The Critical Pre ##cra ##sh Event for V ##1 was code ##d this vehicle traveling over the lane line on the left side of the travel lane . The Critical Reason for the Critical Event was code ##d in ##corre ##ct eva ##sive action . Other factors code ##d to this driver include chose ina ##pp ##rop ##riate eva ##sive action and poor direction ##al control ( failure to control vehicle with skill ord ##inar ##ily expected ) . The driver of V ##2 is a 40 - year - old female that was not interviewed because of a language barrier ( Korean . ) She was transported to the hospital and her vehicle was to ##wed due to damage . The Critical Pre ##cra ##sh Event was code ##d other vehicle en ##cro ##aching from adjacent lane - over right lane line . The Critical Reason for the Critical Event was not code ##d to this vehicle . The driver [SEP]
" + ] + }, + "metadata": {} + } ], - "text/plain": [ - "" + "source": [ + "# true positive\n", + "s = tokenizer.decode(dataset_en[\"test\"][144][\"input_ids\"][1:511])\n", + "word_attributions = cls_explainer(s, n_steps=20)\n", + "cls_explainer.visualize(\"./results/viz_144.html\");" ] - }, - "metadata": {}, - "output_type": "display_data" - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "DistilBERT classifier - 2 epochs task-specific\n", - "accuracy score = 90.0%, log loss = 0.266, Brier loss = 0.154\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 0 0.91 0.92 0.92 816\n", - " 1 0.88 0.87 0.88 574\n", - "\n", - " accuracy 0.90 1390\n", - " macro avg 0.90 0.90 0.90 1390\n", - "weighted avg 0.90 0.90 0.90 1390\n", - "\n" - ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_inj_tsk", - "format": "svg" - } - }, - "data": [ + "cell_type": "code", + "execution_count": 67, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 337 + }, + "id": "04jn-pgmWNv5", + "outputId": "cb99a0b6-07a3-4a2a-9ba1-66dfd1155d0f" + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 0 ", - " 1 " - ], - "xaxis": "x", - "y": [ - " 0 ", - " 1 " - ], - "yaxis": "y", - "z": [ - [ - 749, - 67 - ], - [ - 72, - 502 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] + "output_type": "display_data", + "data": { + "text/plain": [ + "" ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } + "text/html": [ + "
Legend: Negative Neutral Positive
True LabelPredicted LabelAttribution LabelAttribution ScoreWord Importance
1LABEL_1 (0.94)LABEL_14.12 [CLS] This crash occurred in the south ##bound lane of a two - lane und ##ivi ##ded road ##way . This was a level asp ##halt road that curve ##d slightly to the left , with a posted speed limit of 64 km ##ph ( 40 mph ) . It was early in the evening on a week ##day , conditions were clear , and the road ##way was dry . There were no traffic flow restrictions . V ##1 was a 2002 Chrysler Se ##bring 2 - door convert ##ible . The vehicle was traveling south ##bound and its driver was beginning to nego ##tia ##te a left curve . V ##1 departed the road ##way to the right and struck a telephone pole located on the roads ##ide . V ##1 rota ##ted clock ##wise after the impact and then trip ##ped over its wheels . V ##1 rolle ##d two quarter - turns and came to final rest on its roof . V ##1 was driven by a 69 - year old female who suffered moderate injuries . The driver has since been put into a nur ##sing home and does not reca ##ll any information from the accident . The accident report and medical records indicated that the driver of V ##1 had a blood alcohol content of 0 . 177 . The Critical Pre - crash Event for V ##1 was this vehicle traveling off the edge of the road on the right side . The Critical Reason for the Critical Pre - crash Event was poor direction ##al control , a driver - related factor . Associated factors code ##d to the driver of V ##1 include alcohol use , the medical condition of diabetes and the use of pre ##scription med ##ication to control the diabetes . Medical reports also indicated that the driver of V ##1 had a history of alcohol ##ism . [SEP] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [SEP]
" + ] }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" + "metadata": {} + } + ], + "source": [ + "# true positive\n", + "s = tokenizer.decode(dataset_en[\"test\"][18][\"input_ids\"][1:511])\n", + "word_attributions = cls_explainer(s, n_steps=20)\n", + "cls_explainer.visualize(\"./results/viz_18.html\");" + ] + }, + { + "cell_type": "code", + "execution_count": 68, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 312 + }, + "id": "3mXRYEluWNv5", + "outputId": "fdf5dfb7-6f3f-48e0-c1bd-eab23be71d5b" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" ], - [ - 1, - "#276419" + "text/html": [ + "
Legend: Negative Neutral Positive
True LabelPredicted LabelAttribution LabelAttribution ScoreWord Importance
0LABEL_0 (0.75)LABEL_06.24 [CLS] This two vehicle crash occurred late in the evening on a two - lane up ##hill bit ##umi ##nou ##s road ##way , with no traffic controls and a speed limit of 56 km ##ph ( 30 mph ) . Vehicle one ( V ##1 ) was a 2007 Ford e ##cono ##line van driven by a thirty four ( 34 ) year - old male who takes no med ##ication or has any vision restrictions . V ##1 was traveling south in lane one going straight . Vehicle two ( V ##2 ) was a 1994 Honda Civic sedan driven by an unknown aged driver with one passenger . V ##2 was traveling south in lane one . According to a witness V ##2 was traveling at a high rate of speed and attempting to pass V ##1 on the right when the front of V ##2 struck the rear of V ##1 . The driver of V ##2 fled the scene on foot , leaving an injured passenger . Both vehicle ' s came to final rest facing south . V ##2 was to ##wed from the scene . The passenger of V ##2 did not know the driver and refused to speak about the crash due to his illegal status in this country . The critical pre - crash event for V ##1 was code ##d : other motor vehicle in lane , traveling in same direction with higher speed . The critical reason for the critical event was not code ##d to this vehicle . The driver of V ##1 was traveling from one job site to another when V ##1 was rear - ended by V ##2 . He was going straight traveling at the posted speed limit in this residential area and observed V ##2 approach ##ing from the rear in his side mirror . The critical pre - crash event for V ##2 was code ##d : other motor vehicle in lane , traveling in same direction with lower st ##eady speed . The critical reason for the critical event was code ##d to the driver of V ##2 as a driver related factor : poor direction ##al control ( e . g . , failing to control vehicle with skill ord ##inar ##ily expected ) . An associated factor for V ##2 was excessive speed and mis ##jud ##gment of gap . V ##2 ' s left front tire was the wrong size and all tire ##s had low tre ##ad depth . [SEP] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [SEP]
" ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" + }, + "metadata": {} + } + ], + "source": [ + "# false negative: \"leaving an injured passenger\" overlooked\n", + "s = tokenizer.decode(dataset_en[\"test\"][331][\"input_ids\"][1:511])\n", + "word_attributions = cls_explainer(s, n_steps=20)\n", + "cls_explainer.visualize(\"./results/viz_331.html\");" + ] + }, + { + "cell_type": "code", + "execution_count": 69, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 312 + }, + "id": "Gvq1xnu5WNv5", + "outputId": "cb420c49-18b3-4ef8-b981-7ee44b0bb36e" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" ], - [ - 1, - "#f0f921" + "text/html": [ + "
Legend: Negative Neutral Positive
True LabelPredicted LabelAttribution LabelAttribution ScoreWord Importance
1LABEL_1 (0.97)LABEL_11.93 [CLS] The crash occurred on a north / south four - lane highway with shoulder ##s . It curve ##d to the east ( right ) as it traveled north ##ward with a radius of curva ##ture of 274 meters and a positive 4 % grade . Initially there was a grass median div ##iding the north and south lane ##s but as the highway traveled north the median ended with only a double yellow line separat ##ing the directions of travel . A two - lane side street inter ##sect ##ed on the west side of the highway and traveled southeast . Con ##ditions were dark and dry on a week ##day evening . Vehicle # 1 was a 1987 Mercury Marquis traveling north ##bound on the highway . The driver , apparently confused , attempted to turn left on the side street 29 meters prior to the intersection . The vehicle went down a steep 62 % em ##bank ##ment , striking the ground at the bottom of the em ##bank ##ment with its front . It came to rest facing south with its rear wheels just on the edge of the pave ##d south shoulder and was to ##wed due to damage . Vehicle # 1 was driven by a 54 - year old female that was un ##belt ##ed and not transported to a medical facility . Two adult passengers and an 8 - month child in a safety seat were also not injured . The driver stated she went out the wrong exit from a gas station on the east side of the highway a few hundred meters south of the crash . She intended to turn left on the side street to circle back around and enter a shopping center that was located across the highway from the gas station . App ##aren ##tly she thought that the street sign identify ##ing the side streets name was on the north side of the intersection as opposed to south and initiated the left turn 29 meters before the inter ##sect ##ing pave ##ment began . She said that once she started to turn and realized the error she attempted to brak ##e but the front wheels had left the pave ##ment and the em ##bank ##ment was so steep she could not recover . In ##vesti ##gating tro ##oper ##s agree with researcher that poor vision could have contributed to the scenario and required her to follow up with a vision rete ##sting at a state driver ' s license center . The Critical Pre ##cra ##sh Event for Vehicle # 1 was this vehicle traveling off the edge of the road on the left side . The Critical Reason for the Critical Event was code ##d other recognition error , attempted left turn too early . Associated factors included con ##versi ##ng with passenger and poor direction ##al control ( failure to control vehicle with skill ord ##inar ##ily expected ) . A vehicle view ob ##stru ##ction - related to other was included due [SEP]
" ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" + }, + "metadata": {} + } + ], + "source": [ + "# false positive:\n", + "s = tokenizer.decode(dataset_en[\"test\"][78][\"input_ids\"][1:511])\n", + "word_attributions = cls_explainer(s, n_steps=20)\n", + "cls_explainer.visualize(\"./results/viz_78.html\");" + ] + }, + { + "cell_type": "code", + "execution_count": 70, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 312 + }, + "id": "GIUENaqY-NRX", + "outputId": "68b6eaff-0f70-4a84-856e-77684af9e900" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" ], - [ - 1, - "#f0f921" + "text/html": [ + "
Legend: Negative Neutral Positive
True LabelPredicted LabelAttribution LabelAttribution ScoreWord Importance
1LABEL_1 (0.95)LABEL_14.93 [CLS] This crash occurred on a straight level bit ##umi ##nou ##s two lane road ##way that was divided by a painted median . The posted speed limit of 72 km ##ph ( 45 mph ) which reduce ##s to 56 km ##ph ( 35 mph ) 100 meters after the crash site . There is a sign indicating the road ##way narrow ##s . The weather was cloud ##y and the road ##way was partially wet . Traffic flow was normal for that time of day . This crash occurred on a week ##day afternoon . Vehicle 1 , a 2002 Nissan Alt ##ima , was traveling behind Vehicle 2 , a 1991 Chevrolet Lu ##mina , when it drove into the safety zone into the on ##coming traffic lane in order to illegal ##ly pass Vehicle 2 . V ##1 returned to its original lane and impact ##ed with V ##2 ' s front left , with its right rear quarter panel . This sp ##un V ##1 in a clock ##wise position 180 degrees , with V ##1 coming to final rest after impact ##ing an em ##bank ##ment on the right side of the road ##way , with its rear left . Vehicle 1 was to ##wed due to damage . V ##1 came to final rest off the road ##way facing in a northeast ##erly direction . V ##2 came to final rest on the road ##way facing in a south ##erly direction . V ##1 was to ##wed due to damage . V ##2 was to ##wed due to its driver going to the hospital with her baby . Vehicle # 1 , the Nissan Alt ##ima , was driven by a belt ##ed 38 - year - old male who refused to be interviewed . He stated he did not want to be both ##ered \" with this sh - t \" . The Critical Pre ##cra ##sh Event code ##d to Vehicle 1 was : Other - this vehicle traveling entering the road ##way from the left side of the road ##way . The Critical Reason for the Critical Pre ##cra ##sh Event was code ##d as : driver related factor , aggressive driving behavior . Vehicle # 2 , the Chevrolet , was driven by a belt ##ed 21 year - old female who was not injured . There was a belt ##ed 18 year - old male in the front right seat who was not injured . There was a 6 - month - old female child in a car seat in the second row . The child was taken to the hospital for a check out , accompanied by both other people in the vehicle . This driver stated to her relative that she had seen the driver of V ##1 making \" wild ge ##stu ##res \" and tail ##gating her . She stated she saw V ##1 coming around her on the left but could only brak ##e before impact . The Critical Pre ##cra ##sh Event code [SEP]
" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "DistilBERT classifier - 2 epochs task-specific" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } + ], + "source": [ + "# false positive:\n", + "s = tokenizer.decode(dataset_en[\"test\"][915][\"input_ids\"][1:511])\n", + "word_attributions = cls_explainer(s, n_steps=20)\n", + "cls_explainer.visualize(\"./results/viz_915.html\");" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "iBJ99TPuWNv5" }, - "text/html": [ - "
" + "source": [ + "\n", + "\n", + "## 6. Using Extractive Question Answering to Process Longer Texts\n", + "\n", + "In this section we use extractive question answering to extract parts of the accident description which indicate the presence of bodily injury. The aim is to reduce the length of the input texts by extracting only the relevant parts.\n", + "\n", + "The easiest implementation of extractive question answering is provided by the `pipeline` abstraction.\n", + "\n", + "We use [`deutsche-telekom/bert-multi-english-german-squad2`](https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2),\n", + "a multilingual English German question answering model built on `bert-base-multilingual-cased`. By specifying `device=0` we use GPU support." ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# evaluate model performance using predictions on the English test set\n", - "predictions_en = trainer.predict(dataset_en[\"test\"])\n", - "_ = evaluate_classifier(predictions_en.label_ids, None, softmax(predictions_en.predictions, axis=1), labels,\n", - " \"DistilBERT classifier - 2 epochs task-specific\", \"cm_inj_tsk\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "OcogYs7wWNv2" - }, - "source": [ - "We observe the following:\n", - "* Task-specific fine-tuning has further improved all scores.\n", - "* There is still a relatively large number of false positives." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "udjhQrSpWNv2", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "\n", - "\n", - "### 5.2. Investigate False Positives and False Negatives\n", - "\n", - "To investigate the prediction errors, we export the predictions into an Excel file with the following columns:\n", - "\n", - "| column | meaning |\n", - "|---|---|\n", - "| `SCASEID` | unique identification number of the case |\n", - "| `SUMMARY_EN` | description of the accident, in English |\n", - "| `SUMMARY_TRUNCATED` | description of the accident, in English, truncated to a length of 512 tokens |\n", - "| `INJSEVA` | most serious injury sustained in the case, as per Police Accident Report |\n", - "| `labels` | indicator of odily injury `INJSEVB` (true label) |\n", - "| `pred` | predicted label |\n", - "| `0` | probability of negative label |\n", - "| `1` | probability of positive label |" - ] - }, - { - "cell_type": "code", - "execution_count": 54, - "metadata": { - "id": "ZAfQV892WNv3" - }, - "outputs": [], - "source": [ - "# export prediction results for error analysis\n", - "dataset_en.set_format(type=\"pandas\")\n", - "df_res = pd.concat([dataset_en[\"test\"].to_pandas(),\n", - " pd.DataFrame(data=softmax(predictions_en.predictions, axis=1), columns=[\"0\", \"1\"]),\n", - " pd.DataFrame(data=np.argmax(predictions_en.predictions, -1).reshape((-1,1)), columns=['pred'])\n", - " ], axis=1)\n", - "df_res = df_res[[\"SCASEID\", \"SUMMARY_EN\", \"INJSEVA\", \"labels\", \"pred\", \"0\", \"1\"]]\n", - "dataset_en.set_format()\n", - "for i in range(df_res.shape[0]):\n", - " df_res.loc[i, \"SUMMARY_TRUNCATED\"] = tokenizer.convert_tokens_to_string(tokenizer.tokenize(df_res.loc[i, \"SUMMARY_EN\"], truncation=True))\n", - "df_res.to_excel(\"./results/error_analysis_inj.xlsx\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "OR2KmOV2WNv3" - }, - "source": [ - "The first step of the error analysis is to inspect the samples producing false negative and false positive predictions.\n", - "Reading every single text would be very tedious, therefore it is worthwhile focusing on those examples where the probability assigned to the false prediction was high,\n", - "i.e., cases where the model was confident but wrong.\n", - "\n", - "Looking at the false negatives, we observe that there are many cases where the model assigns a high probability to negative.\n", - "We suspect that truncation is responsible for many of the false negatives – the relevant part of the text was discarded.\n", - "\n", - "To address this issue, we split the text into slightly overlapping chunks,\n", - "run the prediction on each chunk and apply the logical OR-function to the results.\n", - "We implement this functionality in a simple function that returns an additional column `pred`,\n", - "containing a list of predicted labels, with one element for each chunk." - ] - }, - { - "cell_type": "code", - "execution_count": 55, - "metadata": { - "id": "oEKN3riTWNv3" - }, - "outputs": [], - "source": [ - "def predict_with_overflow(x, model, feature):\n", - " t = tokenizer(x[feature], truncation=True, padding=True, return_overflowing_tokens=True)\n", - " input_ids = torch.tensor(t[\"input_ids\"]).to(model.device)\n", - " attention_mask = torch.tensor(t[\"attention_mask\"]).to(model.device)\n", - " with torch.no_grad():\n", - " preds = np.argmax(model(input_ids, attention_mask).logits.cpu(), -1)\n", - " return {\"preds\": preds}" - ] - }, - { - "cell_type": "code", - "execution_count": 56, - "metadata": { - "id": "ubKYwONYWNv3" - }, - "outputs": [], - "source": [ - "# Execute the following lines to load the trained model and the okenizer from disk.\n", - "# model_cls_inj = AutoModelForSequenceClassification.from_pretrained(\"models/\" + model_name + \"_inj\", num_labels=len(labels)).to(torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\"))\n", - "# tokenizer = AutoTokenizer.from_pretrained(model_name)" - ] - }, - { - "cell_type": "code", - "execution_count": 57, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 81, - "referenced_widgets": [ - "69c5d78016be424a809d62adc60b9a78", - "5b40e993725b42eb9ddab54f26b65925", - "ef303e43af7d46a598183f8578f27344", - "1e7b332eeeed4054812a90d27d751334", - "4bdfaa4d9f3c430d9c1e3705d174539f", - "114cd6c913db4d2e8b8ed4b811b04244", - "bcfac580838a434b924c75a9996c905e", - "39168f7ac5814af4b820f896df8e8e82", - "4d8d11ab0dfc4aa3b625a3faed894ae7", - "7bea7398b2c64a3580133e9ddba00f55", - "49d052b8696745dda7b9fa1615284178", - "29d1bbafa40648deab0879d236e727e6", - "aef6ee4e19a04fbcb104f202cdc564a6", - "e627c3f0a40d43f8a3baa44e4b876a03", - "a3c11dfae4df40b89eeac4e58a21f76a", - "dae30fe0ebc84bf1a0eb248c9a334c88", - "4e0f77d8ac9c407c8d74969f4adb6931", - "66da5ccd967a441c92df787873fcbb4c", - "b28fed2d2d464a50ac2d155cdfec3c14", - "01c0c343c7e74e99a453aec724074cac", - "3e0978a77d2841938cccbc6abcace64b", - "b2a2e3fcc88c43fe9ef801504b7682bc" - ] }, - "id": "hMoqL5aHWNv3", - "outputId": "18c11419-ecd1-4019-89e0-2e93f7676735" - }, - "outputs": [ { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "34e54ec471aa43568fe3098866d09185", - "version_major": 2, - "version_minor": 0 + "cell_type": "code", + "execution_count": 71, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 177, + "referenced_widgets": [ + "486f11186d874b7e83dd2e088bae002e", + "f5b930386e2a4cb2acd3b2d528c70dd6", + "069f96de1e34477582ce3ad8bcf0a7f2", + "d5e9143bdf8e44429771da6b07934b48", + "83cd8944573b48c5ae1fa8582b259a60", + "f3a3d0f3895f486e9bdfbfa6581c2007", + "2696019fe4674ac28fd87898cc6780dd", + "dd5b7db237bb42209c35403616f2b525", + "fce9d772bcf74a809cff8c6c352abcb3", + "99aa8b82bd2444999ef86bba75949976", + "c0d2cd311db247c1b21a19593c455762", + "c9572f12724249a492816be24f394d76", + "e17eae14f470471bb94730ccbee2c7b3", + "9cbfaf9e319645118cdd384a4007915b", + "2fd6bf638a824c49a4ce018cdb069177", + "ccb333e16f1e459ebb385956e478c373", + "87f5f6c06ecd422fa4675aa7de3e31f3", + "4c176765710b41cdbb625cefa1599800", + "b0d274fc0ea447e1a5f9a9de476332c2", + "7bc39d5ea97945338f47881a1421ff52", + "74f7007eee3241a3bd5002b8e5a6148d", + "cff1616b8ebc459fa434db0a69a195f2", + "f35a9eec4f7a4dd18de10815281b5a2a", + "402640a0df79496f836b2dee7b12e374", + "9c61d2cd86e4430f8207fcb328378463", + "3f185063faa0444abc845b88cb7cf70c", + "be99854c11c14402b518756040346159", + "999c2dc53fa34547ba4e8a4d753d885b", + "0111d78b54e14041b19c18ec2efd0c02", + "300832a0c66e4a4cadc1fc7d2825d647", + "868f963c1e1844499a0240ae345940e8", + "2ac949e50cc74b14b35dc8ff948e36a8", + "b415d3920503453097975ce8575a83cc", + "e47af479ba2947728edead722e37507a", + "6f79ec17441f4b23a52aa96d37fefd13", + "8f206492a6cb4c59978d3edbf0a22601", + "3b6f8d1596d64fa6b88e2b3f3192d820", + "99708f3e63aa49f99fb350f21d69e71e", + "1931acef87bb46b99d6ff96b9d26ea4b", + "8fea0d18b21c4f41bff4e9cab9fafd9b", + "3d55048e65134e33895e0c9f11cd1ba7", + "c6db58831b2845949fca86a2bbc12ae5", + "ca7f36ddc0594a7584a0b266bf71ebca", + "379aadd411804cb8b435f5ec03cf8941", + "d753541428e4471d94d44c3cbb83d5b8", + "8c08b8d2bcbf4a449e90efbd0f436873", + "f4d1d35507dc49dbb0ca8d1616013b3e", + "7e2892dee05147b6b7597d7087d5d08b", + "42019918b32f43fead5e531292cab5dc", + "05106957703944b9991803c6eb9d006d", + "e438e7017e924a428cc47bbee78cacf3", + "3c38cb2d3c5747f79b12915ce195e910", + "2a93b900107f4c24ad3fb04cdd2f5293", + "3bd2b91ef73347068af0ed288fd17e53", + "a1caf52d25ef450287b3ca5a57660bee" + ] + }, + "id": "axQK5AJlWNv6", + "outputId": "b2f4904d-a422-4334-b53a-f6b96cf75daa" }, - "text/plain": [ - " 0%| | 0/1390 [00:00 0:\n", + " x[\"INJ\"] = '. '.join([x[\"INJ\"]] + [item[\"answer\"] for item in res])\n", + " return x" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_inj_split", - "format": "svg" - } - }, - "data": [ + "cell_type": "markdown", + "metadata": { + "id": "nUfUYHs7WNv6" + }, + "source": [ + "We apply the question answering function to the entire test set.\n", + "\n", + "On an AWS EC2 p2.xlarge instance, the run time is about 6 minutes. If you want to try the concept on only the first 250 samples, you can use `ds_test = dataset[\"test\"].select(range(250).map(...`" + ] + }, + { + "cell_type": "code", + "execution_count": 73, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 118, + "referenced_widgets": [ + "4d6cd358cf3142ca8f6d97c3ea467165", + "d84281814e1248dca0cbe97c182552f2", + "e67e2a11fb10484e834bf976a454fac3", + "500a601091eb4c359beed1c5dd143e56", + "3aee35faf2fc43d8beff5fe68b27c8af", + "037c286ac5a2478f87adfbed0858d194", + "0b2e1db7008346f3b79cc51db50acaa8", + "1e8511680e944af8adfafee67945bb52", + "c0564b4e129f4f80aede254fec5e57ab", + "b0b322d936dc476bbd284456502f9365", + "1593150538b64361a97b7bb522a42a60" + ] + }, + "id": "RnHgr4KjWNv6", + "outputId": "4b43ac57-481a-4956-f7d8-964610a0556d" + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 0 ", - " 1 " - ], - "xaxis": "x", - "y": [ - " 0 ", - " 1 " - ], - "yaxis": "y", - "z": [ - [ - 745, - 71 - ], - [ - 22, - 552 + "output_type": "display_data", + "data": { + "text/plain": [ + "Map: 0%| | 0/1390 [00:00predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } - } - } - }, - "text/html": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "_ = evaluate_classifier(predictions_en.label_ids, dataset_en_overflow[\"pred\"], None, labels,\n", - " \"DistilBERT classifier - split inputs\", \"cm_inj_split\")" - ] - }, - { - "cell_type": "code", - "execution_count": 59, - "metadata": { - "id": "mOG699NKWNv4" - }, - "outputs": [], - "source": [ - "dataset_en_overflow.set_format(type=\"pandas\")\n", - "df_res = dataset_en_overflow.to_pandas()\n", - "df_res = df_res[[\"SCASEID\", \"SUMMARY_EN\", \"INJSEVA\", \"labels\", \"pred\"]]\n", - "dataset_en.set_format()\n", - "for i in range(df_res.shape[0]):\n", - " df_res.loc[i, \"SUMMARY_TRUNCATED\"] = tokenizer.convert_tokens_to_string(tokenizer.tokenize(df_res.loc[i, \"SUMMARY_EN\"], truncation=True))\n", - "df_res.to_excel(\"./results/error_analysis_inj_overflow.xlsx\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "MNP9SIeHWNv4" - }, - "source": [ - "The number of false negatives has reduced significantly, as expected, and the accuracy score has improved.\n", - "Since we have not implemented a logic to combine the predicted probabilities of the different chunks, the log loss and Brier loss cannot be evaluated in this case." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "ZC7QButQWNv4" - }, - "source": [ - "\n", - "\n", - "### 5.3. Use Captum and `transformers-interpret` to Interpret Predictions\n", - "\n", - "\n", - "Transformer models are quite complex, and therefore, interpreting model output can be difficult.\n", - "\n", - "Our main interest is in knowing which parts of the input text cause the classifier to arrive at a particular prediction.\n", - "One way to answer this question is the so-called integrated gradients method.\n", - "It is provided conveniently by the library [transformers_interpret](https://github.com/cdpierse/transformers-interpret)\n", - "which provides a convenient interface to the library [Captum](https://captum.ai/),\n", - "an open source, extensible library for model interpretability built on PyTorch.\n", - "\n", - "With just a few lines of code, we can run this on individual examples, and receive a graphical output as shown below.\n", - "Of course, the output is also available in numerical form.\n", - "We run this on CPU because on the AWS p2.xlarge instance, the GPU ran out of memory." - ] - }, - { - "cell_type": "code", - "execution_count": 60, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "qk8aeppCWNv4", - "outputId": "f76d8780-79fc-4604-a7a0-1f2756b7f237" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "loading configuration file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/cf37a9dc282a679f121734d06f003625d14cfdaf55c14358c4c0b8e7e2b89ac9.7a727bd85e40715bec919a39cdd6f0aba27a8cd488f2d4e0f512448dcd02bf0f\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"distilbert-base-multilingual-cased\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"initializer_range\": 0.02,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"output_past\": true,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 119547\n", - "}\n", - "\n", - "loading file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/vocab.txt from cache at /home/ubuntu/.cache/huggingface/transformers/28e5b750bf4f39cc620367720e105de1501cf36ec4ca7029eba82c1d2cc47caf.6c5b6600e968f4b5e08c86d8891ea99e51537fc2bf251435fb46922e8f7a7b29\n", - "loading file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/tokenizer.json from cache at /home/ubuntu/.cache/huggingface/transformers/5cbdf121f196be5f1016cb102b197b0c34009e1e658f513515f2eebef9f38093.b33e51591f94f17c238ee9b1fac75b96ff2678cbaed6e108feadb3449d18dc24\n", - "loading file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/added_tokens.json from cache at None\n", - "loading file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/special_tokens_map.json from cache at None\n", - "loading file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/tokenizer_config.json from cache at /home/ubuntu/.cache/huggingface/transformers/47087d99feeb3bc6184d7576ff089c52f7fbe3219fe48c6c4fa681e617753256.ec5c189f89475aac7d8cbd243960a0655cfadc3d0474da8ff2ed0bf1699c2a5f\n", - "loading configuration file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/cf37a9dc282a679f121734d06f003625d14cfdaf55c14358c4c0b8e7e2b89ac9.7a727bd85e40715bec919a39cdd6f0aba27a8cd488f2d4e0f512448dcd02bf0f\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"distilbert-base-multilingual-cased\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"initializer_range\": 0.02,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"output_past\": true,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 119547\n", - "}\n", - "\n" - ] - } - ], - "source": [ - "device = torch.device(\"cpu\")\n", - "tokenizer = AutoTokenizer.from_pretrained(model_name)\n", - "model = model_cls_inj.to(device)\n", - "cls_explainer = SequenceClassificationExplainer(model, tokenizer)" - ] - }, - { - "cell_type": "code", - "execution_count": 61, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 288 - }, - "id": "5-OUMWc4WNv5", - "outputId": "bba0c235-9b86-4840-a69d-af8bbfacedee" - }, - "outputs": [ - { - "data": { - "text/html": [ - "
Legend: Negative Neutral Positive
True LabelPredicted LabelAttribution LabelAttribution ScoreWord Importance
1LABEL_1 (0.96)LABEL_12.07 [CLS] This three - vehicle crash occurred in the morning of a weekend on a multi - lane highway near an entrance ra ##mp . The highway runs east and west and divided by a high - tension cable guard ##rail . The bit ##umi ##nou ##s road ##way is dry , level and curve ##d to the left at the location of this crash . The posted speed limit 89 km ##ph ( 65 mph ) and there were no ad ##verse weather conditions . V ##1 , a 2006 Je ##ep Liberty with two occupa ##nts , was west ##bound in lane three inte ##nding to go straight . V ##2 , a 1992 Mitsubishi Dia ##mante with one occupa ##nt , was west ##bound in lane four inte ##nding to go straight . V ##3 , a 1996 Nissan pick ##up with one occupa ##nt , was west ##bound in lane one ( ac ##cel ##eration ra ##mp ) inte ##nding to merge left . An unknown vehicle traveling behind V ##3 switched lane ##s and cut in front of V ##1 . V ##1 attempted to avoid this unknown vehicle by changing lane ##s and striking V ##2 ( event # 1 ) . Subsequently , V ##1 and V ##2 sp ##un across all travel lane ##s and departed the right side of the road . V ##1 was struck in the right side by V ##3 as it sp ##un across the ac ##cel ##eration lane and came to final rest on the right roads ##ide . After V ##2 entered the right roads ##ide it sp ##un into an em ##bank ##ment and rolle ##d ( est . 6 - quarter turns ) and came to final rest on its roof . V ##3 drove off the right side of the road after striking V ##1 . The driver of V ##1 is a 45 - year - old female that refused to be interviewed . She was not injured in the crash and her Je ##ep was driven from the scene . The Critical Pre ##cra ##sh Event for V ##1 was code ##d this vehicle traveling over the lane line on the left side of the travel lane . The Critical Reason for the Critical Event was code ##d in ##corre ##ct eva ##sive action . Other factors code ##d to this driver include chose ina ##pp ##rop ##riate eva ##sive action and poor direction ##al control ( failure to control vehicle with skill ord ##inar ##ily expected ) . The driver of V ##2 is a 40 - year - old female that was not interviewed because of a language barrier ( Korean . ) She was transported to the hospital and her vehicle was to ##wed due to damage . The Critical Pre ##cra ##sh Event was code ##d other vehicle en ##cro ##aching from adjacent lane - over right lane line . The Critical Reason for the Critical Event was not code ##d to this vehicle . The driver [SEP]
" - ], - "text/plain": [ - "" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# true positive\n", - "s = tokenizer.decode(dataset_en[\"test\"][144][\"input_ids\"][1:511])\n", - "word_attributions = cls_explainer(s, n_steps=20)\n", - "cls_explainer.visualize(\"./results/viz_144.html\");" - ] - }, - { - "cell_type": "code", - "execution_count": 62, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 313 - }, - "id": "04jn-pgmWNv5", - "outputId": "8576416c-2145-4e3a-b265-d40eadf0bf83" - }, - "outputs": [ - { - "data": { - "text/html": [ - "
Legend: Negative Neutral Positive
True LabelPredicted LabelAttribution LabelAttribution ScoreWord Importance
1LABEL_1 (0.95)LABEL_12.16 [CLS] This crash occurred in the south ##bound lane of a two - lane und ##ivi ##ded road ##way . This was a level asp ##halt road that curve ##d slightly to the left , with a posted speed limit of 64 km ##ph ( 40 mph ) . It was early in the evening on a week ##day , conditions were clear , and the road ##way was dry . There were no traffic flow restrictions . V ##1 was a 2002 Chrysler Se ##bring 2 - door convert ##ible . The vehicle was traveling south ##bound and its driver was beginning to nego ##tia ##te a left curve . V ##1 departed the road ##way to the right and struck a telephone pole located on the roads ##ide . V ##1 rota ##ted clock ##wise after the impact and then trip ##ped over its wheels . V ##1 rolle ##d two quarter - turns and came to final rest on its roof . V ##1 was driven by a 69 - year old female who suffered moderate injuries . The driver has since been put into a nur ##sing home and does not reca ##ll any information from the accident . The accident report and medical records indicated that the driver of V ##1 had a blood alcohol content of 0 . 177 . The Critical Pre - crash Event for V ##1 was this vehicle traveling off the edge of the road on the right side . The Critical Reason for the Critical Pre - crash Event was poor direction ##al control , a driver - related factor . Associated factors code ##d to the driver of V ##1 include alcohol use , the medical condition of diabetes and the use of pre ##scription med ##ication to control the diabetes . Medical reports also indicated that the driver of V ##1 had a history of alcohol ##ism . [SEP] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [SEP]
" - ], - "text/plain": [ - "" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# true positive\n", - "s = tokenizer.decode(dataset_en[\"test\"][18][\"input_ids\"][1:511])\n", - "word_attributions = cls_explainer(s, n_steps=20)\n", - "cls_explainer.visualize(\"./results/viz_18.html\");" - ] - }, - { - "cell_type": "code", - "execution_count": 63, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 288 - }, - "id": "3mXRYEluWNv5", - "outputId": "c23651ca-7161-4180-efbb-62e1c05c4e88" - }, - "outputs": [ - { - "data": { - "text/html": [ - "
Legend: Negative Neutral Positive
True LabelPredicted LabelAttribution LabelAttribution ScoreWord Importance
0LABEL_0 (0.99)LABEL_05.34 [CLS] This two vehicle crash occurred late in the evening on a two - lane up ##hill bit ##umi ##nou ##s road ##way , with no traffic controls and a speed limit of 56 km ##ph ( 30 mph ) . Vehicle one ( V ##1 ) was a 2007 Ford e ##cono ##line van driven by a thirty four ( 34 ) year - old male who takes no med ##ication or has any vision restrictions . V ##1 was traveling south in lane one going straight . Vehicle two ( V ##2 ) was a 1994 Honda Civic sedan driven by an unknown aged driver with one passenger . V ##2 was traveling south in lane one . According to a witness V ##2 was traveling at a high rate of speed and attempting to pass V ##1 on the right when the front of V ##2 struck the rear of V ##1 . The driver of V ##2 fled the scene on foot , leaving an injured passenger . Both vehicle ' s came to final rest facing south . V ##2 was to ##wed from the scene . The passenger of V ##2 did not know the driver and refused to speak about the crash due to his illegal status in this country . The critical pre - crash event for V ##1 was code ##d : other motor vehicle in lane , traveling in same direction with higher speed . The critical reason for the critical event was not code ##d to this vehicle . The driver of V ##1 was traveling from one job site to another when V ##1 was rear - ended by V ##2 . He was going straight traveling at the posted speed limit in this residential area and observed V ##2 approach ##ing from the rear in his side mirror . The critical pre - crash event for V ##2 was code ##d : other motor vehicle in lane , traveling in same direction with lower st ##eady speed . The critical reason for the critical event was code ##d to the driver of V ##2 as a driver related factor : poor direction ##al control ( e . g . , failing to control vehicle with skill ord ##inar ##ily expected ) . An associated factor for V ##2 was excessive speed and mis ##jud ##gment of gap . V ##2 ' s left front tire was the wrong size and all tire ##s had low tre ##ad depth . [SEP] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [PAD] [SEP]
" ], - "text/plain": [ - "" + "source": [ + "ds_test = dataset[\"test\"].map(get_answers, batched=False, fn_kwargs={\"qa_pipeline\": pl, \"questions\": questions})" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# false negative: \"leaving an injured passenger\" overlooked\n", - "s = tokenizer.decode(dataset_en[\"test\"][331][\"input_ids\"][1:511])\n", - "word_attributions = cls_explainer(s, n_steps=20)\n", - "cls_explainer.visualize(\"./results/viz_331.html\");" - ] - }, - { - "cell_type": "code", - "execution_count": 64, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 288 - }, - "id": "Gvq1xnu5WNv5", - "outputId": "f112c0ea-5e38-4a1b-ce2a-e36910a4b53f" - }, - "outputs": [ - { - "data": { - "text/html": [ - "
Legend: Negative Neutral Positive
True LabelPredicted LabelAttribution LabelAttribution ScoreWord Importance
1LABEL_1 (0.95)LABEL_11.85 [CLS] The crash occurred on a north / south four - lane highway with shoulder ##s . It curve ##d to the east ( right ) as it traveled north ##ward with a radius of curva ##ture of 274 meters and a positive 4 % grade . Initially there was a grass median div ##iding the north and south lane ##s but as the highway traveled north the median ended with only a double yellow line separat ##ing the directions of travel . A two - lane side street inter ##sect ##ed on the west side of the highway and traveled southeast . Con ##ditions were dark and dry on a week ##day evening . Vehicle # 1 was a 1987 Mercury Marquis traveling north ##bound on the highway . The driver , apparently confused , attempted to turn left on the side street 29 meters prior to the intersection . The vehicle went down a steep 62 % em ##bank ##ment , striking the ground at the bottom of the em ##bank ##ment with its front . It came to rest facing south with its rear wheels just on the edge of the pave ##d south shoulder and was to ##wed due to damage . Vehicle # 1 was driven by a 54 - year old female that was un ##belt ##ed and not transported to a medical facility . Two adult passengers and an 8 - month child in a safety seat were also not injured . The driver stated she went out the wrong exit from a gas station on the east side of the highway a few hundred meters south of the crash . She intended to turn left on the side street to circle back around and enter a shopping center that was located across the highway from the gas station . App ##aren ##tly she thought that the street sign identify ##ing the side streets name was on the north side of the intersection as opposed to south and initiated the left turn 29 meters before the inter ##sect ##ing pave ##ment began . She said that once she started to turn and realized the error she attempted to brak ##e but the front wheels had left the pave ##ment and the em ##bank ##ment was so steep she could not recover . In ##vesti ##gating tro ##oper ##s agree with researcher that poor vision could have contributed to the scenario and required her to follow up with a vision rete ##sting at a state driver ' s license center . The Critical Pre ##cra ##sh Event for Vehicle # 1 was this vehicle traveling off the edge of the road on the left side . The Critical Reason for the Critical Event was code ##d other recognition error , attempted left turn too early . Associated factors included con ##versi ##ng with passenger and poor direction ##al control ( failure to control vehicle with skill ord ##inar ##ily expected ) . A vehicle view ob ##stru ##ction - related to other was included due [SEP]
" - ], - "text/plain": [ - "" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# false positive:\n", - "s = tokenizer.decode(dataset_en[\"test\"][78][\"input_ids\"][1:511])\n", - "word_attributions = cls_explainer(s, n_steps=20)\n", - "cls_explainer.visualize(\"./results/viz_78.html\");" - ] - }, - { - "cell_type": "code", - "execution_count": 65, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 264 }, - "id": "GIUENaqY-NRX", - "outputId": "1217b5dd-6bb7-40e6-8e7a-b38c2c3a07b5" - }, - "outputs": [ { - "data": { - "text/html": [ - "
Legend: Negative Neutral Positive
True LabelPredicted LabelAttribution LabelAttribution ScoreWord Importance
1LABEL_1 (0.65)LABEL_1-2.65 [CLS] This crash occurred on a straight level bit ##umi ##nou ##s two lane road ##way that was divided by a painted median . The posted speed limit of 72 km ##ph ( 45 mph ) which reduce ##s to 56 km ##ph ( 35 mph ) 100 meters after the crash site . There is a sign indicating the road ##way narrow ##s . The weather was cloud ##y and the road ##way was partially wet . Traffic flow was normal for that time of day . This crash occurred on a week ##day afternoon . Vehicle 1 , a 2002 Nissan Alt ##ima , was traveling behind Vehicle 2 , a 1991 Chevrolet Lu ##mina , when it drove into the safety zone into the on ##coming traffic lane in order to illegal ##ly pass Vehicle 2 . V ##1 returned to its original lane and impact ##ed with V ##2 ' s front left , with its right rear quarter panel . This sp ##un V ##1 in a clock ##wise position 180 degrees , with V ##1 coming to final rest after impact ##ing an em ##bank ##ment on the right side of the road ##way , with its rear left . Vehicle 1 was to ##wed due to damage . V ##1 came to final rest off the road ##way facing in a northeast ##erly direction . V ##2 came to final rest on the road ##way facing in a south ##erly direction . V ##1 was to ##wed due to damage . V ##2 was to ##wed due to its driver going to the hospital with her baby . Vehicle # 1 , the Nissan Alt ##ima , was driven by a belt ##ed 38 - year - old male who refused to be interviewed . He stated he did not want to be both ##ered \" with this sh - t \" . The Critical Pre ##cra ##sh Event code ##d to Vehicle 1 was : Other - this vehicle traveling entering the road ##way from the left side of the road ##way . The Critical Reason for the Critical Pre ##cra ##sh Event was code ##d as : driver related factor , aggressive driving behavior . Vehicle # 2 , the Chevrolet , was driven by a belt ##ed 21 year - old female who was not injured . There was a belt ##ed 18 year - old male in the front right seat who was not injured . There was a 6 - month - old female child in a car seat in the second row . The child was taken to the hospital for a check out , accompanied by both other people in the vehicle . This driver stated to her relative that she had seen the driver of V ##1 making \" wild ge ##stu ##res \" and tail ##gating her . She stated she saw V ##1 coming around her on the left but could only brak ##e before impact . The Critical Pre ##cra ##sh Event code [SEP]
" - ], - "text/plain": [ - "" + "cell_type": "markdown", + "metadata": { + "id": "yY5X79_lWNv6" + }, + "source": [ + "Next, we tokenize the extracted texts and define the labels, and store the dataset for later use:" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# false positive:\n", - "s = tokenizer.decode(dataset_en[\"test\"][915][\"input_ids\"][1:511])\n", - "word_attributions = cls_explainer(s, n_steps=20)\n", - "cls_explainer.visualize(\"./results/viz_915.html\");" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "iBJ99TPuWNv5" - }, - "source": [ - "\n", - "\n", - "## 6. Using Extractive Question Answering to Process Longer Texts \n", - "\n", - "In this section we use extractive question answering to extract parts of the accident description which indicate the presence of bodily injury. The aim is to reduce the length of the input texts by extracting only the relevant parts.\n", - "\n", - "The easiest implementation of extractive question answering is provided by the `pipeline` abstraction.\n", - "\n", - "We use [`deutsche-telekom/bert-multi-english-german-squad2`](https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2),\n", - "a multilingual English German question answering model built on `bert-base-multilingual-cased`. By specifying `device=0` we use GPU support." - ] - }, - { - "cell_type": "code", - "execution_count": 66, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000, - "referenced_widgets": [ - "8dcc9a55f9fc42ea8974b88873a296e6", - "5c1950f44eff441cafd91c9ad714f2c6", - "6697edad9b7542d48a268e439b0d8630", - "9d6263240e6644629bc1a0963e284646", - "213ef0e0126f447695c9306d1516cc32", - "a129525fcef341e7a5375712533c3125", - "fb54065cd71e498193fc18d543305c6a", - "1d6de006570a47148eb237779f954bec", - "e87244fea222418dbb5e217cbbf63eb5", - "9988c1689e5d44e2bdea2dcf9c56bf43", - "3f9e9b94aac24830a4f05856d6f4bc82", - "7af9fd0210104949bb2f68d412ba6bfc", - "f514050af9944f7e899c8264eb4832a6", - "ee456cb04466422e98a475b05f96cb8b", - "939f322f97254a9faf1e41939acf2288", - "99bd2cb4ea1f4927b4a99f90d7969b11", - "c05529b9626d403c814e5970da3a516b", - "cf651577fb50402588cb266cf12c564b", - "bd4d8217e0fd45b0bfedc63eb1b56f2d", - "f52a39f6a097468bb341a26292167487", - "efce905a70f941f5aba349834588da17", - "b0ea248a01e1421ea2bd3b0b35cc68a8", - "2c4c7d9f794741048623a48885c3e18a", - "ff51f3fb74ed4baf9bbe448d998fec9e", - "2215e32ff5ed46caa0ed42dc1dfb8db9", - "ce940e0317304277bcae61555e9d496b", - "6d8e942998f749a7b01f92e0c204ae55", - "14bdc22e4ba748ad95a951fc9205b1de", - "b8e19cf81f204990bbc0f3990c0c802b", - "fa50a023ae0447ab8f9658f436cccb1b", - "422ad05708994a168039e1c25c7c09ee", - "38d4f767793748e9bd5059a337ea4813", - "566b34e5b6ba4816bd35d8c65c940dba", - "dc592b0e71bf4aab9c18eb5ca7f8b266", - "6140cd53a73f4ae0a17508ac6ecd06e7", - "22861483c31a488989581bee679c9049", - "097d191e3c5047508818d5f6505d8696", - "03dc3788d09c4cf8be10db525b0c78bc", - "6f997cf2a9414f6e96ac5810ca3b1fb6", - "176531f5851c43188a3ec3c8d9bb2937", - "5e7a9ed13e64478cb0a37f70209b3356", - "e9c4359fccca45f793b2334ae405b64c", - "7be4267997cb4cc98c9b1f29d9ed440d", - "c22f10d95d564c45bf440b037ea1b271", - "1453d8cefbfe45d29c996f99726dcf61", - "35ee23c71d2f4385bff3075d276b2f19", - "0e8b8b5b5cd04ecbae9e6b63959dbb2c", - "56a08c5383f14e348d0f0dc28369e512", - "d8c732ab359a4c35a8e2be42e9115b3b", - "9242478b18ae4e7b8fccbb5aa9dbfb7e", - "f13ad21315444169813fea97b61a2db9", - "be8a1ebc6f43449f8a4ff0a204ad00e1", - "b368438363fc4c64aa617bf374f646e9", - "6510f713011b40b88d8b2487aaaa7580", - "0032e49d483445b7a0008846b4ef72fd" - ] }, - "id": "axQK5AJlWNv6", - "outputId": "a19e39bf-c1d3-43f4-9675-b1a711f3fb4f" - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2/resolve/main/config.json not found in cache or force_download set to True, downloading to /home/ubuntu/.cache/huggingface/transformers/tmpr8343lrt\n" - ] - }, - { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "0411f1efb8754e06a7c2e016c99b039e", - "version_major": 2, - "version_minor": 0 + "cell_type": "code", + "execution_count": 74, + "metadata": { + "id": "V1wQI2RnWNv6", + "colab": { + "base_uri": "https://localhost:8080/", + "height": 81, + "referenced_widgets": [ + "387894ba27fe4f7faf45f167413e9b5f", + "37fa4a773b554f47b112b51e4ebb938a", + "0670fcc46d654ee0ae20ff7f34f9ab9c", + "9b8c7ba357a64687a41f08c785e908a9", + "cca21899324c4fceb638c2ba5dd6579d", + "dbe87476d4ad4e729fb958d9c8d3fe1f", + "d284f7127d794451951680445b6cda8c", + "030843630f09481ba274bff6e7424c57", + "fc2ea502e43b4c479b9ec436ab73982b", + "a5cd9edbb68d41b48c891090ad7a1c19", + "e426b72d26fa4196a244b6882c025efc", + "f23f875a300a4a3ea7c266830c636f15", + "98a2a10004ea466890dfeb6bbbbbaa8e", + "ea431fa4e48f470e941f955ca54e7fe1", + "a07f93b94c4e4433b2e202ad6a040d9a", + "a6febba2e4214b95a6805794b6f36b12", + "bad729b30fa741ad98907efcd676cd8c", + "3bfb85c28b124170835e8eef3ab1efbc", + "bc6848a19db8420398466d8a3a29965d", + "b6cd9fcec9104022b7328f0c87588846", + "fd90470ad4ed44b09ca704bcd4de2c92", + "1ccec633c01b4c599d199bd1ee10bdf7" + ] + }, + "outputId": "367e2cd7-9d7f-4e16-b835-9188e9ececb1" }, - "text/plain": [ - "Downloading: 0%| | 0.00/817 [00:00" + ], + "text/html": [] + }, + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Extractive QA\n", + "accuracy score = 82.9%, log loss = 0.456, Brier loss = 0.265\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 0 0.81 0.94 0.87 816\n", + " 1 0.88 0.68 0.77 574\n", + "\n", + " accuracy 0.83 1390\n", + " macro avg 0.84 0.81 0.82 1390\n", + "weighted avg 0.84 0.83 0.82 1390\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "predictions = trainer.predict(ds_test)\n", + "_ = evaluate_classifier(predictions.label_ids, None, softmax(predictions.predictions, axis=1), [\"0\", \"1\"], \"Extractive QA\", \"cm_inj_qa\")" ] - }, - "metadata": {}, - "output_type": "display_data" - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "storing https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2/resolve/main/special_tokens_map.json in cache at /home/ubuntu/.cache/huggingface/transformers/5438742f7fe793114a6cb6d1ac46a28b6d8b8b0aa8fd55a8ea8f8ddb70b463c7.dd8bd9bfd3664b530ea4e645105f557769387b3da9f79bdb55ed556bdd80611d\n", - "creating metadata file for /home/ubuntu/.cache/huggingface/transformers/5438742f7fe793114a6cb6d1ac46a28b6d8b8b0aa8fd55a8ea8f8ddb70b463c7.dd8bd9bfd3664b530ea4e645105f557769387b3da9f79bdb55ed556bdd80611d\n", - "loading file https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2/resolve/main/vocab.txt from cache at /home/ubuntu/.cache/huggingface/transformers/93301d199c143a7d7e9b71c94261dc6920fcb9f8c6a1067a9d17f1d77935b8e5.6c5b6600e968f4b5e08c86d8891ea99e51537fc2bf251435fb46922e8f7a7b29\n", - "loading file https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2/resolve/main/tokenizer.json from cache at None\n", - "loading file https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2/resolve/main/added_tokens.json from cache at None\n", - "loading file https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2/resolve/main/special_tokens_map.json from cache at /home/ubuntu/.cache/huggingface/transformers/5438742f7fe793114a6cb6d1ac46a28b6d8b8b0aa8fd55a8ea8f8ddb70b463c7.dd8bd9bfd3664b530ea4e645105f557769387b3da9f79bdb55ed556bdd80611d\n", - "loading file https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2/resolve/main/tokenizer_config.json from cache at /home/ubuntu/.cache/huggingface/transformers/bb76acf9011b1f4e14813c2680af980c4a359b2512e38cd5315f68629e78589a.c60f034cf5bf819518a0170960ddb62b4576fa3d01e9021876b801600cbb6f42\n", - "loading configuration file https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/98815a531e6b412916e105532c140400a6e221e5d249dbc2652fc3bbbc02bb03.063bf511b0ec1ed4ac464b049fce380c9d6f729f38e5413cc3fa45026ec0a0de\n", - "Model config BertConfig {\n", - " \"_name_or_path\": \"deutsche-telekom/bert-multi-english-german-squad2\",\n", - " \"architectures\": [\n", - " \"BertForQuestionAnswering\"\n", - " ],\n", - " \"attention_probs_dropout_prob\": 0.1,\n", - " \"classifier_dropout\": null,\n", - " \"directionality\": \"bidi\",\n", - " \"gradient_checkpointing\": false,\n", - " \"hidden_act\": \"gelu\",\n", - " \"hidden_dropout_prob\": 0.1,\n", - " \"hidden_size\": 768,\n", - " \"initializer_range\": 0.02,\n", - " \"intermediate_size\": 3072,\n", - " \"layer_norm_eps\": 1e-12,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"bert\",\n", - " \"num_attention_heads\": 12,\n", - " \"num_hidden_layers\": 12,\n", - " \"pad_token_id\": 0,\n", - " \"pooler_fc_size\": 768,\n", - " \"pooler_num_attention_heads\": 12,\n", - " \"pooler_num_fc_layers\": 3,\n", - " \"pooler_size_per_head\": 128,\n", - " \"pooler_type\": \"first_token_transform\",\n", - " \"position_embedding_type\": \"absolute\",\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"type_vocab_size\": 2,\n", - " \"use_cache\": true,\n", - " \"vocab_size\": 119547\n", - "}\n", - "\n", - "loading configuration file https://huggingface.co/deutsche-telekom/bert-multi-english-german-squad2/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/98815a531e6b412916e105532c140400a6e221e5d249dbc2652fc3bbbc02bb03.063bf511b0ec1ed4ac464b049fce380c9d6f729f38e5413cc3fa45026ec0a0de\n", - "Model config BertConfig {\n", - " \"_name_or_path\": \"deutsche-telekom/bert-multi-english-german-squad2\",\n", - " \"architectures\": [\n", - " \"BertForQuestionAnswering\"\n", - " ],\n", - " \"attention_probs_dropout_prob\": 0.1,\n", - " \"classifier_dropout\": null,\n", - " \"directionality\": \"bidi\",\n", - " \"gradient_checkpointing\": false,\n", - " \"hidden_act\": \"gelu\",\n", - " \"hidden_dropout_prob\": 0.1,\n", - " \"hidden_size\": 768,\n", - " \"initializer_range\": 0.02,\n", - " \"intermediate_size\": 3072,\n", - " \"layer_norm_eps\": 1e-12,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"bert\",\n", - " \"num_attention_heads\": 12,\n", - " \"num_hidden_layers\": 12,\n", - " \"pad_token_id\": 0,\n", - " \"pooler_fc_size\": 768,\n", - " \"pooler_num_attention_heads\": 12,\n", - " \"pooler_num_fc_layers\": 3,\n", - " \"pooler_size_per_head\": 128,\n", - " \"pooler_type\": \"first_token_transform\",\n", - " \"position_embedding_type\": \"absolute\",\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"type_vocab_size\": 2,\n", - " \"use_cache\": true,\n", - " \"vocab_size\": 119547\n", - "}\n", - "\n" - ] - } - ], - "source": [ - "model_name_qa =\"deutsche-telekom/bert-multi-english-german-squad2\"\n", - "pl = pipeline(\"question-answering\", model=model_name_qa, tokenizer=model_name_qa, device=0)\n", - "questions = [\"Was someone injured?\", \"Was someone transported?\"]" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "tRdXtynCWNv6" - }, - "source": [ - "We visit each accident report in turn (the context), and ask the model the two questions “Was someone injured?”\n", - "and “Was someone transported?”.\n", - "Since the accident reports might provide information on multiple persons,\n", - "we allow a maximum of four candidate answers for each of the questions,\n", - "which we concatenate into a single (much shorter) new text.\n", - "\n", - "To achieve this, we write a short function which applies a question answering pipeline to an input text `x`.\n", - "The argument `questions` is a list of questions." - ] - }, - { - "cell_type": "code", - "execution_count": 67, - "metadata": { - "id": "Oe8OTkSFWNv6" - }, - "outputs": [], - "source": [ - "def get_answers(x, qa_pipeline, questions):\n", - " x[\"INJ\"] = \"\"\n", - " for question in questions:\n", - " res = qa_pipeline(context=x[\"SUMMARY_EN\"], question=question, top_k=4, handle_impossible_answer=True)\n", - " if isinstance(res, dict):\n", - " res = [res]\n", - " if len(res[0]) > 0:\n", - " x[\"INJ\"] = '. '.join([x[\"INJ\"]] + [item[\"answer\"] for item in res])\n", - " return x" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "nUfUYHs7WNv6" - }, - "source": [ - "We apply the question answering function to the entire test set.\n", - "\n", - "On an AWS EC2 p2.xlarge instance, the run time is about 6 minutes. If you want to try the concept on only the first 250 samples, you can use `ds_test = dataset[\"test\"].select(range(250).map(...`" - ] - }, - { - "cell_type": "code", - "execution_count": 68, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 257, - "referenced_widgets": [ - "b2281afdf62f406997af17f69bf5269e", - "d769a85b6ec2484eb38b5114e14617bd", - "d93d50ddb0274d5cb596cd7b2438ead6", - "d67ad6ce37b14b33ace6d52b21fdbe0b", - "93721862d2064d71be348c6ef8540d93", - "93bf6de69a364cb18bb2dbce7ba1969a", - "cda39e8bae2e4f04a9751f6401ddf4c0", - "cd98ea58c50a4d729a7b3caddcf8d9a2", - "659c9820a4b844b2bed858bff924477e", - "10cebe59faf04c33b932ebc02f84341a", - "b9d9c7d3e383478f91402e8f6ebae8d1" - ] }, - "id": "RnHgr4KjWNv6", - "outputId": "9df4eba2-ef5d-497f-9ac0-373e4c6a599c" - }, - "outputs": [ { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "c16928f2c4344705a9dcdd9c279d4127", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "oaNC-X-QWNv7" }, - "text/plain": [ - " 0%| | 0/1390 [00:00\n", + "\n", + "## 7. Conclusion\n", + "\n", + "Congratulations!\n", + "\n", + "In this notebook, you have learned how to apply transformer-based models to classification tasks that often arise in actuarial applications.\n", + "\n", + "You have seen how to address challenges that often arise in practical applications:\n", + "\n", + "a.\tThe text corpus may be highly domain-specific, i.e., it may use specialized terminology.\n", + " – In [Section 4.1](#domain_finetuning) we have applied domain-specific fine-tuning to improve model performance\n", + " in a specific domain.\n", + "\n", + "b.\tMultiple languages might be present in parallel.\n", + " – In [Section 3.5](#multi_lingual_training) we have used a multi-lingual transformer model to encode multi-lingual texts\n", + " and to use this output for a classification task. Performance was good even when one language is underrepresented. \n", + "\n", + "c.\tText sequences might be short and ambiguous.\n", + " Or they might be so long that it is hard to identify the parts relevant to the task.\n", + " – In this tutorial we have demonstrated two approaches to deal with long texts:\n", + " \n", + " * In [Section 5.2](#investigate) we have split long input texts into slightly overlapping chunks and applied\n", + " the classifier to each chunk separately.\n", + " \n", + " * In [Section 6](#qna) we have used extractive question answering to extract parts of the original texts which are relevant\n", + " to the task.\n", + "\n", + "d.\tThe amount of training data may be relatively small.\n", + " In particular, gathering large amounts of labelled data (i.e., text sequences augmented with a target label)\n", + " might be expensive.\n", + " – Throughout this workbook, we have used transformer models which have been trained on a large corpus of text data.\n", + " We have applied these models to the specific task with no or little specific training,\n", + " thus transferring the language understanding skills to the task at hand.\n", + "\n", + "e.\tIt is important to understand why a model arrives at a particular prediction.\n", + " – In [Section 5.3](#interpret) we have shown how to visualize which parts of the input text\n", + " cause the classifier to arrive at a particular prediction.\n", + "\n", + "The notebook Part II deals with another dataset that has only short text descriptions.\n", + "It demonstrates possible approaches in case no or few labels are available." ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "ds_test = ds_test.map(tokenize, batched=True, fn_kwargs={\"column\": \"INJ\"})\n", - "ds_test = ds_test.rename_column(\"INJSEVB\", \"labels\")\n", - "ds_test.save_to_disk(\"./datasets/ds_test\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "lrKxMMqYWNv7" - }, - "source": [ - "We load the transformer model that was trained on the classification task..." - ] - }, - { - "cell_type": "code", - "execution_count": 70, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "nmqqYs_OWNv7", - "outputId": "5b68a0ca-288a-4274-e6aa-4a9910808438" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "loading configuration file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/cf37a9dc282a679f121734d06f003625d14cfdaf55c14358c4c0b8e7e2b89ac9.7a727bd85e40715bec919a39cdd6f0aba27a8cd488f2d4e0f512448dcd02bf0f\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"distilbert-base-multilingual-cased\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"initializer_range\": 0.02,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"output_past\": true,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 119547\n", - "}\n", - "\n", - "loading file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/vocab.txt from cache at /home/ubuntu/.cache/huggingface/transformers/28e5b750bf4f39cc620367720e105de1501cf36ec4ca7029eba82c1d2cc47caf.6c5b6600e968f4b5e08c86d8891ea99e51537fc2bf251435fb46922e8f7a7b29\n", - "loading file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/tokenizer.json from cache at /home/ubuntu/.cache/huggingface/transformers/5cbdf121f196be5f1016cb102b197b0c34009e1e658f513515f2eebef9f38093.b33e51591f94f17c238ee9b1fac75b96ff2678cbaed6e108feadb3449d18dc24\n", - "loading file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/added_tokens.json from cache at None\n", - "loading file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/special_tokens_map.json from cache at None\n", - "loading file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/tokenizer_config.json from cache at /home/ubuntu/.cache/huggingface/transformers/47087d99feeb3bc6184d7576ff089c52f7fbe3219fe48c6c4fa681e617753256.ec5c189f89475aac7d8cbd243960a0655cfadc3d0474da8ff2ed0bf1699c2a5f\n", - "loading configuration file https://huggingface.co/distilbert-base-multilingual-cased/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/cf37a9dc282a679f121734d06f003625d14cfdaf55c14358c4c0b8e7e2b89ac9.7a727bd85e40715bec919a39cdd6f0aba27a8cd488f2d4e0f512448dcd02bf0f\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"distilbert-base-multilingual-cased\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"initializer_range\": 0.02,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"output_past\": true,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 119547\n", - "}\n", - "\n", - "loading configuration file models/distilbert-base-multilingual-cased_inj/config.json\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"models/distilbert-base-multilingual-cased_inj\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForSequenceClassification\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"initializer_range\": 0.02,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"output_past\": true,\n", - " \"pad_token_id\": 0,\n", - " \"problem_type\": \"single_label_classification\",\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"torch_dtype\": \"float32\",\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 119547\n", - "}\n", - "\n", - "loading weights file models/distilbert-base-multilingual-cased_inj/pytorch_model.bin\n", - "All model checkpoint weights were used when initializing DistilBertForSequenceClassification.\n", - "\n", - "All the weights of DistilBertForSequenceClassification were initialized from the model checkpoint at models/distilbert-base-multilingual-cased_inj.\n", - "If your task is similar to the task the model of the checkpoint was trained on, you can already use DistilBertForSequenceClassification for predictions without further training.\n", - "No `TrainingArguments` passed, using `output_dir=tmp_trainer`.\n", - "PyTorch: setting up devices\n", - "The default value for the training argument `--report_to` will change in v5 (from all installed integrations to none). In v5, you will need to use `--report_to all` to get the same behavior as now. You should start updating your code and make this info disappear :-).\n" - ] } - ], - "source": [ - "#ds_test = load_from_disk(\"./datasets/ds_test\")\n", - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "tokenizer = AutoTokenizer.from_pretrained(model_name)\n", - "model = AutoModelForSequenceClassification.from_pretrained(\"models/\" + model_name + \"_inj\").to(device)\n", - "trainer = Trainer(model)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "TgJjAASnWNv7" - }, - "source": [ - "...apply it to the tokenized text extracts and evaluate the predictions." - ] - }, - { - "cell_type": "code", - "execution_count": 71, - "metadata": { + ], + "metadata": { + "accelerator": "GPU", "colab": { - "base_uri": "https://localhost:8080/", - "height": 860 - }, - "id": "c34H0zoOWNv7", - "outputId": "1dca8821-ecf6-4852-e38f-734f94231dfc" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "The following columns in the test set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: SUMMARY_MX, words per case summary, WEATHER7, WEATHER2, WEATHER4, NUMTOTV, SUMMARY_GE, WEATHER8, INJSEVA, SCASEID, SUMMARY_EN, index, WEATHER3, level_0, INJ, WEATHER5, WEATHER1, WEATHER6. If SUMMARY_MX, words per case summary, WEATHER7, WEATHER2, WEATHER4, NUMTOTV, SUMMARY_GE, WEATHER8, INJSEVA, SCASEID, SUMMARY_EN, index, WEATHER3, level_0, INJ, WEATHER5, WEATHER1, WEATHER6 are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "***** Running Prediction *****\n", - " Num examples = 1390\n", - " Batch size = 8\n" - ] - }, - { - "data": { - "text/html": [ - "\n", - "
\n", - " \n", - " \n", - " [174/174 00:02]\n", - "
\n", - " " + "provenance": [], + "machine_shape": "hm", + "gpuType": "T4", + "collapsed_sections": [ + "FGxBx9MVWNvS", + "XKHtvwGHWNvp", + "fYKoqK3eWNvr", + "5FFjmHzBWNvs", + "C_CEp4ShWNvs", + "I1pU2x-JWNvs", + "kSuSXjMDWNvv" ], - "text/plain": [ - "" - ] - }, - "metadata": {}, - "output_type": "display_data" + "toc_visible": true }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Extractive QA\n", - "accuracy score = 85.5%, log loss = 0.408, Brier loss = 0.243\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " 0 0.85 0.91 0.88 816\n", - " 1 0.85 0.78 0.82 574\n", - "\n", - " accuracy 0.85 1390\n", - " macro avg 0.85 0.84 0.85 1390\n", - "weighted avg 0.85 0.85 0.85 1390\n", - "\n" - ] + "kernelspec": { + "display_name": "Python 3", + "name": "python3" }, - { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_inj_qa", - "format": "svg" - } - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " 0 ", - " 1 " - ], - "xaxis": "x", - "y": [ - " 0 ", - " 1 " - ], - "yaxis": "y", - "z": [ - [ - 740, - 76 - ], - [ - 126, - 448 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 20 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Extractive QA" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } - } - } + "language_info": { + "codemirror_mode": { + "name": "ipython", + "version": 3 }, - "text/html": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "predictions = trainer.predict(ds_test)\n", - "_ = evaluate_classifier(predictions.label_ids, None, softmax(predictions.predictions, axis=1), [\"0\", \"1\"], \"Extractive QA\", \"cm_inj_qa\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "oaNC-X-QWNv7" - }, - "source": [ - "The performance is comparable with the logistic regression classifier on mean-pooled encodings of the original texts.\n", - "On the other hand, from there is a larger number of false negatives than obtained by task-specific training\n", - "and evaluation on the full-length sequence.\n", - "This indicates that in some cases the extractive question answering has missed out or suppressed certain relevant parts.\n", - "For instance, if the original text reads “The driver was injured.”,\n", - "the extract “The driver” is a correct answer to the question “Was someone injured?”;\n", - "however, it is too short to detect the presence of an injury from the extract." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "J9SQ_YHjWNv7" - }, - "source": [ - "\n", - "\n", - "## 7. Conclusion \n", - "\n", - "Congratulations!\n", - "\n", - "In this notebook, you have learned how to apply transformer-based models to classification tasks that often arise in actuarial applications.\n", - "\n", - "You have seen how to address challenges that often arise in practical applications:\n", - "\n", - "a.\tThe text corpus may be highly domain-specific, i.e., it may use specialized terminology.\n", - " – In [Section 4.1](#domain_finetuning) we have applied domain-specific fine-tuning to improve model performance\n", - " in a specific domain.\n", - "\n", - "b.\tMultiple languages might be present in parallel.\n", - " – In [Section 3.5](#multi_lingual_training) we have used a multi-lingual transformer model to encode multi-lingual texts \n", - " and to use this output for a classification task. Performance was good even when one language is underrepresented. \n", - "\n", - "c.\tText sequences might be short and ambiguous.\n", - " Or they might be so long that it is hard to identify the parts relevant to the task.\n", - " – In this tutorial we have demonstrated two approaches to deal with long texts:\n", - " \n", - " * In [Section 5.2](#investigate) we have split long input texts into slightly overlapping chunks and applied\n", - " the classifier to each chunk separately.\n", - " \n", - " * In [Section 6](#qna) we have used extractive question answering to extract parts of the original texts which are relevant\n", - " to the task. \n", - "\n", - "d.\tThe amount of training data may be relatively small.\n", - " In particular, gathering large amounts of labelled data (i.e., text sequences augmented with a target label)\n", - " might be expensive.\n", - " – Throughout this workbook, we have used transformer models which have been trained on a large corpus of text data.\n", - " We have applied these models to the specific task with no or little specific training,\n", - " thus transferring the language understanding skills to the task at hand.\n", - "\n", - "e.\tIt is important to understand why a model arrives at a particular prediction.\n", - " – In [Section 5.3](#interpret) we have shown how to visualize which parts of the input text\n", - " cause the classifier to arrive at a particular prediction.\n", - "\n", - "The notebook Part II deals with another dataset that has only short text descriptions.\n", - "It demonstrates possible approaches in case no or few labels are available. " - ] - } - ], - "metadata": { - "accelerator": "GPU", - "colab": { - "collapsed_sections": [], - "name": "Actuarial_Applications_of_NLP_Part_1.ipynb", - "provenance": [] - }, - "kernelspec": { - "display_name": "Python 3", - "language": "python", - "name": "python3" - }, - "language_info": { - "codemirror_mode": { - "name": "ipython", - "version": 3 - }, - "file_extension": ".py", - "mimetype": "text/x-python", - "name": "python", - "nbconvert_exporter": "python", - "pygments_lexer": "ipython3", - "version": "3.7.10" - }, - "widgets": { - "application/vnd.jupyter.widget-state+json": { - "state": { - "002e841ab923418381596abd9cec2fa8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "00690283c799419ba7101ba48a6554d2": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "01285c00184b47b6b6f7da75d8e1e5d5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_7682a106a74843278900781857f02b33", - "IPY_MODEL_f11cc0c6ba9d4d5887a79d3a14394ce4", - "IPY_MODEL_781eab8aa13f4209ab892425843f1b83" - ], - "layout": "IPY_MODEL_884037052e824db9a1e8317443e8ed14" - } - }, - "0148eba515e84e2388409d86e5f588a8": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "0296991cb1a442678b663321b7c710f5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "031f0fbf56af4d50aa05559b5c759864": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "03c603ab46a54e7c9753220cbb96f2af": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_a74d6351cc4e4ec2a2c3ee5e0fc0ec44", - "style": "IPY_MODEL_8c135f1ec9744668be87ef63a409f2db", - "value": " 87/87 [00:11<00:00, 7.85ba/s]" - } - }, - "03d63347fb92463289add09226a20019": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "03d7c08cd37b4bd58a767e2b096c96ea": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_bca2a606e0e64f6e9e76cb0334c209bf", - "style": "IPY_MODEL_6262fcf796fb4a6e80bfb68fbb528d36", - "value": " 517M/517M [00:11<00:00, 48.2MB/s]" - } - }, - "0411f1efb8754e06a7c2e016c99b039e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_c4b444f255b04bda83242e0e4d53187f", - "IPY_MODEL_a4423093e08a48938a05a2a259c8793f", - "IPY_MODEL_a44651735e114874ad306c36ab459dc1" - ], - "layout": "IPY_MODEL_c8145e90ce694ba4b5989657f44d3b9d" - } - }, - "05103e136d4e4eac98e5fa19d7832d8f": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "05342badcb98463a9e8bd5b92aa501dd": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "055aba9250d74ed987addeffdd525c96": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_7a6ef8992dea4c21950bcf777ad08e18", - "style": "IPY_MODEL_0e6663dff85444f7b90664f3476fa9fc", - "value": "100%" - } - }, - "0651c71dc99e4faab331bdec4413ba7c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_f6998bc96c5a49ea8decd03a95fb51f5", - "max": 348, - "style": "IPY_MODEL_5d16ab0d2b8e47289501b08d279a313d", - "value": 348 - } - }, - "06561ab395c642038aa26010867a695f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_1557e0ee175d4501893a6b52b3d67554", - "IPY_MODEL_e716a92d4ce84d75a4e9886320a17c13", - "IPY_MODEL_b1379d827e5a4740b8e55741e9c9be0f" - ], - "layout": "IPY_MODEL_3922b334597b4109b8efe16af17e0034" - } - }, - "06579421526d4f7181cff136661628f6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "06db28f7a8814a5aa2395cefef0cb4e2": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "07f526a4584943198cb19186ea3e274d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "080211f2e8034a6d8f966b988ec457cd": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "08259ba02dd444f090aeb052cb3f1573": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_00690283c799419ba7101ba48a6554d2", - "max": 6, - "style": "IPY_MODEL_df7ed4a356bb491c8e4100437d95d67d", - "value": 6 - } - }, - "086a3d43e4904d8fb264b702390e7496": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "092fa72c59c145f6a799066facb7edcc": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "0988f3d87a2840c5a90d4aefc3cb9dc8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "0ab666685d8a4aaf8dd63bb69750c749": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "0b50269deb734c20905ea10701badb5e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "0bca65497b764e1386e7a69f7de3bf11": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "0c2894596565486f82bb48008bd3b3b9": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_781dbfe0ace544798639a10ec4580222", - "max": 5559, - "style": "IPY_MODEL_a595dcca2b634bc48fad6beae2643543", - "value": 5559 - } - }, - "0c37e2e8c9464605917242f0319decdc": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "0c74fb15f55e44a185fb83650243efe3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_e1d6cedb943e46e0ba8a21b910a3598b", - "IPY_MODEL_a1db92b35be943499b08156a35e059fb", - "IPY_MODEL_54faca62ff874440af3d0bc1ab2a9929" - ], - "layout": "IPY_MODEL_660902a00b7f40f5b6ef088fb116b819" - } - }, - "0e3b197e43674ba0aabd8b92a4cdaea5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "0e6663dff85444f7b90664f3476fa9fc": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "0ec57e8af874486a95bcbdb823dfd851": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_36cda942c08a43438d5951cfd59f2180", - "style": "IPY_MODEL_ab99b45526114e3aaffa9549b416a365", - "value": " 348/348 [00:46<00:00, 7.48ba/s]" - } - }, - "0fc13388a3db46259b6e2c9d034067ed": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_b9c08d510ce44ea384dd3ffe4fc70211", - "IPY_MODEL_d96aeb217a644134a89819efb2beeb3a", - "IPY_MODEL_6a1f0181396d429bb1766a9003d10a3d" - ], - "layout": "IPY_MODEL_c01f8d5218fc495795f1dbf915228298" - } - }, - "1020efb8045748a982ef4e501aa75bb8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_4cce812e7ba640bb8eb350b0a6a3618d", - "style": "IPY_MODEL_bfa3df8bee9d43939055204801eef8b5", - "value": "100%" - } - }, - "1103ab4250b24a38bccfa02cab3e8636": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_57447b8fcfa54e57ac16d8475d634845", - "max": 5559, - "style": "IPY_MODEL_67b3f25a471a47b3838afe87b2175cc2", - "value": 5559 - } - }, - "1114e3a516e24b2aa303dae26f9b1bd3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_3b3d438a87144a3da48185fe3f3f406b", - "style": "IPY_MODEL_649d30ac1ca04a799d1bdfef4f8a37ba", - "value": "100%" - } - }, - "114e186aad8845b289ee2e2f7fdc410d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "117944fbfade4ddda79c3f63e28e8286": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "11c654295ff84876ae63ec3b2ccd5724": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "1274e9af953c425ca19292a87bf94b6a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "1315f3e0ac084d3a8c7ccf4ef7e4c2aa": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "1331643494cd4420be8f9eca0255f727": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "1557e0ee175d4501893a6b52b3d67554": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_989790596fdf43209198ec94434bb7aa", - "style": "IPY_MODEL_f5d136e906c34f628b0d48e0cf4e8a85", - "value": "100%" - } - }, - "160183a43c694d44b63cef13c7d222b6": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "1621a17be2b3429999541088706b266e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "170ff439d3574773b8b7118881c44657": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "187ddca2e74c4d68820cb62f433e2322": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "191693164d78457389a6e913edab5de3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_e1f7a7f11b584fa29544781b6c192a88", - "IPY_MODEL_65727f1586174b85a2b2188dabb2bc12", - "IPY_MODEL_385624c619b642548401e24a083df884" - ], - "layout": "IPY_MODEL_f41c8cf2b23045c3b417f8310395222d" - } - }, - "1956c3d386b0412081a9b1ffd7d21389": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_5cc5e172cca745a89f32556c9ab172a5", - "IPY_MODEL_0c2894596565486f82bb48008bd3b3b9", - "IPY_MODEL_43df9638fd2741018c1c1df507f64630" - ], - "layout": "IPY_MODEL_28a41e4acf444f85a5cb9c7d8df04e60" - } - }, - "19dd5e60e4b54dde89c9a39b9a11ec0b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_7c8ad1c424b440d59d93f1130f63817c", - "style": "IPY_MODEL_6188df176ee941f4963c032c85b41ad6", - "value": " 29.0/29.0 [00:00<00:00, 1.14kB/s]" - } - }, - "1a628f027e824afaa5cc5f43ccf8a06a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "1b26acb6935a40fdbbffc78b8805528d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "1b535a85e8c04761a4279fd3f1c9d642": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "1c2f3079d581443eb41f5ff50579fa52": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "1c945cd4339e4272af70e5d32e7e89ae": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "1d5ed06265a9451b89ed10845e8f224d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "1e0c30113b0d4f259f8e1b7ccf349757": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "1e0cd6a51a0245b9ae22028ffe144026": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "1e0ee0e96b2b4f0fa8b545c82053b36e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "1f2a0ced79fc4b9aaad3f1ef2ca227f2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "218683b0ee39497a893d78cde9afa0ce": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_82da0c4b520741c8b9e00bee90fe288b", - "max": 1390, - "style": "IPY_MODEL_cccfbcfce7e946ffaa69abbb1fe97a36", - "value": 1390 - } - }, - "21a3d53c2ebd42fbb45ffc584b05a245": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "22bdf245c6d6466fa88fa4c666bd517e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "2349c39c31bf4393b08a332fd0448424": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "236cbe2484344f56af7cc21f49ec4430": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "2494a4b3ea254edf85ea3adfc0f7ccf7": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "24d42686153e49aebba0b4d700e18f33": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_a1400c2b1cc447d498fff344fcd400a1", - "style": "IPY_MODEL_3d2fb28e50a149719b3ba12d78c0f467", - "value": "100%" - } - }, - "2514c5f98bed4607a9cd9437a1b27cff": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "254af2c6422b415a9867e6e1fefb8675": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "25bfef46052b440f8952f032f1d8afa0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_abb624f2f904436cad378d2a563f25cd", - "style": "IPY_MODEL_ed953a21812e485faf38d6897e5c0b5b", - "value": " 2/2 [00:00<00:00, 2.59ba/s]" - } - }, - "25e0cd284100462ea605842316026183": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "2670adc07c6b4f42a5810ba8ecd20fe2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "2696a2f56a494c349ec9639d73bfd3e9": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "27ba00051803455ba86df9670ec177c4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_b073c73a739f4c3e95a3d0d37d786dad", - "IPY_MODEL_904e3f60a8a24417b3a54efb249b685d", - "IPY_MODEL_385cecd5fde54f9eb48655b0f8d52f5c" - ], - "layout": "IPY_MODEL_2a2c13ad16f64ac48257b10e4e736fea" - } - }, - "27ef6eeaaccd4aa5896dd377dd6f76bf": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_b95f6d1a997c44419102d1514fb98d2d", - "IPY_MODEL_fe5e5202b92348198a15e7c7f0aa64b0", - "IPY_MODEL_bf4f6dbf5c724478ba1cc10f3b704b2b" - ], - "layout": "IPY_MODEL_4ba9060532a74e8eb5240cdbd0b2d107" - } - }, - "28a41e4acf444f85a5cb9c7d8df04e60": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "2962c27974804c368efd3df7336f4ca7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "2a0a590fc5294eb5b51048cfc6d3f3cf": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "2a293316552740d99764390b02fb179d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "2a2c13ad16f64ac48257b10e4e736fea": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "2a4cf8f973814d3bbb2ca2348693363e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "2adc23438ecd41d9a6eae74e8e9d4889": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_1d5ed06265a9451b89ed10845e8f224d", - "max": 87, - "style": "IPY_MODEL_f19f6f9cecdd43d49b65609114e69f13", - "value": 87 - } - }, - "2b328479261d40ff9e61c032fef10aa2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "2b6c42fe2ea944949a92fb104e2ca134": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "2b90ae2355a5407885fdedc4169cb506": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_50314b5881154bb19b23e20cb4883f19", - "style": "IPY_MODEL_06579421526d4f7181cff136661628f6", - "value": " 5559/5559 [00:09<00:00, 671.44ex/s]" - } - }, - "2bccf81f193e4153a1ac3f87751893ca": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "2c73defaa3574f5082f437cba46e82d8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_d7ebca2da90f43668718ba8843baea6b", - "max": 5559, - "style": "IPY_MODEL_5d6b25459732460a8bf3105b47b3f991", - "value": 5559 - } - }, - "2c9cb39cfa39461e81a7bb992d2b9f81": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "2ca2175a822b4a89acedd3fdb4bddfd7": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "2d78788b8cd84962aa3c3f8fc433f574": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_7079b527b09741418fe0c7d6a6eced1f", - "style": "IPY_MODEL_f5b648cd76ca4057957391fb6768ba18", - "value": " 1390/1390 [00:02<00:00, 625.98ex/s]" - } - }, - "2dff3414bf404bc4aea517c2a2405149": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_3f1ba9ea11564ad88f1eac73e773e19a", - "style": "IPY_MODEL_34349ef8564b444fb13897e4c5dae323", - "value": "Downloading: 100%" - } - }, - "2f0730308735437c9c256d232af64781": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_b41ffb86f218401a9a57dfb735ee9d20", - "style": "IPY_MODEL_a96a2ae1b99740c0a28671b2341764b7", - "value": " 87/87 [00:12<00:00, 7.25ba/s]" - } - }, - "2f72dd2c82dc471c9fa47ab533963cee": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "2f8c513520444fb0be5cc26174d94ab8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_94b48660a81748fa88e90907a1887701", - "style": "IPY_MODEL_ea2542ce46504eb2846b091d5541884c", - "value": "100%" - } - }, - "2fcd2001f783472182709885679c7560": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "30241c63b1274a5a802a9cce0ea502a6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_58bf108b287a46939beecf498badff64", - "style": "IPY_MODEL_3cc92cefcca9468e8ff092907f479a69", - "value": " 6/6 [00:02<00:00, 2.31ba/s]" - } - }, - "3105381953e4426dbb7f66c987a066c2": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "31177b93c29d442f9aa3ae09df40a972": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "31c0c8c1f91b45e988d24593d3c414d7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_f9b15c404b7e4408a357c890dedf03ff", - "style": "IPY_MODEL_91d3e742430343c0b5e6bc56b738864c", - "value": " 5559/5559 [00:08<00:00, 700.98ex/s]" - } - }, - "31f53ae765664719bd921e7d187b5c2f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_4e32b0d64a854ce387c87bd0d76a4dc7", - "IPY_MODEL_fe8432c77f9b49a7b8e6c0d7937556e4", - "IPY_MODEL_0ec57e8af874486a95bcbdb823dfd851" - ], - "layout": "IPY_MODEL_0148eba515e84e2388409d86e5f588a8" - } - }, - "320184abbcdf4efd98d3037b32fc9c6d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "320c12d2684e4b2b8b61f1d799a478ba": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_6eb292e4f6c147ca9e140dcab4125623", - "style": "IPY_MODEL_81e890349f26437b91e4463556537d64", - "value": " 348/348 [00:49<00:00, 6.96ba/s]" - } - }, - "3225c4be3fcb4b258c8c7dae6b02f534": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_e5a2e8bdc0cf48e89893a54caf7aafab", - "style": "IPY_MODEL_2670adc07c6b4f42a5810ba8ecd20fe2", - "value": "100%" - } - }, - "326ae8ff921d4a44bd19ac429b8db569": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "32bcb06cc25c4acda72925aee6d0db47": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_87452986a52341bab8246e485ddb1228", - "max": 112, - "style": "IPY_MODEL_702d18fa940f4abeb9c2bfe1cbcc43b6", - "value": 112 - } - }, - "32de53bbe1ad45d08744699d01fc75bb": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "32f32acbfbfa401f884dda058dfc599c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "34349ef8564b444fb13897e4c5dae323": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "34e54ec471aa43568fe3098866d09185": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_a647739e83e247b4bb7468740a6fe7f6", - "IPY_MODEL_90939b3c68dd486eb49d3c4ebfdd6828", - "IPY_MODEL_cb0e3a7fbb7442389601d142ba74501b" - ], - "layout": "IPY_MODEL_ac6afd59726d400d8e022ba8c0fe53ed" - } - }, - "367f9396563741b3b2243f027eb039e6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_c72401249d054acab1e7163131c27d48", - "IPY_MODEL_f005f6330a86446885cff4b7be7623d7", - "IPY_MODEL_ad1fda29efd54c6788aa1a8b548f6404" - ], - "layout": "IPY_MODEL_95a8b64edf8c4e15b94aee5d05860c16" - } - }, - "36cda942c08a43438d5951cfd59f2180": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "36fabf6cf0894cdb93fa97dc8e72a592": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "37688bb912434489a9b0954571142b8d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "37b1ba9b0990460b80459cd828a3056d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_d40c8782a91a4d33a7eca12e58831d30", - "IPY_MODEL_4683a02422114998a9f035699bb36198", - "IPY_MODEL_dce3303f19c74ce2b0aad9f3acdf1e1a" - ], - "layout": "IPY_MODEL_66aab5aabdd84da2a0d83a032ca0d5bc" - } - }, - "37ddb1f28257417b97dba06fdbea8bd8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_445da3cec248493fa59e9be4269c6096", - "style": "IPY_MODEL_c123b8e01e394da4a3072a965cc9ad96", - "value": "100%" - } - }, - "385624c619b642548401e24a083df884": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_795f291a45fd4fb398364a822284a2a5", - "style": "IPY_MODEL_32de53bbe1ad45d08744699d01fc75bb", - "value": " 972k/972k [00:00<00:00, 938kB/s]" - } - }, - "385cecd5fde54f9eb48655b0f8d52f5c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_114e186aad8845b289ee2e2f7fdc410d", - "style": "IPY_MODEL_a7f364381dff4baaa8188d53d16b41d9", - "value": " 466/466 [00:00<00:00, 18.2kB/s]" - } - }, - "385f90fc5c3a4c23a48e0c8db9d34a7c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "386d998c830b4cbeae3ebff47fd369f3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "3922b334597b4109b8efe16af17e0034": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "395627884a1b45f0af752777a2055ae1": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "3956d66a970a4ee9a30f398f0b57fed6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "3a1c6f07607d4c5e811b79cdb2d631a5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "3a2ba01e272b42ba816f5b8b861dec9f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_60fa1fba02c9411cb72242b8db61f5c4", - "IPY_MODEL_d248f2dcb5614d9f8fc9f00f7dc345ec", - "IPY_MODEL_f6acdb35b23243639f1dede27fd3eebf" - ], - "layout": "IPY_MODEL_bb5caa0726d24ce2884bedb453e4a6f3" - } - }, - "3a3b2f40e028449e9ed5e7496648bf98": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_6c4c131b24a149ad89b1abb9d14cbd9e", - "max": 5559, - "style": "IPY_MODEL_2a293316552740d99764390b02fb179d", - "value": 5559 - } - }, - "3b3d438a87144a3da48185fe3f3f406b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "3b41509658ed4212abe2fa395e8c3921": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "3ca91580b2784348a20b28236f908a94": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_2fcd2001f783472182709885679c7560", - "max": 87, - "style": "IPY_MODEL_9ce313d66b7b474aa8bb638ba0eefac5", - "value": 87 - } - }, - "3cc92cefcca9468e8ff092907f479a69": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "3cfdb9d2f89b44458016e6e562c5a235": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "3d2fb28e50a149719b3ba12d78c0f467": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "3e636c720678435c980ade35823caced": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "3f1ba9ea11564ad88f1eac73e773e19a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "3ffa93f71dd345d68cb00b51c089a880": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "4031d15e172a4fd7b610552e6bde4f9b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_086a3d43e4904d8fb264b702390e7496", - "style": "IPY_MODEL_4122a90326e14b3a9087a92e57cbb6d9", - "value": " 1390/1390 [00:00<00:00, 3258.73ex/s]" - } - }, - "4058fb6758ff4420a0da1ffbbe63aa01": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_ffa0acc7157048b18a90544cf814c32a", - "IPY_MODEL_7e03612cd3744ebe81557acf684339a0", - "IPY_MODEL_9743ff350d474179bff911b72633101d" - ], - "layout": "IPY_MODEL_1a628f027e824afaa5cc5f43ccf8a06a" - } - }, - "406a32ae9c234eea8a3150fd8f287163": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_f2e211f1e1f84a4c82cbee09cc95d477", - "style": "IPY_MODEL_2c9cb39cfa39461e81a7bb992d2b9f81", - "value": "100%" - } - }, - "4088953449d74aa9bc31396a9015d1ef": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_24d42686153e49aebba0b4d700e18f33", - "IPY_MODEL_3a3b2f40e028449e9ed5e7496648bf98", - "IPY_MODEL_2b90ae2355a5407885fdedc4169cb506" - ], - "layout": "IPY_MODEL_1c945cd4339e4272af70e5d32e7e89ae" - } - }, - "4122a90326e14b3a9087a92e57cbb6d9": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "413181e5ce3d45a5b8ef3a7e8f0cd287": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "4132d3fa15124b919ef49cb4bb716ecf": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_e58034433d89426a859c55eb316a92b8", - "max": 348, - "style": "IPY_MODEL_ae236ab9cc40402697a9fca685ac811a", - "value": 348 - } - }, - "4134799bb39445969cecc66809d95b55": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_8f08f2847c4d4edc8f2d5fadfd0e59f3", - "style": "IPY_MODEL_dda190ec480842858552f96133540e5f", - "value": "Downloading: 100%" - } - }, - "43a50f527ce248fc84b0977c18e7688f": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "43df9638fd2741018c1c1df507f64630": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_897e672979bc4914a432e0d476a324ba", - "style": "IPY_MODEL_990ed0260dea470f81e2fcafa3e28fb1", - "value": " 5559/5559 [00:01<00:00, 3536.89ex/s]" - } - }, - "445da3cec248493fa59e9be4269c6096": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "4479bf779ba3468e8f37067c50baed81": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "4551ca0bf1a947e79d71666d1247c2d5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "46448ea2433848c0b023b8b683b65f9b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_834ccccdfb55469ea3594196a07a1abb", - "style": "IPY_MODEL_b16feb58266c4ff0b303c0df791e84d3", - "value": "100%" - } - }, - "4683a02422114998a9f035699bb36198": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_a5e03e9c5dde41f1834711182a5b059b", - "max": 348, - "style": "IPY_MODEL_a9cc5a9d425e4b5f9ac587935cf52b2b", - "value": 348 - } - }, - "4824cdd7e01e46e7a16c85f413e792d8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "4852df9d08cd4a3391e2c05ab4301a98": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "488e18a4d85b4d3f94ac192dc2780dba": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "491f5d951554473cae0beec7e74c249d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "494b723eabbf4fc4aace08493ed50a64": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "4a8b34003f294cd08c4a451162266d75": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "4ac97176706247d69512c913cba8faa4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_58fce118dd9443808210a1b504b45cc9", - "style": "IPY_MODEL_df2c57a8ed6546a88b1ad005a7412ee8", - "value": " 1390/1390 [00:02<00:00, 643.53ex/s]" - } - }, - "4b45465d14254e4db5152cf56173a440": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "4ba9060532a74e8eb5240cdbd0b2d107": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "4be01494d2b44251a16b5b2e4f7363c7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "4c69ba1c8b85408ca6dd03b4b028e5b8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "4c73d3985f594074bd4a806bac38c395": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "4cce812e7ba640bb8eb350b0a6a3618d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "4e0eca1f275c492f84dc93cbc9d94446": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_a1fc0e8c46bf4d64b56b34162866b4e7", - "max": 541808922, - "style": "IPY_MODEL_386d998c830b4cbeae3ebff47fd369f3", - "value": 541808922 - } - }, - "4e32b0d64a854ce387c87bd0d76a4dc7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_8d39cb9850bb4ee39bbbbe170a66636f", - "style": "IPY_MODEL_8c133a86c967414eb6ceec8723c52dc8", - "value": "100%" - } - }, - "4f3290e9d0e7451b95cc4b45184fbed5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_b1ebc6b8c1374ebabdf82063913c0f24", - "style": "IPY_MODEL_488e18a4d85b4d3f94ac192dc2780dba", - "value": " 1390/1390 [00:02<00:00, 623.00ex/s]" - } - }, - "4f50f799e5224b82ab9ddc7421117070": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "50314b5881154bb19b23e20cb4883f19": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "509ccacceca641cd8b85d1780e430360": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "514e81e5fe744f4ab78cdab5d3a7794d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "54faca62ff874440af3d0bc1ab2a9929": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_2ca2175a822b4a89acedd3fdb4bddfd7", - "style": "IPY_MODEL_a213a9e760834d079dac321b59f09344", - "value": " 1390/1390 [00:02<00:00, 612.74ex/s]" - } - }, - "560dd4cd0e9942008997c0ebdf79603f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "57447b8fcfa54e57ac16d8475d634845": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "57ee02ac216e4ebdacfda74a2200b7f0": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "57f2c2d7d49f4d2dbabd2d8b1930d082": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_46448ea2433848c0b023b8b683b65f9b", - "IPY_MODEL_6bb2a2a01a424be3ab79d7cd0508074e", - "IPY_MODEL_320c12d2684e4b2b8b61f1d799a478ba" - ], - "layout": "IPY_MODEL_3e636c720678435c980ade35823caced" - } - }, - "58bf108b287a46939beecf498badff64": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "58fce118dd9443808210a1b504b45cc9": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "59b7ca7b01144e5eb76bc44845967be4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "5af5a48ac97c4376b105eabb22067904": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_eb53d84e66b34ff7aa0ca5d9b8c202ea", - "IPY_MODEL_3ca91580b2784348a20b28236f908a94", - "IPY_MODEL_03c603ab46a54e7c9753220cbb96f2af" - ], - "layout": "IPY_MODEL_ea7721682a9d44a884f00484e9b7f1a8" - } - }, - "5b516c3ec27d4a5a819fb8947b9798ab": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "5c2e14bd4116402584dc695b402ea176": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_9c73b8f38174421faf27c04fec9da712", - "style": "IPY_MODEL_fcc74af4ddc44ecc880ee79b3dedceab", - "value": " 348/348 [00:50<00:00, 6.90ba/s]" - } - }, - "5c6460d0c4bd425798ba1d033647e4b3": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "5cc5e172cca745a89f32556c9ab172a5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_c6b9f9ccac774d7abcee7760d0d73f2c", - "style": "IPY_MODEL_4be01494d2b44251a16b5b2e4f7363c7", - "value": "100%" - } - }, - "5d16ab0d2b8e47289501b08d279a313d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "5d6b25459732460a8bf3105b47b3f991": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "5f48c6bb8084499389fbac7c47510eeb": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "5f4e44590ca64c65b98ce4c4ed6b5190": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_055aba9250d74ed987addeffdd525c96", - "IPY_MODEL_d945f7faea2e420592156ff3f6b48297", - "IPY_MODEL_f3199300d4f44c369d7b66435ec4ddb5" - ], - "layout": "IPY_MODEL_905424bce27a46cc896bfe48be700b87" - } - }, - "6027fe6ca76f44cba40fab280a4299c4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_c0cc08c74360458c87f5cc7feeaf1049", - "style": "IPY_MODEL_4f50f799e5224b82ab9ddc7421117070", - "value": "100%" - } - }, - "60fa1fba02c9411cb72242b8db61f5c4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_d7a218a6d68b422e9076267465749cda", - "style": "IPY_MODEL_22bdf245c6d6466fa88fa4c666bd517e", - "value": "100%" - } - }, - "6188df176ee941f4963c032c85b41ad6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "6262fcf796fb4a6e80bfb68fbb528d36": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "634767f5c7fd4ea7906e47d97593cdb5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "649d30ac1ca04a799d1bdfef4f8a37ba": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "65727f1586174b85a2b2188dabb2bc12": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_f83b733575484bdca0dec3651308a667", - "max": 995526, - "style": "IPY_MODEL_f6850cec019d48a7b18f255197e655ed", - "value": 995526 - } - }, - "6602708ec17a4ca7af338b474355b8d4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_ff3a702486a44640a7b2512d13323f32", - "IPY_MODEL_75569c1f088d4950ad84be835ac67c09", - "IPY_MODEL_4031d15e172a4fd7b610552e6bde4f9b" - ], - "layout": "IPY_MODEL_cf6f18eee4c54755bb7a82870b0c85ff" - } - }, - "660902a00b7f40f5b6ef088fb116b819": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "66aab5aabdd84da2a0d83a032ca0d5bc": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "66b215a1c19a42af9421000dd7c823c5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "676531e6b5e942a0bafe59c509a9b995": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "6778b476b46c45c7b1f5b2bf99c430ca": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_37688bb912434489a9b0954571142b8d", - "max": 5559, - "style": "IPY_MODEL_2f72dd2c82dc471c9fa47ab533963cee", - "value": 5559 - } - }, - "67b3f25a471a47b3838afe87b2175cc2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "67cb390f024d492dacc0d7d4cd0675d2": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6808fceb14ba4531961e02462be7c04e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "683770347e5b40ef828bb6377fecf5c7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_06db28f7a8814a5aa2395cefef0cb4e2", - "style": "IPY_MODEL_395627884a1b45f0af752777a2055ae1", - "value": "100%" - } - }, - "694d97bcf8c44933a68857a4f1b625fb": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "69e94aedff9c4bd1af752b54c1d7244b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6a1f0181396d429bb1766a9003d10a3d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_2494a4b3ea254edf85ea3adfc0f7ccf7", - "style": "IPY_MODEL_6adb24639c7147cea450a4585d87d47d", - "value": " 972k/972k [00:00<00:00, 891kB/s]" - } - }, - "6adb24639c7147cea450a4585d87d47d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "6b237b221412407f9ccc188ce1b4d90b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6b6ef6c31335467dbde30b97d356ca35": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6b7dcb5f7c994552a30029e31e1fd615": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "6b94a963e4ab4ec6a217ad3586b1a25d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6bb2a2a01a424be3ab79d7cd0508074e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_a99d12b2e5ff45079277bbe2589576d5", - "max": 348, - "style": "IPY_MODEL_676531e6b5e942a0bafe59c509a9b995", - "value": 348 - } - }, - "6bdc8d1532464271b0a2451dfc1476a0": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6c4c131b24a149ad89b1abb9d14cbd9e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6cf843de663547a2b090656f3cd3573d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6d2e86c1efa34946b84e48b5b3aaec7a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6e4514e8397841fc82ab54554e3a8932": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_6ef4ca7f54804f239b83bfd239d0f11f", - "IPY_MODEL_dbb0b99a500e40a29f86239a7070a88d", - "IPY_MODEL_2f0730308735437c9c256d232af64781" - ], - "layout": "IPY_MODEL_6bdc8d1532464271b0a2451dfc1476a0" - } - }, - "6ea6cb7ca0a24b57a480a254975f7f89": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6eb292e4f6c147ca9e140dcab4125623": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6ef4ca7f54804f239b83bfd239d0f11f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_e7986977599c471d8f2fa8abe0c5d618", - "style": "IPY_MODEL_ff2be633283f40df9175cde43adda0af", - "value": "100%" - } - }, - "6efd32169fea4c129884c95b243455d9": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "6ffa53391c5f431192a7c1cfce09a585": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "702d18fa940f4abeb9c2bfe1cbcc43b6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "7079b527b09741418fe0c7d6a6eced1f": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "70fb65fde9044c5faef948f74dc00163": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "721f9838df4f43c7b5942fc7faf8e002": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "74554082b33c4069b883587c1c0d6deb": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "7459e7924fca46518d0f5617b1d365d7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "75569c1f088d4950ad84be835ac67c09": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_3105381953e4426dbb7f66c987a066c2", - "max": 1390, - "style": "IPY_MODEL_509ccacceca641cd8b85d1780e430360", - "value": 1390 - } - }, - "755ee5bc3e344bb097e3267a69f3047f": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "75e0f9850ddf4d179076c671445991f6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_2a4cf8f973814d3bbb2ca2348693363e", - "style": "IPY_MODEL_7b399bd196f44faebf0b307026c59ca6", - "value": " 264/264 [00:00<00:00, 10.3kB/s]" - } - }, - "7682a106a74843278900781857f02b33": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_c8267fa9421445fe9ace1a61c19f3234", - "style": "IPY_MODEL_a56cf9ed288841d9b7539811f9d01e71", - "value": "Downloading: 100%" - } - }, - "76e01244c15c40eca4985fd2d9d3726b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "770843649fe748a5b00e276029bd26b3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "7784b2cdafed4007ad7721a76d009f1c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_2349c39c31bf4393b08a332fd0448424", - "max": 87, - "style": "IPY_MODEL_6808fceb14ba4531961e02462be7c04e", - "value": 87 - } - }, - "781dbfe0ace544798639a10ec4580222": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "781eab8aa13f4209ab892425843f1b83": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_82752acadc8940a49a7cfb4c86184b11", - "style": "IPY_MODEL_b61f6b81698c4884b5577cfc54b388c1", - "value": " 1.87M/1.87M [00:00<00:00, 2.89MB/s]" - } - }, - "783a4927d42c489b97c29c1698047a19": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_bb48c4f2115241ae9cb06aaced18d7be", - "style": "IPY_MODEL_7459e7924fca46518d0f5617b1d365d7", - "value": "100%" - } - }, - "78af46f672764221a9a83c9d8b3fbd5c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_2dff3414bf404bc4aea517c2a2405149", - "IPY_MODEL_4e0eca1f275c492f84dc93cbc9d94446", - "IPY_MODEL_03d7c08cd37b4bd58a767e2b096c96ea" - ], - "layout": "IPY_MODEL_5c6460d0c4bd425798ba1d033647e4b3" - } - }, - "78d0eb13230f4c46a43f06d5eb709b29": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_d985b75d84ec42f8b5a683db4231f181", - "style": "IPY_MODEL_4c69ba1c8b85408ca6dd03b4b028e5b8", - "value": "100%" - } - }, - "795f291a45fd4fb398364a822284a2a5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "7a2686e16e9443f5a5508c46e0ed5486": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "7a6ef8992dea4c21950bcf777ad08e18": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "7b399bd196f44faebf0b307026c59ca6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "7b87edac6cac4e49918b43fbb2433f38": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "7c8ad1c424b440d59d93f1130f63817c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "7e03612cd3744ebe81557acf684339a0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_0296991cb1a442678b663321b7c710f5", - "max": 1390, - "style": "IPY_MODEL_c0cd051c9e104dfeabbd5eb477dc010d", - "value": 1390 - } - }, - "7e43280a741347f4b602b192ff6b6bab": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "801495d1fd614dd79a115731132a58a7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_d7c799857d834728a4cc3bc6f7da3e4d", - "style": "IPY_MODEL_e571910d85444667b7e4f535fb996f15", - "value": "100%" - } - }, - "80269e61365142148c17dbe6f06a1e18": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "81446df0c8dc44f593b95f5484a0424f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "81e890349f26437b91e4463556537d64": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "82752acadc8940a49a7cfb4c86184b11": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "82da0c4b520741c8b9e00bee90fe288b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "834ccccdfb55469ea3594196a07a1abb": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "83fb52dd8abc430e9c80434449de43c7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_d170fd6f220a42b2a4261f388aae75b5", - "IPY_MODEL_4132d3fa15124b919ef49cb4bb716ecf", - "IPY_MODEL_5c2e14bd4116402584dc695b402ea176" - ], - "layout": "IPY_MODEL_4b45465d14254e4db5152cf56173a440" - } - }, - "845de289a7dc4b7ba15c1c0b8255e2cf": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_e5443d92db2845f296f8ca7872f4563a", - "style": "IPY_MODEL_e1cd4649482e4b42a2bc3032878c56dc", - "value": "100%" - } - }, - "859b54cd3dfb4a408d92d931fdec5922": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "85dde2754a6c4b5e886ad1b459bef37a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_a0dc2f34bb2a4de3afc64579ac371351", - "style": "IPY_MODEL_b1b8d8f436b848a4b7217257fc31221e", - "value": " 6/6 [00:03<00:00, 1.97ba/s]" - } - }, - "8615158ca0574299a22747a6ec300941": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "8721f66e611f43d094fffba1dbb01bc7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_0e3b197e43674ba0aabd8b92a4cdaea5", - "style": "IPY_MODEL_4824cdd7e01e46e7a16c85f413e792d8", - "value": " 87/87 [00:11<00:00, 7.74ba/s]" - } - }, - "87452986a52341bab8246e485ddb1228": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "880ac415dc784685ad0d57837f12ddd0": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "881f6187c2194bba84d66bcf00c3f276": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_6b6ef6c31335467dbde30b97d356ca35", - "max": 1390, - "style": "IPY_MODEL_770843649fe748a5b00e276029bd26b3", - "value": 1390 - } - }, - "884037052e824db9a1e8317443e8ed14": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "88e7e791e98c4df9b7008ef3b00b9c8e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_bc50e48b05c341079956b022ac5adb4a", - "IPY_MODEL_d1166658e6f44ee7992c032da46276ba", - "IPY_MODEL_f80ac083117842e6a4c633b928c20a2c" - ], - "layout": "IPY_MODEL_57ee02ac216e4ebdacfda74a2200b7f0" - } - }, - "8934ce9135fa444ea9db62a51dd98191": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "894bf6fa3e324d7bac3245a613d4baa9": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_2696a2f56a494c349ec9639d73bfd3e9", - "style": "IPY_MODEL_2b6c42fe2ea944949a92fb104e2ca134", - "value": " 112/112 [00:00<00:00, 4.30kB/s]" - } - }, - "897e672979bc4914a432e0d476a324ba": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "8997b74c0abc4cfcb63f6e4e37d102ea": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_da0c407b7f4d4f5c8ac8ecef5e8ca394", - "style": "IPY_MODEL_6b7dcb5f7c994552a30029e31e1fd615", - "value": "100%" - } - }, - "8b41d06cf9f341f7be52ea922f21feb9": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_c1f4ba58d981450794c6d7e03a550b5a", - "max": 87, - "style": "IPY_MODEL_494b723eabbf4fc4aace08493ed50a64", - "value": 87 - } - }, - "8b60563624504460a7d04bbcc601e0f5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "8b87eeb59ced4b2f851c00e8b35e2fce": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "8c133a86c967414eb6ceec8723c52dc8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "8c135f1ec9744668be87ef63a409f2db": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "8d39cb9850bb4ee39bbbbe170a66636f": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "8dcc40b67f03494eae1433545b547748": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "8e32036825b2404fbe7b40f4e20ef2af": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "8f08f2847c4d4edc8f2d5fadfd0e59f3": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "8f5139aab2b0478695f1a548c0224848": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_b00d12480cdc47eeb759f752f6f7cfdb", - "style": "IPY_MODEL_7a2686e16e9443f5a5508c46e0ed5486", - "value": " 87/87 [00:11<00:00, 7.75ba/s]" - } - }, - "904e3f60a8a24417b3a54efb249b685d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_7b87edac6cac4e49918b43fbb2433f38", - "max": 466, - "style": "IPY_MODEL_5b516c3ec27d4a5a819fb8947b9798ab", - "value": 466 - } - }, - "905424bce27a46cc896bfe48be700b87": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "90939b3c68dd486eb49d3c4ebfdd6828": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_e598abff664f423fab16aebffb3d32d7", - "max": 1390, - "style": "IPY_MODEL_e63eb7ed68af44dea53d560f19f26a0e", - "value": 1390 - } - }, - "91d3e742430343c0b5e6bc56b738864c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "91f9913d451c4690991760e2928c6c26": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_1114e3a516e24b2aa303dae26f9b1bd3", - "IPY_MODEL_6778b476b46c45c7b1f5b2bf99c430ca", - "IPY_MODEL_31c0c8c1f91b45e988d24593d3c414d7" - ], - "layout": "IPY_MODEL_694d97bcf8c44933a68857a4f1b625fb" - } - }, - "92d3b0cb2c1948a89b7f7282e28f1cd7": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "93316e8f392b4d7ca4ea22488db43819": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "942352a3eac4476890e87f998dfe403b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "94506577b7d04d669aafb2b8351def46": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "94677f34a2364c658a091f50308efa3e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_254af2c6422b415a9867e6e1fefb8675", - "style": "IPY_MODEL_32f32acbfbfa401f884dda058dfc599c", - "value": "100%" - } - }, - "94b48660a81748fa88e90907a1887701": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "95a8b64edf8c4e15b94aee5d05860c16": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "9743ff350d474179bff911b72633101d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_99d7c6f88eda4218b5705258afee54ec", - "style": "IPY_MODEL_560dd4cd0e9942008997c0ebdf79603f", - "value": " 1390/1390 [00:02<00:00, 639.24ex/s]" - } - }, - "97f279ba0d73458aa89e07e11d344f1c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_e3b10795ee8c4780a7c1a0ae4d2e83e0", - "IPY_MODEL_2c73defaa3574f5082f437cba46e82d8", - "IPY_MODEL_f881fa161b9743af95ce783f313697fa" - ], - "layout": "IPY_MODEL_8dcc40b67f03494eae1433545b547748" - } - }, - "9833eae02ddb468b86580e895319886e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "98417af07aee4673a5e7d0c0f97badc0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_21a3d53c2ebd42fbb45ffc584b05a245", - "style": "IPY_MODEL_f95e12341c484f169c2d0b9c52f7570a", - "value": " 87/87 [00:12<00:00, 7.16ba/s]" - } - }, - "989790596fdf43209198ec94434bb7aa": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "990ed0260dea470f81e2fcafa3e28fb1": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "99d7c6f88eda4218b5705258afee54ec": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "9a07492ae8bf41a6af69f9dd2eff9614": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_be45cd0759d146318fa9b8a41a10b355", - "max": 6, - "style": "IPY_MODEL_81446df0c8dc44f593b95f5484a0424f", - "value": 6 - } - }, - "9a1639c51e024ce1897355d1259808b0": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "9a4f0689cba94412a6b3ca3052271637": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "9ad6245f15074c818c94e84a396218c5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_845de289a7dc4b7ba15c1c0b8255e2cf", - "IPY_MODEL_881f6187c2194bba84d66bcf00c3f276", - "IPY_MODEL_2d78788b8cd84962aa3c3f8fc433f574" - ], - "layout": "IPY_MODEL_aaaacff6606b49b3ab391be86bf947ba" - } - }, - "9b823adb0caa4b8597031b78a5f1be1c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "9c73b8f38174421faf27c04fec9da712": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "9ce313d66b7b474aa8bb638ba0eefac5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "9ce596837a6242efa34ea8ce082801a8": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "9dafe1bb2de8416db87d6271f87ddd59": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "9e6dc3fe2e6e470091152b651eea8f0e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_67cb390f024d492dacc0d7d4cd0675d2", - "max": 1390, - "style": "IPY_MODEL_4c73d3985f594074bd4a806bac38c395", - "value": 1390 - } - }, - "9eb02559e4ef4035b6ab3495c1dcc0f2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_1274e9af953c425ca19292a87bf94b6a", - "max": 6, - "style": "IPY_MODEL_092fa72c59c145f6a799066facb7edcc", - "value": 6 - } - }, - "9efc9ccfa8f545e9a2ce30a0c794970e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "9ff061a6229c4b81acd23c62aef05697": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_92d3b0cb2c1948a89b7f7282e28f1cd7", - "max": 1390, - "style": "IPY_MODEL_d80e9d8f9e594e16902b27e20acd6cff", - "value": 1390 - } - }, - "a0dc2f34bb2a4de3afc64579ac371351": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "a1400c2b1cc447d498fff344fcd400a1": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "a1db92b35be943499b08156a35e059fb": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_9833eae02ddb468b86580e895319886e", - "max": 1390, - "style": "IPY_MODEL_8b87eeb59ced4b2f851c00e8b35e2fce", - "value": 1390 - } - }, - "a1fc0e8c46bf4d64b56b34162866b4e7": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "a213a9e760834d079dac321b59f09344": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "a2d31bc0bade498daee30b90900905b3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_783a4927d42c489b97c29c1698047a19", - "IPY_MODEL_1103ab4250b24a38bccfa02cab3e8636", - "IPY_MODEL_e30b3e1b446646c2b21248177cf2b08c" - ], - "layout": "IPY_MODEL_d95dec26323c4411bcddfd679df34bcf" - } - }, - "a34add77047a4d38b88a76b96916b5f7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_2f8c513520444fb0be5cc26174d94ab8", - "IPY_MODEL_e1ba20f9cf0e4efb9495f5a260e1e558", - "IPY_MODEL_25bfef46052b440f8952f032f1d8afa0" - ], - "layout": "IPY_MODEL_755ee5bc3e344bb097e3267a69f3047f" - } - }, - "a4423093e08a48938a05a2a259c8793f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_94506577b7d04d669aafb2b8351def46", - "max": 817, - "style": "IPY_MODEL_117944fbfade4ddda79c3f63e28e8286", - "value": 817 - } - }, - "a44651735e114874ad306c36ab459dc1": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_fd2c392d57e64b2e902e83aa10efa107", - "style": "IPY_MODEL_05342badcb98463a9e8bd5b92aa501dd", - "value": " 817/817 [00:00<00:00, 29.9kB/s]" - } - }, - "a56cf9ed288841d9b7539811f9d01e71": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "a595dcca2b634bc48fad6beae2643543": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "a5e03e9c5dde41f1834711182a5b059b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "a647739e83e247b4bb7468740a6fe7f6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_c0991b8988424b7c874c6f6b5c2e81e2", - "style": "IPY_MODEL_80269e61365142148c17dbe6f06a1e18", - "value": "100%" - } - }, - "a734dbd039284f6398af720079454810": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "a74d6351cc4e4ec2a2c3ee5e0fc0ec44": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "a7f364381dff4baaa8188d53d16b41d9": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "a96a2ae1b99740c0a28671b2341764b7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "a99d12b2e5ff45079277bbe2589576d5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "a9cc5a9d425e4b5f9ac587935cf52b2b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "aaaacff6606b49b3ab391be86bf947ba": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "ab3d67551e20490fa7002af5b4427d98": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_37ddb1f28257417b97dba06fdbea8bd8", - "IPY_MODEL_f1c357893adc48b3869aa6319c8371d2", - "IPY_MODEL_e1b9147bb4b24c95be42b8c715b08866" - ], - "layout": "IPY_MODEL_43a50f527ce248fc84b0977c18e7688f" - } - }, - "ab99b45526114e3aaffa9549b416a365": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "abb624f2f904436cad378d2a563f25cd": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "abbf32e0fd9d432197f66aca5c27a046": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "ac6afd59726d400d8e022ba8c0fe53ed": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "ad1fda29efd54c6788aa1a8b548f6404": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_11c654295ff84876ae63ec3b2ccd5724", - "style": "IPY_MODEL_c3bbbc3d1dab406698ae8a9ed3880d9e", - "value": " 2/2 [00:00<00:00, 2.98ba/s]" - } - }, - "adf32fc9789d4b51b75926d0613aac52": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "ae236ab9cc40402697a9fca685ac811a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "ae49223d4df348caa21fc0e19287b8ec": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "aecec71300044f1cb25e8d6599ecd048": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "af55040311694e7a8d62f5ccde9bfb28": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_36fabf6cf0894cdb93fa97dc8e72a592", - "style": "IPY_MODEL_4a8b34003f294cd08c4a451162266d75", - "value": " 6/6 [00:03<00:00, 2.21ba/s]" - } - }, - "b00d12480cdc47eeb759f752f6f7cfdb": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "b073c73a739f4c3e95a3d0d37d786dad": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_6cf843de663547a2b090656f3cd3573d", - "style": "IPY_MODEL_d8ab18381d5c4db1b0a51325740ba46b", - "value": "Downloading: 100%" - } - }, - "b0e2bfe01944461da8ce9af5d85d4a32": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "b1379d827e5a4740b8e55741e9c9be0f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_b0e2bfe01944461da8ce9af5d85d4a32", - "style": "IPY_MODEL_0ab666685d8a4aaf8dd63bb69750c749", - "value": " 348/348 [00:46<00:00, 7.49ba/s]" - } - }, - "b16feb58266c4ff0b303c0df791e84d3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "b1af430f569842cb902bd6af6a6d9057": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "b1b8d8f436b848a4b7217257fc31221e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "b1ebc6b8c1374ebabdf82063913c0f24": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "b34d8e186f0f4f85b195cf342eeb63c4": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "b404abd4d3364cbda3df55a0b1280de1": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "b41ffb86f218401a9a57dfb735ee9d20": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "b4d9573ca7b047278d89f7cfbeb8edbc": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "b521b769d0d24ee49438759f3f492ee1": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_66b215a1c19a42af9421000dd7c823c5", - "max": 2, - "style": "IPY_MODEL_b4d9573ca7b047278d89f7cfbeb8edbc", - "value": 2 - } - }, - "b61f6b81698c4884b5577cfc54b388c1": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "b7b61d47705f40ddb5026f777ff9bc0e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "b80281ba1cca485c980b4f71214f1297": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "b95f6d1a997c44419102d1514fb98d2d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_1e0ee0e96b2b4f0fa8b545c82053b36e", - "style": "IPY_MODEL_f6047d5f6b1d4ec897d6daba869385cf", - "value": "100%" - } - }, - "b9a188980fb8477189e092f248074c4a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "b9c08d510ce44ea384dd3ffe4fc70211": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_880ac415dc784685ad0d57837f12ddd0", - "style": "IPY_MODEL_187ddca2e74c4d68820cb62f433e2322", - "value": "Downloading: 100%" - } - }, - "b9d0610202ad48d6996e7f026cc01c9b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "ba54641fa7a94ff588ea86ca3f2d94cd": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_cb936476c0144700a1484749d2767f26", - "IPY_MODEL_32bcb06cc25c4acda72925aee6d0db47", - "IPY_MODEL_894bf6fa3e324d7bac3245a613d4baa9" - ], - "layout": "IPY_MODEL_2bccf81f193e4153a1ac3f87751893ca" - } - }, - "ba600193ac9940969fa674a59c58c4e4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_93316e8f392b4d7ca4ea22488db43819", - "style": "IPY_MODEL_ae49223d4df348caa21fc0e19287b8ec", - "value": "100%" - } - }, - "ba84aa3b40b344d9a76bd96e29ff48f3": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "ba9f23d0aa064c9f95bcd55fd0b891c8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_69e94aedff9c4bd1af752b54c1d7244b", - "style": "IPY_MODEL_0988f3d87a2840c5a90d4aefc3cb9dc8", - "value": "100%" - } - }, - "bac9fc9549b6448aacc1c09c3c6df159": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_07f526a4584943198cb19186ea3e274d", - "max": 264, - "style": "IPY_MODEL_5f48c6bb8084499389fbac7c47510eeb", - "value": 264 - } - }, - "baf7ff34e8304e1d98081e16cff9e9b3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "bb11b429e4bb458d89a068c83b97958a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_8997b74c0abc4cfcb63f6e4e37d102ea", - "IPY_MODEL_8b41d06cf9f341f7be52ea922f21feb9", - "IPY_MODEL_98417af07aee4673a5e7d0c0f97badc0" - ], - "layout": "IPY_MODEL_9a1639c51e024ce1897355d1259808b0" - } - }, - "bb48c4f2115241ae9cb06aaced18d7be": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "bb5caa0726d24ce2884bedb453e4a6f3": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "bc50e48b05c341079956b022ac5adb4a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_3cfdb9d2f89b44458016e6e562c5a235", - "style": "IPY_MODEL_0b50269deb734c20905ea10701badb5e", - "value": "Downloading: 100%" - } - }, - "bc901470b6784a45825299ce2cfdcf4b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_ba9f23d0aa064c9f95bcd55fd0b891c8", - "IPY_MODEL_b521b769d0d24ee49438759f3f492ee1", - "IPY_MODEL_dc615469761f493fba8f7c6cdcb062d9" - ], - "layout": "IPY_MODEL_1e0cd6a51a0245b9ae22028ffe144026" - } - }, - "bca2a606e0e64f6e9e76cb0334c209bf": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "be45cd0759d146318fa9b8a41a10b355": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "be4cef9a54fc43c3ae742f06d4a5dac3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_080211f2e8034a6d8f966b988ec457cd", - "style": "IPY_MODEL_1b535a85e8c04761a4279fd3f1c9d642", - "value": " 1390/1390 [00:02<00:00, 660.69ex/s]" - } - }, - "beb27f086f28401c9e58f891a4c590d7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "bf4f6dbf5c724478ba1cc10f3b704b2b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_942352a3eac4476890e87f998dfe403b", - "style": "IPY_MODEL_ed356cc14c3641e29302ec7df80e3489", - "value": " 2/2 [00:00<00:00, 3.01ba/s]" - } - }, - "bf7eb0259aaf42e3930681d0063f7a54": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "bfa3df8bee9d43939055204801eef8b5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "c01f8d5218fc495795f1dbf915228298": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "c0991b8988424b7c874c6f6b5c2e81e2": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "c0cc08c74360458c87f5cc7feeaf1049": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "c0cd051c9e104dfeabbd5eb477dc010d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "c123b8e01e394da4a3072a965cc9ad96": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "c16928f2c4344705a9dcdd9c279d4127": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_6027fe6ca76f44cba40fab280a4299c4", - "IPY_MODEL_9ff061a6229c4b81acd23c62aef05697", - "IPY_MODEL_d0b0e0c38353432d8366b2fa402faad5" - ], - "layout": "IPY_MODEL_236cbe2484344f56af7cc21f49ec4430" - } - }, - "c1f4ba58d981450794c6d7e03a550b5a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "c3bbbc3d1dab406698ae8a9ed3880d9e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "c41d4c566c594fa489612f9f492e0806": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_c7c1af7fbcde454eb78538b7f3c328a3", - "IPY_MODEL_df430ddcc26d47ac9a3f4bda660b2892", - "IPY_MODEL_19dd5e60e4b54dde89c9a39b9a11ec0b" - ], - "layout": "IPY_MODEL_4852df9d08cd4a3391e2c05ab4301a98" - } - }, - "c4450c3a1ae24634b69bdb273a1aefe2": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "c4b444f255b04bda83242e0e4d53187f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_170ff439d3574773b8b7118881c44657", - "style": "IPY_MODEL_1b26acb6935a40fdbbffc78b8805528d", - "value": "Downloading: 100%" - } - }, - "c64bfd626d734c00b1bd41139a2103ba": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "c6b919e945d04d6589676f82ae4a0026": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_e67d28b190574642833892ce6dd0e855", - "IPY_MODEL_0651c71dc99e4faab331bdec4413ba7c", - "IPY_MODEL_faf3cf09667e4964b419afa5b570e3fd" - ], - "layout": "IPY_MODEL_f80026d7b1194b1aa16434394cc8c33a" - } - }, - "c6b9f9ccac774d7abcee7760d0d73f2c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "c72401249d054acab1e7163131c27d48": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_e9bf884b74524d0983d7eb11559870b1", - "style": "IPY_MODEL_dd6f0a750b2d42b39a022b71c0c47d17", - "value": "100%" - } - }, - "c7c1af7fbcde454eb78538b7f3c328a3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_634767f5c7fd4ea7906e47d97593cdb5", - "style": "IPY_MODEL_59b7ca7b01144e5eb76bc44845967be4", - "value": "Downloading: 100%" - } - }, - "c8145e90ce694ba4b5989657f44d3b9d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "c8267fa9421445fe9ace1a61c19f3234": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "c951b413644740a2b6548a1cb1732a22": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_1020efb8045748a982ef4e501aa75bb8", - "IPY_MODEL_e2df2978124a401795ae0eaf76d05a1e", - "IPY_MODEL_e704771569834c1cbb9f89f2beb16243" - ], - "layout": "IPY_MODEL_1e0c30113b0d4f259f8e1b7ccf349757" - } - }, - "c9695b34364f41e5a4470ce3f8d220a8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_ba600193ac9940969fa674a59c58c4e4", - "IPY_MODEL_9a07492ae8bf41a6af69f9dd2eff9614", - "IPY_MODEL_85dde2754a6c4b5e886ad1b459bef37a" - ], - "layout": "IPY_MODEL_6efd32169fea4c129884c95b243455d9" - } - }, - "cb0e3a7fbb7442389601d142ba74501b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_b9a188980fb8477189e092f248074c4a", - "style": "IPY_MODEL_2b328479261d40ff9e61c032fef10aa2", - "value": " 1390/1390 [00:19<00:00, 74.19ex/s]" - } - }, - "cb1040e232114af59e874c5410e57cd8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_cfd9b5494afc4779a87d3c7300024b4d", - "IPY_MODEL_9e6dc3fe2e6e470091152b651eea8f0e", - "IPY_MODEL_4ac97176706247d69512c913cba8faa4" - ], - "layout": "IPY_MODEL_e96ebeea443749daaece0a0e51426d1a" - } - }, - "cb936476c0144700a1484749d2767f26": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_b80281ba1cca485c980b4f71214f1297", - "style": "IPY_MODEL_e05adf2ccd254ae18b53a22c12181675", - "value": "Downloading: 100%" - } - }, - "cccfbcfce7e946ffaa69abbb1fe97a36": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "ce00b0ce67f64c6797501857d70aa50a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "ce1e6ba228f04603adaa2b82d04de52f": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "cf6f18eee4c54755bb7a82870b0c85ff": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "cfd9b5494afc4779a87d3c7300024b4d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_8b60563624504460a7d04bbcc601e0f5", - "style": "IPY_MODEL_1331643494cd4420be8f9eca0255f727", - "value": "100%" - } - }, - "d0b0e0c38353432d8366b2fa402faad5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_b34d8e186f0f4f85b195cf342eeb63c4", - "style": "IPY_MODEL_beb27f086f28401c9e58f891a4c590d7", - "value": " 1390/1390 [01:56<00:00, 12.71ex/s]" - } - }, - "d1166658e6f44ee7992c032da46276ba": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_326ae8ff921d4a44bd19ac429b8db569", - "max": 709146103, - "style": "IPY_MODEL_6ffa53391c5f431192a7c1cfce09a585", - "value": 709146103 - } - }, - "d16c25805bfe4a7dabd4401461a5d3c3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "d170fd6f220a42b2a4261f388aae75b5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_9b823adb0caa4b8597031b78a5f1be1c", - "style": "IPY_MODEL_b9d0610202ad48d6996e7f026cc01c9b", - "value": "100%" - } - }, - "d248f2dcb5614d9f8fc9f00f7dc345ec": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_320184abbcdf4efd98d3037b32fc9c6d", - "max": 1390, - "style": "IPY_MODEL_31177b93c29d442f9aa3ae09df40a972", - "value": 1390 - } - }, - "d40c8782a91a4d33a7eca12e58831d30": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_514e81e5fe744f4ab78cdab5d3a7794d", - "style": "IPY_MODEL_f177681b25c04829a95de5ae87ce8c69", - "value": "100%" - } - }, - "d5f3aaf6417b4e4894cfb430ca6557e6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_78d0eb13230f4c46a43f06d5eb709b29", - "IPY_MODEL_218683b0ee39497a893d78cde9afa0ce", - "IPY_MODEL_4f3290e9d0e7451b95cc4b45184fbed5" - ], - "layout": "IPY_MODEL_bf7eb0259aaf42e3930681d0063f7a54" - } - }, - "d7a218a6d68b422e9076267465749cda": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "d7c799857d834728a4cc3bc6f7da3e4d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "d7d12045579a4d86845f2fa5ba6f7648": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "d7ebca2da90f43668718ba8843baea6b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "d80e9d8f9e594e16902b27e20acd6cff": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "d8ab18381d5c4db1b0a51325740ba46b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "d90c5c45e4d6486bb0bb5c64905c65b9": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "d945f7faea2e420592156ff3f6b48297": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_fa86720355ca49c8bc44a8a1d31268cc", - "max": 5559, - "style": "IPY_MODEL_413181e5ce3d45a5b8ef3a7e8f0cd287", - "value": 5559 - } - }, - "d95dec26323c4411bcddfd679df34bcf": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "d96aeb217a644134a89819efb2beeb3a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_385f90fc5c3a4c23a48e0c8db9d34a7c", - "max": 995526, - "style": "IPY_MODEL_1f2a0ced79fc4b9aaad3f1ef2ca227f2", - "value": 995526 - } - }, - "d985b75d84ec42f8b5a683db4231f181": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "da0c407b7f4d4f5c8ac8ecef5e8ca394": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "db98b83fa66c4b4792eb61cf9cf0071e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "dbb0b99a500e40a29f86239a7070a88d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_9dafe1bb2de8416db87d6271f87ddd59", - "max": 87, - "style": "IPY_MODEL_4551ca0bf1a947e79d71666d1247c2d5", - "value": 87 - } - }, - "dc2726fde54748a9a9e2e57bdaf9b5a3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_3225c4be3fcb4b258c8c7dae6b02f534", - "IPY_MODEL_e59fa8bfd5144fbbbc1d57d6fd10fb76", - "IPY_MODEL_be4cef9a54fc43c3ae742f06d4a5dac3" - ], - "layout": "IPY_MODEL_3a1c6f07607d4c5e811b79cdb2d631a5" - } - }, - "dc615469761f493fba8f7c6cdcb062d9": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_8934ce9135fa444ea9db62a51dd98191", - "style": "IPY_MODEL_df8f712d748a4a5a8e092ca9fbe7eac3", - "value": " 2/2 [00:00<00:00, 6.46ba/s]" - } - }, - "dce3303f19c74ce2b0aad9f3acdf1e1a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_4479bf779ba3468e8f37067c50baed81", - "style": "IPY_MODEL_721f9838df4f43c7b5942fc7faf8e002", - "value": " 348/348 [00:49<00:00, 7.00ba/s]" - } - }, - "dcfc899352c545d0bb57b7cb07e78f96": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "dd06db7c48e4406e9b8ec00e6759728c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "dd6f0a750b2d42b39a022b71c0c47d17": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "dda190ec480842858552f96133540e5f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "df2c57a8ed6546a88b1ad005a7412ee8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "df430ddcc26d47ac9a3f4bda660b2892": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_6ea6cb7ca0a24b57a480a254975f7f89", - "max": 29, - "style": "IPY_MODEL_2962c27974804c368efd3df7336f4ca7", - "value": 29 - } - }, - "df7ed4a356bb491c8e4100437d95d67d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "df8f712d748a4a5a8e092ca9fbe7eac3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "e05adf2ccd254ae18b53a22c12181675": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "e0cd4c8b612e4a599dc9197fbf2f37c7": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "e1b9147bb4b24c95be42b8c715b08866": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_6b237b221412407f9ccc188ce1b4d90b", - "style": "IPY_MODEL_8615158ca0574299a22747a6ec300941", - "value": " 5559/5559 [00:08<00:00, 705.98ex/s]" - } - }, - "e1ba20f9cf0e4efb9495f5a260e1e558": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_c4450c3a1ae24634b69bdb273a1aefe2", - "max": 2, - "style": "IPY_MODEL_9efc9ccfa8f545e9a2ce30a0c794970e", - "value": 2 - } - }, - "e1cd4649482e4b42a2bc3032878c56dc": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "e1d6cedb943e46e0ba8a21b910a3598b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_2514c5f98bed4607a9cd9437a1b27cff", - "style": "IPY_MODEL_03d63347fb92463289add09226a20019", - "value": "100%" - } - }, - "e1f7a7f11b584fa29544781b6c192a88": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_6b94a963e4ab4ec6a217ad3586b1a25d", - "style": "IPY_MODEL_002e841ab923418381596abd9cec2fa8", - "value": "Downloading: 100%" - } - }, - "e2df2978124a401795ae0eaf76d05a1e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_3b41509658ed4212abe2fa395e8c3921", - "max": 87, - "style": "IPY_MODEL_3956d66a970a4ee9a30f398f0b57fed6", - "value": 87 - } - }, - "e30b3e1b446646c2b21248177cf2b08c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_74554082b33c4069b883587c1c0d6deb", - "style": "IPY_MODEL_b7b61d47705f40ddb5026f777ff9bc0e", - "value": " 5559/5559 [00:09<00:00, 675.54ex/s]" - } - }, - "e3b10795ee8c4780a7c1a0ae4d2e83e0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_abbf32e0fd9d432197f66aca5c27a046", - "style": "IPY_MODEL_d16c25805bfe4a7dabd4401461a5d3c3", - "value": "100%" - } - }, - "e5443d92db2845f296f8ca7872f4563a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "e571910d85444667b7e4f535fb996f15": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "e58034433d89426a859c55eb316a92b8": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "e598abff664f423fab16aebffb3d32d7": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "e59fa8bfd5144fbbbc1d57d6fd10fb76": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_3ffa93f71dd345d68cb00b51c089a880", - "max": 1390, - "style": "IPY_MODEL_dcfc899352c545d0bb57b7cb07e78f96", - "value": 1390 - } - }, - "e5a2e8bdc0cf48e89893a54caf7aafab": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "e63eb7ed68af44dea53d560f19f26a0e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "e67d28b190574642833892ce6dd0e855": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_db98b83fa66c4b4792eb61cf9cf0071e", - "style": "IPY_MODEL_b1af430f569842cb902bd6af6a6d9057", - "value": "100%" - } - }, - "e704771569834c1cbb9f89f2beb16243": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_e86bd5fbb10f40968b12076c89685507", - "style": "IPY_MODEL_aecec71300044f1cb25e8d6599ecd048", - "value": " 87/87 [00:12<00:00, 7.22ba/s]" - } - }, - "e716a92d4ce84d75a4e9886320a17c13": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_ce00b0ce67f64c6797501857d70aa50a", - "max": 348, - "style": "IPY_MODEL_8e32036825b2404fbe7b40f4e20ef2af", - "value": 348 - } - }, - "e7986977599c471d8f2fa8abe0c5d618": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "e86bd5fbb10f40968b12076c89685507": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "e9311bf60afb49c0be6df9fc4bda9c6f": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "e96ebeea443749daaece0a0e51426d1a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "e9bf884b74524d0983d7eb11559870b1": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "ea2542ce46504eb2846b091d5541884c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "ea5eb2193ee04386a4573e00841533ef": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "ea7721682a9d44a884f00484e9b7f1a8": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "eb53d84e66b34ff7aa0ca5d9b8c202ea": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_ce1e6ba228f04603adaa2b82d04de52f", - "style": "IPY_MODEL_0bca65497b764e1386e7a69f7de3bf11", - "value": "100%" - } - }, - "ed356cc14c3641e29302ec7df80e3489": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "ed953a21812e485faf38d6897e5c0b5b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "ee4e6306627644098b8c58a48e9c7599": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_683770347e5b40ef828bb6377fecf5c7", - "IPY_MODEL_7784b2cdafed4007ad7721a76d009f1c", - "IPY_MODEL_8f5139aab2b0478695f1a548c0224848" - ], - "layout": "IPY_MODEL_9ce596837a6242efa34ea8ce082801a8" - } - }, - "efcc5eb9028744f99e6bac877af2684a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_406a32ae9c234eea8a3150fd8f287163", - "IPY_MODEL_08259ba02dd444f090aeb052cb3f1573", - "IPY_MODEL_af55040311694e7a8d62f5ccde9bfb28" - ], - "layout": "IPY_MODEL_160183a43c694d44b63cef13c7d222b6" - } - }, - "f005f6330a86446885cff4b7be7623d7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_e0cd4c8b612e4a599dc9197fbf2f37c7", - "max": 2, - "style": "IPY_MODEL_031f0fbf56af4d50aa05559b5c759864", - "value": 2 - } - }, - "f11cc0c6ba9d4d5887a79d3a14394ce4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_76e01244c15c40eca4985fd2d9d3726b", - "max": 1961828, - "style": "IPY_MODEL_baf7ff34e8304e1d98081e16cff9e9b3", - "value": 1961828 - } - }, - "f177681b25c04829a95de5ae87ce8c69": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "f19f6f9cecdd43d49b65609114e69f13": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "f1c357893adc48b3869aa6319c8371d2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_d90c5c45e4d6486bb0bb5c64905c65b9", - "max": 5559, - "style": "IPY_MODEL_a734dbd039284f6398af720079454810", - "value": 5559 - } - }, - "f2e211f1e1f84a4c82cbee09cc95d477": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "f3199300d4f44c369d7b66435ec4ddb5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_6d2e86c1efa34946b84e48b5b3aaec7a", - "style": "IPY_MODEL_70fb65fde9044c5faef948f74dc00163", - "value": " 5559/5559 [00:08<00:00, 692.53ex/s]" - } - }, - "f41c8cf2b23045c3b417f8310395222d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "f5b648cd76ca4057957391fb6768ba18": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "f5d136e906c34f628b0d48e0cf4e8a85": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "f6047d5f6b1d4ec897d6daba869385cf": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "f6850cec019d48a7b18f255197e655ed": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "description_width": "" - } - }, - "f6998bc96c5a49ea8decd03a95fb51f5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "f6acdb35b23243639f1dede27fd3eebf": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_adf32fc9789d4b51b75926d0613aac52", - "style": "IPY_MODEL_491f5d951554473cae0beec7e74c249d", - "value": " 1390/1390 [00:02<00:00, 638.53ex/s]" - } - }, - "f80026d7b1194b1aa16434394cc8c33a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "f80ac083117842e6a4c633b928c20a2c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_e9311bf60afb49c0be6df9fc4bda9c6f", - "style": "IPY_MODEL_2a0a590fc5294eb5b51048cfc6d3f3cf", - "value": " 676M/676M [00:16<00:00, 44.3MB/s]" - } - }, - "f83b733575484bdca0dec3651308a667": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "f881fa161b9743af95ce783f313697fa": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_7e43280a741347f4b602b192ff6b6bab", - "style": "IPY_MODEL_1c2f3079d581443eb41f5ff50579fa52", - "value": " 5559/5559 [00:09<00:00, 668.91ex/s]" - } - }, - "f8ee48f2f4b94c2bb81c648558f0aa9e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_4134799bb39445969cecc66809d95b55", - "IPY_MODEL_bac9fc9549b6448aacc1c09c3c6df159", - "IPY_MODEL_75e0f9850ddf4d179076c671445991f6" - ], - "layout": "IPY_MODEL_25e0cd284100462ea605842316026183" - } - }, - "f95e12341c484f169c2d0b9c52f7570a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "f9b15c404b7e4408a357c890dedf03ff": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "fa760e4acd954272981152ef1700203f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_94677f34a2364c658a091f50308efa3e", - "IPY_MODEL_2adc23438ecd41d9a6eae74e8e9d4889", - "IPY_MODEL_8721f66e611f43d094fffba1dbb01bc7" - ], - "layout": "IPY_MODEL_c64bfd626d734c00b1bd41139a2103ba" - } - }, - "fa86720355ca49c8bc44a8a1d31268cc": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "faf3cf09667e4964b419afa5b570e3fd": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_ba84aa3b40b344d9a76bd96e29ff48f3", - "style": "IPY_MODEL_0c37e2e8c9464605917242f0319decdc", - "value": " 348/348 [00:45<00:00, 7.62ba/s]" - } - }, - "fba24976bb6a463cb0f12f0e5e6175fc": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "children": [ - "IPY_MODEL_801495d1fd614dd79a115731132a58a7", - "IPY_MODEL_9eb02559e4ef4035b6ab3495c1dcc0f2", - "IPY_MODEL_30241c63b1274a5a802a9cce0ea502a6" - ], - "layout": "IPY_MODEL_1621a17be2b3429999541088706b266e" - } - }, - "fcc74af4ddc44ecc880ee79b3dedceab": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "fd2c392d57e64b2e902e83aa10efa107": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": {} - }, - "fe5e5202b92348198a15e7c7f0aa64b0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_859b54cd3dfb4a408d92d931fdec5922", - "max": 2, - "style": "IPY_MODEL_b404abd4d3364cbda3df55a0b1280de1", - "value": 2 - } - }, - "fe8432c77f9b49a7b8e6c0d7937556e4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "bar_style": "success", - "layout": "IPY_MODEL_1315f3e0ac084d3a8c7ccf4ef7e4c2aa", - "max": 348, - "style": "IPY_MODEL_d7d12045579a4d86845f2fa5ba6f7648", - "value": 348 - } - }, - "ff2be633283f40df9175cde43adda0af": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "description_width": "" - } - }, - "ff3a702486a44640a7b2512d13323f32": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_05103e136d4e4eac98e5fa19d7832d8f", - "style": "IPY_MODEL_dd06db7c48e4406e9b8ec00e6759728c", - "value": "100%" - } - }, - "ffa0acc7157048b18a90544cf814c32a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "layout": "IPY_MODEL_ea5eb2193ee04386a4573e00841533ef", - "style": "IPY_MODEL_9a4f0689cba94412a6b3ca3052271637", - "value": "100%" + "file_extension": ".py", + "mimetype": "text/x-python", + "name": "python", + "nbconvert_exporter": "python", + "pygments_lexer": "ipython3", + "version": "3.7.10" + }, + "widgets": { + "application/vnd.jupyter.widget-state+json": { + "98b5663a1ddb40c6981d40238ed75f0a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_cf5434b668cd4c1ea48d50451781aa2c", + "IPY_MODEL_5f51063c060747c29258f3397d95cd41", + "IPY_MODEL_f1f57bc9762a474c8c5f58a1a3382432" + ], + "layout": "IPY_MODEL_9f6b3d091fac4b73a7abf40d2330ea8d" + } + }, + "cf5434b668cd4c1ea48d50451781aa2c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_fbda555247024cd88ba591b185de48b9", + "placeholder": "​", + "style": "IPY_MODEL_551c0cda446244f0aee1623fe4de7b71", + "value": "Downloading (…)okenizer_config.json: 100%" + } + }, + "5f51063c060747c29258f3397d95cd41": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_9bfa5a1f66f84deba2e358a2b6cb286b", + "max": 29, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_b825b5d945624e7c946f6a0411343f49", + "value": 29 + } + }, + "f1f57bc9762a474c8c5f58a1a3382432": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f2f1d5051b414acd8b940e078f255cdf", + "placeholder": "​", + "style": "IPY_MODEL_5aa9ca17b85f4170b7515fca94a27c04", + "value": " 29.0/29.0 [00:00<00:00, 2.29kB/s]" + } + }, + "9f6b3d091fac4b73a7abf40d2330ea8d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fbda555247024cd88ba591b185de48b9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "551c0cda446244f0aee1623fe4de7b71": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "9bfa5a1f66f84deba2e358a2b6cb286b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b825b5d945624e7c946f6a0411343f49": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "f2f1d5051b414acd8b940e078f255cdf": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5aa9ca17b85f4170b7515fca94a27c04": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "9e025774336d41f99202cc8e783f2aa9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_fda84d00961941af87410431b8f12a63", + "IPY_MODEL_3a6351a4a95b46e6b1b527bb2a62082e", + "IPY_MODEL_530508480403461687b31c9e3c9092d0" + ], + "layout": "IPY_MODEL_a3c3f1d46daa46089c29e6367db80e32" + } + }, + "fda84d00961941af87410431b8f12a63": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_eb1ad44d35c0469a9f234c159ac8874a", + "placeholder": "​", + "style": "IPY_MODEL_455195e642434214baf41acf37e91cf4", + "value": "Downloading (…)lve/main/config.json: 100%" + } + }, + "3a6351a4a95b46e6b1b527bb2a62082e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_e70f13f1083845deade56d7911329d53", + "max": 466, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_f5c739f99241476990b02cf2630239ef", + "value": 466 + } + }, + "530508480403461687b31c9e3c9092d0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_4d748059485244c0bacdcea2f4978d41", + "placeholder": "​", + "style": "IPY_MODEL_2f7ede5d9a41405882ad73c0299c129e", + "value": " 466/466 [00:00<00:00, 36.6kB/s]" + } + }, + "a3c3f1d46daa46089c29e6367db80e32": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "eb1ad44d35c0469a9f234c159ac8874a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "455195e642434214baf41acf37e91cf4": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "e70f13f1083845deade56d7911329d53": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f5c739f99241476990b02cf2630239ef": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "4d748059485244c0bacdcea2f4978d41": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2f7ede5d9a41405882ad73c0299c129e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "0a31ec3ef0b042dd8683584ca8c6aec7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_e9f6a793519c4fb6ae4eeb74752e80ac", + "IPY_MODEL_ee58735741864d3c9bb2cf67bdac6cf7", + "IPY_MODEL_36e0caf7c4c44f46bc96f17ac11464e5" + ], + "layout": "IPY_MODEL_5c53b40e78354a6da75ef6dce51fd203" + } + }, + "e9f6a793519c4fb6ae4eeb74752e80ac": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_05f7ce05e9894d6bb49b5d259328fb9d", + "placeholder": "​", + "style": "IPY_MODEL_765d8c6396f448868fae13a882772d7d", + "value": "Downloading (…)solve/main/vocab.txt: 100%" + } + }, + "ee58735741864d3c9bb2cf67bdac6cf7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_aa6d0b49af9f45569e9988d38992cbf2", + "max": 995526, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_7a2e04cb21e342f38852298090a4506f", + "value": 995526 + } + }, + "36e0caf7c4c44f46bc96f17ac11464e5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5a94aa5351724f14a53395b48709222f", + "placeholder": "​", + "style": "IPY_MODEL_029dc684cefb4c629e7897330a60dec0", + "value": " 996k/996k [00:00<00:00, 9.21MB/s]" + } + }, + "5c53b40e78354a6da75ef6dce51fd203": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "05f7ce05e9894d6bb49b5d259328fb9d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "765d8c6396f448868fae13a882772d7d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "aa6d0b49af9f45569e9988d38992cbf2": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7a2e04cb21e342f38852298090a4506f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "5a94aa5351724f14a53395b48709222f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "029dc684cefb4c629e7897330a60dec0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "f152d155899045b48182b775041a6a27": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_0e3d52305d8d4c0f85eb090fe00e5cde", + "IPY_MODEL_6ba99193f9bf4838b35bae8493283a44", + "IPY_MODEL_6c1f962313024cb28cde3bee68f4c9a2" + ], + "layout": "IPY_MODEL_3675a709a80d45e8aa9c29183c65f1f9" + } + }, + "0e3d52305d8d4c0f85eb090fe00e5cde": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_aa5e0dd4211048029a6e6846ae26d91f", + "placeholder": "​", + "style": "IPY_MODEL_5d16e5d516d44604974be29732afd396", + "value": "Downloading (…)/main/tokenizer.json: 100%" + } + }, + "6ba99193f9bf4838b35bae8493283a44": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_fd7fde3740594e89b5ee68e9bc5d7a13", + "max": 1961828, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_d18d23296a904667ab6a7f85f599e79f", + "value": 1961828 + } + }, + "6c1f962313024cb28cde3bee68f4c9a2": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_085f58f3e0d043f8b5b2831a1e2a1b54", + "placeholder": "​", + "style": "IPY_MODEL_fcec0374bfd3446cbc183057a3f8e28f", + "value": " 1.96M/1.96M [00:00<00:00, 24.8MB/s]" + } + }, + "3675a709a80d45e8aa9c29183c65f1f9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "aa5e0dd4211048029a6e6846ae26d91f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5d16e5d516d44604974be29732afd396": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "fd7fde3740594e89b5ee68e9bc5d7a13": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d18d23296a904667ab6a7f85f599e79f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "085f58f3e0d043f8b5b2831a1e2a1b54": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fcec0374bfd3446cbc183057a3f8e28f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "7ce0b5785c2448cea7d0d1f1a87ebc2d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_89e3a11241384650b8965245dbd3792c", + "IPY_MODEL_a34a732dd35742e4a4824c8d8a3ad802", + "IPY_MODEL_df639efa669d4f79aacb986358d51ce3" + ], + "layout": "IPY_MODEL_348702e795c84a73962c96b921e50717" + } + }, + "89e3a11241384650b8965245dbd3792c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_edb157f92e984a01a21ae2b06f3498ab", + "placeholder": "​", + "style": "IPY_MODEL_9999a4e4578d41b2a26ed13be0828f9f", + "value": "Map: 100%" + } + }, + "a34a732dd35742e4a4824c8d8a3ad802": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_e9958a996eed4d56b4ba278d1d0636d6", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_eaf861a0c98d40be96de756da12c5c8a", + "value": 5559 + } + }, + "df639efa669d4f79aacb986358d51ce3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_00c02c2cc2784e42b04c439efd858d6e", + "placeholder": "​", + "style": "IPY_MODEL_5ae6713d303d4e8cb40d1bb8193d2808", + "value": " 5559/5559 [00:03<00:00, 1546.37 examples/s]" + } + }, + "348702e795c84a73962c96b921e50717": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "edb157f92e984a01a21ae2b06f3498ab": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9999a4e4578d41b2a26ed13be0828f9f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "e9958a996eed4d56b4ba278d1d0636d6": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "eaf861a0c98d40be96de756da12c5c8a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "00c02c2cc2784e42b04c439efd858d6e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5ae6713d303d4e8cb40d1bb8193d2808": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "2ff3aa3cbc084b018e532313e3a62868": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_df5bdc4dbbc24f518a9b6a729b0e4465", + "IPY_MODEL_8190c12611bd4b1181d109f8b266d12e", + "IPY_MODEL_fbcc9f281d42422f8c584dbc7248cf25" + ], + "layout": "IPY_MODEL_d82ebc1918b04278aaa7a3424876d512" + } + }, + "df5bdc4dbbc24f518a9b6a729b0e4465": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_215db69430ac4835b14a0208ee8e4c2a", + "placeholder": "​", + "style": "IPY_MODEL_f6a251a9d3a8407b9bd5bdd849ce3e7e", + "value": "Map: 100%" + } + }, + "8190c12611bd4b1181d109f8b266d12e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_791078cacb4740fabdaf8eae3b5bb7f1", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_8906283631694146b18824265be2b6f6", + "value": 1390 + } + }, + "fbcc9f281d42422f8c584dbc7248cf25": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_bad4ae381c224f108ace413c9af946b0", + "placeholder": "​", + "style": "IPY_MODEL_34063b2bc88a4ae7a965d1d882104b32", + "value": " 1390/1390 [00:00<00:00, 1845.78 examples/s]" + } + }, + "d82ebc1918b04278aaa7a3424876d512": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "215db69430ac4835b14a0208ee8e4c2a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f6a251a9d3a8407b9bd5bdd849ce3e7e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "791078cacb4740fabdaf8eae3b5bb7f1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8906283631694146b18824265be2b6f6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "bad4ae381c224f108ace413c9af946b0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "34063b2bc88a4ae7a965d1d882104b32": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "9c43faef3dbd4919b84622bf311a055f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_8940ed6274f1413cb57b9823131be494", + "IPY_MODEL_c2fdcaeb805f41a9aafad35cee5f0d4e", + "IPY_MODEL_f1dcb8ed4eeb470fb6802d72fdfaab5a" + ], + "layout": "IPY_MODEL_3d0f159182e3457492d6f1b70d6f04c2" + } + }, + "8940ed6274f1413cb57b9823131be494": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_b287cbb03a264654968d10d85d32e365", + "placeholder": "​", + "style": "IPY_MODEL_7e761125a9684685b8b845bbab01b297", + "value": "Map: 100%" + } + }, + "c2fdcaeb805f41a9aafad35cee5f0d4e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_bf1053a919fb47aebc4971c1b86fcab8", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_c5799a3b73464728afc0f23b2b25188a", + "value": 5559 + } + }, + "f1dcb8ed4eeb470fb6802d72fdfaab5a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_791c1687dc4b47928e8075658f238f7b", + "placeholder": "​", + "style": "IPY_MODEL_1814292c69d34a758378760127308ef9", + "value": " 5559/5559 [00:03<00:00, 1394.80 examples/s]" + } + }, + "3d0f159182e3457492d6f1b70d6f04c2": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b287cbb03a264654968d10d85d32e365": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7e761125a9684685b8b845bbab01b297": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "bf1053a919fb47aebc4971c1b86fcab8": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c5799a3b73464728afc0f23b2b25188a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "791c1687dc4b47928e8075658f238f7b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1814292c69d34a758378760127308ef9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "010ec2102cb64726b037d15a26a88b65": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_b200a63fc8d24eafb67958aea139b90f", + "IPY_MODEL_6008d614d11c4120add33abdb91a8985", + "IPY_MODEL_df0d33aaf9a54f1fbdd0f785cb6ca7c6" + ], + "layout": "IPY_MODEL_557d06369ad04c63aec623d8fc1fa218" + } + }, + "b200a63fc8d24eafb67958aea139b90f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_607fd46718fa41dfacdbc6341623c8e8", + "placeholder": "​", + "style": "IPY_MODEL_f61c59bab83a442c87d5f2e16ded8f1d", + "value": "Map: 100%" + } + }, + "6008d614d11c4120add33abdb91a8985": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_8eb37a97384a4b6f811f51b4de9c9a32", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_449fb956db964fa98a6a1c8b530fd218", + "value": 1390 + } + }, + "df0d33aaf9a54f1fbdd0f785cb6ca7c6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_baef974696724608a22aca48f4b9c846", + "placeholder": "​", + "style": "IPY_MODEL_b2c3a629122d454dafea780c3722666f", + "value": " 1390/1390 [00:00<00:00, 1463.17 examples/s]" + } + }, + "557d06369ad04c63aec623d8fc1fa218": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "607fd46718fa41dfacdbc6341623c8e8": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f61c59bab83a442c87d5f2e16ded8f1d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "8eb37a97384a4b6f811f51b4de9c9a32": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "449fb956db964fa98a6a1c8b530fd218": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "baef974696724608a22aca48f4b9c846": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b2c3a629122d454dafea780c3722666f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "08ceb14dc17a424eb9bbf3b32de86c1b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_d00662d6ed55463aba326b6805620af3", + "IPY_MODEL_4d6755b6c83e4f13a97e9b1b0e609bb5", + "IPY_MODEL_286f86ae10874cb38ce22df2aab01820" + ], + "layout": "IPY_MODEL_2ce61168f9f044889986249f29ae0688" + } + }, + "d00662d6ed55463aba326b6805620af3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_b0a473526061496c888f1e461549bb6d", + "placeholder": "​", + "style": "IPY_MODEL_0d0c1de6161d44eca750d49122405c39", + "value": "Map: 100%" + } + }, + "4d6755b6c83e4f13a97e9b1b0e609bb5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_6709139dd99840c2aeb4fdd54fee4dbb", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_e12aad1e1624479784a4e9053bb5f06b", + "value": 5559 + } + }, + "286f86ae10874cb38ce22df2aab01820": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_2d956a9eaed0479c8d59a618feb9f475", + "placeholder": "​", + "style": "IPY_MODEL_96c0b88835b74b52911896476a380fe3", + "value": " 5559/5559 [00:01<00:00, 3558.57 examples/s]" + } + }, + "2ce61168f9f044889986249f29ae0688": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b0a473526061496c888f1e461549bb6d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0d0c1de6161d44eca750d49122405c39": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "6709139dd99840c2aeb4fdd54fee4dbb": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "e12aad1e1624479784a4e9053bb5f06b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "2d956a9eaed0479c8d59a618feb9f475": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "96c0b88835b74b52911896476a380fe3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "ef037aa5769a4dd2af9eecdc43143f5d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_1ac9b9e9c924479c8f75634e421a48de", + "IPY_MODEL_c6add275de114c8994b1331c0f0174d7", + "IPY_MODEL_abfd941bb9be4e52a7d7c49751bc4374" + ], + "layout": "IPY_MODEL_66626be91b784c5fa1dae53689c57b86" + } + }, + "1ac9b9e9c924479c8f75634e421a48de": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_e339b71029634c288ecb6028e0c93d10", + "placeholder": "​", + "style": "IPY_MODEL_14fe842fc28e4438a5720cc0ab7c9586", + "value": "Map: 100%" + } + }, + "c6add275de114c8994b1331c0f0174d7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_18cbf6e09774445d95569037f2561ac6", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_06e3bf4651c44bd5b93ce7e2115b909c", + "value": 1390 + } + }, + "abfd941bb9be4e52a7d7c49751bc4374": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c658ecb78847441eb166e0fcf79126d2", + "placeholder": "​", + "style": "IPY_MODEL_70dade4321f34ad59a4cd492fdee86c1", + "value": " 1390/1390 [00:00<00:00, 6680.50 examples/s]" + } + }, + "66626be91b784c5fa1dae53689c57b86": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "e339b71029634c288ecb6028e0c93d10": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "14fe842fc28e4438a5720cc0ab7c9586": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "18cbf6e09774445d95569037f2561ac6": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "06e3bf4651c44bd5b93ce7e2115b909c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "c658ecb78847441eb166e0fcf79126d2": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "70dade4321f34ad59a4cd492fdee86c1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "a13e4156d0a6432caf4da59392e12323": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_05cdbc58fcf649f6aba5ef4d4f5c18ed", + "IPY_MODEL_6685a65e8c1d4335987d2b39c1f55100", + "IPY_MODEL_51f53e2cdb4f40c6867bc611d75d4334" + ], + "layout": "IPY_MODEL_6e8f3846056b4c83ac3dbc4a2436ff9e" + } + }, + "05cdbc58fcf649f6aba5ef4d4f5c18ed": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c6d542b5a5e14feaa9317d20ba7ec3b3", + "placeholder": "​", + "style": "IPY_MODEL_e8856e65ab5a407a88a84ef8d423b4e9", + "value": "Map: 100%" + } + }, + "6685a65e8c1d4335987d2b39c1f55100": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_8f58f7096ab54b09bf8911401c541cf8", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_518e0c900feb45e69965e35274bcb570", + "value": 5559 + } + }, + "51f53e2cdb4f40c6867bc611d75d4334": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_adf59b34e63741d7956f58be5b6a26cc", + "placeholder": "​", + "style": "IPY_MODEL_6a8cb8e8428146b694516e2b8dcaf757", + "value": " 5559/5559 [00:03<00:00, 1763.94 examples/s]" + } + }, + "6e8f3846056b4c83ac3dbc4a2436ff9e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c6d542b5a5e14feaa9317d20ba7ec3b3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "e8856e65ab5a407a88a84ef8d423b4e9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "8f58f7096ab54b09bf8911401c541cf8": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "518e0c900feb45e69965e35274bcb570": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "adf59b34e63741d7956f58be5b6a26cc": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6a8cb8e8428146b694516e2b8dcaf757": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "591089b40457413186dc8c7880d1dfec": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_7bb2a99d6777483f9cdaa2e61bde0414", + "IPY_MODEL_0fa2cc05d1ee4908aa1298cb8c74fe10", + "IPY_MODEL_8fedf3c70f53498c8e3e1dedd160c06b" + ], + "layout": "IPY_MODEL_5e3d8ef4f64245e9b177dc68c5a90b87" + } + }, + "7bb2a99d6777483f9cdaa2e61bde0414": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_72b001321f8347fbac2a2fe57c302b1d", + "placeholder": "​", + "style": "IPY_MODEL_dde13f5a004e481f9dc9a0f65b481550", + "value": "Map: 100%" + } + }, + "0fa2cc05d1ee4908aa1298cb8c74fe10": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_d4a3898402a143ec8adefad23a73f40c", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_c5d12f454a5a4bd282d25293b0f9834d", + "value": 1390 + } + }, + "8fedf3c70f53498c8e3e1dedd160c06b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c43e20dacf0542a0b7ba198c4450a441", + "placeholder": "​", + "style": "IPY_MODEL_eb551d22a0f4404594fa74daa3766a4d", + "value": " 1390/1390 [00:00<00:00, 1959.65 examples/s]" + } + }, + "5e3d8ef4f64245e9b177dc68c5a90b87": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "72b001321f8347fbac2a2fe57c302b1d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "dde13f5a004e481f9dc9a0f65b481550": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "d4a3898402a143ec8adefad23a73f40c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c5d12f454a5a4bd282d25293b0f9834d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "c43e20dacf0542a0b7ba198c4450a441": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "eb551d22a0f4404594fa74daa3766a4d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "8f0d224cfe294944a7bd161d995d7bda": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_42f3a829c2fb45749368dbee5e490a35", + "IPY_MODEL_867649fd4e3341ab9ce5a6926b10ce78", + "IPY_MODEL_433519f7276b4fddb38e862c414df5fd" + ], + "layout": "IPY_MODEL_5b80083779a54d34954d8af7a8a9fcd6" + } + }, + "42f3a829c2fb45749368dbee5e490a35": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f3e243c3c2224641babb7629a42f0248", + "placeholder": "​", + "style": "IPY_MODEL_2f6e3c1bab9b43d49976e890255d7c28", + "value": "Downloading model.safetensors: 100%" + } + }, + "867649fd4e3341ab9ce5a6926b10ce78": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3cf4034994f24ca6be2a1a24ded77627", + "max": 541795680, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_b98d787fb58d4c00b277999cb4e81a6d", + "value": 541795680 + } + }, + "433519f7276b4fddb38e862c414df5fd": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5fac8e3703a54610a862d115063debdd", + "placeholder": "​", + "style": "IPY_MODEL_8579b0149f574b36bcf9641481e2f834", + "value": " 542M/542M [00:03<00:00, 143MB/s]" + } + }, + "5b80083779a54d34954d8af7a8a9fcd6": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f3e243c3c2224641babb7629a42f0248": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2f6e3c1bab9b43d49976e890255d7c28": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "3cf4034994f24ca6be2a1a24ded77627": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b98d787fb58d4c00b277999cb4e81a6d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "5fac8e3703a54610a862d115063debdd": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8579b0149f574b36bcf9641481e2f834": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "8ed80abd5ea7459580c458fff0089acc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_d855649c9dcd4b4e9c4b377616d527a7", + "IPY_MODEL_d8a740862ec0449e9a9ea38eadf6549e", + "IPY_MODEL_cc2a4ba35e0e4d55a96715545f60cbf0" + ], + "layout": "IPY_MODEL_d14760dd70124ceab4a356f3ea480ef9" + } + }, + "d855649c9dcd4b4e9c4b377616d527a7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_e4c79a204fd142b6a307c72d7dc10a38", + "placeholder": "​", + "style": "IPY_MODEL_694ecf5bbe544e228a98e8caa343a9e7", + "value": "Map: 100%" + } + }, + "d8a740862ec0449e9a9ea38eadf6549e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_22a3dbd954e343229d64b8b6e81697d3", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_3ea26ec5e4474ede9bfa10cf598f622d", + "value": 5559 + } + }, + "cc2a4ba35e0e4d55a96715545f60cbf0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_308a0ac18d7549e69572e3dd810494e5", + "placeholder": "​", + "style": "IPY_MODEL_d2900942f9df47b28947c30c92de734f", + "value": " 5559/5559 [01:51<00:00, 49.40 examples/s]" + } + }, + "d14760dd70124ceab4a356f3ea480ef9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "e4c79a204fd142b6a307c72d7dc10a38": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "694ecf5bbe544e228a98e8caa343a9e7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "22a3dbd954e343229d64b8b6e81697d3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3ea26ec5e4474ede9bfa10cf598f622d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "308a0ac18d7549e69572e3dd810494e5": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d2900942f9df47b28947c30c92de734f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "85f532274aa34a19a5cadf440768d30b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_844681227c484b3398e7efb9fea80ee1", + "IPY_MODEL_a5a2bfe6a8464279b8cc5e0e6ebb1082", + "IPY_MODEL_521033f81bdb4bc5b841095d1441f8dc" + ], + "layout": "IPY_MODEL_8b7cac926a404a8c975a1b534254d6b5" + } + }, + "844681227c484b3398e7efb9fea80ee1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_b115e3e3a6c74950ac1531366d3d1335", + "placeholder": "​", + "style": "IPY_MODEL_222842b061834510af99839d3b2310f1", + "value": "Map: 100%" + } + }, + "a5a2bfe6a8464279b8cc5e0e6ebb1082": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_d3b19d20d3394eb088c6fa1e88e00b8b", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_2daeb74a35b34ddfb932960196636047", + "value": 1390 + } + }, + "521033f81bdb4bc5b841095d1441f8dc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_7a098858446147ccac3d996486da40ac", + "placeholder": "​", + "style": "IPY_MODEL_9c70d0b152df49e5827eaf7c4c680b2e", + "value": " 1390/1390 [00:26<00:00, 52.48 examples/s]" + } + }, + "8b7cac926a404a8c975a1b534254d6b5": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b115e3e3a6c74950ac1531366d3d1335": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "222842b061834510af99839d3b2310f1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "d3b19d20d3394eb088c6fa1e88e00b8b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2daeb74a35b34ddfb932960196636047": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "7a098858446147ccac3d996486da40ac": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9c70d0b152df49e5827eaf7c4c680b2e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "a2cf47da7e8a450aa8d5c77881873287": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_47b97501f50d4fd793af73e5f7ceaa4a", + "IPY_MODEL_2dfda44036cb4cb88a24f0cb7d34804c", + "IPY_MODEL_56a31f46d7554b3da300d363edc1b8dc" + ], + "layout": "IPY_MODEL_751fe4e50bdb4cc29bc615a7b212bf3a" + } + }, + "47b97501f50d4fd793af73e5f7ceaa4a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_8ca31c08b7da43819df07badc22a179e", + "placeholder": "​", + "style": "IPY_MODEL_d72b1c4807db42d2a3969e57e8e9a636", + "value": "Map: 100%" + } + }, + "2dfda44036cb4cb88a24f0cb7d34804c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_a484c9d090fb4cecaf781a0ae5f43f3e", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_0bcbc8fe0861455f99c5a0784ae64c7a", + "value": 5559 + } + }, + "56a31f46d7554b3da300d363edc1b8dc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_259af91263c2451c8835deb8764a9241", + "placeholder": "​", + "style": "IPY_MODEL_9d7a6e1b52474cb884814647469ee6d5", + "value": " 5559/5559 [01:47<00:00, 52.62 examples/s]" + } + }, + "751fe4e50bdb4cc29bc615a7b212bf3a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8ca31c08b7da43819df07badc22a179e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d72b1c4807db42d2a3969e57e8e9a636": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "a484c9d090fb4cecaf781a0ae5f43f3e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0bcbc8fe0861455f99c5a0784ae64c7a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "259af91263c2451c8835deb8764a9241": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9d7a6e1b52474cb884814647469ee6d5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "5976809ff3b649b4a501c31a5679ac4e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_50a5071b535a47a0b88b728a47b89d11", + "IPY_MODEL_93dde85e17294ddd9e601f5bea74cbb6", + "IPY_MODEL_2b92e8b310de4efd8cec36f3552c9a6c" + ], + "layout": "IPY_MODEL_8c6f897388704644a23244153179b827" + } + }, + "50a5071b535a47a0b88b728a47b89d11": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_584fb7f0e37e4f07be0065d76e908606", + "placeholder": "​", + "style": "IPY_MODEL_f22f1a8cbed842afadde3eac96a11c44", + "value": "Map: 100%" + } + }, + "93dde85e17294ddd9e601f5bea74cbb6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_8628e5935fb84f3593602277332ade4a", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_91f304d326d7495e9556161390588d27", + "value": 1390 + } + }, + "2b92e8b310de4efd8cec36f3552c9a6c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5c6167eaa65b45d68fba432b79090a59", + "placeholder": "​", + "style": "IPY_MODEL_62494f3d853b4398b57450d9990f9f91", + "value": " 1390/1390 [00:26<00:00, 51.76 examples/s]" + } + }, + "8c6f897388704644a23244153179b827": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "584fb7f0e37e4f07be0065d76e908606": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f22f1a8cbed842afadde3eac96a11c44": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "8628e5935fb84f3593602277332ade4a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "91f304d326d7495e9556161390588d27": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "5c6167eaa65b45d68fba432b79090a59": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "62494f3d853b4398b57450d9990f9f91": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "94e9b0b82ef24d50bcd22a69d330b8e3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_04c38476fb474cfca97cd39ba4d7b7d6", + "IPY_MODEL_ea57a35d4bec43dfb17bc720f66760ef", + "IPY_MODEL_ed7412d2d61241169f992d269eade30a" + ], + "layout": "IPY_MODEL_4263e489831f4695915a85d63e155f78" + } + }, + "04c38476fb474cfca97cd39ba4d7b7d6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_0c260d91e8c541d0800dab48c561532f", + "placeholder": "​", + "style": "IPY_MODEL_291c668611224d0bbe003d4afdb940d0", + "value": "Map: 100%" + } + }, + "ea57a35d4bec43dfb17bc720f66760ef": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3595004ad04e440596caf9a909d0cb3a", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_633543a5e3474380a4dc02f1705e6381", + "value": 5559 + } + }, + "ed7412d2d61241169f992d269eade30a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_9ac77dbf03b1450390506cf95bcaa6e4", + "placeholder": "​", + "style": "IPY_MODEL_08dc380285794f59bf458b3c7553f7fb", + "value": " 5559/5559 [01:46<00:00, 52.04 examples/s]" + } + }, + "4263e489831f4695915a85d63e155f78": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0c260d91e8c541d0800dab48c561532f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "291c668611224d0bbe003d4afdb940d0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "3595004ad04e440596caf9a909d0cb3a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "633543a5e3474380a4dc02f1705e6381": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "9ac77dbf03b1450390506cf95bcaa6e4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "08dc380285794f59bf458b3c7553f7fb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "fe3b8ce1b4804ba69782b7a9266496fb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_5668f91584334ed5b07509969388b7f2", + "IPY_MODEL_e9aa55c59bf7444aa2e2abe71eb6f134", + "IPY_MODEL_37662a39e78f4cb1b601f0a32ad6e65c" + ], + "layout": "IPY_MODEL_42931f45c63e48b1a99b7820a9ce4a4e" + } + }, + "5668f91584334ed5b07509969388b7f2": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_78fe6770e8f144279c6be6200b79ecfd", + "placeholder": "​", + "style": "IPY_MODEL_7bd734cbe6c6497a9b21ed39c5da686d", + "value": "Map: 100%" + } + }, + "e9aa55c59bf7444aa2e2abe71eb6f134": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5d2c1928ecb04230bc15718f0da5245b", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_55e730f7626749079541f5ed86db447e", + "value": 1390 + } + }, + "37662a39e78f4cb1b601f0a32ad6e65c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f4af04ec1e2f4e5d94b667119fa68f8c", + "placeholder": "​", + "style": "IPY_MODEL_f7d2f7967b9348e793c9d250bda79da9", + "value": " 1390/1390 [00:26<00:00, 51.84 examples/s]" + } + }, + "42931f45c63e48b1a99b7820a9ce4a4e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "78fe6770e8f144279c6be6200b79ecfd": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7bd734cbe6c6497a9b21ed39c5da686d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "5d2c1928ecb04230bc15718f0da5245b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "55e730f7626749079541f5ed86db447e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "f4af04ec1e2f4e5d94b667119fa68f8c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f7d2f7967b9348e793c9d250bda79da9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "c0c0c6952f1d48f7be957066bac19ed5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_90b5ffd8825a4a1c9fc243723652a4d6", + "IPY_MODEL_af3079f2882443b79eb737a209c1787a", + "IPY_MODEL_acfbfccc008248c6b74509cddc0e2fe7" + ], + "layout": "IPY_MODEL_5f1db7f024f847bd93618601750b474c" + } + }, + "90b5ffd8825a4a1c9fc243723652a4d6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ca72995210bd43408f96cc36f7577b92", + "placeholder": "​", + "style": "IPY_MODEL_959ae0c6077548e9bd64fd7a4bf9b7f5", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "af3079f2882443b79eb737a209c1787a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_a03f8f70ac384db29225f51790acf56c", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_b0c5f79e2d2e4851918c1ed2c2b33064", + "value": 5559 + } + }, + "acfbfccc008248c6b74509cddc0e2fe7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_7be8a5052a174fa9b05e53b0c07117fe", + "placeholder": "​", + "style": "IPY_MODEL_364ed0dfa11d496a81e3e2d95455b5cb", + "value": " 5559/5559 [00:00<00:00, 43065.10 examples/s]" + } + }, + "5f1db7f024f847bd93618601750b474c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ca72995210bd43408f96cc36f7577b92": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "959ae0c6077548e9bd64fd7a4bf9b7f5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "a03f8f70ac384db29225f51790acf56c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b0c5f79e2d2e4851918c1ed2c2b33064": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "7be8a5052a174fa9b05e53b0c07117fe": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "364ed0dfa11d496a81e3e2d95455b5cb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "6ddeec81eeab4e60b7426bf313960252": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_6caf1b50b88940c78df8ffaed4075c82", + "IPY_MODEL_c88e1931c8774b1a98dfb91eef23a56c", + "IPY_MODEL_200c49e4925246a7a92969be34dc80de" + ], + "layout": "IPY_MODEL_98253db133754a49a1ac090560140e33" + } + }, + "6caf1b50b88940c78df8ffaed4075c82": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_b2ff5b74b18c4c20ac24649c94f89d6b", + "placeholder": "​", + "style": "IPY_MODEL_54d8348db2c348aa8148fe990ed1b33a", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "c88e1931c8774b1a98dfb91eef23a56c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_dd0e419bf01340b8b3350490ab322439", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_85478fcd7ee04a2f8a1fe891d3818c3a", + "value": 1390 + } + }, + "200c49e4925246a7a92969be34dc80de": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_efe396a9fce84ddfb95794d1d6e5ab54", + "placeholder": "​", + "style": "IPY_MODEL_ece09fe9319e45aa8fc925360be92e09", + "value": " 1390/1390 [00:00<00:00, 25715.92 examples/s]" + } + }, + "98253db133754a49a1ac090560140e33": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b2ff5b74b18c4c20ac24649c94f89d6b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "54d8348db2c348aa8148fe990ed1b33a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "dd0e419bf01340b8b3350490ab322439": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "85478fcd7ee04a2f8a1fe891d3818c3a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "efe396a9fce84ddfb95794d1d6e5ab54": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ece09fe9319e45aa8fc925360be92e09": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "6e0ff75463754489a5174cac1d9b5822": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_738a0639d9bc40fc8f69f0c766038536", + "IPY_MODEL_7edb817203b449f68ff239b8712c592d", + "IPY_MODEL_3c8040823b5343f8aa1988035358d62e" + ], + "layout": "IPY_MODEL_545359cafd1048ffa7c815ed5534aa79" + } + }, + "738a0639d9bc40fc8f69f0c766038536": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_380ad081adba47d087ff581aaae181b0", + "placeholder": "​", + "style": "IPY_MODEL_88ace3f672e04c1d9999692ff85ba4ea", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "7edb817203b449f68ff239b8712c592d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_91afd40d9d1a48f58d3178c049fe0af7", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_4183d077fe4a4a60a67bf93c051ea600", + "value": 5559 + } + }, + "3c8040823b5343f8aa1988035358d62e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_92feef36eed0474696c5fd819a30e8ea", + "placeholder": "​", + "style": "IPY_MODEL_da2a9434bb7f4d08bed438e2360be212", + "value": " 5559/5559 [00:00<00:00, 45839.61 examples/s]" + } + }, + "545359cafd1048ffa7c815ed5534aa79": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "380ad081adba47d087ff581aaae181b0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "88ace3f672e04c1d9999692ff85ba4ea": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "91afd40d9d1a48f58d3178c049fe0af7": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "4183d077fe4a4a60a67bf93c051ea600": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "92feef36eed0474696c5fd819a30e8ea": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "da2a9434bb7f4d08bed438e2360be212": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "d17de88295f24936bb07e02bdde1ef18": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_e91ff5ce47b64722a011e3d227c1e5d8", + "IPY_MODEL_62960d7214e549e4aa236dae77b3adcc", + "IPY_MODEL_2534601ee1494d0ea3ed3fdeee9e409c" + ], + "layout": "IPY_MODEL_c695710cb07048549d1c0ee460798838" + } + }, + "e91ff5ce47b64722a011e3d227c1e5d8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_680fa3c642974c18ba47e1c4f4ff8a0e", + "placeholder": "​", + "style": "IPY_MODEL_72d551809cbc4b2eb497db44c5adc46c", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "62960d7214e549e4aa236dae77b3adcc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_19ab9163969d4ba1aedd890e8456b3f2", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_d65c3ae998494d1fa592052257e66c58", + "value": 1390 + } + }, + "2534601ee1494d0ea3ed3fdeee9e409c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_9258f33f48714db0856c57e8efccba3e", + "placeholder": "​", + "style": "IPY_MODEL_967d9e918cdc44f8a6a1afebe8f35049", + "value": " 1390/1390 [00:00<00:00, 28750.78 examples/s]" + } + }, + "c695710cb07048549d1c0ee460798838": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "680fa3c642974c18ba47e1c4f4ff8a0e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "72d551809cbc4b2eb497db44c5adc46c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "19ab9163969d4ba1aedd890e8456b3f2": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d65c3ae998494d1fa592052257e66c58": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "9258f33f48714db0856c57e8efccba3e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "967d9e918cdc44f8a6a1afebe8f35049": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "9aba4419261f433babdbacf2cddbaaae": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_c4d27da25d7b46fe98a95b5f6f0c0ce8", + "IPY_MODEL_2df81efc712b4533acf87f15de43714d", + "IPY_MODEL_1d3171780d8e42988102b4cca3c113c6" + ], + "layout": "IPY_MODEL_e260174df0ad4d47864ed4ec99b25fea" + } + }, + "c4d27da25d7b46fe98a95b5f6f0c0ce8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_0c0a76b141ce4c48b951c3f4e8406ce0", + "placeholder": "​", + "style": "IPY_MODEL_f15f80503f43492fba9c88cd3c624edb", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "2df81efc712b4533acf87f15de43714d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ea01494848f64ee197d761be6236273c", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_7769aa1581144b6db3198fc9c6c94927", + "value": 5559 + } + }, + "1d3171780d8e42988102b4cca3c113c6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3f5ba3ff8b474e2780ce0f87edd73d26", + "placeholder": "​", + "style": "IPY_MODEL_af395a656b45411784c0f53579de2e4a", + "value": " 5559/5559 [00:00<00:00, 40342.41 examples/s]" + } + }, + "e260174df0ad4d47864ed4ec99b25fea": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0c0a76b141ce4c48b951c3f4e8406ce0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f15f80503f43492fba9c88cd3c624edb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "ea01494848f64ee197d761be6236273c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7769aa1581144b6db3198fc9c6c94927": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "3f5ba3ff8b474e2780ce0f87edd73d26": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "af395a656b45411784c0f53579de2e4a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "c69bc5a9ef494ff1be688d3345b47951": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_047ca1cddbe74f378ce360e1df50937b", + "IPY_MODEL_283e7d7c9610439696622eac021cb1fa", + "IPY_MODEL_c29cd6ad1acb4a0d883ec60ac23ec295" + ], + "layout": "IPY_MODEL_c57ea7deb5b143b99e06357c41528cf1" + } + }, + "047ca1cddbe74f378ce360e1df50937b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_6e889c250ea94043bad8867ddc10ec92", + "placeholder": "​", + "style": "IPY_MODEL_85e59a7172294e76b4e2f83bd60c1f2e", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "283e7d7c9610439696622eac021cb1fa": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_914c186c1d5e4353b0881142cd23c52e", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_b79e41c92a56412a824ef3b87636694f", + "value": 1390 + } + }, + "c29cd6ad1acb4a0d883ec60ac23ec295": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_56f7bd66913546b790cac64698f47d1f", + "placeholder": "​", + "style": "IPY_MODEL_e8dd5c4ec763417c9c01fda0e23af7dc", + "value": " 1390/1390 [00:00<00:00, 27892.60 examples/s]" + } + }, + "c57ea7deb5b143b99e06357c41528cf1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6e889c250ea94043bad8867ddc10ec92": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "85e59a7172294e76b4e2f83bd60c1f2e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "914c186c1d5e4353b0881142cd23c52e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b79e41c92a56412a824ef3b87636694f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "56f7bd66913546b790cac64698f47d1f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "e8dd5c4ec763417c9c01fda0e23af7dc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "8859929b31c548eaa0fceb367568af33": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_f0f547acc2c44f10be2f6c7ffd5db923", + "IPY_MODEL_815ca085199c4f6a9dc202d3a174fdd5", + "IPY_MODEL_dc0772cdfd4d42ac9211675e32f48f44" + ], + "layout": "IPY_MODEL_c4703cc30b76400cbb482ef52d6d3791" + } + }, + "f0f547acc2c44f10be2f6c7ffd5db923": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3ecfc0861d334e8391ad99b43ab7b723", + "placeholder": "​", + "style": "IPY_MODEL_514b6b97e18e4dd897b082cfe5b36bcf", + "value": "Map: 100%" + } + }, + "815ca085199c4f6a9dc202d3a174fdd5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_da418dbc160c4b82a1c35722798a28e4", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_f9e8fbba70044acfa947d2dd6e4c2d43", + "value": 5559 + } + }, + "dc0772cdfd4d42ac9211675e32f48f44": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_8b97e9202169463792af0302a19f6af8", + "placeholder": "​", + "style": "IPY_MODEL_2c347ab097bb4170908b355dd7b71d9f", + "value": " 5559/5559 [00:01<00:00, 4098.91 examples/s]" + } + }, + "c4703cc30b76400cbb482ef52d6d3791": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3ecfc0861d334e8391ad99b43ab7b723": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "514b6b97e18e4dd897b082cfe5b36bcf": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "da418dbc160c4b82a1c35722798a28e4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f9e8fbba70044acfa947d2dd6e4c2d43": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "8b97e9202169463792af0302a19f6af8": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2c347ab097bb4170908b355dd7b71d9f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "37bb3b9cd750470580d42d0792ea8e3b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_c457da46eced414bab1662ca2953b86f", + "IPY_MODEL_f762156b82c5482a878a0c1c42da6836", + "IPY_MODEL_5c7f3a804425438da85a57efc4521a2e" + ], + "layout": "IPY_MODEL_da3addaf251f48cbb48533d0a115bef2" + } + }, + "c457da46eced414bab1662ca2953b86f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_9459bb2fa5574d7fbed332a76760365e", + "placeholder": "​", + "style": "IPY_MODEL_ad926e85837b43f7b23dd42b1c8e977c", + "value": "Map: 100%" + } + }, + "f762156b82c5482a878a0c1c42da6836": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c18d64ce39c643beb6dfec5cbb1034c9", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_96b808e296584cd6b405d92bacb33857", + "value": 1390 + } + }, + "5c7f3a804425438da85a57efc4521a2e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_a78fc8e06cd84d3d93000149a0f8b783", + "placeholder": "​", + "style": "IPY_MODEL_c7f80157d6f84c239ea6ee339354101c", + "value": " 1390/1390 [00:00<00:00, 4706.10 examples/s]" + } + }, + "da3addaf251f48cbb48533d0a115bef2": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9459bb2fa5574d7fbed332a76760365e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ad926e85837b43f7b23dd42b1c8e977c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "c18d64ce39c643beb6dfec5cbb1034c9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "96b808e296584cd6b405d92bacb33857": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "a78fc8e06cd84d3d93000149a0f8b783": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c7f80157d6f84c239ea6ee339354101c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "a38d4960d8b347d5a27e3b6e4e1fb113": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_e778619f05884fc6a625a4b4d791324c", + "IPY_MODEL_f4b2e06f854044a2b39d3c44f2e581c8", + "IPY_MODEL_3ae6c793683f4204a6c0a2e94c8c0f38" + ], + "layout": "IPY_MODEL_d09b95acf723434d8efc0441bb70c42b" + } + }, + "e778619f05884fc6a625a4b4d791324c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_cf0d5b8201ab49d193edb2699eb83ec5", + "placeholder": "​", + "style": "IPY_MODEL_031029d1c7154f67aa36703d8c500d81", + "value": "Map: 100%" + } + }, + "f4b2e06f854044a2b39d3c44f2e581c8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_202292e0000146dda5d3d4947d912a0c", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_7d10f210fd1245c59a0339e183c515cf", + "value": 5559 + } + }, + "3ae6c793683f4204a6c0a2e94c8c0f38": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ebdcd3076e304521aff61740d639b38f", + "placeholder": "​", + "style": "IPY_MODEL_ec6167948240441b9261d5448b3237ec", + "value": " 5559/5559 [00:01<00:00, 4016.98 examples/s]" + } + }, + "d09b95acf723434d8efc0441bb70c42b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "cf0d5b8201ab49d193edb2699eb83ec5": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "031029d1c7154f67aa36703d8c500d81": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "202292e0000146dda5d3d4947d912a0c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7d10f210fd1245c59a0339e183c515cf": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "ebdcd3076e304521aff61740d639b38f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ec6167948240441b9261d5448b3237ec": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "0c3537ff57e04d7db9262aab594bcd5f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_2d74142f04f349e19e808a98746390f2", + "IPY_MODEL_f6221bb71bc34c918db36e1aebe1aac4", + "IPY_MODEL_6206181637814e5b8e4213187a9dedb0" + ], + "layout": "IPY_MODEL_ee6b155dd8744028b375e56594d2b48a" + } + }, + "2d74142f04f349e19e808a98746390f2": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_8ce81913402e4ea49de86a20651add07", + "placeholder": "​", + "style": "IPY_MODEL_9ec9ef006d004103907e24442f7c80fe", + "value": "Map: 100%" + } + }, + "f6221bb71bc34c918db36e1aebe1aac4": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_dff32c0ac16d4f14a39096288f1aa8b8", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_fad7778daf544f62bd8d74cbb1b015dc", + "value": 1390 + } + }, + "6206181637814e5b8e4213187a9dedb0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_db1d68dfb3fe437f9b8c67268f5a4ab2", + "placeholder": "​", + "style": "IPY_MODEL_f34edd60534c4f17b75fcff5fba45589", + "value": " 1390/1390 [00:00<00:00, 4554.11 examples/s]" + } + }, + "ee6b155dd8744028b375e56594d2b48a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8ce81913402e4ea49de86a20651add07": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9ec9ef006d004103907e24442f7c80fe": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "dff32c0ac16d4f14a39096288f1aa8b8": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fad7778daf544f62bd8d74cbb1b015dc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "db1d68dfb3fe437f9b8c67268f5a4ab2": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f34edd60534c4f17b75fcff5fba45589": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "ac73a156c46644d7970e16e7781a5183": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_b688e34e55b94fdb9d2cabb20fef3053", + "IPY_MODEL_775a6250bd854c1aa0247923d97ff9fd", + "IPY_MODEL_93549c8a61fa4894b4a19c3fca99a118" + ], + "layout": "IPY_MODEL_fec529325496499c94c6177b5d54c3eb" + } + }, + "b688e34e55b94fdb9d2cabb20fef3053": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_557d9c1161664117a7cf83affd6d3980", + "placeholder": "​", + "style": "IPY_MODEL_a501b1086d6a4d8ab3518b23cf02789d", + "value": "Map: 100%" + } + }, + "775a6250bd854c1aa0247923d97ff9fd": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_6c8190f1fcdc45f0939a82f9eefc5cad", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_acac3bd9c181437eade41fca54c92646", + "value": 5559 + } + }, + "93549c8a61fa4894b4a19c3fca99a118": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_575523c10a5f40de80d8135c76fccb76", + "placeholder": "​", + "style": "IPY_MODEL_ca7e438ad5904494809d67935892bb2d", + "value": " 5559/5559 [00:02<00:00, 3402.23 examples/s]" + } + }, + "fec529325496499c94c6177b5d54c3eb": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "557d9c1161664117a7cf83affd6d3980": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a501b1086d6a4d8ab3518b23cf02789d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "6c8190f1fcdc45f0939a82f9eefc5cad": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "acac3bd9c181437eade41fca54c92646": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "575523c10a5f40de80d8135c76fccb76": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ca7e438ad5904494809d67935892bb2d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "56ab07e2da3340d7a5548ad251b507fa": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_5981828186cd4cfc8c4d9965b22d3718", + "IPY_MODEL_d84b745464254fcabdfd97422f03ee50", + "IPY_MODEL_fdfc7556cc4c4d1588fa53412a33a7ca" + ], + "layout": "IPY_MODEL_f822c415536240868446e730383ab21d" + } + }, + "5981828186cd4cfc8c4d9965b22d3718": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_061e5070e4d44f79b35a87f07647c265", + "placeholder": "​", + "style": "IPY_MODEL_756f1da19f454852af074af6e9767b16", + "value": "Map: 100%" + } + }, + "d84b745464254fcabdfd97422f03ee50": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_df7ced2045694585bf5caab44d2219de", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_3680dc3182db4b0994d21e70d86a9fb1", + "value": 1390 + } + }, + "fdfc7556cc4c4d1588fa53412a33a7ca": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ca4efa3ede794e85b856adbf87edb53b", + "placeholder": "​", + "style": "IPY_MODEL_9da06a1fcd77401e926701eb80bd7619", + "value": " 1390/1390 [00:00<00:00, 4406.05 examples/s]" + } + }, + "f822c415536240868446e730383ab21d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "061e5070e4d44f79b35a87f07647c265": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "756f1da19f454852af074af6e9767b16": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "df7ced2045694585bf5caab44d2219de": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3680dc3182db4b0994d21e70d86a9fb1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "ca4efa3ede794e85b856adbf87edb53b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9da06a1fcd77401e926701eb80bd7619": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "338d1ffeb8364875b1e3eba99eb75d0a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_7275f894b10449d2b00a494e7a109f87", + "IPY_MODEL_ce54d113c2944f0c961501a967028b30", + "IPY_MODEL_ff0f15dcd86e49338cee6af7ef89395b" + ], + "layout": "IPY_MODEL_d1022bbf6fd149638383529c47051f93" + } + }, + "7275f894b10449d2b00a494e7a109f87": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_fe30bd2fe55140ec9a61a55b72615524", + "placeholder": "​", + "style": "IPY_MODEL_b5db735f399d490eabfeb025a0dad1c3", + "value": "Map: 100%" + } + }, + "ce54d113c2944f0c961501a967028b30": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_708703e4fd9246f1ae61126f2be90578", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_410d2908686b4039b5e00d427644a576", + "value": 5559 + } + }, + "ff0f15dcd86e49338cee6af7ef89395b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_1262a69f9f5448c38112759d637102b7", + "placeholder": "​", + "style": "IPY_MODEL_b7e157b1383a4c92b9ab4dc8a8d07e91", + "value": " 5559/5559 [01:46<00:00, 52.46 examples/s]" + } + }, + "d1022bbf6fd149638383529c47051f93": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fe30bd2fe55140ec9a61a55b72615524": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b5db735f399d490eabfeb025a0dad1c3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "708703e4fd9246f1ae61126f2be90578": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "410d2908686b4039b5e00d427644a576": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "1262a69f9f5448c38112759d637102b7": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b7e157b1383a4c92b9ab4dc8a8d07e91": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "e3da77ab25d548fbbb1ad74b532f8c7d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_b1ad913a10fd4c14801c68d6b5e31bc8", + "IPY_MODEL_d2746a51c2a643a68b813dc9d100721b", + "IPY_MODEL_2f490e9dab4b44d59f9b8d148911ae79" + ], + "layout": "IPY_MODEL_74bb44ca631a4f6cb832269a39518cd3" + } + }, + "b1ad913a10fd4c14801c68d6b5e31bc8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_6cf7db0b71144e7b915f1c569386e834", + "placeholder": "​", + "style": "IPY_MODEL_dee4dd1ec2ea41a7be94073e291002c3", + "value": "Map: 100%" + } + }, + "d2746a51c2a643a68b813dc9d100721b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_2f99de0601824cee8f0a7525f58c4726", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_db2642b85eb048a1853c061567ea01fa", + "value": 1390 + } + }, + "2f490e9dab4b44d59f9b8d148911ae79": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_51228ddf46e9405685247b445ec55dfe", + "placeholder": "​", + "style": "IPY_MODEL_133b07406b014ebc9ff41a244838a23a", + "value": " 1390/1390 [00:26<00:00, 51.97 examples/s]" + } + }, + "74bb44ca631a4f6cb832269a39518cd3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6cf7db0b71144e7b915f1c569386e834": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "dee4dd1ec2ea41a7be94073e291002c3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "2f99de0601824cee8f0a7525f58c4726": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "db2642b85eb048a1853c061567ea01fa": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "51228ddf46e9405685247b445ec55dfe": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "133b07406b014ebc9ff41a244838a23a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "88ab9b0630634433a38ec1a1041b6793": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_a69938d2b5ef4b8e99d9a1b1c20f1d55", + "IPY_MODEL_e5e254c3143540998ac5a90294dbe490", + "IPY_MODEL_35578a8ace994593b59e7404e49c1fe1" + ], + "layout": "IPY_MODEL_403503061ca6475eab164690ed0a35de" + } + }, + "a69938d2b5ef4b8e99d9a1b1c20f1d55": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3915829c49f948119803ec5ba3ac6bbf", + "placeholder": "​", + "style": "IPY_MODEL_1b06a7cb6a7a49918ff546c21d7208f5", + "value": "Map: 100%" + } + }, + "e5e254c3143540998ac5a90294dbe490": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3e4f5d3074514aa58216884ad9a054e9", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_fc325bb097f04411b1e46bc9a0adc7b9", + "value": 5559 + } + }, + "35578a8ace994593b59e7404e49c1fe1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_72c126b0b7284c9f9d0d851c7037a2d1", + "placeholder": "​", + "style": "IPY_MODEL_9bdeaef34b28447aaadc6bdc6faeed57", + "value": " 5559/5559 [01:46<00:00, 51.85 examples/s]" + } + }, + "403503061ca6475eab164690ed0a35de": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3915829c49f948119803ec5ba3ac6bbf": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1b06a7cb6a7a49918ff546c21d7208f5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "3e4f5d3074514aa58216884ad9a054e9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fc325bb097f04411b1e46bc9a0adc7b9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "72c126b0b7284c9f9d0d851c7037a2d1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9bdeaef34b28447aaadc6bdc6faeed57": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "6b5c8a5a7934422a903a7d0ecc91f321": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_05e2dc79509649588adc10d0e27a5ab1", + "IPY_MODEL_29c9dc340f4a422ea0a4b21513b89ddb", + "IPY_MODEL_7ecb6a88b5754c0abc125b054eba7389" + ], + "layout": "IPY_MODEL_2a17ba043fb74a0b9581f32208a74732" + } + }, + "05e2dc79509649588adc10d0e27a5ab1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_9ef9ed8d47154ff495177e3ce6f0ccab", + "placeholder": "​", + "style": "IPY_MODEL_2f8cab7a7e584b75b4dcd027512e7ae8", + "value": "Map: 100%" + } + }, + "29c9dc340f4a422ea0a4b21513b89ddb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f7332463f4da4e598d0c76a7cf0e1160", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_3636683727324018a5472386ed6990ca", + "value": 1390 + } + }, + "7ecb6a88b5754c0abc125b054eba7389": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_84e62572b55b418fa40d3cb3c1ce0f14", + "placeholder": "​", + "style": "IPY_MODEL_77a56d8ee48e46a08e2ecaa5d676be0b", + "value": " 1390/1390 [00:26<00:00, 51.86 examples/s]" + } + }, + "2a17ba043fb74a0b9581f32208a74732": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9ef9ed8d47154ff495177e3ce6f0ccab": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2f8cab7a7e584b75b4dcd027512e7ae8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "f7332463f4da4e598d0c76a7cf0e1160": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3636683727324018a5472386ed6990ca": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "84e62572b55b418fa40d3cb3c1ce0f14": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "77a56d8ee48e46a08e2ecaa5d676be0b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "ffcb83603765474d9379a90187bc3a27": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_aeaed39127bf45a1acfa3632224babd1", + "IPY_MODEL_21d9e3e2ebb540c5bf7649b10a0258ea", + "IPY_MODEL_8297e4bda30b4e8cb9ac8ed97defc75b" + ], + "layout": "IPY_MODEL_a074133c31d2406c8b68f4881acb0f62" + } + }, + "aeaed39127bf45a1acfa3632224babd1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ff8f39d347ca4672b691a38d34bf0dd1", + "placeholder": "​", + "style": "IPY_MODEL_8eca63e0ea5b4e578dffc3f10212d558", + "value": "Map: 100%" + } + }, + "21d9e3e2ebb540c5bf7649b10a0258ea": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_51ba5660537f4a1cb8e1fc430652b051", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_67327719377c4fc691be3f72f5a36747", + "value": 5559 + } + }, + "8297e4bda30b4e8cb9ac8ed97defc75b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3b1109fb54d84f179d202759e8b66495", + "placeholder": "​", + "style": "IPY_MODEL_a1cec3a032bc4ef08f921d9be506c9de", + "value": " 5559/5559 [01:46<00:00, 52.61 examples/s]" + } + }, + "a074133c31d2406c8b68f4881acb0f62": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ff8f39d347ca4672b691a38d34bf0dd1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8eca63e0ea5b4e578dffc3f10212d558": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "51ba5660537f4a1cb8e1fc430652b051": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "67327719377c4fc691be3f72f5a36747": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "3b1109fb54d84f179d202759e8b66495": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a1cec3a032bc4ef08f921d9be506c9de": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "84f23c987e614f0992dbdae071fb6314": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_0a148286887b421bbfb2579c3eab211d", + "IPY_MODEL_bea4705f37d9422c875d9fa13669950a", + "IPY_MODEL_39a2d7b0750e4f84ab56ca52b66b94be" + ], + "layout": "IPY_MODEL_98e36923b3f948bcabcbe2c3d950d82b" + } + }, + "0a148286887b421bbfb2579c3eab211d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5914f98fb60341deb7966b634faa360b", + "placeholder": "​", + "style": "IPY_MODEL_73017793c9394f818104215972655c2b", + "value": "Map: 100%" + } + }, + "bea4705f37d9422c875d9fa13669950a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5def40185d6543e091aa714c9b891ac9", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_0112437a720846dca2e16f634c862ce8", + "value": 1390 + } + }, + "39a2d7b0750e4f84ab56ca52b66b94be": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_16e007cf72174f60a0edd1bd3735549b", + "placeholder": "​", + "style": "IPY_MODEL_2d2ed668b80547dca68771be04264059", + "value": " 1390/1390 [00:26<00:00, 51.61 examples/s]" + } + }, + "98e36923b3f948bcabcbe2c3d950d82b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5914f98fb60341deb7966b634faa360b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "73017793c9394f818104215972655c2b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "5def40185d6543e091aa714c9b891ac9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0112437a720846dca2e16f634c862ce8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "16e007cf72174f60a0edd1bd3735549b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2d2ed668b80547dca68771be04264059": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "25171061d90a40068fdd9cc385050aeb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_95a3e9f6b0c24aa5976042ce50e669f7", + "IPY_MODEL_3789d006f67e48aeb3c41504caafa634", + "IPY_MODEL_ede8b23198334ae9a16d06ee134d1023" + ], + "layout": "IPY_MODEL_a6a8d8cb31604e6caca980432245ef7f" + } + }, + "95a3e9f6b0c24aa5976042ce50e669f7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_6fdafd894d354b9abed9c335d1d6e943", + "placeholder": "​", + "style": "IPY_MODEL_069398105c3d47ccb215475d097fccae", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "3789d006f67e48aeb3c41504caafa634": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_7a5896e66d084ccda618082d735dcba9", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_d3ace19af72b4c91a96535ee74353cca", + "value": 5559 + } + }, + "ede8b23198334ae9a16d06ee134d1023": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c831615c79d847c0b84179cb86720b78", + "placeholder": "​", + "style": "IPY_MODEL_0f6f967388174a3ca14eaec5b5cece38", + "value": " 5559/5559 [00:00<00:00, 41812.54 examples/s]" + } + }, + "a6a8d8cb31604e6caca980432245ef7f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6fdafd894d354b9abed9c335d1d6e943": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "069398105c3d47ccb215475d097fccae": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "7a5896e66d084ccda618082d735dcba9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d3ace19af72b4c91a96535ee74353cca": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "c831615c79d847c0b84179cb86720b78": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0f6f967388174a3ca14eaec5b5cece38": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "d3b0ab351fe24f6c8c94db179bddfe82": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_3763230ceae34b57ab800df9f52fb4c3", + "IPY_MODEL_fe19f45121c940a09d4f6ca7203d14f3", + "IPY_MODEL_c9d9ad64c1744e70baa2d9fcba04381d" + ], + "layout": "IPY_MODEL_a17542b65b2f489d918d5c2ea0efbf14" + } + }, + "3763230ceae34b57ab800df9f52fb4c3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5573793fd299467eb4258e27b3629a9d", + "placeholder": "​", + "style": "IPY_MODEL_68c2bc2ea11a4d6893ec9a400c7072df", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "fe19f45121c940a09d4f6ca7203d14f3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_a33e610f4b064359a78d639632b91228", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_169684652ce9425db5d0ed190749fdf7", + "value": 1390 + } + }, + "c9d9ad64c1744e70baa2d9fcba04381d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5cba2d1c85ad4e82933bf92fb8154885", + "placeholder": "​", + "style": "IPY_MODEL_5c2755ed53f84c8382ca67d7b25985db", + "value": " 1390/1390 [00:00<00:00, 31131.96 examples/s]" + } + }, + "a17542b65b2f489d918d5c2ea0efbf14": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5573793fd299467eb4258e27b3629a9d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "68c2bc2ea11a4d6893ec9a400c7072df": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "a33e610f4b064359a78d639632b91228": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "169684652ce9425db5d0ed190749fdf7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "5cba2d1c85ad4e82933bf92fb8154885": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5c2755ed53f84c8382ca67d7b25985db": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "e27d3f29de024968b35a25d755a9abf6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_5a7908d105174393987c8c8a5461a4c0", + "IPY_MODEL_53b343b183e14c398f4f96fc7efcb017", + "IPY_MODEL_47a96c0b881747529b37bbaf4d31c66d" + ], + "layout": "IPY_MODEL_73c86ddeb50f49a0b81bf07a598b4442" + } + }, + "5a7908d105174393987c8c8a5461a4c0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_252a7cd731bf40a7959a370d6146a95f", + "placeholder": "​", + "style": "IPY_MODEL_7036a7d40faf42498db22dd68212bd15", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "53b343b183e14c398f4f96fc7efcb017": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_1345735c960a40179f21f9950386f24e", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_7f33c98181574426bf5526db319b50d3", + "value": 5559 + } + }, + "47a96c0b881747529b37bbaf4d31c66d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_bafa736d2fca4004be822dfab9916ae1", + "placeholder": "​", + "style": "IPY_MODEL_525bda7c29214bd09981186d4e39cde4", + "value": " 5559/5559 [00:00<00:00, 44506.80 examples/s]" + } + }, + "73c86ddeb50f49a0b81bf07a598b4442": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "252a7cd731bf40a7959a370d6146a95f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7036a7d40faf42498db22dd68212bd15": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "1345735c960a40179f21f9950386f24e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7f33c98181574426bf5526db319b50d3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "bafa736d2fca4004be822dfab9916ae1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "525bda7c29214bd09981186d4e39cde4": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "92d69515e6c246ffba8dbc9389875efb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_4402d0c3b2b2409d8aca3bfa87b3bb2c", + "IPY_MODEL_3132cbb00d16405a996c2efdb4fb86ef", + "IPY_MODEL_16bfa0ea08c4484f8be77b3fa76d98b1" + ], + "layout": "IPY_MODEL_be7d33d41de74c20a195a2e9a96ffa80" + } + }, + "4402d0c3b2b2409d8aca3bfa87b3bb2c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f9920508dbb94df98a1d328cd967769c", + "placeholder": "​", + "style": "IPY_MODEL_ffc90b0962284848a7d393f8b328b805", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "3132cbb00d16405a996c2efdb4fb86ef": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_31f5a53161ad4ccbb5bbd4b18e17ff09", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_cc26324bc67f437fb91e53565dd00afe", + "value": 1390 + } + }, + "16bfa0ea08c4484f8be77b3fa76d98b1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_0e28586042ac4be4a3d8d84d412ea3a3", + "placeholder": "​", + "style": "IPY_MODEL_84a7817fb46549608bfa8b8f5d3b5aa8", + "value": " 1390/1390 [00:00<00:00, 30533.58 examples/s]" + } + }, + "be7d33d41de74c20a195a2e9a96ffa80": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f9920508dbb94df98a1d328cd967769c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ffc90b0962284848a7d393f8b328b805": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "31f5a53161ad4ccbb5bbd4b18e17ff09": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "cc26324bc67f437fb91e53565dd00afe": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "0e28586042ac4be4a3d8d84d412ea3a3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "84a7817fb46549608bfa8b8f5d3b5aa8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "7b7cfee0c19a418ca5a8892796d1764d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_671416fe8ccf49d2bcbb86a4b1f34e37", + "IPY_MODEL_b846f21cadb2441bb8c0176577e6e4ac", + "IPY_MODEL_2f6c5e2f216649f295b42870dd47ed4a" + ], + "layout": "IPY_MODEL_b5f605db39c3468d8ee0cd12fb57fbfe" + } + }, + "671416fe8ccf49d2bcbb86a4b1f34e37": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_96583fa6a2974012a68a03a68a50a51a", + "placeholder": "​", + "style": "IPY_MODEL_68091e0a86b24f07926dc12d0b6d81f8", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "b846f21cadb2441bb8c0176577e6e4ac": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_1f8574ed99f840e597c36e3a9e464827", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_14b195ddb341465d93c140ee4fec3eae", + "value": 5559 + } + }, + "2f6c5e2f216649f295b42870dd47ed4a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f0b49fb723c74a709a559ceab47e2298", + "placeholder": "​", + "style": "IPY_MODEL_14bd51b1afda4fb6aa21a99cbecd0477", + "value": " 5559/5559 [00:00<00:00, 40408.48 examples/s]" + } + }, + "b5f605db39c3468d8ee0cd12fb57fbfe": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "96583fa6a2974012a68a03a68a50a51a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "68091e0a86b24f07926dc12d0b6d81f8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "1f8574ed99f840e597c36e3a9e464827": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "14b195ddb341465d93c140ee4fec3eae": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "f0b49fb723c74a709a559ceab47e2298": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "14bd51b1afda4fb6aa21a99cbecd0477": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "c17f3526e8cf4d4f909fb45e980c405e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_c1a5cc55d3d3426396a06ec7dd2851f1", + "IPY_MODEL_b59c4ee41345481c98115ab079a4c915", + "IPY_MODEL_b5e9b9d525a4487d81266b47451e6e20" + ], + "layout": "IPY_MODEL_a26a7799687545758d0057168ea00aaf" + } + }, + "c1a5cc55d3d3426396a06ec7dd2851f1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_0be030a620ab4eaf89f3f25bed03c0cd", + "placeholder": "​", + "style": "IPY_MODEL_66771ce5d79d439d88cb8095e7f58dc4", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "b59c4ee41345481c98115ab079a4c915": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_789591a72e9046139927b9d4d2d85ae1", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_6706374cb7d1452cbf198207f5eeb1ae", + "value": 1390 + } + }, + "b5e9b9d525a4487d81266b47451e6e20": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_eb441c0cf54241cca31fc0e47a38f457", + "placeholder": "​", + "style": "IPY_MODEL_32905dd3bba94d9a8034c9d7a2892493", + "value": " 1390/1390 [00:00<00:00, 27672.82 examples/s]" + } + }, + "a26a7799687545758d0057168ea00aaf": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0be030a620ab4eaf89f3f25bed03c0cd": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "66771ce5d79d439d88cb8095e7f58dc4": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "789591a72e9046139927b9d4d2d85ae1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6706374cb7d1452cbf198207f5eeb1ae": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "eb441c0cf54241cca31fc0e47a38f457": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "32905dd3bba94d9a8034c9d7a2892493": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "5034dad0e3fe47ceb3a20148f5792be6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_4570394dee324e6cb9130713be09a95f", + "IPY_MODEL_eed4861bd33a40229185411b951ae7d7", + "IPY_MODEL_d498f9fef62d4021aaa5fddac7ea7642" + ], + "layout": "IPY_MODEL_9f6092eb37354c31b6267a6d022798ae" + } + }, + "4570394dee324e6cb9130713be09a95f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_cef357675e694cb2b5ec7e3d555ef742", + "placeholder": "​", + "style": "IPY_MODEL_1fad1da202d447a5b70d992dbc287632", + "value": "Map: 100%" + } + }, + "eed4861bd33a40229185411b951ae7d7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_8a0d54e87d6b40f9baf9ba9637e4d804", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_b9773d963d234d02b29b91682d362eed", + "value": 5559 + } + }, + "d498f9fef62d4021aaa5fddac7ea7642": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_126d29a7e53949c7b41b816828baac8a", + "placeholder": "​", + "style": "IPY_MODEL_c139fddf7f1a4db99dd9698e3ed5169b", + "value": " 5559/5559 [00:01<00:00, 2672.72 examples/s]" + } + }, + "9f6092eb37354c31b6267a6d022798ae": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "cef357675e694cb2b5ec7e3d555ef742": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1fad1da202d447a5b70d992dbc287632": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "8a0d54e87d6b40f9baf9ba9637e4d804": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b9773d963d234d02b29b91682d362eed": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "126d29a7e53949c7b41b816828baac8a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c139fddf7f1a4db99dd9698e3ed5169b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "0335aa51e5d34138bfc2b0a579a814d7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_38d70205cc8a4b43b9b6becc54263d8b", + "IPY_MODEL_f43cfcd4ee704bb6a16edf7a182e7473", + "IPY_MODEL_628d3cddbf464951a363ce16c08751f3" + ], + "layout": "IPY_MODEL_1544874d7e774df8af088b770be4dccc" + } + }, + "38d70205cc8a4b43b9b6becc54263d8b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5e00c1cb9e864ac09fdec4d859adf2e1", + "placeholder": "​", + "style": "IPY_MODEL_b968ce2633a6410c9c92e77dd6cbc754", + "value": "Map: 100%" + } + }, + "f43cfcd4ee704bb6a16edf7a182e7473": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_0a57fe2ada4042899cc66b83fad04ddb", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_051d6e3aabd54222b3138578853cd8db", + "value": 1390 + } + }, + "628d3cddbf464951a363ce16c08751f3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_060ba3d9303042648c2f573b6536fb69", + "placeholder": "​", + "style": "IPY_MODEL_898eb3017be0487a909de4a8fb31cc1c", + "value": " 1390/1390 [00:00<00:00, 4588.17 examples/s]" + } + }, + "1544874d7e774df8af088b770be4dccc": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5e00c1cb9e864ac09fdec4d859adf2e1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b968ce2633a6410c9c92e77dd6cbc754": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "0a57fe2ada4042899cc66b83fad04ddb": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "051d6e3aabd54222b3138578853cd8db": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "060ba3d9303042648c2f573b6536fb69": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "898eb3017be0487a909de4a8fb31cc1c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "e773ba097a3f434eb44f2584e154f6f6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_b669bcca5e00419cbfb91d4d1f6e062a", + "IPY_MODEL_49b63c26912048568b5b98ac1a62bc6f", + "IPY_MODEL_4263b494d7d144e0b7944f6e9f58acf3" + ], + "layout": "IPY_MODEL_440f4a3b7d464140868133bb7e36fe25" + } + }, + "b669bcca5e00419cbfb91d4d1f6e062a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f734c1a444564389b3a462ca3f0c3d8d", + "placeholder": "​", + "style": "IPY_MODEL_5f3a5e30bf624d96aa395b92245bcd74", + "value": "Map: 100%" + } + }, + "49b63c26912048568b5b98ac1a62bc6f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c82badd876bd489d8a4a85750f6fd67a", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_980185848a1e47078f9da4329d4b1baa", + "value": 5559 + } + }, + "4263b494d7d144e0b7944f6e9f58acf3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_e6789b3bc2014d3dbf89d293dded59e7", + "placeholder": "​", + "style": "IPY_MODEL_33d9e3c66ab5457c8500a852849066c4", + "value": " 5559/5559 [00:01<00:00, 4556.29 examples/s]" + } + }, + "440f4a3b7d464140868133bb7e36fe25": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f734c1a444564389b3a462ca3f0c3d8d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5f3a5e30bf624d96aa395b92245bcd74": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "c82badd876bd489d8a4a85750f6fd67a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "980185848a1e47078f9da4329d4b1baa": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "e6789b3bc2014d3dbf89d293dded59e7": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "33d9e3c66ab5457c8500a852849066c4": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "53ecd38b4d364424966bf6fb209a5dec": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_45c03b5ea2094a219a1285a9d6468e03", + "IPY_MODEL_24b9fa74b4e741538b65348a76b706bc", + "IPY_MODEL_d25d332a247c4819b382d18243fb1ba1" + ], + "layout": "IPY_MODEL_9dd784fe64bf44f68034bdd58f28f663" + } + }, + "45c03b5ea2094a219a1285a9d6468e03": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_fb29ea64da3044d5a35f4d66f67f0fd9", + "placeholder": "​", + "style": "IPY_MODEL_34ee1ff16660410588a3146ce223e38b", + "value": "Map: 100%" + } + }, + "24b9fa74b4e741538b65348a76b706bc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_4fb277b45013402a8de30f51d97284f6", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_44478466268643aa9a765b95622a3ec8", + "value": 1390 + } + }, + "d25d332a247c4819b382d18243fb1ba1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_1ffcab679880495aa36381d32738a01b", + "placeholder": "​", + "style": "IPY_MODEL_84ab8a58b26e41cbbf5e407fbf443310", + "value": " 1390/1390 [00:00<00:00, 4454.83 examples/s]" + } + }, + "9dd784fe64bf44f68034bdd58f28f663": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fb29ea64da3044d5a35f4d66f67f0fd9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "34ee1ff16660410588a3146ce223e38b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "4fb277b45013402a8de30f51d97284f6": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "44478466268643aa9a765b95622a3ec8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "1ffcab679880495aa36381d32738a01b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "84ab8a58b26e41cbbf5e407fbf443310": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "bf9651c1a1e8405892e43f72b6aba784": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_cc2c4ae127ed46a8846f03aaa724d4aa", + "IPY_MODEL_15cb0216bf144607a0dde58717010094", + "IPY_MODEL_4ac5c4efce42442fbbcb60c1346b33cb" + ], + "layout": "IPY_MODEL_c69aa4d145c943d79b4903a961353d0c" + } + }, + "cc2c4ae127ed46a8846f03aaa724d4aa": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_bf409d51992f4dba85d06bb225fb0cd1", + "placeholder": "​", + "style": "IPY_MODEL_de74e6632fb24428a87af62ff3ff77cd", + "value": "Map: 100%" + } + }, + "15cb0216bf144607a0dde58717010094": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_78fbb8b976794a8bb86c1ed2906e5f98", + "max": 5559, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_a1236188a7f1495da0c2b1c92c397a67", + "value": 5559 + } + }, + "4ac5c4efce42442fbbcb60c1346b33cb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5ab8d81f80414249b2681a79df68a8ed", + "placeholder": "​", + "style": "IPY_MODEL_409695e6b5534b91a32120d12bc60a7f", + "value": " 5559/5559 [00:02<00:00, 2236.41 examples/s]" + } + }, + "c69aa4d145c943d79b4903a961353d0c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "bf409d51992f4dba85d06bb225fb0cd1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "de74e6632fb24428a87af62ff3ff77cd": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "78fbb8b976794a8bb86c1ed2906e5f98": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a1236188a7f1495da0c2b1c92c397a67": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "5ab8d81f80414249b2681a79df68a8ed": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "409695e6b5534b91a32120d12bc60a7f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "6ae930de9d8e4f428c840cf6f020dca0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_05edc742dd73465b8b71346b0f8ab36b", + "IPY_MODEL_e511803d9d0447afa9e93140e729e459", + "IPY_MODEL_4298a23cc33946a8b1a95495a4677446" + ], + "layout": "IPY_MODEL_82b3218b228d45de88f240cc0774c828" + } + }, + "05edc742dd73465b8b71346b0f8ab36b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f9a04d25138f42feb8ec93810debaf1f", + "placeholder": "​", + "style": "IPY_MODEL_f2d5b0d06f384bc7a00837a14693afae", + "value": "Map: 100%" + } + }, + "e511803d9d0447afa9e93140e729e459": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_0004f3961df248d684f02b275fa2278f", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_c1577a8ac76d4eb590951b6e7f0c11b0", + "value": 1390 + } + }, + "4298a23cc33946a8b1a95495a4677446": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_2b391d7675284905a45d38390dc5cdc8", + "placeholder": "​", + "style": "IPY_MODEL_5b84f00033714b2595eeab8aed6a3fe0", + "value": " 1390/1390 [00:00<00:00, 4343.34 examples/s]" + } + }, + "82b3218b228d45de88f240cc0774c828": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f9a04d25138f42feb8ec93810debaf1f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f2d5b0d06f384bc7a00837a14693afae": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "0004f3961df248d684f02b275fa2278f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c1577a8ac76d4eb590951b6e7f0c11b0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "2b391d7675284905a45d38390dc5cdc8": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5b84f00033714b2595eeab8aed6a3fe0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "417140ff131946deb837591bcd4798c0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_d2840413cb3647918dd209ed02f8adbd", + "IPY_MODEL_16b8498863764a08a77f8ac777a87436", + "IPY_MODEL_e1a7fdf268d94e34ad6a16435504d532" + ], + "layout": "IPY_MODEL_2ac6537fe9114614a24a3f66d05dad95" + } + }, + "d2840413cb3647918dd209ed02f8adbd": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3919bfdaf9da46368520911822adb2fc", + "placeholder": "​", + "style": "IPY_MODEL_a60d72a71f0540178966c622ec56f736", + "value": "Map: 100%" + } + }, + "16b8498863764a08a77f8ac777a87436": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f00bed838d0f4c3ab299ce5262b6a798", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_cdde89a5a3fc4f43868f2f6015c2c2e9", + "value": 1390 + } + }, + "e1a7fdf268d94e34ad6a16435504d532": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_1bdb39a03e4648929713a5cc06398640", + "placeholder": "​", + "style": "IPY_MODEL_51815cc800eb43809ffda39f1189659b", + "value": " 1390/1390 [00:35<00:00, 38.65 examples/s]" + } + }, + "2ac6537fe9114614a24a3f66d05dad95": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3919bfdaf9da46368520911822adb2fc": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a60d72a71f0540178966c622ec56f736": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "f00bed838d0f4c3ab299ce5262b6a798": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "cdde89a5a3fc4f43868f2f6015c2c2e9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "1bdb39a03e4648929713a5cc06398640": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "51815cc800eb43809ffda39f1189659b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "7673cb93bbdb4a6b892b16fd4d1ce652": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_564ac17789894c88a217ffcd9ba0ca76", + "IPY_MODEL_1365493485fa468ea3349de592e3907f", + "IPY_MODEL_94da900685a34397b689f7304710126b" + ], + "layout": "IPY_MODEL_7078410ec64a478f9719b2f6668e814a" + } + }, + "564ac17789894c88a217ffcd9ba0ca76": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_325997139c4140b39c3fd1b7d2052bd9", + "placeholder": "​", + "style": "IPY_MODEL_0b65902e95034eeab6c6ef9405d9548c", + "value": "Map: 100%" + } + }, + "1365493485fa468ea3349de592e3907f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_d85bc144efd54d62aba3878f87a6f990", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_3e621df89e934cbf8362c79cb02e9eb5", + "value": 1390 + } + }, + "94da900685a34397b689f7304710126b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ad168d9ef0f6401d86983bb577b76dd5", + "placeholder": "​", + "style": "IPY_MODEL_82ec607265204206a33103ecf0e98d21", + "value": " 1390/1390 [00:00<00:00, 4335.27 examples/s]" + } + }, + "7078410ec64a478f9719b2f6668e814a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "325997139c4140b39c3fd1b7d2052bd9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0b65902e95034eeab6c6ef9405d9548c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "d85bc144efd54d62aba3878f87a6f990": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3e621df89e934cbf8362c79cb02e9eb5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "ad168d9ef0f6401d86983bb577b76dd5": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "82ec607265204206a33103ecf0e98d21": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "486f11186d874b7e83dd2e088bae002e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_f5b930386e2a4cb2acd3b2d528c70dd6", + "IPY_MODEL_069f96de1e34477582ce3ad8bcf0a7f2", + "IPY_MODEL_d5e9143bdf8e44429771da6b07934b48" + ], + "layout": "IPY_MODEL_83cd8944573b48c5ae1fa8582b259a60" + } + }, + "f5b930386e2a4cb2acd3b2d528c70dd6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f3a3d0f3895f486e9bdfbfa6581c2007", + "placeholder": "​", + "style": "IPY_MODEL_2696019fe4674ac28fd87898cc6780dd", + "value": "Downloading (…)lve/main/config.json: 100%" + } + }, + "069f96de1e34477582ce3ad8bcf0a7f2": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_dd5b7db237bb42209c35403616f2b525", + "max": 817, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_fce9d772bcf74a809cff8c6c352abcb3", + "value": 817 + } + }, + "d5e9143bdf8e44429771da6b07934b48": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_99aa8b82bd2444999ef86bba75949976", + "placeholder": "​", + "style": "IPY_MODEL_c0d2cd311db247c1b21a19593c455762", + "value": " 817/817 [00:00<00:00, 78.8kB/s]" + } + }, + "83cd8944573b48c5ae1fa8582b259a60": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f3a3d0f3895f486e9bdfbfa6581c2007": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2696019fe4674ac28fd87898cc6780dd": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "dd5b7db237bb42209c35403616f2b525": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fce9d772bcf74a809cff8c6c352abcb3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "99aa8b82bd2444999ef86bba75949976": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c0d2cd311db247c1b21a19593c455762": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "c9572f12724249a492816be24f394d76": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_e17eae14f470471bb94730ccbee2c7b3", + "IPY_MODEL_9cbfaf9e319645118cdd384a4007915b", + "IPY_MODEL_2fd6bf638a824c49a4ce018cdb069177" + ], + "layout": "IPY_MODEL_ccb333e16f1e459ebb385956e478c373" + } + }, + "e17eae14f470471bb94730ccbee2c7b3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_87f5f6c06ecd422fa4675aa7de3e31f3", + "placeholder": "​", + "style": "IPY_MODEL_4c176765710b41cdbb625cefa1599800", + "value": "Downloading model.safetensors: 100%" + } + }, + "9cbfaf9e319645118cdd384a4007915b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_b0d274fc0ea447e1a5f9a9de476332c2", + "max": 709085090, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_7bc39d5ea97945338f47881a1421ff52", + "value": 709085090 + } + }, + "2fd6bf638a824c49a4ce018cdb069177": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_74f7007eee3241a3bd5002b8e5a6148d", + "placeholder": "​", + "style": "IPY_MODEL_cff1616b8ebc459fa434db0a69a195f2", + "value": " 709M/709M [00:13<00:00, 55.4MB/s]" + } + }, + "ccb333e16f1e459ebb385956e478c373": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "87f5f6c06ecd422fa4675aa7de3e31f3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "4c176765710b41cdbb625cefa1599800": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "b0d274fc0ea447e1a5f9a9de476332c2": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7bc39d5ea97945338f47881a1421ff52": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "74f7007eee3241a3bd5002b8e5a6148d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "cff1616b8ebc459fa434db0a69a195f2": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "f35a9eec4f7a4dd18de10815281b5a2a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_402640a0df79496f836b2dee7b12e374", + "IPY_MODEL_9c61d2cd86e4430f8207fcb328378463", + "IPY_MODEL_3f185063faa0444abc845b88cb7cf70c" + ], + "layout": "IPY_MODEL_be99854c11c14402b518756040346159" + } + }, + "402640a0df79496f836b2dee7b12e374": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_999c2dc53fa34547ba4e8a4d753d885b", + "placeholder": "​", + "style": "IPY_MODEL_0111d78b54e14041b19c18ec2efd0c02", + "value": "Downloading (…)okenizer_config.json: 100%" + } + }, + "9c61d2cd86e4430f8207fcb328378463": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_300832a0c66e4a4cadc1fc7d2825d647", + "max": 264, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_868f963c1e1844499a0240ae345940e8", + "value": 264 + } + }, + "3f185063faa0444abc845b88cb7cf70c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_2ac949e50cc74b14b35dc8ff948e36a8", + "placeholder": "​", + "style": "IPY_MODEL_b415d3920503453097975ce8575a83cc", + "value": " 264/264 [00:00<00:00, 23.5kB/s]" + } + }, + "be99854c11c14402b518756040346159": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "999c2dc53fa34547ba4e8a4d753d885b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0111d78b54e14041b19c18ec2efd0c02": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "300832a0c66e4a4cadc1fc7d2825d647": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "868f963c1e1844499a0240ae345940e8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "2ac949e50cc74b14b35dc8ff948e36a8": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b415d3920503453097975ce8575a83cc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "e47af479ba2947728edead722e37507a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_6f79ec17441f4b23a52aa96d37fefd13", + "IPY_MODEL_8f206492a6cb4c59978d3edbf0a22601", + "IPY_MODEL_3b6f8d1596d64fa6b88e2b3f3192d820" + ], + "layout": "IPY_MODEL_99708f3e63aa49f99fb350f21d69e71e" + } + }, + "6f79ec17441f4b23a52aa96d37fefd13": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_1931acef87bb46b99d6ff96b9d26ea4b", + "placeholder": "​", + "style": "IPY_MODEL_8fea0d18b21c4f41bff4e9cab9fafd9b", + "value": "Downloading (…)solve/main/vocab.txt: 100%" + } + }, + "8f206492a6cb4c59978d3edbf0a22601": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3d55048e65134e33895e0c9f11cd1ba7", + "max": 995526, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_c6db58831b2845949fca86a2bbc12ae5", + "value": 995526 + } + }, + "3b6f8d1596d64fa6b88e2b3f3192d820": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ca7f36ddc0594a7584a0b266bf71ebca", + "placeholder": "​", + "style": "IPY_MODEL_379aadd411804cb8b435f5ec03cf8941", + "value": " 996k/996k [00:00<00:00, 9.24MB/s]" + } + }, + "99708f3e63aa49f99fb350f21d69e71e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1931acef87bb46b99d6ff96b9d26ea4b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8fea0d18b21c4f41bff4e9cab9fafd9b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "3d55048e65134e33895e0c9f11cd1ba7": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c6db58831b2845949fca86a2bbc12ae5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "ca7f36ddc0594a7584a0b266bf71ebca": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "379aadd411804cb8b435f5ec03cf8941": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "d753541428e4471d94d44c3cbb83d5b8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_8c08b8d2bcbf4a449e90efbd0f436873", + "IPY_MODEL_f4d1d35507dc49dbb0ca8d1616013b3e", + "IPY_MODEL_7e2892dee05147b6b7597d7087d5d08b" + ], + "layout": "IPY_MODEL_42019918b32f43fead5e531292cab5dc" + } + }, + "8c08b8d2bcbf4a449e90efbd0f436873": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_05106957703944b9991803c6eb9d006d", + "placeholder": "​", + "style": "IPY_MODEL_e438e7017e924a428cc47bbee78cacf3", + "value": "Downloading (…)cial_tokens_map.json: 100%" + } + }, + "f4d1d35507dc49dbb0ca8d1616013b3e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3c38cb2d3c5747f79b12915ce195e910", + "max": 112, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_2a93b900107f4c24ad3fb04cdd2f5293", + "value": 112 + } + }, + "7e2892dee05147b6b7597d7087d5d08b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3bd2b91ef73347068af0ed288fd17e53", + "placeholder": "​", + "style": "IPY_MODEL_a1caf52d25ef450287b3ca5a57660bee", + "value": " 112/112 [00:00<00:00, 8.20kB/s]" + } + }, + "42019918b32f43fead5e531292cab5dc": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "05106957703944b9991803c6eb9d006d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "e438e7017e924a428cc47bbee78cacf3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "3c38cb2d3c5747f79b12915ce195e910": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2a93b900107f4c24ad3fb04cdd2f5293": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "3bd2b91ef73347068af0ed288fd17e53": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a1caf52d25ef450287b3ca5a57660bee": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "4d6cd358cf3142ca8f6d97c3ea467165": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_d84281814e1248dca0cbe97c182552f2", + "IPY_MODEL_e67e2a11fb10484e834bf976a454fac3", + "IPY_MODEL_500a601091eb4c359beed1c5dd143e56" + ], + "layout": "IPY_MODEL_3aee35faf2fc43d8beff5fe68b27c8af" + } + }, + "d84281814e1248dca0cbe97c182552f2": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_037c286ac5a2478f87adfbed0858d194", + "placeholder": "​", + "style": "IPY_MODEL_0b2e1db7008346f3b79cc51db50acaa8", + "value": "Map: 100%" + } + }, + "e67e2a11fb10484e834bf976a454fac3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_1e8511680e944af8adfafee67945bb52", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_c0564b4e129f4f80aede254fec5e57ab", + "value": 1390 + } + }, + "500a601091eb4c359beed1c5dd143e56": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_b0b322d936dc476bbd284456502f9365", + "placeholder": "​", + "style": "IPY_MODEL_1593150538b64361a97b7bb522a42a60", + "value": " 1390/1390 [02:25<00:00, 6.79 examples/s]" + } + }, + "3aee35faf2fc43d8beff5fe68b27c8af": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "037c286ac5a2478f87adfbed0858d194": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0b2e1db7008346f3b79cc51db50acaa8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "1e8511680e944af8adfafee67945bb52": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c0564b4e129f4f80aede254fec5e57ab": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "b0b322d936dc476bbd284456502f9365": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1593150538b64361a97b7bb522a42a60": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "387894ba27fe4f7faf45f167413e9b5f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_37fa4a773b554f47b112b51e4ebb938a", + "IPY_MODEL_0670fcc46d654ee0ae20ff7f34f9ab9c", + "IPY_MODEL_9b8c7ba357a64687a41f08c785e908a9" + ], + "layout": "IPY_MODEL_cca21899324c4fceb638c2ba5dd6579d" + } + }, + "37fa4a773b554f47b112b51e4ebb938a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_dbe87476d4ad4e729fb958d9c8d3fe1f", + "placeholder": "​", + "style": "IPY_MODEL_d284f7127d794451951680445b6cda8c", + "value": "Map: 100%" + } + }, + "0670fcc46d654ee0ae20ff7f34f9ab9c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_030843630f09481ba274bff6e7424c57", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_fc2ea502e43b4c479b9ec436ab73982b", + "value": 1390 + } + }, + "9b8c7ba357a64687a41f08c785e908a9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_a5cd9edbb68d41b48c891090ad7a1c19", + "placeholder": "​", + "style": "IPY_MODEL_e426b72d26fa4196a244b6882c025efc", + "value": " 1390/1390 [00:00<00:00, 4430.11 examples/s]" + } + }, + "cca21899324c4fceb638c2ba5dd6579d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "dbe87476d4ad4e729fb958d9c8d3fe1f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d284f7127d794451951680445b6cda8c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "030843630f09481ba274bff6e7424c57": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fc2ea502e43b4c479b9ec436ab73982b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "a5cd9edbb68d41b48c891090ad7a1c19": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "e426b72d26fa4196a244b6882c025efc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "f23f875a300a4a3ea7c266830c636f15": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_98a2a10004ea466890dfeb6bbbbbaa8e", + "IPY_MODEL_ea431fa4e48f470e941f955ca54e7fe1", + "IPY_MODEL_a07f93b94c4e4433b2e202ad6a040d9a" + ], + "layout": "IPY_MODEL_a6febba2e4214b95a6805794b6f36b12" + } + }, + "98a2a10004ea466890dfeb6bbbbbaa8e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_bad729b30fa741ad98907efcd676cd8c", + "placeholder": "​", + "style": "IPY_MODEL_3bfb85c28b124170835e8eef3ab1efbc", + "value": "Saving the dataset (1/1 shards): 100%" + } + }, + "ea431fa4e48f470e941f955ca54e7fe1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_bc6848a19db8420398466d8a3a29965d", + "max": 1390, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_b6cd9fcec9104022b7328f0c87588846", + "value": 1390 + } + }, + "a07f93b94c4e4433b2e202ad6a040d9a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_fd90470ad4ed44b09ca704bcd4de2c92", + "placeholder": "​", + "style": "IPY_MODEL_1ccec633c01b4c599d199bd1ee10bdf7", + "value": " 1390/1390 [00:00<00:00, 42123.35 examples/s]" + } + }, + "a6febba2e4214b95a6805794b6f36b12": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "bad729b30fa741ad98907efcd676cd8c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3bfb85c28b124170835e8eef3ab1efbc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "bc6848a19db8420398466d8a3a29965d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b6cd9fcec9104022b7328f0c87588846": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "fd90470ad4ed44b09ca704bcd4de2c92": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1ccec633c01b4c599d199bd1ee10bdf7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + } } - } - }, - "version_major": 2, - "version_minor": 0 - } - } - }, - "nbformat": 4, - "nbformat_minor": 1 -} + } + }, + "nbformat": 4, + "nbformat_minor": 0 +} \ No newline at end of file diff --git a/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_2.ipynb b/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_2.ipynb index 4ccbd29..4301c54 100644 --- a/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_2.ipynb +++ b/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_2.ipynb @@ -1,52274 +1,22699 @@ { - "cells": [ - { - "cell_type": "markdown", - "metadata": { - "id": "kmbK3sewEVGy" - }, - "source": [ - "# Actuarial Applications of Natural Language Processing Using Transformers\n", - "### A Case Study for Processing Text Features in an Actuarial Context\n", - "### Part II – Case Studies on Property Insurance Claim Descriptions - Unsupervised Techniques\n", - "\n", - "By Andreas Troxler, June 2022\n", - "\n", - "In this Part II of the tutorial, you will learn techniques that can be applied in situations with few or no labels.\n", - "This is very relevant in practice: text data is often available, but labels are missing or sparse! \n", - "\n", - "Let’s get started." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "EnmTW4uhEVG3" - }, - "source": [ - "## Notebook Overview\n", - "\n", - "This notebook is divided into tutorial is divided into six parts; they are:\n", - "\n", - "1. [Introduction.](#intro)
\n", - " We begin by explaining pre-requisites. Then we turn to loading and exploring the dataset – ca. 6k records of short property insurance claim description which we aim to classify by peril type.

\n", - "\n", - "2. [Classify by peril type in a supervised setting.](#supervised)
\n", - " To warm up, we apply supervised learning techniques you have learned in Part I to the dataset of this Part II.

\n", - "\n", - "3. [Zero-shot classification.](#zero_shot)
\n", - " This technique assigns each text sample to one element of a pre-defined list of candidate expressions. This allows classification without any task-specific training and without using the labels. This fully unsupervised approach is useful in situations with no labels.

\n", - "\n", - "4. [Unsupervised classification using similarity.](#similarity)
\n", - " This technique encodes each input sentence and each candidate expression into en embedding vector. Then, pairwise similarity scores between each input sequence and each candiate expression are calculated. The candidate expression with the highest similarity score is selected. This fully unsupervised approach is useful in situations with no labels.

\n", - " \n", - "5. [Unsupervised topic modeling by clustering of document embeddings.](#topic_modeling)
\n", - " This approach extracts clusters of similar text samples and proposes verbal representations of these clusters. The labels are not required, but may be used in the process if available. This technique does not require prior knowledge of candidate expressions.

\n", - " \n", - "6. [Conclusion](#conclusion)\n" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "hcc6Je4lEVG4" - }, - "source": [ - "\n", - "\n", - "## 1. Introduction\n", - "\n", - "In this section we discuss the pre-requisites, load and inspect the dataset." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "iEu2UBDEEVG4" - }, - "source": [ - "\n", - "\n", - "### 1.1. Prerequisites\n" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "2mGZv-UxvKO_" - }, - "source": [ - "#### Computing Power\n", - "\n", - "This notebook is computationally intensive. We recommend using a platform with GPU support.\n", - "\n", - "We have run this notebook on Google Colab and on an Amazon EC2 p2.xlarge instance (an older generation of GPU-based instances).\n", - "\n", - "Please note that the results may not be reproducible across platforms and versions." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "qXPfoNIUIpuv" - }, - "source": [ - "#### Local files\n", - "Make sure the following files are available in the directory of the notebook:\n", - "* `tutorial_utils.py` - a collection of utility functions used throughout this notebook\n", - "* `peril.training.csv` - the training data\n", - "* `peril.validation.csv` - the validation data\n", - "\n", - "This notebook will create the following subdirectories:\n", - "* `models` - trained Transformer models\n", - "* `results` - figures and Excel files" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "3ahENX7-EVG5" - }, - "source": [ - "#### Getting started with Python and Jupyter Notebook\n", - "\n", - "For this tutorial, we assume that you are already familiar with Python and Jupyter Notebook.\n", - "We also assume that you have worked through Part I of this tutorial.\n", - "\n", - "In this section, Jupyter Notebook and Python settings are initialized.\n", - "For code in Python, the [PEP8 standard](https://www.python.org/dev/peps/pep-0008/)\n", - "(\"PEP = Python Enhancement Proposal\") is enforced with minor variations to improve readability.\n" - ] - }, - { - "cell_type": "code", - "execution_count": 1, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 + "cells": [ + { + "cell_type": "markdown", + "metadata": { + "id": "kmbK3sewEVGy" + }, + "source": [ + "# Actuarial Applications of Natural Language Processing Using Transformers\n", + "### A Case Study for Processing Text Features in an Actuarial Context\n", + "### Part II – Case Studies on Property Insurance Claim Descriptions - Unsupervised Techniques\n", + "\n", + "By Andreas Troxler, June 2022\n", + "\n", + "In this Part II of the tutorial, you will learn techniques that can be applied in situations with few or no labels.\n", + "This is very relevant in practice: text data is often available, but labels are missing or sparse!\n", + "\n", + "Let’s get started." + ] }, - "id": "1wK6e7a5EVG5", - "outputId": "96247e63-3acb-43bf-9371-05765dcc2024", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "text/html": [ - "" - ], - "text/plain": [ - "" + "cell_type": "markdown", + "metadata": { + "id": "EnmTW4uhEVG3" + }, + "source": [ + "## Notebook Overview\n", + "\n", + "This notebook is divided into tutorial is divided into six parts; they are:\n", + "\n", + "1. [Introduction.](#intro)
\n", + " We begin by explaining pre-requisites. Then we turn to loading and exploring the dataset – ca. 6k records of short property insurance claim description which we aim to classify by peril type.

\n", + "\n", + "2. [Classify by peril type in a supervised setting.](#supervised)
\n", + " To warm up, we apply supervised learning techniques you have learned in Part I to the dataset of this Part II.

\n", + "\n", + "3. [Zero-shot classification.](#zero_shot)
\n", + " This technique assigns each text sample to one element of a pre-defined list of candidate expressions. This allows classification without any task-specific training and without using the labels. This fully unsupervised approach is useful in situations with no labels.

\n", + "\n", + "4. [Unsupervised classification using similarity.](#similarity)
\n", + " This technique encodes each input sentence and each candidate expression into en embedding vector. Then, pairwise similarity scores between each input sequence and each candiate expression are calculated. The candidate expression with the highest similarity score is selected. This fully unsupervised approach is useful in situations with no labels.

\n", + " \n", + "5. [Unsupervised topic modeling by clustering of document embeddings.](#topic_modeling)
\n", + " This approach extracts clusters of similar text samples and proposes verbal representations of these clusters. The labels are not required, but may be used in the process if available. This technique does not require prior knowledge of candidate expressions.

\n", + " \n", + "6. [Conclusion](#conclusion)\n" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# Notebook settings\n", - "\n", - "# clear the namespace variables\n", - "from IPython import get_ipython\n", - "get_ipython().run_line_magic(\"reset\", \"-sf\")\n", - "\n", - "# formatting: cell width\n", - "from IPython.display import display, HTML\n", - "display(HTML(\"\"))" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "5V9gFHqyEVG7" - }, - "source": [ - "#### Importing Required Libraries\n", - "\n", - "If you run this notebook on Google Colab, you will need to install the following libraries:" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" }, - "id": "Mxggg0WmFDuy", - "outputId": "b6ee319a-540d-400e-c889-f27245d894c9" - }, - "outputs": [], - "source": [ - "!pip install datasets" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" + { + "cell_type": "markdown", + "metadata": { + "id": "hcc6Je4lEVG4" + }, + "source": [ + "\n", + "\n", + "## 1. Introduction\n", + "\n", + "In this section we discuss the pre-requisites, load and inspect the dataset." + ] }, - "id": "lSUQsZPlFeBu", - "outputId": "9828bf8d-6e1b-4b5f-bbe3-e5297cf85939" - }, - "outputs": [], - "source": [ - "!pip install transformers" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" + { + "cell_type": "markdown", + "metadata": { + "id": "iEu2UBDEEVG4" + }, + "source": [ + "\n", + "\n", + "### 1.1. Prerequisites\n" + ] }, - "id": "1BEZPSNtGwzp", - "outputId": "0e0f193a-b652-4cfd-fada-1f6c7f941a96" - }, - "outputs": [], - "source": [ - "!pip install plotly" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" + { + "cell_type": "markdown", + "metadata": { + "id": "2mGZv-UxvKO_" + }, + "source": [ + "#### Computing Power\n", + "\n", + "This notebook is computationally intensive. We recommend using a platform with GPU support.\n", + "\n", + "We have run this notebook on Google Colab and on an Amazon EC2 p2.xlarge instance (an older generation of GPU-based instances).\n", + "\n", + "Please note that the results may not be reproducible across platforms and versions." + ] }, - "id": "ItEs2TIcR8fz", - "outputId": "08fe2b77-d4ba-4193-91ce-cd81a9b3d62e" - }, - "outputs": [], - "source": [ - "!pip install kaleido" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" + { + "cell_type": "markdown", + "metadata": { + "id": "qXPfoNIUIpuv" + }, + "source": [ + "#### Local files\n", + "Make sure the following files are available in the directory of the notebook:\n", + "* `tutorial_utils.py` - a collection of utility functions used throughout this notebook\n", + "* `peril.training.csv` - the training data\n", + "* `peril.validation.csv` - the validation data\n", + "\n", + "This notebook will create the following subdirectories:\n", + "* `models` - trained Transformer models\n", + "* `results` - figures and Excel files" + ] }, - "id": "iflvB6DtHIHj", - "outputId": "3476d786-2932-4412-cc46-630ddfad4e41" - }, - "outputs": [], - "source": [ - "!pip install pyyaml==5.4.1 ## https://github.com/yaml/pyyaml/issues/576" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" + { + "cell_type": "markdown", + "metadata": { + "id": "3ahENX7-EVG5" + }, + "source": [ + "#### Getting started with Python and Jupyter Notebook\n", + "\n", + "For this tutorial, we assume that you are already familiar with Python and Jupyter Notebook.\n", + "We also assume that you have worked through Part I of this tutorial.\n", + "\n", + "In this section, Jupyter Notebook and Python settings are initialized.\n", + "For code in Python, the [PEP8 standard](https://www.python.org/dev/peps/pep-0008/)\n", + "(\"PEP = Python Enhancement Proposal\") is enforced with minor variations to improve readability.\n" + ] }, - "id": "zt3VhIayHUvh", - "outputId": "09678be9-24b9-4e53-d160-ddc2b22e9809" - }, - "outputs": [], - "source": [ - "!pip install bertopic" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "7b2yEtZjEVG8" - }, - "source": [ - "and loaded:" - ] - }, - { - "cell_type": "code", - "execution_count": 2, - "metadata": { - "id": "LuwY5ubtEVG9", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [], - "source": [ - "import os\n", - "from collections import OrderedDict\n", - "import pandas as pd\n", - "import numpy as np\n", - "from scipy.special import softmax\n", - "from datasets import Dataset, DatasetDict\n", - "from transformers import AutoTokenizer, AutoModel, Trainer, TrainingArguments, trainer_utils, AutoModelForSequenceClassification\n", - "from transformers import pipeline\n", - "import torch\n", - "from sklearn.metrics import accuracy_score, f1_score\n", - "import plotly.express as px\n", - "from wordcloud import WordCloud\n", - "from bertopic import BERTopic\n", - "from umap import UMAP\n", - "from hdbscan import HDBSCAN\n", - "from tutorial_utils import extract_sequence_encoding, get_xy, dummy_classifier, logistic_regression_classifier, evaluate_classifier" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "44WiOM3SEVG-" - }, - "source": [ - "\n", - "\n", - "### 1.2. Loading the Data\n", - "\n", - "The dataset used throughout this tutorial concerns property insurance claims\n", - "of the Wisconsin Local Government Property Insurance Fund (LPGIF),\n", - "made available in the open text project of [Frees](https://ewfrees.github.io/Loss-Data-Analytics/).\n", - "The Wisconsin LGPIF is an insurance pool managed by the Wisconsin Office of the Insurance Commissioner.\n", - "This fund provides insurance protection to local governmental institutions such as counties, schools,\n", - "libraries, airports, etc.\n", - "It insures property claims at buildings and motor vehicles, and it excludes certain natural and man-made perils like\n", - "flood, earthquakes or nuclear accidents.\n", - "\n", - "The data consists of 6’030 records (4’991 in the training set, 1’039 in the test set)\n", - "which include a claim amount, a short English claim description and a hazard type with 9 different levels:\n", - "Fire, Lightning, Hail, Wind, WaterW (weather related water claims), WaterNW (other weather claims), Vehicle,\n", - "Vandalism and Misc (any other).\n", - "\n", - "The training and validation set are available in separate csv files, which we load into Pandas DataFrames,\n", - "create a single column containing the label, and finally create a `dataset`." - ] - }, - { - "cell_type": "code", - "execution_count": 3, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" + { + "cell_type": "code", + "execution_count": 1, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 17 + }, + "id": "1wK6e7a5EVG5", + "outputId": "c254f1de-a7fb-4412-f285-73dcf85eda4f", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "# Notebook settings\n", + "\n", + "# clear the namespace variables\n", + "from IPython import get_ipython\n", + "get_ipython().run_line_magic(\"reset\", \"-sf\")\n", + "\n", + "# formatting: cell width\n", + "from IPython.display import display, HTML\n", + "display(HTML(\"\"))" + ] }, - "id": "DogoPiqXEVG-", - "outputId": "997accba-fc26-4de7-f7d3-d7d582edd3b4", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "DatasetDict({\n", - " train: Dataset({\n", - " features: ['Vandalism', 'Fire', 'Lightning', 'Wind', 'Hail', 'Vehicle', 'WaterNW', 'WaterW', 'Misc', 'Loss', 'Description', 'labels'],\n", - " num_rows: 4991\n", - " })\n", - " test: Dataset({\n", - " features: ['Vandalism', 'Fire', 'Lightning', 'Wind', 'Hail', 'Vehicle', 'WaterNW', 'WaterW', 'Misc', 'Loss', 'Description', 'labels'],\n", - " num_rows: 1039\n", - " })\n", - "})\n" - ] - } - ], - "source": [ - "# load data\n", - "df_train = pd.read_csv(\"peril.training.csv\")\n", - "df_valid = pd.read_csv(\"peril.validation.csv\")\n", - "\n", - "# extract label texts and create column \"labels\" which encodes the peril\n", - "labels = df_train.columns[:9].to_list()\n", - "df_train[\"labels\"] = np.matmul(df_train.iloc[:, :9].values, np.array(range(9),).reshape((9,1)))\n", - "df_valid[\"labels\"] = np.matmul(df_valid.iloc[:, :9].values, np.array(range(9),).reshape((9,1)))\n", - "\n", - "# create dataset\n", - "ds = DatasetDict({\"train\": Dataset.from_pandas(df_train), \"test\": Dataset.from_pandas(df_valid)})\n", - "\n", - "print(f\"{ds}\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "ilcy8gKCEVG_" - }, - "source": [ - "\n", - "\n", - "### 1.3 Exploring the data\n", - "\n", - "The first records of the training dataset look like this:" - ] - }, - { - "cell_type": "code", - "execution_count": 4, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 + "cell_type": "markdown", + "metadata": { + "id": "5V9gFHqyEVG7" + }, + "source": [ + "#### Importing Required Libraries\n", + "\n", + "If you run this notebook on Google Colab, you will need to install the following libraries:" + ] }, - "id": "de1ksaP-EVG_", - "outputId": "539bbca5-c64d-47a7-cb02-57927c7a41fb", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
VandalismFireLightningWindHailVehicleWaterNWWaterWMiscLossDescriptionlabels
00010000006838.87lightning damage ...2
10010000002085.00lightning damage at Comm. Center ...2
200100000011335.00lightning damage at water tower ...2
30010000001480.00lightning damge to radio tower ...2
4100000000600.00vandalism damage at recycle center ...0
\n", - "
" + "cell_type": "code", + "execution_count": 2, + "metadata": { + "id": "Mxggg0WmFDuy", + "colab": { + "base_uri": "https://localhost:8080/" + }, + "outputId": "aa32bc1b-eee6-4e61-db0a-1766f975ef36" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Collecting datasets\n", + " Downloading datasets-2.14.4-py3-none-any.whl (519 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m519.3/519.3 kB\u001b[0m \u001b[31m7.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.10/dist-packages (from datasets) (1.23.5)\n", + "Requirement already satisfied: pyarrow>=8.0.0 in /usr/local/lib/python3.10/dist-packages (from datasets) (9.0.0)\n", + "Collecting dill<0.3.8,>=0.3.0 (from datasets)\n", + " Downloading dill-0.3.7-py3-none-any.whl (115 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m115.3/115.3 kB\u001b[0m \u001b[31m8.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: pandas in /usr/local/lib/python3.10/dist-packages (from datasets) (1.5.3)\n", + "Requirement already satisfied: requests>=2.19.0 in /usr/local/lib/python3.10/dist-packages (from datasets) (2.31.0)\n", + "Requirement already satisfied: tqdm>=4.62.1 in /usr/local/lib/python3.10/dist-packages (from datasets) (4.66.1)\n", + "Collecting xxhash (from datasets)\n", + " Downloading xxhash-3.3.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (194 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m194.1/194.1 kB\u001b[0m \u001b[31m10.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hCollecting multiprocess (from datasets)\n", + " Downloading multiprocess-0.70.15-py310-none-any.whl (134 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m134.8/134.8 kB\u001b[0m \u001b[31m11.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: fsspec[http]>=2021.11.1 in /usr/local/lib/python3.10/dist-packages (from datasets) (2023.6.0)\n", + "Requirement already satisfied: aiohttp in /usr/local/lib/python3.10/dist-packages (from datasets) (3.8.5)\n", + "Collecting huggingface-hub<1.0.0,>=0.14.0 (from datasets)\n", + " Downloading huggingface_hub-0.16.4-py3-none-any.whl (268 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m268.8/268.8 kB\u001b[0m \u001b[31m11.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from datasets) (23.1)\n", + "Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from datasets) (6.0.1)\n", + "Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (23.1.0)\n", + "Requirement already satisfied: charset-normalizer<4.0,>=2.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (3.2.0)\n", + "Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (6.0.4)\n", + "Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (4.0.3)\n", + "Requirement already satisfied: yarl<2.0,>=1.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (1.9.2)\n", + "Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (1.4.0)\n", + "Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (1.3.1)\n", + "Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0.0,>=0.14.0->datasets) (3.12.2)\n", + "Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0.0,>=0.14.0->datasets) (4.7.1)\n", + "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests>=2.19.0->datasets) (3.4)\n", + "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests>=2.19.0->datasets) (2.0.4)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests>=2.19.0->datasets) (2023.7.22)\n", + "Requirement already satisfied: python-dateutil>=2.8.1 in /usr/local/lib/python3.10/dist-packages (from pandas->datasets) (2.8.2)\n", + "Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas->datasets) (2023.3)\n", + "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil>=2.8.1->pandas->datasets) (1.16.0)\n", + "Installing collected packages: xxhash, dill, multiprocess, huggingface-hub, datasets\n", + "Successfully installed datasets-2.14.4 dill-0.3.7 huggingface-hub-0.16.4 multiprocess-0.70.15 xxhash-3.3.0\n" + ] + } ], - "text/plain": [ - " Vandalism Fire Lightning Wind Hail Vehicle WaterNW WaterW Misc \\\n", - "0 0 0 1 0 0 0 0 0 0 \n", - "1 0 0 1 0 0 0 0 0 0 \n", - "2 0 0 1 0 0 0 0 0 0 \n", - "3 0 0 1 0 0 0 0 0 0 \n", - "4 1 0 0 0 0 0 0 0 0 \n", - "\n", - " Loss Description labels \n", - "0 6838.87 lightning damage ... 2 \n", - "1 2085.00 lightning damage at Comm. Center ... 2 \n", - "2 11335.00 lightning damage at water tower ... 2 \n", - "3 1480.00 lightning damge to radio tower ... 2 \n", - "4 600.00 vandalism damage at recycle center ... 0 " + "source": [ + "!pip install datasets" ] - }, - "execution_count": 4, - "metadata": {}, - "output_type": "execute_result" - } - ], - "source": [ - "df_train.head()" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Axos90P1EVG_" - }, - "source": [ - "Let's look at the distribution of peril types in the training and validation set:" - ] - }, - { - "cell_type": "code", - "execution_count": 5, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 }, - "id": "WwAKZ-KYEVHA", - "outputId": "fba350dd-8c84-4324-bce9-b75a05ef6d4c", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
periltrainvalid
0Vandalism1774310
1Fire17146
2Lightning832123
3Wind296107
4Hail7618
5Vehicle852227
6WaterNW20267
7WaterW42638
8Misc362103
9Total49911039
\n", - "
" + "cell_type": "code", + "execution_count": 3, + "metadata": { + "id": "lSUQsZPlFeBu", + "colab": { + "base_uri": "https://localhost:8080/" + }, + "outputId": "5b259df6-c0a7-42b1-9da2-c8ae97386690" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Collecting transformers[torch]\n", + " Downloading transformers-4.32.1-py3-none-any.whl (7.5 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m7.5/7.5 MB\u001b[0m \u001b[31m20.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (3.12.2)\n", + "Requirement already satisfied: huggingface-hub<1.0,>=0.15.1 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (0.16.4)\n", + "Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (1.23.5)\n", + "Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (23.1)\n", + "Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (6.0.1)\n", + "Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (2023.6.3)\n", + "Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (2.31.0)\n", + "Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers[torch])\n", + " Downloading tokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m7.8/7.8 MB\u001b[0m \u001b[31m64.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hCollecting safetensors>=0.3.1 (from transformers[torch])\n", + " Downloading safetensors-0.3.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.3/1.3 MB\u001b[0m \u001b[31m71.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (4.66.1)\n", + "Requirement already satisfied: torch!=1.12.0,>=1.9 in /usr/local/lib/python3.10/dist-packages (from transformers[torch]) (2.0.1+cu118)\n", + "Collecting accelerate>=0.20.3 (from transformers[torch])\n", + " Downloading accelerate-0.22.0-py3-none-any.whl (251 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m251.2/251.2 kB\u001b[0m \u001b[31m32.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: psutil in /usr/local/lib/python3.10/dist-packages (from accelerate>=0.20.3->transformers[torch]) (5.9.5)\n", + "Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.15.1->transformers[torch]) (2023.6.0)\n", + "Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.15.1->transformers[torch]) (4.7.1)\n", + "Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from torch!=1.12.0,>=1.9->transformers[torch]) (1.12)\n", + "Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch!=1.12.0,>=1.9->transformers[torch]) (3.1)\n", + "Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch!=1.12.0,>=1.9->transformers[torch]) (3.1.2)\n", + "Requirement already satisfied: triton==2.0.0 in /usr/local/lib/python3.10/dist-packages (from torch!=1.12.0,>=1.9->transformers[torch]) (2.0.0)\n", + "Requirement already satisfied: cmake in /usr/local/lib/python3.10/dist-packages (from triton==2.0.0->torch!=1.12.0,>=1.9->transformers[torch]) (3.27.2)\n", + "Requirement already satisfied: lit in /usr/local/lib/python3.10/dist-packages (from triton==2.0.0->torch!=1.12.0,>=1.9->transformers[torch]) (16.0.6)\n", + "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->transformers[torch]) (3.2.0)\n", + "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->transformers[torch]) (3.4)\n", + "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->transformers[torch]) (2.0.4)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->transformers[torch]) (2023.7.22)\n", + "Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch!=1.12.0,>=1.9->transformers[torch]) (2.1.3)\n", + "Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy->torch!=1.12.0,>=1.9->transformers[torch]) (1.3.0)\n", + "Installing collected packages: tokenizers, safetensors, transformers, accelerate\n", + "Successfully installed accelerate-0.22.0 safetensors-0.3.3 tokenizers-0.13.3 transformers-4.32.1\n" + ] + } ], - "text/plain": [ - " peril train valid\n", - "0 Vandalism 1774 310\n", - "1 Fire 171 46\n", - "2 Lightning 832 123\n", - "3 Wind 296 107\n", - "4 Hail 76 18\n", - "5 Vehicle 852 227\n", - "6 WaterNW 202 67\n", - "7 WaterW 426 38\n", - "8 Misc 362 103\n", - "9 Total 4991 1039" + "source": [ + "!pip install transformers[torch]" ] - }, - "execution_count": 5, - "metadata": {}, - "output_type": "execute_result" - } - ], - "source": [ - "stats = pd.DataFrame({\n", - " \"peril\": df_train.columns.values[:-3],\n", - " \"train\": df_train.groupby(\"labels\")[\"labels\"].count().values,\n", - " \"valid\": df_valid.groupby(\"labels\")[\"labels\"].count().values\n", - "})\n", - "summary = pd.DataFrame({\"peril\": [\"Total\"], \"train\": [stats[\"train\"].sum()], \"valid\": [stats[\"valid\"].sum()]})\n", - "stats = pd.concat([stats, summary], ignore_index=True)\n", - "stats" - ] - }, - { - "cell_type": "code", - "execution_count": 6, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 }, - "id": "FKfk4QAoEVHA", - "outputId": "413a754f-0ae9-4040-df0d-2affba6f66f6", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "text/html": [ - " \n", - " " + "cell_type": "code", + "execution_count": 4, + "metadata": { + "id": "1BEZPSNtGwzp", + "colab": { + "base_uri": "https://localhost:8080/" + }, + "outputId": "1297dc6e-751c-4562-c3be-cf1ad66fe3eb" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Requirement already satisfied: plotly in /usr/local/lib/python3.10/dist-packages (5.15.0)\n", + "Requirement already satisfied: tenacity>=6.2.0 in /usr/local/lib/python3.10/dist-packages (from plotly) (8.2.3)\n", + "Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from plotly) (23.1)\n" + ] + } + ], + "source": [ + "!pip install plotly" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "peril_type", - "format": "svg" + "cell_type": "code", + "execution_count": 5, + "metadata": { + "id": "ItEs2TIcR8fz", + "colab": { + "base_uri": "https://localhost:8080/" + }, + "outputId": "e54eac1b-46b8-4a70-c21d-d34a95d835b3" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Collecting kaleido\n", + " Downloading kaleido-0.2.1-py2.py3-none-manylinux1_x86_64.whl (79.9 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m79.9/79.9 MB\u001b[0m \u001b[31m8.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hInstalling collected packages: kaleido\n", + "Successfully installed kaleido-0.2.1\n" + ] } - }, - "data": [ + ], + "source": [ + "!pip install kaleido" + ] + }, + { + "cell_type": "code", + "execution_count": 6, + "metadata": { + "id": "zt3VhIayHUvh", + "colab": { + "base_uri": "https://localhost:8080/" + }, + "outputId": "7cc81188-4819-4fe3-c2ba-02a5e8150791" + }, + "outputs": [ { - "alignmentgroup": "True", - "hovertemplate": "variable=labels
index=%{x}
value=%{y}", - "legendgroup": "labels", - "marker": { - "color": "#636efa", - "pattern": { - "shape": "" - } - }, - "name": "labels", - "offsetgroup": "labels", - "orientation": "v", - "showlegend": true, - "textposition": "auto", - "type": "bar", - "x": [ - 0, - 1, - 2, - 3, - 4, - 5, - 6, - 7, - 8 - ], - "xaxis": "x", - "y": [ - 2084, - 217, - 955, - 403, - 94, - 1079, - 269, - 464, - 465 - ], - "yaxis": "y" + "output_type": "stream", + "name": "stdout", + "text": [ + "Collecting bertopic\n", + " Downloading bertopic-0.15.0-py2.py3-none-any.whl (143 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m143.4/143.4 kB\u001b[0m \u001b[31m2.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: numpy>=1.20.0 in /usr/local/lib/python3.10/dist-packages (from bertopic) (1.23.5)\n", + "Collecting hdbscan>=0.8.29 (from bertopic)\n", + " Downloading hdbscan-0.8.33.tar.gz (5.2 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m5.2/5.2 MB\u001b[0m \u001b[31m16.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25h Installing build dependencies ... \u001b[?25l\u001b[?25hdone\n", + " Getting requirements to build wheel ... \u001b[?25l\u001b[?25hdone\n", + " Preparing metadata (pyproject.toml) ... \u001b[?25l\u001b[?25hdone\n", + "Collecting umap-learn>=0.5.0 (from bertopic)\n", + " Downloading umap-learn-0.5.3.tar.gz (88 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m88.2/88.2 kB\u001b[0m \u001b[31m10.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25h Preparing metadata (setup.py) ... \u001b[?25l\u001b[?25hdone\n", + "Requirement already satisfied: pandas>=1.1.5 in /usr/local/lib/python3.10/dist-packages (from bertopic) (1.5.3)\n", + "Requirement already satisfied: scikit-learn>=0.22.2.post1 in /usr/local/lib/python3.10/dist-packages (from bertopic) (1.2.2)\n", + "Requirement already satisfied: tqdm>=4.41.1 in /usr/local/lib/python3.10/dist-packages (from bertopic) (4.66.1)\n", + "Collecting sentence-transformers>=0.4.1 (from bertopic)\n", + " Downloading sentence-transformers-2.2.2.tar.gz (85 kB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m86.0/86.0 kB\u001b[0m \u001b[31m11.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25h Preparing metadata (setup.py) ... \u001b[?25l\u001b[?25hdone\n", + "Requirement already satisfied: plotly>=4.7.0 in /usr/local/lib/python3.10/dist-packages (from bertopic) (5.15.0)\n", + "Requirement already satisfied: cython<3,>=0.27 in /usr/local/lib/python3.10/dist-packages (from hdbscan>=0.8.29->bertopic) (0.29.36)\n", + "Requirement already satisfied: scipy>=1.0 in /usr/local/lib/python3.10/dist-packages (from hdbscan>=0.8.29->bertopic) (1.10.1)\n", + "Requirement already satisfied: joblib>=1.0 in /usr/local/lib/python3.10/dist-packages (from hdbscan>=0.8.29->bertopic) (1.3.2)\n", + "Requirement already satisfied: python-dateutil>=2.8.1 in /usr/local/lib/python3.10/dist-packages (from pandas>=1.1.5->bertopic) (2.8.2)\n", + "Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas>=1.1.5->bertopic) (2023.3)\n", + "Requirement already satisfied: tenacity>=6.2.0 in /usr/local/lib/python3.10/dist-packages (from plotly>=4.7.0->bertopic) (8.2.3)\n", + "Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from plotly>=4.7.0->bertopic) (23.1)\n", + "Requirement already satisfied: threadpoolctl>=2.0.0 in /usr/local/lib/python3.10/dist-packages (from scikit-learn>=0.22.2.post1->bertopic) (3.2.0)\n", + "Requirement already satisfied: transformers<5.0.0,>=4.6.0 in /usr/local/lib/python3.10/dist-packages (from sentence-transformers>=0.4.1->bertopic) (4.32.1)\n", + "Requirement already satisfied: torch>=1.6.0 in /usr/local/lib/python3.10/dist-packages (from sentence-transformers>=0.4.1->bertopic) (2.0.1+cu118)\n", + "Requirement already satisfied: torchvision in /usr/local/lib/python3.10/dist-packages (from sentence-transformers>=0.4.1->bertopic) (0.15.2+cu118)\n", + "Requirement already satisfied: nltk in /usr/local/lib/python3.10/dist-packages (from sentence-transformers>=0.4.1->bertopic) (3.8.1)\n", + "Collecting sentencepiece (from sentence-transformers>=0.4.1->bertopic)\n", + " Downloading sentencepiece-0.1.99-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.3/1.3 MB\u001b[0m \u001b[31m24.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25hRequirement already satisfied: huggingface-hub>=0.4.0 in /usr/local/lib/python3.10/dist-packages (from sentence-transformers>=0.4.1->bertopic) (0.16.4)\n", + "Requirement already satisfied: numba>=0.49 in /usr/local/lib/python3.10/dist-packages (from umap-learn>=0.5.0->bertopic) (0.56.4)\n", + "Collecting pynndescent>=0.5 (from umap-learn>=0.5.0->bertopic)\n", + " Downloading pynndescent-0.5.10.tar.gz (1.1 MB)\n", + "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.1/1.1 MB\u001b[0m \u001b[31m32.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", + "\u001b[?25h Preparing metadata (setup.py) ... \u001b[?25l\u001b[?25hdone\n", + "Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.4.0->sentence-transformers>=0.4.1->bertopic) (3.12.2)\n", + "Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.4.0->sentence-transformers>=0.4.1->bertopic) (2023.6.0)\n", + "Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.4.0->sentence-transformers>=0.4.1->bertopic) (2.31.0)\n", + "Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.4.0->sentence-transformers>=0.4.1->bertopic) (6.0.1)\n", + "Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.4.0->sentence-transformers>=0.4.1->bertopic) (4.7.1)\n", + "Requirement already satisfied: llvmlite<0.40,>=0.39.0dev0 in /usr/local/lib/python3.10/dist-packages (from numba>=0.49->umap-learn>=0.5.0->bertopic) (0.39.1)\n", + "Requirement already satisfied: setuptools in /usr/local/lib/python3.10/dist-packages (from numba>=0.49->umap-learn>=0.5.0->bertopic) (67.7.2)\n", + "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil>=2.8.1->pandas>=1.1.5->bertopic) (1.16.0)\n", + "Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from torch>=1.6.0->sentence-transformers>=0.4.1->bertopic) (1.12)\n", + "Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch>=1.6.0->sentence-transformers>=0.4.1->bertopic) (3.1)\n", + "Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch>=1.6.0->sentence-transformers>=0.4.1->bertopic) (3.1.2)\n", + "Requirement already satisfied: triton==2.0.0 in /usr/local/lib/python3.10/dist-packages (from torch>=1.6.0->sentence-transformers>=0.4.1->bertopic) (2.0.0)\n", + "Requirement already satisfied: cmake in /usr/local/lib/python3.10/dist-packages (from triton==2.0.0->torch>=1.6.0->sentence-transformers>=0.4.1->bertopic) (3.27.2)\n", + "Requirement already satisfied: lit in /usr/local/lib/python3.10/dist-packages (from triton==2.0.0->torch>=1.6.0->sentence-transformers>=0.4.1->bertopic) (16.0.6)\n", + "Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers>=0.4.1->bertopic) (2023.6.3)\n", + "Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /usr/local/lib/python3.10/dist-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers>=0.4.1->bertopic) (0.13.3)\n", + "Requirement already satisfied: safetensors>=0.3.1 in /usr/local/lib/python3.10/dist-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers>=0.4.1->bertopic) (0.3.3)\n", + "Requirement already satisfied: click in /usr/local/lib/python3.10/dist-packages (from nltk->sentence-transformers>=0.4.1->bertopic) (8.1.7)\n", + "Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /usr/local/lib/python3.10/dist-packages (from torchvision->sentence-transformers>=0.4.1->bertopic) (9.4.0)\n", + "Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch>=1.6.0->sentence-transformers>=0.4.1->bertopic) (2.1.3)\n", + "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers>=0.4.1->bertopic) (3.2.0)\n", + "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers>=0.4.1->bertopic) (3.4)\n", + "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers>=0.4.1->bertopic) (2.0.4)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers>=0.4.1->bertopic) (2023.7.22)\n", + "Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy->torch>=1.6.0->sentence-transformers>=0.4.1->bertopic) (1.3.0)\n", + "Building wheels for collected packages: hdbscan, sentence-transformers, umap-learn, pynndescent\n", + " Building wheel for hdbscan (pyproject.toml) ... \u001b[?25l\u001b[?25hdone\n", + " Created wheel for hdbscan: filename=hdbscan-0.8.33-cp310-cp310-linux_x86_64.whl size=3039170 sha256=67ee3feb90bd27f3b3c604d9650215ee7bdbeb9d8a249c01ad432923ded042ba\n", + " Stored in directory: /root/.cache/pip/wheels/75/0b/3b/dc4f60b7cc455efaefb62883a7483e76f09d06ca81cf87d610\n", + " Building wheel for sentence-transformers (setup.py) ... \u001b[?25l\u001b[?25hdone\n", + " Created wheel for sentence-transformers: filename=sentence_transformers-2.2.2-py3-none-any.whl size=125923 sha256=6961625364758df913080d6b755f1910f2f5ef5db2d3b0f2632d70129c837329\n", + " Stored in directory: /root/.cache/pip/wheels/62/f2/10/1e606fd5f02395388f74e7462910fe851042f97238cbbd902f\n", + " Building wheel for umap-learn (setup.py) ... \u001b[?25l\u001b[?25hdone\n", + " Created wheel for umap-learn: filename=umap_learn-0.5.3-py3-none-any.whl size=82807 sha256=fa472aac87894c334dd21acc472eee753aeb2f4269a0576cafccdd63b7169f80\n", + " Stored in directory: /root/.cache/pip/wheels/a0/e8/c6/a37ea663620bd5200ea1ba0907ab3c217042c1d035ef606acc\n", + " Building wheel for pynndescent (setup.py) ... \u001b[?25l\u001b[?25hdone\n", + " Created wheel for pynndescent: filename=pynndescent-0.5.10-py3-none-any.whl size=55615 sha256=08fac3e6109a62dae1e2a144317f48eaadb79c7baedb4850bf8eae890b5b9c8e\n", + " Stored in directory: /root/.cache/pip/wheels/4a/38/5d/f60a40a66a9512b7e5e83517ebc2d1b42d857be97d135f1096\n", + "Successfully built hdbscan sentence-transformers umap-learn pynndescent\n", + "Installing collected packages: sentencepiece, pynndescent, hdbscan, umap-learn, sentence-transformers, bertopic\n", + "Successfully installed bertopic-0.15.0 hdbscan-0.8.33 pynndescent-0.5.10 sentence-transformers-2.2.2 sentencepiece-0.1.99 umap-learn-0.5.3\n" + ] } - ], - "layout": { - "barmode": "relative", - "legend": { - "title": { - "text": "variable" - }, - "tracegroupgap": 0 - }, - "margin": { - "t": 60 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } + ], + "source": [ + "!pip install bertopic" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "7b2yEtZjEVG8" + }, + "source": [ + "and loaded:" + ] + }, + { + "cell_type": "code", + "execution_count": 7, + "metadata": { + "id": "LuwY5ubtEVG9", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [], + "source": [ + "import os\n", + "from collections import OrderedDict\n", + "import pandas as pd\n", + "import numpy as np\n", + "from scipy.special import softmax\n", + "from datasets import Dataset, DatasetDict\n", + "from transformers import AutoTokenizer, AutoModel, Trainer, TrainingArguments, trainer_utils, AutoModelForSequenceClassification\n", + "from transformers import pipeline\n", + "import torch\n", + "from sklearn.metrics import accuracy_score, f1_score\n", + "import plotly.express as px\n", + "from wordcloud import WordCloud\n", + "from bertopic import BERTopic\n", + "from umap import UMAP\n", + "from hdbscan import HDBSCAN\n", + "from tutorial_utils import extract_sequence_encoding, get_xy, dummy_classifier, logistic_regression_classifier, evaluate_classifier" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "44WiOM3SEVG-" + }, + "source": [ + "\n", + "\n", + "### 1.2. Loading the Data\n", + "\n", + "The dataset used throughout this tutorial concerns property insurance claims\n", + "of the Wisconsin Local Government Property Insurance Fund (LPGIF),\n", + "made available in the open text project of [Frees](https://ewfrees.github.io/Loss-Data-Analytics/).\n", + "The Wisconsin LGPIF is an insurance pool managed by the Wisconsin Office of the Insurance Commissioner.\n", + "This fund provides insurance protection to local governmental institutions such as counties, schools,\n", + "libraries, airports, etc.\n", + "It insures property claims at buildings and motor vehicles, and it excludes certain natural and man-made perils like\n", + "flood, earthquakes or nuclear accidents.\n", + "\n", + "The data consists of 6’030 records (4’991 in the training set, 1’039 in the test set)\n", + "which include a claim amount, a short English claim description and a hazard type with 9 different levels:\n", + "Fire, Lightning, Hail, Wind, WaterW (weather related water claims), WaterNW (other weather claims), Vehicle,\n", + "Vandalism and Misc (any other).\n", + "\n", + "The training and validation set are available in separate csv files, which we load into Pandas DataFrames,\n", + "create a single column containing the label, and finally create a `dataset`." + ] + }, + { + "cell_type": "code", + "execution_count": 8, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "DogoPiqXEVG-", + "outputId": "3b6c80aa-d921-4d84-be97-d9f0659c7c72", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "DatasetDict({\n", + " train: Dataset({\n", + " features: ['Vandalism', 'Fire', 'Lightning', 'Wind', 'Hail', 'Vehicle', 'WaterNW', 'WaterW', 'Misc', 'Loss', 'Description', 'labels'],\n", + " num_rows: 4991\n", + " })\n", + " test: Dataset({\n", + " features: ['Vandalism', 'Fire', 'Lightning', 'Wind', 'Hail', 'Vehicle', 'WaterNW', 'WaterW', 'Misc', 'Loss', 'Description', 'labels'],\n", + " num_rows: 1039\n", + " })\n", + "})\n" ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + } + ], + "source": [ + "# load data\n", + "df_train = pd.read_csv(\"peril.training.csv\")\n", + "df_valid = pd.read_csv(\"peril.validation.csv\")\n", + "\n", + "# extract label texts and create column \"labels\" which encodes the peril\n", + "labels = df_train.columns[:9].to_list()\n", + "df_train[\"labels\"] = np.matmul(df_train.iloc[:, :9].values, np.array(range(9),).reshape((9,1)))\n", + "df_valid[\"labels\"] = np.matmul(df_valid.iloc[:, :9].values, np.array(range(9),).reshape((9,1)))\n", + "\n", + "# create dataset\n", + "ds = DatasetDict({\"train\": Dataset.from_pandas(df_train), \"test\": Dataset.from_pandas(df_valid)})\n", + "\n", + "print(f\"{ds}\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "ilcy8gKCEVG_" + }, + "source": [ + "\n", + "\n", + "### 1.3 Exploring the data\n", + "\n", + "The first records of the training dataset look like this:" + ] + }, + { + "cell_type": "code", + "execution_count": 9, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 206 + }, + "id": "de1ksaP-EVG_", + "outputId": "1a3a8647-f2b5-4fa7-c4de-07ba5de39dd3", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "execute_result", + "data": { + "text/plain": [ + " Vandalism Fire Lightning Wind Hail Vehicle WaterNW WaterW Misc \\\n", + "0 0 0 1 0 0 0 0 0 0 \n", + "1 0 0 1 0 0 0 0 0 0 \n", + "2 0 0 1 0 0 0 0 0 0 \n", + "3 0 0 1 0 0 0 0 0 0 \n", + "4 1 0 0 0 0 0 0 0 0 \n", + "\n", + " Loss Description labels \n", + "0 6838.87 lightning damage ... 2 \n", + "1 2085.00 lightning damage at Comm. Center ... 2 \n", + "2 11335.00 lightning damage at water tower ... 2 \n", + "3 1480.00 lightning damge to radio tower ... 2 \n", + "4 600.00 vandalism damage at recycle center ... 0 " + ], + "text/html": [ + "\n", + "
\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
VandalismFireLightningWindHailVehicleWaterNWWaterWMiscLossDescriptionlabels
00010000006838.87lightning damage ...2
10010000002085.00lightning damage at Comm. Center ...2
200100000011335.00lightning damage at water tower ...2
30010000001480.00lightning damge to radio tower ...2
4100000000600.00vandalism damage at recycle center ...0
\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + "
\n" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 + "metadata": {}, + "execution_count": 9 + } + ], + "source": [ + "df_train.head()" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "Axos90P1EVG_" + }, + "source": [ + "Let's look at the distribution of peril types in the training and validation set:" + ] + }, + { + "cell_type": "code", + "execution_count": 10, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 363 + }, + "id": "WwAKZ-KYEVHA", + "outputId": "88ac986d-2f92-4f2d-b2e0-135fad450cf2", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "execute_result", + "data": { + "text/plain": [ + " peril train valid\n", + "0 Vandalism 1774 310\n", + "1 Fire 171 46\n", + "2 Lightning 832 123\n", + "3 Wind 296 107\n", + "4 Hail 76 18\n", + "5 Vehicle 852 227\n", + "6 WaterNW 202 67\n", + "7 WaterW 426 38\n", + "8 Misc 362 103\n", + "9 Total 4991 1039" + ], + "text/html": [ + "\n", + "
\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
periltrainvalid
0Vandalism1774310
1Fire17146
2Lightning832123
3Wind296107
4Hail7618
5Vehicle852227
6WaterNW20267
7WaterW42638
8Misc362103
9Total49911039
\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + "
\n" + ] }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "number of claims by peril type" - }, - "width": 640, - "xaxis": { - "anchor": "y", - "domain": [ - 0, - 1 - ], - "title": { - "text": "peril type" - } - }, - "yaxis": { - "anchor": "x", - "domain": [ - 0, - 1 - ], - "title": { - "text": "number of claims" - } + "metadata": {}, + "execution_count": 10 + } + ], + "source": [ + "stats = pd.DataFrame({\n", + " \"peril\": df_train.columns.values[:-3],\n", + " \"train\": df_train.groupby(\"labels\")[\"labels\"].count().values,\n", + " \"valid\": df_valid.groupby(\"labels\")[\"labels\"].count().values\n", + "})\n", + "summary = pd.DataFrame({\"peril\": [\"Total\"], \"train\": [stats[\"train\"].sum()], \"valid\": [stats[\"valid\"].sum()]})\n", + "stats = pd.concat([stats, summary], ignore_index=True)\n", + "stats" + ] + }, + { + "cell_type": "code", + "execution_count": 11, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 542 + }, + "id": "FKfk4QAoEVHA", + "outputId": "7d060915-3a5c-4ffe-f999-5178955afac0", + "pycharm": { + "name": "#%%\n" } - } }, - "text/html": [ - "
" + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "fig = px.bar(df_train[\"labels\"].value_counts().sort_index()+df_valid[\"labels\"].value_counts().sort_index(), width=640)\n", + "fig.update_layout(title=\"number of claims by peril type\", xaxis_title=\"peril type\",\n", + " yaxis_title=\"number of claims\")\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"peril_type\"}})" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "fig = px.bar(df_train[\"labels\"].value_counts().sort_index()+df_valid[\"labels\"].value_counts().sort_index(), width=640)\n", - "fig.update_layout(title=\"number of claims by peril type\", xaxis_title=\"peril type\",\n", - " yaxis_title=\"number of claims\")\n", - "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"peril_type\"}})" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "rrxncDLlEVHA" - }, - "source": [ - "Next, we want to see some statistics on the length of the claim descriptions.\n", - "To this end, we split the texts into words, with blank spaces as separator.\n", - "The text length averages to 5 words and does not seem to vary significantly by peril:" - ] - }, - { - "cell_type": "code", - "execution_count": 7, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 }, - "id": "emd-I7T5EVHB", - "outputId": "5f169d71-129b-43ad-ae8a-2f3aa59ee0bf", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "Overall number of words by claim description: min 1, average 5, max 11\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "rrxncDLlEVHA" + }, + "source": [ + "Next, we want to see some statistics on the length of the claim descriptions.\n", + "To this end, we split the texts into words, with blank spaces as separator.\n", + "The text length averages to 5 words and does not seem to vary significantly by peril:" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "peril_len", - "format": "svg" + "cell_type": "code", + "execution_count": 12, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 559 + }, + "id": "emd-I7T5EVHB", + "outputId": "3fe0942c-18ca-4024-c7eb-5c799d1f1009", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "alignmentgroup": "True", - "hovertemplate": "labels=%{x}
words per description=%{y}", - "legendgroup": "", - "marker": { - "color": "#636efa" - }, - "name": "", - "notched": false, - "offsetgroup": "", - "orientation": "v", - "showlegend": false, - "type": "box", - "x": [ - 2, - 2, - 2, - 2, - 0, - 0, - 3, - 2, - 5, - 8, - 7, - 2, - 8, - 2, - 3, - 5, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 5, - 7, - 5, - 2, - 5, - 6, - 0, - 0, - 8, - 2, - 3, - 6, - 5, - 0, - 8, - 2, - 6, - 7, - 7, - 0, - 6, - 0, - 5, - 0, - 0, - 7, - 0, - 7, - 2, - 2, - 6, - 3, - 7, - 5, - 2, - 6, - 2, - 5, - 7, - 8, - 0, - 8, - 5, - 5, - 6, - 5, - 7, - 2, - 3, - 5, - 5, - 5, - 3, - 3, - 2, - 7, - 3, - 0, - 8, - 7, - 5, - 5, - 5, - 5, - 2, - 2, - 0, - 6, - 2, - 2, - 2, - 5, - 6, - 0, - 0, - 0, - 8, - 0, - 2, - 7, - 0, - 8, - 3, - 3, - 3, - 2, - 5, - 1, - 7, - 3, - 2, - 2, - 2, - 7, - 0, - 3, - 8, - 2, - 2, - 2, - 8, - 2, - 8, - 5, - 3, - 5, - 7, - 2, - 5, - 8, - 5, - 8, - 7, - 7, - 3, - 3, - 0, - 6, - 5, - 2, - 2, - 7, - 2, - 2, - 5, - 5, - 5, - 8, - 5, - 3, - 3, - 2, - 2, - 0, - 8, - 0, - 8, - 5, - 0, - 0, - 3, - 0, - 3, - 4, - 0, - 0, - 0, - 0, - 5, - 5, - 0, - 0, - 0, - 5, - 5, - 2, - 1, - 2, - 1, - 6, - 2, - 0, - 2, - 7, - 7, - 2, - 0, - 2, - 2, - 3, - 7, - 2, - 2, - 2, - 2, - 2, - 2, - 8, - 5, - 0, - 2, - 1, - 4, - 5, - 2, - 8, - 2, - 0, - 5, - 6, - 5, - 8, - 5, - 2, - 2, - 3, - 8, - 5, - 5, - 5, - 2, - 8, - 2, - 2, - 7, - 5, - 2, - 8, - 7, - 8, - 1, - 6, - 7, - 0, - 7, - 7, - 0, - 7, - 0, - 0, - 7, - 0, - 2, - 0, - 0, - 6, - 0, - 0, - 3, - 0, - 0, - 0, - 3, - 0, - 8, - 6, - 7, - 7, - 3, - 8, - 7, - 2, - 0, - 0, - 0, - 3, - 0, - 0, - 0, - 7, - 0, - 2, - 8, - 6, - 0, - 0, - 7, - 0, - 0, - 1, - 0, - 0, - 2, - 5, - 7, - 6, - 0, - 0, - 6, - 0, - 0, - 7, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 1, - 0, - 0, - 5, - 0, - 5, - 0, - 3, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 8, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 1, - 0, - 0, - 0, - 1, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 8, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 8, - 0, - 0, - 0, - 7, - 0, - 0, - 7, - 6, - 0, - 0, - 7, - 0, - 5, - 0, - 0, - 0, - 0, - 7, - 0, - 5, - 0, - 5, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 5, - 1, - 0, - 0, - 7, - 0, - 2, - 0, - 0, - 0, - 0, - 2, - 5, - 0, - 0, - 0, - 6, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 1, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 6, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 1, - 7, - 0, - 0, - 5, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 7, - 0, - 0, - 2, - 0, - 0, - 0, - 0, - 7, - 0, - 3, - 0, - 0, - 7, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 3, - 2, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 2, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 2, - 0, - 0, - 0, - 0, - 1, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 3, - 0, - 7, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 6, - 0, - 0, - 2, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 8, - 3, - 0, - 6, - 2, - 8, - 2, - 2, - 8, - 7, - 1, - 2, - 3, - 6, - 2, - 8, - 3, - 8, - 7, - 7, - 3, - 7, - 8, - 2, - 5, - 2, - 6, - 2, - 7, - 7, - 8, - 2, - 7, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 3, - 8, - 3, - 5, - 2, - 2, - 3, - 1, - 8, - 3, - 2, - 2, - 7, - 4, - 2, - 2, - 8, - 8, - 8, - 8, - 5, - 5, - 2, - 2, - 1, - 1, - 5, - 0, - 3, - 6, - 7, - 3, - 2, - 5, - 0, - 5, - 5, - 5, - 2, - 2, - 1, - 0, - 2, - 2, - 5, - 2, - 2, - 3, - 2, - 2, - 6, - 2, - 5, - 5, - 7, - 5, - 7, - 7, - 5, - 0, - 7, - 3, - 5, - 3, - 3, - 2, - 8, - 8, - 1, - 5, - 5, - 5, - 5, - 5, - 5, - 1, - 2, - 3, - 2, - 2, - 3, - 8, - 5, - 2, - 8, - 5, - 5, - 2, - 2, - 5, - 2, - 5, - 2, - 2, - 2, - 7, - 7, - 5, - 2, - 2, - 3, - 2, - 7, - 7, - 0, - 0, - 2, - 2, - 8, - 2, - 0, - 2, - 2, - 2, - 0, - 3, - 2, - 2, - 3, - 2, - 0, - 6, - 6, - 5, - 8, - 2, - 0, - 0, - 0, - 7, - 5, - 0, - 0, - 8, - 5, - 5, - 6, - 5, - 2, - 0, - 2, - 7, - 3, - 0, - 8, - 3, - 3, - 2, - 3, - 2, - 0, - 2, - 2, - 2, - 8, - 7, - 2, - 7, - 2, - 2, - 0, - 2, - 2, - 2, - 2, - 4, - 5, - 0, - 0, - 8, - 2, - 0, - 0, - 0, - 8, - 2, - 2, - 0, - 2, - 3, - 1, - 2, - 6, - 7, - 8, - 7, - 2, - 6, - 2, - 0, - 5, - 5, - 1, - 6, - 5, - 2, - 7, - 1, - 8, - 2, - 7, - 7, - 5, - 2, - 7, - 6, - 0, - 7, - 8, - 0, - 7, - 1, - 5, - 0, - 2, - 7, - 7, - 8, - 5, - 2, - 5, - 1, - 8, - 0, - 2, - 8, - 7, - 5, - 6, - 8, - 2, - 8, - 1, - 2, - 0, - 5, - 5, - 8, - 5, - 6, - 3, - 5, - 5, - 5, - 2, - 5, - 5, - 2, - 3, - 0, - 6, - 2, - 2, - 0, - 0, - 8, - 6, - 1, - 8, - 2, - 8, - 5, - 0, - 0, - 2, - 8, - 2, - 8, - 8, - 3, - 0, - 2, - 5, - 2, - 5, - 8, - 0, - 8, - 5, - 0, - 2, - 5, - 3, - 0, - 5, - 1, - 0, - 2, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 3, - 0, - 3, - 8, - 0, - 2, - 5, - 5, - 2, - 3, - 0, - 0, - 3, - 0, - 0, - 7, - 0, - 0, - 0, - 6, - 5, - 3, - 2, - 2, - 2, - 0, - 8, - 0, - 0, - 6, - 2, - 0, - 0, - 7, - 0, - 5, - 4, - 3, - 2, - 6, - 3, - 3, - 2, - 2, - 5, - 1, - 3, - 2, - 8, - 5, - 2, - 0, - 8, - 7, - 3, - 2, - 2, - 8, - 8, - 8, - 8, - 0, - 0, - 2, - 2, - 2, - 1, - 2, - 2, - 2, - 5, - 5, - 3, - 3, - 2, - 8, - 2, - 2, - 1, - 3, - 5, - 2, - 6, - 1, - 5, - 3, - 3, - 2, - 0, - 2, - 2, - 6, - 8, - 3, - 1, - 8, - 5, - 0, - 5, - 0, - 2, - 2, - 5, - 2, - 2, - 2, - 2, - 6, - 2, - 7, - 2, - 3, - 2, - 0, - 8, - 1, - 3, - 3, - 8, - 5, - 2, - 2, - 5, - 2, - 5, - 2, - 4, - 7, - 8, - 2, - 2, - 0, - 5, - 5, - 5, - 1, - 2, - 1, - 4, - 1, - 2, - 8, - 2, - 8, - 8, - 7, - 2, - 3, - 8, - 7, - 7, - 4, - 2, - 0, - 3, - 0, - 0, - 1, - 0, - 0, - 2, - 3, - 8, - 7, - 0, - 2, - 0, - 8, - 8, - 8, - 5, - 0, - 2, - 0, - 2, - 0, - 0, - 4, - 0, - 2, - 5, - 0, - 2, - 0, - 2, - 0, - 2, - 0, - 7, - 2, - 6, - 2, - 8, - 8, - 2, - 8, - 3, - 3, - 1, - 1, - 3, - 2, - 7, - 8, - 7, - 2, - 5, - 6, - 1, - 7, - 1, - 3, - 0, - 2, - 3, - 5, - 7, - 8, - 0, - 2, - 1, - 7, - 2, - 3, - 5, - 2, - 0, - 2, - 0, - 2, - 0, - 2, - 2, - 0, - 2, - 0, - 2, - 0, - 0, - 2, - 3, - 2, - 8, - 7, - 8, - 6, - 2, - 3, - 3, - 3, - 2, - 0, - 4, - 0, - 2, - 2, - 8, - 2, - 5, - 8, - 1, - 3, - 7, - 3, - 0, - 2, - 7, - 8, - 2, - 4, - 8, - 6, - 2, - 8, - 6, - 6, - 0, - 7, - 2, - 7, - 7, - 0, - 6, - 6, - 7, - 4, - 7, - 7, - 3, - 8, - 0, - 0, - 4, - 3, - 0, - 0, - 3, - 2, - 2, - 7, - 8, - 1, - 2, - 3, - 7, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 1, - 1, - 8, - 6, - 7, - 8, - 2, - 7, - 0, - 7, - 0, - 3, - 2, - 7, - 7, - 2, - 3, - 0, - 0, - 0, - 1, - 5, - 3, - 3, - 0, - 7, - 2, - 7, - 6, - 0, - 0, - 7, - 8, - 3, - 3, - 2, - 3, - 7, - 2, - 0, - 8, - 1, - 2, - 0, - 5, - 8, - 0, - 0, - 0, - 0, - 5, - 0, - 8, - 0, - 2, - 5, - 3, - 2, - 7, - 2, - 2, - 8, - 0, - 2, - 2, - 2, - 5, - 0, - 0, - 6, - 2, - 0, - 2, - 8, - 8, - 3, - 2, - 2, - 2, - 2, - 8, - 2, - 7, - 7, - 0, - 2, - 2, - 8, - 0, - 8, - 2, - 0, - 8, - 0, - 2, - 2, - 2, - 8, - 0, - 0, - 8, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 8, - 0, - 0, - 6, - 0, - 8, - 0, - 6, - 6, - 6, - 2, - 0, - 8, - 0, - 6, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 0, - 3, - 7, - 0, - 0, - 0, - 6, - 6, - 0, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 2, - 0, - 0, - 8, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 7, - 6, - 0, - 0, - 0, - 0, - 0, - 1, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 3, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 7, - 0, - 0, - 6, - 2, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 6, - 3, - 0, - 5, - 6, - 0, - 7, - 0, - 6, - 0, - 0, - 8, - 7, - 6, - 6, - 3, - 3, - 5, - 5, - 6, - 7, - 3, - 3, - 0, - 5, - 0, - 0, - 1, - 7, - 6, - 2, - 8, - 7, - 6, - 5, - 2, - 2, - 0, - 2, - 3, - 2, - 2, - 7, - 0, - 2, - 1, - 7, - 1, - 2, - 2, - 0, - 2, - 8, - 0, - 6, - 2, - 4, - 5, - 0, - 8, - 8, - 2, - 2, - 3, - 7, - 7, - 7, - 1, - 2, - 0, - 0, - 2, - 2, - 7, - 3, - 3, - 8, - 8, - 0, - 0, - 0, - 0, - 2, - 5, - 0, - 4, - 3, - 7, - 3, - 8, - 7, - 7, - 7, - 7, - 0, - 0, - 0, - 2, - 2, - 6, - 6, - 6, - 2, - 0, - 8, - 1, - 1, - 2, - 0, - 2, - 7, - 8, - 6, - 7, - 2, - 8, - 8, - 8, - 6, - 4, - 2, - 0, - 0, - 8, - 7, - 7, - 6, - 0, - 7, - 2, - 3, - 1, - 7, - 3, - 6, - 2, - 0, - 7, - 0, - 6, - 8, - 2, - 0, - 0, - 0, - 0, - 0, - 3, - 3, - 3, - 7, - 6, - 2, - 7, - 7, - 2, - 7, - 2, - 8, - 2, - 6, - 3, - 0, - 6, - 0, - 2, - 4, - 7, - 6, - 0, - 2, - 8, - 8, - 7, - 2, - 4, - 2, - 8, - 0, - 0, - 8, - 7, - 7, - 0, - 2, - 7, - 6, - 7, - 6, - 2, - 5, - 0, - 2, - 6, - 0, - 6, - 0, - 8, - 3, - 6, - 8, - 1, - 6, - 7, - 7, - 7, - 6, - 0, - 8, - 5, - 5, - 8, - 0, - 6, - 2, - 2, - 0, - 8, - 2, - 8, - 2, - 8, - 8, - 1, - 2, - 3, - 8, - 7, - 7, - 7, - 8, - 2, - 8, - 2, - 7, - 2, - 3, - 7, - 2, - 0, - 7, - 3, - 8, - 7, - 4, - 0, - 0, - 3, - 0, - 0, - 0, - 0, - 4, - 2, - 2, - 7, - 7, - 7, - 7, - 8, - 2, - 7, - 5, - 7, - 5, - 8, - 8, - 8, - 7, - 0, - 2, - 0, - 0, - 7, - 0, - 8, - 0, - 5, - 7, - 5, - 5, - 2, - 8, - 2, - 2, - 2, - 0, - 2, - 2, - 2, - 2, - 0, - 1, - 1, - 2, - 6, - 8, - 7, - 8, - 8, - 0, - 6, - 0, - 0, - 0, - 0, - 7, - 0, - 7, - 5, - 0, - 1, - 0, - 3, - 5, - 6, - 0, - 0, - 5, - 2, - 0, - 0, - 0, - 7, - 7, - 0, - 0, - 2, - 3, - 6, - 3, - 2, - 2, - 0, - 2, - 6, - 1, - 2, - 7, - 7, - 7, - 2, - 6, - 2, - 1, - 0, - 7, - 3, - 6, - 2, - 8, - 7, - 3, - 5, - 2, - 2, - 7, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 7, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 1, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 2, - 0, - 0, - 0, - 0, - 3, - 2, - 7, - 0, - 0, - 0, - 6, - 0, - 0, - 1, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 1, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 7, - 7, - 0, - 0, - 0, - 0, - 2, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 7, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 2, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 1, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 5, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 1, - 0, - 0, - 7, - 0, - 0, - 0, - 8, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 4, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 6, - 8, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 0, - 0, - 7, - 8, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 1, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 1, - 0, - 0, - 0, - 8, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 2, - 0, - 0, - 2, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 4, - 0, - 0, - 8, - 0, - 0, - 2, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 2, - 0, - 8, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 6, - 5, - 0, - 1, - 3, - 0, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 3, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 1, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 6, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 3, - 5, - 0, - 0, - 0, - 3, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 8, - 0, - 0, - 0, - 8, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 2, - 3, - 2, - 0, - 7, - 2, - 7, - 2, - 2, - 8, - 5, - 0, - 8, - 7, - 2, - 2, - 1, - 8, - 2, - 2, - 2, - 7, - 2, - 7, - 6, - 2, - 2, - 5, - 2, - 0, - 5, - 6, - 2, - 0, - 2, - 0, - 5, - 7, - 1, - 2, - 2, - 5, - 0, - 5, - 0, - 2, - 8, - 2, - 5, - 0, - 5, - 2, - 0, - 6, - 1, - 2, - 5, - 2, - 2, - 0, - 2, - 0, - 0, - 7, - 0, - 7, - 0, - 1, - 2, - 6, - 2, - 2, - 7, - 7, - 1, - 0, - 1, - 4, - 1, - 3, - 1, - 2, - 6, - 5, - 0, - 2, - 6, - 2, - 7, - 2, - 2, - 0, - 7, - 8, - 8, - 7, - 0, - 0, - 2, - 0, - 2, - 7, - 8, - 7, - 0, - 2, - 8, - 6, - 0, - 6, - 6, - 6, - 0, - 7, - 0, - 7, - 8, - 7, - 7, - 7, - 7, - 1, - 8, - 6, - 2, - 3, - 2, - 7, - 8, - 2, - 8, - 3, - 7, - 0, - 0, - 8, - 3, - 8, - 5, - 2, - 7, - 5, - 8, - 6, - 8, - 2, - 2, - 0, - 0, - 0, - 0, - 8, - 2, - 3, - 0, - 0, - 2, - 0, - 2, - 2, - 5, - 2, - 8, - 4, - 8, - 3, - 8, - 2, - 2, - 3, - 6, - 3, - 7, - 7, - 8, - 6, - 0, - 7, - 7, - 6, - 5, - 2, - 8, - 7, - 3, - 7, - 0, - 2, - 3, - 7, - 3, - 3, - 7, - 7, - 8, - 0, - 2, - 8, - 8, - 0, - 8, - 8, - 3, - 3, - 0, - 2, - 0, - 0, - 7, - 7, - 7, - 7, - 7, - 3, - 3, - 8, - 0, - 1, - 0, - 7, - 8, - 7, - 3, - 2, - 0, - 3, - 4, - 2, - 7, - 8, - 2, - 8, - 8, - 8, - 8, - 2, - 2, - 7, - 2, - 5, - 2, - 7, - 3, - 6, - 2, - 7, - 0, - 7, - 7, - 0, - 1, - 8, - 7, - 0, - 7, - 8, - 8, - 0, - 1, - 8, - 0, - 7, - 6, - 7, - 6, - 0, - 3, - 8, - 2, - 7, - 2, - 2, - 3, - 3, - 1, - 7, - 1, - 1, - 6, - 2, - 1, - 7, - 1, - 0, - 7, - 1, - 0, - 2, - 6, - 8, - 7, - 3, - 5, - 5, - 5, - 2, - 6, - 5, - 8, - 1, - 0, - 0, - 0, - 8, - 2, - 2, - 5, - 2, - 3, - 2, - 5, - 2, - 2, - 4, - 2, - 0, - 5, - 5, - 8, - 8, - 5, - 0, - 5, - 5, - 5, - 1, - 5, - 5, - 5, - 5, - 2, - 5, - 2, - 5, - 2, - 0, - 5, - 5, - 7, - 5, - 5, - 3, - 5, - 7, - 5, - 5, - 0, - 5, - 2, - 5, - 3, - 5, - 5, - 2, - 8, - 5, - 5, - 5, - 5, - 5, - 5, - 0, - 7, - 5, - 2, - 5, - 6, - 2, - 2, - 2, - 0, - 0, - 5, - 2, - 5, - 5, - 5, - 5, - 5, - 3, - 5, - 5, - 2, - 5, - 0, - 5, - 2, - 5, - 5, - 5, - 5, - 5, - 3, - 5, - 2, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 0, - 2, - 2, - 5, - 2, - 5, - 3, - 5, - 2, - 2, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 2, - 2, - 2, - 5, - 7, - 3, - 6, - 5, - 7, - 3, - 0, - 5, - 5, - 7, - 8, - 0, - 8, - 5, - 0, - 0, - 0, - 5, - 8, - 5, - 4, - 3, - 2, - 7, - 6, - 4, - 3, - 3, - 5, - 5, - 5, - 6, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 3, - 5, - 5, - 0, - 5, - 7, - 0, - 2, - 2, - 2, - 2, - 4, - 5, - 2, - 2, - 7, - 7, - 2, - 5, - 5, - 5, - 5, - 5, - 1, - 6, - 0, - 5, - 6, - 5, - 5, - 0, - 7, - 1, - 0, - 5, - 7, - 8, - 2, - 5, - 0, - 5, - 8, - 5, - 5, - 7, - 5, - 7, - 5, - 5, - 5, - 5, - 7, - 7, - 6, - 5, - 5, - 5, - 1, - 5, - 2, - 5, - 5, - 5, - 2, - 5, - 8, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 3, - 5, - 5, - 5, - 3, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 2, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 2, - 5, - 5, - 8, - 5, - 8, - 5, - 8, - 2, - 5, - 3, - 1, - 7, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 7, - 8, - 2, - 5, - 0, - 5, - 5, - 5, - 2, - 5, - 2, - 0, - 5, - 5, - 7, - 5, - 2, - 5, - 5, - 5, - 5, - 7, - 5, - 5, - 1, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 0, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 3, - 5, - 5, - 3, - 5, - 0, - 5, - 5, - 5, - 8, - 0, - 2, - 5, - 3, - 7, - 2, - 5, - 2, - 8, - 2, - 2, - 8, - 2, - 8, - 2, - 7, - 6, - 0, - 1, - 7, - 8, - 2, - 2, - 2, - 3, - 2, - 5, - 5, - 7, - 7, - 0, - 8, - 0, - 8, - 5, - 5, - 2, - 7, - 7, - 5, - 1, - 2, - 4, - 5, - 2, - 1, - 8, - 0, - 0, - 1, - 5, - 0, - 6, - 0, - 1, - 7, - 5, - 0, - 0, - 5, - 0, - 4, - 3, - 0, - 0, - 7, - 0, - 0, - 0, - 7, - 7, - 4, - 7, - 5, - 7, - 0, - 7, - 0, - 7, - 5, - 5, - 5, - 5, - 8, - 0, - 2, - 5, - 0, - 0, - 1, - 0, - 8, - 5, - 2, - 8, - 8, - 0, - 0, - 8, - 5, - 5, - 8, - 0, - 5, - 0, - 0, - 8, - 4, - 1, - 8, - 5, - 8, - 5, - 4, - 0, - 4, - 3, - 7, - 2, - 7, - 0, - 5, - 0, - 0, - 8, - 0, - 2, - 7, - 5, - 2, - 2, - 2, - 2, - 2, - 2, - 8, - 5, - 5, - 5, - 0, - 2, - 5, - 5, - 3, - 5, - 5, - 2, - 1, - 5, - 5, - 5, - 3, - 0, - 2, - 5, - 7, - 2, - 4, - 4, - 0, - 7, - 2, - 5, - 2, - 0, - 2, - 2, - 3, - 2, - 2, - 5, - 8, - 2, - 2, - 2, - 1, - 0, - 5, - 5, - 5, - 2, - 5, - 4, - 5, - 5, - 0, - 5, - 5, - 5, - 5, - 2, - 5, - 5, - 1, - 1, - 7, - 7, - 5, - 6, - 2, - 2, - 0, - 2, - 2, - 6, - 2, - 7, - 2, - 1, - 5, - 5, - 8, - 6, - 8, - 7, - 7, - 3, - 0, - 7, - 2, - 0, - 7, - 0, - 0, - 5, - 3, - 5, - 2, - 3, - 0, - 6, - 5, - 5, - 5, - 5, - 3, - 5, - 3, - 3, - 5, - 0, - 5, - 7, - 5, - 5, - 5, - 5, - 3, - 5, - 0, - 5, - 5, - 0, - 5, - 0, - 0, - 5, - 5, - 5, - 5, - 8, - 5, - 5, - 6, - 7, - 8, - 7, - 3, - 3, - 8, - 7, - 5, - 2, - 2, - 8, - 0, - 6, - 3, - 5, - 5, - 2, - 5, - 5, - 5, - 7, - 2, - 5, - 2, - 5, - 1, - 1, - 2, - 1, - 7, - 7, - 0, - 2, - 0, - 5, - 6, - 6, - 0, - 2, - 0, - 5, - 2, - 5, - 5, - 2, - 2, - 8, - 2, - 0, - 8, - 2, - 2, - 0, - 5, - 2, - 2, - 1, - 0, - 2, - 0, - 3, - 3, - 1, - 2, - 5, - 5, - 2, - 2, - 2, - 2, - 2, - 2, - 2, - 1, - 1, - 2, - 2, - 2, - 2, - 0, - 2, - 5, - 5, - 2, - 4, - 5, - 0, - 5, - 2, - 5, - 5, - 2, - 2, - 0, - 5, - 0, - 3, - 5, - 8, - 5, - 5, - 8, - 1, - 5, - 8, - 0, - 0, - 5, - 3, - 3, - 5, - 2, - 5, - 5, - 7, - 0, - 7, - 5, - 8, - 0, - 3, - 2, - 5, - 5, - 4, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 2, - 2, - 7, - 1, - 3, - 0, - 2, - 8, - 8, - 2, - 6, - 5, - 6, - 1, - 5, - 5, - 6, - 8, - 5, - 5, - 5, - 3, - 6, - 5, - 0, - 2, - 7, - 0, - 3, - 0, - 1, - 5, - 5, - 3, - 0, - 7, - 2, - 5, - 7, - 3, - 5, - 2, - 2, - 2, - 2, - 4, - 8, - 8, - 2, - 7, - 7, - 0, - 3, - 0, - 0, - 0, - 8, - 5, - 2, - 2, - 6, - 4, - 5, - 5, - 2, - 2, - 5, - 2, - 2, - 2, - 0, - 0, - 2, - 5, - 2, - 2, - 2, - 2, - 8, - 2, - 8, - 2, - 3, - 2, - 2, - 1, - 0, - 0, - 6, - 2, - 3, - 1, - 5, - 7, - 5, - 2, - 7, - 7, - 7, - 0, - 2, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 2, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 6, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 2, - 5, - 5, - 5, - 2, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 0, - 7, - 5, - 8, - 5, - 5, - 0, - 5, - 5, - 5, - 5, - 5, - 5, - 2, - 5, - 5, - 2, - 5, - 5, - 5, - 2, - 0, - 2, - 2, - 1, - 3, - 8, - 8, - 7, - 7, - 4, - 0, - 1, - 7, - 0, - 2, - 2, - 2, - 7, - 3, - 0, - 1, - 7, - 1, - 2, - 3, - 5, - 7, - 5, - 3, - 5, - 5, - 5, - 6, - 5, - 0, - 5, - 5, - 5, - 0, - 5, - 0, - 3, - 6, - 7, - 3, - 4, - 8, - 8, - 7, - 2, - 5, - 5, - 5, - 5, - 5, - 5, - 2, - 0, - 2, - 5, - 5, - 5, - 0, - 5, - 5, - 5, - 5, - 1, - 5, - 5, - 5, - 0, - 2, - 2, - 3, - 6, - 2, - 2, - 0, - 8, - 2, - 2, - 8, - 8, - 1, - 2, - 2, - 2, - 1, - 6, - 2, - 2, - 3, - 5, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 7, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 2, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 5, - 0, - 0, - 0, - 0, - 0, - 0, - 1, - 5, - 5, - 5, - 2, - 1, - 5, - 3, - 7, - 2, - 5, - 1, - 5, - 5, - 1, - 2, - 2, - 8, - 2, - 7, - 2, - 5, - 5, - 3, - 3, - 5, - 7, - 5, - 2, - 7, - 5, - 8, - 0, - 2, - 2, - 0, - 5, - 2, - 0, - 0, - 7, - 2, - 5, - 2, - 0, - 2, - 2, - 4, - 3, - 4, - 5, - 0, - 8, - 2, - 5, - 2, - 0, - 2, - 0, - 2, - 8, - 8, - 5, - 5, - 7, - 5, - 8, - 5, - 3, - 0, - 5, - 8, - 8, - 5, - 0, - 2, - 3, - 0, - 2, - 0, - 2, - 2, - 8, - 3, - 5, - 1, - 5, - 8, - 7, - 5, - 5, - 0, - 2, - 6, - 5, - 8, - 3, - 2, - 7, - 2, - 6, - 7, - 3, - 3, - 3, - 7, - 7, - 1, - 4, - 5, - 5, - 2, - 3, - 0, - 7, - 4, - 0, - 0, - 1, - 6, - 2, - 0, - 2, - 2, - 2, - 6, - 0, - 2, - 8, - 0, - 5, - 5, - 5, - 0, - 4, - 0, - 4, - 7, - 5, - 3, - 5, - 0, - 7, - 5, - 5, - 8, - 3, - 0, - 5, - 3, - 2, - 2, - 8, - 0, - 5, - 0, - 4, - 5, - 0, - 5, - 2, - 2, - 8, - 8, - 8, - 0, - 1, - 5, - 3, - 5, - 4, - 4, - 5, - 5, - 2, - 2, - 4, - 8, - 2, - 2, - 0, - 8, - 4, - 5, - 2, - 5, - 5, - 3, - 0, - 5, - 5, - 3, - 7, - 7, - 4, - 5, - 3, - 2, - 2, - 2, - 3, - 2, - 0, - 8, - 2, - 4, - 3, - 5, - 2, - 1, - 5, - 5, - 8, - 2, - 3, - 5, - 2, - 2, - 3, - 2, - 0, - 0, - 7, - 2, - 2, - 7, - 3, - 2, - 2, - 5, - 3, - 0, - 2, - 8, - 2, - 3, - 7, - 7, - 7, - 5, - 5, - 5, - 2, - 8, - 5, - 2, - 5, - 7, - 0, - 2, - 7, - 2, - 3, - 3, - 3, - 8, - 0, - 0, - 5, - 0, - 5, - 7, - 0, - 1, - 3, - 2, - 4, - 2, - 3, - 0, - 4, - 5, - 5, - 4, - 5, - 5, - 5, - 2, - 8, - 4, - 5, - 3, - 2, - 2, - 0, - 8, - 2, - 5, - 2, - 2, - 3, - 5, - 5, - 2, - 0, - 0, - 7, - 5, - 0, - 2, - 5, - 2, - 5, - 0, - 2, - 5, - 1, - 0, - 5, - 0, - 2, - 5, - 2, - 0, - 3, - 0, - 0, - 7, - 6, - 5, - 5, - 8, - 3, - 8, - 0, - 2, - 1, - 5, - 1, - 5, - 7, - 1, - 7, - 2, - 2, - 5, - 8, - 3, - 2, - 3, - 5, - 0, - 7, - 3, - 1, - 7, - 2, - 2, - 0, - 2, - 8, - 0, - 2, - 5, - 7, - 8, - 1, - 5, - 6, - 2, - 0, - 8, - 8, - 5, - 3, - 7, - 2, - 5, - 0, - 1, - 2, - 3, - 8, - 2, - 5, - 5, - 5, - 2, - 2, - 5, - 0, - 0, - 7, - 2, - 2, - 2, - 5, - 1, - 3, - 2, - 8, - 5, - 5, - 6, - 7, - 2, - 7, - 7, - 4, - 7, - 2, - 7, - 0, - 1, - 2, - 2, - 2, - 2, - 0, - 0, - 6, - 2, - 8, - 0, - 7, - 3, - 1, - 5, - 2, - 2, - 2, - 2, - 5, - 0, - 8, - 1, - 2, - 3, - 6, - 5, - 5, - 2, - 7, - 5, - 0, - 2, - 1, - 2, - 5, - 5, - 0, - 3, - 2, - 2, - 5, - 8, - 0, - 5, - 1, - 5, - 5, - 5, - 7, - 7, - 8, - 0, - 0, - 3, - 4, - 7, - 2, - 2, - 7, - 7, - 7, - 5, - 5, - 7, - 5, - 7, - 7, - 5, - 6, - 6, - 2, - 4, - 5, - 5, - 2, - 0, - 2, - 8, - 0, - 0, - 0, - 7, - 2, - 7, - 2, - 5, - 8, - 1, - 2, - 1, - 5, - 7, - 5, - 8, - 2, - 2, - 1, - 6, - 0, - 5, - 2, - 8, - 2, - 2, - 2, - 3, - 3, - 8, - 4, - 7, - 0, - 4, - 3, - 8, - 5, - 3, - 2, - 3, - 2, - 2, - 2, - 6, - 2, - 8, - 6, - 2, - 0, - 2, - 2, - 2, - 5, - 7, - 2, - 2, - 8, - 8, - 7, - 8, - 6, - 2, - 5, - 5, - 8, - 0, - 7, - 2, - 0, - 2, - 0, - 0, - 0, - 2, - 5, - 5, - 5, - 5, - 0, - 5, - 3, - 0, - 2, - 2, - 0, - 4, - 2, - 2, - 2, - 2, - 2, - 2, - 0, - 5, - 3, - 3, - 6, - 3, - 3, - 8, - 3, - 0, - 2, - 0, - 5, - 5, - 0, - 0, - 0, - 0, - 3, - 2, - 2, - 8, - 0, - 2, - 2, - 2, - 2, - 0, - 3, - 1, - 2, - 2, - 1, - 5, - 0, - 0, - 8, - 4, - 5, - 1, - 2, - 0, - 0, - 0, - 0, - 1, - 6, - 3, - 2, - 2, - 0, - 2, - 3, - 3, - 2, - 0, - 5, - 8, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 0, - 5, - 5, - 5, - 5, - 7, - 7, - 5, - 2, - 2, - 5, - 5, - 5, - 5, - 5, - 4, - 2, - 7, - 5, - 3, - 3, - 5, - 1, - 5, - 3, - 2, - 8, - 1, - 5, - 6, - 0, - 2, - 7, - 2, - 7, - 2, - 2, - 2, - 2, - 2, - 0, - 3, - 2, - 5, - 3, - 3, - 3, - 7, - 3, - 2, - 3, - 5, - 2, - 1, - 2, - 6, - 3, - 2, - 8, - 2, - 2, - 6, - 2, - 2, - 2, - 4, - 5, - 2, - 2, - 2, - 0, - 2, - 0, - 2, - 3, - 3, - 2, - 2, - 5, - 6, - 2, - 4, - 0, - 7, - 5, - 5, - 7, - 4, - 8, - 5, - 5, - 5, - 0, - 3, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 0, - 1, - 2, - 5, - 5, - 2, - 5, - 8, - 2, - 8, - 8, - 8, - 5, - 2, - 0, - 5, - 5, - 5, - 2, - 2, - 5, - 7, - 7, - 8, - 2, - 0, - 5, - 2, - 8, - 8, - 2, - 8, - 5, - 7, - 7, - 1, - 4, - 2, - 8, - 5, - 2, - 2, - 8, - 2, - 4, - 4, - 3, - 8, - 5, - 5, - 6, - 6, - 8, - 8, - 3, - 1, - 6, - 7, - 5, - 8, - 7, - 1, - 2, - 1, - 1, - 2, - 8, - 0, - 1, - 5, - 5, - 0, - 8, - 3, - 2, - 5, - 0, - 2, - 6, - 7, - 2, - 2, - 0, - 6, - 2, - 4, - 1, - 5 - ], - "x0": " ", - "xaxis": "x", - "y": [ - 2, - 5, - 5, - 5, - 5, - 3, - 7, - 2, - 8, - 5, - 4, - 6, - 6, - 4, - 5, - 7, - 4, - 7, - 5, - 5, - 5, - 4, - 2, - 4, - 2, - 4, - 5, - 4, - 4, - 3, - 5, - 3, - 5, - 2, - 4, - 6, - 6, - 5, - 5, - 5, - 4, - 4, - 2, - 4, - 4, - 5, - 4, - 3, - 3, - 7, - 4, - 4, - 5, - 2, - 4, - 4, - 6, - 4, - 4, - 4, - 4, - 4, - 2, - 6, - 5, - 2, - 4, - 4, - 4, - 5, - 5, - 6, - 3, - 4, - 7, - 5, - 6, - 6, - 4, - 4, - 5, - 6, - 5, - 6, - 6, - 4, - 3, - 5, - 3, - 7, - 6, - 6, - 7, - 7, - 6, - 5, - 4, - 6, - 6, - 6, - 4, - 5, - 5, - 6, - 5, - 4, - 5, - 2, - 5, - 4, - 5, - 6, - 5, - 5, - 4, - 5, - 4, - 2, - 4, - 4, - 4, - 5, - 5, - 7, - 5, - 2, - 5, - 2, - 5, - 4, - 2, - 6, - 5, - 4, - 2, - 6, - 3, - 7, - 6, - 4, - 5, - 3, - 3, - 4, - 4, - 4, - 3, - 5, - 5, - 6, - 6, - 6, - 6, - 6, - 5, - 9, - 6, - 2, - 2, - 3, - 5, - 6, - 3, - 4, - 2, - 5, - 2, - 2, - 4, - 2, - 3, - 4, - 5, - 4, - 6, - 7, - 6, - 5, - 6, - 9, - 4, - 4, - 6, - 6, - 6, - 5, - 5, - 7, - 4, - 2, - 5, - 3, - 4, - 5, - 5, - 4, - 2, - 5, - 2, - 2, - 8, - 7, - 4, - 3, - 4, - 5, - 7, - 5, - 5, - 5, - 6, - 5, - 4, - 3, - 4, - 4, - 6, - 6, - 5, - 4, - 5, - 5, - 4, - 6, - 6, - 7, - 4, - 6, - 5, - 5, - 6, - 5, - 5, - 6, - 7, - 4, - 3, - 3, - 5, - 5, - 6, - 5, - 2, - 4, - 5, - 5, - 5, - 2, - 5, - 5, - 5, - 5, - 5, - 3, - 5, - 6, - 5, - 2, - 5, - 6, - 3, - 2, - 5, - 2, - 5, - 4, - 6, - 4, - 5, - 5, - 5, - 1, - 5, - 5, - 5, - 5, - 5, - 3, - 4, - 5, - 6, - 3, - 5, - 5, - 4, - 4, - 4, - 4, - 5, - 4, - 5, - 4, - 5, - 2, - 2, - 5, - 5, - 5, - 5, - 5, - 5, - 2, - 4, - 5, - 5, - 5, - 5, - 5, - 3, - 5, - 5, - 2, - 5, - 5, - 3, - 5, - 5, - 4, - 6, - 5, - 2, - 2, - 4, - 5, - 4, - 5, - 5, - 2, - 5, - 5, - 1, - 2, - 5, - 5, - 5, - 4, - 4, - 4, - 4, - 4, - 3, - 4, - 6, - 4, - 5, - 4, - 5, - 5, - 4, - 4, - 4, - 3, - 4, - 4, - 5, - 6, - 5, - 4, - 5, - 5, - 5, - 5, - 5, - 4, - 6, - 5, - 5, - 6, - 4, - 4, - 5, - 4, - 4, - 4, - 4, - 4, - 4, - 5, - 4, - 4, - 4, - 5, - 5, - 4, - 3, - 5, - 3, - 4, - 4, - 4, - 4, - 5, - 5, - 5, - 5, - 4, - 4, - 5, - 5, - 4, - 4, - 4, - 4, - 4, - 4, - 5, - 5, - 5, - 5, - 4, - 4, - 5, - 4, - 4, - 4, - 4, - 5, - 5, - 5, - 3, - 4, - 5, - 4, - 4, - 4, - 4, - 3, - 5, - 5, - 5, - 4, - 5, - 5, - 4, - 4, - 4, - 5, - 5, - 4, - 5, - 5, - 5, - 4, - 5, - 4, - 4, - 5, - 5, - 4, - 6, - 5, - 4, - 5, - 6, - 4, - 5, - 4, - 7, - 5, - 4, - 4, - 5, - 5, - 4, - 4, - 5, - 4, - 5, - 4, - 5, - 5, - 4, - 4, - 4, - 4, - 4, - 5, - 5, - 4, - 4, - 5, - 3, - 5, - 4, - 4, - 5, - 4, - 5, - 5, - 5, - 6, - 5, - 4, - 4, - 4, - 5, - 6, - 5, - 3, - 4, - 6, - 5, - 4, - 4, - 5, - 5, - 4, - 6, - 5, - 4, - 4, - 5, - 4, - 4, - 3, - 5, - 5, - 5, - 5, - 3, - 5, - 5, - 4, - 4, - 5, - 5, - 4, - 5, - 5, - 3, - 5, - 5, - 5, - 5, - 4, - 6, - 5, - 5, - 4, - 5, - 5, - 4, - 5, - 5, - 5, - 4, - 5, - 5, - 5, - 5, - 5, - 5, - 3, - 4, - 6, - 4, - 4, - 4, - 2, - 4, - 5, - 4, - 3, - 5, - 4, - 4, - 4, - 5, - 4, - 4, - 4, - 6, - 5, - 6, - 4, - 4, - 4, - 4, - 5, - 4, - 4, - 4, - 3, - 5, - 4, - 4, - 3, - 4, - 4, - 7, - 5, - 4, - 5, - 4, - 5, - 3, - 6, - 4, - 4, - 4, - 4, - 4, - 5, - 4, - 4, - 2, - 4, - 4, - 4, - 4, - 4, - 4, - 5, - 5, - 5, - 3, - 4, - 5, - 4, - 4, - 4, - 6, - 5, - 4, - 4, - 4, - 4, - 5, - 4, - 4, - 4, - 4, - 4, - 3, - 5, - 5, - 5, - 5, - 7, - 5, - 6, - 2, - 4, - 3, - 6, - 5, - 4, - 6, - 6, - 5, - 2, - 2, - 7, - 2, - 4, - 8, - 4, - 7, - 4, - 5, - 7, - 9, - 2, - 5, - 6, - 3, - 2, - 2, - 4, - 3, - 3, - 2, - 7, - 3, - 5, - 6, - 2, - 6, - 3, - 6, - 2, - 6, - 3, - 6, - 5, - 4, - 3, - 7, - 4, - 4, - 5, - 7, - 4, - 4, - 3, - 6, - 5, - 8, - 6, - 4, - 5, - 10, - 5, - 4, - 7, - 1, - 2, - 4, - 3, - 4, - 2, - 2, - 5, - 8, - 2, - 7, - 4, - 5, - 4, - 5, - 7, - 5, - 9, - 5, - 2, - 5, - 4, - 2, - 2, - 2, - 5, - 6, - 5, - 2, - 5, - 4, - 3, - 4, - 6, - 5, - 6, - 6, - 5, - 5, - 2, - 4, - 5, - 5, - 6, - 5, - 2, - 5, - 4, - 5, - 3, - 9, - 9, - 6, - 5, - 6, - 8, - 3, - 4, - 4, - 4, - 4, - 6, - 4, - 5, - 3, - 4, - 5, - 6, - 4, - 3, - 5, - 4, - 4, - 4, - 6, - 4, - 5, - 6, - 2, - 5, - 5, - 3, - 4, - 5, - 3, - 5, - 4, - 4, - 2, - 6, - 2, - 5, - 4, - 7, - 5, - 5, - 3, - 5, - 5, - 3, - 5, - 6, - 3, - 6, - 4, - 5, - 3, - 5, - 2, - 6, - 2, - 4, - 8, - 7, - 3, - 3, - 7, - 6, - 5, - 3, - 3, - 3, - 4, - 4, - 4, - 5, - 4, - 7, - 2, - 5, - 4, - 5, - 5, - 5, - 3, - 4, - 4, - 4, - 5, - 7, - 4, - 4, - 6, - 5, - 7, - 4, - 5, - 6, - 4, - 3, - 4, - 4, - 8, - 5, - 5, - 4, - 4, - 4, - 6, - 5, - 7, - 5, - 3, - 5, - 5, - 6, - 4, - 4, - 6, - 4, - 4, - 5, - 4, - 5, - 4, - 4, - 3, - 6, - 2, - 2, - 3, - 4, - 4, - 4, - 5, - 4, - 5, - 4, - 5, - 5, - 5, - 4, - 4, - 3, - 4, - 5, - 6, - 6, - 8, - 7, - 5, - 6, - 2, - 2, - 4, - 5, - 4, - 7, - 2, - 6, - 4, - 5, - 6, - 4, - 4, - 2, - 8, - 2, - 4, - 4, - 6, - 4, - 5, - 7, - 6, - 2, - 3, - 2, - 4, - 5, - 6, - 5, - 4, - 2, - 4, - 2, - 5, - 5, - 6, - 5, - 6, - 4, - 3, - 2, - 5, - 5, - 5, - 7, - 4, - 6, - 4, - 4, - 5, - 5, - 7, - 4, - 5, - 4, - 4, - 6, - 6, - 6, - 4, - 3, - 4, - 5, - 5, - 5, - 3, - 4, - 4, - 4, - 4, - 5, - 4, - 3, - 4, - 5, - 6, - 7, - 6, - 4, - 4, - 8, - 6, - 6, - 3, - 8, - 7, - 7, - 7, - 9, - 8, - 9, - 3, - 5, - 7, - 5, - 5, - 4, - 6, - 4, - 4, - 3, - 4, - 6, - 5, - 4, - 3, - 4, - 7, - 2, - 5, - 7, - 6, - 7, - 7, - 8, - 3, - 5, - 3, - 5, - 3, - 5, - 3, - 3, - 5, - 4, - 4, - 3, - 5, - 6, - 4, - 6, - 4, - 4, - 6, - 5, - 4, - 4, - 4, - 4, - 4, - 5, - 5, - 5, - 8, - 7, - 8, - 6, - 6, - 6, - 7, - 7, - 6, - 6, - 3, - 8, - 5, - 7, - 4, - 7, - 3, - 8, - 5, - 5, - 6, - 6, - 5, - 5, - 11, - 5, - 3, - 7, - 6, - 8, - 7, - 8, - 4, - 6, - 4, - 2, - 4, - 5, - 6, - 2, - 4, - 3, - 3, - 5, - 4, - 4, - 6, - 3, - 2, - 4, - 2, - 4, - 4, - 4, - 2, - 6, - 4, - 5, - 5, - 7, - 4, - 5, - 5, - 8, - 3, - 5, - 4, - 4, - 4, - 4, - 5, - 5, - 4, - 3, - 5, - 2, - 4, - 4, - 5, - 4, - 4, - 4, - 5, - 7, - 6, - 5, - 5, - 6, - 2, - 7, - 6, - 4, - 6, - 4, - 7, - 5, - 2, - 3, - 6, - 4, - 3, - 4, - 5, - 5, - 3, - 5, - 5, - 4, - 5, - 5, - 5, - 6, - 4, - 4, - 7, - 7, - 2, - 3, - 5, - 5, - 5, - 2, - 6, - 4, - 5, - 2, - 4, - 4, - 4, - 4, - 6, - 5, - 3, - 6, - 6, - 5, - 2, - 7, - 7, - 5, - 2, - 2, - 5, - 5, - 5, - 7, - 3, - 4, - 5, - 7, - 5, - 4, - 5, - 2, - 2, - 2, - 1, - 3, - 2, - 2, - 5, - 7, - 4, - 4, - 2, - 5, - 2, - 5, - 7, - 7, - 4, - 4, - 5, - 5, - 4, - 2, - 7, - 5, - 6, - 3, - 4, - 5, - 3, - 5, - 5, - 6, - 7, - 5, - 5, - 5, - 5, - 9, - 4, - 10, - 7, - 6, - 6, - 4, - 4, - 4, - 4, - 2, - 5, - 4, - 5, - 4, - 6, - 7, - 6, - 6, - 7, - 7, - 5, - 5, - 4, - 6, - 5, - 6, - 8, - 8, - 2, - 4, - 6, - 5, - 7, - 4, - 5, - 7, - 2, - 5, - 4, - 5, - 4, - 6, - 4, - 4, - 5, - 6, - 6, - 5, - 2, - 5, - 6, - 4, - 4, - 5, - 5, - 4, - 4, - 4, - 2, - 5, - 5, - 2, - 4, - 4, - 4, - 2, - 5, - 4, - 2, - 3, - 6, - 2, - 4, - 4, - 4, - 4, - 7, - 5, - 6, - 5, - 5, - 5, - 6, - 2, - 4, - 4, - 8, - 3, - 4, - 4, - 5, - 6, - 4, - 4, - 2, - 3, - 7, - 6, - 4, - 4, - 4, - 3, - 2, - 4, - 5, - 3, - 5, - 4, - 6, - 4, - 5, - 2, - 6, - 4, - 5, - 4, - 5, - 3, - 6, - 3, - 4, - 6, - 2, - 5, - 4, - 4, - 4, - 6, - 6, - 6, - 4, - 6, - 4, - 4, - 5, - 4, - 5, - 6, - 4, - 6, - 5, - 3, - 4, - 5, - 4, - 6, - 5, - 6, - 4, - 5, - 4, - 4, - 5, - 6, - 5, - 4, - 3, - 4, - 5, - 4, - 5, - 4, - 5, - 6, - 9, - 7, - 5, - 4, - 6, - 2, - 7, - 5, - 2, - 4, - 7, - 7, - 4, - 4, - 7, - 2, - 5, - 4, - 6, - 5, - 5, - 7, - 7, - 4, - 4, - 7, - 5, - 5, - 2, - 5, - 7, - 5, - 5, - 5, - 6, - 2, - 4, - 4, - 7, - 2, - 2, - 4, - 4, - 5, - 4, - 4, - 7, - 4, - 5, - 8, - 5, - 4, - 4, - 5, - 5, - 4, - 5, - 6, - 6, - 5, - 6, - 5, - 7, - 3, - 5, - 5, - 5, - 3, - 3, - 3, - 5, - 5, - 3, - 6, - 3, - 3, - 5, - 4, - 5, - 5, - 3, - 5, - 5, - 3, - 5, - 5, - 3, - 6, - 6, - 3, - 3, - 5, - 5, - 5, - 6, - 5, - 5, - 6, - 3, - 5, - 5, - 5, - 4, - 6, - 6, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 4, - 5, - 5, - 4, - 6, - 5, - 4, - 5, - 5, - 5, - 6, - 5, - 5, - 4, - 5, - 5, - 4, - 5, - 5, - 6, - 2, - 6, - 6, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 4, - 5, - 2, - 6, - 5, - 4, - 4, - 5, - 3, - 3, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 6, - 5, - 5, - 5, - 5, - 5, - 6, - 5, - 5, - 4, - 5, - 6, - 4, - 7, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 6, - 5, - 2, - 5, - 5, - 5, - 5, - 6, - 5, - 5, - 5, - 4, - 4, - 5, - 6, - 4, - 4, - 6, - 5, - 4, - 6, - 8, - 7, - 7, - 6, - 7, - 5, - 4, - 7, - 5, - 7, - 5, - 2, - 2, - 5, - 4, - 5, - 4, - 6, - 4, - 4, - 4, - 4, - 4, - 5, - 6, - 4, - 5, - 6, - 5, - 5, - 5, - 5, - 4, - 4, - 6, - 7, - 3, - 4, - 3, - 4, - 6, - 7, - 4, - 4, - 5, - 4, - 6, - 6, - 4, - 4, - 4, - 4, - 4, - 4, - 5, - 5, - 5, - 4, - 4, - 4, - 4, - 8, - 5, - 5, - 5, - 5, - 6, - 4, - 4, - 6, - 3, - 6, - 4, - 2, - 5, - 5, - 7, - 7, - 4, - 4, - 8, - 4, - 5, - 4, - 4, - 6, - 4, - 4, - 2, - 4, - 5, - 4, - 3, - 2, - 3, - 5, - 5, - 5, - 3, - 4, - 4, - 4, - 8, - 4, - 3, - 5, - 6, - 6, - 5, - 5, - 4, - 4, - 8, - 5, - 4, - 4, - 5, - 4, - 6, - 5, - 9, - 4, - 5, - 4, - 8, - 3, - 4, - 5, - 6, - 4, - 7, - 5, - 5, - 8, - 5, - 3, - 3, - 6, - 4, - 5, - 4, - 4, - 4, - 4, - 5, - 2, - 4, - 5, - 6, - 4, - 4, - 3, - 6, - 5, - 4, - 4, - 6, - 6, - 8, - 4, - 4, - 4, - 8, - 5, - 4, - 5, - 4, - 5, - 4, - 7, - 6, - 4, - 2, - 5, - 6, - 2, - 7, - 4, - 4, - 9, - 2, - 5, - 4, - 6, - 6, - 6, - 4, - 6, - 5, - 4, - 6, - 5, - 6, - 2, - 7, - 4, - 5, - 6, - 4, - 4, - 4, - 4, - 5, - 5, - 6, - 5, - 4, - 6, - 5, - 4, - 5, - 6, - 4, - 4, - 5, - 4, - 5, - 2, - 5, - 4, - 4, - 4, - 4, - 6, - 5, - 4, - 5, - 7, - 7, - 4, - 4, - 5, - 4, - 2, - 3, - 6, - 5, - 4, - 4, - 7, - 2, - 4, - 4, - 6, - 4, - 6, - 2, - 7, - 6, - 5, - 3, - 5, - 6, - 5, - 6, - 5, - 4, - 3, - 5, - 4, - 5, - 4, - 7, - 6, - 6, - 8, - 3, - 6, - 2, - 5, - 6, - 4, - 6, - 5, - 2, - 4, - 5, - 3, - 7, - 6, - 6, - 5, - 5, - 8, - 6, - 5, - 4, - 2, - 2, - 4, - 4, - 3, - 4, - 5, - 6, - 4, - 4, - 7, - 5, - 4, - 3, - 7, - 6, - 6, - 6, - 6, - 7, - 6, - 5, - 5, - 6, - 4, - 4, - 5, - 4, - 6, - 5, - 7, - 4, - 5, - 5, - 7, - 5, - 6, - 2, - 4, - 4, - 8, - 6, - 5, - 5, - 6, - 7, - 6, - 5, - 4, - 5, - 5, - 6, - 3, - 6, - 6, - 4, - 5, - 5, - 4, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 4, - 4, - 5, - 5, - 6, - 5, - 6, - 5, - 5, - 5, - 4, - 5, - 4, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 4, - 8, - 5, - 5, - 7, - 6, - 6, - 5, - 5, - 5, - 5, - 4, - 5, - 4, - 5, - 5, - 6, - 5, - 5, - 5, - 4, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 7, - 3, - 5, - 5, - 5, - 5, - 5, - 2, - 3, - 5, - 5, - 5, - 5, - 5, - 6, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 6, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 6, - 5, - 5, - 5, - 5, - 7, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 6, - 5, - 4, - 5, - 5, - 5, - 5, - 5, - 8, - 5, - 4, - 5, - 5, - 5, - 6, - 5, - 5, - 5, - 4, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 6, - 6, - 5, - 5, - 2, - 5, - 6, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 7, - 4, - 5, - 5, - 5, - 5, - 5, - 4, - 4, - 6, - 5, - 5, - 5, - 4, - 5, - 6, - 6, - 5, - 5, - 6, - 5, - 7, - 4, - 5, - 5, - 5, - 5, - 6, - 5, - 5, - 5, - 5, - 5, - 5, - 3, - 6, - 5, - 5, - 4, - 5, - 5, - 5, - 5, - 4, - 5, - 5, - 5, - 4, - 4, - 5, - 5, - 4, - 4, - 5, - 5, - 5, - 5, - 3, - 4, - 4, - 4, - 6, - 5, - 5, - 5, - 5, - 4, - 5, - 5, - 5, - 5, - 4, - 5, - 5, - 4, - 5, - 5, - 4, - 4, - 5, - 5, - 4, - 5, - 4, - 5, - 6, - 4, - 5, - 5, - 5, - 4, - 5, - 5, - 4, - 5, - 4, - 3, - 5, - 5, - 5, - 4, - 4, - 5, - 5, - 7, - 4, - 5, - 4, - 4, - 5, - 5, - 4, - 5, - 4, - 4, - 5, - 4, - 5, - 4, - 5, - 5, - 4, - 5, - 5, - 5, - 5, - 4, - 2, - 5, - 5, - 4, - 5, - 5, - 5, - 5, - 4, - 4, - 4, - 4, - 4, - 5, - 5, - 3, - 5, - 3, - 3, - 6, - 6, - 4, - 3, - 4, - 4, - 5, - 4, - 4, - 6, - 6, - 8, - 7, - 5, - 4, - 5, - 5, - 3, - 3, - 6, - 3, - 4, - 5, - 4, - 4, - 7, - 4, - 3, - 3, - 4, - 4, - 4, - 7, - 4, - 4, - 5, - 7, - 4, - 3, - 3, - 4, - 4, - 4, - 3, - 8, - 4, - 4, - 8, - 6, - 4, - 2, - 4, - 5, - 6, - 9, - 4, - 3, - 3, - 6, - 5, - 5, - 4, - 7, - 6, - 4, - 5, - 4, - 5, - 5, - 6, - 5, - 8, - 4, - 4, - 7, - 4, - 4, - 5, - 4, - 8, - 4, - 8, - 8, - 4, - 4, - 8, - 4, - 4, - 3, - 8, - 6, - 5, - 6, - 4, - 4, - 3, - 7, - 4, - 3, - 5, - 4, - 5, - 5, - 3, - 4, - 2, - 5, - 6, - 3, - 3, - 4, - 3, - 4, - 4, - 6, - 3, - 3, - 3, - 4, - 5, - 4, - 4, - 4, - 5, - 5, - 5, - 4, - 4, - 3, - 5, - 5, - 5, - 4, - 7, - 5, - 4, - 4, - 4, - 4, - 6, - 6, - 3, - 4, - 4, - 5, - 6, - 3, - 4, - 9, - 4, - 6, - 6, - 5, - 4, - 4, - 6, - 4, - 5, - 4, - 3, - 6, - 4, - 4, - 4, - 6, - 5, - 4, - 4, - 6, - 4, - 3, - 4, - 5, - 4, - 4, - 4, - 7, - 4, - 10, - 4, - 4, - 4, - 7, - 7, - 5, - 4, - 6, - 8, - 3, - 3, - 5, - 4, - 4, - 3, - 4, - 3, - 4, - 6, - 5, - 8, - 8, - 5, - 7, - 3, - 4, - 5, - 7, - 5, - 6, - 5, - 3, - 7, - 6, - 6, - 5, - 6, - 6, - 5, - 5, - 7, - 7, - 8, - 7, - 3, - 5, - 6, - 5, - 5, - 6, - 8, - 9, - 6, - 6, - 4, - 4, - 9, - 5, - 1, - 5, - 3, - 3, - 5, - 5, - 6, - 6, - 6, - 5, - 7, - 9, - 4, - 8, - 7, - 8, - 3, - 5, - 5, - 5, - 8, - 1, - 5, - 7, - 8, - 7, - 4, - 6, - 4, - 5, - 4, - 6, - 5, - 7, - 6, - 7, - 4, - 4, - 5, - 3, - 8, - 5, - 6, - 5, - 7, - 6, - 6, - 6, - 6, - 6, - 7, - 5, - 8, - 6, - 5, - 6, - 6, - 4, - 7, - 8, - 5, - 5, - 7, - 6, - 7, - 7, - 4, - 8, - 6, - 6, - 5, - 4, - 9, - 4, - 5, - 6, - 4, - 4, - 5, - 4, - 3, - 4, - 4, - 5, - 8, - 7, - 4, - 7, - 6, - 8, - 3, - 7, - 6, - 8, - 5, - 7, - 5, - 3, - 2, - 8, - 6, - 7, - 6, - 6, - 8, - 8, - 8, - 5, - 10, - 7, - 4, - 7, - 4, - 5, - 5, - 6, - 6, - 6, - 7, - 7, - 4, - 5, - 7, - 6, - 7, - 8, - 6, - 4, - 5, - 2, - 7, - 6, - 5, - 6, - 6, - 4, - 9, - 7, - 8, - 7, - 4, - 5, - 6, - 5, - 7, - 5, - 4, - 7, - 8, - 8, - 8, - 7, - 8, - 5, - 4, - 7, - 6, - 5, - 8, - 6, - 4, - 5, - 8, - 6, - 4, - 6, - 6, - 5, - 6, - 6, - 5, - 6, - 7, - 9, - 6, - 6, - 6, - 7, - 9, - 6, - 5, - 9, - 9, - 2, - 7, - 4, - 6, - 6, - 5, - 7, - 6, - 3, - 5, - 2, - 4, - 7, - 6, - 4, - 5, - 2, - 2, - 5, - 3, - 2, - 5, - 7, - 5, - 4, - 7, - 5, - 5, - 4, - 5, - 5, - 5, - 6, - 3, - 2, - 4, - 3, - 4, - 2, - 6, - 4, - 4, - 3, - 5, - 5, - 5, - 7, - 4, - 5, - 2, - 4, - 5, - 10, - 4, - 5, - 5, - 7, - 8, - 4, - 5, - 4, - 5, - 4, - 7, - 2, - 2, - 4, - 5, - 5, - 6, - 4, - 5, - 4, - 5, - 4, - 6, - 5, - 4, - 5, - 2, - 5, - 5, - 4, - 3, - 5, - 7, - 4, - 3, - 7, - 6, - 6, - 4, - 5, - 5, - 4, - 6, - 7, - 6, - 6, - 5, - 5, - 4, - 3, - 5, - 5, - 3, - 3, - 4, - 7, - 6, - 4, - 4, - 5, - 5, - 5, - 7, - 5, - 5, - 4, - 5, - 5, - 5, - 5, - 6, - 5, - 5, - 4, - 5, - 8, - 9, - 4, - 6, - 7, - 6, - 6, - 2, - 4, - 3, - 4, - 5, - 7, - 6, - 6, - 3, - 5, - 7, - 7, - 3, - 4, - 4, - 6, - 5, - 5, - 5, - 4, - 4, - 4, - 6, - 6, - 4, - 4, - 5, - 5, - 8, - 4, - 4, - 3, - 4, - 4, - 5, - 3, - 6, - 4, - 9, - 4, - 4, - 2, - 2, - 5, - 4, - 5, - 5, - 5, - 4, - 5, - 4, - 2, - 2, - 5, - 4, - 2, - 4, - 4, - 5, - 4, - 7, - 2, - 5, - 8, - 8, - 5, - 5, - 5, - 3, - 2, - 2, - 3, - 5, - 4, - 5, - 6, - 4, - 4, - 3, - 4, - 2, - 4, - 5, - 6, - 5, - 2, - 4, - 6, - 4, - 3, - 5, - 4, - 5, - 4, - 3, - 5, - 5, - 4, - 4, - 6, - 5, - 5, - 5, - 6, - 2, - 5, - 4, - 2, - 6, - 6, - 5, - 6, - 5, - 5, - 5, - 4, - 2, - 6, - 5, - 5, - 7, - 5, - 6, - 4, - 4, - 3, - 4, - 5, - 4, - 6, - 5, - 2, - 8, - 5, - 4, - 6, - 6, - 4, - 4, - 3, - 6, - 5, - 5, - 4, - 5, - 6, - 6, - 5, - 4, - 5, - 5, - 7, - 4, - 6, - 4, - 4, - 6, - 5, - 6, - 4, - 5, - 2, - 5, - 5, - 5, - 2, - 4, - 3, - 9, - 5, - 8, - 5, - 3, - 4, - 4, - 4, - 6, - 5, - 4, - 5, - 4, - 4, - 5, - 5, - 3, - 5, - 2, - 5, - 4, - 7, - 3, - 3, - 2, - 5, - 2, - 7, - 5, - 6, - 2, - 4, - 3, - 5, - 5, - 7, - 4, - 3, - 3, - 3, - 2, - 4, - 2, - 3, - 5, - 3, - 3, - 3, - 3, - 5, - 3, - 3, - 5, - 3, - 5, - 3, - 6, - 4, - 5, - 4, - 4, - 3, - 3, - 5, - 4, - 7, - 2, - 5, - 6, - 3, - 6, - 6, - 5, - 4, - 5, - 2, - 5, - 5, - 3, - 4, - 6, - 3, - 6, - 3, - 3, - 3, - 3, - 5, - 6, - 5, - 2, - 2, - 5, - 3, - 3, - 3, - 3, - 4, - 6, - 3, - 5, - 3, - 4, - 4, - 3, - 3, - 3, - 4, - 3, - 5, - 4, - 2, - 3, - 2, - 3, - 6, - 7, - 6, - 4, - 5, - 3, - 6, - 4, - 7, - 4, - 6, - 8, - 5, - 7, - 8, - 8, - 4, - 8, - 6, - 7, - 6, - 3, - 5, - 3, - 5, - 8, - 5, - 2, - 2, - 4, - 2, - 7, - 4, - 3, - 3, - 7, - 4, - 2, - 2, - 8, - 5, - 6, - 7, - 8, - 7, - 6, - 5, - 5, - 4, - 4, - 5, - 5, - 5, - 7, - 3, - 4, - 3, - 4, - 3, - 4, - 6, - 3, - 4, - 3, - 5, - 3, - 3, - 6, - 6, - 3, - 5, - 8, - 4, - 5, - 4, - 4, - 3, - 5, - 5, - 7, - 3, - 5, - 5, - 4, - 5, - 6, - 5, - 5, - 4, - 3, - 6, - 5, - 4, - 6, - 6, - 5, - 3, - 3, - 5, - 3, - 6, - 5, - 6, - 5, - 3, - 4, - 5, - 6, - 5, - 6, - 6, - 6, - 6, - 5, - 4, - 7, - 9, - 4, - 2, - 7, - 4, - 5, - 4, - 5, - 4, - 4, - 6, - 7, - 7, - 3, - 3, - 2, - 4, - 3, - 3, - 3, - 4, - 3, - 3, - 3, - 3, - 4, - 3, - 3, - 5, - 4, - 3, - 3, - 7, - 6, - 3, - 3, - 4, - 5, - 5, - 3, - 3, - 6, - 3, - 3, - 4, - 5, - 3, - 5, - 5, - 4, - 5, - 4, - 3, - 4, - 7, - 5, - 8, - 2, - 6, - 5, - 2, - 6, - 3, - 5, - 6, - 3, - 5, - 6, - 5, - 4, - 5, - 3, - 4, - 3, - 2, - 3, - 2, - 3, - 4, - 4, - 3, - 3, - 5, - 3, - 5, - 3, - 3, - 3, - 4, - 5, - 2, - 3, - 6, - 5, - 3, - 3, - 3, - 3, - 4, - 5, - 3, - 2, - 3, - 3, - 6, - 4, - 5, - 3, - 3, - 3, - 7, - 3, - 7, - 7, - 4, - 6, - 6, - 6, - 6, - 3, - 7, - 4, - 3, - 6, - 6, - 8, - 3, - 4, - 3, - 3, - 6, - 5, - 4, - 5, - 5, - 2, - 2, - 2, - 4, - 4, - 5, - 4, - 4, - 5, - 4, - 4, - 4, - 4, - 3, - 6, - 5, - 5, - 6, - 6, - 6, - 3, - 4, - 5, - 3, - 4, - 6, - 3, - 3, - 3, - 5, - 5, - 3, - 3, - 4, - 4, - 2, - 3, - 2, - 4, - 2, - 4, - 5, - 8, - 6, - 4, - 5, - 5, - 5, - 5, - 2, - 5, - 6, - 5, - 5, - 5, - 5, - 5, - 5, - 5, - 4, - 5, - 4, - 3, - 8, - 6, - 4, - 6, - 5, - 5, - 5, - 4, - 7, - 4, - 3, - 6, - 4, - 6, - 5, - 4, - 4, - 2, - 2, - 6, - 4, - 7, - 5, - 6, - 6, - 3, - 7, - 5, - 4, - 7, - 6, - 5, - 6, - 6, - 7, - 6, - 7, - 3, - 6, - 6, - 5, - 3, - 5, - 8, - 2, - 2, - 5, - 5, - 4, - 5, - 4, - 7, - 4, - 2, - 5, - 5, - 4, - 5, - 5, - 5, - 4, - 2, - 5, - 5, - 5, - 5, - 3, - 6, - 3, - 4, - 7, - 3, - 7, - 8, - 9, - 3, - 4, - 7, - 7, - 6, - 6, - 7, - 3, - 5, - 3, - 5, - 5, - 5, - 2, - 1, - 2, - 5, - 4, - 4, - 4, - 5, - 4, - 5, - 4, - 4, - 3, - 9, - 6, - 5, - 5, - 5, - 4, - 6, - 4, - 5, - 4, - 3, - 7, - 4, - 4, - 8, - 4, - 4, - 4, - 4, - 5, - 5, - 5, - 8, - 5, - 5, - 6, - 3, - 6, - 2, - 4, - 3, - 5, - 4, - 6, - 4, - 5, - 4, - 6, - 6, - 8, - 5, - 3, - 3, - 4, - 3, - 6, - 6, - 3, - 4, - 5, - 7, - 4, - 4, - 3, - 4, - 5, - 6, - 3, - 5, - 4, - 5, - 3, - 7, - 4, - 4, - 3, - 5, - 2, - 3, - 4, - 3, - 4, - 3, - 3, - 5, - 3, - 2, - 3, - 3, - 3, - 5, - 4, - 3, - 4, - 4, - 4, - 3, - 3, - 4, - 3, - 6, - 4, - 5, - 3, - 9, - 6, - 5, - 6, - 5, - 4, - 3, - 6, - 5, - 6, - 4, - 5, - 7, - 3, - 3, - 4, - 5, - 3, - 6, - 4, - 4, - 8, - 4, - 4, - 5, - 5, - 5, - 4, - 4, - 4, - 5, - 5, - 8, - 5, - 6, - 6, - 4, - 5, - 6, - 3, - 4, - 3, - 3, - 6, - 6, - 8, - 6, - 5, - 6, - 5, - 9, - 3, - 3, - 5, - 2, - 6, - 3, - 4, - 2, - 4, - 3, - 5, - 4, - 4, - 6, - 2, - 2, - 4, - 4, - 4, - 4, - 5, - 7, - 5, - 4, - 3, - 4, - 2, - 2, - 5, - 2, - 3, - 5, - 5, - 3, - 5, - 3, - 2, - 3, - 3, - 4, - 4, - 4, - 3, - 4, - 4, - 4, - 7, - 3, - 3, - 9, - 5, - 4, - 4, - 5, - 4, - 5, - 5, - 7, - 10, - 4, - 5, - 3, - 6, - 4, - 4, - 4, - 3, - 7, - 5, - 5, - 7, - 4, - 5, - 3, - 4, - 3, - 3, - 3, - 3, - 3, - 3, - 2, - 2, - 3, - 3, - 3, - 6, - 2, - 3, - 3, - 4, - 7, - 8, - 3, - 8, - 6, - 5, - 4, - 7, - 7, - 5, - 5, - 5, - 5, - 8, - 7, - 5, - 6, - 5, - 5, - 6, - 5, - 5, - 4, - 5, - 3, - 3, - 6, - 7, - 3, - 3, - 3, - 5, - 7, - 4, - 3, - 8, - 4, - 4, - 6, - 5, - 5, - 5, - 3, - 5, - 5, - 5, - 5, - 6, - 4, - 5, - 2, - 5, - 3, - 5, - 4, - 4, - 7, - 6, - 2, - 5, - 6, - 4, - 4, - 3, - 5, - 3, - 4, - 3, - 3, - 2, - 2, - 3, - 5, - 2, - 5, - 4, - 4, - 2, - 5, - 6, - 5, - 5, - 4, - 4, - 5, - 7, - 9, - 5, - 6, - 4, - 5, - 2, - 4, - 4, - 5, - 8, - 5, - 4, - 2, - 5, - 4, - 7, - 5, - 4, - 6, - 2, - 3, - 3, - 5, - 2, - 3, - 3, - 3, - 3, - 5, - 2, - 3, - 3, - 3, - 2, - 2, - 3, - 3, - 3, - 5, - 3, - 3, - 3, - 3, - 4, - 3, - 3, - 3, - 3, - 2, - 3, - 4, - 3, - 3, - 4, - 3, - 3, - 3, - 6, - 3, - 6, - 3, - 5, - 3, - 2, - 2, - 3, - 3, - 5, - 3, - 5, - 3, - 4, - 2, - 2, - 6, - 3, - 4, - 4, - 3, - 5, - 6, - 3, - 5, - 3, - 3, - 4, - 3, - 3, - 3, - 4, - 4, - 3, - 5, - 5, - 4, - 5, - 3, - 6, - 6, - 7, - 5, - 4, - 4, - 5, - 9, - 3, - 3, - 7, - 5, - 2, - 5, - 4, - 4, - 5, - 3, - 3, - 4, - 5, - 6, - 3, - 2, - 4, - 5, - 3, - 6, - 3, - 5, - 3, - 6, - 3, - 3, - 4, - 4, - 4, - 4, - 5, - 8, - 4, - 5, - 9, - 7, - 7, - 5, - 7, - 5, - 5, - 3, - 3, - 5, - 6, - 3, - 6, - 5, - 4, - 3, - 6, - 6, - 3, - 6, - 5, - 4, - 5, - 2, - 6, - 3, - 6, - 4, - 4, - 4, - 4, - 4, - 4, - 5, - 2, - 5, - 4, - 4, - 5, - 5, - 7, - 2, - 4, - 4, - 7, - 6, - 2, - 5, - 5, - 4, - 5, - 5, - 7, - 6, - 5, - 4, - 5, - 8, - 4, - 4, - 4, - 6, - 5, - 5, - 4, - 5, - 5, - 3, - 4, - 4, - 5, - 4, - 5, - 4, - 4, - 3, - 5, - 4, - 4, - 4, - 5, - 4, - 4, - 4, - 5, - 5, - 5, - 5, - 4, - 4, - 4, - 4, - 6, - 4, - 4, - 4, - 4, - 4, - 3, - 4, - 4, - 4, - 5, - 4, - 5, - 4, - 5, - 3, - 4, - 4, - 4, - 4, - 6, - 4, - 5, - 4, - 5, - 4, - 4, - 5, - 5, - 5, - 5, - 3, - 4, - 4, - 5, - 3, - 4, - 4, - 4, - 5, - 4, - 5, - 4, - 5, - 4, - 4, - 3, - 5, - 5, - 4, - 4, - 5, - 4, - 5, - 4, - 5, - 4, - 4, - 4, - 5, - 5, - 4, - 4, - 4, - 5, - 4, - 4, - 5, - 4, - 5, - 4, - 4, - 4, - 4, - 4, - 5, - 4, - 5, - 4, - 5, - 4, - 4, - 4, - 4, - 4, - 4, - 4, - 4, - 5, - 4, - 4, - 4, - 4, - 5, - 5, - 7, - 7, - 4, - 7, - 6, - 7, - 7, - 6, - 6, - 5, - 6, - 5, - 5, - 5, - 5, - 5, - 4, - 6, - 5, - 5, - 2, - 3, - 6, - 5, - 7, - 3, - 5, - 5, - 4, - 6, - 3, - 6, - 6, - 5, - 4, - 4, - 3, - 5, - 6, - 6, - 5, - 4, - 3, - 5, - 5, - 4, - 5, - 2, - 6, - 7, - 5, - 2, - 4, - 7, - 4, - 2, - 2, - 4, - 4, - 6, - 2, - 5, - 3, - 2, - 4, - 3, - 6, - 3, - 6, - 5, - 3, - 5, - 2, - 3, - 2, - 6, - 5, - 3, - 4, - 4, - 5, - 8, - 2, - 2, - 3, - 4, - 3, - 8, - 7, - 4, - 5, - 4, - 5, - 8, - 9, - 7, - 7, - 6, - 3, - 5, - 4, - 4, - 4, - 6, - 6, - 2, - 5, - 5, - 4, - 3, - 4, - 2, - 6, - 7, - 5, - 5, - 6, - 3, - 4, - 5, - 4, - 4, - 6, - 5, - 4, - 5, - 2, - 5, - 7, - 5, - 4, - 4, - 3, - 5, - 2, - 5, - 7, - 5, - 5, - 6, - 5, - 4, - 5, - 4, - 5, - 5, - 7, - 4, - 5, - 5, - 5, - 4, - 6, - 6, - 3, - 6, - 6, - 4, - 1, - 3, - 4, - 4, - 8, - 2, - 5, - 5, - 7, - 3, - 7, - 4, - 5, - 4, - 4, - 3, - 2, - 5, - 4, - 3, - 2, - 5, - 3, - 4, - 8, - 7, - 6, - 4, - 8, - 5, - 4, - 6, - 4, - 4, - 5, - 2, - 2, - 3, - 6, - 5, - 5, - 4, - 7, - 6, - 3, - 3, - 6, - 9, - 6, - 8, - 5, - 5, - 5, - 5, - 8, - 5, - 7, - 2, - 7, - 5, - 6, - 5, - 5, - 4, - 5, - 6, - 5, - 4, - 5, - 7, - 2, - 5, - 4, - 4, - 5, - 6, - 5, - 7, - 4, - 6, - 5, - 3, - 4, - 3, - 6, - 2, - 3, - 4, - 6, - 4, - 5, - 5, - 2, - 4, - 4, - 5, - 5, - 3, - 4, - 5, - 5, - 3, - 4, - 5, - 6, - 4, - 7, - 4, - 5, - 4, - 7, - 2, - 5, - 4, - 6, - 4, - 4, - 4, - 3, - 5, - 3, - 4, - 7, - 4, - 4, - 2, - 4, - 3, - 3, - 4, - 5, - 5, - 5, - 5, - 2, - 2, - 5, - 5, - 4, - 6, - 5, - 5, - 2, - 3, - 4, - 4, - 5, - 3, - 5, - 4, - 6, - 4, - 3, - 7, - 4, - 3, - 6, - 6, - 5, - 4, - 7, - 6, - 3, - 3, - 5, - 3, - 3, - 7, - 4, - 4, - 4, - 4, - 4, - 7, - 4, - 4, - 4, - 5, - 5, - 7, - 4, - 5, - 3, - 4, - 5, - 6, - 4, - 5, - 4, - 4, - 4, - 6, - 5, - 7, - 4, - 5, - 2, - 6, - 4, - 5, - 4, - 5, - 3, - 5, - 2, - 5, - 6, - 5, - 2, - 3, - 6, - 4, - 5, - 2, - 3, - 5, - 6, - 3, - 8, - 4, - 4, - 7, - 6, - 7, - 5, - 5, - 6, - 5, - 4, - 4, - 4, - 5, - 6, - 6, - 6, - 7, - 5, - 5, - 4, - 4, - 5, - 8, - 5, - 5, - 6, - 6, - 7, - 5, - 5, - 5, - 2, - 5, - 4, - 3, - 8, - 4, - 4, - 5, - 6, - 6, - 5, - 6, - 4, - 5, - 2, - 4, - 3, - 5, - 5, - 2, - 5, - 5, - 3, - 5, - 5, - 5, - 5, - 4, - 5, - 5, - 3, - 6, - 4, - 7, - 4, - 4, - 3, - 2, - 3, - 6, - 4, - 4, - 6, - 3, - 4, - 5, - 7, - 4, - 5, - 5, - 5, - 4, - 6, - 5, - 4, - 4, - 5, - 3, - 5, - 6, - 3, - 4, - 5, - 6, - 6, - 5, - 4, - 4, - 6, - 3, - 5, - 6, - 6, - 5, - 3, - 5, - 5, - 6, - 5, - 6, - 2, - 6, - 5, - 4, - 4, - 7, - 4, - 4, - 6, - 4, - 4, - 4, - 6, - 8, - 4, - 6, - 4, - 4, - 6, - 4, - 3, - 4, - 4, - 5, - 2, - 2, - 5, - 7, - 4, - 5, - 4, - 7, - 6, - 5, - 2, - 2, - 2, - 5, - 5, - 4, - 5, - 7, - 5, - 4, - 5, - 6, - 3, - 4, - 4, - 5, - 6, - 6, - 2, - 7, - 7, - 5, - 6, - 3, - 3, - 4, - 5, - 5, - 5, - 5, - 5, - 3, - 4, - 4, - 3, - 7, - 4, - 5, - 5, - 7, - 2, - 6, - 2, - 5, - 6, - 6, - 4, - 3, - 4, - 5, - 6, - 5, - 4, - 2, - 6, - 7, - 5, - 2, - 4, - 4, - 2, - 5, - 5, - 5, - 4, - 6, - 4, - 5, - 4, - 3, - 4, - 5, - 5, - 5, - 4, - 4, - 5, - 3, - 4, - 2, - 9, - 5, - 4, - 4, - 5, - 6, - 3, - 5, - 5, - 4, - 2, - 2, - 5, - 7, - 6, - 4, - 4, - 5, - 7, - 7, - 7, - 5, - 4, - 6, - 6, - 6, - 4, - 5, - 6, - 6, - 3, - 3, - 3, - 3, - 3, - 3, - 3, - 2, - 4, - 3, - 6, - 6, - 5, - 2, - 5, - 3, - 4, - 5, - 6, - 3, - 6, - 5, - 3, - 2, - 3, - 4, - 5, - 5, - 5, - 7, - 4, - 5, - 6, - 4, - 3, - 5, - 5, - 5, - 6, - 8, - 5, - 5, - 5, - 2, - 5, - 5, - 5, - 5, - 3, - 5, - 5, - 6, - 4, - 5, - 5, - 4, - 5, - 6, - 5, - 4, - 2, - 1, - 5, - 2, - 6, - 5, - 8, - 2, - 2, - 4, - 7, - 4, - 7, - 7, - 4, - 5, - 5, - 4, - 3, - 6, - 5, - 5, - 5, - 4, - 7, - 5, - 3, - 6, - 6, - 2, - 6, - 4, - 6, - 3, - 7, - 5, - 6, - 5, - 4, - 3, - 1, - 4, - 2, - 3, - 4, - 7, - 6, - 7, - 6, - 7, - 9, - 7, - 5, - 2, - 5, - 5, - 3, - 3, - 5, - 3, - 6, - 5, - 5, - 5, - 5, - 4, - 5, - 3, - 5, - 6, - 7, - 5, - 5, - 5, - 2, - 4, - 3, - 8, - 2, - 3, - 2, - 2, - 5, - 6, - 3, - 5, - 5, - 6, - 4, - 4, - 4, - 5, - 4, - 2, - 4, - 7, - 5, - 2, - 5, - 2, - 6, - 4, - 2, - 3, - 2, - 4, - 8, - 5, - 5, - 3, - 6, - 5, - 2, - 5, - 6, - 6, - 5, - 5, - 5, - 3, - 4, - 4, - 4, - 2, - 4, - 3, - 2, - 6, - 8, - 5, - 4, - 5, - 5, - 4, - 4, - 3, - 7, - 4, - 4, - 6, - 5 - ], - "y0": " ", - "yaxis": "y" + "output_type": "stream", + "name": "stdout", + "text": [ + "Overall number of words by claim description: min 1, average 5, max 11\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} } - ], - "layout": { - "boxmode": "group", - "legend": { - "tracegroupgap": 0 - }, - "margin": { - "t": 60 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + ], + "source": [ + "# statistics of description length\n", + "df_train[\"words per description\"] = df_train[\"Description\"].str.split().apply(len)\n", + "print(f\"Overall number of words by claim description: min {df_train['words per description'].min()}, \"\n", + " f\"average {df_train['words per description'].mean():.0f}, max {df_train['words per description'].max()}\")\n", + "fig = px.box(df_train, x=\"labels\", y=\"words per description\", width=640)\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": \"svg\", \"filename\": \"peril_len\"}})" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "rXOTLyd-EVHB" + }, + "source": [ + "To get an impression of the most frequent words, we generate a simple word cloud form all case descriptions.\n", + "By default, the word cloud excludes so-called stop words (such as articles, prepositions, pronouns, conjunctions, etc.),\n", + "which are the most common words and do not add much information to the text." + ] + }, + { + "cell_type": "code", + "execution_count": 13, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 542 + }, + "id": "eq952mq8EVHB", + "outputId": "bfd3701a-102e-4582-d9a8-01d4dfb8b884", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "width": 640, - "xaxis": { - "anchor": "y", - "domain": [ - 0, - 1 - ], - "title": { - "text": "labels" - } - }, - "yaxis": { - "anchor": "x", - "domain": [ - 0, - 1 - ], - "title": { - "text": "words per description" - } + "metadata": {} } - } + ], + "source": [ + "text = df_train[\"Description\"].str.cat(sep=\" \")\n", + "\n", + "# Create and generate a word cloud image:\n", + "word_cloud = WordCloud(scale=5, background_color=\"white\").generate(text)\n", + "\n", + "# Display the generated image:\n", + "fig = px.imshow(word_cloud, width=1440)\n", + "fig.update_layout(xaxis_showticklabels=False, yaxis_showticklabels=False)\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": \"svg\", \"filename\": \"peril_cloud\"}})" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "7I4oINQQEVHB" }, - "text/html": [ - "
" + "source": [ + "\n", + "\n", + "## 2. Classify by Peril Type in a Supervised Setting\n", + "\n", + "In this section, we will train classifiers to predict the peril type (labels).\n", + "\n", + "We will follow two approaches:\n", + "\n", + "1. We use a transformer encoder to encode the claim descriptions,\n", + " and then train a logistic regression classifier to predict the peril type from the encoded descriptions.\n", + "\n", + "2. We train a transformer encoder with a classifier head directly.\n", + "\n", + "Let's get started." ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# statistics of description length\n", - "df_train[\"words per description\"] = df_train[\"Description\"].str.split().apply(len)\n", - "print(f\"Overall number of words by claim description: min {df_train['words per description'].min()}, \"\n", - " f\"average {df_train['words per description'].mean():.0f}, max {df_train['words per description'].max()}\")\n", - "fig = px.box(df_train, x=\"labels\", y=\"words per description\", width=640)\n", - "fig.show(config={\"toImageButtonOptions\": {\"format\": \"svg\", \"filename\": \"peril_len\"}})" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "rXOTLyd-EVHB" - }, - "source": [ - "To get an impression of the most frequent words, we generate a simple word cloud form all case descriptions.\n", - "By default, the word cloud excludes so-called stop words (such as articles, prepositions, pronouns, conjunctions, etc.),\n", - "which are the most common words and do not add much information to the text." - ] - }, - { - "cell_type": "code", - "execution_count": 8, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 }, - "id": "eq952mq8EVHB", - "outputId": "bfe8432b-e469-447e-8bb7-940294368f42", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "peril_cloud", - "format": "svg" + "cell_type": "markdown", + "metadata": { + "id": "Djm3pEdfEVHC" + }, + "source": [ + "\n", + "\n", + "### 2.1 Train a Classifier on Encoded Claim Descriptions\n", + "\n", + "We follow the approach presented in Part I of this tutorial.\n", + "\n", + "In this single-language case study, we use the `distilbert-base-uncased` model.\n", + "First, we load the model and the tokenizer." + ] + }, + { + "cell_type": "code", + "execution_count": 14, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 177, + "referenced_widgets": [ + "5de761bf4ce54fff891723d5f98c30c0", + "b366a73190a04eca91fd9e178afbd079", + "e7e87b9254b3409d8fbce91e18cc4e67", + "3b96837862ae49b383cdb217b9e7678b", + "38d82167e54d434db8b4773fccdc6964", + "0b1a03946ab44964ac6edb92aa6db81d", + "0c77cb11648542ae996d05d71def2d0a", + "4a750fab548b4f2cb426ebd59b6daf67", + "5cbe432ada394f689eb626e6ac6ee1e9", + "7d75e25536874831970c370271156295", + "50a7e6c371bf4bbc8fea6a6bdc1e5675", + "936a3987f942462693f82b88a4dc7d87", + "70db356388aa47bb94b9bd9d44886579", + "39e2f380a4c54f518a0f4fb0208f6cf0", + "75657aaf52794cfaa2fd69e9740e9257", + "783f18beb4d94dfaa6b450de189842e5", + "5f86aeb0f83e4206800af67b306a0c0f", + "46d258d710524bef9f8ce4317b3ffdad", + "5014ff2443284a57950aceb5475e9a19", + "f9deae3c7ae346e9b8f1e41c94201957", + "04295d910be446d593fbfebe0a07b625", + "fee0d7272c2645aab945ca5c098d1f84", + "8d2b1667e8b542eda14174a9c3e6f208", + "74adbc967e914123bc2bfc5dacb7630f", + "b7fa2473bfc744b091190c0d64735e20", + "41c26bf23c614163b597e52761facd86", + "55f6187d766a46248f5c56ec666dccb5", + "f64187684eee4c33a1bcc8e17ae98301", + "8435b1c0cd864e8f9f67247c59d8e06f", + "7d8a93c13e8243efbb8df5b8bbf4a9fc", + "99077d65096e4a738cb2f7b6c2aaa7d6", + "c03367c15d71470999dbb00e2429a5f0", + "4cf9b9fbd0334a9b8d6c65850109b41b", + "77b6e23d10f24ae986e796459dd47faf", + "dd5f78d31d85485d89c609a4c1c560b0", + "4954d8ffa3f34b1489a0a548655368ba", + "dd2abf3d137847a0b061bc32e25bf4f5", + "f0f164f0ae99419aaf92f625cb2987e3", + "e2101e95402f4b76a654f2fd06d9cb82", + "ed69ce527b2f480abb6fead6089aa870", + "befc3d34e6924c2d8c5cbfd994c6360e", + "1c82763c43f541a182de5692fc7a1ca2", + "973c00d9934e491b89eb23083f3deeed", + "736f08c910874fafb4a496de8517e53a", + "f667052649984f7295359e00c7dfe491", + "2712323f94c746c3871e424f0c0bc928", + "dacbe9b563e5468ab9d9f0bbf6d47d8c", + "4fcfbef91ffa4dc48eaf062ed2fea45f", + "cb8f544c88c34580947daae0b390779b", + "2f043d8319c4447399ab62735cf6761f", + "d5924691f4164f549756bfd57d83b04f", + "392811b52dc141099d755a7392023722", + "f2f7dcbf838e4938a4f959bbc4b70e12", + "952a86292e0043e89e0adae2df4efc3c", + "3251f229b9a24114b5b1f01d6107b537" + ] + }, + "id": "o7MG5LsCEVHC", + "outputId": "262bba62-45d5-4135-99c7-4fef059adc0c", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "hovertemplate": "x: %{x}
y: %{y}
color: [%{z[0]}, %{z[1]}, %{z[2]}]", - "name": "0", - "source": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAB9AAAAPoCAIAAAAJPPL9AAEAAElEQVR4XuzddXQbV9YA8KsRkyWZGWJ2EoeZOU3SNG1TbrdNmbZbhi1vu1+7bbfcLUPKTdK0YW4YHbSdmJlBzKOB7w85svQEljFO8n5nzx7pvhllKsmjmTt37uOwLAsYhmEYhmEYhmEYhmEYhmEYhvUOgQYwDMMwDMMwDMMwDMMwDMMwDOs+nHDHMAzDMAzDMAzDMAzDMAzDsD6AE+4YhmEYhmEYhmEYhmEYhmEY1gdwwh3DMAzDMAzDMAzDMAzDMAzD+gAPDWAYNoB++u7Ad1/uQaMAH36xIntoHBrtyuqfj/z47T5VmOzVN69PSg5Hh4PQUKfZ+OeJ/NO1TY06i9kuFPLkIeL4xLCcYfF/u2s6ujQ2OPT+c8ec1HrzFf/43PX09QcWz5+Q6TZ+8TlT1vif73c1tOpS48OfXzEvNb4nX48Pft3709YTaNTNIzdMv/WKsWj04nHgdOXj7//pevr7f+5MiFK6nmIYhmEYhmEYhl1wb23b9+3BQOdlTy2YfueUMWgUu0BwhTuGXTp+/HafxUI21Gk2rz+JjgVh17aCe277fM2vR0uLm4wGK00zFgvZ0qw/cazyZF4lujQ2aPTyc8cuVSwLL322ubyuzWp3FFY0vblyJ7oEhmEYhmEYhmEYhmF9DVe4Y9iFdM0N46fPytbrLXqdRa+zfP7RDouFRBfqPh6Xi4a60tigfeeNjZSDBgCRiD9yTHJYuNxBUnq9pbK8dfykNHQFbPDpweeOXcLUenOT2uB6eq6qhWFZgsNxWyQoPVgFwzAMwzAMw7DLwf0//rm3tAqNBicxVLnt0RVo1BeKZvaVVR2vaShqaq3T6I120my387lciYAvEwoTQhWJocqs6IixyXFDwkPRlS8V+Lzs4oIT7hh2IYnFgoSksAQIcz797ss9vUm433bn9B++2Rcdq1x6bbfbO2z686Qz2x4bH/r+p7erQqXuoyzr/syHm6/+sK3VsH7n02KxAB0b9C7sxvf+X+/N545dwpDjMQ6Hw4GeHKL9/Ybpdy6dqDNZdUarzmTVG60ag+XD3/ahy2EYhmEYhmEYhvUpm4P6cn/eL8fOaC1WZIhmKJuD0pittRrdQahxBiPlsiuGZywbmZMVHeG5+EXvyfnT7p8xQWuxas1WncWqtVjVZuvb2/B52SCFE+4YdulYftPE5TdNRKPBKcyvcz649obxSLYdvDJ3iLpadVtrZyHtxeXCbnyf/Ou9+dyxS1hoiDQ2QtHYpnc+HZMVH/gPOQCpWCAVC+IiFM6nNM3ghDuGYRiGYRiGYf2quLntoZ/XN+q6ccrcajStPHTSQdMvLp6Njl38ZEKBTChIUJ0/L2MYnHAftHDCHcMwAID2NqPzQWpalOdI1y7qDu8XduMv7L+OXdo4HPjXfVe8uXJXQ6suNy32nyvmoUtgGIa5oRhLq/Voq/WogSw3O+ocjJlmrFxCzCfkMn5CiCA1UjwhQjyeR0jQNfsHy9Ja+9l22wmdvcTsqLNQLTRrpRkblxDyOBIxL0bGTwwVDYsQjwsR4MZ3HSjGoradarOeMJAVZqrOTmtoxsqwFI8Q8wm5hB8r4yeFCnMjxGOl/Hh05QuBBabdesL5rTOSVSRjoBgLAMvjSPhcuZQXJ+UnqITZYaJRckEy9Og+rYsRC4zWVqgnS/VkmYEst9NaijFTjJlirFxCxOOIeYSER8ik/HgZP1HGTwoRDFEKsjgc3FrQhwv4HWNZWmMvaLee1JOlJketjW6nGBPN2LmEWEAoBFyFjJ8YIR4XIR4v4yegK/e/i253gV2GChta7lz5u9FmRweCcN2Y4WgIwwYWTrhjGAYAYLc5nA9E3W9scuJYD1u2DQYXduMv7L+OXfJy02J/fu02NIph2GWjXP9Tfvs77pEI8dhpsV+6RwDA7Ggo039fY1hPszZkyJnms1LNbda8Cv2vPEKSIFuUqVoh4cUiS/Yho6O6Uv9bvWmbndaiYwAUY6XAaqPVWnthnWkzAMj5yUkhS1NClvMJObq0fySt31g9EwkmyBaOi3oDCfpTqH6/VLcSjQJES6ZPjvkAjfpRrP3ynOZ/SHBJyh4B0VG8FqR268kqw5pG81806yMx4WDMDsZsoZrbrSer4Q8AUAqzU0KuSZQv5XK6feDnD8VY1ldNQYLzEtbKBSlIEABIWlem+77KuJakO+7E8hhl9SSjNzvqwXrUeagk5IbFSmfFyeZFiscjC19K1LZTdcYtDeadPr/8AEAxFgosQKsBQGcvcsV5hDRcNCpCPD5aMtXnG96lWuOm460voFGAOfG/KoSZaLQ79PaSXfU3olGAMZGvJsmXotGALpbvmNlRX67/uc602ec/7dyvWqhGnb2o3rQNHe5KpHj81NjP0Wh3DIbdBXapSglXbX7kDjTaIyRFP/37Fvdsu1wkXDYyZ2p6cmpEqEoiFvJ4FpLUW21V7dryVnVedX1edb3JTgLA0NioS6+fDHbRwQl3DMPAZnPQDINGg2OzOc6c6miXdtG5sBt/Yf91DMMw7DKks5e4P2VZukT3TYn2K5oNagoZirFUGdbUGNdnKG/PVt3X5xW1Vqq5QP1+g2kHC904LDE6qgvVH5Zov81QrUhX3EZwgjrBEXAVEl6shWp0D+rJMvengaltZ9AQAABo7QVoyD+95ycCAFJ+XLey7Tp7cYH63TZrHjoQkM5edKrt3+c0nw0L+3uSfGnfFva6s9ItckCToZX6VYWa9ykG7cYbgJ1WVxnWGMjyyLjeJkMHJz1ZWtD+31brMXQgOBRjbrYcaLYcKFC/qxIOTZJfGS9f2K0v0sVrUH3HHIz5rPqDKuNalqXRsUFgkO8uMMzd7ycLq9o7Lz1OSk1897rFSonIbRGQi4RykTBepZiWnrxiyhiaYQ5V1G44UzQpNdF9MQy7III6HsUwbHDavfPs/738BxoFePalq+YsCHQLVVVF6++/HW1vM7a3GtrbjWZT53Xj++9AC98SEsO++eUB90hZSdOJY1UVZc0V5S31dRqWYZ3xpXPfcl/M6YZbJ9/9QH91T6utbt++Jb/gdG1DncZssXMApDJRdIwyNT1q5JjkCZPTvGci7auNb2rUHtxXmn+qpqqiVac1Oxy0WCKIjFJkZsXMmjd01Fj0uN+pT/71Hn/u7lpb9Fs2nD5xrLKpUWcyWuUh4tj40AmT0xYtHaVQ+G4XcDKv6plHfwKAl/69fNrMLJpmdm4t2L3zbG11u1ZrFgn5UTGKUWOSr1o+LjpGia6MYRiGDQIOxmihGp316SSjP9b8dA8SfAxLFmu/bLUemRj9nojbMfF771UZ1hSo36cYMzoQHAdjPKv+sN64dVzU6yGCdHTYF5Uox2LySLgbHdUM6yA4fPegTwzr0NnPoVEAALDTWrOjPsgmDHqyFIkohTlIxB8WmCLNZyW6b3qc2rPT6hOtr9QZN4+LekPIDUWH+4KVanF/SrO2Yy3PNpn3ugeDFy2ZhoYufixLF2o+KNf91K3rTAFo7We19rNtthMTonwcXl56Bs93TGcvPtL8mIVqRgcGgYtid4Fh7jYXdl6QjlbIP75pqUTQxa8zlyCmpSdPS09GBzDsQsAJdwy7HNXVqrdt8l2WFYw/V+dt35KPRgcWw7BffrLz91XHXDlrJ53WrNOai881bFp3UiwW/PD7w0j6uPcb39Kke+8/m094tV83GW0mo62yvGXLxtMTp6S/8Nq1QiG6j+39v957LAs/fbf/55UHHI7OA26txqzVmM/m1/3246H7/j7viiUjO1fwUlvdrm43vvLc6uJznXkKk4M2ldkqylrWrz3xxHNLZs8f5rYGhmEYNljo7CUSXqyDMe5vuNc72xs8ja1gX8OKqbFfSHjR6Fg3MazjdPv/VRv+RAe6T0+W7mm4Y1zkv2OkM9ExL0phToNpp3uEZWmjo0ohyHAP+qSzFwe4LUBjLwgm4U4xFpOjHgmqgku4OxjzsZZnWiwH0YHua7Ue+6v+pikx/wsRpKJjvWalWl2PHYzxUNPf/d0ZEIwYac+ToYMTw5KHmx/vk88RkRJyDRq6RA2S75jadupg00PdqqkfMBfL7gLD3BU2dF5Lu2bU0C6z7Rg22KDJoAtl8ZavinStAPDV9Otnx+GJj/rMx2cPvpvv4/L+7/NuHxUeh0axi82U6Znf/fqgXm8x6K16neXn7w821mvQhXxJS4964JH57pFvv9htszkA4LqbJ4aHh7gPyUM87tsCgNnzh6Wmd5xd20nHN5/tdj6++8E5fB56d3lmdgwS6RPffrF7za9HnY+jY5RpGdEhCjHloJub9RVlzc6a/exhcd7F2r3feKVKWlba5HwsFPHT0qNi4lRCIV/dbsw/VWOxkABw5GDZR//d8uQ/r/RYsy/+dejF5+70zv9t2L654zwkNEw2LDdBJhfp9ZbCM3V6ncVssr/7xkZ1m/HWFX7PN0qLGw8fKC0pauRwIC0jJiklnM/j1tWqzxbUsSyQJPX2v9fHJ4ZlZPnefgzDMOwC0ttLYiTTDzX9ozfZdieTo+5Q00Mz4r7nE1J0LGgMSx1tearH5ajeKMZypPmJMZH/SpQvRsc8+Uxt6+1lwSTc1bbTaMiNxpafILsCjXrRk6UAHnUD4GerEBRjPtB4n9Z+Fh3oKSvVuq/xrmmxXyqCuzkgeK7qY4Yle5kJlfCig7x34SJyvPWlPkmDIqT8+EjxBDR6iRoM3zGTo+5Q0yP+su0cIEIEaaGi4UKuikfIKMZMMnqdvUhnL2JYCl3aPw6HK+HFKIXZ6EBAF9HuAsNcTHbS5uj860iL7LPb6TBswAyWhDuGYT0gEPDiEkLjEjru6du+JT/IxGtsfOg1N3h0J/xp5X5nwn3O/OGp6VHuQ97GjB8yZvwQ52OTyebKGi+9Zox3C5f+YLGQf6w6BgAEwXnulatnzvE4NWUYtvhcw55d58ae30h3vd94oYh/7Q0TKspaFiweMWpsCp/fmSg3m+z/eW3d4QOlALB9S/7td8+IiPS4etH7fx168bkDwPq1x53Zdh6PeOixhYuXjuIQHX0YaZr5Y3Xel5/sZBh25Vd70zKiJ07xfRh9aH8pACQmh//zlavdvy0lRY0vPPWbTmumKOaHb/a99tYNnetchAhOxzvDsOzBM1V7TpSdq2ppVhusdodUJAiRitISwkdlxF8xJUclF3uu2gUHRZ8oqjtV2lBa01rTrNWbbRYbKeRzpSJhmFKanhA+PC12zth0uRS91hXAlkNFL3+xBY26mTch898PdJF7uvS0aU0780oPnK5sbNO3680CPi9SJUuLD583IXPS8GTnVS7va11d6qtP8P43V50srgeAJ2+dff3ckQBQ1aj+fO2hvKI6u90RF6lcOCnrloVjBPzOo7XNB8+t2nm6vL5dyOcmxYQunJS9fPYI4vxfcQB9tc0+maz27UdKTpXUF1e36ExWo8XOeN575NP910y5c2nX+SC13nzgdOXB/KraZq3GYDFZ7CFSUWiIJCcleuLw5CkjUsRCXPHUPTqy+KzmY7XtFBLnEdII8dhQ4XAhVyXgKrkcIckYTGRNm+242nrKX7MLA1l5vPX5SdHvowNBO9H6YoBsOweIUNHwMNEoGT9JyFUSHAHN2m10u5GsbLee9HfNgAXmROtLPEIUK52DjrlR+cpb6clSgK73loGTehpbIRryRW/33n5Oly1lGNZxqPmRAOkzAVcRLhobKhom5KoEhBIASEZnp7UaW0Gb9biDMaArAAAASesPNT0yK/7HPmwTBG7J0BOtr/h702T8RBE3XMBVCAgFxVodjNHkqDU7GpCrEb3p9TE41Ro3BZgzk0eIw0SjFYJ0KT9eQIRwCREAx8EYHLTRSrXoyXI9WWb1070kJeSay6fR9gX/jrHA5LU862BM6AAAlyNMVdyYprzN55+VgzFXGVaV6lb6nFtVwFWEiUbJ+AlSfoKUFy/jJ0h4Md2dOePi2l1gmIvrROy8rg8sByGjzb6poOR4df25platxWq02ekgjpAfmTP5gRldHyH3BwdNH62qP15dX9TcVt2u1VltZjsp5HFlQmGEXJoZFT4yMWZBTnqIuCfnCzTDHK2q21taVdLcXqPRmWx2q8Mh4PEkAn6kXJYcpsyICh+fkpAbF83jEujKAfXfK/cSTrhf4u7MHHdFQpbWbtHYrRq75d+ndpodJLoQhl1s6mra7XYKANIyopFsOwAQBCdnWHzOsK5v5e6xm2+fioYAAEAqE/7z1atvueZDg97KMuyZkzVzFwbbVH0AWK3kt5/vcT5+5MkrrrhylPsol0ssv3ECweF8+uF2APj43a3jJqZy/fwmyeSitz+8NTRM5h7MzI594JF5b7z6JwCcOFZJOWie29WIi45YyAOA/PLGf3+zo6pR7T5ktNiNFntDm37vyYpP1x68ecGY+66eHEzSs7Ciac2uM3tPlZut6K7YQjMWm6NNZyqubtmw/+zbP/x19czcB5dPlYhwMrEnSIpeufHYyo3HSKqzdZKdpIxmW0V9+7YjxfGRypfuXjAyIy6kOynmfvoEq5vUAHCmrPGRd3632h3OYFWj+tPfD+4/XfnJ08vFQj7Lwqtfbd18sKNnNOmgCiuaCiua9p4s/+CJawIcPvbTNjsxDPv1+iM/bT1hsaEv3nsGs+3rdUdW7zpN0R6pXo3BojFYyuvb1+8vDA2R3Ll0YpBXHTCnJvPeJvBIcMv4icPC/hEtme5zutFsAAvVWKz5stq4zucZb5N5b41xfZJ8KToQhFLdd3WmrWgUADoSVTenKm4Q8/zWARgd1WW6H2oMf3pfD2CBOd764sy4pBCB33tn+USIlB9v9mzqYiDL3Z/6o/GT13PSkyUMSxKcLi6l68gSJCLjJ/AJj99Wb/nqd9qtJ9EoAACEinKzVPdES6b4S7aywDSYdhRpPjM6qtExACvVfKzlmemxX/pbvQecydBK/ao6k8dVYQ4QcbK5MdKZkeLxQl85O4qxaOwFzZYDzeZ9JkctAET3tNfH4MSy9FnNx2gUAABk/MQs1b3xsgU+/yTd2WlNq/VIi+Vwq+WIjW53BgkOL0l+leeCl7IL/h2rMazT+prRQcyLnBT9foCCdD4hzVCuiJddcbj5Ue/5k1mWGRXxvIgbjsS75eLaXWCYi0TAF/J4dqqjyL2sVd31XWODCc2wn+498t2hk2Z73x8h94f8+uafjp7+q7jC5LXBFpKxkI5Wo+lsY8vaU2df27j7hnHDH5s7NfgmPywLv58s/Hj34RYDemHSSjqspENtshQ1tW4pLAUAuUh4xbCMWyaMzIjqeu/Xf6/cJ/yenmGXBglPkBoSNjYiYX58xo2pI8XcYP8kMGww452vSG1vM5JkN+7EHAAiEX/cxI5z+7ZW31UhF8rOrQUmkw0AEpPDFy7xyLa7LLtuXFS0AgBamvX79xSjw+dde8MEJNvuNG1WNo9HAIDDQdfXBVt3PzhJxcKdx0rvf2MVkm1H2Enq2w1HH3vvD9ozJ+jtvZ/33PnaL5sPnfPOe3pzUPSqnafu+NdPBrMNHfMFZxvd2Ujq72///uWfh92z7Yj6Vt19b/y2ZtcZZdA3KPTfJ1jVoDFbyec+2eDKtrsUVjR9+vtBAPhhc54r2+4u71ztN+uPoNHz+m+bAcBqdzzwn9Vf/nm4B9n2MIU0XBmoCUlRVct1z333y/aTSLYdoTFY3vnxr8fe+yOY/0DMpwzlirkJv8dKZwdI7Ul4saMjX54U/S6P8P33UqB+rweTnersRWfVH6FRAABQCrPnJKweFvZIgGw7AMj5yaMjXpwZ/73PhukUYz3S/GSATusA4J0L81V1jjI76l3JTac4z1J6hnXo7H5/Q128U2xd9pNpMu+p1K9CowAEhz864sWZcSujJVMD5L84QMTLFsxN/H2I4np0DAAA2q0nKvS/odFesFKtJkdtgfo992CcdM6chNXjo/6TILvCZyYUAHiEJFI8ITfsifmJ62bEfZcSsjxC7HF35sWu2XLAZ316tGTq7PhfEuWLA/xJugi5oQmyRWMjX1uUvH167NfJIdfwiZAY6azLak7LC/sdY4Ep1X2LRgEIjmByzEfeexhvEl701JhPvDfSwRjPtL+FBLvlottdYJi7nNhI1+MNZ4oDHxAOKlbSccd3qz/ZfaQH2fZwmTRSHugIuT+8sWXvDV/8sv5MkXe23ZuDpn88cvr6z3/WW4M6X7BT1KO/bXxx3Q7vnLhPRpt91fGCqnYtOuCl/165r3T9K45hGDbYJA+JUCglep1Foza98NRvjzx5Rfz5/iqDQWRURxsZi8XuOXKBuSZ6nT4rG71L7zyC4EybmeXsj593pML7BgKn6bN8nz/w+dywcHlLsx4AjAbfjSwvFrXN2jdX7nQd2wl43JS4MFWIhKKYxnZ9Y5vefeHDBdWfrj348HWBCqMmj0j5ZTtaZBShkkWHyUMkIruDbtEY6lp07qPVjZoXPtv84RPXuAd9WjAxa+boNK3RqjNZ9UarzmTVGa3fb85r0wZ1/HEpYRj28ff+PFXiUbIq4HGHxIeHhkjMVntju8H5trAsvPPjXwQRqOOEu/77BKsa1b9sP9muMwt43KGpMTTNFFQ0sucridf+dWbp9GFfrjsMAAIeN2dINEFwzpQ1uq7x/Lbj1B1Lxrt3nnHpv20GgJc+3+L+PidFq5ZMG5qZGCkVC40WW1F1y/q9hU3qzuuOKrn4nyvmxUUq4yOVIoGPrXU5UVT3xAd/Wmwelx9iIxQxYSEiAU9vtlU2qN2z/IcLqh94c9WXz98oDPiymLdM1V1DQx9Go37ESGdOjH73YNPDLIteyiJpXZnuh+zQ+5F4ACwwp9pe965MB4Bw0ejJMR/xCAk64IdKOHRm3Hf7G+81kB0/cy4mR02x5rOhYY8gcReVMKfBtMM9YqPbSVon4CrdgwikbQWXI0hRXNdg3uUe1NgLQkW57hEEC4x3NX3gfjIUYz3d/h80CsDlCKfGfhom8n0p3RsHiJHhz/EJeYn2a3QMoEjzWaJ8SZeF9kEiGf3BpgdptuO0nAPEiPBn/OXv/AkTjQgTjUCjFzmfrdtF3LBxUW8G/+V3wwkXjw4Xjx4Z/qyDMaKDl7QL+x1rt540OerQKECm6q5gZoNwEnLDRoQ/fazlGSTeYNppDq33eUGxSxfj7gLD3E1PTz5V2+h8XK/Vv7F1z4uLZ3suMkg99fuW49UNrqcp4aqrRw3NjomUCQUGm/1sQ8uak4WNus4j5FCp+F9L5yWEKhJDlSJfx/P9bUZG8veH0fOFqBBZjEIeIhaRFNWoM9ZqdO6jFW2aJ1dv/vJvXZ8v/HvTnu3nytwjUqEgKVQZKhVzCcJkJ5v1xka9wXXiAwBhMsmcrNTO53703yv3lQvwWWIYhvUSl0vc+/Dct19fDwCnjlfdefOn4yakLrpy1ITJaYOhh4mrAN995z4YlBV3FFKlnZ+41ae0zBjng6KzHilLF4GAl5CIluG4CM4nvBwONCNzcXnr+13ObHtMeMiDy6dOH5Xq3iq6pln78ap9e09WuCK/bDt547zRAYp2JwxNykiMKK1tk0uE00alTh+VOiozHun/3qQ2fLfh2B978l2RIwXVJ4vrR2d1fa4lFPCiw+TRYXJXZNPBc5dhwv23naeOF9W6ngoFvPuunrxs5nCZWOgKVtS3f73+yM5jpQzLvrlypyseWP99ghqD5ev1R9ITIt5/4uoIpQwA8s7VPvLftc6UOknRj7/3h52kclKi3/nHVc7vWEF5031v/Ob8ihot9tOljeOHJnq+KkB/bvP+05V7T3bmCq+Zlfv0bXPc77SYnJty26Jx//py6/ajHTW8WqOVxyXS4sNdy/jUpjM997+Nrmw7j0vcOH/09XNHuX+3aZo5Ulj9yeoD5fUdVcbFNa1v/bDrxbsWuJbBuhQtmRp8tt0pUjwxW3XfOc3/0AGACsOvGao7uV01UXGpM27x2YRByo+bGPNudxOOQm7Y5JiP/qq/2bsVcpn+h+SQa6X8OCTu5LOiXE+WBi50RfrJhAjSQ4XDADjuLXc0tgJQuC3kxUTW0Cx6YV4lHIpE3JXpf/BZEz0y4vng02cuOaEPtlnzNLbOv30nktGX63/OVt2LxHvM7OjIO3A43EnR70dLpnqOX6a8GwoBQKL8yt5MQQwABId/WZW3O13A71iTeTcaAiA4giEh16HRgOJkcyXqGAvV5Blmqwxrh/m/ZBjARbq7wDCXG8blfr7vmGvq1J+PnmkxmF5eMidiwAvAu2V3SeWuos4zxBvH5b6weDbX7Qh5enryXVPHPvfHts0FHb8CGrOVxyUGrM+Jt8mpSVnREcXNbXKRcHZW6uysIWOT4kOlHucLjTrD5/uOrTpe4IocKK/Jq64flxzofKGyXbP6ROcqOTGRTy2YPi453v0NAQAL6ThV23iwombnufI6rf7a0cMCdMt06r9X7kM44Y5h2EVp/hW5IiH/4/e2ajVmlmGPHS4/drhcHiKeu2DYkmVjEpP7/eeKZaGkqOFkXlVVRWtLs95osFosJGmnSJJyuM2oPqjotB33+4eGB6pDCTvfK0antXiOdFAoJa6pVi9hzm4kIzPi3n/8Gu+W1knRqrf+ftWrX27dfKgjYeSg6PX7CgNPAvnwddPadOb5EzL91eHGhIU8d8fcuAjFx6v3u4LbjxYHTn1iLlqD5fO1nTWDAj7vf09fNzyt4xqSS2p8+P89uGTokBMf/LoXGQqs/z5BmmZeu3+RM9sOAONyEhdPzlm/v9D5tFltFPB5bz58peuKzvC0mDnjMrYd6ehZUVDhO+EO/bbNP2zOcz3OSYlGsu1OAh73pXsWFlW31rV03Lz5++78KSOGeC6FevXLrTpjx/0xEhH//cevGZmBpkq5XGLKiCFjshMff+9P1/WVDfvPLp4yNPBmYy4cIIaHP4FGg5ChvKPWuMG7opOk9Q2m7YnyJUjcJxaYEu1XaBQAAEZHvCQgAiaq/ZDwYnPDnjre+gISZ1iqRPvV6MiXkbiTUpiNJMoBQE+WB064q22n3Z8qhdk8QirnJ7l3OvbOTCG8860cIJTCLCToQjHmCt3PaBQgTjonSX4lGg0CB4hRES/sqvNRCFxt+D1LeVd3p2fsUk7oQwOZCR3k7LSPhnUBphzAgjHw3zFkb+AUIR4r5KrQaEAcIGKkMyr0vyLxVusRgG4n3C+B3QWGqSTipxdM/9fGv1yRXUUVB8trbpkw8tYJI6MVnXUYg8rXB467Hg+Pi0Ky7U4CHveNqxecbWypUeuckV/z8mdkpHgsNLCemD+t1WhaNCzTX4l9rDLk1aVzE1SK/+444ApuLigJnHDffrazAj0qRPb9nddJhT4qMyQC/pS0pClpSU8vmH6qtjFe1fVxYP+9ch/y/VYOPI6/7gYYhmF+TJ+dPW5S6qY/T/75+/GWJh0AGA3WP1bn/bkmb+qMrPsenhsVo0RW6SsH9hZ/9elfDRdVj3KGYV397oXCQDt/kbgjuWwxo5V3TiKv7POlKjRE8u5jy7yz7U4cDjx526w9J8tcpbgniusCJ9wnDk9GQ77cumjsxgNnq5s6vmCnSjrvScQC23yoyL0PyYPLp3hn211uWTjmZHHd/tNoD4oA+u8TzE6JGhLncePIrHHproQ7AEwfNcS9xBsAxmQnuBLuDa1oVa9Lf2yz2Urml3fc5AsAN84f5Z1tdxLwuMvnjHjv5z3Op8fO1tI04282ZgA4WVx/7GznDQrP3THPO9vuIhLw/nXfFcuf/cb1oX+78ShOuAcpWjpdzk9Go0EgOPx05e2n2l5HBwDqTduCTLi3WY/5nIUvWjI1cKY7sET54nL9j97N02tNG4eG/d1n2S+fkMv48cj1A4O98yzOG8WYDWRn8RoAKIWZAKASDXX/j7JQTXZa7d2X2cW7WbxMkBSgtL/WuJFkvP/SOdmh96GxoCkE6WGiEUiHHACwUq2t1qNRkslIvDcixOMzlXeg0csY49WaCeulC/EdY70bQwFAqHAYGgpCqCjXO+GuJ0tp1sbliJB4YBf77gK7eFW1a7Nfeg+N+hEmkxx4OtB38qbxI2o0upWHOrud2BzU1weOf3fo5MzMlGUjc2ZkpPC5g+hij8lOnq7rPEK+bdJo72y7k4DHvXn8iDe2dJT+HK6opRmGS/g9Qu5vU9OS0JAvd04d+8epc5XtHecLeW6dc3yq1xpcjycOSfSZE0eMSoxFQ7703yv3oUA5lz53oLlqdeWZE2317TazjC9MDQlbkpRzQ+pIAcEVEF3/kTRaDKsqTu9vrqo16fSkVSkQJ8lVs2PTbkwdqRL6PTZ16fHqH589+G7+XgA4evU/IkRSACjRtf5cfupIa02TxciwbIRYmqWMnBGTet2QEdz+uXJwoLlqbVXBaXVjq9VkofzOY/DznFsmRgb1dxK8WpNuR33J0dbaEn2b2ma207SML4iVhAwPi1maNHRyVDK6gpdyQ/vaqoJjrbVVRq3JYecAyAWiBKkiWxU1KSppdmyahBfob6OXq2OXNrFYsPymidfeOPFkXuW2TWcO7ishSYplYf+e4hN5Vf/6z/UjRvXxXwQA/PLDwW8+67h7NEQhHjchNTU9OipaIZOLxBKBUMj/Y/WxrRtPe6wzCBAERyji220OALDbOzLvPtmsHakribSzBcfl6b5rJrv3IfEmEwunjhji6phRXN3iOd5DBIcza2z6txuOOp+2aIye45hfmw6cdT0ODZEsnzOyc8yXe66e3K2Ee5B68AkOG4JeGMhMjHR/OjYbLWCPj+ys0eh976BubXNxdQvDdFYEj84MlOMe5TZKOqjaFm1KrN8U5C/bT7geZyZFLpjot9rXKVwpXTgpe+3ujlLio4U1bTqT60YBLIAgM+M+JcoXF6j/SzHoRB2t1mMUY+YF0RCjxrABDQEAQLrydjTUTenK2/NankOCDEvVGjemK/+GxJ2Uwhwk4a4n0VS4O429AGk975wXUSnMqTVuco9rbAUx0pnuEXd6rwp3n/1tXGqMPt60KMnkEEE6Gu2ORPmV3hk0AGi27O/bDFpO6APgf3rGy5CACLEC2vFDT5YALEaCWJAG/jtmpzU+p2WWCZLRUBBk/AQ0BMCytMXRJBekoAMBXey7CwxzeXbhjASV4p3t+129ZQCAZphdRRW7iiqUEtHSEdnXjh52AfuxuDvb2EK7HSEHrv4e6zZqp6hqtTY1wu8R8iBBcDjzctI+33fM+bTZEOh8AaE2ddxt3+f675V7aYAS7hTDPHN04x/VnYVaGrtF02bJa6v7sezkF9OWKwVit8VRLMBHhQf+d/YgyXQWArTbzO0284m2+s/OHX5+1NzrU0e4reGhl6u7tFiNESLpB4X7Pyo8wLj1Zq4xkjVG7VlN842pIzuX7iMWyvHY4XU76gMd9ztxAHicvrwgVm/W//PY5gPNVUhcT9r0pK1I17qq4sycuPSPplwt4vr+ItEs++bpv74tOeb+dgGA2mZW28yn1Y2/lJ+S8AT7lz7o85pHL1fHLh8cDowZP2TM+CEGvXXjnydW/XzYbLJbzPZ/Pb/m+1UPS2WBEqbdVVne+u0Xe5yPr75u3F0PzPGuFpf16b/Yh1QqaXOTDgDU7YF+Gl2jqtCukyaXMKGA12WyDwCykqNcCXejxR64ejd4KbGdlZgWG0nRzED2m7tIaQ0WV0dvAJgxOk1wfkIFf7KSImPCQ5raO0sk+kp3P8GkGBUSCVVICA7H9QuY6tX6XCnrPHaykZ11/T0W/DZrDBbXY4LDiVAFuqs3UuWR/tYarCl+6kssNseBM51HHVdMznYb9GvCsCRXwh0AThbXB/OXe5njcLiR4oloNGhcjihaMq3etB2JMyyptp3pMu3CsnSTpaOky52EFxshHoNGuylWOptPyBwMegmqzrTFX8JdJcypN21zjxjIChYYDvj+/iP5Jg6H68xheafLNbb8AAl3nR1NuAeYMdXsaNDaOy8ousRKZ6GhbvI3s2ubteN0uk+ohDlhopFo9PIm4cd6X9qpNW7KUt3NJ0KQONalC/IdI2nfxw98ItDPoj/+1vJVqx7Ixb67wDDELRNGTktPfmvbPvfe6E46i+37w6e+P3xqTFLcvdPHT09PRhYYYBqzxxFylDxQCQgyqjFbUyPcA4NUamTnVQGzPdD5AgCkRXaeXByqqD1UUTM5tW8KIvvvlfsQmifqJ08e2bC+pmOnHyWWjY9MlPAETRZDXmtdmb7ttt0/x0o7q7S8PXN045rKjlOpSLFsTHi8QiDS2q15bXUau8XosD97bFOL1fj3YVM91+vQy9Vd2qymD+r3f1C4HwAkPH5aSLiEJ2i2GuvNOophZsWmoSv0hcfPZ9ulfMGKjHE5qighl1dpUH9fdqLOpAMAgsN5Z+KVQ1VRiTKV0E/iu2fCRJKz2o6yCzGXn62KSpIpRTx+q9V0pLXG7CABYFdD2UvHt741wXeR1H/z93xd3FErlyBT5qiiVAKxg6Hrzfpz2hajww4Ao8Lj/KXLe7k6dhkKUYhvvn3qzDk5D9/zrdFgNeitB/eXzL/C96Fhz+zeWcgyLACkZ0Y/8I8FPu9pMRptaGhwyB4a50y4lxY3TZ3hNyFVVtLxh5+Z7ScrdnnITYuViLq+gUYl99gFmaykQta92359knpW1pMOOsChDOZU5HmHgb+e5ojctNj+SLh39xNEvkgAQHA4QgHPau/IpCNpawDgu/VYtJ9vGNUbwW+za6sAgMclfO4JXfieL+Kg/XZRKKxocs4T6zQ+J6hPEJmFtbCiaZAk3B00veHouT+PnG1o1xutdpVMHBemmJyTvHzycPeLJQCw7WTJnoLKN26/wj3YrxSCjF5OzBgpnuidcAcAte10lwl3tf0MxfioRYqRTu99dSqXI4iUTGww7UTiOnuJvwYvzvp0dzRrNzvqZHzfZ25q62n3p3J+inOqWKUwiwOEe/G7xt5ZbISw02rvFt7eKXuXVuthNAQAAL1vVx0iSOVyRDSLHroYyWqKsfKIQEVRwUsOuRoNXfbCRaObzHuQoJ3WHGv558To/3I5g7R6Y9C6IN8x73mPnXicnvzh+PvQKaYzhReMi313EdiNCfdrmnVcHnej8XtuV3UVTizDLpLeSlN0aLTy17rP0OHLzCvXvnNo/XEAuO3F5be9tBwdPu+Hf6354bU1ADBh0ajX1j2DDg+4xFDlxzctLWpq/e7Qye3nytyr3Z1O1DTc98MfufHRL185JyfG4ybRgWRxq4DpwyPkQUXm2byFpP2eLwDAgqEZ72w/QDMMADAse9+Pf94yYeRdU8b2fubb/nvlPtSX+Vl/dtSXurLtD+RMfjx3hqvvitZu/Wfe5m11JfVmv5dtfyw74UyX8wjilTELbkwd6fra0izzXUnem6f/oln2vYJ9OaqoOXHoTVK9XN3d6sr8bXXF0WL5c6PmXJGQxTvfX8nksO9sKEtToKVnvXe0tXZ7fSkASHj8zQvvTpApnfFZsWm3pI9ZvmPlOW0Lw7L1Zv2y5GHuK/YJMZd/Z+b4c9qW64aMmByd7N72x+iwP3F4/c6GMgBYW1Xw+PAZ0RL0grzZQX5XkgcAXA7nvclXLUn0OIWgWfaMunFT7blp0UPc4y69XB0bMHy3Ax2rhRSLu05Q9rfY+NBZ84au//04ADQ1aNFhNz3Y+OZGnfPBsNwEf7+ghfked6b704N/vZfGT0rbvfMsAOzfXbTi3lk+t59h2AN7i52Px4xL8Ry8vKQnBFVjwOd7HOtTfXSo5OvDwbpQ4VbeDgDJMaHuT/1JCm6x7uruJxji6zqNeydH7ws57kfx7rev9ljw2yx121+RFG21O8RCvtu4B53Jo/GI96UFl4KKRtdjDgcSo1Vug37JJR7vjNat+v4CYlj24U//PFpSG62SjxwSK+BxW3SmorrWwprm66ail4H3FFS26tCK7H4VYGbOIIWKfN8bqrWfQ0Ne2q2djYPcRYjHoaEeiRRP8E64A7Ct1rwE2UI03FFXzkHnTbWX+Uy4s8Bo7QXuEdebyeWI5IJUA1nmGtLaz/qrlPcubw88Y2qrrwJSMS9KzItCo93EAULCjzGS6C2tLDAmR7X31YieCRONQkOXvVjprEL1+0h7IgBosRzc03D7qPDnQ0XDkSEsgAvyHeMS6E+zk/dNNsHwt5a/RLw/F/vuIrDY1GhNs46m6NY6dUxKUHlVbYuepmgAiE4OavmBd8uQh9rq1Ou034m9DvYuOinhqs2P3IFG+0h2TOR/rl34wuJZmwpK/jh1Nr++o0rMJb+++frPf3541qT7Z0xAhgaGTNj510pStJV0iAV+j5C1Fo9rV6FSv0fIg0rw5wsAEKOQr5gy5qv9ec6nFM2sPHTy56Nn5manXTdm2IQhCV1clPCv/165Dw1Ewv1/5w45HyxKzH5qxEz3IZVQ/PGUq6/c+k2xrtU97mKhyHfy9zofvzZ24Q2ePVu4HOKurAkcDuf1kzsB4JUT22fGpnLd2qr0cnXE1rriaLH8zwUrIsUeVWYyvrA/8t0AsK2u41j81vQxrmy7k4jLe3T49Hv3rQaAbXXFDw+d4j7aVx7y87JyvvD9ycumrf9Ya7cyLHu4teZqr3egwqi20RQA5KiikXQ5AHA5nNHhcaPD45C4Sy9XxwaMUMQXifg2mwMAKstbQsM8/jouFNdsnyEhgUoterDxgvNJJZ3Wd05nx5b8ICdT7cG/3ksz5+R8+b9dGrWpvk6z8c8TV17t4879P1fntTTrASA0TDZjNvqnd1lBJqjsWwzLllS3ltW3VdarWzRGg9mmN1mtdsruoEgHZSepPilYvtzojB6J3ZjwQDfPuXhXjgejzz9BoVu5uk+CrhboUh9uM9Lfpri6xb1RO+JcVeedBzwu4d56HtGi7ux2xbIw9Z4P3QaDheT3L5TDRTVHS2pnj0h7564lriN+u4OqaFYrPK8QMAx7rKQ2OapfLvz44zOV3C1yQTLBETBezYtNjhok4k3vlWt2ClDf3S0q4VA0BAAAOvs5nwl3PiGV8RORLdeTpXEw1z3iZCArHJ7l+e5ZcpUwxz3hTjEWA1mh8NU02buBu1wwJMC8iDp7ERoCkPGDugukS3zC927QQjX3SQaNT8hDBLhEBiXlx8dIZzSad6MDAHp7yZ6Gv8VIZ2Qq7/TXxANzd6G+YwLC9y8ayejQUBDstO86IQE3qMvPLhf17qJLsalRhQeLAaCpsiXIhHt7Y8epWVRyUMU0A6y+tLGtDr3hCQtALhLeOC73xnG5Ve3aX/Py/zh11mjrvNeEZtgPdh0y2OxPL5juttIASY/yuJHubGPr2GS/OauChs4LBjwukaDyvT8ZYAzLnmtsLWlpL2ttb9GbdFabzmK1Ohx2B2WnaBtF2b1uLwjs0TlTtGbr7yc77/lz0PSWwpIthSVRIbIluVlXjxqaGtGTw+D+e+W+0tuTty7VmrRn1B31Sj6TwlwOcU/2xCcOr0cHAADgj6pCA2kDgLSQ8Ov9dEi/PWPctyV5DWZ9g1m/pa7YPTnby9W9vThmHpJt71eVxo49b7bSx2+JK1hlDCq717ckPP6MmNQ/qwsBoMlsQIfdGso3Wwx2mupuu5tero4NpKG5CSeOVQLA15/tTs+MUSj7/drszysPNDXqZs7JGT4yUSDw+G6wDLtja/7uHR131YwZ38XBd3c3PjMrZvvmMwBw+EBpdVVbckrncRvLsFs2nv743a2dS3elu/96L/H43IceW/DaC78DwCfvbWMZ9sqrx3DOz5zOMOy6NXmff7zD+fTeh+fyPGu3LzeS/rnnoLJB/cv2k/tOVQySOtxLicnamfvjcCBAzbU7UXCLufTTJxjgZkynLhcIoM+3OTkmNDZC0dimdz5dt7cwQMJ93d7O4+ARGXEBOjUZLb7vze+W4C8b9KsmrQEAZg4f4l5fI+TzchI6CwxXH8hfd+RsWWO73UGpjZaRf3/PNXTig3+439/Q56S8WDTUTRwgpLxYo6MaiVscjQzrIDiB/qz0ZDkaAuARUjEvGo32iL/ZBb2Lyl1Uwmwk4W7wtZEAoLadRiJKQWeOSSUaWmNc5zYIWluB74S7vRSJBLjeQDFWs6MBjQJIfU2x2AP+Okd7N73pGaUwq5slcZeLYWGPtVgOezfocGoy720y71UJh6UqboyTzXN2LsJ8ulDfMSFXJeAqSVqHxHX24iT5VUiwSz7vEOIAIeX7Tdh5u9h3F12KTe34GW2u8l2y6a29oSNbEj0oE+4ndnrcNYUFLyVc9dwVMx6dM/nnY2e+OpCncysY//bgifHJ8TMzu0gF9Lkh4aHxKkW9tuMIefWJggAJd/dM8ZjEOKlnq5aBV96qXnn45O7iSrVbJ/re4xKc15fNm5Od+tbWfdVqj8uKLQbT1weOf33g+KjE2NsmjlowNL1bZen998p9pd+TmCfbO3b3MZKQLF9ZYwCYFu37sBgAXDN2XpGY5e/t4XI4CxOynM2+9zVVumfMe7k6QiEQLYjPRKP9yXF+llcRz8d5i2uqUtpzTtEBEysNcT4wUT7OkDOVEaFCicZuabOZ79q76rVxC1Pk3bi41MvVLwpajdlgsJpNNrPJbjbbzSab3eZwDh3YU9xYr5FIhVKpUCIVSmXCiEgFj+dx7m00WHVai9lsM5vsZpPdbLa1t3XUBp7Mq2IY1rmiVCqUSoVhESHec3v2lauvG+/MGpeXNt9xw/+Gj0wMC5fZ7ZTRYFW3G5deM3bhkpHoOr1jsZBbN57euvG0QMBLSomIi1fJ5CKGYbUac0lRo0Ztci62ZNnoxGSPMkxv3d342QuGrfx6r0FvtdkcD674avqs7ISkcC6XaGnW5R2tbGnSSSSCm2+fuvKrve5r+dPdfx16/blPn5V909+m/PL9QZpmPnp3608rDwzLTZCHiI0Ga8GZWq2mo2rvmhvGz5k/zH3Fy5DI/w2APWMjqbd/2LXpwDlkImisr7g3FhfweUEeVgWZl4d+/gT7Kbvaf9t83ZyRH/zasaPbfOjc+KGJi6b4OIL6Ycvx40W1rqe3LvRxY42LqS8S7oNEQrgSAI6W1C2d4LvaGgBSokKvmTycZph//7YrKVJ1+5yxriHC/w2XfULI7YNjKgk/xjvhzgJjpzWBGxdYqSY0BCDl+T0j7S4uRyTihtvodiRuoXwkoZyUwpw6k8f1cr1bobo7jeeMqQAchbDz7MA7aa6xFSSHXIMEAUDnVeHuva6LmapHOt44VRvWVhvWotG+QzF9c7+IgDsoqvYGIRk/YUT4MyfbXkUH3GjthcdbXzjT/laifFGSfOnAFBFfdC7gd0wlHNpiOYgEezaJaJs1Dw0BKISZ3Wopc7HvLroUm9pxabapsvP+ucDU5yvco4OriB9gJ3fmoyGsO8QC/l1Tx14zeugLf+74q7jCFf9g16GBT7gDwM3jR7y1bZ/z8fozRZNTE68a6eP3/esDx49UdvahXTEl0BFyf7M5qNc2/vXn6b4/X3CZlTlkenrKlsKSlYdPFjagf7ynahtP1TYmhSmfXjB9dlYqMhpY/71y7/VXAs6lVN/mfJCp8Hs5MVwkVQhEetLHtf0CTccReY4q0IH7sPOjp87n9516uTpiWGjMAF8ViZcqAWoAoNLg44pxxflgfMApZ/sPnxOo+pXLIZ4bNeepIxsA4FBL9bxNn0+PGXJD6sjZsWl8t3bw/vRy9YvCS8+sKj7n+yu36ufDSOS9T28flutRmPDJe9t2be+8KOpu+5b87Vs8frmfev7K+YtGuEf60ITJabeumPbjt/sBwGSyHT7gUbRlMXfWnPYVVxKZJKmykqayEvTUnSA4y64bd9/D85C4t+5uvEwmeuWN6156ZpXJaHM4aOQjiIgMef5f16SkRn7/zT7n3KqBdfdfh7743O+8b1Z4hPzrT/+yWEiN2rRvd5H7qEjEv/2emctvnOAexHrPbCUfeHNVcY1HMY5MLBydFZ8aH54YpVKGiBVSkVjIFwn5IgHvYH7V619vd18Y65LI7X4Xh6PjinWX2OCOLC/GT7Bft/m6uSM37C+sbOg4FHnly637T1cunpKTnhghEQlMVntpTeufewoO5neUPgDA7LHpU0YEOvMRuV0gFAl4E4YluQ0GKyU2DA1dCOMyErITIjflFTEMc/eCCakxPrZqbHr82PR4u4P692+7wkOk10weuMucAm5HzURvCAglGgIAgMAJd5LW016NaABAxOviAnm3iHg+Eu5WqhWA9VkG653sNjsaKMbCIyRIXO2ZcJfx492nn1UIMggOn2E7L/5p7D4yKTRLmsgaJKj02gYXG+XxVzxgvFsG9Qyf6IPv26UqOWQZw5Jn1G+xbKCfLQdjqND/WqH/NUSQmiRfmihf0ieXzS4ZF/A7Fiud5Z1wN5CVbdZjEeLxSDwAs6O+1YKeAEL3Zzq92HcXXYpxVbhXdySauuSqcI9K8puSulBsZvuZvT7ubMC6SyURf3jjktu/XXOipiPBUtzcVtmuGRI+0LvKWyaMXHvqbHlrxxHys2u37S6pXDYyJys6QioUGG32oqa2VScK9pV2HiHPz0mfkeG3Crm/mezk7d+sPtfkseuQi4TjkuMzosKTwpShErFCLJIIBSI+T8zn7S2tfuHPYM8X3HEJzpLcrCW5WYUNLWtPnd1UUGKweiSBa9S6h35evyQ36/Vl84S8biSr+++Ve6nf/yVXGj1c3Hkw6k0pFPtMuKvtHfcyRIoCNXJxtXlR2zzufejl6ohQIXrM3d8WJmSurjwDACtLj9+SNjpEIHIf/eRsx0/73IBzvfYSC3BG3XiwuapE19Zg0evsVpPDbmdoO02RdBd3bV+bMlzM5b1yYnu7zcyw7J7Gij2NFUqBeFnysJvTR6WFdHFm1cvVsYF0+90zxo4fsuHPk+cK6tXtRoZlpVJhWLh8SFpkzvA+q1lzue3O6cNHJh49VF5a3NTcqDPoLSRJcbmETC6KTwzLHZk4Z8HwhEQf2Q2furvxw0ckfv3T/WtXHcs7Ut5Yr6VoJiREHBcfOmFK+pVXj5FIBACQMiSisjyo493u/ut9Yuk1Y6fNzN68/tTRQ2WN9Vqz2SaTi+PiVeMmpl1x5cgB6CZ/GXrrh13uec+Y8JAHl0+dOy6D66dPSJ/X118O3GfyZFjWTlJCz5ZTPpmsQVVVX4yfYL9us4DHfecfV933xqo2rckZ2ZVXuiuv1HOpTmOyE1699wo06kkhFbse8/m8tx+5ym3wIkNwOB/dv+yVn3dsOVGy5URJTkLUVROHLp2YE2DurIHE5XS+1T3G95O1dzBGNOTGzmjREAD4b4XcMz5fjWEdDsboMzF3vh+F++U31kBWILNW2mm12VHvHlF4TnNKcPghgjT3BspGstrBmN2T8gBgIMuQqTI5HK57pTzC++LBwPCez7NnBH56UGBOQxTXK4SZJ1pfNDk6qx39MZAVBer3zmo+ipHOSg25MVw8Gl3isnQBv2Nxsrn57W95X0csUL8/M+47IuhGQPnqd7z/4jhAJMqXIMHALvbdRZfiul/h3t7Y8bvjs8KdtDl2/rjv8IbjlQW1ulaDQMSPiA8bNXvYFXfNTh7adR+e2uKGHd/vLdhf3FDeZDZYORyOVCGOTo4ckps0ataw8YtGec+DWnay8sTOgooz1ZVnaurLmlxFWlep7vBYDgAAbnhq6V3/dzMaxXzhEsSjc6bc9s0qV+RUbdPAJ9wFPO4nNy/92zerWwwdR8jbzpZtO+v7tjkAmJCS8J9rF6LRAfTaxr/cs+1xypDH5k1dODTd39234l5PKzUsLmpYXNSzC2fsKa1cdbzgUEWNe/nTxvxis5385OarelDt3H+v3DO9fae6ZKE6SjwC9+AWc32cftAsaz+f0vXZU8VFzOv4JTM6Ok+be7m6N4GfL1z/mRmbNjYi4XhbXavVtGjLVw8MnZytjBRx+TUm7Tclx0601QNAlFh2b/YkdM0+sq2u5D9ndlf3okf8osTsmbGpP5ef+r70eL1ZDwA60vpdad7K0rwFCVn/HDUncHl+L1cf5D76cgUa6o5nX1727MvL0GhP/b75CTTUTUNzE4Z61uD3q5Gjk0eOTkajPdXdjQ8Nk939wOy7H5iNDpz3+cp70ZB/3frX++pzV4VKb7lj6i13dKNqZvS4lB0HX0CjXr755QE0dNmrbdZuOdSZf0mIUn3z4k0Kr+NvdxQdqNIN80kh88ghNmuMSdEq94hPBpOP6/2Ii/ETHIBtjo9Ufv/KLW+u3LX3ZDk65kYi4t96xbg7r5xAnJ8xwp9QRWdlg9FsIx1U76eKvYDCQ6Qf37/sXF3Ln4fPbjtZ8sbqvz7bcvilm+bNyh3oG1q9Be6xHiR/HaXd67u90YzvvzguEejL2V3+Xo1m7Hxfh/M8QirnJyEdcvRkKZJw927g7l0aHyoa7p5wZ4HR2gsjxR73jXlPGxsiSPP3fgIAxQQqCRr8+uT7dmkLE42Yk7CmTLeyVPddMB83w1INph0Nph1KYXaG8o442VwO+PpmXzYu4HdMQChSQq4r1/+ExHX2ouOtL42N/FcQOXf2rObjJvNeNAwQJ5vX3clOg/n+XNRkKqlMJTVpzU1B93BXN2gAgENwIhPQir3Tu8/+955PW2o6r1I47A6z3lJ9tu7PT7Ze/fcr7v3PrYSfMgWGZr589qe1H25GbmvWtTp0rYbiY+Wbv9ollom+L/tIEe5xQejPT7bt+N7Hx4313qjEWC5B0EzH5Z92k9lzfIAkhirX3H/zKxt27SqqQMfcSAT8u6aOvW/6BG5XR8j9p1qtXX+m86AlKUz56z03KSW+D6KcqPNvby8JeNz5Oenzc9Ir2zWf7D6yuaDz0Gh3SeWmguIluR41DcHrv1furn4/jRGfz7O7ct8+0ayPz4zL4Yi5fCvtAADb+cS9T1aq45KynC90BXu5+mDAAfh82rUr9vyWr2lqtBhezNuKLJAiD/1s2nKVsA/KlLx9eu7Q22f2OB+rhOLpMak5qqg4SYhCIJLwBGIe/9uSPGcBfmASnuDurAl3ZU040Fy1pvLM9vpSO02xAFvrig80V30xffnEyCR0HTe9XB3DMOyCQ8p+H7tpRuC8JwDojFY0hHUlLd7jPKqqQR1Mwr26qeuLyhfjJzgw2xymkE4ZkXKksNo5ValSLrZYSYphpGKhUibOTIoYk5WwYFKWTBzU8dWw1Bj3p+eqWkZm9NeNPgMmJyEqJyHqyWtmbDh67r11+5/6ZuPqZ29LiR7oeqv+4C/D5V3p6c5fOp7o07MSfxkumvVbW6MU5ngl3NF6NKSfDACEiUYgkVDh8EroLK8DAI0tH0m460j0XhDvxL27AJuNXTK4HEGW6p6UkOWlum+rDL8HmTbV2YuOtTwTok0bGvpwjHQGOowNiEzVnbWmjSStR+L1pm1mR93w8CfCRX5vRDA6qgvV7/vMtvMI6fCwx9BoVy6H3UVcanTJ8QqjxmTWW6TnL9W3N2huTn7Q+fizE/8ZktuZImirVwNAeFwoj+/RmfbQ+uOv3/Q+RVIAIJaLh0/NCo8NtVntxUfLGyuaWYZd+8FmTbPunz8+4r6Wy3cv/fb7+5ucj6OTI9NGJYeEyh0OqqW6reJMtVlvAYDsCelIth0AZt84JXVEx+aRVvKbF351Pr77jZt5XrdmZo698BfpLyJcgiMVClztRFyZ94EXLpPOyEg5WF5jc1AAoJKIzSRJM4xUKFRJRDkxkeOS45fkZslFQR0h95+thR4HJM8unBE42w4AWnO3zxcCGxIe+t/rFi0cmvHYqk2uj+y34/m9T4v33ysHCf177nOK811QNOe7u/iks/v+zMLF0jqTDgBarR23Y/jUcn40XORxw2YvVx8MVELJz3NuuWrbtxUGtZDLoxiG4HCUAlG2KmphQtay5GGuqVP7VrGu9b/5HT/8d2SMe3rkLO9/CGlxExgHYFp0yrToFK3d+nP5yS+KjhgddpPD/tCBtXuufLDLSx29XB3DMOwCqm/VuR4TBGfi8GTXU39KPPtuY8HISo5yf3q8qG7mmDT3iE/F1V2/1RfjJzgw2/zfn3b/tuMUABAE57GbZl4/d1RvbtIcnRVPEBzmfKXYwTNVl0DC3UnA4147ZbhIwHv++63bTpXef8VEdImBxfqaUq+7/M1/wPHVJH2g+SrlCUwlzK4zbXaPGMlK96fglXAnODylcKh7BABUomFIRGMrRCJ6e/cS7oG7e2OXEiFXNTzs8UzVXZX61VWG1dbg+nEbyPLDzY9GSSaPinhRwotGh7F+JuSGjo548Ujzk+gAgNZ+bl/DXQphZqR4vEo4VMhV8QgZzdhIRq8ny9qtx9usx33OcQoAYyJeCTAfhj+Xw+4iJjWq5HgFADRVtaaNTHYGT+zo3D/nbTvjnnB3tpSJTvboJ9NS0/bWik+c2fYl9867+42bJSGdVYy7ftr/3v1fkDbHnt8OjZiRs/ieuZ1rAgCA1Wj946MtAEBwiee+//uM6z1aDjA0U5xXvnfV4THzct3jTmPm5briJp3ZlXC/8v753v1nsG6xU5TR1pFtB4AI+QXL7/3f5j0/HDkFAFyC88zCGbdO6NURcv+p03ReKeQSnKlpyZ1jfiDd3vvKvJy0WyaM+P7wKefTgvpge0Z1qf9euUtoCrXPpZ2fK7VM77ebmNlBttt83+sxMizWmTEv0DYtSMhEh88r1DQ7H+SGedRG9XL1wcBGU7ft/qXCoB6qivp6xg2udvP9bX3NWecMxcNU0S+Omedz56AnfV8mCUwlFD80dMqSxJyrt3+nI61au3V7fem1KR537AbQy9UxDMMGnsnSWe8pEwt5fm5NdbHaHYfcpprEghSulCbHhLoq1vecLH/0phmB3+1mtbGouuMYIICL8RMcgG3eerjImW0HgEdvnHHDvFGe490mEwvHD006UlDtfLp2T/6KK8dLRL5LlS9GCeFKANB7VgY5W2T6S173E5YNdONpkFjw/SL+qsuduITvIgkGfFe+9wzjZ9u4HN//OgAoRWjKG0m4Myylsxe7RxSCLO8+MHJ+koBQkEznGazWXuA2DgBgINEuTAFmTAX/b2m68rYoyRQ02ndk/GD73WF9S0AoslR3ZypXNJr/qjL83mo95i8n667FcmhX3fIxka/GSuegYxfUgHX3voBipXNyQh88p/kfOgAAAHp7iXcjqcBGhD8dJ0OTvMG4HHYXsefbuDe7JdyPb88HAKlCYtZbjm87fcNTS51xq9FqNVrBq4H7Ny/8ajFYAWD68omPfHKX+xAAzLllml5t/OyJ7wHgx9d/X3D7TKT2vLak0W4lASBtZDKSbQcAgkvkTMzImZiBxLH+drDco2d3cpiq88kA2pBf7My2A8DTC2bcNrG3R8j9x2jvvCdGJgzifIF07Cvr3vlC8EYnxrnS4naKomimy+0JUv+9cmD9nnAfFRbrfFBn0pUb2n1OdHm4tcbfEcTM2LQNNecAYEtt8RO5M32mfWmW3Vbf8QM2NTrFfaiXqw8G3xQfO9XeAADvT142YNl2AKg3dZwnjI1I8Pm+AcDxtno0FLQkuerKpJwfyk4AQJ1Jiw53pZerYxiGDaQQt3IVk9VuIymR1x2j7r7dcFQfRGNxzNuSqUM/Xr3f+bhVY/xjT/51c0Z6LOHph815weQ5L8ZPcAC2+edtJ50P+Dzu8oDvc/DuvHKCK+FuNNv+79sdrz+w2GOJi0RpQ3tsqNy9lw7DsL/uOw0AuSkdx8ZOPC4RHiKtadWSFC3gedzt3n/6pOeAv5YX/tI9Tv7ma6WYnpRx+OPv1fz1dgcApSCbA4R7ZtBGqx2MwTXJqoEsYzy75Xj3kwEAAI5KNLTFcsj13E5rLVSjhNfxuVuoJmReWYLDVwjS3SMIf5st4oYjzWqwSwmHw42TzYuTzTM7GmqM62qNGy1UE7qQJwdjPtL81KiIf6aELEfHLhx/jaQuMVmqewgO76z6415eYBBwFaMjXo6VzkIHgnM57C5iUzsK/5vP36TIMuzJXQUAsHDFrN/f33T2UInVZHNWi3fOmJrUUQkKAJpm3b41R5yP7/z3Ta64u8V3z/nupd9sZru6UXtyV8H4Kzxypq7uNO0NGtLmEIh891gbzH54bc0Pr61BoxczkqI/2NX54xsqFY9OvDA3Sq48dP4Imcu9ebzPQ4XBQiF2O1+w220OShRw/qTP9h3TWbp3vhC8Zn3n0ZFSIurDnHj/vXJg/f7PDAkJG6bquAL5UeFBz8EO3xQfQ0PnLUnMdmaZq4yan8s6vrWIlaV5DWY9AESIpIsTs92Hern6YHCguQoAeASRLB/Qdp8iXsefmdru++aDtVUFvZlMFQBM56eoVQh8n3oF1svVMQzDBsyQuDDXY4Zhdx4LVOX0596ClZv8/ixigS2emuOeVv7ot33nqprdxj3sOVH+++4zaNSXi/ETHIBtrmpUOx8wLGu1900+ZWRG3JTczuqH7UdLXv5ii430Xa3sTme0/rr9ZHF1Czpwgfyw+8TM5z67473f/rlyy3/W7H5u5ZaFL3+1+Xjx1JzkBaPRkrcFYzLVRsvdH6z+bMuRTzYeev3XXcgCfQ5J+PaMvxcRcBVoyI2I2/nNdEfSOjTUCyTtoxqD4PD5hN/iFR4hlgmSkKCB7Czjcp8K1clPwh1CRWgPAfeuMgYSnUItRJDmryG+k4Dw/Zba+/RNwwYtKT8uJ/TBBUkbp8R8Eiud3dX8qOzptjfarHlo+MKh2P7Kzgw2GcoV0+K+DBEMQQeCFiWZMjd+dY+z7XB57C5cCffW85OdOlu6A8CVD8wXigWUgz71V8det62u41glOrkz4X5691maogEgZVhi7JCOV0MIJcLUEcnOxwX70f1/8tAERUQIAGiadS9e9Z/6si4uhmHd9b89R15ev/NETUMwlTEA0GIw3f392tKWzr4a140ZfqEmI61ocztCdvTNEXI/SY/sPCqjGXZLYaDzhdUnCr7c343zBTtFvb/zYK1Ghw74orPYXLcFAEBufIzbIKr/XrlvBbp20Vfuz5n08ME/AGBDzdlkueqRYdO459sXWSjy/07tOtJa47GCGz7BfXnM/IcOrAWAV05sZ4C9JW00cX51mmW/Lz3+xqmO05J/jprDJzwqg3q5+mDg7JxOMcz/ndq5InN8jETO5QQ+xuobw0Nj1lTmA8CuhrIyfVv6+dZAAMCw7KrKM68c39a5tC+fnD1Ya9ItScoZH5Eg9Oz/zrDs2qqC9TXnnE+nxfi4saCXq2MYhg0eU0cMef+XPa7jxf/+tDtCKZswDM3sVDaov15/ZMfREgAQ8Lgkdel34exzYQrpPcsmfbSqo8jdRlIPvLn6vqsnXzVjuFTcWXXbpDb8su3k6l2nGYblcgma7qIY7WL8BAdgmxUycavGCAA0zfz97d9XXDlhWGp0iFTE712Z9iv3XnH7qz81tnXcabflUNHRwprr5o6ckpuSkRhJnD93Yllo1hhqGjWFlc1552oLyhspmnn30WWu17mwFozO1JttpQ1t52pbKJqRiYXpsWH3LpxwzaThrgNRl0eunCLkcbefKv162zGxkJ8e6zsl3Ye8J/frARvdcT6JEHID1YjwCAmfkDoYtJ7DRvttPtkDPrdNxI2AgP3lVcIco1uGHQCMZJUrq661dxx5ungn1p1ChcORiNZeGC+b73yM/BMAoPJqBI/w18eZZHRoCLt0cYCIkkyOkky2UE3l+p+r9GtoP4lsFphjLc8tSFzHIy5Y/2J3fXs5bZALF42ek7D6aPOTjebd6Jh/XI4gXnZFmvJmhQC9Ittdl8PuInZIR0FnS22b88GJHfkAEJEQFjskKnNcWv6+c8e3nZm8dCwAtDd21AhGuSXcS/I6+nqlDE9wBb2FxiidD1rPZ+1duDzuvW/e8vZdnwLAqb8K7xr2+LgFI6+4c/aERaO8Jz4dnEJjlGExfn+v1U0aTZMOjQ4gvdW26njBquMFKol4fEr8uOT4jKjwIeGhYTKJ+2ItBlNRU+uu4oqN+cXO6UmdEkOV98+4YLd0KMWiZocJAGiGuWvl7/fNmDAiPlohFvG5vTpC7g8zM4e8uXWv63zh/zbviZTLpqSh5wvlrer/7TnqTMcHf75AM+zn+459sf9YbnzMtLTkyamJWdERYgFaYWCw2nYUVXyy+3CTWx36dWOGuS2C6r9X7lsDsS9YlJh9RW3RlrpiAPio8MCqitPjIxOlPEGrzZTXWmd02DMUESnyUFdfF8QVCVkPDp38v7OHaJZ5+fi2jwsPjI1IUArFOrs1r63O1fz9zszxVyX7eON6ufoFd33qiD1NFQDwbUnetyUepQoiLi9CLMsNjbluyIjpMT4upLfbzFq71eiwGx12o8NmJO1WuuPy2rb6khqTVsYXyvlC5//HSkJ4RGcq/6qkoe8X7NParRbKceXWb65IzE4NCeNxiHqzbl9TZb1ZL+ULHho65b2Cfa5VEGaKXF15ZnXlGSGXl64IT5aFhgiEDMu228z5mibXNLY3p43y2Wiol6tjGIYNHglRyoWTsrcc6qiOMVvJv7/ze0ZiRG56rEousTsojd5ytrLZVS8s4HE/euraZz/ZqDX47tiAsJOUyWo3WUmTxW62kiar3WS1myx2tb4zpVXVqPl1+0mpWCiTCKQioUwikIqFUpFAJhH66zTCsmC1kx0vaCFN1o4XN5o9zvBPFNUJ+DyZWCAVC2VigVQilIoEzgcD1h/D3c0Lxuw/XXm6tMH51Gp3vP/r3v+tOZCaEB4ql9hIqlltaDifzCU4nHceWfrkh+sD59z7+xPsDwOwzQsmZv2wuePI5FxV81MfrvMcBwAgOBypWKCUSzISI8blJM6bkCmXCNGFPClkov/+46pH3lnbpuv4rdcYLJ+vPfT52kMEwZFLhEIB32ojLXZH4E/twpqakzw1JxmN+iHk8x5ZOvWRpVPRgX5jpTtuw+8NK+XjfgKCwxNyVWjUk5Sf6F0tbnbUA7CBE+JBohiLnfZxF6aU79HMx5tSmFNr3OQeMToqXY+RhLuYF+0vsRUqGgbAcW+67b6u0eGdcA/UwB0AJDzf1VgmRy0awi4DEl5MbtgTmcoVRdovqvSrfTYwsdPqCv2vmaq70IELweff46XKwRjyWl5stnicI/MIiZQXb6VbKMbKshSPkPCJEAE3RMSNDBUNCxONUAmH84i+uWn7cthdhMYoRVKhzWxvre04hjm+/QwAjJw1DACGTcnM33fOGQGPCvdI5wMA0LTonA/++uXgX7/4bsPgzlk+j5j3txlCifCTR7/VtuhZhj225dSxLafkobI5N09dct+8xKwL08wkeIvvnnvbS8vR6Hk//KuHDWeq2rXZL72HRv1LDFVue3QFGnWjtVi3nS3bdrbM+ZTHJaQCgVjAd1C0yU7aKR83QUaFyD6/bVng1ij9anFu1tcHjjsfFzS0PPzzes9xAOcRslAQKhVnRUdMHJK4eHimXBToCJllwUKSJjtpstuNNtJoszsfG6x298WOVtUJeVyZUCATCWVCgVwklAkFUqFALvR9XpYYqrwyN3v9mY6jMpOdvPv7tVnREaMSY0OlYjtFq02W/PpmV82+gMf9+m/XPvrbRrU52PMFloUzdU1n6po+3n2Yw4F4pSJcLpULBRwOx+pwNOtN9Vq9c/5Il3k5aXOz09wjPvXfK/eVAfoKvj/5KuIwZ1NtEQC0WE3OvupOQ1VRn0+/bmPNOX8JdwB4MndmtFj+nzO7zQ6yzWZ25u5dJDz+Y8On35Xl9/pVL1e/sGbGpl2ZNHRDzVl0AMBGU3UmXZ1Jt6m2aPmQ3DfHL0Zqpu7dt/q0utE94vJFUUfPMpdVc28bG9F5gTdEIPps2vJ7963WkzaSoddVF7otC9ES+cdTrs5URH5QuB/5Bru4ytLtNFWoaXbNTOvC5XBuzxj33Kg5SNypl6tjGIa5/PH9oc//s+m5t2+Ysch3NSJCVmHkGxxmvRUdCM76n4/8798bnI8JLrE5/zUAeOq22WW1beX1nSWcpbVtpecLc9xJRPz//H3pqMz44akx+05VoMNeSmvbbn3pBzTqpbyu7d2f96BRAAD49NnrxmT5KPD5Y0/+myt3olEvB/OrDvqZbHPPZ3+XeDW1vGn6GyKJ4NutTyDxvsLlEu8/fvXDb/9eWNHkCpIUXVSFJgcJgvP8ivlTRgxJiFS6plr1p/8+wf7T39t839WTKurbA0+1yrCs0WI3Wux1LdpdeaUf/rb3weVTr587Cl3OU2p8+Pev3vLsxxvOlHkcxjAMqzfZAHwXdWLBszh8Hx8Gj2ZJny8i5cV31e8CFIIM74Q7zdrNjgYpPx6J94B3zxanLktHvRPfhvPzpjKsA5np1F8/GQDgEyFyfpLRUe2K6O0lrssJvirc0X8XIeZFCrhK7zJhnf0cC0yXbzh2SRJyQ0eGP5soW3yk5Qkb5WPHXqH/JVN1Z59cxOolM9VxCfySZ6Wa9zfeh6S2I8Tjxka+5u/6XJ+7THYXMSlRVYW1mmYtAJj1luJj5QAwZm4uAIycNeznN/5orm6tL2uKT49pq1cDAI/PDY/rrOa26IPNFTo5+894m7584riFIzd9uXPdJ9taatoAwKgx/fnx1nWfbJt69fh737o1yq1xPNYnKJrRW216q99DwTFJcW9esyBepUAHBtDfZ08qa2nfV1aNDrhhWNZosxtt9hq1btvZsre37Xts7tRbJ45Elzvvt+P5r27YhUa97Cut2leKHmY4nXjhYYlXDTgAvLB4VnFzm3s3nuLmtuJmHz8rEgH/o5uuHJscNyIh5q9i38dagbEs1Gn1ddpA91nOzU57e/kVaLQr/ffKvTFACXc+wf1oytXLh4xYVXH6lLpBbbPI+cLUkLClSUOvTx3BJ7hdFinfmj5mYULWrxWndzeWVxu1RodNIRAnyVQzY1NvSB0ZIeridrlern6h/Fh24t38fTrSyuUQSXJVlFjOP1+E7mAYo8NWZdSYHSQArKnMH6qKvj1jrMf6vTMuImHbonu/K83b01hRa9I6GEYpECXLQ2fHpd+aNlrKFwBAhiKiWOe7SOofw6aNj0jc3VheoGmqM+l0pNVOU1wOESIQDQkJGx+RsCx52JAQvzdN93J1DMOwnmOBJTgcr7YPQZq+cHjikAiDzvL1u9vamjt+9WVi4efPXf/m97ucvTv8yU2LffHuBUnRKgAY1p3UZ5cEGlKgI01DZOjApUgiEnz6zHXfbDj645bjDj/nSHERiufvnDc2OxEAkmNDu0y4X/BPsAf6e5vbdObctNjTpQ0Wm8dMkgFYbI53ftzd2G549MYZ6JinMIX08+du2Hq46NsNR2uateiwl/hI5ZXTho5I76KEGXNCcsc9YCQrfNbVygTJaMiLSphTY1yHRgG09rN9knDXefV+cVIIs9CQJ6UwC5k31ZUcN5DlyMSPARLuABAqGu6ecHcwJpOjXsZPAACTo8YVBwAuRxAi6LrYSiXMbrEcRoIUY9XbS5Vd/Xdhl7BQ0fBpsV/sqb/dwRiQIRut1pNlXV5ncuFwfBQ/Ql90YDeev3B1aXMwpv2N9yPZ9kT54jGR/xrgNPflsLuITYuqKqzVtxtZhnU2ZOdwOGPmDgeAYVOzJCFii8F6fNuZ+PSY9gYNAETEhxFu0ySKpCLng4wxQ7LGd70HTvBfri6WiZY/tuTaRxef3FmwbeWeQ+vySJuDZdn9a4+e2Jn/6tqnRszo4pIq5tOcrLSyVvXRyjp/9Z3esqIj/jZp1LKRQ3t6DtdnWo3mkYmxJ2obzfagj5BJx783727QGZ5ZOB0d62dykfCHO697ZcNfgRu4j0qM/fey+SnhKgAYER8dTMJdyOOtmDLm95NnDf4vkLiLU4Y8MmfylbnZXX6C/ffKfWuAEu5OM2KGzPDV+QQAZselVd70TzTqKVwkfXjolIeHTkEHgtPj1Xu2Vu99XnTkP6f/AoCZsamvj7siVhKCLgFAs8zbZ/Y4y9VXVZxGEu5r59/h/rQHIsWyp0fMenrELHTgvM1X3I2G3EyKSpoUlYRGg9bL1TEMw3rGlCYHAElIx7F4dylDpSMnpgLA6m/2uxLuACCXiv79wOIVV07YdODsmbLGhlad0WIHALlEGBuhGDoketaY9DHZnZXmw9N83xTcMwIdSZA+smOXKqGA98C1U66embsrr/TA6crGNr3aYAGWDVfJspOjZo5JmzMuwzVDfUps2J4TXecfL+wn2DP9tM16k+29X/ZsPVTkOgvicCBEKpIIBe6LUTRjd1BGiw05V/p564lJw5K9G8ojCIKzaErOwsnZ+WWNx87WnCppaNUadUar2UaKBDypSBgVJk+KUWUnR43LSUzp/77nlxKtV4F5d6ltp9EQAATRjhwAIiW+7ytttR6Lly1Ao93Xaj2KhgAAIEI8Dg154nJEckGKe4G8lWpmWIrg8LxL8v01cHdSiYbXGDtudXLS2Ytk/AQHY7J7TuiqEGb6S3S6CxeN9c6gAUCb9dglk0HDekbOTx4W9vdTbf9GBwA0tvzgE+5cPzP3UowJDXWT1u7jXu1Lz5n2N5HLaSrhsNERrwxwth0uj92Fc6ZThmZ0bYaTuwoAIHVEknMWUx6fO2Zu7v61R49vP7Ps4YXOhHt0Smc/GQBQRnSkVjLHpT384Z3uQz3D4XDGzMsdMy/XoDZu/GLn6v9uMOstFoP1tRveW1nygVTh0XYcC8b4lPjxKfEas/V0XWN+fXO1WtukN7YaTGbSQVK0g6ZFfJ5cJFSKRRlR4dkxkVPSkjKiuqjiHQA6i+3NrXs3nPE4QlaIRRKB1xEyRRls6BHyd4dOTE1L8m6h3t9CxKJ3r190/4zxf54+d6KmoV6rN9jsABAiEsarFMPjouflpE1I6TxfGJkQVIELl+A8vWD6P+ZMPlXblFddX9GmrtcaWo0mK+mwURTLglQoCBEJh4SrMqMjZmSkjE6MCzIh3n+v3LcGNOGOBc9KOz4q3A8ACoHoo8lXO8vJvXE5xCPDpn5ZdIQFqDJ2UZ2HYRiGBRCmkB777nE02pX5EzLnT8hEo/6lxYf/o6vaXqcxWQnBbE9GYkSXizE0c8us/8RnRbz9XaCrpIhrZuVeMytQRmnwiw6T37JwzC0Lx6ADnh64dsoD1wZ7Zb0PP8HPnr0eDXn669OH0JCbhChl4Nd36cNtBgCNwXLv//1We77qfGRG3O2Lx43KTPBuH+RE0Ux1o3pnXun3m/Ko813Xf9xyvMuEuxPB4YzMiBuZ4be4DOsBO602Oqrl/GR0IGgtliNoCAC6qvt2kvGTpPx4s6MeiTdb9ve+4wHN2n0m3OX8ZAkvGo16UQlz3BPuLDBWqlnKj9eRpW5LAZcjVAgC7fm9503Vk6XxMN+7jbKyq34yTjHS6Wc1H6FRgCrD7+nK2wZD2xDsAkqQLc5vf5tm0VJKW3eap/MI3/fA+ZyCOHh6e0mfzNI8yBnISmQGCAAYHvYowbkA+ZbLYXcRm9axP9e16U/9VQgAY+d3/vqMXzRq/9qj+fvOUSSlbtSAZwN3AMgcn7bh8x0AUHGm2j3eeyFh8pufu3rm9ZP+PvkFo8ZkUBsPrcub97egjsEuXp/dugwN9ZFQqXh2VursrFR0YFBSmyy3fr2qWt1xhDwmKe6eaePGJcf7bOQCABTNVLRrthWWfnmg8wj5m4MnfCbcbxyXe+O4/j0vy4gKf3pBUPX141Pii/71GBr1Q8jjTRySMHFIZ76+r/TfK/eVC/ADgAWjTN9uoRwAkK2M8pdtdxJy+QSHoFlGxPX9Z4xhGHYxspjsN854Iy4x7NM//o4M3Xvl+61N+l/3PycSd+weC45X//rFnuL8OtJOxSWFzVs2+urbJrvfOgoABJf44/tDm1YdbWnQhUXKR01MW/Ho/BBVZ8nJ3s35bzz1m+vpmiMvyuQ+itytZvva7w8e3HGusVbNsKwqTJY1IuGOf8yLiQ9FFw0omG0Oxl8bTm/67VhddZvNQirDZEMyY+YsHTlt/jDn6Kbfjm3/40RVWQtpc2jVpoVDn3etuCn/Ne75f87Zd37NkRebatXfvLetpKCeZdiElIgn37wucUgE+OmD73zH7ntm8dV/m+wK9uD9+fSNjet+PHzVLZMe+OcSdAwbfF7/Zrsr2z5/QuZr9y8OXDPC4xJpCRFpCRFSsfCj3/Y5gydL6imacd1kgA28RvPuTOUKNBocB2NutfpIuPMIcWgQCXcASJAtLNZ+hQRtVFur5XCUJNirXz41mHZSjI/mvHGyeWjIF6UwB6lMN1ONUn68gSxzD6pEQwPn0RTCDC5HRLv14nC28fFOuHfZwN0pRJAmF6R49383OWpbrUcjxROROHZZ4RFiCS/WvYuRk4M2IJEARFzfxaE6e1GSfCkaDVqj+S80dCmqN21BInxCFi4ejQQHxuWwu4gZ0tETv6qgrr60EQDGzOs8QB2/cBSHw7GZ7QUHivXtRgCISvbopT56znCCSzA0U3ysvLGyxVkv34diU6Nn3TB5/afbAaCpyncDXie+oPOnxGq0iWU+Tj2wi8UL63a4su2Lhme+s3xRl0fImVHhmVHhUqHgne37ncG8anyEfOnAn+IgRZy/8myi7J4jqE2152iWAYB0he+DJAzDsIuRRCacPDu7qrS5urTFPV5+rrG2sm3q/KGubPvuTWeeXvFVS6N2wdVjrr1jqlQm+vLtLa8//gvreZPe798dWPnhjuzcxOV3TouIVmxZk/fywz+4LzBmavp/vr3r+XdvSk73e9it15gfueHTHz7eJRTzr7p10jV/m5KSHnXqcLky1HddmD9BbnOXVn+9761nV5Mktei68dfeMTV7ZOK5UzVlhZ2zkyUMibhi+bj7nl4EAHHJ4Y++erXrfwSBHgMe3V301O1fiSXCq26dPGvJSJ3GHBHVccttkHrw/nz59hacbb+IVDdpDpyudD7mcYknb50d+FzC3eyx6a7HDorWGnxkRbEBU2vcANC9HY5LjXEd41VLCwBRkilcTqAyEZck+VU+qyxLdd+hoe5hy3Qr0RgAACTKr0RDvninv51zw+rtnjOmCru4rsABQiXyeCm9vQwAzI469yD4+hf9SQlZjoYAAOCc5n8+++ljlxUGPOYYcOISQjTkn4QX6/OvUm07g4aCxrJ0tXE9Gr0Uab2mjhBwFT7fz4Fxye8u4s5XuJ/YcQYARFLh0Mmddx2pohTpo1MAYN+ajmvDSIV7eFzozBsmAwBDMx888CXloN1H+4TFaHU+kPs/BgYAoUQoknb8nVYW1HgOYheTynbNnpLOI+QXFs8K/gh5/lC3I2SaVpvxEfIlIlBpBnYBpSrCJDyBhSILNc0/lp24Nd3H7fB2mlpTmf9/p3Y5n96QOtJjGMMw7CI396pRezbn79p4+q7HO7v6/rXhNADMXTrK+dSgtXz4yp/DxyS/8fWdrnrtt55Z9dfGM0d2F0+anX1+PagobvrwtwdSMjoO0F+4b+XxA6VFp2uzRyY6I7IQ8YjxQwBg6+/Hq8s8svwun725qa6q7c7HF1x/V+cNd5SD5vG77sDrEvw2d+mvjWdCVJL3f7nf9To0zThIyrVA7riU3HEppJ366F/rQiPkC5ePdQ15++DVda99+jfnmwAALMt2d+bYIN8f18t++/723787cNWtkx54DmfbLw4nizvbgGQlRynlYrfBLkhFQaVisYFhJKuazHtjpDPRga7QLFmm87ha6ZIgW4iG/JDy42Ols7xLX9usx5vMe2OkPbz7vsa4Qe9Ziu4ULZnqnLC0SwphJjJvqoVqtFItyIyUwRTyhwqHt1tPup5aqCaKMSMJdy5HJBd07HK7lCRfWqT5zMEYkbjGVlCi/TpLdQ8Sxy4fNGuzUj6qaEVcj6rewHiEWMaPN3ldE9LZiwxkeTBT+3qrNv5ppZrR6KWIYsxIxEq1kLROwFUi8YFxye8uIhPCeQIeRVKndhcCQO70HJ5bqTgATFg8uvRE5bGtp5xPo1PQv4W7Xr/pxI58fZvh1F+FT85+9Z7/3OKesgcAu8V+9nDp0U0nLQbrE1/d7z4EAD+/8UdTZevM6ycNn5Yt8GypxzLsjh/37f71kPOpe+m9T0MnZ57YkQ8A3zz/S/qoFGcneuyik1fVeYQ8NDZKJenGEbLMcw4k7JKBE+6DlJjLvz9n0rv5ewHgpePbvi89MSkqKUYSwicIO02r7eYqg+Z4e73J0VH/vigx+5oUtFkkhmHYRW30pLTQCPnujWfufHQ+h+AAAEMze7bkR0QrXEnhvVvzrRZy2W2TXRlnAJi5aMRfG88c21vinryeccVwV7YdACbOzDp+oLS+pt2VcO+S1Wzft7UgLjncPZsMAN3KtkN3trlLqnBZXWVb8Zm6oaM7mv1xuQT3fO1/d02dN9T1xoJbWjxIwb8/zrsTvv9o529f7l122+T7n12MLIANWhq3snSFtHs3Pte16FyPCQ4nTCHtHMMuhHz1fyPEE3hEN84JAaBY+4XPDJqYFxkjmYlG/csOva/RvNu7yv5U+79DRcOE3DAk3iUL1VjQ/i4aBQCALNW9aMgPLkcoF6S6N5AxOxqc3WDcBZ4x1SlUhByZs0ZHlZnqvAMJAJTCzOB71vMJWaZqRaH6Q3QAoFj7hUqY08tuPNjFq8G0k2F9VLgrBJ1Vk8EIE430TrgDQJnuhzGRr6LRrlip1rPqj9DoJcq7IQ/DUifaXhkX+UZ397F94pLfXXAITnRSRH1ZU3u9BnwltScsGv3Dv9a01XXMQBCd5FHhDgARCWEvr3r8xWVvmfWWc0dKH5vxsiJcHpcWI5IKbRa7pknXUtvGMiwATFjUUeXjzmq0bvtu97bvdgtE/KSchNi0KJlCyjKstlVXcrxC06RzLrb4nrmJWV1MQrPs4SucCffy09Urch4bPi0rNFpF2kij1tzeoLnqwfkL7piFroMNPu5l6Qpx946Qa9Q612OCwwmX4SPkSwROuA9eDw2dQtLUZ0WHKYYpN7SXG9rRJQAAQM4X3pc96f6cSegAhmHYRY7gErOXjFzz7f7841XORPCpoxWaNuMN98xw5t8BoLSwAQD+9chP7is6adUm96epWbHuT+UKMQCY9J0NdrtUWdJM08yIcSnoQDcFv81d+tvDc5+759snbvtixPgh868ePW3+MKTKplvSc7o4JQgs+PdHKheu+/Hwz5/tXnTdOJxtv7jI3C7nNLTp3Ua6tmpnR6EZAKQlhHs3NcIGmNlRf7z1hQnRbwef8222HCjVfotGAQAgTXELh4NeXQtAIchICbm2yrAGiduotkNN/5ga+ymfkCNDAdhpzaGmR0jGx3cyXrbAK/cdiEqY7Z5wt1CNSNW8jJ8o5KrcIz6FCtEEkJGsNjuQhHuw/WScUhW3VBvWmRw1SJxhqUPN/xgV8UKyfBky1F16srTGsD43/El0AOtTtcaNXI4wRjqT4PT8V9vJTmsKNT7yqjxCHMyVIXdRkinIHAZONcb1cbJ50ZKp6IB/NqrtQON9Pv8kL0lyQQqgNe7QZN67o+7qZPlV4eKxMn6igKvicvgD1mfmkt9dxKRG1Zc1OR97J9zTR6eERis1zToAEIj4qmgFsgAADJua9dGh19++89Oio2UAoG83Ohu+I8JiQ9EQgOD84RBpc5SdrCw7Wek5DgSXWPbQwnvfuhWJe5uwaNStL1z74+u/A4BJZz684YT7qNnQ0ZoGG+Rkws4WXvWa7u36fjp62vU4Iyqci4+QLxU44T54cQAez52xfMiIP6sLj7bWVhnUOtJKMrSIy5PyBPEyZVpI+NTo5FmxaTJ+N9rzYRiGXUTmXjVqzbf7/9pw2plw/2vDGWfQtYDZaAOAa26foghFawFiEz0KJFXhgVooBsP5b0lDelupFPw2dylrRMJXGx9d9fW+netOnTlW+dmbm66/a/ryFdNcFyS6ReE2hWwPBP/+1FW2ffafTQBQeraBtDl6c5EAG2ApcZ1f0eomzf7TldNGdt0Qg2Xhu41Htx0pdkUWTurGnRxY/2k0/3Wk+fGxkf/iE13fw95o3p3X8k+f/X/FvKghihvRaFeGhf2j2bLPuxWG1n52b8OK8VFvhQTXbkVnLzra8rTZ0Xk3twufkOeGP4VGA1IJc2rcuk5bqEZn+3WXsCD6yQCAiBch5kW73w2gJ0ttVJvbIqASDnV/2iUuRzA28rW9DXd4fwosS59sfbXNcjQ79MEg++e4MzqqW8wHakwb9fYSALhQGbTLh8ZeWKn/TcBVJMoWJ8qXKIVZPcvDmhw1R5qfRL5XTvHSBd3N5sdIZ/IJqcOrOwoA5LU8OyH6v5HiCeiALzp70bGWZ3wWy1+qEuVLi7Vfe9+yY6VairRfgPYLJI7gAMEn5HyunE/IQwRDVMKhKuGwUNGwnn0rnC753UVcanQeAABEJIR5V5FzOJxxC0ZuW7kHACITI/zdtRmfEfvBgddO7io4+MexggPF6iatWW8RiPiqSEV8ZuywKVkTl4xOGebjXtjbXlyeOy376OZTpScqm6tbDWojaXNweVyZUhKfETt8WvbcW6bGZ3jU+gTwt5evGzMvd+MXO88dKlE3aRmGlSokYTGqIbmJORMz0KWxQSktsvPCTGW7ZndJ5azMro9hWBY+33d0Y37nEfKVI/AR8qUDJ9wHu0SZ8pFh3agmwDAMu5Qkp0elZsce2HH24ReXsgx7aOfZzOHxCW59GCUyIQBMmTd06KiOnir++D7Q7g6xVAgAmjYfxS/dEvw2ByMsMuSB55bc9diCvdsKVn+17+t3t2nVpnufXoQu1w8slo62Zk7Bvz8WC/nkv681GW2f/t/G/77w+3PvdDtPh10o47ITw5XSdl1HOuaf/9v44PKp18zMFXr2TnUxW8mD+VW/bj9ZWNFRhgYAcRGKa2ahxWjYhdJk3ruj9tqs0HsTZYt5hO+rbhaquVjzebVxnXc6yWlE+NNBTpfqjk/IJkS9va/xbu9uGAay4q/6m4aEXJemvFnC85uzMDlqy3Q/VBv/YFmfU95xxka+Jupmdxqk6txKtTVb9rpHgq8aDhUNazB1JtyrDX8gma/gZ0x1CRUNHx7+RH772+gAAADUmbbWm3ckyBZGS6ZHiscH6B9NMnoTWWMgK9ttx1utx3xmbLH+RtL6cv3P5fqfRdywSMmkKMmUCPFY7+YkPhnIykrDbzWGdTTr8VvsxOFw01W3o9GucDnC5JBry3TfowMADsZ8qOnhIYobM5UrhFwfBb9OBrK8VPddrXGzv33FpUrGT/B5y06QWGBIRu+8IUBnL6o1bgIAKT8+OeSaFPk1Aq6P6uxgXNq7iwffv+PB9+9Ao26e+Op+797rPo2eM3z0nG7cCOU0YubQETO7d9E0gKGTM5Em8v3kld+DukBy20vLb3tpORrF/JuQkhghl7YZO46QH1+16bG5U64fmyvi+z5CNtnJfaVVKw+fzK/vPE5IUCluGNvtryI2aPn+7DEMwzBskJh31ajP3tyUt68UAKwWct5Vo91H04fG7Vx3Kv9YVZ8krwNLyYjiEJziM7UMzRBu7de7qz+2WSDiz7tq9IwFw+9Z+sG2tSeQhDvB5QCAsxNlz8hCRABg9LytFZlaNvj3JyxCPmfpKACoLm3ZsiYvOS3qpvtnoQthgxJBcJ66bfYzH3X0HLCT1Hs/7/l0zYHc9NjEaJVcIuLzuKSDstodrRpTXauusqGd8fziycTC1+5fJMETqF44oaLhLEtr7edcERvdfrrt/wrV74WLxoWKhkn58XxCzgHCwRhNjto26/F263HvGkmXBNmiWOlsNBqcUFHuqIjnT7S+6p2eY1iyXP9Tuf5nlXBouHi0nJ8s5IYSHAHDknZabXBUtVtP6OxFyFruckIf6MH8qwphJofDdcvgs0jBb5AV7gAQKsxtMO10PXUwHk3DeIREJujJr0Ca4maLo7Fc76MvGQCwLF1r3FRr3ATAkfOThLxQAaEUcEMY1kExFoqxOBiTmWogaR26Jnbh2Gh1rXFjrXEjAAi4ihBBmkKQLuHF8AkZj5DxCRkLNM3YHIzZQjWaHLVq22kr5fETjMhQ3i7nJ6PRIGQo76g2/InMEuzEsFS57sdK/aow0cgI8VgxL1rIVbAsa2e0JK03klWt1iM+tyo3/Kk642at/Sw6cGkZEf6MlWputhxAB3rK7Kg/q/6wTPf9yPBn42UL0OHg4N0Fhg0MLsF5cfHsR37tOEK2Oag3tux9b+fBUYmxyWEqhVjE5xJ2iraSjmaDsVatK29T055HyHKR8J3rFknxBKqXEJxwxzAMwwa1WYtHfPn2loO7znE4wONzZyzyKC2ctXjEyg93/PH9wZmLc2PiO0uutGqTVCYSCPvyZ04WIp40O/vQznOrvt53470zXXGKooH1MTWoP321zSzLtjbqouJUrgjBJQiC433bLI/HVYXLG6rbHSTF91OJHFhccjgAHN1TvOTGjtvJWxt1uzeecV+mB+/PQy9eWV/d9v3Hu5Izors1Wyx2Ac0ak/7krbPe/WkPw3acJ9hI6tjZ2mNnaz0X9CE5NvSth5cm+2qHig0YAaEYFfHi7vqbbXTHbHJOFGNttuxrtuxzD3ZJKcweHfkiGu2OJPlVFGM90/4fdKADq7UXau2FaLgrGcoVWap70GgQuBxBCD9VT5aiAwAAwCekckEqGvUjcO94pTAr+O75iNzwJwmOoFT3LTrggTU6qo2OajSMDW4krW+3nmi3evRx7pZI8cQc1YNoNDhCrmpkxDN5Lc+jA+cxLNlmPdZmPYYO+BErnZWmuNlIVl3yCXeCw5sc82GF/rd89Tt+7rnpCZLWHWt5ts16fFSE3w8lMLy7wLCBMS8n7flFs97Y4naE7KAOV9Qeruj6CDk1IvSDG69MjcBHyJeUnpx1YxiGYdiAUYRKx03LOHW4nKGZCTOynJOduoQoJU+/ed2/H//1wWs+nnlFbnh0iE5trqtszT9e/e2Wx92T0YHRNFN8ps5isllMdnWrAQD2bclXhcslMmF8UnhYVEd344eev7KyuOm7D3Yc3VuSPSJBIOQ312tOHCx7e+U9yelRAEDaqdLCeovJbjHb9Vozy7J/bTgtkQklMlFiaqQyVAp9t80Mw94+/52MYfFpObFhkXKLyZ63v7SpTnPrQ3PQRQFmLhr+x/eHnrrjq7FTM2ia0WvMj7x8FbqQf9kjErJGJOTtL33qjq+GjUnWtBkPbi8ckhWTn1flvliX7w+Cx+O++P4tf7/hf289s+q9n+/3uQw2CF0/d1ROSvRHq/afKqlHx/xIT4i4ecGYKyZn47lSLzgbrRbzIqfGfra/8T47rUGHuyNEkDY55iMuR4QOdFOq4kY+IT/Z9i+GJdGx7uMAMTTskQzl7ehA0FTCHH8J91BRbvBZcqUwh+DwGJZCBwCg+w3cEcPCHpHy4/Lb36L74k3DLhlRkkkTo9/t1gzGiATZIp29xGdjme4KF40eF/UGACiFWejYJafVerTOuKnJsr8Ps+0uVYY1PEI8POxxdCA4eHeBYQPj1okjc+Oj396+73h1AzrmR1Z0xO2TR1+Zm43nSr304IQ7hmEYNtjNXTb6yJ5i8Jwu1WXirOyPfnvwt6/2Ht1bbNBa5ApxTELo7Y/MVYV1Y5ZUs8H2xG0eU1p9+Oo654NbH5ztSmGHRYZ8tOqhNd/sP7Tr3MZfj3I4nNAI+eQ5OaERcucCLY3aJ//2pfOx01vPrnY+ePD5K5fePNH5uE+2mSA4y++cdvJg+e6Np+12SqGUxA+J+OeDN05f6KOmcsU/5gsE/H1bC379Yo9ILEjJ6F5qm8Ph/OuTv33z/rZThyvWnNkfGau8+YHZs5aMuGn6G+6Ldfn+eAtRSV79+LbHbvnslYd/+PDXB0N6N3ErNmCGpcZ8/tz1dS3aPScriqqaqxs1ar3ZYnc4HLRQwBMJ+TKxIDZckRitSksInzQ8JTrM73cAG2B2WgsAIYK0GXHfHG5+zEh6XDYLXoR47ISod3rcXBiRKF8sFyQdb3mxlyWWYl7U6IiXoyST0IHuUIpywPgnGgUAgFBhsA3cwVksL0j31/cGaRbfAykh14aKck+2vuLeIKj3gr+igA0qBEeQobw9O/T+3n+Cw8MeIzj8Eu3X6EB3xEpnj418jcsRAoBSOBDNqS+UJvPec5pP9GQZOtCnynQ/RIjHRkumowPBwbsLDBsYufHRP9x5fY1at7Oo/GxjS0Wbpt1ktpAOkqKFfJ6Ez5cKBfEqRXK4MjMqYlp6cowCHyFfsjjs+ZsdMOzSZqONx9U/VBkPmahWLkcQJhySq1qWHjIbXQ7rI1+UXkl69jx1uid9vZDbjZTi5Qy/hxiGYVhvlOt/ym9/BwlyOYKrhhx1PqYYa6Hm/Sr9mgAt2r1xOcJM1d2Zqjv7PNVCs2SJ9qty/U8UY0HHusLlCFMU12Wr7ucTUnSsm7T2wt31t6FRAACYEvO/bmXzT7e/Wan/DY0CAMD8xHUyfiIa7T4WmBrj+hLt12ZHsHec+CPjJyaFLEuSXxnkvJ0IirGsr5qCRgGyVHfnhD6ERi9vRrKqSPt5g3lnX1VDR0umjwh/SsqPRwd6odmy71TbG1aqc0K/IPEJeU7og6mKG1wz1tOsfX3lZGQ/Myby1ST5UvdIlwbbd4xirKfa/lVn2ooOAAAAj5AoBBlCbhifkBEcPjoMAAAsUAzroBgbyWitVIvF0RRgbyznJ89JWE1wel40OXh2FxiGYZe8nu+sMewi4mCsv9c8oiVrnE9plmqyFjZZCw2OljFhN3kui2EYhmEYdsmiWZJm7c6yUx4hHhn+3JCQ60p139WbdnTZ0YVPSBPlV2Yo7xDzuneXTJC4HEFO6IOpipsqDatqDOstVCO6hC9SfnyibFGK4noRNwwd6xGFIMNnKxgOEKGiblS4A0CocHgl+Ei48wmZjJ+ARnuEA0SyfFmSfGmTeU+tcVOL5SDN2tGF/ONwuKHCYRHi8VGSKcHPB4v1klyQMj7qTTutqTdtb7bsa7eeolkbulAQpPy4BNkVCbJFckEKOtZr0ZLp8xMnVhvWVhpWBXkrjJAblhJyTariJiHXoz8elyOUC1IMZIV78GLnYIwHmx7W2PKROMHhJcmvSg5ZphTmdPeqJMVY1bZTtcYNdaZt3lNJGx3VzZZ9PZ6kGvDuAsMwbADhCnfssnBS/euhNo9mEU5cjmBF2moRF9/F0/dwdXbv4fcQwzAM6w2fFe4AsDh5p9ArN+1gDC2WI23WPANZYabqKcZEM3YuIeQTITJ+QoggPVI8IVIyofcd24PG6uzFrdZjOvs5o6PGRrVSjJlhKS4h4nEkEn6MjJ+oEg4NF49RCDLQVS9jFGPV2PM1tnw9WWZxNFqpFoq10oyVw+HyOBIeIeYRUjEvSsZPlPOTZYKUUOFQXq/vCcB6iWVpA1muI0tMZLWZarRRbXZa42CMFGthWAfD0gSHxyMkfELG40hFvHCFIFMhzFAKMvsjz+6TgaxstR7R2c8ZyRor3eKgjQxLOr9UQq5KJkhSCDIiJRPDhCN60z7+4nKo6R/es0zL+cnjo99SCNKReHfVGjcdb30BjQIkhywbHfEyGu0pvLvAMAzrP7jCHbss1JiPoSEAAKBZssFyOlU+DR3AMAzDMAy7RHnXbgMAnwiJl82Pl81HBy4YjlKYrRRmo2EsIB4hjhRPiBRPQAewQYzD4SqEmYpB3Og8RDAkRDAEjV7GaozrvLPtzvmo++QGoET54mbL/nrTNiTeajmCRHoD7y4wDMP6T/duccKwi5TJ0YqGzjNRfocwDMMwDMMwDMMwzA1bov0WjQEMC3usT7LtTonyJWgIwEq1BmjyjmEYhg0euMIdu9x1t7MehmEYhmGYPyRD5akrT2lqyozNjRatmjRZKJJiaR6HK+LyFXxJhEgeK1alyaPSQ6JzlQlSnhB9CQzDMGwQU9vOmBwdc4O5iHgRCbIFSLA3VMIcNATAAkPSeqRFPoZhGDYI4YQ7dlmQ8yP1Dt/zbin4sWgIwzAMwzCsm1ps+m8r9m1qOG2mfMxBR7IUyVAGh7XOoj4J1c4gwSGuSxz/zFAfZYwYhmHY4NRmPY6GACLFEwA4aLQXBFwlGgIAAIox44Q7hmHY4IcT7thlIVE2od5yGo0CiLiKOMlINIphGIZhGNYda2vz/lu0xUqT6EBADMvESXDeBMMw7GJiJCvREICc38cT2LIsjYYAAIBLDNjM1RiGYVjP4WYa2GVhuPKqUGESEiQ4vNnRT/AIfCs3hmEYhmE990XZ7tcL13U32+40JSIDDWEYhmGDGMno0RCAgKtAQ71jphrQEAAHCAERgkYxDMOwwQdXuGOXBT4huibxw+PqHyqNB01UG48jjJOMGBd+W6QoE10UwzAMwzAsaLtbij4r24VGgxMjVqbIItAohmEYNogxrI/LqzRjRUO902Y5hoYAJPwYgiNAoxiGYdjggxPu2OVCxJVPjXxwauSD6ACGYRiGYViPkAz15tn1aPS8cKE8RxEXJpRJeUJnA3eDw6olzZWmNjvtAICpuLwdwwafA6crH3/vT9fT39+6MyFK6XqKYTxCiob8FKT3GAtMpWEVGgVQCYehIQzDMGxQwgl3DMMwDMMwDOuJ9fUn22xGNAowKTztgYy5w5Tx6AAAADAsU2lqO6dvyAyJQccwDMOwwU3K87FvbzTvzg1/itNHPXtLtd8ZyAo0ChAtmYaGMAzDsEEJJ9wxDMMwDMMwrCc2NpxGQwCL40a+mnstweGgA+cRHCJNHpUmj0IHMAzDsEEvVDQcvLq4W6mWSv1vqYqb0IHuqzasPav5GI0C8Al5nGwOGsUwDMMGJZxwxzAMwzAMw7BuMzishbo6JKgUSJ4ZuiRAth3DMAy7qEVJJnE5Atqrk3uh+n0xLypWOhuJB89OawrV79cYN6ADAACQpriJyxGhUQzDMGxQwgl3DMMwDMMwDOu2s7p6hmWR4PyY4TIeTohgGIZdsvhESIJ8cbXhDyROs+SR5idTQq7NUt0l5kUjowGxWvvZGuOGGsN6mrWhgwAAIOXHZahWoFEMwzBssBrsCXdb62SWbhJHnwWOBB3DMAzDMAzDsAuk0tSGhgAmhKehIQzDMOzSkqN6oMG03cGY0QFgqwxraox/hotGR0mmKoQZMn6SiBtGcPiuJRjW4WCMNqrNQjUZHFU6+7l26yk7rXZ7ERSXI5wQ9Q4ub8cwDLuIDOqEO0tVsnQTGsUwDMMwDMOwC63F5tXEFyBNHomGMAzDsEuLiBcxOuKVoy1PA6D3OQEAw1Kt1mOt1mOuCIfD5XJEACzDOhjW4bZs17gc0aSY95XCLHQAwzAMG8T6ZhLtfkLbD6AhDMMwDMMwDBsE9A4LGgIIFcjQEIZhGHbJiZPNHRXxT05wGRWWpSnGTDGW7mbbpfz4GXHfRIonoAMYhmHY4DaoK9wZcj8awjAMwzAMw7BBwE5TaAhAzBWgIQzDMOxSlBKyXMKLOd76kp3WoGO9RnB4QxQ3Zqvu5xNSdAzDMAwb9AZxwp210PYjaBDDLlEWSlNnPtFkLdSRdXpHE8mYHYwVgMPjCERchZQXrhImRorS4yWjlYJ4dOX+wbBUk/VsvflEm71CR9bZaD3JWDlACAiJhBeqEiREijISpePCRakAHHRlAILDRUOXn8H/HlppXbO1qN1WriVrDY4mC6Wx0QaKJVmW5nIEXIIvJORirkLOj1YK4sNFqTHioVJeOPoq/UNjrynUrau3nDI6WhmWFnFDIkTpSdJxWYoFfEKMLu3G5Ggt1G2sNefpHY0OxsInxHJ+dLQoO00+I146yudb3RuD+T100ZJ1DZbT7bZyDVljdrRbaT3N2lkAISETcUNE3JBwUVqcZESsOFfCU6ErDxQWmDZbeaPlTJutXO9oMDpaHIzVwdgIDo9PCMVcVQg/OlSYHC0eGicZIeKGoOtj2ICjWQaJEByC4PTxTgbDMAwbtKIkU+Ylri3SfFZtWEuzJDrcI3xCmii/Ml15m4QXi45hGIZhF4nBlXBnHAWM/QBDnWMcRSxVBdBxGmNtHuq5IAAAT3Y/X/4MGj2PpRspy2+MfT9L17KMnkMoObxkrnAWV3ITh0CyCYy1eTiwFoKfKwxf5zFAnrCrlzsfC0K/5gpnu4+Smttp+z7giMTRhQCeeTHWTlnXMradDFXEMmoOCDncGEI4hSu5keBleCzpiTJ97DD+FwBEUcc4RAQAMFQJbf6ZJg+zdBMAw+FGELxsQjiDJ7kO/Ue7z0Ybvyq7CglygHNf5mYeR4jE/am3nPqz9gk0CgAA06IeGqG6Fo36933FLQYH2rX/rvS1Yq4SCbpzMNbPSxej0eDEiIddm/QhGu0Ln5YsoD1vGMxVLZse9Yh7BABYYCuM+wq06xosp5EhJ5KlSMZicDQ1WQvOAQCASpA0TLkkR7kocM6xNyyU9oz29yL9FgulRccArDRppXVqe2W5ce+hti+VgvjhyquGKpfwCI/vjICQ2GiDe+SyMpjfQxaYBsuZKtOhWlOelqxFh8+jWDtF2+20yeBoarEVu+JhwiFp8uk5ysVSXpjb4t3zeekiB2NzPU2Ujl+a8KbrKc1Sh9o+P6NZ694W00y1m03t1abDR9u/nR71j4wQjx2yE8PSeeofTqh/ZtjOslM7bbLT5e228kLdhkhR5pyYp8KEQ9xW6onB8B4Gw0rrCnUbi3Vb9Y5GdAwAAKy0zkrrAKDJWlig/RMZDcaEiDvHhd2KRrtJY685p99Uatjl8++FZkmaJm20UUvW1piPAQDB4cZLRuUoF6XKpwd5KzeGYRiGYVhvWOyOCc9/jEY7CABuRGPn5QypuWHBXjTqRcKLjhCPj5FOj5JM43L6/mapU9WNn+84kl/bbCOpGJV8wYiM++ZOEPIHV0ao/2w8UfTcL1vRKMDqx2/Nio1Aoxh2iQq4HwtkXm76u39bgkaxgAbX7pUyr6Stv6PRbmMp00cO0yfgdoWZZdpZsp0hj1Omz/ghz3MlN7gtTxD8HIY8zlBlAIx7X3vGcbLzMXkKSbgzjiIAIPg5SOKbIQ+RuqdZusEVYYFkKSNDlVLmlTzpCn7Ic13mylm6hUNEUKYPHMYPXRceAIClamiqhnEU8iR+f9GDJ+LKQ/gxSI6bBVZjr44UZboHA2iyFKKh85qt54JPuJOMxeBoRoJyflTgbPtFpM1WgUSaref2tnzQZitD4oFpyZr9rZ+c0Pw8KeKebMVCdLh3WGBOqn87rv7RwVjRMT90ZP3+1k9OaVZNibw/PWSWKy7kysHrA70cDOb3UGOvPqvbVGb8y2daM0hqe6XaXpmn/iFbccXEiDv75C+03V7uekyz5Kb6l2rNndNMIWy0cXvj6wZH41jPPC/NkpsbXq4xHXUPIlptJatrHloS9+946Wh0LDiD9j1E0CyZ1/7jGe0a9wsbg5CebDjS/k25YQ/ra84xfxiWrjUfrzUfV/BjJ0femyqfji6BYdjFwGS1bz9ccqqkvrimRWe0Gi12hul6V3D/tVPuXBqonbGDok8U1Z0qaSitba1p0urNNouNFPK5UpEwTClNTwgfnhY7Z1y6XCpC1/Tvg1/3/rTlhPPxxvfuiQyVu4Ya2vRbDhYdL6qtadIazTYWQCYRxkUoMpMix2YnTMpNloi6Tpz1xza79NP77KTWmw+crjx4pqq2WasxWEwWe4hMFCqX5AyJnjg8ecqIFLGQj65zQbVpTTuPlR44XdnYpm/XmwV8XqRKlhYfPm9i5qThyXweFwCc/99dDMvmlzYeLqg+WVzXpjPrjBaWhdAQSUSobHxO0rRRQzKTejijcp+/cn9/nzEEweERHD7DUhzgEBwewRHyCRmfGyLihkl4MRJ+XAh/iFKYJeZFoWv2nROVDXd/voaiOxILte26L3cdO1vX8tk91+D7sjAMw/rD4Eq488RXEfycjieszWF82/mQL38WOOixGsHPRSJOpO5p2rrG+ZhDRBKCMRxCwTJahsxjGQ3LGkn9s3ymlSf7u2sVgj+cIY8Da2WpWg4v2RVnyI4DEQBgHKddjwGAZdQs0wYABH+4e5y27SB1D4GztJkj5QrGc7hRLGtjHKdYqgaAocxfs0yrQNlFVTXLtDqM71OmDwAAOBKClwYcCcs0s1Q9AIWk/nsjUpThXVTebivvRsLdWoCGzmu2nkVD/rXbKtyrWZ2iRJfObOxqu/M/sOOI5qTmt8OtX7JuV1O6xUJpdzW9VWM6Oi/2ub6qgDBT6m2N/2q0+P1AAzBRbdsaX6s1582I/ofz9ggxV4EudBkYrO8hW2U6fErzW882zCeGpc/qNlYaD8yLfS5ROg4d7iYLpbFQWmczk70tHwbItrscaftGwY9zvz6xo/GNwNl2J4qxb2546YbkzxWCOHQskMH+HrpT26u2NLysI+vRgcGEBfaUZtWxtu8o1o6OBU3vaNzS8EqSbMK8mGdFffb3cjGpNrfvbSk6p2+oMLZqSJOZsgOAhCdU8SUJ0rBkacRIVeLI0CSVoG/avzZatUfbK85oa2vM7Y1WrdlhtzGUkODJ+MI4cegQeeTo0OTJ4elKgQRds08Nhs2w0Y5Wm8HgCPbC6oWSprglTXELGh0EGIb9et2Rn7aesNj6pgODU2FF05pdZ/aeLDdb0Ze10IzF5mjTmYqrWzbsP/v2D39dPSv3weVTJSL0FKNL7XqzM0FpI6mPf9u35q8zSP5aa7BoDZbCiqbf/zozYVjSR08Fqj7p123up/fZyWC2fb3uyOqdp10pPCeN3qLRW8rr29fvKwxVSO5cOnH57BEEceFTeiRFr9x4bOWGYyRFu4J2kjKabRX17duOFMdHKl+6e8HIzLiQ7l/YOJRf9fGqA+V1bUi8oU3f0KY/XdLwxR+HxuUkPnrTjPTE7tXS9t8rO/Xt9xnzKUY6c9mQd9DowHp/8wHkTxUADpXWHC2vnZieiMQxDMOw3htcCXdCOI0QTnM+ZhmDK+HOk94GnKDOmijLD+ez7Ty+4lWe5Ea3inWaMn/rMLwJQDuM73J4OVzRHOeAK3fPUEVcr4Q7V7SAtm1jyTPu2VLWUeR84J73Z+l6Uve4M9vOk9zCD3kWODLXKG39k9Q/C6ydtm6gBBN5kptdQ95oyxratpXDjebL/8kVX9H5SbEm2raTw0vzWLoXIkWZ5Ub0Brd2eyUS8YcFttnq7HTig9HRaqbUQfZMcC9xdQk+7z/4OUv4Q/gxALC35cOedW9AlBv3Wut0SxPe4npdkeouPdmwru4p75sMuqVIv1XvaLgy/k0+IRZzkd5Nl75B+x6e0qw+2PoZGu0LVlq3sf6f82OfT5PPRMe6qd1ensgbV2U6dE63GR3zY2/L+wnSsSKuHADytX9478r8IRnL7pb3liV048znongPnRospzfVv0AyFnRgMCEZy/bG16tNR9CBHqkxHf216t7F8a9HiNLRsYvQzuazT5/8xT2yYebjcZJQ9wgAHGgr/ap8T77WR0cjPWnRk5Zqc/t+KPmhCjjAyVUlXJc0YVHsCHTR4DAss72p8LeaI2d8/XNWmrTSZJvNeFpbs7Y2j8fhTovMuH3ItFxVH5/AD/BmMCyrJc2tNkOrzdBqN7TaDG02Q9v5p0aH73tHGJYZvfkFNOrHN5PuGalKQqOXAavd8eh//zhV0pOLgmEKabjC9wWk937e88u2zptTA3NQ9Kodp46drfnqhRu7m11t05ohBXRG6z/+u7aoqgUd9jQpNxkNuenXbe6n99mpqKrl0Xf/0Bq6+K3R6C3v/PDXwdOV//fQEqm4bwpEesZGUv94Z23gd6O+VXffG789dducKSNS0DH/aJp5c+WudXu7vh6fd672tpd+fPTmGTfOD+o2u/57ZXd9+H3GBi2L3ZFfg9bYOR0uxQl3DMOwfjG4Eu69xVooY0cCha94nefRNwYAuDzp3QCEw/AaADgML3NFM52tXQj+MOcSjKOEK7rC+Zila1imHQC4khtp2zaWNbJUhSvTzVAdWWb3CneH8W1gTQDAFS3iK153xZ244mV8RuP81ynThzzxdd5l+y60bQuHGy0MX8chPO8Q5Mi44mUekd6JFPsoIW+3V6AhP9T2ysBpnWbruVR5x0WUwNptvhLu4ksn4Q4A7baKEH7M0fZv+yTb7tRgOfNX0zvzYp9DB7rDTKn/qH3cRKG1Mz3QaClYX/fsssR3xDwlOnZJG8zvYZZi/pG2b/pqHicEw9I7Gt8ISYrp5eWxdlt5vGTU/pZP0AH/bLTxjHbNhPAVZkp9pO1rdDigevPJJmthjLhj59+li+I9BIA2W9nG+ucDtzPiEUIpN0zIlXOAY6MNFlrTm7YzPShZtNGGP2ofVwd9ZTcYJqrtj9rHr0x4M0Y8FB27+DXb9O4Jd73D+n+F63Y0+e3nhmCBPaOtHRPajfyRuxOaqn8Xrq82Bbtzo1h6d0vR7paimVHZzw1dGiHq7FTQGwO/GUfayx/OW4lGsb7w0udb3POeSTGqJVOHZiZFSsVCo8VWVNWyfl9hU7vBtYBKLv7ninlxUcr4SKVI4PfkZXJuinfyOkIliw6Th0hFdgfdojbUtejcR6sbNS98uvnDJ69xD3ZJrTPbSeqxd/9wz04SHI5MIhTwuQaTzb2AetrIIa7H3vp1m/vpfQaAE0V1T7z/p8XmcA/GRihiwkJEQp7eZKtsULvX1B8uqH7gzVVfPn+jMODL9h+GYR9/708k2y7gcYfEh4eGSMxWe2O7oU1rAgCWhXd++IsgOqqyukTRzJPvrzuUX+Ue5HKJlNiwMIWEZli13lzTqGHYjppxhmXf/WlPm8789+u7OD/qv1dG9OH3GRu02oxm11cF0aI3oiEMwzCsL1yYg55+QlnXsowBADi8NJ7kenQYAAB40tsp8zcs3cDSDbR1C1e8BAA4vCHAkQBrYali15LO8nYOEcEVTgWOAFiSIU9xXQl3Z4U7R8LhpTojLNNGWzc5H/NDnnY+QPAkNzmM/wXWwtItNHmAK+xshuCNH/ISmm3vB5GiDAAO0ssl+DxIU1fdFZqtZ4NMuLf5qHDnRIoy0JgXLkcwM/oxG6230nobZbDSehutdz4NnHUaeG32cj4hzmv/ER04T8ILVfDjxDwFlyMgaZONNmjJOpIxo8t5KjHsSJFPTpPPQAeCQ7OOTfXPd5kpFnJloYIkMU/F5Qgoxmam1HpHg502ocsBNFkL9ja/rxQkoAOXrkH+Hoq5ymzF/7N339FtVFkDwO+MerMsy733FseJkzi995AekkDoBFg6LAvLLrAsW/lYyi4snaWFXpKQRnrvvTjuvXerWL3NfH/IkaWnUbEt2bIzv8PhSPeNldFYlkZ37rtvUaFiJzrgCMeYQaxIDkPExUVshsBE6AwWldLUojXL0E0dWUjTgeZXNyR9hmP9/0zpNFRVdB+x73AVzI61dn3p0Fe42ofr8h350nvOd25yvPKHSTlJQaxIC2lq15frLUq7oV5Fil+9T7gPi2NoJLR7mv7i6n2PjfNHS1YlCaeGczNwjGGLk0B06Ctq1Geuy3/RW9x96eIwRGJWtJgdLWZFB7Gjg1kxYna0l3OYbAwW9faG33v8lOEzJUJmOJcRxMYFRkKrtyg15k6NuQvdzo6R0OxqfGFtwnsS9kgr1GrT9b6Gm7Tyx85/2aB1dygoTQ/3/HmKIEji3bIDX1Wf7FOHfZujbSUXu2r+OXbdjPABXUkKkN2g+cqJK9XHLvWe8q2Zm/v83fPs+41MzU26e2n+3/63d//ZMmtErtIxmXhqbKhtG0qTchLS48PK6ztEfM6MvJSZ41LyMmIlIocV5ls6u7/cef6XowW2yNnrtZdLG8dlxtpt5UGHQv3GN4eLqlsBQMBj3zp3zMy8lFHJkQwGDgAESTa1Ky4UNxy9VNna1R0X4W6ymv/22X/HuUOhfuH9XbZsO5OB375w3PoFeZHS3staFgtxtrD2/Z9OVjZ2WiOlte2vf3Xo5QcX2bYZTD8euHKxuHdmDIfNfHjN1FWzRwt5HFuwqrHzs+1nD54vJ0jytS8P2uLuvf/zCfuceIiY//CaqfMnZoj4vY8sV+n2nC7+bNtZlbanhdrXv15IiZHeMu1GJ1Uq/ntkhA9fzyMen8M69PJDMo1OodHJHf6vl6u1co1OodF3qNQuMtsBCqc7uNNoN5MR+T4WsPr/xT4AEYaT1hsM7hLXVXcMBneJWfMpAFgMx6wJdwAcZ40ijBcIp4Q7zhoFwMSZmYSpgDBdYcA66yhpKgawrpiK92xvOA1gAQCcmYExXEwQxnjWBVoBgDCed5Nwx3AxgzsYp6RsnB/MjkFa/RosapWpXcTynO5v0RWiIUduGs7YI0iLzFCLBCXsWDbubjarFY4xcoKXo1EAALCQJmvmvUVbeKztHXR40JV3HypS7EIubwBAGDctW3xLonCyiBWBDFlzYeXdhwrlO910Oj7V/lGycFr/UnVnOz5r15ej0RtwjJkpXjRKfEs4LxND/6zILkNNpep4seJXJBFWrNzD6NfODFOBfwzzQtYXKXY5p6sETGmCcHIkNyuMmxbCSaL8F7tNrfWa89dkW+XG3i+rCLmxoUjx62jJSnTAa/WaS7b3k3BuxsyIJyN5PV8XLaT5quznMx2fOv/t6C3Ksu4Dpcp9tkiqaPbksI3B7J40hIU0nu/cdKnre9sGNrXqMyQQmN1C2e4F/jG80PmV85ocVqmi2XMif8dhCNEBAAzwcG5GODdjXMhtx9veLVHuRbcAwABfl/iBN1dAPSH3t/zTzUrRYdy0UcHLYvhjJVRXmxTGxkbt5WuyX+TGOnQMAAAMFvWuhhdvS/qEjXvVhm64aNH3JNybdfKNZz/p0Lu7LkJJzObnBvftOoSJsPz+8vfH23vPi/pBbdY/c+mb57OXrU+YhI55J0B2g+ZDX+++YLudnRSJZIGt2EzGnx9aXFLT3tAmt0a2HC6YNsZzae0T62d0KDQLJ2W4qqSOCg164f75MeHi9346YQvuP1fqPnmN2HWiqE2mAoD87Ph/PrY02DE/jmNYXIQkLkKyZk6uwWi2H6Lkp33233H+6yd7FaqeK7t8LuvtZ9eMTY9x3AQYDHzamOTxWfG/+882W6Z754mipdNHud9tf5B3az/eesp2l81ifvCHdaNTo+w2AQBIiQ199fFlo5IvvfPDMWTIlYvF9d/tvWS7mxob+sEf1yGvBwCQiHh3LBo/Lz/9kVd/auroeT//16ZDo1Oj4yKCHTa9wX+P7My3r+cRL1wsDBdTnE3ZzPjzhwpt/ycO+kl4kADHMMoi9+iQIDREC1R1HXLbLzFUJBDZXTKk0bw3TN/HhiPqE7thijD1VFvjLHczym2jhOmKXXA0YbxAmhuA1Fr7xfdUuLNyAABn5RKmgt51U0kjYa6yxm88ABCma9YbGIuiSYsNhvesZkNamh1HHGCsHFsq39/CuRnOa+t1Gar6kXCXsOOVpiaCtNgi7fpygjR7TATLjXUW60qzdsIHvGIqA2MJmKECZqiZcJmqHkxKYxMSETClsyKeThZNR+I2drmwDftb/tmoQecdW6lMbWXdB7PEi9EBT9r1ZVdlP6PRG8K4aQujX3JdLopJOclSTvJ46YZLnd9e7PrOfg1YC3mznJQPi2MoZscki2ZUqY733GVFpwfNTRRNjeBmuL482SOIFZkTvCInePl1+Y6T7R84/6laXZNvGUiyWG9R6i0AAFG80Svi/sXCe7vTMjDmeOkGgjSf6/zCFrQ51PK67fbYkLXTwx+zGwQGxp4S9pDG3FWq3G8fBwC9pbtTX+V91+8AP4Yac1eBfCsaBQCA0ZKVsyKe8riTLJw3L+p5PjPkUtd3yBAJxNmOz1fEvYbE++pC5zeuFrYNYkXNingqQeguHxrMjg1mx44KXl7effBY638pZ/8oTc0n2t6bF0U9z2yYsla4q836py58TZltxzFMxOSK2XwTYek26axLp9qbFpbepxI2giSev+IuzR3LD0kUhEo5IiGLozTqugyqSnUb5b4RJPla0U4Ght8an4+OeRIgu0HzIY3OWFDZewJ8+6I85yywFZvJWDtvzH++O2q9e76o3mIhrCW3bkwenYiGqNx1y4RdJ4pqW3rmHl0pQ0/P3LNmJ8dnxv33uTXud8lVDt2eP/bZf8f5cmnj+aLeK8cv3LfAOdtuw2Uz//bwkrV/+NxWDv/FznODn3DffarEvvvNY+umOWfbbe5cMv5yWcOJKx6mYVl9uv2sLYHJ57LfeW6Nc07cJiJE9M5zaza89JXJbAEAncH0+Y6zrzxEferuv0d25tvXMy0w8dissYnRl2so3jfm5aSiIVpAapIpl/3rS9vdl2+dt35KbzKKRqMFoBH1qUkSPfWhGMNdprh39Mb2ALZW7ARhrsBZY4BUE+YK6Klh70msE6ZyazqeMFf0FLPbNXAniQ7rDYtuu0633RZ3iVCgETsY3rdJ+gMRwc0s7z6EBDsNVYnCKUgQoTZ3qEzt9pFk0fQ69Tn7FvAW0thpqPLYmLiDuoH7wKspA1oUb9TS2H9yGV6VFfCZkhWx/zrQ8mpF9xF0DAAAihV7+pFwP93+sXPFrlWcYPzS2H8wMc9XzpkYZ1LYxkh+zp7GV9yU4Y9Uw+UYjpPeXqM+lSickhO8Il4w3mP61Qk2WrIylJu8rf5ZyisBCmNjh77C+/w1JQbGmh/1vH223Wa8dEOJcq+rCm4ACOOmTQt/BI0CAMCk0I2lygPOBfJt+tI+7XAgH8NCxQ7Kxwzjpk0Pf9z7XZ0c9kCLrrBZW4DE6zXnGzWXYwXjkLj3ZIbaC11fo1EAAIgTjF8U/Wfr+rceYYBlBC0I46TvbPyjytSGDgOUKPdmiRdH80fOl5A2vRIAXrm2pVrd+5mLATY1LG16ePpEaUqCINQ+n95lUJerWi90VZ9qL69QtQLAjLC+fZ6+W3bgWBtFmpvLYN2ZNG1xdG6KED3RIoEsUjT92nR1c/15C9l74dDq/4p2xguk+VIPlbOIod2N0cFxn095CI06+qD84MWuGvsIjuGfTn7APuJGmigSDY10pbVtBNH7Vjwuw13uNc9u1Ggy17fKk2J8c3qMY9icCWlf7Oy5/tfWRXGRxj0Om/m3R5e4z076Vp/22X/H+ft9vWXXGQnhi6Z4KI4JDRYsnpK19UjPZ8q5wroOhTos2F1hnc/9erLIdjtEzF87b2zvGJWHVk31JuFeVtd+ubS3YunepflhEg/PKz5SctuCvG/2XLTe3Xem9JFbp0WEoJ99/ntkVwb/9UwbfE/fMu2BjzabLQ6fjHfNyMuKQT9JaYHpTHnvxU4ajTYsjKSPVQv0ZqkokjW9sJ6Z5iTRe6pqS52TplIAsBgvAxAAgLPyAABjjwEAAAthKgAA0lxy46fsvs/bPZo3SOgtA6fCQgN+Q5nX7tR7PtF0buAexk1zXoW1Rdd7mutKJ0UDdx9UuAeycG76irg3vMy2W+EYY27kc2JWNDoAAAAtukKdRYFG3WrSXm3UXkWjAAAgYcffEvN3bzLFNgmCifOj/4hGR7phdAwjuJkbUzffEvO3eMEE79OviCje6BkRT6LRG+o059FQH2WJF1v7tjvDMWZ28BI0amdG+OOu+sOIWOGRvCw0CuDcycq9QD6Gri7FTQl7iLLLjSsYYFPCqJOMHlvYu3e07W2C6pJAFC9neez/eZlttwnhJKyIe42BsdEBAAA43fEJGhrOWnXKbQ2XjrT1nHsAwIzwjO+nP/5u/j23JUxOEoYh1etSjnBKaOpTGQt/nPHE5plP3Zs8Y2pfEu4Xuqo3VZ9AowATpSmbZz71ePp85zQ3AGCA5QTH/mHUsu+mP5YpRj+nCJL445UfFUYtEndjyHdDxOKOlSS4/0/Momhe5LyZq/8EzD58QIwMsu7eg49jWJjE3R9+uGOSUX6jjYlPJMWE2G5r9UYkCeXRLVOzBzlrDH3ZZz8dZ63edPJa7xWmJdMoPlidTcpJsL97uQSdVutX8m6trY88AMzKS2UzGXbjFDITw6NCPZ+fH7lYYbuNY9iyGT1TqN1bMSvHdttsIQ5f6H0QG/89sitD8nqmDbJxSTGfP7puWkaCkMthMRjpUaF/Xb/gDytno9vRAtWZ8jo0RKPRAht1bmJ4YgBmm2qntx9AkT3noBjee/aJMZMAEwCAtVcMaSoAAIwRhTEiAQBnpgImBABrwp0wlQIAYAKMmWR7BFseH2eNZvLv8fgfg7Ow92eHVBgn3TlL1WVXpe5Ks1MD93BueoRTMXubF23cnSvccYwRxh2xE9zYOH9JzN8oy3jdY+G8qeEPo9EepKuGM64UyH9BQwAAgAG2IPrFfuxeqmhWP6rsh7XhdQy5DDEa6rtRwctsHdIR7foyNNRHqUFz0JCdZOF0NHSDhB3nvqI5gkuRF1CamtGQJ4F5DJWmZufOYAAgZsfEC8ajUU+ieKNCqd5+q9WnHBen7YMGzSXnqnkA4DNDFse84rHtGCUJO2FqOPW1gVZdcbPTJeHhq0rd/n9FO6y3cQx7MmPhOxPuTg/yqjg6WRj+dOYiEcvb9yITYfnHdYpZelNCU/+bf3c0T4IOOEkTRX4yaWOWU7JbbtS8UfwrEnQlQHaD5nM6u84eTIaHRkcspsPZqbVdhq8IuA5XO4ymvj347AkUb5L+5v0+++k4F1a1WOyy/BOz4+0GXUqNC7W/W1jlcqaaP5TUOkyEmjjKq33OTUPfOpxdLe/tzpGeEOaxCN0qMSokNjzYdvdKGcVnt/8e2ZUheT3TBl9eYvRHD60584/HLv/rqS3P3r1mYu9FGlqAI0jyXGUDGqXRaIENTbMOaxjecz5HWijmmNuQlhszsm9sb71j7e1OmisBgOhZE3Vc7yh7DAAQxgIAIMzlAICzcuwrHG1NYHDWWJb4rx7/Ywrusf3s0GLiHAkHPftUGBs99rVAGrhzGMIgVpRz9xhv1k2170JjFcJO7FNp8PAyKex+b1rkU0oWTRMyw9AoAAC4WYrQmc6iqFadQqMAAJAunt/v1REnhz3AwAZvfsbQujmPIQZYrmQNGgWAvheMI3CMGcVzV8Yl4SS4WgzTYwssKTcZDQFoTL1Vb4PJ58ewTddb+2yv35X4cXzbx18vgjT373oAAFzs+gYNAQDApND7BEyXvQs8Gh28ks/sLfm0V6igSNcOUwRJmIieFNifclbdnzLTcdyXtjdeatB2IcEkYdhb4+9k495eFxEyuR/k3xfKQYtq9zRfK1F6dZUrQHaD5nMCPtt222i26Ay9eWFnCrVDqbUkiPr9v3/c56A9ykmJQkP+5/0+++k4X7frC49hEB/p+dIXAIj4Dhf85Kp+Xrjtn6oGhw/6xGjqjwxEQqTnzYqqW223U+Ooz8wp2V+BsG+1b+O/R3ZlSF7PNBrNe8WN7Up6EUsabbjx9kvLsICzx1p0DQBAmAoZXJclooSpJ03s0BAGrOumnifsE+7s3sJAnDWWMJyy/izptGIqAODsMaD9BgAIs+f8cqCJ4GYiWR4SSJmh1jl7bmMktF2ObWfCOKkAIOUkMzC2hTTa4t2mVq1Z5ionAgAqU5vBgjbkCee5/KeHOwFTmhO8Eo16DQM8WTStQL4NHQDoMtaiIdeqVafs1+e0Ny7kNjTkNQFTmh40r0S5Fx0YiW7aYxjnopG32tSBhvoihJ3g/koDBlgIJ5HyGl4Uz0ORjpBpf4W1h9YiR0ODxbfHUGagnmQa0d/GXBFUHXgAoE1XGsvPQ6OeyI0NTdpraBRAxArPHNh8DhxjZouXXOz6Fh0AqFGftpAm96+oYWd5bN6quD5PWfAeCeSXVRRdXJ7NuoXL6NuRFLP5T2YsfKVgCxL/pPLwf8bfhQQRAbIbNH9IiXV4Ky6tbbNvII4oru4toGEy8NjwPkwwIkiyrLa9oqGjurGrTa7qVuuVap3OYDaYzEaT2WA0G4xm9Ge8xmEzRXzfF4X4cJ/9dJytq2takSRMf/C/doPeUrhuWeMPyOWEqFCXz84e0mbHmUZntP91RHv3sFb2dejybi1BkPZL2vrvkV3x0+uZRqP5EN1PhkYbjgI34Y7ZfUkmSTV2o2GLGwzOHItuJwBY9LtZomddlPVZLPqeNBaDM8N+AGflAABpaSYJJWmpBzThngcApKWOJDpJSwuAw4qpAICzpwMwACyE8SppqcMYDv0KA1w4N905u9epd7fYaauuGEk1hnHTAXpawSAZsVZdcbJoun3EnosG7i7/6eEuO3hpn1oqO4vgZgFsQ6N9TNXVqKlLs8O5GVIORS2w9wI8WexDN+0xlLDjOQyR83UyM2kwk4Z+z01x1WXFnqvpHaHcFDTkiM+gKMQzEho0NFh8ewzV5hsztxwFsfpZsyZiRaAhAHD9D7lXqtyHhgAAYFTwsgG+GQJAWtAcyoS7idA3aa/ECyaiA8OWkMl9PnsZGvWp853VzTr0KtSk0JSpYWlI0BvLYsd+V3u6rLvFPniivaxN3x3BddcfOUB2g+YPiVEh0WHi5g6l9e72Y4VuEsHbj/eUyADAmPQYPre3atuN6qau7/ddPn6lSm7Xx9y3hLy+vUV75PN99tNxVmk8TH71hveXDXxCre2tAcIw4HG8umjH9bRZt8ah1FTAc3nQnNlvTJKg1OglIp4t4r9HdsXnr2cajeZzZyvq0RCNRgt4OBoIHBjP1hW9p2e6JwzuMgwPBwDSXGPWUnz9BgCzZhNpaQIADA9jcJfaD92oWLcQhiMAJGBcnJXdO8oea71B6A8DkHbb98AYkQzecgAAsBiVLwEM6tnkAFFmt53bvNhD+snAjYQ7UD1aq56iItXGuYE7DKAwM/ClB81FQ33kKreo87pclwTSVYPjFJHDhah+iOGP6Ufv8mHnJj+GlPlrADATvd9s+yqI7Tk7TDlXhoExRaxINOqIzaCoVjMTBuv7+ZDw4TE0WNRoCAAAOFTP2hscnPoHna8QeKNadRINAYAXjYC8EcJJZOLUyQJXf6HD1Jr4Cf5eY3NfSwEaAlgW0+c5DVYYYEtjxiJBgiR3N11FgogA2Q2an6ybN9Z2e/ep4t2nqE8Rv9598WJxb37hriWe53bojea/f7rvjpe+2n7suq8y15S8qRr2kv/22R/HWa3zQcJ9kNm302GzmF625fGYl0e69HDYfbh4zGU7PLjG8aj675Fd8eHrmUaj+YPeZL5a24xGaTRawOvDR/jgw9njCcMJADCrXsdZORhOkWdxgLFY4r8Y5Y8BgEn5FwCCyb/L7qKCxaz5ytT9qvUOK+hFcJxp3rNuKqmx6PdDTwF77/HBcCnGiCMtDRbDIQDA8CCMifY9Z4meJwzHSUJGGE4Zum5jiV7A2RMctiB1hPGyxXCIJNVs8esOQ0MqlJuKY0yCdLhI0GVw6BiDoEq495SeOefKW3VFSMSec8KdgbGknCQkODIEsSIlbPSV01ccBtqR1spMeHViDQAyQ42r2t5+9ItA4BgzipdTr7mIDowsN/kx5DKoK0ORt5E+4TM8vckDUKZWBcwwjHpKUy9XrUUspGXgRdb948NjaN/Fy15fK+VtmBh1SV0/Fk1VmzvkRoqqHCEzLJRDfe2wTzDAwzhpzh9J0N8VaAPW2viJaMjXznSgC4GwcebsiCwk6L0FUaP/U7KXdLysdbKj3H0b+gDZDZqfrFswdueJwuqmnh79f/lk74kr1UunZ6fFh/G5bLXWUF7Xvu3Y9VPXamw/MndC2rQxHuaNaXTGR1/7qbTWYRaOkMcZlxmbEhcaHyEJFvHEQi6Pw+JyWFw289S1mn98tt9+48Hn1332x3Hm2iV/uWzmpJz+TOdNipaiIX/icnr32eR6mVkE8nbhDCk81xvddclHICl1pMDcf49Mo9GGqYtVjUbXy1nTaLSANTRZBi8xBfcZDScAgDAVGTrm4OyJGB5OknoglaSljcm/m8Ffj/wIg7uEKXzcrH4fwGJSvmJWvYezJ2B4MEkoCOMFkui0bsYUbGTwVjn8JAAAhrNGEcbz1pS6fT8ZK2uPeIvhKABgzBznljUYI4ot+cgoe4AkVYTxsqFrHYZLMGYSYDwg9aSlnbQ0ARAAwOAMtMbZt6wJbmTJzU7XCXcSCGSNPhbOs7WDcG6/3q4rJ0gLjjGQuJVzS5lQTgo+RCkwf4t0uyakl9i4AA0BAIDZRdLNmfNFDisGxrRdOBmIUG5qICeLfeImP4YMnDohO5CCcR4zGA05YVAlgvlM6lJxe66y6gRpdjXkbz48hgwXifV+5MetDC4uJlEef/eatFfREADYTYoaOCErHHRoEAAoE/3DVAQ3KJbv+YrUQDRpZW36biSYK4kbSFl9BDcoRRReqWqzDxbI6/UWk6tu7AGyGzT/YTMZb/525cOv/tQh75mac+hC+aEL5Y5b9RqfFffXh5egUSevf3XIPnMdFRr02Lrp8/PTGQxb5Y0DpBZ4SPh1n/1xnMXC3v4kLBbzjadX2g0GKPv8NUGSBqPZm5pxtdZDCUuQwGEaokbn7Rk4AGj0vQ+OYehD+e+RaTTaMHWG7idDow1P1OdzAYLBmcsUPmW9TRLdFv1Bs/Y7i26rRX+IMBWSZM/pI4Ileo4l/htgAgAgiQ6Lfo9Z+71Fv6cn247xWUEvsYJeRn7KqqdLDGkEAJzllHBn5fWOsh0auNvg7HxO6LaeLQFIQk4YLxOGU4TxEmlpsGbbAQBjRPT+TGAId8p9GCwqtcmh6MamQ19pIhzSG6GcVFuFqYQdx8b59qNm0uCqQY3BolaZHL4DA0A4D62RHzF8kop1VbVKkj0vMI8UxgY0BAAAEnaCTy51hLAT0dCIQx9Dn+O4uJJkj/LYchliNOQEA+oLfv3IbgcgrotZLwaC+oPSI1etY1z9Q2506qnf/IPZMWiov1y9cjTmLo9VisPFGEl/Kkn7pKy7FQ0BpAgHerqSKkIfwUISFSqKf8sqQHaD5lex4cFf/fXOWeNT0QFHfC7rN6unvv/8Wo8Z0vpW+Z7TvYUgcRGSr/5616LJma4y1wBgtgxxteAg7LPPj3NIUO/pvUqjN5r6PB9r8NlfJACA1i7qTzcE0kjdGY/Dsl9otLFN0TvmSUOrwnY7WMRHOrr475FpNNowRa+YSqMNUx7Oq4YcS/QMgzPDrP2WMF4miTYAAsNEGCMCY2bi7HHo1jcw+XczuEss2h8s+sOkpZYkVBguxpiJDM5sBv82DA9Df+AG67qpPbedHt/Wxh1sqXkqGDOZE7qVMJyy6PcSxvMk0U4SKsA4GB6KM5Nx9gScOx9nojXgQy6cm1EEvyLBTkOVkBWOBAGgRXcdiYQ75JGxcG56o2NVY6uu2DmnD1Tl7QAQ4dQFfsTwYY5pIBTGRjQEAN6tWukNVysujiT0MfQ5luOFOu+xcIev0zchMTsaDQEAQJehun8NjlxdIg1iUf9Dbrh6KF/9pYCLBv0AQJAWvUXJYwSjA8NQktDlqYuvVKspLrGniCjOAfokxSnTDQAV3a2jg+PQKAAEzG7Q/E0qFkzLTTp7vda6hGawiKfVGc0EIeBxgoW8jISw8Vlxi6ZketkT49B5h8LtZ+6YJRZ6qO1VqHVoaHANzj779jjnpEbZ3y2ubhubERCntW6kxoba361p7kqI8jwrrrZFhoac5KbFnLrWMxu4oqHTcdCdioYO2+1cx0PaE/TbI9NogcBCEAX1rZeqG8uaO+s7FZ3dGpXeYDCbeSyWWMAN5vPiQ4MnpcZNTI2LDw1Gf3iwEARZUN9ypry+vKWjtkPepdJqDSYTYeEwmSIuJyJYmBAmyY4Nn5KWkBrpxzZZJoulqKGtoqUP7wM0hNZgOltRf7airqK1q75TodEbdSYTj8US8TjxocGpkdLJafGTUuP5npbu8BULQRQ2tF2qbixp6mjoUrQqVDqjSW8yc5hMAYcdJRHFhwaPjo+clBrv15fW8KI1mC7XNF2oaqxq62roUshUWp3RbCIsfDZLxOVEhwQlhklyE6ImpsTFSj3X4Q2mQE+4AwDOnsBGOqF7AcNDmcInmMIn0AG3GLyVPJ7L2ZE4K48X1dvo0D2cMw3nTEOjnvRjn33FeaVTAOg0VFMuateiLUQiSOF2OC8TSbi36YpBsso+YkVZ/Bju1AV+xBAw/Z408YbGTP1FgvL6Sj+IfPQ4gWyEHUMjoVUYG7tNLRpzl9YsM1jUJkJrJHQW0mAmDWbCaCYNZsJgIW03+tBU1EuU/dm94arh+CAbwmNIeTkTAFq0hWMkt6JRL7haeMPVP+RGt7EFDQEAwJHWfx9p/Tca9TUToee5mtswrASx/H5VqVWvREMA8YKBnuvH8ykegfLfsqIcGvzdoPnbW98c+fHAFQDAceyZO2avn5/n5WqWlBrbFbbbOI5NHp1ou+tKmWPn9ME3OPvs2+M8LjMWxzGC6Jk5dKqgJvAT7pmJDhfbLpY0zPZU8g8ApTWeD/W4jN60eFVjR0tnd1RokOMmFKqbulo6e7tmjUmnOID+e2TaCPb4Z9uOl3ibqbB3/c1n0JDfNHQpvj1x9dfLJQotxSQSjcGoMRibZd3FjW17r5ahw55MSov/9OH+nPRymA5ninK17rtTV7ecu97RTdFfUWc06Yym9m719frWXZdKACAhTLJ+Su76Kblclg9yawqtvqy5o6ypvayls6y5o6qty2yhnsL+9y2H/r7lEBr1ZMO0MS+uDqzmxv3w9YnLr28/Zh/JT4n9/NF19hEAaJIpvzx6aduFIr3TfCzri61VoTpf2fDdyat8DmvpuKwH5+RHh3h+s+23mnbZD6ev7blaJqe6fG59aXWqNNfrW3+9XAoASeEhq/Kz103OFXl3UXxEulTd9NOZgkOFlQanXyIAqPVGtd7YolBdqm7acq4QALJjI26dlLMyP5vD9MHf48AFxE7QAoGUk8TA2MjKe5TZcHC7YqqVc/q+xUX6psNQgURYOE/CiUeCI0aA1FrqLHI0BAAAfB/tHgenLjgdSUbAMZQZ6uo1F1p1RW36EpWL/lGDqd95c1frQwyCADmGUbzRTIxjJtGes7Xqs3pLt6vVWV0xWNQ16tNoFICBsfuxCoXG0oWGBpHF6ZgMUyKWh9LXgesyUHRaEDAH+u8KqXqvtzt1abcJkN2g+dXeMyXWLDAA/HbDrNsW9Gcijj21XZ9rIY/DdN2VxUpnMJ0u6E9myocGYZ99fpyFPM7EUQlnr9da7249UnD/8ol8bj8/uwdHaLAgMSrEVrF+9FLlbzfMcn+0W7tUJbWe+03Nn5TxwZZTFgsBACQJO08U/mb1VHQjJzuO936HwjGMMvvvv0em0YaKWm98e/fJzWevWwjq9PEQEtx4EyNJ+OH0tXf3nlLp+nD2WNchf2PHsU3HLr20eu7cnBR02BONwXiytLasuaOsuaO0uaNdqUa3oHmhtLl3fg8AWAji00MX/nfovMFMkaV1pjWYfj5TsP1C0f2zJzy6cDIDd/cZ0Q+tCtW/d53Yd62cIPvQ67KmXfafX09+evjCA3Py75013v0n18hT0tT+5s7j5ysb0AG3ihvbihvbPth/5re3TF85YdRAigx84ub6ndHcwDFmKCcZCXZRrZtqrd+0jzAwtoTt0F42wqlEvdvUorMokCBQrTwZxk2ztYMfediB0fvCYKH+LOf0MTHnCpshdF5VeIQZvsdQZWo71/nlV1V3fldz/8n2DypVx4YwU2wP6+9HUr9/sN8C7RiycF6icDIaBTCThquyn9GoJwXyrSaCovIoSTiFhfct72kktGaiD19afI7wemWLAMdl+D2lpTU7XHG34g/43+VTZbp1Fop/yypAdoPmV9/tvWy9wWIy1s4b6zDWL/aLQ6p1Br3RwxfsL3acU6op3uUG0yDss8+PMwBsXD7Jdlul0b/6xQG7wQC1bEbvpeJ2meqXIwV2gxS+3n3Bm5RIVGjQ/PzeWV/f7L5oX2BOqa5F/vPBq7a7s8enxoYH2+7a+O+RabQhUdLUvubNr348fS0As+0AIORwAEBrMD379a5Xfzncp2y7TbtS/fSXO97addybdw97Zc0dz3396/8OnT9eUkNn2/tNpTM0y3reJ5Va/cP/++W9fae9zLbbGM2Wjw+eu+f9nzpVFJMb+u3nMwWr3vhqz9WyPmXbbVQ6w9u7T97+znc3T2chgiDf23d6wzvf9zXbbtOl0r784/6HPtkiU2vRscE12EkKWiAL56Fl6Qpjo3PJpHN5ezg3DakwFbEi+EyJfQQAWnXFSMRCmuXGeiTonKwfSXBskLqDuYdMZbDpd08PBAYYY+iKjgfHcDyG3aaWA83/93X1XRc6v+o2UTf6GELYkF+D9kLAHsNcyWo0BAAAl7q+Rxp8udeqK77Q9Q0aBQCAMSFr0JAnyPLatEBmIijWY+QzB5rpFlBluvUWl/2UAmQ3aH5V09xTt0GQpM7gg99CckxvyyCCIA+ec9eLYNvR65t+PY9GB90g7LPPjzMAjM2ImTYmyXZ3/9myVz7e4/FqAQAoVLof9l8urW1DB/xv6fRsrt16sO/+eLy4xmUB+9FLlVsOX0OjLjywcrJtpVm90fz0W1tlSpff7dtlqt++tdVk7nmLYzLw+1f0Xr1A+O+RabRBdrmm6d73f2pRUExfCwQ4hvHYLIPJ/NhnvxwoQGfe99WXRy/9a/tRNEobFNYid5XO8MBHm89VoCkm7xXUtfjqFWuyWF756cDfthzSGKjzBt4ra+64670fjhRR958YSdR64+Ofb/v4wLmBX587V1G/7j/fVrYO5WRrOuFO6+XcB4YEQmaoRYLODdwpmwxEcLORiHNTYLmhliDRc3Tn3RhJcCwg/uhcNY9mYD5rMxUglxb8Z7gdQ/Jy1w/fVW8s6z5AkBT5rMAQ4An3gD6G0fzcWME4NApAArG78U9VqhPoAJV6zYWdjX90flsGgAThpCjeaDTqiavrUrThguxXMY49ynKevs5jC5DdoPmKWNgz289iIZ58fcuxy1VdSo0tXdgP08cm21+xfevbI+cK63rv31Dd1PXSB7+++sUBkgS2Y9PewTcI++zz42z1l98siQ4T2+7uOV2y6rlPP9t+trS2zdbeHQBIElo6u89er/1029mHX/3plqc//ve3RzsVviwb9JJULHhoVe+SVHqj+dH/+/m7vZc0dl19AKCls/vf3x594f1dBEEyvJu5nxgd8txdc2x3a5tlG17atOXwNZXWoVxJqdb/eODKhj993dShtAUfWzc9IyHcbisH/ntkGm0w1XcqHv9su85I/aUJx7CM6LC1k0f/Zv6k3y2b8fCCSbdPHZObENXX1hkMHI+TBmfH9Odlz+ewMQxe+H7vpeomdKxfvj15ZfsFNOlBGwSlze0Wgnji8+1lju1l+qG+U/Ho/35R6wf0LcZsIZ796tet59HUWb9pDabffrnTunLASKUxGB/6ePPJ0lp0oL/aler7P/ipfOgmB/gsMUQbASgz3TJDLRJ3rnCP4uUgEQCI4mXXqE/ZR5wr3DsMaD8ZoCq0p/kBReoBAHyY8Rz8Lh+DbtgcQzNh2Nv8t1r1GXTALRxjchkiNi5g4wIWzmXiXBbGY+FcFs5l4rwSxR7KJlEj1bA4hjPDn/yp9hHnaUlGQrun6ZUk4bS8kPVR/BzKJGO7vvyK7KfK7iMk1QubjQtmRTyNRr0QgFcmaK5wGBTnhJoBN13RWtAXJABwGC6vJgbIbtD8atGUzK9/vWC9XVzT+vt3tjuOAwDgGCbgsYNF/PT4sPzs+AWTM0R8imkKVnERwYunZO053fMtVKMzPvnGlvT4sNy0aImIbzCZZd3aourWmqaeKic2k/Hu87f+8b1d8m6XVcP+Ngj77PPjbCUWct/67cqn3tjaoejpfiBTaj/eevrjradxHBPxORw2S6c3ag0maxfyQHDH4vEnrlVfLetJqOkMpre/P/bBzydT4kJDgvh6g7m1q9uWs8Yx7M2nVzz3zg5v9n/lrNE1zbLv9l6y3pWrdP/adOjNb44kRUulYj5JkjKltrq5y/5SBADcMi37zsUT7CPO/PfItBHp1Q2LO7o1co1OrtEpNTq5RqfQ6BVa6w2dXKPvVGkoVx30H4Ikn/92t1pP9fnLYt4xbew9s8aFigToGIBab/zpzLUvjlykXFs1mM/NS4qJCw2Ol4rjQoPjpOJoSVC/m24LuezN565T1raHBwknpsWlR4XGSIL4HLbJYlFo9E1y5YXKxoL6FldrmQLAa9uPTc9Mkor46AAVJo4Lue7edUmSpKyP5rCYLEbfrsICAJc1Ys98Sps6/rvn1OUa9MKJgMOemBo3Oj5SIuRJBDwOk9mt09d2yC9UNV6uaULeQm2q2rpe/H7vf+9fgQ547aUf9ropSMcxLDchalxSdEKYRCLgsZlMg8nc0a2ubpddqm5ydc2AIMmXftzHZbPmj05Fx4Y/k8Xy+GfbChtczoQL5nMnpMSOjo8KEfLEfC6GYQqNTqbWFdS1XKhq7NZRvF0AgEKrf/yzbd8/vYHy3cbfKL7V0G5aIZwEFs5FWvfKjA7lNkZC2+VU8x7Fp0i4O5e9t+vLSCDsc4idBvQ9iMsQiVnRSJDmcwyMbaEqYqWsbKVRGi7H0EKadja+0OSpqQgT50TxciK4mVJOspgdE8SK4DKC3Fw8qFWf8W2yOJANl2MYwkmYFv7IsbZ30AEAAKhRn6pRn2LjgkhetogVzmGIMMANFpXG3NWqK3azJxjgC6NfCmJFogNeYLheCDdROIWD+/28h8MQoiGaC5RNV3RUHdX7RGOm+KYtcN0iJkB2g+ZXD6+eUtXQ6X4JUIIkVVqDSmtoaJMfulD+3x+PPbZ2+nrXy37+/p65FfUdlY29RUzl9R3l9RRfWflc1r+eXJGXETs6Jer4FfREdDD5e5/9cZytUmJDv/rbnX98d+e1imb7OEGQSrUegPpL7xBiMPC3f7f6ide3FFa12IJGs6WkBv1ij+PYSxsXThuTHBcebFtq1b3fbpgVFix898fjtpk0FgtR2dDhqvfsfcsmPrp2ujdd9Pz3yLSRR8znivnuFtp5c+fxTcd6rt8Mjl/OFxVR5c7CxcL3Nq7Mcl2QLuSyN87JX5KX+dTn25HFMAHAQpIv3zovLMg355CtCtVffz6IBMclxTy8YNLktHic8s9pEbQr1Z8ePv/jmQLKdK1ab/js8IXnV85CB6jkJkSd+cdjaNROTbtsxeub0CjA8ytmrZ+Si0ZvYkeKqo44Ti1ICA1+ZtmMWVnJruZMNMu6Pzp4dtuFIqppkHCkqGr7haKV+WhSyxufH7m4+wp1pzgOi3nn9Lw7po+NELv8klLTLvvq2OWtFwqdX2AEQb74/d7EsA2pkb2N6UaG17cfczXRZExC1MPzJ03PTKL8iwQAgiT3Xyv/YP/ZmnaKD+5Wher33+z+/JF1rn7cf+iEO60XBngoJxUpYJcZHBLuHfpypLBXzI7hMYLtI1bh3AwcY9iXN5oIfZehJpSTYot06attt60oq+xpPueqV4nZd/0fXHVcGTGGyzE83vaum0wxBliSaFqWeEm8IN+HzXBGmGF0DEdLVmrMXRddNGEHACOhqdf0FDx6A8eYC6JeoFyR1RtM3GVCc1LofWHcNDRKGzrhXIoFn1XmgSbO1CaKRwjjUPxbVgGyGzS/6lBoctOir5Y3ab2er63Vm9785khzZ/dvN1CnMIQ8zscvrn9t06EDbpuh56ZFv/zAooQoCQDkpPYhee0P/t5nfxxnG6lY8PGLt+09U/LFznN1LXJ02ElsePDyGaPGpA1ZVQ2fy/7wj+s+33Humz0XXfXViQkTv7RxwYTseABIjA7xMuEOAHcuGT8hO+7t749dKnGRCwcAgNGpUU/eNnNsegw64Jr/HplG8yuCJD8/QnHCyWYyPnhgVUZ0GDrgJCpY9NFDa27999ddKodpPSqd4bXtR9+6e6l90FfYTMYLq+asnTwaHXAULha+uHru9Myk33/zq5ZqhYwt568/uWQqj039bZE2CDbOyX9y8VRXqXar6JCgv61fOGdUyh++3UPZ+OitXSfm56YJOC6/zlAqaWp/Z89JNAoAAFkx4W/evTQ+NBgdcJQUHvLKuvm3Th79+29+bezqmX1lozOafrtp55Zn7+Iwh/iLpw8dKar64fQ1NArAYjBeXDNn7SQPf5I4hi0em7EwN/3/th2hfJyLVY0/nL66YdpYdMDPRs5viOYT4dwMp4R7rf3ddn25/V1w0U8GAJg4R8pJ7tBX2AfbdKUOCXcDWnQTPqJXTA0cHFygt6Dv3QBgsPhgeRAAACBHfO/mYXEMGzWXixS70OgN4dyMeVG/l3KS0QGanWF3DCeHbeQygk53fDLwyRZ8pmRx9CvR/P6Xz7BxIQBG2X/JSAxBJ1+aG1G8YDQEUKfunBI6oFmrdZqehhj2Iqiy6lYBshs0P1Gq9f/57uje0yW2il0MgyABl891+DZrNhMGk1ml1SNFZ9/tvTRldOKknASH6A0iAfefjy29f8WkX08WXStvbmpXWBtei/ic6DDxqOTIORPSxmfF2bYfnRrV+8NDxE/77NfjbIPj2C3TshdPzSoobz5fXHeltKldrlKodBq9kctmCricCKkoIUqSlRiRnx2fZLdI7FDhsJmPrp22ek7uofPlJ69WN3cqu5RaIMlQiTArMWL2+NR5E9Nt2ZmkaOnRSxStL13JSAj/8I/rSmvbjl+pulBU3y5Xy7q1DByTiPhhIcL8rPipY5JGJfdnrpj/HplG859L1U31nQo0CvDQvIneZNutpCL+C6vmPPf1r0j8QEF5Y9f0WKkYiQ8Qm8n44MHVk1J733Ldm5mV9NodS576Ygc6AKA1mI4UVd2SR2c2hsZD8yY+tWQaGnVhzqiUd+5b/uin25xX6ZRrdJuOXXps4RQk7gZBkn/dfNC5Mh0AxiXFfPjgaj7H28swOXER3zxx+wMfba5qQ09i6zrkH+4/+9tbpiPxYUpnNL36yxE0CsBhMT/5zZpxSd5eS8Zx7KU1c0U8zv8OnUfHAN7fd2b5+Cz3HZx8jk640xyE8zLAsUhFZWo1kwYm1vO6bNejNThRTq1jbCJ52WjCXV8yCnouR+stSucmBuHcdCRC8wceM1hpcpgFbEWZQe4HvUWNhkacYXEMT3f8Dw3dkCyavjD6JdufNs2V4XgMx4asjeaPPtH2XovTUtVewjFGlnjJ1LCHOAwROtYXDIzJZ0q0ZooiQY0ZPXekDa1UEUW+pkpNMRm8T6rU7WgIIEUUgYZuCJDdoPmDTKn9zas/1rf2nGiOTY+5d1l+XkYcn0v95dNsIWqbuw6eL//q1wu2brnf7LnoPhGcGhv69O0eqrOtxmfGnd/0OzTqwtO3z/LyYfvBt/s8OMfZBsewsRkxYzO8/T485CKlojuXjL9zyXh0wNGja6c9utbbfI1NZmJEZmLEb1ZPRQcGzLeP7NfXM40GAIcLKa5XsZmM26aMQaNuLRidFi0JapZ32wdJEn4+e/2ZpT7ONv5l3QLvs+1Wc0alLB2X+evlUnQA4GRpLZ1wHxIzspK8z7ZbTUlPeHTh5Pf2nkYHAL4/efWBufne15LvvlxK2UkpJkT83/tXeJ9tt5KK+B88sOq2t791Xs9g07FL6yaPjgnx8WWnIbHp2KVWBUXN4su3zvM+227zxKKp5ysbrtX1dpCzUmr135y48siCfs7b7h93MyxoNyHnji4kkHJDve1uu8454U5d4Q4AkbxsJNKm6/00ktk9rE0Ej/5YGgx8ZggaAgAAtakDDfWLzuJ43WYkCvxj2KYvdb5CZiXlJC+K/vNAMsUmQoeGRqLhewzDuRkr49+M4fftWw0A8JmSsSHr7kr+ak7k7waYbbcSMal7dKpMFCejtCGUFRTtvKBupWqgv6ZKVSsSwTEsLYgiq24VILtB84d/fL7flgVeODnj4xdvmzYm2VUWGACYDDw1LuyRW6c9urY3q3K5tNHNUnU0oI8zjUYLAFdqKcqS8lNiJUIeGnULx7HZoygmkp6toMgkDMScUSnLx2ehUS/cN3sCGgIAgMs1FEeA5m84hj2/oj9XEzfOmUDZ6UWh1e+7ivZ4cIUgyU+oaqsB4K/rF7hfZcGV6JCg51fORqMAZgvx8cFzaHQY0hiM35y4gkYBFuSmrZyAphO9gePYn9fOR6MAAPDz2evO8xj8ik640xxI2LFsnI8E5caezzODRa00OVwp4jCEIRyX9S/O66bKDLVm0tBz21jrMAYgYEoFzFAkSPMHVyvTUpZs98PNkEoL/GNYraJuHgcA86KeH2C3cV8V8ge44XsMO/QV39c82KR16GGHAR7OTRcwpQyMDYBhgDNxjoAZGsHNzAiaPy38kfWJH96funl6+KNBrCj7HxwIKScJDQEAQKehGg3RhlQwm5/hlIAuVDQqjQ69U/ukWSevUaPXILPFMXyGy26YAbIbNJ+rbZGdvNrzV89k4M/dNdf7pavm5veu92AyW+Td/X8xjHj0cabRaEOOJKGyhWIi4+j4/pxejkmg+Kmy5g69aaC9E21wDOt3vXxmdFgmVZOcZrlSYxhod1BaX83KTk4Mk6BRL7AYjPtdXDvZe83bhPu5inrKRTtnZCX1dfKEveXjsygXGd55qUSmHvaf1Dsuliid6vcxDB4dQCl6elTo2ESKXE27Un22wt2CKD43oGQBbSTCwrjpyPKAtnVT2/VlSCveSG42OFWi2YhZ0TxGsH3fGBKILn11BC8L7PL4Ns719TQ/kbDj0RAA9HTVJ938Tr2kMDahoREn8I9hs/Y6GgIAgDBu2gB7N1lIo4lAPxdHpGF6DGvUZ/Y2/RVZA0DKSV4Q/YL9KhqDI5yXUazcg0YB2nQlaIg21GaEZ5Z2O1xWt5DE4bbi1XHU30A8OtBSiIYApob1JvUoBchu0Hzrcmmj7XZmYkSwqA9FjgLHzuM0N+jjTKPRhpxMrTWYKbLhSeH9yYTGSYPREICFIJpl3ckR1BOO+2p6ZmJSeP8famxidGkzel2fJKFZ1p0WRVcTDqr+TVOwWjY+6/Udx5xXTz1XUa8xGL1ZOnX7xWI0BAAArlL53rtv9oQ/fLsbCZotxI6LJffN9tAhLcDtuEjRAXVaRuIA/3ZWTsi+SjXP5lhx9bQMlxXDPkdXuNNQEU5Zb4Wx5ypQh/OKqXyX/WSsInnoW55t2VWFsfcrgRWdcB80oVzqpJuJ0HU5LpPbP52OvftHpMA/hnJjz6UyRLKwb13tnPnkCQ4Lw/EYNmmv7Wl6Bcm2JwgnrUt4f/Cz7eC67Vi3qUU54KtKNN9aGjMWDQHsaLyMhrxDkOSvTVfRKMDiaA+djgJkN2i+JVP2FmGJhX2bVd3QprDdxjFMKhb0jtEc0ceZRqMNOed6VStRv5YrDOJR/5RSR/2v9MOKfnWusMmOjUBDAADQodKgIZo/MXB8Snr/c6lcFnNmFsXEXKPZcsWLBkEWgjhaRDF/NzokaEJyLBrto3mjUyhX+9x9pRQNDStNMmUhVcv7eTmpaKiPcqlmxgDA+cpBrXCnE+40VDgPzXp3m3o6n3YY0MVPIl1kUmycu8rYHsQ54R7h9E/T/CSUk8rCqb+GNWopWmj1VYuO+uruSBLgx5AEQm9xWF/IJohN/fHjvUbNJTQ0Eg3HY2gkNPua/06QDlVFUk7ykpi/MHGKs7RBIOUki1gUsyABoFx1BA3RhlS8QDpRil6VuSavP9zan7ejnU2XnXuv54UkJgo8VKwEyG7QfEvI7y0Na2rvW0Otnw72fqqmxoXi+EDnkI1g9HGm0WhDjrK8HQB4bJeLSbjBYVF3ZdDofdOwBcexAVa8SkVoS14rtY/2kOal9KhQ4cCmarnK11PWSiOu1bVQNhGalZXsfW83VzhM5tR0iun1pc3tXareC+3Dzuky6uK2GVRXPvokNULKpXrrqGmXOU9i8B864U5DOZeZd9/o296pd7hkh2OMCG6mfcRZhNO6qV36KgAgSIvqRh7fxvmfpvkJjjGcr4VYVamOo6E+UpnaXdUFjyQBfgzdtCvhM/o/ZdKqXuuXZHGgGY7H8ErXj1oz2jpwevijA1ncdeCShFPREAAAlCh2E6QFjdKG1G/S5qAhgP+U7lWbXf45UFIYte+XHUSjAA+mzEJDVAJkN2g+lBQttd2ubZGduEJRBeaMJOGLHef2nekt4Fo8FZ06SbNHH2cajTbkXCXW1VTpSI9cpa0ps2n9kB4ZSlk77D2Rixp8o++6zNO8kR1LXeLjvbGJ1DVVRY1o6YazC1VoOanVpLT+d2+3NymNIuFOknBucEu2fess1c5HiIURYiEa7SMcx6JDgtAoAEGSlH32/YROuNNQQawoLkNkH9Fbuo2E1kKalCaHN5FQToqrCl+bCG4m5vgykxlrSSC7TS1IniWIFcVliO0jNL9KFE5BQwAA0Ky9PsBlPyu6D6GhESqQj6Gb9TxJGFCKs9NQ1ajxQQl/4BuOx7Ckez8SYeP8WME4JDjIRgUvQ0MAANBtai1V7kWjtCE1LiRxTgSaaGvSyp668LXe4m09iMZseOzCl50GFRLPlyZP8a5zeoDsBs2H8rPjQ4N7W5S8+MGu7/ddNhhdJiM0OuP+s2UP/P37D7ecsgVjwsRr5uTabUVD0ceZRqMNOTGPOkWg0OjQkBdcLQspEfLQUL9kDThL6+oCg4Ug0BDNnxL6tVyqvaSwEDaTgUYBajvkaMhJmVMff6tRLjoO9VVOHPXjFHtxMSBglTS2oyFf/B6tXF1Ia1Wo0ZDfuMwm0G5m4dyMes1F+4jK1EqQFiRF7qozrz0WzpVykzv1vb1oTIS+29js3Lp3gCsQ0voqRTTjRNv7yCq4AABAXun6cXbkM2jYOwRpKVTsQqMjVCAfQwbGZmBspJG3ldasQEN9ca7jS6qnPAINu2OoMXepTehZC5cRhA14Cd8BknKSo3ijW3TX0QGA0x2fJomm8RjB6ABt6Pxx1IqLshqVyaGW/Kq87rHzX76SuzrBUyeWSlXbXwq2lirRi45snPlizgok6EaA7AbNV3Ac+/3dc//w7k7rXYPR/J/vjn64+WRuWnR8pEQk4LIYDKPJrDOY2uXqhjZFdVMnQTi8Twp5nL8/egt/YLPFRzz6ONNotCEnEfIkAp7cKb1e3Ni+Kp96frAblMXFOI7FhvimVi8h1DfZPdqQi5FQVDT3CY5j0ZIg5/R6s6zbZLGwGBS5eJvylk40BCDgsCODHYpZ+y05oncGm73SJvTb33ChM5oaZQo0ChBPtU5yP4hcnMl0DuLiCnTCnUbBOeHebWrRW9AaMY8rplpFcrPsE+4A0GWoUZvR96NwnofuNDTfEjLD4gX59Zrz6ABAsXJ3rmR1CCcRHfBCsXK3rQfRiBfgx1DECndeKQEA2vQlmeKFaNQ7lapjNereIrgRb3gdQ4PTuzQAqM0dWrOczxzi7xKTwu7bVv8sGgXQW5T7mv6+Iu51HHN3CksbTGFc0T/GrHvm0jcE6ZCGuyqvu+3EexsSpyyJHpMeFGk/ZFWqbN7VfPWn2nNmqk5BL+Qs95gltxcgu0HzoTkT0p67a86/vz1q+53qjebzRfXni+odN6SQGB3y+pMrEqMH2s7rZkAfZxqNNuRGxUWcLK1Fgv1brpDypzKiwlz1du+rKIlv8qG0IRcipG6m3yeUCXeCJGVqnfs+J61yii9isVLfXBYCAC6LGRYk6OhGk8WNMuolxwJfQ5fS8Ry/x+Zz1zefo6jT8hX9IPZw982bFG2Ece6l3m1qVTkVTrpqYI2I5I0qVPQU2ljJjfU6i8I+AgARTv8ozd/GSFZTJosJ0rK/+Z/rEt9nYNRXBV2RG+tPt3+MRke0QD6GoZwUymRxjfrMjPDHcdf9Ulxp15cdbH4NjY5ow+sYsnCKqbUEaTnQ8uri6Fc4DHfniP4Wy89LEEyso/pjadRe2df8t4XRL7vp4dMnBGnWmGWuVmqleWNGeMbvMpe8WbIbiRsJ86bqE5uqT0TzJMnCsBCOMIjF6zbpugzqSlVbm97lCo13J01fGTsejXoSILtB86H1C/KykyPf/fHElTKKt1ZKafFhdywav2RqFr2Gp/fo40yj0YbWvJxU54R7VVvXucqGSal9aGnd0KWgXFZx5oDXVLQJFlCcP9OGIzGfupdRn7h6PcjUWjcJd4VWT7lWcKiLBXX7J1REkXBvV6pJEga+Luvga1eq0dCgMJgpKnL8xDdfbmkjjHN3l25jq8xYax8RscKFzDD7iCuRTuumyox1RgvSiw0Lc/pHaf6WIJwUwc1s0/eukWXTaaja0/SXJTF/ZWDUPemcyY31v9T/zkggv9kRLpCPYTR/TKXqGBoFUJvaCxW7ciWr0AG36jXn9ze/aiYN6MCINryOoYgVzsYFRgI9D2vQXPq6+u5M8cJY/lgJO57PDGHiHGR1jUEwO/KZ72seoHx5V6lObKl7cmH0S8HsWHSsLzr1lSXKfWXdB7ODb5ka9hA6TOuLO5KmWoB4u2QfSdX+qFknb9ah5T+u3JE09ZmsxWjUOwGyGzQfykmJ+vjF9Q1t8qOXqkpqWmubZV1KjdZgMpksHDaTy2EJeezoMHF8pCQ1LnTK6KRIKV172B/0cabRaENoQW7aa9uOOqcg39p5/Jsnb6dsk03pjR3HkYluAIBj2PIJaIah3wScvlVH0QKWq2b6fSLmUzf+7ta5+wYnd7HSgJhPnb7vH8orCiaLRaXXB7lYOCGQDWZrF3vObyn+QyfcaRSErHA+M0Rr7l29V2Fs6DJU220CkV40cLcKZsdyGUF6S+9UF5mh1kI6zOOQsOPYuC+v/tG8NDX84V/qqVuN16rPbq17ekH0ix5TYCQQxYo9Zzo+1Vtc1hWOYAF7DJNF0060vUuZpTrV/kEIO97LtTRNhP5i1zeXur73R9vxADfcjiGWKppZrNyDhgH0FuVV2c9XZT+jA04YGJONC9kMAQcXhnASw7kZEdyMcF7mwBvBi1gRsyKePtDyf+gAAAC068u+q9mYE7x8bMjaIFYUOuyakdA0aa81ai7Xay7JjRQ1ULR+uztpejRP8sq1LVoLxUoG3mDhjOeyl66Ln4gO9EWA7MYgeP3akY+Kz1hvPz9mziPZ1OtyjwxxEZK7b5kAAMdaqu8/+oM1uDgu84Ppaxy2ow2M7TjTaDTaYBLzueun5H594jISL2lq/9MP+/5x+yKPOXeShP/uOXWkqAodAFg4Jj0hNBiN9heLMdg1KDQ/YXl6UXmDzaTOkZrclkXrTei1JSsem/rR+sfVFQW9yRzky8T+INEY+nliP4z48tdPG0nCuem16rO2u859ALxZMdUmkpdt/2gd+gq7QQCAcJ7v+8lYSKOR0BosaiOh6dCXo8MAAGAg1M3a6xyGgIXzObiAzRAMftXn0IrhjxkVvKzIxRKdbfrS72s2ZooXZYtvocy4yQx19ZoLJco9XYYa+zgDYwaxouRGio57I0/AHkMhMyxJNK1adRIdALCQ5u0Nz4+Xbhgbso7LcLm8jNrcUazYXSDf6ryEQyQvu1VXjARHnmF3DCeE3l2pOkZZRe4lC2nWWRTWrl/t+rJS5T4AELLCR4lvyQ6+RcAMRbbvkwzxgi5j7eWu79EBAAAgSHOB/JcC+bYIXma8ID+CmyFmxwiYoSychwGYCIOJ0JkIrYFQK43NCmOD3NggN9Z36qtIINDHovnIvMhR2eKYVwt3nOqg/hh1Y6wk4U+jVyYLfdDbJ0B2g0aj0Wg0mpcenJe/81KxQuuw+DkA7LlaVt+leH7FrHFJMciQTU277N+7Thwtdij4sxJw2M8tn4lGBwDHb66v/zT3XK2ManSbcHeVjme6eLT+cXVFweAi3R/gDCbqgzaS0Al3GrVwboZ9itxZlHcN3K0iHBPuziK4mWjIE6WxqVp9ykhojBaNgdAYCY3RojYSWgOhMVo0RkJtIT2/78gMtVvrn7aPsHAuGxewcQEb57MZAjYu4OACFoPPwYVsnJ8eNI/PHGkLSU0Pf7RZe91VZaiFNBcpfi1S/MphCEPYCTymhIGx9JZuvaVbbepw7sVvNS38MQA43vZfdGCECthjOCn0/lr1GYJq5UASiItd316R/RQnGB/BzRSxIjkMAUmS1h1TmJqatFeVxib0xwAAYIxkTX7oPZ9WrPZzvXZAGF7HMIgVuSj65d1Nr1hIX5YMqE3t5zq/vNT1/eSwjWNC1jpfN/Le1LAH9RZlsQLtym2HbNOVtOlKHIOYbw8UzXtRvOB38++5LKvdVH3iVEcFQXq4vIFj+OTQlDuTpk0JTUXHBiBAdoNGo9FoNJo3QoT8V9YteGaTw1puVkUNbfe+/1NmdNiktPhRcREhQr6Qw9abzEqtvryl40JV44WqBlddH/5220I3rbRpNzOftApx9SAemqR7GPYN0tW+DeCr2RCyEB5O5kcAOuFOo+bcxt0eC+eFclPQqGtRXA9N1pyXafWoXV92qv0jNDpgJkJvIvQa6EIHAAAggpc58hLuLJy3PO7Vn2sfd5X5tTJY1C26IjRKJUu8OFeyqkXnx6WlA03AHkMpJ2m89M4LnV+hAzdYSFOt+qz762GItKC50yMexwCTcpKQTlMj0rA7hgnCSWsT3j3S+la7i5k9/WYmDSfbP6xSnVwW+88BLMGKzY18jssIutzV00TCO9TnlyPS/MhRl2/5BxodauNCEseFJHYZ1Kc6yi/LaqvV7S06hcqkN5MWDs4Ssbgx/JAkYVieJGFKWFoIW4D+vI8EyG7YvDFuAxqi0Wg0Go0GAADzR6c+sWjqe/tOowMAAFDa3FHa3IFG3frjqtkLc9PQKI0GAABmC0WBVF+ZXWSBXVW+W3Fc1J67qnzvH1ePxmZR/+sBztVBu3fW+OmZiWjUd+KlwWjIb+iEO41auNuS8wheVp9ar1g7aVD2QQYAHGOEcekCtKEUxIpaFf/WjobnNWbqKw3eSxXNnhv1HABIOSk3VVFqwB7DiaH3ygy1Varj6EC/jApeOjvyd9ar6LH8PJ8niwPT8DqGalN7s+66/1bFaNFd39n4x5Vxb7Lw/i/OMzXsN1JO8rHWtwfS/YY2+KQc4YrYcStivVq6wH8CZDdoNBqNRqO59/CCSSwm/s6eUwQxoG80wXzuX9cvnJvTh5o/2s3GJy1KtC4ai3NY7nKnrrqr64wOKxcOkKtH47Go//UA5+qQhooEk9Pi0ejw1IecKe2mwmdKhMwwNHpDn/rJAAAb54dwktDoDSGcJAZGLw4+xKScpFsT3u3HVAN746QbFsW8bL0Yw8b54r6sfDgCBOYxxABbGP2nnODl6EAf4RhzWvgjcyKftc1ZixWMddhi5Boux7BDX7G36W+bqu440fZeo/YqOuw7rbriQy3/QqN9lBE0/7akT+IFvl/HEgNMOLBe8zQajUaj0Wg0n9g4J/+LR9elREjRAa9Nz0zc8tzddLad5p5Kb0BDfafSUT+ImO+u0ihURD2rUq7RoaEBoHw0FoMh5HLQ6HAQLKBe6ZXyaQ5T1JcUaDQACOdlqFXUk7z6tGKqVSQv21UhZ8TAEpQ0XwliRa5NePdC1zdXun40k9SfNK6IWdGzIp9Ccmeh3FSlqdk+MuIF5jFkYMzZkc/ECvKOtP7bYFGjw14I52bMjvwtci0hmjfGzcyVESbAj6GZMJzp+LRAvtXjQ7mZnNSnpUcrVceatNdi+GPQgb4Qs6JXxL1Wpz53sesbL7stuRfEisoSL84KXuzmgjGNRqPRaDQabTCNS4rZ+tzdz2zaebiwCh1zjcNkLsnLuGtGXkY0fV5H80zptEJvP3SpqWffhgips8NWfA5LyGWr9Wh1fKdKg0QGolNFsW9hYsGgNJD3PVeLMSi1dMKddhMI52ZUq06iUQAMsEieh57sziJ52UWKXWgUAPrVwJ3mJzjGnBR6X07wsquyzSXKfXqLEt3CiYSdMCZkTZZ4MQNDpzKFclN91YVjGAnYY5gqmh0vmFik2HVNvlVtakeHqWCAxQrG5QQvTxHNAKfFWDgMYSg3tUNfgcRHsMA8hjqLYnvD8536SnQAgIGxU0UzY/hjw3kZAqaUjQsZmLvPfQtpNBJanVmpMrfJDLXN2mv1mosWknr24un2j9clfoBG+y5BOClBOKldX1aq3FelOqkxd6JbuMXAmJG8UbH8cXGC8ZG8LOeDTKPRaDQajUYbQt06/Yvf7ztW7FB+x+ew4qTBbQqV1mgyWwg+hx3E54h53HCxcHR85NjE6Nz4SFedOmg0Z20KFRrqu1aqB2Ey8BCBh3adcdLgkib062FDl5IkfbOiqtZgklFdDIiRBKGhYSLaxZ7XdSrQ0LDl7os37SY3QXrnBOmdaLS/ssSLs8SL0egApAXNTQuai0YDxqMZ+9CQ7+AY44nMw2jUdwTM0Gnhj0wOe7BFW9CovdJhqFQYG/UWpYnQY4CxcD6fKQlhJ4Rz0xOEk6ScZPTnb8iX3pUvvQuN3hwC8xiycX5eyPqxIWvb9eXN2oIWXWG3sUVPqAwWlZkwMHE2A+PwmZIgVmQwOy6Slx3Ny+UzJeij2Lkt8WM05J2H03ejIe/0+4BwGEKf/NUEzjG0MhLarXXPyI116ABguZKVk0Lv5zBE6IhrDIzNY7B5jOAQTkKCYGJeyHqdRXG45Y0a9Rl0U4A2fanK1CZiRaAD/RLOzQjnZsyMeLLLUNumK27XlytNzSpTm97SbSYMFtLIwNlsnM/CeCwGX8QMl7DjgtlxEk5cGCediQ/LeZQ0Go1Go9FoI16rQvXgR5uRJNrE1LhXNyx2VeJKo/VDs7wbDfWRwWymfJA4aTCOe8iaZ0SHOSfcDSZzk0wZKxUj8X6obKNeKG74zv8IFwslAp5zA5mihjaCID0e8GGBTrjTaDRqDIwZKxgXK6BXpeu/wDyGGOAR3MwIbmYerEfHaN4JnGN4rPUd52y7tel8WtAcJN4PPEbwLbF//6X+mWbtdXQMoE5zLid4BRodEEzKSZJykrJhKTpCo91MGLjL7k80Go1Gow0Xar3hwY+3INn2ZeOz/nnbopGRUKMFjopW6pS096pauyhX900Mc1c+ZTUqLmLbBYoOmYUNrT5JuBc1tKEhAADIjAlHQ8NHVkz46XL0m6zOaCpr6cgazs/L5mZPuL975cybl3q6pjw5dvJzE2Y4jgeKgs7W5du+RqM3zI1L/mLRrWiURhs6H1w7968LPY1QHh0z6Y/5Mx3H/WUQ/lJIgJdPHdheVcJmMJ/Km3xvdmAl02k3lRZdYVn3ATQKMDHsfp9k260wwKeE/WZL3ZPoAECLtsjXCXcajQYAwMYZ1huNGuX22sIjzZXNmu4ug1bM5kbyRTMik1ckZGcEe/VV5LqsZeW+L6y3z61+Oozbs65Xt1G/uabgaHNVhbJDZtCxcEYYTxDFC5oUHj8jKnmMNJrhaQq03mI+1FRxvKW6QNbSqdcojToxmxfGFYwLjZkbnTYrOsXjI/TV52Xn/3H5oPU2BvCXCYvuThvvuAmqUN56sLH8VFtti6a7y6Bl4YwQDj8jOGxmZPIt8VkSjruWrADwXtGpfxccA4A0cdi+Wx6yBuUG3e6Gkv0NZfUaRYdOTZIgZnNTxKETw+LWpYyJ5PVhXtEAqUzqjRd+DwBv570Sw4tEhwfR0fYz71d+FceP+vfYP6NjNBrtJvbqL0fqOuT2kdHxkX9fv5DOttN8rriROiXtvSu11Gun5cR5ntE7JS0eDQEAwLmKhsVjfdBC+WwFmpi2mpgah4aGj/zUWOeEOwCcq2igE+40Go120znZVPt1yVUAADD87eyRZcmZUq6Hhm40mp9clf2MhgAETOm4EB/X3UfysrmMIL0FnWKptciQCI1G8wkug0mQ5P9Kz/274JiJsNjinXpNp15TKGv9uOTMhpS8P46dK2Cx7X7Ogzatyppw31Zb+MrFfSpT7+LeJsJSpzLWqeRn2+veKTxxauUTUXzq3poAQAL8VHX1nesnWnUOrU679JouvaZU0f5d5ZU0cegLefNmR6XYbzAQ/ys9939XDllv4xj22sSla5NzHTdxUN3d9X9XDx9qclgkw2Axq02GerX8QGP5v64deThr8iPZU725MFCrkllIgoHh22sLX7m0v9vosDKbTmdq1alOtda8V3Tq0ewpT+XMwL14TBqNRhvZqtq6dl4qQYK/WzqDyaBncXnL1acJSVIUYt/kulTamnZZUngIOuC1M+X1aAgAAMYmRqMhJwlhklipuLFLicSPl9QMvEGKwWQ+W0Gxb4lhkqjgwbvM73Ozs1Pe2X0KjQJsPltw76zxLl77wwn9Tjc8iNnc6TEJ2dLwKIGIw6Avk9Bo1AbhL6Ve1fshaiaIFjXFsio02iCwkMZa9Vk0CpARNJ+B9SEB5w0MMDE7Bo0C6MwKNESj0XyBz2S9dGHPv64ets+22yNI8tvKy/ce/UFjMqJjrrXpVADwftGp353ZYZ9tR2QGh7vJthsJy29Pb3vh/G4k246oUHZuPPrjO4Un0IF++aj4jC3bzsDwt6eudJ9tP9Fas2LfF0i2HaE2Gd4qOPbQsZ+8OYYmwlKvVnxYfPqZMzuQbLs9E2H5b+HJly7sQQdoNBrt5rP7ShkSEXI545NjkSDNDQGX+qxeYzChIRrA4cIqNOQ1td54hqramsdmjUmMQqNUbsnLREMA7d1qyiLuPtlfUKGl+o0vGpOOhoaV1EhpcgTFBZK6ToWriv7hxS8JKZrPJQQFf7ukt2JRYzLuqi57/sReu00GpLCz7VxrI5fJvDNzDDpGow0f/v5LAYAEUbDtNofBjBP5oCMbjdYPbbpSC0lx4hUryENDvsBlUGTfTKTLrBONRhuIbyuvnG+vBwAhizMvJi1PGh3C5evN5gplx6/1Jc3anukmlzsbf3tm+/9mrnP4YdfadOrN1QVvFRyz3o3gCSeExUXwRFwmU27QlSnar3W1WEhibkyq48/1IgEePbHlSHOlLRIvDF4Qm5ESJA1iceRGXZmi42BjuS0X/871E3qz6Q9j59q274cPik6/WXDUepuNM96bvmZ+TJrDFo5OttZsPPqjhSSsdwUs9qLYjLHSaAmHb7CY69XyQ00VRfKeiedHW6qeOr3t01nrPdZRfVB06pfaQuvtHEnknJjUOEEwj8nq1GvOttcdbCy33Kg3/LHq6uyolEVxPphCTqPRaMNXUUMrEhHzuSOganUwiflcNAQAADK1Fg3RAHZcKt44J79/r7FtF4qMZooqhxmZiRymV4nT1fmj/nfonPPcg8+PXJiemYhGvUaS8OXRi2gUAABWTMhGQ8PNusm5/9p+FI0CvLf39KTU+AHODBhyXr1uaIFGwGIHc6nfefvnk+sXtleVSDg8OuFOG0l8/pcCANNjEu7JzttWWSxksV+YOFvM8fHj02heUhgb0BAAAASxPM957AfK5D4Lo1//NJpfWLPt82LS/jVpaQjHoXHZ73Jn/ePKwW8rLlvvHmqq2NNQuiSOoqjK2YmW6uMt1QCQJg59Yey82dFovxeVybCnvnRsqMu3kU9Kztqy7QwMeyFv3r3p+UhLlj+Nm/9R8Zl3rh+3fuX8uOTsuNDYBbH9LMKydVEHAB6D9fHMtdMjkxw3cdCl1/zuzA5btn1ZfPbf8xeL2Q5vVr8dPXNbbeEL53cbLGYAONJc+UXZ+Y0ZE+23cbal5joAiFicNyYvX+j4dO5Nn1Aob33g6I8deo018mHxaTrhTqPRbnLOVdhtSpVco5MIPKyfQbNhMRg8NktnRI9kodPFDBoAVLfJjhZXzRmFnt54ZDCbNx27hEYBAGAJVd06pVipeO6o1EOFvUUJVheqGo8WV8/OTkbiXtpxsai8pRONAszISooPDUajw82q/OwP9p9R6dBplwX1rf87dP7hBZOQ+PBCt5ShAQCcaqZoCEWj0Sj9fer86/c8dWbDIytSvP30pdF8zrmjuhVlKfrAdRtb0BAAl0nP8KDR/CUnJPLD6bci2XYA4DCYf5+w2D6Z+17hSbtxd/Y1lukspikRib8svM852w4AIhZnfcqYdHEYOgAAADKD9u3rx213/2/i0o0ZE50boLNxxlM501/Mm2eL/OnCHqOL3jj2nDvVvlN4wpZtF7I4m+bc7j7bDgBvFRzrvJH1XhCb/s60VUi23WpVYs5fxi+03f2g6LTOgqYznDEwfNOcDUi23SpHEvn65OW2uwWylnad2m7cvxhYzyq7NBqNFjjCgnqW6bYxW4g//7jfOX1Mc4OyKfn1+la6yJ3S6zuO9eMF9vGBc60KikZ54WLhnFF9SJQ/unCy07kMAMDfNx/qUvXn99Us635jZ++pl71HFkxGQ8OQkMt5cG4+GgUAgI8Onj1ZWotGhxW6wp0GJbKOTl3PNxMajUajDQtmkrrpsMVFfCDU5o5uE0UdjYQdh4ZoNJqP/C53FhN3WRnzUt58Ww+TEkV7oaw1JyQS3YiKlCt4b9oqPpO6J6x7X5dfspaEA8DUiET3XdQ3Zk7aWVdcIGsBgA69ZnN1wR2pHhpe8Zks+7tvXz/+3xvXEoLZvE1zbh8d4qGJqsygtXV94TCYf5uwmOprb4/1KWM/Ljlbq5IBgMyg3VlbvD7Fw0TPe9MnjJW6LP+fFZWcJAqpUfWsJn21q5kyNe8PLIx5SX59Z/PBGnWDhbTE8CLnRkxdEDEDx9CX0IvXX69Q1Xye/4aQJdjXcuxIx5kWXTsJZBgnZLJ03Pq4Zcj2F2UFB9tOVqpr1WatkCnIECUvjZ6bHeSupY+9w22nPqr6Fsfwp9Lumxo6wX6oXtu0s/lgobJcYezmMFgJ/NhZ4ZPnhE/BwM0vjUajDSeUmeKjxdXL//Xl6ok5+SmxCWGSYAGXzWBS5ihpVhOSY4obe9qg2RjNlk3HLj+zdDoSpzV2KV/4bu+/71nmfTeSEyU1nx2+gEYBAODuGeMYrk/GnGVEh62dnPvzmQIk3t6tfuLzbZ/85lYRj4MMuSFTax//fJtSS9HDc/HYjNx4r078At+dM/K2ni+q65AjcbOFeOLz7a+snb964ihkqK/Kmju2Xyh+fuUsdMDP6IQ7DU421aEhGo1GowU2Fk49G1dt6hAwQ9HowBQrdgM49SMECON4m3Oh0Wh9ImJxpke4K+WOFYgnhsefaes5hTvWUuVlwv3+9HyJU9W8l3bUFdlu350+3m6EAgZwV9r458/tst7dUuM54S5k9n4Lfavg2PtFp6y3Q7mCr+dsyAgOt4268mt9ie2SwIKY9Aie0HHcAQawKDb945Kz1run2mo8JtzvTBuHhhyNC42xJdw79INX4X6w/dTmhl/ZOEvCFneb1NWa+urq+uvKsmczHqLMX3cYZB9UfX1RVgAAbJxlJEwN2pYkQYf9NgRJvF/51fGOcwDAY3BDORKFSXVedvW87OrKmIV3Jay235jS3tZjn1f/yMZZz2U+PDbYoc/swbaT/6v+niAJBoZL2MEqk7q4u6K4u+J058U/ZD7GwumvqDTaSLByQjZlS+s2pfqjA2c/OoDGETiOibgcEY8TxOOmRISMiosYHRc5Oj7qZsvOj0+O/ep4Tx85e18eu5ifEjuQ5uAj1aHCyqe/3PHPDYuCeBRT3BCHC6v+8O1uwvllChAhFm6Y7uHEwNnvlk4/VlzdrkTPAQob2u55/8c3716aEiFFhiiVNLU/+9WvDV0KdABAxOP8YdBzx/7DYTJf3bD47vd+IAj0t2AhiD//tP9sRd3ji6b2o39ObYf8eEnNzovFpc0dAEAn3GlD4GRTLRqi0Wg0WmATsahzT3Wa8xG8LDQ6AGpT+1XZz2gUAADiBQ7lijQazVdGSSLdlLdbTY1ItCXcC2UUc1Ao3RLfz2ZoXXqNLZXMwLBZURQdaRDz7JY2Lehq0ZpNSA07Qsjqqbt/s+DoB0Wnrbcj+aJv596ZJKIok3R2ob13cYsZUe6uWFhlSSJsty91NNqNUIgXSjzuhpTb2z9BZUQbkvrPlobd9ybeujhqNhNjEiRxtOPsJ1Xfnuu6sr/1+KJIiq+XH1d922mUPZl2X37IGB6Dq7cYirsrglgO1yd+bvj1eMc5HoP7WOo9E0PG4BhuIYkzXZc+rvp2e9P+UE7IYqdHtk/u72g+8HXtVgGT/2LW4+kih/n4hcqyT6q+Y+KMh5I3zAmfYu2HU6Aoea9y0zVFyTd1W+9PWm+/PY1GG6biQ4Mpq329RBCkUqtXavUAyuLGtp2XSgAgThp866ScWyePDnaxmujIMz0zMVQk6FShPQkIgnzyi+1PLp525/SxHJZXmT2CJJ27t41IR4urV73x1cPzJy0fn83nUJ97tChUH+4/s+1CEVWyHQDghdVzvFwu1Z6Qy/n3Pcvu/+BnkwVtplfZ2rX+P9/eNmXMXTPyokNcdgGt61R8dezSlnOFFqJnQRp7GAavblgcKkL7NQ1rufGRv18+i3L1VADYfaVs37WKJXkZs7OTJ6bGuVkEQqnV13bIq9q6LlY1nqtoaO9GL3sMsj6/emgjjNygO9fq4QsGjdZXN8XHOI02pEI5qWgIAABKlHvyQta7qn/vKyOh/bXpZSNB0XMwmj9a6CLpT6PRBigpyENiFwBSg3rnslR0U6ym5UzM5iZ6Shm7ct0up58kknIZnr9ESDi8SJ6oVacCAAtJFMlb88Pc9aESsjgA8GX5BVu2PV4Y/M3cO2MF3i4XcbWryXY7JchzBZmY3ftWaVvv1JUsL0rsWXhvL3XzjYVbB8G00AnLoudbb+MYPjd8aoO2ZVfzwZ3NBykT7nXaptfHvBDPj7He5TI44yQ59huozJodzQcA4OGUOydLe6YmMDB8emi+mbC8X7nph/ods8Im8RgOCS823pPU2NK454f6HRK2+E/ZT8Xz0SY839b9QgK5IX7l/IjeZgi5wVn3JN76Tvnn+1tP3Ba/nM/wzacYjTZwZgvRJFOq9Ua13qDq+b9BrTOqDUa1ztAb1Bk0BqNSR9H84WhR9fy//0/I5Qi5bCGXfeMG9f+jJCLvc3xtSrVCo7Pum1pvVOkNar1BpbPeNaj1xp6gziBT69AfBgCA2X/9uPdf57CFPOv/2UIOR8hjCzm9+xYaJOhHjvvFVXNaFaoTJTXoQH81dCne3n1y07FLL66es3jsTbE2NZvJuHvmuP/8egIdADBbiP/8euLLYxdnZiaNjo+UigR8DstiIYwWi0pn6NYZ5Gpdp0rTqdK0KlQtctXfblu4MHdkzk/NjY+0kGRRQ2/vnY5uzT+2Hn5r14mJqXGj4yPjpGIRl4NhmFpvqOtQXKhquFDd6FxSbbN0XOa8HOpvWx6NSYj689p5f/5pv3Mq32i2fH3i8jcnL+fERY5PjkkMCwkR8jgspsFk7lJra9pkF6oaS5ra0R+z8/iiqf1YfzWQ38es7pqR1yzr/voExWQOALAQxK5LJbsulWAYJIRKpCJ+MJ8n5nNNFovGYNQaTGq9oUnWLddQv9ENlb4dgkCjMhoO1Fceb6wtl3e2aFRqk5EgSQGLLeXyEoMkWSHhU6Lj8iNiud79prEb1/rkBt2v1WX7aivqVcp2rZoEEHM4qcHSSZFx69NHRwrczU51VtjZtr+u8lRzXbNG1aXTsnBcyuNnSEJnxiYtS86QcAb7bLK2W17S1VEsay+RdRR3tTepu21DcoMu4dM37LZ18NDo/D9Nmo1GqfjkKRd0ti7f9rX19sU7Hwvj9VzB6zYafi4vPNJQXS7vlOl1bAYjjCeIFAgnR8XNik0aExblvHiXD6lNxgnffqAzmwAAAzh5229iRV59CSyRtS/eusl6O4jNuXjnYxwX31Q1JuPRxppzLY1FXW0NKmW30WAiLEIWO5jDS5dIx4RFLU/OTAgKRn/M0btXzrx56SQApEtCD9x6vzXowxd2ubxzR1XJscbaZo1KadCH8vixIvH8+JSVKVlRAhEAsBh9WLzLJ0/ZT8wEkfL5W2j0hkiB8NyGR9Godwb49pX82ZsWkrTtQF234o2LJ0631JsJIkMS+kjuxHnxPbWHJMDWiqIvii5VKWRcJjMvPPqR3IkTI2MdHo42DAWzY4NYkc6t1VWm9mNt/50f9fzAr3zJjXV7mv4qM9SiAwAAkCtZg4ZuGj/XXfjH9R1o1NHahPyXR69AozSadyjX+UTYTo0AQGmk+GrkzL7+uq9kht4LbxF8kd2IOxH8noQ7AHR5ymgLWZzd9SX/uHzQFnkxb7732XZwTJqvPfCV3YhnJsKiMRkFN6rsnYW7bVAztPJDxiCRGaH5u5oPtuk7OwxdYRz02sOEkFxbtp3SVXmRkTAJmPwpUrSLzoyw/M9rftSYtdeVpRNDxtoP8Rg8APi+fsfWxj0R3LA/Zz8Vzu29LGTVZZBXqusAYJpjS3cAsLaGN5PmClXtmGCfTdXq9zt2/pb/WhfgXZU46j/T0NG+mrfzk+ruLjQKwMYZZRueR6MD88ypHdtqiwBAwuFdXvtbdJjWR2XNHbe/8x0a7QuTxdKmVLc5tZig9OGDq71vEvLI/7ZWtlK8rrzXpdJ6uZbjmok5f12/AI16wmTg729c9cPpq//afoyyXLd/5Brd77/ZfaGq8eVb56FjI9FtU3N/OlPQJFOiAwAAIFfrtl8s3n6xGB24mYgFvL+snX/b298hUwF0RtOx4upjxdX2QY+yYyP+sq7Pr3Z7q/JH6YymV385gg4AAABJwvX61uv16Pc4jzbOyX94/iQ06oVAfh+zeX7lLBaT8fkR6n76ViQJtR3yWqeG74GJOpUT+AiS/LDg3AdXz6lN6OpwSoNeadBXK+WHG6rfv3ZWwGIvTcr4x7T5rvKbNtYz7G2VxS+fPtjtOAlUZza1atQnm+r+e+XMY2Mm/XbcVG9m4lQrZf88d/RgfZV90GABtclY163YX1f52vljj4yZ9NiYSX7NESOWbN2kNZvQqI/46Sm3atTWb5W/VBa/fPqg/RRd67ej2m752ZaGty+fPrPhkWiBt18C+0HIYi9JTN9aWQTWPGZl8VN5U9CNqGwuL7LdXpWaTflqPN/a+EXR5YP1lUanyUcKg15h0Nd2y/fXVb5x8cSq1Oy/TJnrzaWLGqXcTBBMHPfVC1trNr12/vjXJVfs25y1aFQtGtWF1sb/XD71+wkzNo4aH8zxnCkA/zzlwOfDt69WjVplNHTotLfu/Fam77mce7618Xxr4yuT527MGQ8Afzp14JuSq9Yhrdl0qL7qSEP1O7OXrUjpZ1cBWuDIFC8639lzJc9eqXKfidDNi/o9G+9nck1rll2R/VQg/8VCUn9eRPKyU0UUVZM0Gs0nvFnUVGC3jcq7hLv7ji7u2ef0bb1fPBKxetuyyw0eyo6K5K1bqgvsTzBevrAnJyQymu9y2rU9g8Vsa+DeP0bCLACXT81NLn7IRXLDkEgMP9J6o0Xf4ZxwTxa4m2oAAA26FgCI40U5L7vKwBgxvMhKdW2dpglJuPOZvO1N+7c27mHhzL+OekbKkdiPWtVqG603Hr74guNIL6Wp5yINjUYb7s5W1O+6VHK8pMaH2Xabn84U8Nis55bPRAdGHAGH/e79K+567wetgfrMnNbZrQkXC//38K0PfLRZpvbqGpIrqZHS9x9YyfWuS48bG6aNFXE5r/x8wGhGcx39gGPYb5dOv382o3L4HQABAABJREFUeq16hHlm6fQ4qfi1bUcN5gGd0QWIgb6GhoSFJB868Mshx6yuKxqTsVjW7ipdZU/IYr9/7ezrFyim6tiYCMs7V063adX/mrEIHXN0vKn2kYPbNU4JNXtqk/HNiycutjV+MHdFIJ/Ee8l/T7lNqx4NEe9ePfvmRXe/nayQML9m263WZ+RYE+4AsKWiyJuEu4Ukt1WV2O6uTx9tN9ijUaW87dcfKBfrcLatsrhM1vHzsg0itodFrk2EpV6l3FNb5pMXttZsum/vZjc9iPRm89/PHqlUdC1M8DxVzU9P2bdwDJsRkyjTa+V6ndygt05uGAifv31VKLr+cuaQLdtu849zR+bGJ59rabRl220Iknzx1P45cUmDfDBpPpcrWX1NvtVgoUhMVKmON2qvjA1Zlx40V8xCp/O7ojK1N2ovV6tO1WnOEqTLU0MWzpsX9Xs0SqPRfIf04sPRPnVhm6bpPw7/gue962H/Ke9xJ7+vvIJEOvSaB4/9tHnBPd5cgTD7IZtjj+GUeg4ctl4uNhycjQFGAmmwOBRb9IwyPJwA6Cx6AOA6doyxsXaS0ZjRjEaFquZ811UAMBHmnxp2PZp6N7IBAGjNOgDAAIvihaNjN3AZnn/dw86To6fVqeQyg1au18kM2hJ5u/2sERpt5DlaXP3unlPlLV51POu3Tccu5afEzup7h41hJy0q9K27l/3+m91qPcW7Os3aSyQ1UvrV4+uf+nJHdVvPqjN9lZ8S++97l/ejexKlZeOzEsIkL36/d4AV2RFi4d9uWzg1PQEdGInWTh6dmxD155/22zcIGjgc93AW6g/u8jgB64OrZ+3TVRMiYqZFJ8SJxEIW22Axd+l15fLOax0tJbIO6wZ3ZqKzLCmdaKrbX1dhvZ0TGjE3LjlOJOYz2Z06zZmWhgN1FZYb3xl+KCuYE5e0ODG994cdnWiqvX/fFtt5v4DFXpyYNjYsKoTLN1jMdd2Kg/WVRV09jZmONtQ8cXjn54tuHZzf/75b77P/8qM0GFZs7+ncIuZwd6y8yzaEELutWfbrU27Tqn8qv27LtkfwhfmRMRF8IY/Jkul1pbKOgs5WM0HYemj41eSo+HhRcL1KAQC13fJLbU3jI9zNyQWA4401nbqemU2ZIWGjQyMcxwEAYkXixYnpu2vKbHcnRMRkh4SF8gRcJlOm111tb9ldU2abnVAi63jz0sm/TvE8h+79q2dtVwgG+MJ+9tge+2x7tDBoeXJmanAIl8Hq1GnOtzUerq82WMzflxbUKD1/ovjvKfsQjmHfLFlnu2uwmMvknbZmR/3g87evNy6euNbROi06YVVqlokgPi44X9etAAALSX5ScME63WRRQtqixDSt2fThtXPWLlIqo2Fndekdnh6cFuC4jKBpYQ8fbn0THQAAAINFda7j83Mdn0vYcaHcNAk7TsgMY+E8Fs7FACfAYib0BkKjsyg1pg6FqUlmqNWaPZ+b4hhjQdQLEvZNccJHow0VncXz9V2dubfEwb6Q3E8kdu3O1Xb/tHsauy2DveiTAwBrkkbfkz5h49EfrenIUkX706e3fzxjrcdJeAIWm4UzTETPxcJ/TVpq36LdG9Ym8sORgUB/I3qLgQQSALiecuuUrC3U9RbqmRPWdDyfiR5euVG5IHLGeMnoN8s+Odx+OoIbtiZ2MbKNNVmPYdjbea/YL7I64q1KHGV/949nd/9Ydc0+QqONGDqj6S8/H9h9pedbHoLPYWVEhUlFfCGXw2Iy0GEAALBYCJPFojOa5Bpdq0LdIu92U6T15s7j0zISmYzAvSbqK9MzEzf/7s7nvv610KeJyJFBfmOVgoQwyQ9P3/HvXSd+OlvgpkW7Mw6L+Zt5Ex+cN9Hj+UafjI6P3PzsXf87eP7rE5f7MUGBw2LeNiX30YVThNwReCnalfSo0O+e2rD9QvEnh841dinR4T5KCA1ePTFnxYRsdMD/hl/C3UKSXxb31L8wMOzj+asWJKQ6btKjQ6fZU1O+t7ZiZUoWOkZlb205AIjYnLdmLVnkWJ9736hxhZ1t9+3b0nEjbfrBtXOu8pJdOu1vj+62pZ6XJ2f+c9oCJFv9u/HTfqks/sOJfdapr4cbqj8vvPRAznj7bfwkXhRsf9e+MBYHLDGIYu6nR/5+yscaa4431gJAWrD0pUmz58ShV7BVRsPumvKx4VFI3B8wgLXpo/596ZT17uaKIo8J980VhbbblOXtVo+OmXiutWFdWs7q1OzMEHRq8N1ZY/+QP/OhA79c7WixRr4tufb8hBkeJwpY//WBv7AP1FXakuMAcGfmmFemzLUvvt6YM75RpXziyK4r7c1nWxpscTf89JT9h8Ng2vfM7St/vH2dbq5fmJD6yYLV1vOCObFJczZ/pjebAeDb0msA8EDO+D9PnmvdeEJEzOKtX1pvn2yqoxPuI0B28C1t+tIixS50wI7c2CA3evUn6REDYy2IfjFZ1LvMHY1G8wdr52j3WrW9s1uC+5hZ7odQu/7vzRpvv/y0aHvXCvLYQT6SJ3pryvIpEYkA8MnMtXcc+tZIWADgUFPFa1cPv5jn+Yp7CIfXplNbb+eERHmzzOnI0KJvTxE6XAdt1LVab0Ry+3MQEvgxANCga7aQBFLabyEtTbpWAHDuAh/Lj3woeQMAPJF679vln/1QvyOSGzrVsVe7dQ1VgiRqNA3Jgnj7IRqNNgKodIZHP/3lWl3P1zcbJgNflT9qzcScUXERfU1o6oymyzXNOy4W7bla5px4r+2QHyup7vf6lsNLTIj42yc3HC6q+ubE5UvVTeiwWwmhwWFBHj6Ihy+D2WwwmTksJgDw2KyX1sy9beqYz49c2Het3GNHFyGXvXx89gNz8yPEflmshcNkPrF46p3T8344fW3bxaJmWe+pkRuxUvGycVm3Tc0NFY3Y35obOIatnjhqZX72kaKqnRdLTpbVGkx9aDLDwPHR8ZGT0uKmZySOTfR2trfPDb+Ee5tGZSsWnh6T6CpdBQBhPME92Xn3ZOehA64xcfzrxevyqPK2OaERb85acu/ezda71zpa27WacD7FS/+NSydse7gwIfXducspP09Wp2YbLOY/nNhnvfv+1bN3ZObyBtBbcwj5+ynvq60AgKnR8Z8uWE2ZbBWxObdluExk+9y6tJy3L5+2XmbfVV36F8e8M0JlNByo66loZuL4qlSX+dPc0MjzGx5l4i4vzofzBZ8uXD3jx/9ZG5uYCMv51kbnyw/OfPLC/u+VM7bbCxJS/zl9ofNvOVYk/mbJukVbv2xUefVV3H9POTD56e3rqbyptt9FtDBoYULqjqpS610ek/Xs+N7caFZIWIYktEzeCQBVSs+1zLRhYXbkMxhghYqd6ICviVnRi2NeCeM6XLej0Wj+QLm4IqKiu3eefpo41G7EL3Kl0QwMs86Kq1PLtWaTx47wMoO2/Ub6m4HhoyQUM/zsjQ2NsWbbAWBcaOzrk5f99vR2691PS8+lBElvSxl7Y1tqo0Oi2poqrLfLFO03T8L9TOel6aH59pETHecBIIIbFsYJsY97aawkm8fgasy6050XZ4RNtB860XFBZ9HzGNzc4Ez7uL2poeM7DbKv67a+V/mVlBOSIeo9cwvnhiYL46vV9dub9j+T/qDdD9FoAWpUXMT1N59Bo4Hhl+fuQUND7YXv9zpn25PCQ968e2l6VD8/qnhs1rSMhGkZCTMyk174fi86DHC8uMZjwn3Z+Kxl411+Ex+IzOiwwXyF4Dg2f3Tq/NGpDV2KKzXN1+paSps7lBpdt96g1hkJkuSwGHw2O0TICwsSxISIE8MlKRHSUbERYh+1SQlYar3RmnC3So2Uvrph8R9XzT5TXn+usqGqtauxS6nSG6x5+SAeJz40OD0qbFJa3JT0hIF3bPdIIuQ9unDyIwsmlza3n62oL2poq+uQt3WrtXqTyWLhspkCDjsqWBQfJsmJi5iQHJsRjdYjDkQgv4+5gWPYvJzUeTmpOqPpWl3LtdqW8tbOZpmyTanWGkw6k4mB4XwOi89mCbjsCLEwIUySGBaSHC7JiY8UcCgyh4PM768qn9P5s3f+vdl5lElJq9mxScliSfWNXhlXOpqRemEA6NJrt1YUW29zGMx/TFvgnJS0uS0j96OC89bmG1167Y6q0sHMGvvK4DxlKY//fl/avvtVtDBoanT8yaY6AOg2Gg7UVS1LzkA3umFXdZltCa/58alSLt9x3IGb1LNVGE9gW7UVACoVMm+yzwN/YZfJOws6e0qlGBj2p0mzXf2WhSz2s+OnPXN0Nzrggp+ecmDyx9uXkMVGmhSND4+xJdynRMUhfzXpNxLu1t4ytBEAA2x25DPh3PST7R8aCS067AssnJsXctt46QYGFhBvwjTaiFckb/OY0T7VWmu7PTrE5ae8r4hYnCxJRKGsFQAIkjzSXLk03kPm4mBjT+4bAEZJIrzpw25vRcKomm7ZO4U9HQVfvrg3QSSZHO6un9XUyMSDNxLuh5sqVyXmOI6PWOdl1zY37l4RvYCNs0ggj7Sf2dd6FACWR3ueFkCJz+Ctj1u6qXbL/6q/Z+LMSSFjcQwnSOJs1+XPan4AgDWxS6xtZ1xZEbOgzdC5v/X4v0o//L/Rf4jg9iba7k1c+7eit093XmJgjNUxi+P4UQCgMmva9J2XZAUMDF8bt7T3gWg02vCx7ULRseJqJGhdytIntcPLxmcdL6nZc7V31rXVmfI6JHIziJMGx0mDh6RRRmCiXMoliMddNCZ90RjqSfyDD8MgKyY8K+ZmKQjwFR6bNTktfnLaMJsY5yHVFYBihEFsRk+rr1PNdZfa+jaPxr27sjzUk44L75072aHtqVS196tddnVhQmoE393nCgZgn9k82VzbOzZ8DM5T3jhqfAjX3Wn9ILPvDGPfMcaZYz8ZH3zxs8+uKg29HYHcGPgL+0hD75nT+IgY962HFiWkuSn574d+POXA5I+3r5RgtHItWhhkuz1Kin6Wh9y45KN1u74xbdjJDl56Z/KXo4KXMTBf/vWJWBGTQu+/N+XHiaH30tl2Gm3QGCzmg03laNROnUp+ubPRdndW9GAsY7MuubcR2dcVl+xGKBAk+U1l7zarkvpzCvT06BkrEkZZb5sJ4rETW2tV7qZnLYnLYuM9n7N7Gkq8mSgwAoSwg+9OXPNj/c77zv/uicsv33/+2Q8rv7aQxGRp3sLImejWXlsWPf+WqLk6i/7fZf+77/yzT1x++b7zz/6n/DO9xbAwcubKmAXoDzh5IOm28ZLRKpP61ZL37FdYzQ5KeyptI4fBOdFx/ndX/3b7mSc2nHly4/nnXih4bXPj7mZ9z5pPAaSP7S9otJsTScKnhy+gUYBnl830SbbdajlVlXpbt9pNk3cajUYbEsMv4c5lMhcn9mRszQRx++4f/+/8sXaqFGFfJQQFJ4vdpREBQMrrLU/uNhrsRnqct1tScmZsYu+AC9l26bCLbc12I8PG4DzlpUkuS8iHxOLEtCB2zyJUJ5pqbX1CEPUqxcUbSdUwnmC2L0qz7Zvj6y0e+pGBj17Y12+UtwPAjJjE3gEqAhbbOc87EH19ygHLH29foU495QWs3orISIHIbgQAgHMj428hSdvKcrSRQcAMnRP5u/tSf5oW/kgkL7vfi9FhgIVz08dJN9ya8M69Kd/lh97NZaAvJBqN5m//LjimdbE2KQnwzysHbcmFnJDIwemdsi55TAin54ThfHv9t5WXHccdfFZ23loODwBiNnd98liHYa+9PnnZuNBY622FUffAsZ+URr3jJr0ieEJb2xkLST56cqvcu+v0ttqR4SgzKGVF9IIXsh7PECV3m9QmwpwsiH8w+fZn0h/s9weB1f1J614e9XR+yBg2zuo0yNk4Oz9kzEvZTzyUvMGbR8Yx/Jn0B5KF8c26tjfKPjaTvQd5auj4d8a+siJmQQI/hoUzMQwL40hzxOn3JN56R/xKu8cICIxhl3AfdjtMGxGu1jXXdfTMmbYJDxIuGevLL/Kj4ii6kxEEqdS4/Gig0Wi0IeHLOrhB88LE2aea6rv0WgAwWiwfFZz/tPDiwoS0dek5M2MSPXaocMV5zUZnbLsHt1DNWLlyY3VHAEgRo5WnzuwziZSVxYFvEJ6ymMNN8pQyHmQcBnNlStbXJVcBwEwQv1SWPDR6AroRwJaKItvtW9NG+eR8va+LzPjkhV0u760RS3UqqXaWEhxyud3bqyke9fUpBzKfv30FO65ODAD2i5tJnOaFMOz+CboSZETiMYLzQtbnhazXW1Rt+pJ2fbnC2NBtbNFZFHqL0kQYCNIEADjGxDEmC+dxcBGXESRgSoPYkWJWtJSTHMpJYeI9FxRpNNpQqVcr7j36wztTV0Xze+ctAYDBYv775QO2xikA8OSo6XbjfsRlMP+ev/jxk1utd1+5uE9rNm3MyEcW1TQRlo+Kz7x9/bgt8lLefPftcdxg44xPZq5dvf/LBrUCAGpUssdPbt0053bkH7X57egZh5srmzRKAKhQdizb+9mLefMWx2VQbt+p15xpq91dX9pt0n879050OOCJWMKfp35ovT1OkjNO4nkawaujn0dDbuWKM3PFLnu128wOnzI7fAoaBeAwOP/KfQGNAgCAlCO5O2HN3Qlr0IHAY5s2cbKlZmtN4dWu5jatCsOwCJ5oYnjc6qScieFxjj/hd5c6Gn+pKTzbVt+mUxMkEc4T5YfHrkkaPTkiHux22KNiedvm6usXOxob1Ypuo8FCUnwLsKm5k/pXSaNZXahsQEMAk9PjfftNLpiPfruxUhsMEiH1EI1Gow2JYZlwjxaItiy/48kjO693tlkjZoLYXVO2u6YshMtbmZJ1W8borJA+V/q474XiJfsM8pqd39mNeGYiLBqTMUDalHtvEJ6y+77nQ2Vd+mhrwh0AtlQUUSbcbd3twbELjXtKg/5MS32prLNS0dWp0yqNepXRYLCYDRaLwWI29LEPuE9e2EpDb8mAc9G0M1vfEi/59ikHMp+/fdl61FBief2NizbycBmiBMHEBMFEdIBGowW8qRGJp9tqL3U0ztv10byYtAlhsaFcgcFiqVR27KwrbtZ227ZcEpe5IDbd7kf9a0lc5saMiZ+XnQcAgiT/78qhbyouLYhJTxOHilicbpOhXNGxv7HMfg/XJueuTc7tfYi+C+HwP5u1/tb9m1QmAwCcbqv988V9/8xfgm4HAAASDv+TmevWHfjKOj+gRdv95KlfJBxeXmhMnCBYxOIYCYvGZGzSKKtUXdYkPgCMD+spoqfRnPGYrG6j/o/n9uyp71kjx6ra1FXd3fVD5dWlCVmvT76lr6sU9I/ObHrx3J5ttb01PQBQq5LVqmQ/VxUsT8j+56TFYjZajeFMazb+6fy+X2rcNcb0q8YW+bZ9164WNTa3KTQ6I4fNDBJy42NCcjKiN942Fd3a0ffbL3zx05mQYMFrf1yVGCdFh2lDpKqNouVXUriPy+ZcXRbi2s3xpdFotEAwLBPuAJAkluxYeffmisIPr52zLfYIADK97ouiy18UXZ4YGfvomElz+9LBw2Pa1yODxTzAGakGi0UwrD4pBucp27fICBxjwiIzbqw/WSJrL5G1I3nS862N9SqF9fa48GjnXtvOjjfVfnTt/LnWBsoVP/pn4C9sAFDZ9ZnheVGk5v2vzB9POcD59u3LfUrdJ5MqaDQajTaY+EzWl7Nv/8O5Xb/UFhos5t31JbvrS9CNAABgYnj8G5OXo1E/+9O4+Twm6/2iU9a7DWqFNf9O6e608X8evxCN9l1qUOgH09fcd/RHa6rl+8orKUHSjRnUFxSzgsO3Lrz34ROb61Q9H7Jyg+5wU6XjVjSat1g44+HjW8621dsiTBy3P3H9ta6kTavaNPf2fs/k8JLeYr7/yE/n2nv3BBx3ZmddcZtONS0y0X4DZ2aCePDo5jNtdda7Ui5/Uni8lMvvNhoudjRaJ4hYTQqPHy2NjBdKEkW+TJvuO1b82gf7TKbe3oZanVGrM7Z2dOv0Ro8J9y9+OmPdfseBgqc2zkGHb2IkCccKqk5er+nq1i6dnDV/XBoAGE3mzm6tNIjPYfk3+aPUUrTwclWQ3m+NXb2vTxscw8R8z9eZaDQabTD59z3Xr3AMW58+em1azuGG6h/KCo40VNuf95xvbTzf2jg9JuH1GYtj7JYQdIM54MzUzZMxtLkJn7K9demj/3HuiPX25vKilyc7JNzt+8ncluGhvF1jMj5zbPe+2t4Z4jY4honYHBGbw2UweUxmt9FQ161AN3Jt4C9sALDvPOJNgxf3WWAr/z3lwOfzty8ajUajjRhjpDFMHH998vI0cdg7hScoKxtwDLszddwfxs71d4KP0rO5s/KkMa9ePeRmVdJ4oeS5MbOWxWejA/01LTLprxMW/enCHuvdV68cShKFzIlOddyqR7o4bMeijR8Vn/m64pLaRLE4jb3kIOm6pN71YGk0xNfll7VmI5/J/k32pFviM5ODQhgY3qnX7G8o/0/BiU69BgAudjS+ee3Yn8fPR3/Yp/597bgt2x7C4f9uzMxFcemhXIGZICqUnb/UFG4qu3i+vaGgq7fhJ6Uvyy7asu0PZk38/djZti40BEl+WXbx75cOWu8mBYW8NG6e9bavNLUqXnt/n8lsAQAulzUuJz40RGAyWZTdusq6jsnjvKo4sWIyKVpF3bQIgvz9J7uOXO25uJibHGW9odIZV7z8+eMrpt2/OL93az8wmilWh9IaTWhoYM5RNa6JkgSxmZ6/ftJoNNpgGsYJdyscw+bHp8yPT+nUaX6pLNlcUVgq67CNnmyqW77965+XbvCmuHjgBCw2C2fY1iF8Y+Zi+37l3hCxfVCMPJhuwqdsb01a9msXjllTpduqSl6YOMvWg9tgMf9aU2a9zWOyliW7a39JkOTG/VvPtvSePSSLQ1akZE6KjEsWh0QIhPYZ7m9Krr506oBdYDCI2GyduedsSWuiXsPNnvbGxq4E/lMeBAH19kWj0Wi0AJEfFgsADAx7JHvKisRR22sLDzVVNGqUMoM2iMWN5gfNiEpelTgqTRyG/uQgmhuTOis6+Uhz1aGmiiudTR16jcqkF7N5oVzBuNCYWVEpc6NT+7EwiXt3pObVqGSflZ4DAIIknzq9bfP8ezJcLBgrYnF+P2b2w1mTDzVXnm6tuS5rlRm0CqOOgeECJjuSL0oWScdIo6ZFJmW6eAQazUprNgpY7B8X3DVK0rtaYyhXcEda3pyYlDX7vmrVqgBgU9nFu9LykoP81eGkTiX/vLRnNkkYT7B10b2xArH1LhPHsyThWZK5c2JS7j38o57qKp29L8ouWG9MDI9D8uk4hm3MzC+Wt22pvg4Av9QUvjRurpDly5Vdtu+/Zs22x0YFf/DPO0KCHRpRerPA0Mbbpn7+4+mocPGaJXno2E3s20OXj1ytvGVi5qL8zKff32aLS4P449Nij1+v9nfCXcCh+F5PWZDebwRJ/nj6GhoFyI2PREM0Go021IZ9wt0mlCd4aPSEh0ZPuNDa+N7Vs0cba6zxLp328cM7d6++x5uy3IEL4fLatGrr7dGhEX3qxTxM3YRP2UbK5c+LS9lXVwEAnTrNiabaOTfagBysr7K1YbklKV3otq/LD2UFttQzBvDnyXPvzxnv6vXqxVmo74nZ3PYbzfrbdT033LDv+U4p8J/yYAqQty8ajUajDaHnx8x5fswcJBjND3o0e+qj2R4aLLgxOiSqesOLaNQXGBg+PyZtfkwaOtAXs6KS+7R7L+XNeymvD/W2QWzu6sSc1YmeVxOl9MSoaU+MmoZGXXs2d9azubPQKG34eyR7in223SaKH/TKhAWPHt8KAARJ/lB57cVxc9GNfOSHyquWG9noF8fNs2Xb7U2JSLgvY8L/Ss6hA3ZqVbJmTc8qC+tSqNdXWJeSa024Gyzmq53N06OS0C0GoKCkyXrjtuUTkGw7AHhzznv7igm3r6BYPesmt/NM0diU6H9spFjfIikq5NBlilnFvhUnDUZDAIcLK/+4aravvst8fuRCZSvFzKoZWb58idJoNJpP+LjwJBDkR8ZuWrz2v3OW2cpqSmTtZ1ocWt35T25Y78XVUlmn3ciIdRM+ZXvr7XrF/FJZbLu9q7qnvB28WC71p/LeBYvuyhq70XXqGbzIZftDqqS3WqdCTnGWg6hWUqyZYy/wn/KQGNq3L5oPaY2mj85eWPfND+P/+2HGm+/kvfPBgk+//O3O3Y3Knq+4NBqNRqPRhotbk11es1kYmx7GE1hv728sdxz0pf2NPQlTCYe3PMFls6bbUz30R2q6kW0HgNSgULuRXil2dfr22/tER1dPqVZq4lBO0xl56tsV49Op138OEfGVGr9/nxqdQFFm3qZUf3/qKhrtl83nrv93T8/yIfZEPM6C3AFd+qXRaFbfvfrLQvYdzv+VnKMXwumPEZhwt1qZknVHZu/ZxpV2D53sfGVadILt9qH6KruRAGV/sZnsVyXxsHvKvjU7Nqn3JLuuUmMyAoDObDrSUG0NxouCJ0XF2banVC7vvVCxOtXlCbSV/caDJje09/zpdLOH/K+FJAs729Coo8B/ykNoqN6+aL6iMhjWfP39m8dPXmluUer1FoJQGQw1MvnesgoJr29Nt2g0Go1Gow2tKH5QFN/lmjo4hk2LSLTerlfJu41+SWuqTYaaG0smTI5IYLiuF04OkoZye76bULJfFoLFoG57bd8Pykz6eMku/Y2m3lzOECxBMYKxWUy9kbqbULtcHSz08eKlzqZlJHCYFB0U/rPr5KHCAWXrZGrtn37Y99efD1J2HLpzeh7Xz+vB0mg0Wj+M5DemUdLe3iaU6035wy1J6a+eP2q0WABgd01ZtXJasjig+y+L7FryqU1GM0H0teHmsHvKvsXE8TVpoz4uOA8AOrPpcEP18uTMIw3Vto7n69JzXJ4RAwAAQZL2XdFDuOjMSntKg/7wjVT+YJodm/SvC8ett8+1NjSpu90s5nmiqVbhtiZ9WDzloTUkb180X/nw7PnKri4AyI+NuWvcmAihUG82t6nV3XqDYDivWkGj0Wg02k0oKUiChhyliHvqxEmAWpU8V9qzWKUP1XTLbJnGtBv/nCvJQSHWpVwp2feiadF0U7bKsa9qD+cJ7UYGSq83EQRV0pQ2YKOTIk8V1vz21hkMx6/zTZ3KfRfLZuYm2wf9IYjHXTY+c8u53nnMVgaz+ZlNO9dOzv3NvImRwSJk1A2ShMKG1h0Xi7ddKNKbqL8QxYSIH5jr3970tJuEWqFdE/6g7e7r+14aO2eU3XiPYz+f+eed79ru/tz8sTiU4lVddrHqyI9nSs9XNle1apQ6kiR5Qq40ShKdEpE5MTVv7qiMCSnozwSA1U8tmXHrJGWnqrtLpejo/vj5b3Qqd4kdmnvDL+FusJg5DK92u6Cj1XY7WuAyOehbEXzh7Rm5XxVfAQALST58cPtPy26XcDxfT/b+efkWE8dDuDyZXgcAZoK40NY4JSoe3citYfeUfW59eo414Q4Au2vKlydn7q3tmfKJY9jaNIq3aXs4hok5XFuGurZbniSmPq0nAV45c8jWGn4wZUvDs6XhxV3tAGAmiL+fO/LRvJXoRgAAYCaINy6eQKOOhsVT9gfvX/ND8vZF85W9ZZUAEMzlfrZ2NZ9NV2/RaDQajTaM2dcnUbL/4qMy+eWstdvuYaUcd6UqACBmu5tOlxQUEsLhywxaANjbUDY/lqIXx76Gnt6YOIZNCKPuUuKlqrrOn3Ze7JCp27tUnV1qtbb3idz/7Fd2GwIAxMeEfPfuRiQIAAdPlv7l37vQKMDLT9+yaJaHmbIAsOnns//7/iQA7Pj80ZBgAQBU1XVu33/tcmF9R5eKIEipRJCSEDYpL2nZvNE4Tl0rZTSZ9x4pPnmhsrKuQ67UcljM8FDR+Nz45fNzk+M9XAIZHA8smfSbf//86NtbNswdBwByte5qVfOl8oZvDl42mS33LxqMrPRji6bsu1au1vdWVlmRJPx8puCX84Xjk2NnZCZmRIclhElCRXz7ORYmi0WlM7R3a1rk3dVtsuLGtks1TV0qrd3DoDgs5n/uXUaXt9P8oexiNWXCvfSCh6YOshbFfx7737lfryBxlUytkqlrixpO77gIAMm5CR9eeBVzPV1pSPCE3LiM6LiMnrub/vIznXAfiOH33vTWpVPXOlrWpuXMjUuW8qjPNkiAH0oLfigrsN7FMWx23OAto/HMuGmH6qua1N0AUC7vvGXrppcmzVmcmEZZOd6p05xqrv+1pqzbYPhh6W3o8KCYGBm3t7an4eDfzh754ZbbxBx3Z2nOht1T9q3UYGleePSV9mYAON5YY61ztw5Ni06Idl0JbjMuPNr2I+9ePTstOoHtNMGz22j406kD26tKkPigeTpvysMHt1tv76kp//PpQ3+aNBvZT4VB//zxvR77ycAweco+F/hvX7SBMxNEvUIBAONjY+hsO41Go9Fow53Hagmu3QbaG5NcfcvatdKKS9W1wx6f6W46HQtn3Jme9+71UwCwtfr65Ij4tckOS6eebKn5uOis9fbKxFHe1FG5Ud8s+/UwWvI8VDpl6pBgwec/nv7ypzOEXXeSxhZFY4uivLp9xQLqVWQvXa//v/f2tnb0Fv6bTBZ1vaG6vnPLr1fWLRv3+L2zXWXqB824tJi/37/4n98efPajHQDwzcFL3xy8BAACLvtfv1maGjMYVwXCg4R/Xb/wua93UfZ+MVuIcxX15yrqbREGjnNZTBJIk5kwWSx223rGZTHf3bgyK6Z3WjCN5kPlF6kT62UX3U2+V7R3PzP7Ly017da7GIaFxUqFEoHZaFZ0KLtvrGABABkTkgMt207zOQ+f1gGIIMmzLQ1nWxowgCxpeI40Ik0iDeHyhCy2iSBkem2lQnassaauW2H7kTsyx0QJKGZ5+EkIl/fZwtW37vzeemLUrFE9fniHhMMbFxEdJxKL2ByjxaIxGRvVyiqFrEGltP7UhIgYh0dxzUwQapNRrtfZInqLuUOnEbE4Hk+/KG3IzLUl3Iu72udv+XxtWk5mSBiXwdRbzAqDrkOnbdWoliVlukr8+fspB7716TnWhLvaZPy86JKtItvjcqlWGzLH2LLPl9qalm776t7svNGhkSI2W2My1XUrzrTUb6ssVpuMALA+ffRP5dcdfn5QLE5MX5SQtq+up3h/U/Hlg/WVy5MzU4OlPCZLptde62jdV1dhfe7LkzN3Vpc6/LyjQXjKPv9LIQE0JmO7tneKroUg27RqIYstYLn7YmMT+G9ftIFTG3u+EocKqK+p0Gg0Go1GG0Y8NvezT7LzmX651s6ze1i9p/2xeOq6/mj2lCNNVYWyVhLg92d+/br88tSIhBAuX2UyXOpoPNNaZ02WxguDXxo3D/nZvkpLDH9q4xz7yCffndTrTQCwYWV+mNShX02QkLrqa+ak1B/ef0DRrVN26xQq3ddbzja2KNCNvNAp15z88fTnP54GAC6XlRQr5XJZHV3q1nal2UJMGU/ddOXE+co/v7nTZLYAAJ/HHpMVGyYV6g2m4oqWxhYFQZI/7rzUJdf85XfL0J8cdEsmZk7JTth/sby4rk2l0wu4nOyEiCUTM8UC6gPrDwtz0/60Zt4/tx62v6ThioUgNAa0HN4bsVLxW3cvzY6laIhEow1Qcm5CdUEdZWKdsBCVV2oAICknrqawAR0G+OQP31qz7Twhd+M/bp+3YZpQ0ruohqK9+/rJkvN7r5385fwSxzdG2ojUn6xTgCABirvarT0u3JgVm/SnSbPRqJ9lhYT/suLO3xzYVtstt0bkBl2/FxR95ujumm65ymiw/udcN3G6uX7Ctx8AABPHRSyOkM0WsTkiFvuB0RMWJVBMEkTMjk1akZK5o6onPdqu1Xxw7ZzjJgAAY8PctSP07VMedlakZP3t7BFr3/ZPCi5Yg0FszqLEVIftXFiYkLosOWNXdc/kzXJ550unDjhu0uO+UeP+OmXeyea6ZnVvhcWg+c/sW+7Zu/liW5P1bpO6+6MbvXTsPTZm0j3Zee4T7v54yj7/S3n36tmjDdXWR+s2GjQmI3La2KHTTPzuQwBgYJiAxRayOUFsjpDFXpyY9tBod9M2A/ntizZA2htLgeF0zQKNRqPRaMOf0tM6qHJDb9eLIE/9Z/oniN37sEq3SyUBgMLTDvOYrM9mr3v2zK6TLTUAUNDVUtDVgmwzKTz+7WkrpG5XWvJGbFTw+mXj7SObfj5rTbgvnJmVluRVeTKbxYyNksRGSax39xwp6l/CfffhwmNny8NChI/fN3v2lHQmo2c2tkZrPHmhMilO6rg5AEBLu/If/91tzbavWjTm0btnCfi9dTb7jhX/64P9RpP54MnSvJy4lQvH9P7kEAkW8tbPHuLdWD8lN1oS9NIP+2Rqdw1h+ofJwO+YNvbRhVOEXK8Knmi0vkrMjq0uqGtv6FS0dweHO7QrqCtp0msMAJCal+SccNep9Mc290wP+tN3T+UvHuswDBAcHjRjzaQZayY99e79LHrV6JvA8Eu4jwuPCuUJOnUu14GxEbE5j4+Z9NDofMrGJv6WIQndteruD6+d31R82Vql60ayOMRNKbR1jUo0SsVMEHKDTm7oKeldlJjuOO7SWzNvEbE435ZeQwf6wodPedix5lh/qSwGAFtr8lWp2R6noNq8PXtpCJdvbYVPScBi/zF/5j3ZeQAwLjzKY/bZHwQs9leL1756/th3pdcoaxb4TNafJ8/dkJkLAEIW2/3LwOdP2ed/KUVdbbarC+5ZSLLbaOg2GpoBACDRxeJaw+Xti9ZXn5y7eLK2rk2tblOpbRXu318t+P5qT2ugns1uXTk3haJ4qkur/erS1aPVNQ0Kpc5sDuHxxkRFrs7Jnp+W4pyzf3rH7l9Ly+4eN/aV+XPa1ZrPL146UlXT3K0iSTJSJJyaEL8xf3yiJBj9MTtVXbKfCgovNDY2Kru79QYhhy3l85NCJNMTEuanpUSKKNZG69Me0mg0Go02klR3y9CQowplp/UGBpAUFOI46BuJot6Hrezu+edcqVf11D+5Ec4T/nPi4tsOfNOqVbFwBpvB0JlNfCY7ki/MC41ZkZA9PYp6ZvOwdvRMeViI8NM37pba1ZwCgIDPdtUL/uNvT2i0RgCYMzXjuYcXIKOLZmUrVbr/fn4EAL746cwtc3NYTLRJ5s1pembijufv/WD/mS1nCw1mD3MyvCTksldMyL535vjoEM8tW2m0fovLiLbeKLtYNemWPPuhsgtVAIDhWEIWRbeGxooWk8EEACFRwc7Zdnt0tv0m4W02MHDckpSxICH1bEvDuZaGEllHg0rZodPozGaDxcxmMAQsdqwwKEMSNiMmcX5Cip/m9HlJxOY8nz/jkTETD9ZXnmqqv97Z2qXXKQw6BoYLWewIgTBFHDImLGp6TEJWSBj6w4OLzWC8On3hvaPG/Vx+/WJbU323UmnUM3FczOZKuLy0YGm2NHxmbCL6Y06G0VP2udsyRlsT7jbr0nPs77rHwhl/nzr/rqyxP5YVnG9trFcp1UYDA8elXH5asHR6TMLatBxb1+9x4TG22vBBJmCx/zltwT3Zedsqi4831baoVd1Gg5THixWKFyWmrU7NDuP1nL+mBkuvdqDFMvaGy1P2oWH09kXrkzP19afrevtR9sm+8srnd+/T3EjTA0CbWr2/onJ/ReWMpIR3ViwN4lDUylV1ya61tD6w+ReFrreKrVauqJUrfikq/nD1iumJCXab9zBZLP84fOy7K9fsL5cpdHqFTl/VJTtYURUjDnJOuPdvD2k0Go1GGxnadepalcw+5W3PQpKnW+ust5OCpEL/VLiL2dwEkaROJQeA0611BEm6mkjXqdc0qBVo1EmJvP32g992G/UJQsmns9eliimKu0ekpx6Yi2Tb3ZApNEdOl1tvP3LXDMfBHisW5Fqb5HTK1BcL6qaMoyitGDQkCccKqk5er+nq1i6dnDV/XBoAGE3mzm6tNIjPGdzFRcV87gur5vxm3qTtF4v3Xi0rbW6nqtfyLCpYNDEtfnZ28oysRE6/+oLSaH0SHB4kDhUpO1UUCfeLVQCQmB2LUa3ZYLixKLRQ7O2bjJ9cPnj9wDcnSs9XyloVOrXLOU9vHPjTGBfXGvutpab99PaLBcdLagrrFR3dJoOZJ+KGx4Wmj0+ac9vUvLmeU2T1pU0Hvj5+/URpU2WrpluHYZhAzItMDE/Ojc+bM2rikjyei+ZjVgP8cd8alm9YLJwxIyZxRkwiOtB3T+ZNeTJvChp17bkJM56bQP1Z60oQm7MmddSa1FHogNdO3/4wGvKPDEnonyb5oJPUwJ8yAOSGRtY9+Hs0GsCmRMUPfIczJKF/njwXjTp5IGf8AzkOczMR/n5hZ0hC/5A/8w/5M9EBO9tX3oWGqPjqKYMf/lI+mrcSDQ2Yr96+qh94Dg3dMDkqzs1L8Y/5M//o9hdH64e3l99ivLHQk1KvX/zZVwCwelT287On228m5qKf7keqap7cvosgyXCh8J5xY1KkUj6b1aBQbr5edLW55URN3ePbdn65/laG05fqorb2R3/Z2a03rB6VPS81OYTPa1R2by0sPlvfoDOZf7drz7GHH+Q5fq0iAZ7Y/uuhyioAYDEYC9JSxsdEh/D5Sp2+Xqk8UVOrMhhmJifa/wgMYA9pNBqNRhsxfqy89oc86m9Je+pLZTdayiyMpWhR6CsLYtM+LTkPAJ16zb6GsiXxmegWAACwufq6x6wmCfDsmZ3dRj0AfDBz9c2TbRcJubMm9+F3dOl6vcVCAEBKQmhMZDA6DAAAXA4rLTH8emkTAFwtahzChDtBkL//ZNeRq5XWu7nJPf1gVTrjipc/f3zFtPsX5/duPVikIv7GORM2zpnQpdJerWsuaWyv7ZA3y7u71Npurd5gspgJC4ZhLJzBZjFEXE4QjyMV8aMkQbEh4pRIaVZMeIQYrQWh0fxKp9ZnTkw9t/uKcxt3a4V71uQ0ow7tXgsAITfaXjVXt2m7dfygAa043T96jeG1e947vfMSOuAEwzCGT2fktNV1/OfRTy8fRNfeU8s1armmuqBu7xdHJy/9f/buOrqNK2sA+B0xW5aZGZM47DAzNk2aMjN95S1tabvtbrlbSpm54TZMDaMTOzHFzGzLYtbM94ccRX4eS7LAMbzf6emR7xvZit94NLpz575x//zlES6fvh8UaSW/fO6XTR/upMhu72OKVrOiVXXxdPmOrw7wRbwfSj8ICKZZ5c7Lp/vDoEy4Y5i//d+ubdvKSgCg/KHHmYOzp0fyx+9ZKWpBYvIXy3yfNUb058/CsAHIMZNu7wLEY7NChM6qG3Qm89M7dpMUNSo87Jcbrr2cH4+D60ePenrH7k0FRSdq6v4qurhqREa3ZwIoDQYCYN3VKxekJNki2TGwemTmQ1v+2l1aLtfp95aVr8zs9lH8l9zztmx7UpDsyzVXxUqljqMwZ6bWZELy5t68QgzDMAwbMr65eGZuVPLE0Bgk3qRTvXZ2n+0xkyCuTx7Tbdinrksa83XxaVsW4dWz+8YER0YI0MYapcr2TwqOI8GeGrXK4s5WAGASjDTpULvt2Im0xLDe7gygVVTWdbduYqyz31LwpZL5lna3mlv6yc/7z/2dV740O33RxPRHP9lijwdJBONTog/nV16RhLtdkFgwb2TyvJFurXCGYU7cMmPcLTPGoVHfMelN6ROTT+3ILc2p6BY3mKsL6wAgY1JKY0Wz45BNZFJYcJSsvUFuMVm+/9f6B969Fd3C/9647RNbtp0v5l39f0uSRsdxuOz60qat63Y3V7cBAMEgnv7mgeQx8RGJYRyeL2+pl4ZIbCvKAgBXwE0aHReZGMbhs+VNivOHi/RqAwCc3H7u40e+ffJL+kLJ717+Y+P/dtgeh8eHJI+JlwSJzSZLS01bxfkarVIHABmTkntLl3v5dH/ACXcMwzAMuwI2FBR26vUA8J/FC5BqdAB4ZvaMTQVFALAhv5A2nb0iM92ebbe7d9LE3aXlAJDf3OKYcKcAvjiVAwBsJvOL1T2y7QAAIOSgtQZevkIMwzAMGwK4TJbRarnlwG+3p01YlTAiJSCYSTDkRt2eutJ3zx9uN2htm92Znh0n7ipv9IfkgKBbUsf/UHoWAJp16pU7v3ti9MyF0alBPIGVomrU8p21JZ8XndSYjYFcvn2lIlpMoqs4wEqR/zy1686M7BhhAH8YNDOUBvSt4FTe2XXvwt4jxXuPFHcfpKFW99q6oR/8daJwTFLka3cuQQcAEiJk+8+VoVEMw+hYLNaRU9MAQNmubqlpC4vrut5WnldtMVsBIHNySu3FBsen2K15dOnnT/8EAJs/2qVsU9/9xg3BkfTtyPzhwuHi43/mAABPyP387Jvh8V2vfNLSscvvm//YzJcrztdQJNVS3Tbvxm73YfsEV8Bd/cjSivM1i26bNXbuCMc+9Vql7q07Pj2x7SwA7Pnx8G2vrA2OQn8terVh80e7AIDBZDz3w0Oz1nZr2EBayYtnKg6tPzF+fpZj3M7Lp/sJ+vkZwzAMw7B+cKC8EgBChMKMUJqyqSCBIEQobNNqzzfRr4WwIoPmXvKkoK5zF7m+2yftsvaOBpUKABakJMU5XVLVkZevEMMwDMOGgE9mrPq08OTZtvrPi05+XnQSAFgMhoUkHbeZGBrzxGj6ln21GsXuuhK12ag2GdVmo+1BiaLNNmomrWv3/Chmc8UcrojNFbO5IjY3WihZlUDT6PaZsbPz5c257Q0A0G7QPn9q5/OndrIYDCt5+f75+dEpi2PSnjqxzeF5qHCBeGJozJnWOgD4veL87xXnkQ0ELE4ITzhCFrY8LnNRTGqfqsIHsr6uaKq51JHZTche0c9qWxW3LKDvwCkTC5TaK3kxAMMGEZKk0iYmEQRBUVRJTqU94W7rJyMKFEanRiBNS+xWP7Ik9++C0zvzAODAb8eObD4957opS+6cmzklhfD/gfToljO2ByvuX2DPtttw+ZxbX77m5dXv2ja78fmrHUd95cbnVqEhAAAQBgie+/Hhm5P/T9WhoUgq72Dh/JtmINvUljQY9SYASB4Tj6TLAYDBZGROTsnsvSeYl0/3E5xwxzAMw7AroKC5BQDatNrkt95HxxzozRa92dKzwJw2CS66VKVusXb7yFfY0mJ7MCkm2jHunJevEMMwDMMGOyZBTAmLmxgS8+ypnTtrL9qCSF51eVzGm5OX8Zj074OF8ub/nDuARi+hAHLa6pFgoiSINuEuYHF+nHv9P05u21lbYg86vphrk0a/MmFBuarDHunNuhlX33NoQ157IzoAAAA6i6lGY6rRdO6ovTguOOqLWdcE8QToRsMA/1K/hfSk8MzUiO6DNOJ61Gz2Jw6bZTBZ0CgAALR2aqSivlX3Y9jwRVHCAEFMWmTtxYaSnIqZaybZwrYVUzOyk52kzgkG8cqGJ7945uetn+ymKMpsNO/54fCeHw6Hx4csvHXWottnhUT7cc2M+tKuQ3pSVlz3EQCAxEvB+kvNsvoTT8iduGjM/l+OAkBbnRwdBmBd+izZ3iA3Gcx9bXfj5dP9hP60AMMwDMMw/7FSlNLgbqmRmbTye7xfS/noEqxOdOq6Ct5DRe4uPOX9KxwISIoqVjbmddZWa9qrte3NeoXWYtJZTEbSImByhCyOkM2LFgQmiEISRSHjZPGxQrc+Kttvxh+AjKSlSt1WpWmr1LQ16Drbjep2o0Zp0hmsFiNptlIkm2CyGSw2gylmcwM5QilHGMITxwmDYoVBiaKQWKEfPwb4UJtBvbsp/3R7VYW6pdOkM5PWAA5fxhFmBESOD4qfGZom5XiSGypWNh5pLT3dXtmg7+w06iyUVcDkBPPEccLg0YEx00JTUsRh6HOuhGEyy4hOk/aisqlU1VypaWs1qNoM6k6T1mC1mEiLhbLymGwBkxPIEcYKg+JEweNkseNk8UIWF/0ug1OTXpknr6nRdtRqO+p1crlRq7Oa9FaTwWphM5h8JpvP5Mg4wihBYJQgMF4UPCYwNl4UjH6XAW9gHrEzAsMELA4ArJtx9fHmmk1V+Tlt9a16DQFEmEA0KTR2dcLInr3d/UfI5qybsfpUa+3mqoLTrXUtOg0AFcoXZ4fGrE3KmhASDQDJkiACgL78EgAAdtWVfFp44kKHWzmXc+0Ndx1cv2nRrUOmzt19gQFdbyUZKeFP3DOv++CAMyoh/FhB1WNrZiArkDW0K3fnlMzMumKruWLYYJSenVR7scFW1W5je5yenXx5IzosNvPB925dcPOMH/+98dTOXFstfHN12w+vbvj5P5vnXj/1lpeuQcrPfcV86ZIbV4B2CgUALq8rSHYvzOo3obFd5596DU3Ts/gR0QEhEmWbSt6seHHV2//30R3RKa4vc9p5+XQ/GYgfjzEMwzBsiKMo2yfhEWGh/1owFxlE9OyuDgDsvqznbL/rsQ+flb1+hVcQSVHH2sr+qs871V6hMHU1YEVoLAaNxQAGVaW69XBLV6lgjEA2PTT16thxaRJnp2h85oAomrBTmw2n2ivOymsudNaVqJrMpBXdwoGRshhJCwB0mrS1WrTARMoRjJJGTwxKmBOe6WYyq5/JjdqPSvb+VZ+H/DPbDOo2g7pE1byl7hyPyV4ZPfbulFlhPHRFwd7kdFR/Wnogp6NrrSc7JalXmvUV6tYDzUXvF+8eIY26I2nGgogRyGb9YFjNsh0FVK689kBz0cm2ijJ11506tHQWk85iajdqbJt9A8AkGJODk9bETZgdlu5lyvWKsFLk8bayvU2FZzqqGnUKdPgSo5U0Ws0K0DXpFYXKyy1lpRzBhKCEhREjZoal8ZkD6xCNGLBH7DNrHkEiU8PjpobTlA06tyQ2veqm59CodyaFxk4KjUWjl/BZ7Mref+ILp3f9XJYLAGI2966M7Gnh8WF8EZtxudeKkbQojPoSRdtPZbn5HU0AcL6jcW992aKYVPs2w0RGcvhmAAAor25Fhgagu5ZMuve99Q/8b+MNc8cBQKdGn1fReLa07qd958wW6x2LJqJPwDCsdxmTUvb8cLjsXBVFUgSD0Ch0jRUtAOBmW5KUcQmvbn6qta59z/eH9/10pLGyBQCsFuven44c3njqvrdvXn7vfPQ5XguPDz0PRQBQd7ERrkJH60q66t/tTXL6mb0I/dKnzG6YLOa9b9z49l2fAUDugYK7Rj01cdHoJXfOmbRkLIvjOnHt5dP95Ir9YAzD/IsggO5A5hf9+bMwbEhgMhhiLldtNBosljGRzjIFPhFwqRy+XUefy+ipn1+hrxhJy29VJ3+tPtWkV6BjbqjTyX+tPvlr9ckxsthbEqbO7yWvKmb34fYC/6nXde5pzD/UWnKhs56kfFOrojDpjrSWHmktfa94d4o4bE3chJXRY/1XJjxt1+saC82NFHcmzXg0YyEaBTjWVvZi3qYOowYd6M5gNf9Rc3pn44UXRq1cHDkKHe7OSFo+KN7zS9VJylk9aJdCRcNTZ3+bFJz4n7HXBHPF6LAfDIFZ9ozGYvit+tTm2rP1uk50zD1WijzWVnaszZfrBP447d6sQL/XMtfp5L9UndzZcKHTpEXH3KYw6fY1Fe5rKuQx2YsiR96eOD1RHIpudKUNqyP2ALGpMt+WbRewOFsW35Yoob/fJU4UODoockVc5sytn9pWhT3SVDkME+4Tx8QzGARJUoWlTQ3NiqhwKbrFQDIuJerfdyx+/ed9T372JwD8tO/sT/vOAoCQx3nz3mXJUYPvrhcMu4Jslex6jaG2pDEuI6o0p4KiKIIgXFa4OwqNCb75hdU3v7D6/MGizR/vOvHXWYqijHrThw9/AwA+z7lPXzVx93cHAWDLut3L71sgkna73fOXN7bYHkxZQb/Yg09QFFVypuLc/oKqgrrW2ja1XKtT600Gk8lgNhvpe17ZLbhlJlfA/eSx7zpblBRJnd6Zd3pnnlgmmnfj9OX3zotNj0Kf0J2XT/cHnHDHfCO/teWXggunGupatBoACBeJp8fE3j56XII0ENny2f17fi/KB4CDt94VFyBFRm2K29uW/voDANw2euwrM9HKyg697rvzuQerq2pVCr3FEsTnjw6LWJ2euSAxmbZ4s16lmvH9lwBw7u4HA/n8Dr3u+/O5uyvLG9UqkqLChKLxEZG3jR47MgS9T5wAYDAYrVrtV3k5f1dXNqrVtu2nxcTePXZCz3+aXV9fIQCUdrTvKC891VBfJu9QGg1sBlPG52eGhC5PSVuRmt7bswBgW1nJb4X5RW2tWrMpXCSaHZdw37iJkWIJl8nU+XrdHs9+lvv7hqO+PsvjWcawKyUzLORUbX2VvFOhN/SpP4wH0kO6PmWdrW+8frSL/KNdf75Cn9jRcOHDi3ua9Ep0oO/y5LV58tpxsrhnRixLD0CvNwR41K7EVxQm3baGvB0NFwoVl6tZ/aFM3fJGwfaPLu67KWHKnckz+rNItljVVYPjaFdj/nO5G9xPOqvNhmfO/VGnld+TMgsdu0RrMT54+oc8eS064NSp9srrDn/6+eTbkv3WYWY4zHJvjFbztxVHf6w8TnsxZmir1cq/Kj+4rf681e393CWD1by1LvfPuryZYWmPpS8YOGn3YXLEHmh+Ksu1PViblNVbtt2Oz2KPD4naXVcKAK16F1c6h6QQmWj+9PQ9h4tJknrrsz3vvngNizmgb5dZkp0+JTNuT05pUU2LWm8Q8riZcWFLstMDhIPgLA7DBpSEkTE8IdegNZbmVMRlRJXkVAJAbHqk8FKnqT4ZPTtz9OzMsnNVb96+rvZiAwB8+ewvs9dOEQUK0U29kL1kzMhpaQXHSuRNivvHP3v9MysTR8VyBdzGiuZNH+4sPF4KAEERgdc+uQJ9po8c3XLm6+d/bShvRgfcNnPNpImLRm//cv/WdXtaatoAQC3XbPl419ZPdk9fNfHet25yXp7v5dN9DifcMW9ZKer1Iwe/O3/OsTCsslNe2Sn/ueDCU5On3T8+22EE1maOtCXcN10senzSVMchu43FhbYHazPQ9YJ2VZQ9tW+X1mSyR5o1mmZN2e6Kspmx8R8tXi7h9lqi1azVNGhU92zb0qy5fMpYpeisUnSuSstw2LCLgMO50NJ8x5+bOg2Xm0zVKBU1SsXmi8WfL1s5Izb+8taXePAKnzuw97fCC44RC0k2qM0NatXeyvINxYVfLV/FYV6+09PGSpKP7N6+o7zUHqlVKn+4kLfpYtHny66S8fk6s9lhc6949rP6um/YePYsu77OMoZdKfOSEk/V1pMU9XPe+YemdK3G4yeZYaHBQkG7VrezpPTJmdPCxW51cu/PV+glhUn30vnNh1q6lrPzlXPymhuOfnpX8swHU+c59q4NYHtyqu29s/LqDTVn9jUVmUgXFSI+pLUYvyg7uLnu7AujVs4OS0eH/aNYiXYWPtRysU/ZdruPS/YJWJybEqagAwBai/G+k9/lK+rRATe0G9X3nfzux2n3RQqk6Jh3hs8s0zrVXvnvC1vrdGgbnCHPRFq+LDv0TfkRC+WsWZDHKKAOtVw81lp2c+KU+1Lm2JqSXynD5Ig9MF1UdLVGyQh069KLydq1QwrZ6OeXYeL+m2eezqtRqHRnL9Q+/MJvD902a1T3MkmD0VxQ0ngsp0KnMz338GLHoStCKuJfO3s0GsUwrI8YTEbq+MQLh4tLcioX3DKz5Ew5AGS410+mNynjEt7e+8Jdo57UKHR6jeHkjnPzb5qBbuQFgiBeXv/ECyvfKsmpaK1rt9XRO4pOiXh5wxOSILc+CfbVb29u/ebF322PJUGiCQtHJ42OC4sLEUmFfBGPK+Bs/miXrQDfOb6Id83jy9Y8tvTcvvzd3x86/meOyWCmKOrI5tNn9+f/a+OTo2dlos9x4OXTfQsn3DFvvXRw3y8FFwAgWSa7eeSYlKAgiqIudrT/eCGvRql48/gRC0k9PPFypmZ8RGRioKyyU77pYuFjk6b2rN22UtTW0mIAyAgOGRHS7VzwQHXlQzv/shUs35o1JlkWJGSza5XK9cUFuc1Nh2urH9jx5w+rrmH2sqTPhdbm904ek+v1K1LTJ0REBfC4rVrt+Zbm0w312ZHR6NYAFEXdt32r0mhYnZ45PyFJxhfUq5QbLxaeqK/TW8yP7tlx7PZ7+KxufSE9e4UTIiJ/K7yQGCibF584KjQsTCjSmE3F7W3fn89t02mP1FZ/k3e2Z5b5zeNHbBnwSLHk3rET0oKDDRbL2aaG78/n3bt9K8un7Uo9+1l93Te8eZZdX2cZw66U60dnfX4qp0On+/j4qfSQ4HnJSegWAIUtrVEBEinP27okJkHcMWHc24eOGiyW+zZt/XLNVT1XT9WbzSRFOXZj789X6I3znXVPnf2t1aBCB3yBpKgvyw6d76x7Y+zaIG7XL03G7df0DUmR+5qKvq04UqSkqfvuH20G9aNnfr45YeqTmYsYvRzzfUhh0jXplRH8ANuXDbrOf+Zt9CDbbvNu0a6xsrjMgEgk/sr5LZ5l223ajZqnz/3+/bR7fNIffBjOMoIC6ovSg5+W/u1Ob58hpkBR/2LepkpNGzrgaxbK+l3F0QPNRe+MvyFNEo4O94shf8Qe4OyfQHTmy7VBvdGYjWfaug6S8WL6e0z7gUpj6FTqtFqjRmfU6owanaldrrYN5VyooShKyOcKhRwhnysUcEOCRFyftusNDRa//vTKZ/6zWaMzFpQ0PvD8rwESfkxEII/LNprM7Z3allYVSVEAMHV8IvpkDMMGs/Ts5AuHi0tyKgDAVuGeMcmrhDsABIYFTFo6bv8vRwGg9qLvT/kCgsVv7fnnw1NeqCtp5PDYVgtJMAiJTJSYFTv96ux5N07n8v1yxb0yv/bbl/+wPV718OK7Xr++5w9CWtw4RxDE+AVZ4xdkqTo0277Yt/69bVqlTqfS//v6/31/8X8u7zPw8um+4st3I2wYOlJbbcuNzoiNd6zCnhYTd+PIrNv/3HS6of79U8dmxcWPCr182/XajBFvHj9Sr1KdbqifFIXmQA/XVNu6DF+b2a28XWc2P7VvF0lRo0LDfl9znT3TPS0GbhiZ9dS+XRuLC4/X1/5ZUnx1Ov01q5cO7g/iC7bfcGuqrNsdlFaKos3R68xmvdn82bKrFiYm2yKToqLXZIx4YMefuyrKOvX63RXljkXTHr/Cq9IyEgNlY8O73QM7Nz5xZWr6kl9/0JpMW0svIgn3GqXim7yzABAtkfx57c2BfL4tPjsu4arUzFXrf1YafXYjtmc/y7N9w7NnOerrLGPYlSLgsD9YufT2PzaZrdb7Nv05LS52VmJ8iEhkJckOna68veNkXX2dQrnjzlt9ks6+e+L4Q5XVp+vqC1ta53357dK0tNGR4RIuV2kwtGi0F5qaT9fVf3nNqmlxlxdh6+dX6JnjbeWP5/xisNLcZONDp9srbzv25ZdT7rSlgEUsHpvBdL5qpQ89cOqHk+0VaPRK+KnqeKtR9cbYtT5JMTtXrGy0/bYpoJ7P3aA207zRuMlKkf/M2/jHjAcdVwX8qer4nqYCh608ka+o/7nqxK2J09CBvhues2xnpchnc9fvafR2RgajLXXnXsv/s9+OJwBQq5XfcuyLf45ccVXMWHTMz4bDEXuASxDLCjtbAGBjZf4tqeNZvS/ArrOYHj32p8ZstH25JPaK3fvyv6/27zlcjEYBAGDn34U7/+66Mdrm+YcXL52L3iHtpdGZ0V+8edPrH+0sLG0CAKVKr1RdvvvZLtg/RaPuq2qWh0pFQh6a5MIwzDMZk5IBoPJCbXN1W0dTJ7i9YqpzAcFdiwBZLb5/YzLqTc8u+U9dSWPymPjXtj4ti5CiW/jHwd+PUyQFAMljEx549xaCLvGi6fRkZRpJkOjG51bNvnbK/017US3XqDo0x//MWXDLTHS7Xnj5dC/1+haLYe744lwOALAYjLfmLUJ6nvBZ7LfmLWIQBElRn+acchxanT7ClvrcdLHbGZLNxouFAMBmMq/q3gBkfVFBp14PAG/OW4TUlQPAc9O6/mbWF/f6ac1ktX64aBmShwUAJ3nYlakZ9my7nT33nd/a4hj3+BWyGAwk224TIwmYEhUDABWd6L3VG4sLrRQFAI9PmmbPgNsky2S3ZfnyE5RnP8uzfcOzZznyYJYx7EqZHBvz43XX2IrNj9XU/ufvw4//teOp7bv++/fh9fmFdQol+G7XZTIYX61ZtTwjDQD0ZsvGgsKX9ux/7K8dL+89sO7EqaPVNfbbxh315yv0wIHm4kfO/OTv3I1NnU5+54mvGnUK25cyji9bLjo3N5z+KvIVsaex4KXzm9GoHxRfKvTeXn8+r7O2+2CfVapbt9Z3dS4GgCa94sOL+xzGPfdV2SGftBofnrNsQ1Lks+eGY7adpKh3ina9fH5z/+eCjVbzS+c3fVNxBB3wp2FyxB7gVieOsj0o7Gy5Yd/Px5trkAUDrBR1UdH6aeGJ+X99eaCh3Ba8JjErNSDYcbPhJjZK9vkbN/3vlbVXLx6TGBssEfEYDILHY0eGBUwel3DvTTO+f//2p+9fiD6tf7347a61r/5ADbt7hDDMXzKyUwDAbDTv/OYAAAgDBD5ZeNPWwx0AQqJk3Ud8YNMHO4tPlQPAcz8+3G/ZdgBoquq6S2/ktDTabDsAFBwrQUNui0wKm3PdVNvjpqrW7oOuefl0j+EKd8xzeov5ZEMdAEyOignv0Z0AAOICpOMiInMaGw7VVltI0l5DESoUzopLOFBdub289JVZcx1z02qTcV9lBQDMT0gK5HXL7e6rqgCAEIEwIzjEMW4TxBeECIRtOm1ec69LNGSGhE6I7NshcmUaTTVHUmDXkVGu1znGvX+FPUWKxQBgtlpNVqtjAvpMYwMAMAii5/UAAJiXkLiu95R0X3nwszzbNzx7FsKDWcawK2hiTNTf996xsaDoQHllUWub7aKdjM9PCpJlx0QvSUtJCvLZqZiAw/7fiqV3TBi3qaDoTF19k1qjM5ulPJ5MwM8IDZmblDguEu25Af37CvukQFH/bO76/kxUNeoU95789pcZ90vY/CCuqMU/LRF6WhUzdl3pfoWp2zvOFbStPi9LGnNdPNrozLdsbdyNpOV/F/egYx75tvzw6phxtk4pbxXuMPoo66c067fW5dL2iO+T4TnLNm8X7fLgboNAjjCYKwrg8CVsAYMgFCadyqyXGzXtRg266YBEAfVq/tbNtWfRgX70QfEevcX0UNo8dMAPhs8Re4C7LW38nrrSU621AJDTVn/T/l84DGakMEDIYpspUms2NevUSAp+dmTSvyYucIx4afv3D6Ehp156bNlLjy1Do31x29rJt62djEb7bkJW3ISsODQ6YFQ3y5dkZ/SS6cIwrM9kEdKQ6KC2+o5tX+wHgLSJSQTD2R+YXmPgi1zc9Vtw9OK5/V3nPBMW+n65hXP78wGAxWZGJfdr4zguvyunp2hVdh/psvenI94spgoAuku3FokDaTJFLnn5dM/ghDvmuXK53EKSAIB0WneUGRya09igM5vL5R3pDmnoazJHHqiu1JpMSFeW7WUlRqsFevSTAYCCthYAaNNpEz56FxlypLeY9RZzzwJzAMgK7fNBJ5MudS661OPY9s+38+YVkhR1sqHucE31xY62Fq1WYTAYLGa92WL7bQAA0tK0vLMDACJEYvuLcZQo9WX+y4Of5dm+4dmzEB7MMob5UCCfX/7042jUKS6LdeOYrBvHZKEDdD5YufSDlUvRqAOXP310RPjoiL79mfTpFfaPJr3ikTM/e5MzJYDgMJgm0tqnhtF1OvnT535fl32rvTtwP+Ay2TfET/609AA60Ee2f7KZstq6zXrjnaKd00JTogWB6IDv2Crct9XntRnU6BgAADAIBgGAJIacqNd1Hmy5ODc886y8+kAzfXcCm752n9hQm+N9wn14zjIA7G7M/6XqBBrtBZNgzI8YMTUkeZwsPlZIc/oBAE16xTl5zcm2il2N+T5ZeFbA4sQIZNECWYxQ5sM1cv9bsM3LbDuDYLAJRl8PYogvyg5KOQLvd2DnhtURe4BjEozv51732tn9v5bn2m5gNZHWajV6K61NKF/00MipN6WMu4K3smHuIwgiUNytXg3DMC+lZye31Xeo5Rpwo5/Ml8/+Unq2csbqSWPmZCaNjmexu92v39mi3PPD4Z//s4m0kgAwfdXE6FSaJgde4vA5AGAxWz9/+qfVjywJjpIxWd1ehp+kjk/c88NhADi5/VxNUX1cZrR9iCKpnd/+/clj31/ems4v/93SVNU6e+3kUTMyOLxuuTKKpPb+dOTv34/bvhy/oOtWLUdePt1PcMId81ynoesakax7mxFHQZeG5Jc2tlmQkBTI53fq9RuLCx0T7huLiwAgTCiaERtvDwKAlaKUBndv2TZbST7dri3hctGQK9LuVfZOePMKzzU3Prt/T5m8wx5hM5liDidEKFAZjSqj8fKml9iCyE0AduK+/0ud8OBnebZvePYshAezjGHY4EJS5DPn/ujoYx1rBD9gWmjqxKCEBFFItCBQwOIQQFBAGazmNoO6XtdZpmo+J6/J6ah23iHkRFvFc7kb+vrTvXR9/KRvK46434ohgh8wQhqdKApJFIVECKQhXHEQV8Rlsmz/ZI3ZqDLrFSZdsbLxfGfd+c66Gm07+i2cMpGWd4t2vj/hRnTAd9qN6naj+qfKrpNjGwbBWBI5aknUqJHS6ECOEACa9IoDzcXflB9pN9Ln5R3tbiyYG575ddlhdABAyhGsjhk/Kzw9VRwuYHEMVnOdTr69/vz6mjPO9wcAqFS3VqpbE8W9Xip20zCcZYVJ91r+X2iUDotgro4df0fSDJcp7wi+dFmUdFnU6EczFv5UefyX6pPu53kDOcIYoSxGIIsWymIFsmihLEYg80eu9tPSA79Xn0ajTsWLgicFJ2YGRCWKQsL5ATKukEUwAcB2EGvRq5r0Cttcn2yvcH8vAoB3inbFCoNmhKaiAz4yDI/YAxyXyfp39qL7RkzeXlN8urWuXNkuN+r1FhOLwRSw2FIuP0EsSw0InhmZmB0a059rOWBeGpkQXtHYt+M8hmHOZUxKPrLpVNfjbJrb/R1RFFV6trL0bCUAMFnMiITQgBAxV8A1Gczt9R0tNe3UpWKI+BExj35yV7cn+8jiO2af2ZUHAJs/2rX5o12OQ1w+JzAsIG1C0qLbZ09YSFNH1dmiVMk1WqVOq9TpVDqtUm/QdWWijm453VjRLJDwhRKBQMIXBghCooMcryjMvWH6D69uUHVoDFrjg5P+OWN1dmxaJIPFbKlpy9lzoaWmjS/m3fjsqu//td7+FIReo9/93cHd3x3k8NhxmdGRSeEiqYAiqc4WZcnZCnmTwrbZsnvm0Tb28fLpfkKXlcSwPnJSamIvsCKgW2UEi8FYlZrx7flzx+trmzUaW/+QWqUyp6kBANZkdDV5v+zSwWlkSNirs13c+iqkK8QGAEbfqzPYdE1L6Hn6CovaWm/ctN5otbAYjBtHZi1JTk0PCrGvQPjs/j2/F+XbN7Zz8jsHACZB2HqdowMecf5dnP8s+igA9L5vgKfPsvFgljEMG1y+qzh6vrMOjfZuYlDC7UnTp4Wm9DxuEEDwmZxYYVCsMGhqSPJtSdONpOVQ88Vfqk/mymuQje12NdIclv1KyhFcHTPu1+quM35aEfyAqSEpU0KSx8pig7lidPgSAggxmydm86IEgSOkUdfETQSAQkXDT1XH9zQWWih3K7sPNBcXKRszA2jaEPnK2sOfyI1a+5cJopC3x1+XIg5z2AQi+NKbEqasiB7zeM6vOR1VjkM9HW4tudBZd6ytDIlfHTv+H5lLhKzL12t5THaKOOyxjIWrY8fff+r7Bl2nw+Y0DraWeJ9wH4az/L+Le1Rm+svnjgI5wncnXD9eFo8OOBXMFT2WsXBJ1KhHz/zSpFegw90tjcp6YdRKx33Af460lnxeehCN9iKAzb86dvzq2PFxwmB0DAAuHcTiRcHxouApIckAYLSa9zcX/1R1vFDRgG5Nx5YQ3zDzYZcXMzwzDI/Yg0K0MOC+zMn3Zfqg0Qo2QDxy9fS7311/pqRuYloMOoZhmEfSLyXZCYKwP+4NT3j5LMJqsdaXNdWXNTmMAwAQBLHw1pn3vXWzKFCIDPlE9uIxc66baq/mdmTUm5qr25qr2w5tOLnotllPfH4v0iHn5TXvXjxd7hixW//uNiTy3t8vj5yWZv9SJBW8sv6Jl9a8q+nUmo3mA78ec9gWgqNkL/zySMLI2B/+vcG2tmpPnEsLPpsM5rJzVWXn0LN6BpOx6qFF9755ExK38fLpfoIT7pjn7GXIHd1bmTtyUrN8bebIb8+fIylqS0mRbRnSzSVFtqFrMkZ02xSAyWCIOVy1yWiwmmnXF73iPH6F7548Zusbs27JigU9mqT3dle7mMOR6/VKI31Rj85s7i0D7gEPfpZn+4Znz8IwbFip1LStc7vtRiBH+NzIZYsi+3DnIJfBWhg5cmHkyONt5a/l/+ky09pvbk2c/nvNGbJHB5VEUcj8iBELI0cimeg+GSGN+u/Ytf+XtuDZ3D/cT439UnXitTFr0KjvOGbbk8Vh3069S8KmP/JL2PyPJt5807HPK9XO1kHSWUy3H/8KCT6UNu/elNlI0C5WGPTZpNuvOfSR0WlzkjPtlXcmzUCjfTesZrle17m17hwa7SFaEPjVlLsi+AHogHvSJBG/zXjg3pPflajQD72OdjXmr46dMDEoAR3wtXpd53O5G9zpi8JhsG5NnHZn8oy+XgbgMtlLo7KWRmXtaSp4p3CnO73LtRbji+c3fTXljp45bi8N2yM2hvW/6GDp8zfOe+TjLfPGpWTGhkpF6Dvm0kkZSATDMOdSxiWw2EyL2RqVEi6Wubjj7b63bp6+Kvvc/vzSs5XNVa0dzQqjzmQxW3hCriRQFDciesSUtDnXTw2Pp+mL6xN/fbb3u1fWq+UaJosZkRgaHCWzF6FbzFatUldf1qRXGwBg9/eHksbEr3poUbfne2fk9PSv8t7e/PHOM7vON1a2WMxWiUwUmRw+eenYFfct4It5AJAwIqYyvxZ9JgAA3PLimqwZGad25paerWyualPJ1SaDmcliiqSC6NSIUTMy5t843UkTHi+f7ic44Y55Lk0WzGOxDBZLUVuvn28LWlsBgMdi2RcatUsPDhkZElbQ1rK5pNiWcN9eVgIAEyKjEqQ0DUNHhISebKir7OzsNOh7a29yZXn2Ck811gNAvDSwZ7YdABrVajQEAACJgTK5vqFBrdKZzQI22rC+SuHLzxse/CzP9g3PnoVh2LDyv+I9vV2JRKRJwj+YeFMEX4oOuGdqSPL6mQ/9O//PnQ0X0LErIVIgXRgxwl6qKWHzl0ZlXRUzzofVx5EC6bdT7/7g4t7vK46iY3R2NxY8N3J5X7OBHuAx2e9PuKG3bLuNgMX59+irbz76hfNUJtLzfVnUaCfZdptYoezO5JnOu6vnK+opoLxPVg6rWf6x8ljPC/YINoP59vjrPc6220g5gncnXH/d4XVaixEdu4SkqFcvbN0462EOw48fjiigXszbqDbTVzA4ShSFvDHu2jRJ39bbQCyMGJkdlPhs7voTbfQFa45yOqp+qz51Q7yP652H7REbw/rfrCfW2R7sOFW841Rx90EAnHDHMKdEUsEe0y9IkMvn7ND+iAQB4N43b6KtlR4xNXXEVH+1aHPuj3f++ur5XwEge8mYRz6+MzSG5sY4q8X6zYu/28rVd317EEm4f3j0VccvPSCLkN71+g13vX4DOnDJZ2ffQEMORs/OHD07E426zcun+4Pb7TIwrAc2kzkrLgEATjbUN2lo8sI1SkVucyMATI+JY9H1ZlmbORIASjvaSzvay+VyWxPztRkj0e0AAGBeQhIAkBT1c/55dGxg8OwVGsxmABDTtcFp02nPNTeiUQAAyI6MBgCSovZVVaBjAIdrq9GQFzz4WZ7tG549C8Ow4SNXXnOo5SIapZMqCf9qyp0e525shCzuf8de4+/lBN13e9J0AMgIiHx19Or9C55+buRyH+ZhbZgE44mMRdfHT0IH6JhIy3E3EnneuyNpRqwwCI32MFIaPTPs8s2tLkk5gudGLkejdG5ImOw8D6s2G2q1lxdi8cYwmWUjafmrPg+N9vBo+kKf/PNjBLIXR61Eo93VajvW15xBoz61pfbcud47n9iNl8X/MO1eL7PtNlKO4OPsm+dHoHeO0lpXcsCdiwHuG+ZHbAzrZ89cP8f5f+gTMAwbKow640+vbwIAUaDwnz89QpttBwAmi3nzP1cTBAEADT3a3WA+hzNWmFceGJ/NIAgrSf5j3y6TtVsBi95i/se+3RQAAXDf+ImOQ3ZXpaVzmEwA2FlRtquiDAAEbPbyFPpPyzeOzAriCwDgwzMnaTO/AFDQ1qJwe+VSn/PsFUaKJQBQ0SlH4iar9el9u5Hfqt3q9ExbHd17J48hT2zWaL7OPesY8ZJnP8uzfcOzZ2EYNkx8XLIPDdEJ5oo+nXSb84JoNxFAPD1i6eK+tDjwn4yAyPUzH/ptxgNXxYx1nv/10tMjlrrZL/twSwka8jUuk31zorsZtGvj+vDucHvSdDGbh0bpBLD5E4Li0Wh3leo2NOSRYTLLJ9rKndSb2wRxRW5eFXDH4qhRCSIXN3F/W3EEuQfChxQm3fvFu9FoDyOkUesm3ermnukOFsF8c9za0YEx6EAPKrP+m4ojaNQLw/yIjWH97LrZY5z/hz4Bw7Chorqo3qA1AkBSVpyteUtvuHwOg8kAAA6fpuIT8y0/nsdjw8HosPBHsqf879TxY3W1S3794ZZRo1ODggGguL3txwt5NUoFANw9bsKECPqFgAO4vIWJydvKSo7UVlspCgCWJqf2bFpiI2CzP1q8/NatG8xW6z3btkyLiZsdlxAqFFpJsl2vK5d3nGyoq1Uqd994m33F0X7m2Stcmpz6+bkzOrP5zr82PT5paoJUZrBYzjU3fp2bUyrvSA8OudhO8xk+KVB286gxP+bn1SgVK37/8Z6xE9OCgs2kNa+5+fsL50igAvn8Tr0efZpHPPtZnu0bnj0Lw7DhoFTVnNNRjUZ7IIB4few1wVwXbRb75NXRV5eomqs0NEfjfpbqi6JXl5gE419jrl759wc9m4kjLijcbQXusXnhGSKWu2/rk0OSxGyeO1W6XAZrdewENNq7iUEJzgu9q7XtaMhTw2GW/26maXeAuDYum83o6j3qPQKIGxMmv57/FzrgoM2gPtxSMifcL10Xvi4/rHS1QmwwV/TxxFt4TPozYY+xCOY7469fdfBDlxc5fq46cVviNClHgA70HT5iYxiGDTHfV+3/soLmyvHnEx8eERCLRrF+xLh0979O7eJM4+D6E1aLFQDiMqPRMczXcMId89aj2VNYDMb7p45Xdsr/dfhvxyEGQdw3buI/ps5wDCLWZo7cVlZyvqWZoigAuDaTvp+MzZTomJ9XrX1k9/YWreZYXc2xOprbcplXtNOIB6/w4YmTD9dWF7e35TY33bp1oz1OADwxedq0mNg163912PyyF2bMbtKo91VV1KtULx/ab48HcHlfr7j6k5yTf1dXOWzuFc9+lmf7hmfPwjBsyPu1+iQaorMieszk4CQ06h0uk/3CqBV3nfgGHRi6YgSy+RGZexoL0IHuajQdWovRHw2+7WaE0t/3RotFMMfL4g+60cViamhKQF8qakdIXXwsGYyrNV7BWc6V0y+Z5WhNX66IuGN51Jg3CrY7r2Hf01Tgj4S7wqRzp1/Nq2NWy7hCNOoLoTzJQ2nz3ircgQ50Z7Sat9Sds/U18hI+YmMYhmFY/4hNj+SLeHqNoexc1V+f7V1x/wJ0CwCTwbz7+0NfPPOz7csld+I2U36HE+6YDzw0YdKixJTvL5w7WlfbrFEzCCJMKJoaHXtL1pi0IPruUXbTY+IiRGJbw+64AOnESBcfaLOjog/ddteG4sL9VRVFbW1ygx4Agvj8pEDZpKiYpcmpV3wtzb6+QhGHs3HtDV/nnt1eXlqt6KQokPH54yMibxs9dkJElMlqZTOZZrrGMhwm84vlq7aWFK8vKihqb9WZzeEi0Zz4xPvHZYeLRMmBQbRJcM94/LM82zc8exaGYUOY1mLc4cZSeDwm+5F0mlNM700ISpgZluaP3hoD1h1JM1ymYimgytWt7nSr8Fh2cCIacmqMLNadhPusvuTxASBB5OLdp81As/TIwHdFZlll1rtseR8lCAzhidGodwQsTpokvEhJvzqOzfG2cp+sf4v4ofKY3mpCo93NC8+cFpKCRn3n2rjsbyuOuNxR19ecvi1pmpe/AXzExrD+ZyVJBsEgvPrbxTBnro2dMTt0lNKsU5q1nSbNx6XbdFYXN05h/YMr4F731IrvXlkPAB898u3WdXvGzBkREh3EYjNNBrOiTVlf1lx4vESn6qp/n7lm0oKbcRWj3xG2smIMwzAMw7ABa3dj/tPn/kCjPVwXn/38yBVo1Edy5TW3H/8KjfbimriJLhdpHPjm7X2z3ahBo929Pe66hZHO7k5zYtqu1zUWZ+1fQnjiffOfRqNOHW8rf+DU92i0h7/mPB4r7MMVegqo7B2vmkgLOnDJiICoX2bcj0YHA3/Pck958trbjn+JRrtbGpX137Fr0ajX3ijY9mv1KTTa3ba5j8cI+rBvuGQmrfP3vaUw6dABBwyC2DL7kTihi+s6Xvq6/PCHF/ei0R6+nnKXy0ULnMNHbAzrf+Puf//FmxdcPZ3mWP36z/urmju+evJadAAbzFYf/U+rQbF3zmt85pVpxr3y8KtykwZwS5mBgaKo7/+14Y+3/7SYaYo17YQBgmufXHH90ysJBr4653dXsvkGhmEYhmGYO/Y1F6GhHgggbkpwd3VND4yVxaWIw9DokDZWFoeGemgxKNGQ76RLItCQKzFupNEDOcI+ZdsBgADCecG1wuwsnTqQ9f8sN+hdt9/JDPDLYi3pAZFoqIcyVTMa8s6hlovOs+0AMDss3d/ZdgBYGjXandL1Q27cI+IcPmJj2IASKOaXN7i4rwgbXGp1ba0GBRrFhjGCIG5/Ze3XBe/e+tI1Y+aMCI6UcfkcgkHwhFxZuDRjUvKi22c/9+PDP1d8dMOzV+Fse//ALWWGO4NV+U35KjQKMDv8qcyAZWgUwzCnNJa2Hypoikemhtw/RnYdGh2czKT+y7KlaNQNSeKZiyL/hUb7XZO+4GzHDy36YjNlELPDksWzxwfdwiJ82ZsY8zkzaT3WWoZGe8gKjPZ3xmpJVFaZG/WhQ8Y4WdzepkI02p3cVSbRGx5MaAQ/gACCAmd3cKZIPEnDSTkCJ43aXS5HOWD1/yw3612n7/3Uytyd5UAb9Qo05J2t9bloqIe1cdloyA8i+AGZ0shCRQM60N2hlpInMxejUbfhIzaGDTRMBkNvMqNRbDA70+H6MIsNQxEJoTe/sBqNYlcIrnDHMAzDhotG/YWtdY/Xas8YSQ1JWZSmhrMdP+9seAGc5uawK65AUe9ONnNR5Cg05GsLIkagoSEtUhCIhnowWv34GT5a6PoFIFgEM4DjYjXUJFEIGnKD80VW1WZnvXEGsv6fZY0bvysJm4eGfEHidBJtOoxaNOQFtdngMvss5Qgm9XGtAo9NDEpAQz3UaNub3Lgo0ht8xMawAcVksR4vrA6VitABbDA7Iy9FQxiGDTC4wh3DMAwbLk62fUFSaAvmOm1Ove5ctGA8EscGjlx5DRqiMzssHQ35WqwwKIwnaTGo0IEhynmK2ca3qVhEOC8ADblByhE47+AR3cd+MjbOe6RaKdJCWVkEEx0Y8Pp/lvVufDcxy/Wr8oA7eXyDGy/PfafaK6wUiUa7mxWWxiT6qQrKzcVvCxX1EXxP/voAH7ExrH/985udrYqudTh+2Juz43Sx4yhJUrWtnR0q3R2LJzrGsUHNYDXldlaiUQzDBhiccMcwDMOGBTOpb9HTd5Wt057FCfeBLLezFg31EMGXRrlRqOu9icGJ2+rz0OgQ5U4q1kw5W5rJS8FO26b3xnlmHAAi+FI05AY+y8W3tZAkizk0E+6+nWVz72vP2rEZfvlNunM3E+UqP94nJ9rK0VAPE4P6qbwdAJLEoWiITqGycb6n5eH4iI1h/WlWVuKhC5WnL9YCQE1LZ00L2vosSCK8cd64e5dNRuLYFVStbd3ZlHO+s6pO166zGgAIEYsXwZcliyLGy5KnBmf0PJMpUdWfkZeVqRvLNU11ujaS6npDW/D3C903BAC4KX72A8m9tgBtMSi2NZ4+3VHaqJerzXoJmx8lCJ4anLEyKjuA7Zd+bo5MpGVX09mjbUXlmqZOk4bLYIXypONlySsisxNF4ejWAACQIy977NyXAPBa1i2zQ0dZKXJX07n9LXnVmpZOs4bL4ETwA8cHJq+JmRrB96SiAsP8xJOE+86GF6o0x9CoUwQwmAw2i+BymRIBM1DEDg3kxMq4CRH8UXymFN0awzAMw3xNZ+nora2z1tKGhrCBJL+zHg31MCEoHg35x4iAyOGTvhG7kYq99InPL4K5ntwCz2Oy0VB3oTwJGnIDy1UNsstC5oGp/2eZz3K9bIbKrEdDvuDOt+2Z5vDGifYKNNSDO+vW+kqMQMYgGKSrfbVE2YSG3IaP2BjWnxZOSFs4IY0kqWmPfvzk2lkrp2Q6jjIYDBbTxZsX1p9IilxXtuOPuiP2jLlNp0nTadIUKWv/bDjFZ3I2TH8OyX1vqDu2s+msY8QDFFDfVe7/ofqA45VvuUkjN2nyFdU/V//9cOry5ZF+XFPkrLz8v0Xrmw2XLwuZSYtG01ypad5Yd2xtzPSHUpYxej/dqtG2thtVz5//vkhVZw+aSX2ZWl+mbtxUf/y5zLULwsc6PAPDriRPEu4eoIC0kEYLGA1WlRLqweFcV8aNTxTNTJHMC+TEXo5iGIZhAxKbwb8tab3eqjBYlXqr0mBRdj2wKm1Bg1WptcjdqyMcKAi8oskApjDpOk2uWyqnB0SgIf9IkdBX3wxJBEGgof7lzhKXPbnszuGnb2smfVkG3m/6f5bd6eviTmbcAyqT62/r8lYG93UYNU4W2rURsrhRAika9RsGwQjkCDqMXQ0oeuPxyrH4iI1hVwSDQaREBTMZDA67nzI8mGe+qNj9W+1h2+MIvixVHBnAFppJS5Ohs1zdqLEYAGBEQFzPSvMF4WNTxJG2x0bS8nn5TtvjB1KWsnu0s8uQ0HcP+2/R+h2NObbHQVxJVkCcmC1QmLUXFFUKk1ZjMbxRtKHdqLo9YX735/nGkbbCl/J/sp0sCZjc0YEJIdwAg9VUpKqt13WQFPV77ZEOo/qVUTeiz7zkoqr+aFtRsaqOACJVEhUvDGUTrFpda76ihgLKRFpeL/wjRhCSLolGn4lhV8KVPxzLjdVyY3VOx4+xwokTg24L43e7JIthGIYNNEJWsJAVjEYdfFN+lcE64FqmCljBBBC0Re5iNv5APnBVa9rREJ1UcT9NYoo4DA1h/sEgGJ7VGjNdZZClbE8S7v2fmB6qAtz4/cudduH3WIcbueBwT3uX91SqakZDPSSJQwno110riCtymXBv9nTRVHzExrArZeXUETGhUjSKDSQ6q3F97VEAYBCMl0feMC9stOMoSZFFqrr9LeezZamOcZvsoNTsoK64xqK3J9xXR09182Rpc/0JW7adRTAfT79qReQkxqUTGytFrq87uq5sB0mRX1XsSRFFTgvxcV6uSd/5WuHvtmz7qujJDyQvFbIuX33f3XTuzeINJtKyryVvrCzxqij6DkhH2goBIF4Y+vLIG+2XHwCgWFX3dN63nSaNhbJ+W7XvzdG324cw7ApyUarTj6ha7emNtQ/vb/qvifTLGTaGYRg2nLEZvHD+SDQKAAAJouloCBswqjRuNfxJdK8xsfekHIHAdwWwmBNiNxqPeEbot++MuSNRHIKGeihSNKAhX8jvvHwTem9iBD7rAFviRsI90qMVBbzhsucSAOitJqVHNxngIzaGXSnXzMyakIoLewe0Gm2rkTQDQKo4Esm2AwCDYIwMiHs0deWUYN+vKa23mj4v32V7/GT61VdFTbZn2wGASTCuj535cMoy25fvl2z1eZe8zyt2ai0GAJgTlvVU+mrHbDsALIoYd3/yEtvjbyv3ObllUMzmfzDuXsdsOwBkSGIeSV1he3y6o9TJ0zGsPw2chLsNVaLa80f13Z0mt1a3xzAMwzD3TQ65m0Ggt3ZlBa4J4aUgQWzgqHfVkAEAuAxWEBe999Z/wnk+K4DFnPBhZw9HXAbL8UMm1v8yAyJd1nSfk1ejIV/Ic7WeJwGED3PB7lS4+7Cg3k0c9xak9ayrDz5iYxiG9YZ1qfdLq0FpcmP9cB/a1XRWY9EDQLwwdHnURHQYAACuiZkWzgsEgGZD58HWfHTYC3KT+u+WC7bH9sQ6YmXUZB6TAwDtRlWOvAwdvuS62BlBXJqVeGaHjrL9es2kpU7n1qVfDPM3NO8wEKjMTVtqH1sZ824QNxEdwzAMwzBPRfCzrop5/2zHD836IgtlDOTEZgWuyQhYim6HDSQdJhetDwAgnC91mb/zoXB+QKV7VZwDgYm0dBg1bQZ1u1GjtRg1FqPOYtRajAar2Wg1G0iL0Wo2WC1G0mx7YCItBqvZSJqNVovBaka/XT/iMlzX4XrAT3n8K2twzbKQxY0XBTsvha7XdTbqFJE+bW7eYlC5bHiSLA4NcGMVWTe50wn9u4qj31UcRaMDgNGjHQMfsTEMw3qTKAqXcoQKk1ZuUv8j75un0q+OEbi+5csnzlxKYc8OzertCMwgGLNDR9lazJ/qKOlZg++xs/JyW8l8kig8ih+EDgMAAI/JThFH5iuqASBPUdlbmf/s0Cw0BAAAbAYrmCuxLceqMuOeGdiA4MuEe2bAMoJuOSmKIk2k1kTqjFZ1p6nGnY4xeqtie8Nza+M+5zOl6BiGYRiGeSqCP3J59FtoFBvA5EbXPZdDeGI05E+eLbnZP9RmQ4GioUTVVK1tr9a012jb3fkFDkxcpi9PU+1YdCerg8sQmOWZYWnOE+4A8Ev1yacyF6NRL/xSdQIN9TApOAkNeaHNMOCWM3GfZ1di3NkV8REbw7DhiUkwHkpZ/nrh7wBwVl5+04l3JgWlrYjMnhKcwXbv3iOPlajqbQ9SuzdjQaRKomwPCpUubgjrkyJVVz+3RJGzFbODOV3vDi0GRbeBSzgMVmzvlyg4jK7zRguFW8pgA4IvP8nMCHuESbgsGqKUpsYWQ3Gpak+dNod28Tobjbn1YPM7S6JeQwcwDMMwDBs25K4W9wMAH1akukPSvz/OJa3FeKKt/GhbWa68pkbT4eTkanCxf3DyLebgTLgPsVleGpn1vauy7o21Z+5NmeWrPzedxbShJgeN9rAkahQa8kKbQY2GBg+jR+0O8BEbwzDMiSUR43kM9vslW+QmDUlRJ9ovnmi/KGELFoWPuyp6crzQZz3NEJ2Xbj+i7cdiF3Qp5W3f3ifkxq53w73NuXubc7sP0lD3UqIu5YhwV0BsEPHLJxmniABOVAAnKlUyX2NpO9H2eZlqP7rJJVWaYzXaU3HCSegAhmEYhmHDgzsL9wVw+jWfImZ3W+jpSjFazfuai/6qzz3dXuXzta0GAqZ/PlMxBlXCfajOcnpARKI4tFLdig440FlMbxXueG3MGnTAI28X7dBYDGi0uwRRyEipz5YcVJn1nuWsBwiK8uSiDj5iYxiGOTcnLGtycPrW+pMb64816btaoKyvO7qh7tis0JEPpSyP4Aeiz/EOSZH2lvHO+/XxmV0VtLYFTn3F5fsvwtLLCQ/P6YvHsIGm/xPul4lYIQsiXkgRz93b9JqZpD85O9vxI064YxiGYdiw5c6iUiJWv+ZTBJc+jVwpbQb195VHN9We1VqM6NgQQvgn4T5YDPlZviNp+ot5m9Bod3/V52UGRN6YMAUd6KOtdbmbas+i0R7uTJ6BhrwwVCfOOXzExjAMc4nP5FwfN/O6uBlnOsp2NOYcbiswkRYKqIOt+WfkZW+Mvm1soC/7mzEIBo/JtjUKM5LO2oXprSbbA6FPD9T2PH66JDozILb7II04gb8q/TGsP13JhLtNvGjqkqh/b6t/lqRozs+a9YXtxvJgbjI6gGEYhmHYMOBO+sbfjS8RrP79cY5UZv0nJfs31Z5159cy2DFhMJWi+9AwmeXlUaO/KT/ispP7O0W7rBR1S+JUdMBtG2tz3ijYjkZ7iBMGL4vy2QJx4GkP9MHOnZ12+ByxMQzDnCCAyA5KzQ5KVZp1W+pP/FpzSGMxaC2GFy78+Pu0Z317bTKQI27SywGg3ehscRH7qIwj6j7ilcBL3y1DEvNE2qpuYxg2dA2ITzLRgvFTQu5Do5dUqA+iIQzDMAzDhgeT1fXCR/2cT7lSq27+WZ+74u///VZ9yp2U1hAwPAvch88sMwjG/6XPR6M9WCnynaKdj+f82n6pA6z7lGb9y+c3v3phq8tfJgHES1krfdvf3+UPHZLwERvDMKyvAtiC2xLmfZX9qIQtAAClWXekrRDdyDsjJF115SXqrtVTaZWqG2wP0iUx3Ue8knHpu5WrG7uPYNhQNlDOP0ZJV0nY9AsW12ld3wGKYRiGYdiQZKbcSN/0bz6ln7NFAKC3mp7P3fBi3iaFiX4VKWwIGIazPC88c0lUFhqlc6C5aPH+d1/I21ioaHBnwdhqTfsbBdsX7nt7S905dIzOdfHZE4IS0Kh3jNbhmHDHR2wMwzDPRAuC5oePsT1u1Hd0G+uORVzuVKFzrz36lOB024O/W/J7exslKfJQa4Ht8URZSvdBr0wMSrGtoFOoqmtw+k/DsKHkyreUsWEQrNGB1xxp/QgdAGg3llspM5PAyyNgGIZh2LDDIhguGyGTHi3u5zEC+rX0Wm7U3nfqu1JVMzrgKQmbL+XwRSyeiM0Tsbh8JofPZPNZHD6T0/V/JlvA5PBZnHqd3J1eHJj3hu0svzBqRZ68tkmvQAd6MJPWv+rz/qrPE7N5WdKYUYHRIVyxmM2TsPlMgqG2GFQmfadJW6RszJXX9qkcfrws/h8jlqBRzCP4iI1hGOYx+1KlEpag+0g3PCabx+QYrCYAKNc0B3El6BY9zA0bva58R4dRVadr21J/8upomsVRNtQdazZ0AoCMI54b5sseayHcgPlho/c055IU+VbxxnfH3sUi8KVQbOgbKAl3AIgRZqMhAAAgKYva3CzleHtLi8bc2mYsazeWtxvKtZZ2I6k2WjUmUgsATILFZgj5zAAhK0TKiQ7iJoXzMwM5cei3uBIoIBt15+t1ZzuMVZ2mWqNVbSZ1FFBsBp/LEEnYkQGcqBBeSgR/VCAnFvAJJUZnUOz8FJAt+uI6XU6HsUJhqtNZOs2knqQsLAaHwxAKWSFSTkwILzVGMF7G9XENWk8W0livO1evO9thrFSaGoykxkIaWAwehyEI4ETJOAnRwnExgvFsBnomxPDzQXVQTCXmJts+32Gs6DBWyo1VeqvSRGrNpM5MGlgMLpvBZzP4HIZQwo6UcqKk7JhAblwwN4Xht9PTTlNtfufmBt05taUFAARMWRgvI0kyO0E03Um2QmVuKlBsrdOeUZubScoqYMnE7PB40ZQk8WwRKwTd2iPudPs1k65rKgepdqPmnhPfVLrqc90bGVeYLolIl0TECoNihEFRAmkQV8RhuHukypXXoCHMD4bzLItYvHcnXH/PiW/dX2JUbTYcays71laGDngkVRL+3oQb/PHJn8t0q1qIy2Qzej/GXkG2asS+GuZHbAzDMCe+r9rfqJfPCxs9JjAReZsmKWpX09l9zXm2LycGpTqO9pQljT/dUQoAn5fvTBNHSTlCdIvu2AzmY2lXvXjhRwD4X8lWiqJWRU9hXGreR1LkxrrjH5d1XX1/OHW5OwfzPrk/eclpeanCpD0rL38457OHUpaNksY7bmCwmguU1cfai3UWw3OZ1zoOYdgg5e65eD+QcqJFrFCNpRUdAFCbWzxLuJOUtVF/vkpzrEpzVGOm+c42JGUxkwadpaPDWFmrPWULitlhSeLZI6VX9dbrxgNmUv9l2VIkeEPCd7RJMYNVmSf/o0i5zWClWdfCaFUbrWqVuale19VyR8AKTBBNTxLPjhaM675t/6MONr9XpNyGhgEAYKT0qplhjw6iawOFij8PtbyPRgHmhD+dEeDjeqjT7d/kdPyIRgEWRf4rSTwTjTo1EHb+UtXefU3/cYzIuAnXx3/jGAEAvVVR0LmlULlNZ6G5v8xMGsykQWvpaDVcLFXtBQApJ3qEdOWIgJUsBhfd2mtaS0eu/JeLyt22LLYjM6kzkzqtpb1Rd75AsYXF4KaK54+RXS/lRNu34fRIwXtvIEzlYLG9/rka7Uk06oYH0/5GQ/7UpM8vU+2vUB/SWxXoGAAAmEm9mdTbHrcZSu1xNkMQyR8VJRgXJ5pE+8bRm3Zj+R/V9zhGro//VsaNtz2mgDrT/u3Zjp8pIO0bqMgmlbmpTH0gmJu8IPKFnj+OAvJM+/fn5D+TDg0EVOYmlbmpQZd7ou3zCUG3jQ+6ifC6eZ07eUOLG00MfKjfyjNNpOWRMz/1NQ/LYbCmh6ZMC03NDkqMFcrQYWyAwbM8IiDqs0m33X/qe/dz7r6SERD52aTbpBzfv3cDAI/p+tgFAJ9OunW8LB6NDlrD+YiNYRjmnM5q3N54ZnvjGQ6DlSAKj+YHiVh8Cii5SV2squ+4tGDpVVGT44Wh3Z+KuiZmmi3hXqpuuP74W2MCE4I4EiNpVlv0bQblmpipyyInIk+ZEzrq1oS5P1QdsFLkeyVbvqvaP1oaL2YL1GbdeUWV3KSxbXZt7IyF4WO7PxUAQG7SqMxa27Kutv/b1wY/1Jpfr2sXsngiFk/A4opY/FBeAHIlO5QnfT3r1mfyvtVYDAXKmgdy1gWwhTGCYB6TY7Sa2k3qFkOn7XA9NTjD8YkYNni5PiXqT2I2fcLdQNJknJ3rNNVc6NxUrv7baO3DLaWO1OaWPPnv5+V/pAcsnhxyL58pRbfwEY25rWcio0Cx9UTbZ2bSrYZcNjpLZ6HiL7mxKjr2yibcqUMt7/eWbc8KXDM99GE0OrAlS+Yebf3ESpmQeKlqj68T7lSpah8aA+AxJQmiqWi0dwN551eYaq2UiUlw7JECxdZTbV8Zya43eHcoTPXHWtflyf+YGfZogmg6OuwpCqhc+a9nO3508+/OQhqLlNsvqnZnBa6ZFHyXre0Vi8FlEmwr1XXy4aWBPJWYZ9qNFcdb19Xr3Oop3JOZ1NVoT9VoTx1v+zSUl54esChFPI/LFKPbuaHdWH4p4U4daH6zRLm7+/hl7cbyTbX/d1XMe8HcZHuQpKx7m15zsqo5SVlPt3/TaiheEvW6kwJ5d3DcKLHRW9FDtF/12497s3BHoaJr9Sp3xIuCb0qYsixqtJDl++uRmJ/gWQaArMCYzyff/kTOr62GPp/ze2xJVNYrWat47tWhe4DLcOs76/r9MoNfDecjNoZhmHP29wUTaSlR1Zeo6ruPA4NgXBMz7eGUZUi8p6nBGXckzv+2ch8AaCz6o21FjqP21jSIe5MWh3ADPi3bobMa5Sb13635jqM8JufupIXXx9LX+T17/rsiZS0aBQCAX2oOIZF1Ex7M6l7ADgCjpQlfZP/f64W/FyprAUBp1iqVaIkbAAS70SFnkCo6XfHxs781VbfFZ0Q9+u5N8emR6BaDx6m9+a/c8qn9y69P/CsywTc3Nw8lAyvhzuslGWQh3T8Tpao1J/MVm+q0OeiIRyigipU7a7SnF0W+EsEfiQ77gtbSrabJQhr3NL1arTnuGHRfnHAyGupX1KGW/xUq/kLDAAAwVnb9lJD70OiAx2WIEkTTytVoAWyD7rzG3Cpiu7j47L4mfYHK3IRGAVIk8xgO66L0bhDs/CRl7TBWhfLSAMBMGg40v1GhRt+e3aS1tO9seHGM7LqpIfd5f8OE0are1fhygy4XHXCFpCx58t8bdOcWR/5bzA4DAD5Tqun+R913g2Aqsb4iKeuJts8vdG7obZ2ivmo1XGw1XGzQnV8U+TI65oYOYwXAfADIlf/uJNtuY7SqdzT884b4b+1tlI61rXOSbber1pw42faFl0d+EZuHhnpQmek/V/hJ/6RvzsqrN9ScQaO9COQIH0lfsCpmnP3uYGxQwLNsN0oavX7mQy+f33yw5SI65mtiNu+xjEXXxE5AB3xK7MaxCwC0lv44nvSbYXvExjAMc+nOxAVjAhOPtxdfVNU36eVKs85EWpgEQ8zixQpDR0sTFkWMixW4m7W8K3Fhtix1S8PJfEV1u1FFASVk8YK5kiRRxMgAtKDT7uroKbNCR/3VcOp4e3G9rkNrMYjZ/Gh+0OTg9BVR2TKOJ3U87osVhHw+8eEcedmh1oLziqp2o0pjMXAYLBlHFCsIzZLGTwvJTBKFo08bEiiKevPBb1vr5QBw8WzVR0//+u6fT6IbYUOLO1m8/uN9NwaSsh5qeVdL15jCGzpLx7b6fyyPftsfuSrH3JyR1Gyvf7ZZX+gw3jdxoiloqP9Qh1s+KFT8iYYBAGBC0C3ZwXei0UEiPWBxz4Q7AFWi2js+6CY07KkS1R40BAAA6ZLFaIjOYNn5243lobw0K2Xa0fBcgy4PHe6jPPnvJGWeHvp/6EBf6K2KP+ue7DBWogNuazOUba595KqY9wI4UTyvE+6DZSox91kp886GF+2tfnwoM8B1CQytdmM5AChNDafav0bH6GjMrafbv50W+hAA1GhP5nduQrfoRa789xTJPMfq+L4K4ojQUA9Kkw4N+ZP+0i20/kNSlPvrWI6Txb09/rpgrn8/I2E+h2cZIeUIPph4086GC5+XHazqY48dNzEJxoroMY+kLwjiuj6weEnI4gpZXJd9cuTGPtzkN/ANzyM2hmGYm8YFJo0LTEKjnholjUc6obtDxhHdljDvtoR56IBTX0x8GA15aoIsZYIsBY32boIs5ej8t9BoD79M/QcaGkg6W1W2bLtNaW4NRVIEYwiWUGB23nZW9a2eTZNt3O/UzCBYWYHXoFFfMJOG3Y0v6yyd6IDX7Lk5K2X2MtsuYocGcRPRaH853PJBgWIrGgUAgOzgOwdvth0AYoQThKwgNApQ2kuK3ANWylyhOohGAWTchBCeiyVTbAbLzt9uKAeA/U3/9T7bbnOhc9NF5S406jYLZdxe/5w32XYbjaX1z/on9VaFgBWIjvXRYJlKzH0Hmt7wR7Zdwo6IEY5Ho+6x/SWebP+KpCzoWC8KFX/prQorZT7a8hE65gyVJ/8djfWFjCtEQz3ITfTnD37SDwmyI60lpapmNEpnemjqZ5NvH9p52KEKzzKtJVFZm2b930NpfUsEuCRm866Lz/5rzmP/Gn11P2TbbSL4UjTUQ5NeiYYGs+F5xMYwDMMw54jutycyGF423cQGgYFV4U67OigAcBl9+IAxQrribMePJpK+dILDEARxk0N4KWJ2GJch5jElBMEwWtU6S2er4WKT/oKTqlKdRX6i/fN54c+iA97RmrsS7gea3+wt2x7AiRYwZTymhMcUW0ijkdQoTHUqczN0b00QL7xi5e1Osu1TQu4bK7sejQ4qBDBSJQtz5b8i8U5TbauhxNYgxUvVmhO0fczdLG+3GRQ7f4exvFi5s1x9EB0AELKCogTjgriJEnY4m8G3UhaDVaU2NzfoclsMxU7SgkdbP44VTvIs032o+b1WQ693rxPAiBRkRQnGBnCiuQwRSVlNpEZlbmrRFzXqzyPd3tXmll0NLyF/lZ4ZFFM5AM2PeF5raddblQar0mBVGS49uBRR6ixyC+Wi2NDnSlR7ytQH0OglbAYvgj86iJsQwI7iMkUsBg+AMFrVJlKjMbd1GCs7jJW0q5sAwAjpCo/7KemtiiZ9QeWlnk5idnhGwJJATiwANOjOFyt39Fy4wkIZy1UHGARbaW60ByP4WUnimWJ2uJnU1WhOlqn/7vknUKE+PCvsSTbDdZ8BWu6kxpp0CjTkTx3+T9/8Wn0SDdFJEoe+M/46rhurFHrGRFrREOY7eJZpkRT1a/XJr8sPowMeCeaKJ4ckzQ5LnxWW5s56nr4Vzg8oV7eg0e6ah1bCfXgesTEMwzDMOWmIODw2qLm263N61rQUJAWPDT39fd7pnNbSjoYAAMDWGdlNHIYwU7rCsZ6OACKcPyJeNC1eNCWQE+skPUEBVak+ktPxfW/lriXKPROCbg1g+3JxA1uFe4Fia5lqv2OcACJJPCtBND1KMI42k2gm9S2GohrNqWrtCaWpHgDiRJPRjfrFkdYPCxRb0CgAAEwPfTgrcA0aHYTSAxb3TLgDQIlqj08S7rTF8gyCmSpZgEZ7Nyh2/iZ9QZO+AAlG8LMmBN0SLRzfy3XeO7SW9rMdPxcq/qSARAcBTKQ2V/6LrdlFn1RpjvXWyQcA0gMWTwy6vbfjj5nUl6h253T84Fgw3qTvtvKMxwbFVA5AXKbY+Qqix9s+zZP/gUb9iaSsp9roe7YEcKInBt2aLJ7jcpEGvVVRp82p056p053VXbqawiBY6d6t2/xn3RO2hvIjpCtmhj1GXLrpLUk8Oz1g0Z91T/W87axYuct8KcgkOAsiX0gUzbCPpkoWxCqz9ze/YY/YWClTg+5cfF8Wf3bkTomo0qzXWUwC1uUFmf2q3c/pG4VJd6qd/u/XEYMgXh+zhs/047/agHsf+w2eZVpKs/65c+uPtZWhA5ewCObMsLR2o7rNoFabDQar2UqRBEFwGEwugyVh84N54lCeJFYoSxWHp0rC40XB6LfoR7FCmvsjEeUa+kuqg9QwPGL3yU+Hzr29uetSt6M9r9wTJnV9rQJzR15V4+e7T+bXNBtMlohA8cKxqfcunMRluzjX8obOaJ7yzMdo1A3zR6e8e8dyNDpQtSg0C1/5Eo0CPLFy5m1zPbzh0rn+n0oM8x+CIP7xyR0fP/NrU3Vb5sSkR97xWWtibMAaQEcrraWDdsVIBsGSsMPRqFOjA6+50LmRpCyBnLhM6fI0yQIeMwDdiA4BRJJ4Zrxo8qGW/11U7kSHAQCoIsVfXq7/htBY2pSm+uNtnzoGk8Qzs4PvDOT0utgFALAZ/GjB+GjB+GnwYLO+sES1O0owFt3I/460fpTfuRmNAgAQs8IeGyFdiYYHp0BObBgvo8VQjMTLVQemhTzIIJhIvE8MVlUNXbuJWGE27bUWJwbXzg8ATII9I/SRTKmLc00hK3hm2KNxokl7Gl81k3p0GKBIuT07+K4+ldBaKfORlg/RKAAAsAju/Ih/JoovZxJ7YjP4I6WrUsTz9jW9Tjt9Xhp0U4nRqtWeoq1PjxNOWhj5MpvBRwfo8JnSVMn8VMl8AKpRn1+q3FuhORQtGM/vZaVxN1kpMwDEi6bMCnsCGQrlpU8Jue9Qy3tIvN14OQu2IKJbtt0mLWBRleZYpeYIEm/S53uccHczX1atbc8M6KfLSHXayx0Y/eFYWxlJoTcK9LQkMivDz/9kjav205jH8Cz3VKeT33fyuwZdr33PRgfGvDL66kSRuwvKXXHuHJSqNe1Gq5nLZKMDg9MwPGJjA8rZioZ7122wWLsKdGrbFV/tPV1Y1/LpfatxLenggqcSG3oyJyauO/BPNIoNXQMo4d6gO4eGAAAgmJvMJPpWASFkBU8PfTiQExclGIOOuYFJcOaE/0NvkdMm0ao0x3ybqDJa1X/VP20huz7tEMCYEfbISOlV3bdyIZw/Ipw/Ao3639HWj2iXziOAmB3+jwzvqi8HmvSAxT0T7nqrolZ7Ot67tWrL1X/T9ktJ60s/GZvBtfMzCfby6Dfdv1AUJ5w8P+KfOxteQAcAzKS+WnMsRdKHlq8Fii20mVACiIWRL7s5p1ymeEnU67saX6rWHEfHvDO4phLrTa32NBoCELBkCyJfcjPb3h0Ryc+K5GfNpB6lbULVVwyC2duaw5nSZWc6vrcX1CPiRVN6uyKVKV3WM+FuW6PVMwnuJddKlE39k75pM6j1fq4IPttRjYboXB8/CQ35WmP/dn4YVvAsI2q07Xed+KbNoEYHLrklcdrjGQuZxMBagMo5dw5KJEUWK5vGyGLRgcFpGB6xsQHlw21H7SlauxMXa06V1U5OHSJ/ZcMEnkoMwwa7AXTOelG5Gw0BAIBnyaaR0qs8e6INAcTciGdZBBcdAFCY6ny+5KC9tJ9BMJdG/6ev2fYr5VjrJxfos+2MeRHPDbFsOwAkS+bSXvuh7QbTJ7RdTXhMSYJHBaGDaOefHf6U+9l2mwTRtFTJfDQKAL1kNntDAXlevh6NAgDAWNkNbmbbbRgEc0HEP3vrPOONQTSVWG9oE81pkoUchgCN9gWDYHlZ3m4TLRgvYUegUQAAIICRIp6DRi8ZK7sBDV0SLRjf86afTlMtEnFfGE8iZNHsxogSVdc7qb+Vq2ku1PlWhRstJoK5oqzAGDTqaw16fKDwFzzLjtRmw8Onf3SSbX8iY9FTmYsHV7YdABJEIe60AzreTvNOMUgNwyM2NnDojOYL1fS71qkSz89DsP6HpxLDsCFgoJy2Nuov1OvOolEAAEgSz0JD/YLPlPbWHpc2geIT2cF3xgn9Xsrkjl5aaV92rHXd+c4NaNSWfIx8sU+dxwcLLkOUIJqGRgGqNMd7djp2n9LU0KIvQqMAKZJ5Ljs7+0n/7PwJomlpkoVo1A1jZNehIQDoY//0Ks0x2/IJCCEreELwrWjUFTZDMDXkATQ6APTPVGJO6Cw0d7LLuAlo6AqJEU5EQw4i+FloCAAABCxZBH8kGr2EQbCkHLTySGtut/WL94w7hZBn5TVoyD8KFPVoyNeqNfRL2jgaJ4tHQ35QpGhAQ5iP4Fl29NL5zbW99/24KWHKbUnT0ehgwCCICUHxaLSH46299qwfjIbbERsbONpV2t5adbUoer2ehw1AeCoxDBsCrkw6D2EmdUdaPkCjAAAQyIkL5aWj0f6SIJpGuxaomq7XvPeiBGPH9V4z2M9oq2LtjrWuO99JUx3MIFgLI1/q2dV3yEgPWFKu/hsJWilTufpgZsAyJO4m2vJ2AEiX0OdJ+4e/d34CiMkh96JR9wRzk4O5yT3zxSpzs5nUsd0rHC5THUBDAAAwRnat852/N4nimVJOtMI04D7X+XsqMedIyoqGBhLn77AhvFQ0BAAAkfzR4PSibAA7Um6scoxQQOotnQKWzDHovrGyuDMd3b5hT2WqFoVJJ+W4dQTwRr6f0zcUUEqTHo32kCB2q2+DN3QWEy4O9RM8y46OtJYeaKapPLCJEwY/luHJ5fkBYnZY+pHWUjTaXb6ivk4njxF4eIQcaIbVERsbLAiGs/MWLwm47L3/uqdTo+/U6hW2/3c9MHRqdAqtvlNraFdpekkgY33j16nEMAzzoSufcCcpy67GlzuMlegAAABc2QR0OH8EAQwK0N5h2l562nopO/hO5ymM/uQka3m87VPabDuTYC+OejVOOBkdGEJihBOErGCtBa1KK1Xu8TjhXqrai4YAgriJIbwUNNqP/L3zxwonBfaogXVfOH9Ez4Q7AKUyNwdxE9FwD1bKTNt/hkGweqsHd4kAIlWy8HT7N+jAlebvqcSc4zHFPZcK6DBWIJErReZ0aW4hK5gAomdleigvDYkg+Eya1Z6NpFoAHqaTxsqcvU4bCqijraXLo8egAz5loaw5rhJJXtJZTD1/5z0FcURoyNeOtZVZKfTQgfkEnmVHn5WipQyO7kqeyWFc+Q8sHpsVlv5a/l8up/vPutyH0vqwDs1ANqyO2NiAEhIgZBAEbWV0pEyChnwqNEAUGuDsiD3rn58qtAY0ivXiCk4lNlRZzNbVSY+bTRYAEIh5G8veQ7cAAIBt3x3+5Nnf7F/e8PiSW59Z4TB+2T3T/lVf0QIALDZzU8X7bE63c5UDG06//fB3jhHEzKvGP/f5XWi0d52tqhuznrU9Xnnn7Af+c63tMUVSp/cVHN+RV3q+prVebtCZ+CKuWCpMyIgcOTll3tpJAUHODk20OpoUR/46d2pvfnNth7xFyeGygyOk8RmRs1ZNmDA3k8VmAQCb7cm5GUVShWcqzh4ounCiTN6sUHZoKIqShkiCw6VjZ6ZPWjgqaVSvrRT7eQZ9wvffsU+Upob9zf9t1heiAwAAEMxNSg24kp1J2Aw+jynRWxVI3EIZkYj3QnlpTu7Q738cphANAQDA8bbP8uR/oFEAFsFdEvVajHACOjC0EECkSRaek/+CxBv1+Wpzs5gdjsRdatIX2Dv4O0oP6PNyqb7l750/LWARGuqLkF7yfTqL3J2Ee4u+yEzq0ChAjGA8l9HnNyS7RNH0AZhw9/dUYs6J2eHtPdLrJco942U3c5liJN7POAyh89fAIJh8lqznuqk9O8YgeKwANARgJl3X8/ZmdGAMm8E0ky5uF9jZmO/v9M25jhqtxb9/OybSgobo8FlsNORr+5roT88w7+FZtitVNTtp+sEkGPMjMtHooBLCE48KjL7QWYcOdLeh9sxdyTN5TL/PeD8YVkdsbEDhc9ijEyJzK2naZM0dlYyGsAEMTyXmcyw2Mz4jqux8DQDo1IaWuo6wmCB0I4CiM91KgS+epb9qa9SbGqq6aqri0yP9kat1orasK4NUnFP5vyd+ri3tllDSKvVapb65pv3Ergvfv/Hn6vvn3fKP5QymW+3EzSbLHx/u/v3D3ba8to3JYNYoddUXGw9uzomID3nig1tGTkoWB/ZaodubnAOF37y2paoI/bturmlvrmkvOFX+49vbxsxIu+eVNYkjopFtYHDOoFu/dH9oN5Ydannv1+rbe8u2MwjmrLAniCv3Cm14TJorqFbKhIa8luFpfbSf0C7od6Lt8zz572gUgM3gLYv+75DPttv0kgqnSugK1V2iXXCVQTAHQhN8/+38BDBinXaOdknAoqmfBQA3m+k36wvQEAAARHu3D8u48T5Zx9Ln/DeVmEu0bdD1VsXeptev+DUPISsYDfXAZvDREIDLJYKZBE3OyJtdTsjiZge5vpZ2oq283ejfzp7bG86jIV9zs5hXbzGjIZ9qN6r3997lA/MSnmW7k+3oJUlHscIgd1bgHOCuiXV9ziM3atfX0Nx7NxgNqyM2NtA8snwaq0de6aZZYzOiQ5EgNsDhqcR8LnXM5Zqhnmlfm6LT3U5LSnKrKZLmTovq4kZ7PGUMzX1dfu19VFfWDABHt+U+ffX7SLYdYTKYf/vfrpdvWWe1uL6d0ag3PX/thz+9s90x245oqm57etX72747LJH1oU7RaiE/ePLnF2/8pLdfu13ekZKHF/x3y5f09z725wz6BHoI8zkKKCtlMliVnabaOm1OgWLLgeY3f6y84Y/qewsVf5FUrxM5JeS+MP6VL2lhMXhoCICiu7nJSxH8UWjoiuIw0Ar3E21f5Mov35phx2YIlke/FSUYiw4MUVJODO2eSZs6d46kLOXqg2gUIFY4aSDkbf238wdxE3vuYH3C6aUO3c2MXquxBA0BAIDXd5kQV7YRUG/8N5WYSwni6bRrUNdqT22qebjFUIwO9CM+S4qGemARHDQEIGTRVBM4YtLdP+dlO/t5blS5Winyl6qTaNR39FbTXv+XA7tZ4qo009ym40M/VZ5wWaCKeQzPsl2RshENORCwaA5Bg87iqFEBbJqLl4gvyg51GDVodHAaPkdsbKAZlxj19cNrp6bHiXhcNpOZGhn8yvULnr56NrodNuDhqcR8LjnLRbpW3qJsqet2a69Obagta3aM2FQUXL5xLXU0Tbp2zuqJW6s/+P7sax/tfe713/7v6XV33P/a2qAIKbqdRzqalReOl775wLcWc9dZHJvDShoVM35O5ujpaeGx6Ce1nANF37/xJxJEkFby5Vs+LThZ7hhkc1gpWbET5o7IzE6yv3iKotY9//vZv92t2LCYra/c+umun485BpksRkJm1LhZGaOnp8WmRjhen6BI6vMX13/z780Om3fpzxn0CZqPxB77vNSrHhGOsgJXjw5ci0aHLi5DJOP6a449g1S4n27/Jlf+q2PEhsMQroh+izYBPYSlSxa36NHji8JU32q46HwFQkS15oTRSlPaky6hLaIfOrzPSrPpMsjgdkav01iLhgAIIGScBDTaRzJuQq32DBrFhrEAdmS8aFqV5ig6ANBuLN9Y82C8aOo42Y3h/BHosP+500CJQfQ8TyCcN6IB+mdBz4UE+mROWMbrxF8um02vrzlze9J0iRu5LQ/8UX26H7oTMAmGhM1XmV104Gkz0Lx9+Eq9rvPnqhNoFPMdPMt2cqcp5ma9Eg0NQlwG6+rY8d9V0LwROFKZ9f8t2PbO+OvRgUFo+ByxsQFoTELkp/evRqPYIISnEvMtx7wqbbrW3o0kPiOypbZDrzUCwMWzVXFpEd22A6gsrLc/ThlN32yTw2OHRslCoy4vYbX/j1MdTYrLW3jhxRs+sZgtABAWE3TbcyunLB7NE1yuUaivaPnm35tP7Lpgj2z+/MCqe+bIwgLsEcSfXx88f/RyVSKHx7716RWLb54mlFx+j66+2PjrezsP/3mWIqmPnqZJD9L67j9bcw5cvv4dGCK55enlM1eOFwZc/s7KDs2BDad/fm+7Vtl1brz+k71xaZHzrp1k3wb6fQa95/cKdw+MlV0/PfT/0OiQFsxLGTjLpdo4FiAXKv7M6fjRYbALlym+Kua94ZZtB4AUyVwmXdXnReVuNORUCV1RPI8piRdNQaNDSwCHpidXv6GAUpppjs4idiiL4e1962JWn/v4Y0Pe1JD7nexa1Zrjm2of3lDzQIlqj5u3aPiKZzeasBncK9LtTcYVzgnPQKM9qMz6dSX70agvaC3G7ypd5Mt8JYIvRUM95Mpr0JCPkBT16oUtbjYZxzyGZ9nGeYl9h1Fzos1Zz5nB4vak6e70xtnbVPhT1XE0OggNqyM2hmEYNijEpUdyuF23GFYX09xgV3Sm65Qjc2JS0sgY22PaJuCVhV35BDaHFZce2X2wP5iMZgAYOSn504MvzFk90THbDgDRSWEvfnvfvLWXs9UWs2X3L72eYCja1T+8+Zf9Sw6X/caGR9c8ON8x2w4A8emRz31x190v9+Ey2PmjJZs+u/xGH58R+dmhF5bcMt0x2w4AAUGiq++b++nfL4THXW55+vGzvzZWtTlsNfhmkKYG7QriMISzwp9IEc9FB3yJ0ljaFKY6tblFa2nXWxUmq9ZE6iyUwUIaLZTRQhqtlMn2wEIZnTS98SHaDstXEJNg2+sTqzXHD7d80H0cAIDPlK6IeSeYm4QODAMchjBRNL1MfQCJl6sPTA99iLa0syejVV2jpbmRNkUy383v0HcDZecXs8LQUD8yWJW0/zSRL16ViN0/XQUHylRi7gjgRM0IfeTv5rfRAQethov7m/57tPXjVMn8dMkS7+8CcQfthUOXWAT9/SX94Ib4Se4s8Ph7zZklUaNHB3adY/nKe8W75UYtGvWPeFFwiaoJjXZXrm6VG7UyridXTZz7vOzvU+1d5SGY/+BZthG7qm7+14UtP067N4Tn4saaAS6QI7wjacbHJfvQgR7eLdodyQ+c60a2eoAbPkdsDMMwbFCwtTEpya0GgIaqVpPRbM/e2hSd7jo1ShoZzeWzC06VA126lqKo6uKudG3iyGgWm9l9vJ8Ehkhe+fEBvpD+cj5BEA+8fu3xHXm2Km8AuHC89IbHl3Tfqsv+9afsmwHA7c9flTGh17VY1jwwP/9E2ak9+egAnZ/f3WHvZMsX8V775WEnzd9DIgNf++Xh+2e/ZiveN+hMv76/88kPb7VvMOhm0E95vT4jgEiRzJsa8oCAdfmGC1+hgGrVF9doTzXrC1oNF02kfxtieoDLGFifIuxlj62Gi3uaXu3ZB0DAClwZ/Z6MG4/Eh4+0gMU9E+4Gq6pWezpeNBWJ0ypTH6BNg/q2n8zA3Pl5zF5vZeoHeksnGgKA3hdi7ROeq1YbHhuYU4m5KSNgqZUyH239yHnXI6NVnd+5Ob9zs4wbny5ZnBawyK/LOTAZniTcCcJfZyQuTQhKSBGHlalb0IHuSIp85tzvv814UMrp1hvNGweaizbW5KBRvxkljdrd6OIslgJqQ+2Ze1NmowPe2Vib81np32gU8wM8yzaxQrTTKKJJr7jm8MePZyxaGpXl5mKzA9OtiVPX15xuMajQge5Iinzq7G+vj1mzJCoLHfOzSnUrj8mJFEjRAY8MnyM2hmEYNlgkj461pWtJK1lT0pTi0BPcZDDb+3onZ8XyRV01RjWlTXqNwf4lADRWtdnT0/5r/+3SLU8vRyrQEUIJP3vBqENbut4Qyy7QtNW12ffH5UrQwBDJ8jtmOgzSuPkfy91JuFfk1+WfKLN/ee3DC112sY9KCr3qntkb13UVKBzcfObWZ1eERF5O1AyuGbwCd4UjOAxBZsDyGxK+nx/xT59n21XmphNtX3xfsXZj7UM5HT/U684NzCwVl9nrRZ4rwtbAXWlq2F7/nIW8fKXLjqSsnmVqhowY4QQh6/LdLnYlqt1oqBelqr1oCCCIm+irytaBvPOzGc7eGPzNSNK3xHWnn7VL/rh4NpCnEnPfSOlVq2I+COBEoQN05Mbq422ffV+xdnfjvxr1l7vv+RbDo3MA2jVg+82DafPQEJ0mvfLB0z/4qntvrrzmudwNFHRVZ/SDsTK3zvx+rDzuq3+jzS9VJ17L/xONYv6BZ9nGndJmhUn38vnNC/a9/Xzuhg01Z3I6qhp0nWqzYSC0xHEfl8l+ZfTV7hxCrRT5bO76d4p2WZxeo/UVvdW0veH8Hce/uvrQR+Wu8uN9MkyO2BiGYdhgkerQrRtpAl6aV2Nbg5TJYsRnRKaO6TpPo0iqJLdbi79u7b8vbdbPODz27KsnoNEeHPPRWqXeakFLaQFA0a52bM8yeXEWm+OiviF5VExYjIuCCQA4tiPP/phgEAuum3x5rHeLbrxcwGoxW49ty3UYHGQz6OL36CcEEFJOTKRgTIxgQpxokmd3tTuns3SebP+yVLXHeTnhAOG3FiIeYjOEBqtyW8MzeqsCHQMAAINVtaP++TVx65C1VYcPAog0ycJz8l+QeLXmhJHUuEzdKk0NzXqa22zTA3xQ3j7wd34m0e3Gn35mIenbZLN6WYi1T3x7NBv4U4n1STh/xPXx3+TKf8+V/2omXSyWCAAkZalQH6xQHwzhpYyV3ZgknuVOpqYvfPvd+sPc8IwxgbF5nb0WaNgVKhruOfHt+xNvDONJ0LG+2NNY8ELeRmP/5vVGSKNCeZJWV5WwKrP+hbxN746/nkF4O5V6q+mtwh2bas+iA5jf4Fm2mRGaKmBxdBb6t2ZHCpNue8P57Q3n0QE3sBlMDoPFY7JlHGEQVxQpkCaKQpPFYVmB0e60VveVqSHJ18dn/1p9Ch2g82PlsRNt5U+PWDopuNfbur2hs5hOtpfvaiw41HLRYDWjw74wTI7YPuH13zeGYRjmWrJDAhpJ19rbf8ekhHO47MiEEGEA37aG58WzVWNmpNm3rCxwSNf6bb1N5zInJjqWbPcmILhbYkqr1ksC0UaF5d0r38fOTHf8sjeZExNb6jrQaHcFJ8vtj5NGRLssb7eJSQ6PiA9pqu7q3p5/snzVvXPto4NrBn2Z580MWEYQNOVyBDCZBJvN4PGYUiFLJmZHyDjxTlaQ816Z+sDh5veNpAYdwNxDELC9/jmlqdvui+g01expfHVZ9H+uyOp5A0F6wOKeCXcrZa5QHcyULkfiCNrydgbBTJUsQKN9NCh2ftoDRb+xUvSfKn1yGcCHF88GxVRifcUkOBOCbhkhXZEr/7VQ8Zc7aXcAaDOU7Wn8l4ybMDn4bjebVrmDGJyf75/IXHzbsS/dqV4sVDZcf2Td8yNXLIgYgY65ocOoebdol2fZPS8RQCyMGOnO2okHmov+W7Dt2ZHLmF4cV4+1lf03f1udTo4OYP6EZ9mGx2TfGD/lq/JD6IBPmUmrmbRqLcYOo8axyQmDYGQERMwNz1gcmRUt8EFnOZcez1iU01HtstGKTbm65d6T32YHJ94YP3lWWLr3F10slPWisulsR/WxtrJz8hrnK9b6xHA4YvuE95OLYRiGuRSXFsnhsU0GMwDYu3jb2Nt/J4+KBQCCIJJHxZ4/WgI9moDb66O5fE5sSrjjUL9JyHTrtmmkVt1qpnnfr+q++miMe/+i6CTXC+DZer/YuPmCbRIyo+wJ9+IzXfNiM7hm0Ge5IQCYEfaIb6s7PXO6/ducjh/QKB02gydhRwpZIQKWjMsQcZhCNsFnM2z/8dgMPpvg72j4Z29V3kNYm+FyoyUnarWnjrd+Ni30QXRgeJByYsL5I3oWqpeo9niWcI8VTvKyXzPe+d3j+lOfx3x1LQFP5dDGZ0qnhjwwXnZzgWJrgWKr1tKObkFHbqza0fDPWGH27LAn+2t53oFodGDMzYlTfqx0naYEALlR+9TZ3yYExd+eNH1aSKqbGY0SVdPm2rOb6s4Z/VP16Y7r4if9Un2CvLTKkBN/1Jy+qGp6fcwal72wESRFHW8r+7biaE5Ht3NQBJfBGozlooMCnmWbu5Jn7mkqqNW6qJPyB5IiCxUNhYqGjy7umxKSfHvS9MnBSehGPsVlsj/OvuXmY5+3Gegb3PV0ur3ydHuljCucFZY+PSRlVGCM+2XgCpOuTicvV7WUqltKlE2FygY/FbP3Zpgcsb3HYvrmBBLDMAxzgsliJI6ItqVfkfro4pyudG3SqK5md6lj4rrStee6nURVXErXJo2KYVyho3dodN9OCJ1QdXSr8HOnVwwAuCxX16kNtrS4TXhssMOgCxHxlzdWtKtJK2n/PQ+uGfRlwn0gOCf/xXmWSsgKihdNixaMDeGlSdgR6HAPPqxXHdQIYPRcOhUAzneul3HjMwKWogPDQ7pkcc+Ee5M+X2VucrJ3NesLleZuVxFtvOwng3d+N/V2XXDgtG3BUzlMcJni8UE3j5XdUKU5UqjYVq87587VoFrt6d+q75gb/myieAY6Nmz8X/qCY61llZquwgeXcjqqczqqw3iS6aGpE4ISEkUhMUIZn8mxZXPMpLXTpG3UK6o17Rc66850VDlP/DEJxjdT73qrcEehwtl9YF6KFcrmR4zY01iADtC50Fl31cEPZ4elXRM3cUJQAtfpwpIGqzlfUX+opWRfU2GTXoEOd3dn8szRgTGPnvkZHcB8Ac+yjYDFeX/CDXed+EZhupIrlJxoKz/RVj4lJOmZEcsSRCHosO+E8wM+yb71juNf9alrudyo3Vx7dnPtWQCQcYUxAlk4XxrEFfEYLC6TDQBm0moiLXqrSWnSK8y6DqOmSa9wp1ePvw2HI7b32CwmGgJQ6gwnLtacKa+raJY3dCi1BpPebOaz2WI+NyZEmhwRNCkldlJqrIDrg3s0seHDYLKcLqs9WVpb1the26ZQ6422/UrI48SGSJPDgyalxk5KixVy0U9M+LIQAJAkdaGm6WRJbWljW3VrZ4dapzeZzVYrl8US8blhAaK40MDMmNDJqXHJEW5lLb1hJcn8muazFfUlDe117Yo2lVajNxotFj6bHSDkSYX8mGBpdkpMdmpMbLAUffIwlpIVa0vXKjs0na2qwFAJANSVN6s6tfYNbA/sTcCVHZqm6raI+BAAUHVqO5oUXRv4sxuJcwKRz1qGaNWXb7kmCIInQP/2abncTK3o+n3aCMSuG+DYCRy65VAUpVboAoIu98YZRDPo7GR90GnQ5Z1q+wqNXhLGz5wQdGusMNvXPXCHvnjR1BmhjxxseadOm4OOARxqeT+AEx3Jz0IHhoFkyZyjrR9bKPTzUqlq74SgW5GgXYlqDxoC4DED4oVT0Kjb8M7vvt5ax1gpH3wo7a1fjfvwVA43DIKZJJ6dJJ6tMjddVO4qUe1Wm120GjCRul2NL88Ke2yEdCU6NjxwGay3xl9327Ev+5SuajGoNtbmbKzteiMjgOAwWWbSSlI0l5OdeCxj4ZjA2FRJuL/TN09kLDrUUuJmzSZJkQeaiw80F7MIZookLE0SLuUIRCyegMWxkFYjaZEbtS0GZbW2o1rT7uY/eVnU6EfS56vNBgIIdzpCYB7As2yTLA77Zspdj+X84jx52g9OtFVce3jdP0YsuTYuGx3znTRJ+LrsWx8+86PabEDH3CA3auVG7fnOOnRgQBomR2wvcbon3Esa2r47kLMnr9RiRf+9WqNJazQ1K9Rnyup+PZwn4LKXjs+4a/7ESJkE2bJPtucUP//TLjQK8Mc/bk6L8ur6U0lD27Vv/4RGAV69ceFV2SPQqCsPf7HlSJGz+3V6c/5/j6Oh4adNqflmf86fp4s0BvSP0bZftSo1OeX1vx09z+Owlo5Lv33ehLiQy722eqbgvTFwprLnzp8cEbTxGfSzfKdG/9vRvA3H89tV3dKINnqTWW8ytyk1BbXN23OKASAuJHDttKy1U7N4rtaf9EBdu+KXw3k7zhYrtDRvIrbZbJSriupadueWoMOuTEqN/eLBNWh0CHFcJLOquMGWrrX3LWGxmfam3hnjE+xbXjxbZUvXVjmst2nP5/Y/Lt9nf48G3eU0CJvLcrPpKE/gIuPv+G0BgMOjT8LQQv51OrW+W8J98Myg7//4rxSSsh5u+V9vHxUmBd81PuimwbhA3JUlYAVOD30kWTwbABZGvryp5qFOUy2yDUlZdjW8dE3cp+5U2g4xHIYwQTy9TLUfiZeo9vSWcCcpS7n6bzQKkCqZ53EZMt75+4TD7LZyiJ3R6u7N3U5YSJqTHvfhqRzOJOyI7OA7JgbfXqfNKVL8VaU5Rntf0SXU4ZYPpJyYKMFYdGR4SBGHvTXu2v8783Nfky92FFBuZjkdLYgYcWviNABIFbtuXOilCL70/9Lmv1O0Ex1wykJZi5WNxUqa+6j6ZEpI0qtjriaAkLD5yeJQN1tOY32FZ9kuSRz6+4wHPynZ/3vNqX7oLe6EibS8nv9XibLpn6NWutnVxANjZLHfTLnrgVM/tBt9cPoxwA2HI7Y3mAwGm9mVcNcZze//eWTD8QvuNJsCAJ3RvOH4hT9PF94+d8L9iyczGbgGGaNBUtR3+3O+2HNKb3Lr78hgsmw6WfDnmaKbZo19eOk02wUhHofFYTFNlit5fO4fVS2dRrOFy7782fz3o+c/2n5MrUcvVDhR09b5zpZDP/x99rlr5s4d5bNmZVqD6X9/Hd14It9Keng4xezlzwBQW9o8blYGABRf6vGdNDLGnhoOipAGRUht1dAXz1XPWZMNAJWFly/fOmZ+By8u/3Iq3Gxyt8Eg5epNCilpN+rdOvjYGLsn64USvuOXg2gGh85bcpXmaKepBo0CAMDMsMfGB93sWZaqt8zXcJAesOSG+O9t2XYA4DJES6P+w2WKu20EAAAGq3JHw/Nm8kreCHylpEto+sAoTQ0t+iI0CgAANdpTtIldb/rJ4J2/TwS9NMrXW5VoqO8M3n0TPJUYAUSscOLiqFdvTvxldOBaJwuMU0Dubfr38Dzw2kwPTX1h1Ir+vNtjWkjKf8eutT1OkfhxgR27WxKnzg3PRKP+NzMs7YMJN7GIrgTQ+KD4bsOYT+FZtiEpqlTdzGYwAzlCdOxK2FCb8/L5zWjUp1Il4T9MuydlYOeCfWU4HLE9xud0pQbq2hU3v//rH8fOu5lttzNZrF/sOXX7h3/Q1t5iw5xKZ7hv3cYPth11M9tuZ7GS3x84e+v/fmuSq2yRQFG3tNdQZSXJ8uau2630JvNT3277z4YDfcq227UqNY9//ed7fx7u4980vYv1rWve/OGPY+dxtt0bsanh9gLqurJm24Oy8111pRkTE20Pur68VCJt38C+UKdAzItKDLU9HtSE4st/1xRJOTZed0KrutyIhpZY2u10TufQuMYlneZyFSNBEKIAgcPgYJrBoZNwv6ikuQkOAOJFU0ZKr0KjbqPNjQ4Hk4Pvnhv+NJJeD+BELY58lbYQW26s3tP472GY14sWjhexaG60LKFbFhUAKtQH0RBAEDcxmJuCRt2Gd/4+4TGljEv5BUcaiw8q+7xcmxRPJWYnZodNC33wlsTfRkpXEb28WessnRc6/ZsPGuDWxE54fewapo8WK3YuOzjx/Qk3sBldR49+y5H9d+w142XxaNSflkWN/t+EG21doW36+QUMQ8N8lpv0ircKd8zb9+Ztx778tuJIq6Ers3PF/Vmf+2XZITTqU1GCwJ9n3O/X9jUDx3A4YnuGz2UDQEOH8s6P1ldcSvN54EJ10x0f/tHUic/6sMvkGt1dH68/XVaHDrituL719g//qG1XAECgqFvaawgraWgDAKPZ8vAXW/aeL0OH++j7A2ff2nwQjfZRbmXD7fgP3BcYTEbiiGjb49qSJgAwmyw1F7vuGsyY0JWftUkf1/VlRUEdaSUBoKa0yRZJHhXrZveVAU4c2C0z3togd/yyN2qFi6ovnoAjDLicym+sbnMYdKGhstX+OCBIhKxrOohmsD/OePoBSVka9LloFAAAJgXfjYbcZiYNPmnrPBjxWFI0BAAAUYIxM8MeQ6MAAFCjPXmi7XM0OtQRQKQGLESjAOXqv3suwmmlzNWa40gQvCtvxzt/XzEIppiu/ZHK3ExS7t5C1RuVuevw7QE8lVhPfKZ0Ztijq2M/ErKC0DEAAMhXbHJnqdUhbFnU6I+ybw5g+7fk6prYCeuyb3XMTko5gmAuzS1fPsdjsj/KvnlysM9uRnaCQRD3p87pmREbd6Vrn4e8YTvLZeqWZ879sfTA+z9XnZAbB2Jl7rrS/Rf83Cqdy2D9c9SK9yfcGMaToGNDzpA/YntGyGVrDab7P93UqtSgY31U26548PPNWgM+8cMAAIxmy/99sbW0sR0d6KNmhfredRs7Nfog8bBJuNe3AsALv+zOKb/c7tkbvxzO3Xq6EI26rbZd8fAXW3u7R4FBEGlRIddMHXXPgkmPr5xx76JJ100fnRUf0dd1bpkMRkywNCPavzW/A4G9x3dtWTMAVBU1WMxdqZvMid1OxtIv1UebDOaakiYAqC/vqtJLGXO5scmgFp8R6filLYXtUn15V2m5EyMcfplVRZcbubjkuDGSQLcZLDNIU6o8GClMdRaS5h4fKScmiNvthoI+0VndurYz3GQGLOs01pzvXI8OAOTJf5dx4r1JHw9G6ZLF5zp+RoIGq7JelxMrnOQYrNPmmHr0f2AQzFTJAiToPrzzeyCQE6M0oSdPJGXpNNV680sDAEWPb+s+PJVYb8L4mVfFvL+x9qGeNyvoLPJ2Y2Uwtz/ydAPWtJCUP2Y+9HzuhrPyanTMazwm++kRS9fETkAHAFIlYe1t6Iz4g5DFXTfp1neKdv1SdQId851QnuS/Y9dOoMu6BnNFscKgK76a5dA23GbZTFo/L/v7m/IjVk+bevcPkqL+dWHr+pkPMvxclz03PGNqSPLX5Ye/rzzmQbNy76VJwq+NnzQp2PPzDTcN+SO2BxgE8fKve2wVxI54HFZ2SuyouHCZiC8TCThslkpnqGnrzCmvP1fZQJL0l9srmzue/2nXB3evRAeGhNdvXtym1Cq0+k6tXqnVd2r1Co1BodMrNPpOrV6hNbSrtEaztwU0Q8a//9hfUNtrUozBIMYlRmWnxMSFBIr5XCtJqvXG+g5lfk1zTnk9ktttkqse/+Yvl12b3TfAp/JiQ9uWU4V7ckvRAYCQAFF2SkxqZHCkTCLgcswWq1JnaJArz5TV59c09Vzo2O6tTYemZyR4cNGCpKhnv9/Rc6lbAOCyWTfMGHPL7HHBEppubFqD6fdj578/kEO7tqpUyBubGBUdJI0NCYgJkkYHB0TKJMNkHQh7ulYl12iUOnuzkZDIwOAIqX0zAEgZHctiM23J3LLzNdIQsb2VSuroOMctBy/HlugAcP5Y6dSlYxwjtOy/NCdGTkk5va/A9ri6uLG1Xh4aLeu+CY2akqaWusunoyOykx0GuwyWGRwiCffeqkrD+SPQUF8067t2DgwxNfQBham2RnsKHQA42PJuACcqgj8KHRi6pJzocP6IZj16ybpMdQBJuFdqDjt+aRMrnMTvpau4O/DO74EQbmq1hiaj0awv9Ca1DQBthhI05DY8lZgTUk7M5OC7D7W8jw4AtOiLhnnCHQDC+QFfTblzQ+2ZT0sP+LBOdk54xjMjlkbwpegAAACkSsKPt5WjUf9gEoxnRiydHZb+6oUt9bpOdNg7bAbz2rjs+1LnOCk7HR8U32+p2GFr+Mxypbr1yXO/V6ov3y/sXACbnx4QEcQViVg8EZvHd6hcdsJKkSRFGUmL3mJSWwxyo6bNoG7QK/qazi5Xt+xqLFgalYUO+BqPyX4obd41cRN/rjqxqTZHbabJj/iclCNYGDFyefSY0YEx6JjfDPkjdl9VtsgrW7qVR0TKJI+vmDFrZKLjso2OGuWqz3ef3Hq6kDb/ebCgYuvpwquyvTqBHJgCBLwAAQ+NOnh36+Ef/j6LRoelv/Mr/jpDv6gYAFyVPeKBxZMjZPQ31uiM5j/PFH2x+2SH+nKtWG5lHwpUXRrgU5lX1ZhX1dWhwm5cYtS9CydNSoulX097CbQqNV/vPf3H8Qu018M0BuM3+8784+pZ6IArW04VFtbR9D4NDRB9eM9VTgrShTzOnfMmLhmX/uhXW21NchxZSeqFtfNoM/VDXopDprWltqOqqKtmDmn/DQAcHjshI6rsQi0AVBU1RCWG2YfsOd/BThYWEJMcXnepYv34jrx7XlnDYnf1ZKPV2iB3J+E+66rx3/93q9VCAgBFUbt/PX7LP5ajG/Ww59fLPSEIBjF16WiHwS6DZQbp38IHHSOpQUMAACBgur5+4kSDLg8NYQAAQACxMPKljbUPyY3VyBBJWXY1vHRN3Gdi9uVdechLlyzumXCv0hy1UmYm0fWxkKSsVZpj3TcB8K6fDOCd3yPh/JFoCAAA6nVnR0hXoFG3Ga3qnn8R7sNTiTmXKll4tPWTng2C9FYfJ+YGKQZBXBuXvSxq9I+Vx9fXnG430v9BuYMAYkpI0u1JM5wXe/Z/U+BJwYlbZj+6qfbstxWHm/RKdLjv+EzOwsgR96bMiRYEomPdjZfFb669Yp97h5UhP8vFysb7T32vMKE3/PU0ThZ3dez4sbK4GIFX74OOKKDqtJ0FivqT7eX7m4o1FreS2t9VHO2HhLtNGE/yRMai+1PmbK3P3V6fV6Bo8McKSVGCwJmhqTPD0icFJ/ZPU3XEcDhie+yGmWMeXzGjt1S7TaRM8q8bFs4emfTcjztpu0y8t/XI/NEpQm7XsnLYcGOyWN/Y+DcaBQAALpv131uWzMuiKRq1E3DZ108fvWRc2j9/2nWkqAodHn44LOYzq+dcM9VFTWFogOi5a+ZOz0x4+vvtOiPNH+amk/kPL5tqXyfZHSRFfbvvDBoF4LCYH9+7Ki0qBB3oISJQ/On9q9e+9aPj5RMAUOuNb246+PbtyxyDw0RsSjhPwDHoTADQXNthb2CSMYHmfSR9fIItXVtT0pQ0quu6hVgqjIh3/csfLBZcP/mb17bYHrc3KXb+dHTFHc6uDG34eK8797uERstmrBh3cHOO7cuN6/YtumGq8yL3+oqWP7++vHzOtKVjaH/Pg2UGnb2RDyK9LXnPYfT5hh07K2Wq1Z5Eo9glbIZgadR/NtY82HOVSL1VsaPh+dWxH7MZvVZRDTHJkrlHWz+2UN3u8zKRujrtmXjRVNuXjfq8nu0geMyAeOEUJNgneOf3QDh/JJPg9Exc1mhPmkkDm+Gs2sKJWu1pCnq9i9AlPJWYc2wGT8IO7zSh1QQ9DyzDmZDFvT91zj0psw62XNxWn3eqvVJrobkDtzeJopAZYWlXx4xLELk+A0uRhKMh/2MzmNfFZ6+Nm3i8rWxbw/njrWVKc9d9ke6TsPmjA2MXRo6YHz5CwHIrHUPbhATzkyE8y4WKhntPfucyzT07LP2xjIXu/Bn2FQFErFAWK5Qtjcp6fqT5p6rjn5QcIF21tSlRNVWqWxPFvVYR+pyAxbkhftIN8ZNaDar9zUXHWsvyFfXuXKXoDYtgJoiCRwZGjwmMHSeLjxU6+7jbb4b8EdsD104b/ezqOWi0F3NGJb1/14qHPt9iJdF9WKHV//D32QcWe/UpAxu8fj+a16ygOT9kEMQ7ty+bOYImJ9VTgID3wd0rH//6r0OFlejYcMJhMT+57+rsFHdvA5qRmfCfm5c89vWf6ACAzmj+O79i6fh0dKB35yoaevabAoC7F2S7k223CRILnl095x/fb0fie8+X1ndMjw4KQOJDHsEgEkfGFJ2uAIDm2vbqS+ttZvaojwaA9PEJf317CABqSpqaarpWROiH4uj+NP/ayT+/u8Oo70qPfP3q5rSx8aljLleROzq+I2/7D0fQaC9ufGLp8Z3nTQYzABj1phdu+PjNTY8FhtDfW9PepHjxxk8sl3pJsdjM6x+lL04dLDM4RBLuPCb9hPVWMeqOIsU2nQWXDTojYUcsjvr31rrHey412WGs3Nv02pKo13rLIQ4xHIYgQTy9TLUfiVdqjtgT7pVqmqNSqmQ+g/DqzxDv/B5gM3gxwvE9u8pYSGOpaq/HRe4lqr1oqC/wVGIuWSmaYhkmg4uGhj0mwZgXnjkvPNNKkfmK+vzOumpNe7W2vVmv1FpMOqvJTFr5TLaQxRWxuFECWZI4JEkcOl4WH+WqBNhRmiT8/PJ/o9F+wSCI6aGp00NTSYoqVjYWKRsvqprqtfJWg0pu0hqsZhNpZQDBZbL4TDaPyQ7iiiIFgZF8aYxAlhUYkygO6eu7cwRf6o9/7LHF/0RDvvDF5DvQkC+8OGrli6NWolG/GTKzbKe1GJ8695vzbLuAxXlmxLJVMePQAT/gMdl3J89Kk4Q/efZ3l31m9jUX3duPCXe7UJ7khvjJN8RPBoBabUeBoqFW29Go72zUKVoNap3VaLCaDVazhSRZDAabweQwWBI2L4AtkHKEYXxJFF8aKQhMEIUkikLYDGe3h19BQ/6I7b7slJjnrnE3224zJS3u/sWTP9lx+QZ8u9+O5N05b6LzSnlsSCJJ6seD59AoAADcPm+Cm9l2GyaD8d9bl6x588cmuQodGzZevm6B+9l2mzmjkpaNT99+9iI6AHDsYnWfEu4H8ml6YXFYzGun0fTZcGL+6JQImQSZR4qCjcfzH10x3TE4TKSOjrWlay8cK9WpDQDA4bETR0Sj2zmsuilvUZZf6qPSP+nafhMYKrnpqWXf/Huz7Uuj3vTM6vdveXrF4pumCcSXixFb6+WbP9//17eHSCvJZDFsvWKci0kJf+D1az948mfbl3VlzQ/Mfu2WfyyfffVEYcDl8lxVp/bvjad/enu7Rnm5tuD2565KGtXrn96gmMEh8gbMY9JflFOau+4s6CsTqcuV/4ZGsR4i+CPnhD21v/kNdACgWnP8ZNuXU0LuRQeGqHTJ4p4J92rNcQpIAhgAlD/6yQDe+T2VLJ7bM+EOALnyXzMClnhwFURurKrVnkajfYGnEnPOQho1FrT9IgAImUFoCLuESTDGBMaOCeyPM6orgkEQI6RRI6RR6AA2hAyZWX49/69GnQKNOmARzPfG3zAlxFmjA5+bEZp2d/LMT0rQUzjEOXkNGup3scKgWOFQPuAP+SO2cwQBT6+eTd8b2qk75k3463RRzxpYhdawJ690xcRMJI4NeQcLKloUNPU6oQGi+xdNRqOuCLmcJ6+a+dS329CB4WHOqKTlEzPQqBtumzuBNuGeW4m2hncuj277CcnRgaK+9RJgMIjZIxN/PZyHxE+W1j6KhIaH5EsrhdpX9UwdE0fbuDwyIUQiE6nkGnDY2LGHeE8mg1mr0mvVeq1Kr1MbtCq9Tq3XqgzytssXPOrKmrd8+bdAzBOK+QIxTyjhC8Q8gYgnlPC5fLduTPSt1ffNO70nv+BU1wUeg8705Ssbv/vP1viMKGmw2Kg3tTbImy+VhxMM4qXv7n/19s/cybkvvmlaXVnzps+6TrSUHZqPn/3t0xf+iE2NCAyRUBTV2aaqLW0muy84PG/tpNUPzHOMIPw6g77S56TSwCRhRwAQ0KPFYZMu/1K6s0+ofU2v0eY1sJ7SAhbJTTW58l/RAYBc+a8ybnyaZCE6MBRFC8eLWKEaS7cVwAxWVbO+KII/stVQorV0HZ7sgrlJwVxvP1Xind8zSeJZx1o/6dkQSWVuOiv/eWLQbUjcpaOtn/SchT7BU4k5V6E51PN2IgDwcqVfDMOwfnBOXrO94Twa7e7FrJX9nG23uT1p+vqaM60GZ/WbBYp6NIRhPjU5LS4lIhiNuoHNZN42d8K//9iHDgDszsUJ9+Fo57kSNAQAALfOGe/ZHQ/zspLjQgJr2obdXbMMgnh0uYfV32lRIWlRIT2XKm2UK7VGk5vrK1AUlDd3oFGAUXERaMgNWXERv0IeEixpaDOYLDyOJzvGoNazXwpt+2+b9HHx9kStTcqYXq8NVxbUPzT/P2i0h6qihs9fXI9GAQDgzU2PZU1NRaN+xmQxXv35weev++ji2Sp70GyylJ1HCw4YTMaj796UPX9kZHyofalV5+55ZY0sLODrf2+mLq0nbLWQVUUNVUBfWXjdI4tue24l4fQKtP9m0If6msEZoHjMgGC6jIPeqihTHUCjTlFAHW39hLb0FevNlJB7EkTT0CgAABxsfqfnaqJDEgFEWsACNApQqz0FANUamjs907wubwe883uKSbBHBq5CowAAkNP+Q522a2UPNx1v+7Re5+1Cc3gqh54S1Z4K9UHaLHlf6a2Kk21foFEANoMXzh+BRjEMwwaYHypp7vNzlBUY0z+dZHriMFgzQ118slWbDaq+d9LHMPctHdeHLhOI5RMyaJdhPFVaqzWiSxZhQ5vJYj1WXI1GAdhM5qpJHp4xMgjCsyrvwW5aRnxCmAyNum1MQiQaAqAoaHS7P49cozNe6mftKD60Dw217GJDpGgIwEqSjZ3uvp6hJDopjC/s1paTtv23jb0niU1AkCg0yvMdY8Dii3hvbnzs+kcXs3q/MhceF/yf3/9v4fVTACAmNRwd7t2aB+Z/tPvZ0dNcnG5lTEh8Z+uTtz9/lfNsOwySGRwiCXcAiBLQn6Mfb/usZ2Vxb4xW9fb65y50bkQHMBeI+REvBHOT0DCAlTLvanxRY+5W9z1UpUtoEuj12rMA0DP1ySBYqZL5SNAzeOf3zJjAtXymFI0CUEDubHyBtgVQTyRlOda6Lk/+BzrgETyVQ0yLvnh347++q1hztPXjNkNZz9sX3KQw1W+te0JroalwSRbP8aADEoZhWH+q1coPtdDcWe/o4TTfnBR5xp3K+ia9Eg1hmO9Mz4xHQ27jcVgzRnTLJtiYLFbafhTYEHahuon2KsvktFgx3/NVf+aOcn2QHHpWeneDSGZMGBoCAIB2pRYN9UKpM6AhAADwbCp7e5aql58ytBEMImlkt/7gzuqju6dr+6cbyRXB4bFve27l1ydfufvl1VlTU0OjZRwum81hhccGTV8+9ul1d3x59OXR09NsG8em9CHhDgBJo2Le2PjYh3uevfHJpZnZSWExQRwemy/khscFj5yUfNNTy/638+n3tj01YhJNXrGnQTGDQ+dTeqZ02YXODVSPdIbO0rGl7vFFkS8Fc1OQIUcW0lio/DNX/ruOLqOBucRm8JZG/2dDzQM6ixwZ0lk6dzQ8f3Xsx2wGDxkaYgI40eH8EUhFf5uxVGlubDeiq53ECSfRZns9gHd+z7AZgqkh99OuQGAhjTsbXkwPWDQx6DYxm/6NhKQs1ZoTJ9o/V5ro74TyAJ7KIclgVV3o3Hihc6OAJYsRTIgVZkcJxghYbvXh7TTV5HduvqjcZaGM6BgAg2COkV2PRjEMwwaYgy3FJIW+tTmK4EsnBff6MakfxAhdFzppLTTHYQzzifjQQJlIgEb7Ykpa3J7cUjQKkFfVOC0jHo1iQ9f5avpLLJPTvOqfkBQeFCjid2qG0Y0+DAYxNcOrrFyQmP6PWkN3RYSWia68HQBo72hxqbeGQlqDu69niHl76xNoqBdjZ6bvbF6HRnuRODLa/Y3dFxgq8eDbzlo1YdaqCWjUldAo2ZoH5q95wEUlxG3PrbztuZVo1JWUrNiUrNhb/rEcHeg7P82gD9H/yQ1GgZy4JPHscvXf6ACA0lS/vvr+BNG0ZMmcMF6GkBXCIJgAlNGq0VsVzfrCBl1ujfakwYreShPCSxkvu2VX40tIHKMlYoUuiXptS+1jVgo9ZLcbK/Y3/Wdx1L8AXNwYMtilByxGEu4kZT1PV/7s/XKpdnjn91hawKIKzWHahj8A1EXlrhLlnkhBVqRgjJQdzWWKrJRFb1UYLIoWQ3G9LtdM6pDnjJRepTa31GhPInE3DeSpJCmLytxsIrUmUmuyak2kxnj5cdd/RqvGRGpNpM5gVaPPB6jSHP+h4lo2Q8BlijgMAYch5DCEHKaw6wFDwGGIOMyuuJgdxiTcam4IABpLm8Gq6vZirJdenkPQSGr0FgX6ZAAA+K5i9aWXYX9VAg5DxGEIHF6hkMMQClgyHlOCPt89Oou8RLWnRLUHAHhMiYybEMRNFLPCOEyh7WdRQFpIg4nUqc3NSlNDkz7feRf+MbLrAzlefXzCMAzrBy5XHJ0c4lY1k/9IOUI01IPeip7fYpivpEaFoKE+GhNP39O5qK4FDWFDWmEt/YyPTfBq5W2CgIzo0OMXXRzMh5KUiGARj74k3E29VZT3lkbviddLYp32JgaXNHr6Z/WWiMcwzEtD6k9rUvBdtdrTJpLmDh0KyErNkUrNEduXbAbPQpoocLairoQdsSzqDQ5TyCBYPunAOxyE8TLmhj+9t+k1dACgUnPkVPvXk4LvRgeGlmTx3KMtHyO1qAWKrY5fAgCfKY0TTkaC3sA7v8fmRzy/seahThP96SMFZIMur0GXhw7QCeWlTwt96Jz8F48T7jCAp7LdWLGh5n402hckZXGePna0PPrNWGE2Gu3Ftvqn5cZqNNoXOkunDtxaCSojYOmc8H+g0b4zWFWNuvONuvPogNtihBOyg+5AoxiGYQMMBVSuq4T7xCCabhj9ScxyfRcmi2CiIQzzkUQv+kTbxIfKOCymyWJF4tWtbp3eYENGFd2MMwgiKdyteyudSI4IHlYJ94zoUDTUR73VoVtIZx/fHAUI6N+bPLvVoFOD1orZyER8NIRhmC8MnR7uABDAiVoY+TLhxj/KTBqcZ6kCObGrYj8QsGQsghvG86p113CTIpk3IehWNAoAAGc7fi5V7UOjQwuHIUgQu17KPEUyz7dtl/HO7zEOQ7gi+q0AjldFHwAg4yYsj36TSbBDnHZ9cQlPJeaOGOGEJZGvMXD2B8OwAU9p0itM9B/y7SL5UjTUvwxWMxrqQchy974rDOuriEAPb56zYzCISBnNN2mUq8xWNAuPDVUkRdW1KdAoQFigmMfx9rMn7Q42hMWFBKKhfhco4kuFNNnwi/WtaMgNhXT3uzAYRFRQABrFMMwXXOd0BpdY4cS5Ec+434iAVpRg7NWxH4pYXXf2RQvGdh/HXMgOvj1JPBuNAgDA381vtxiK0ejQQrt0KsKH/WTs8M7vMRE79OqYD8N4GeiA26IEY1fFvG/rNBLM9XZNITyVmBNMgj0h6Nbl0W+yGPS3qWIYhg0oSrOLbDsABHDoG932m04TzY1lCAHTq/dlDHMiROK6qZFLEXT5UJKi5GpPimGxwUih1dNeX4mQitFQ34X74psMIuGBA+LfOzKWZuXVU2V1aMgNZ+ielRYZglvKYJifDLWEOwCkSRauifvEs3pVFoM7OfjulTHv8piXr/JF4URVnxHzIp4N4aWiYQArZdrZ8IL7bSUGo2jheBHL2Q1o/8/eXUe3cWwNAL9itmRZZmZ27IDDzExNm6bMlFd+pVfuV2aGlNukTSHUMDPYiWNmZpBkMcP3xzpraSXLsi1j53d6enbvrDYraS2t7s7cETGiB56TdQqd/P3GpgrXhn0ywedmCsn50L+eUEj0TNEdK0PexV83Ls2v3zW+ceitHBtSvdfE8OZ6sB96BHfqxsgfM0V3uDMGAkEQZCSQG3pP9glow5xwr1A66fdH4M9CfQCRweLVQ+GIPvF21hMWAKQ91JFAxp6ebq70NHtnn/A5HjhLR5Ge/qCG2NxUJ3mD6lZJlrPsuQsNYpnTikAzk4a5pBuCjGFj8xe7iBGzMeKHOQFPCuihxLYesCiCcd4bbo7cOt7nJpL9xJ4BrGQqCXUk7BsqibEs+A0OVURsANCYpPsb/2ey2FU5H0tIQIrnLyJGbcQPQvd2HDr5+41Mok4W3bUp8udkwUoaufcLLBqZmSJYfWPkjxN9biVkVD1yQwW9lWOANz18UdCLt0X/NdPvP6Gcif3uk+5FC5zgc/ONkT8uC36DTwsiNiMIgoxgGjfmGrWClRgaWjnSWmLInojB41D7+RmOIL3iMD0wfsKrhxkaldox+7MLIVBodcQQAPQ8e2efeLH+XQl3tif+KgduYXqs0x7oH+w+7Thngwvv7TptsRK/askk0spJqO4oggwWJ3+6vVoa7GRKzJGGQqIl8Zcn8Ze168qbNXkt2nyFsUVnVujMCiuYKSQGjcziUkU8WqCIERPITg1gJvfUCZFMot4bd5AY7RcamfVg/AlidFgxKfxeD0miUC98+ht89c27li2eGG/T7hyH6nNb9J/E6Mh2pqD6kS9246u7X70j1FfQ3ey2yaK7JovuIkaHysg5+eO8FsZ5LSRGPUHEiOn1vO0fHi1gtv/j03wfaNBcbtJcleir5YYmg0VVXSU4tLt7Ds/Pnk6dFDa9p7z8qtD3iaF+GTlvJQD4MeMH6TUfuI0RPxBDQ6jXzw0WRZDqvS7Ve53FapYaasS6SpmhQWFsUZskWnOnwaI2WjRmq8liNZNJFDqZTSdz6GQ2m+rjw4gWMaJFzBhverjtDvuh338yG8K/JobckC68IV14AzGKIMi/EpPc+9AxmUHjw+ASo0PFYrUcb+2l4GEk10knEgTxFDrV+fVbn9CdZeUAoE9ZOWRU0xtNxBAAALAYvX8O94pO88BZOorQKCOicyqfzdwwLe3XUzmEeElj+wvbDr22aXGvnx5WK3y679zJwipiA8DC9LiwfqU7BuKGjZ93dCgB4OH/LFyzZgKx2aXdu3M+/uQwAAiFHAqF7JH9/PXnfwBg3vy3iBu5h8mk7d/3hG3k88+P/r3jsm0EQyaTOBwGl8uMiBDFxwfOnZMYGjrQ6bKREc75t/IYQvJjxvsx49PhemILgoxx6OTvPxqZFcWdGcWdiUfO6KoPQXdSNZQzsads+yBAb+UYQSZRRIwYjwyAQBAEGS04tN57Vlap2qN5rsrxDar9TfkdOiUxam+CTwQxhCCeQ/VEao9GcZ53Qwn3fw9jD+91T+dGn9DIHjhLRxHKiHm+dy2ctPdysUxNHL5wMKesoUP25NrZ46N6LENa0yb9cM+ZU0XVxAYADoP+xOpZxOjgCwryxhLlLS1yYltvJBIVthAQwKfRqB7Zj33LILJYrEqlTqnUtbTILlyo/PHHM5mZUY89utjff+iOARliYz7hjiAIgiAIgiDI8AhiCYghB5fE1YsCU4jRIaExGT4vP0aMOpjmG0sMIYjnOFR66A9rD3uxKzKIjGnOzwAAkidOAvKISUD/2wi57BdvWPj49/8QGwCKGtru+OSP+GDfyXFhyaH+Qh6bw6TrDCa5RlfR3JFd2Xi5sqGHDwZ4ZdMif8EwjC0LChLk5dUDQEuLjNjWGzGeKPfnM5g0j+zHvmVIZWVV33X39++/tzE+PpDYhowJKOGOIIjnGYymNpkKAHy8OGxPjGFEEARBEGQ04lAZfkyvdp2C2GDjcHPhf5OWMinDcMHwRuE/zRoZMWpPyOCkCnrsP4ggA2cyO++Y3CdGs4UYAgAP1avpN8ey0cjgoffQk93Uw7mBjBbz02IeWjrt8wPniQ0AAFDW1FHW1EGMuvT0ujkLxw3PjeSgIG9soaVVZtfgBrG4azhaQKCAxeoqsj/A/WALX35x+7VGOy+/srOtTQ4AISHC/z23itgMQKa4up317bd38bhdkx8YDCaFQltd3X76TNnlyzXYR6NGo3/2uT9//OEeL68hGz2PDB2UcEcQxPMOXi57+efDAPB/dyxZlplIbEYQBEEQ5F8jzTv0aEsRMWpDYdT+Un3+ntjZxIZB9knpkX8ac4lRB+tCJ5JJqGsnMog8UvVFa3A+QbHTGReHjEeeGuImWg83V/RGD7wLBpPzAvHI0Lh38WQqlfzpvnMWy4BuYgk4zJc2LpqXGk1sGCpBQQJsoR8907tLwfjzOdyugnUD3A+2EB8f0N1sg07v+ptiMKg9beOCj5DL53dn0oODvRMTg5YvT8/NrXvxpZ0qlQ4AZDLNtt8u3n/f3O6HIWMFunZEEMTzLpbUEUMIgiAIgvwrTfPtfe6KLRUni+RNxOigMVhML+Xt/K7yNLHBAZlEvi58IjGKIB6l1OqJob5T9LATL3ZX/8phoTMYiSFk0PBYzufMUGiJ5b/7QWtACfdhduf8Sd9t3hAV4ENscNuMxIi/nrplGLPtABAU2NXDXaMxKBRa+8ZedPdMD+B7aj/2LUMkPT38f8+txFePHCm0aUTGDpRwRxDEw6xWyCptIEYRBEEQBPlXmheQSCM773eJ01tMm7N+KVO0EhsGQW5n/Q2nv9jVkENscOa6sImBbpShR5CBkGs8kA+VKjXEEAAACLnDWalA7jDTIzJ4fHhsYggAAGSqvqUjnZKrPbATZIDGRwX//XSfM+YMGnXN5OQ//nvz5/et9eUPQ912W3gPd+hj53SDwaRUdn2eBATwPbUf+8ahM3lydFxcV5f5zk51XZ3Yvh0ZC4ZzfBmCIGNSeVNHT1f8CIIgCIL823jTOYsCU/Y15REb7En16tvObXkqednasPGkwZnosVDWuKXi1Mm2UmJDD7xorIfi5xOjCOJpbbKu7pYD0drpZCdUClnIdZ6EHRoS9KNgCHlzWRQy2WwhVmxvcXZu9JVUhd7K4afQ6P639dDpomrbIJtBCxUJ2mRKjd5oMlvYDLoXm+HFZvrxuanhAemRQanhASz6MMyS4hSPx+TxmFjKu6VF7v58oWJxVx0YEgn8/fk0GsUj+7FvHFIZGeHl5V39DNraFeHhIvt2ZNRDCXcEQTwM1ZNBEARBEMTWXTGzDjQXWKzENBCB1mx4JX/X3/WX746ZNds/gUzyTNq9Xi091VbyT2NuX3vQP5eyQkAfzmQl8i/RLHU1q7A79EZTc6eTnYSKBGSyZ/6O+qdJKieGkEFDIZODfbzqO2SEeLNUYTJbqJQBlTdokjg5wZCh1CpT3vP5X4T3d1Js6Os3LfEXDHO/9T4JChKUlbVCH3umSyRd942EQi6NRgHP7We4iHy63zWlAg0GGoNQwh1BEA+7VFJPDCEIgiAI8i8WzfPbED5xe20WscGZQlnjo5e3iRi8hYFJU3xj0r3D+pr1Vhp11aqOCkVrXmdDbmddvVpK3MINN0ZMXhqcRowiyCCobJEQQ31U1SpxOpVihF9XmWPXyGTnqVjtgCuwV7UO9KkhfRLhJ3RMuBvN5pp2aWzggPrP1nV0EkPIEFLp9Pd+/jfhzV0+MfH/Ni0e3ptq/RAYeC1R3iojNN1193c1NR0A4OPD/fOPzbZNHdd6puN1YDy1n+FiNnf3QmCxRsoQBMSDUMIdQRBP6lRpr1YO3aRnCIIgCIKMCo8kLLrYUV2ndrdKqViv/K320m+1lwDAl8kL5/gEsgTedI4XjcWkUKlkitVqNVktJqtFZzaqjDqVSSfVa9p1ijadXGYYaOmD2f4JTyYvJUYRZHAUN7QRQ32UW9NMDAEAQHKYPzHkDJ3qvJunSmcghvpo4E8N6ZOkUD9CvRFMXk3zABPu6K0cXm/+fYJwzyMlLODVGxeNumw7AAQFdd0IbGmW2calUjWWJQcAiURVXdMRFemLt+I90wMDBNiCp/YzXPDUPwAIBBybFmSMQAl3pM/w4b0Wq/VsQc3x3MriutYWqVJrMHIYdC8OMzZYND4mePmUJG+XU/Tc/Na24rqur+3kcP9fntlk396Lda/8VNva1V8pIyb4uyeut28napepjuaUny6oaRLLxXI1g0b1E3BigkWLJ8ZPS4qgUSkAQO3hWtOpD/8+/cvRK9jygTfu8ffuHhDUJJbvu1SSXdZQ29ap1OisADwWI0jklRjqPzE+ZFpSBIdJxzfuidFkvlzemFPRWNbYUdvWqVDr1DoDg0bhMBkiPic2WJQWFbhgfKwXm0l8pAOJQr3w6W+w5RvmpD99w1xsufsdrG9rkSj6+g4CgNUKjWJZeWNHeWNHeaO4rLG9VWpXIvD5Hw4+/8NB2wjB2Y82sxnDfDvX4+cGxlPv4D0f/HmlohEAnr5h7g1z0gGgukXy5T8XsssadAZjiK9g6aT4WxZMoNO6P8/3XizefjK3olnCoFLCA7yXZyZumDXOnasxTx2zUyqt/mB2WU5lY2l9e6dKq9TqnXbFInhw1bS7l04mRh1IFOrTBTVnC2vq2zolSo1Kq+dzmN48dnK4/7SkiBkpkax+nWaDdG4gCIL8C3GojPcnbrzt3Ba1SU9s602HTtmh80ANYjfNC0h8d8INVBL6eEeGiESpqWmTRvoLiQ1uu1DmfIBpekQQMeRMT79NJEo1MdQXZU0dMjRp6tDq6R2/WFZ/3bT+D9lRaHSVaLDC8KlulezNLiEEH1s1c4BlgoYLPt8poWf6lZxa29XLl2tsE+XiDmLPdE/tZ7jk5nZV4qXRKNHRfvaNyFiAEu5InzEZNADIq25+7dej1fbjH5VavVKrbxLLT+ZVfb7n/M0LJjywYmpPab4Ns8a98sthbLmorq20oT0h1N1PmcLaVjzbDgCrpyXbNBIZTOYfDmX/cDDLYDLjQb3RpNDoKpslB7PLQnwFr9y6KCMmmN+vNCIAiBVqLOGuM5g+3nnmz9N5hEyiVKmRKjWFNa1/ns6bmhj++cPrbFsJCmtat5/KPZlXpXboVKLRWzR6Y4dcVVLftudC0dvbT6yfmbp59Qz3c9Y11163/OqWV389MpB3EABe33Z0x9kCYnT0GKRzY5DeQey9y61qfujTHVp91wjf6hbJ53vOnyqo/vqR61gMmtUKL/18aO/FYqzVYDQV1rQW1rSeyKv6bPNaF9dkg3TMGIvFumX/xV+P5TjufODkat2W/Zf+OJVrshmUBwAShUai0FQ2iXefL/LxYt+9dLKbdx0wg3RuIAiC/JvF8vw/z7zlgUs/a82e/zrwlFuipj+WuIhC6vEbE0EGw4mCqn4n3NU6w8UyJ1Mosei0tAi3JhL09XLeubKkoX11pqvfWa4dy68khpBBlh4VxKBR9UYTIX6mpEZrMPZ75sxzpXXudJRBBsn+K2WECJfJmBAdQgiOFnjP9PZ2hcVixX+gXblSAwACAZvHYzY0SLOzq6/fkIk/Cu+Z7t+dcPfMfoZFVnZ1VVU7tpyeHsZgoNzsGIQuJZE+4zLpR66U3/PBn4RcLYHeaPruwKWHv9jlOE86ZsmkeNt+sn+f6UPeFs8nAgCbQVswPs6m0Y7OYHrwk7+/3nvBNmtG0Nghu/uDP/44lSforUN3TzpkKgCQqbR3f/DH9pO5ri9HpiVHEEM23vvz1K3v/LbvUok7qUmjyfz7idxb3tomd7vzSE2LFACOXa24+4M/BvgOAoDF6uqZjnCDdG4M3jtY3SJR6wxPbdmLZ9txhTWtn+85BwA/Hcm2/evAZZXWf3vgEjF6zeAdMwBo9cZ7P/rz630X3dk5gY8XR9TDL0BMcV3b+ld+2nY8h5BtJ5AoNG9vP/HwF7vcPIZBOjcQBEGQDGH4N1NuFzFG4vRuAjr7w4mbnkxagrLtyND7J7u435fVuy4VOb1imZEYwbAZAelCkNDL6RTFebUtxJDbzBbL7ktFxCgyyFh02uS4MGIUQGcw7btM7CLtvr3ZTn5fIEOmqKGVEOFzmE7/ZkcFvGe6yWQRi7uHr125UgsAcbEBCfGBAFBQ0KjXd986cqy97qn9DL2SkuY33/wHX91041SbRmTscOsLGEFs1bV1vvHbMTy9RadSogJ9vHksk9nSLFE0ieW2G58vqv189/mH186wDWIYNOrKqUlbj+VgqwezSx9bP8udPrMms+XwlXJ8dcH4uJ4eZbFYH/liV05Fk22QTqVEB4mEPJZaZ2iWKNplKgCwWuGd7Scobvd+JRDL1Xqj6eHPd+FFcgCATCLx2AwalaJQ62wvgmemRuHLjmakRGw73vWa4PwE3AAhz4vN1BtNrVJlg/1kKTWt0ue+3//5f1z1msd1yFWXyxuf+/7AwN9BAJibHhPk42Ub0eiMPx7OxlcXjI+NC+kewOWop5KRg23wzo3BewdrWqVbj+WI5Wo6lZISGWA2W/NrmvHfZn+dzl8zLeXrvRcBgE6lJEcEkEmk3Kpm/H7Jb8ev3rl4km3lGdzgHTMAPP/DAdvXOcLfe+XU5IRQPw6TrtTqi+vadp0rbJEq8A28uaznb14YKuKH+AqYdCdHi8sub3jsi90a+9sPwSJ+oJDHpNPkah12iwJvOl9Ue8+Hf/7w5A2uf3wO3rmBIAiCAECad+hvMx94OuePHKmTPrnDgkwirQub+HDCQj4N3UNFhkd1m/RkYdXc1GhiQ2/0RtPPJ7qqXBIsnZBADPWARaeF+gjqxTJCvLihrbJFEhPoQ4i7Y+fFolbZ0FWCQnBLxsc7LeP+w7HLqycn0yh9/vFV2SI5V1pLjCJDiPB7BwDaZEqZWivgjMrvLF+RF41GMRrNANDWrvDz8wKAujqxRKICgPiEQL4X68jRIoPBlJ/fMGlSJPaojo6uH4x47XVP7WcIWK1WrdYolaoqKttOny47c6YM76O5eFHquHFObpIhY4CrpAOCOPXW78exXG2Qj9dDq6fPSYu2LY5c29b5yc4zJ/Oq8MjW4zmb5mWI+E66qW6YNW7b8RwsY6jWGQ5ml66bkUrcyMGZwhqZSouvrum5nszvJ69mlzXgqwwa9YGV09bNSOGyGHiwslmyZf/FI1fKLVbr69uO4fE+6ZCr3t5+orC2FQA4TPqGWeNmj4tKiQigkMkAYLFaGzvk2WX1x3MrW6XKMD8B4eG2piSGx4f4ljV28FiM2eOiZ6dFjY8NIdRSb5EqvjuQZVvL5UJx3ZWKxgmxbg0r2/zZTqPJDJ54B2emRM5M6frqwkgUatuE+5xx0csyE23aR4rBOzcG7x2UKDRb9l+KC/H9dPMaXz4XALJK6x/6dCeWUjeYzA9/sUtvNCWH+3/4wGrs/cqvbrn7gz+wP1ilVn+1qnlygpOv88E75tP51SdszqXrZqU9c8M827ou05Mjbls08aWfDh263DVSslOlpVLIMcEifBunOuSqp7fsw68+qRTypnkZG+dkBAh5+DZmi+V8cd2nu85WNomxSGl9+5u/HX/51kX4No4G79xAEARBMH5Mr++n3fVHbfbHpYf7UdLdg8gk8qLA5LtiZsV5BRDbEGRovbfr1JT4sL4W/fjm8CWneW0/PndOiqtePgTpUUGOCXcA+PnElVc3ubpwcqpdrvpk71liFBkSC8fFvrvzZKfN72VMo0T+3ZHs+5dMIcR79e7Ok/0efoF4hOOQX5PZ8uK2w2/ftqyvnxgjAYkEgYGC+noJALS3KSAFAODylVqsNTkpWCjser6XL9dgiXKrFcRiFQCQSCQssQ6e28/gWbvuY2LIXuakqCeeWEKMImMFSrgjfYZ11s6ICf5081rHruUR/t7v37fqxZ8O7rvUNWbNaDLvOl/odNrDMD9BZnzYpdJ6bPXvMwXuJNxtK2aE+QnSY4JtGrtJlZov9pzHV+k06tePXpcWFWizCQBATJDP23cvT4kI+PDv04Qm9+25UNzWqQSAzISwt+5aRigxQSaRwvwEYX6C9TPTHAvqOXp47cwOuWrxxPie+uEGCr2ev2lBiC//k53dF7KHLpe5Tn3iDEYTeOgdHKUG+9wYvHfQbLG8fudSLNsOAJkJYSumJO4+3zVct1WqpNOo7967Er87khYVuHB83IHsUmw1v7rFacIdBu2YfzxyGV9ODvcnZNsxdCrlldsWl9S31bfLsMhfp/MJN3IcvfjjIfzGG5tB+2zzWsePAgqZPDMlclJc6CNf7MJz6HsuFK2cmtTTYQ/2uYEgCIJgSEC6ISJzaXDqz9XnttVcHPq0ux/Ta2lw2sbwyUFsAbENQYZDo0T+3K8H3799hePFUk/OFNd8f7S7p4utm2ePx7r+uGlGYsSeLCdlQ3ZnFS1Mj52Z1MuFma0OuereL/6Wa9yqPYh4HJ1K2Tgj/cuDF4gNAF8fvjguInBqQjixoWfv7z59sbzr1zoyXCL9hMQQwKmi6tVv/LhmcsqkmJAwX28Bh0mnUkdLnZmgoGuJ8mv9zbHC6xQKOSUlmMVieHmxFApt9uXqB2AeAMhkapPJDAAiEZdK7f5k89R+hh6bTb9p07SNGyeTRst7hvSd88QKgrjm48X++MHVjrlaDIkET98w90RuJd759HJ5Y0/p2utnj8MT7iX1baX17QlhrqZOlat1Zwtr8NVVU3vs3r7vUont2Kv/rJ7umDXD3bJgwpWKxtP5TgbfuQPLtk+MC/n8P2tdX9r2lM20NTXJrWugWxdO3HOhGJ88llABwzUPvoOj0WCfG4P3DiaF+0fbj+qdnxGLJ9wBYHZalG0XbwCYEBeCJ9wJ9YJsDcYxq3WG/OpmfPXGeeN7+gFJp1Kunz3uvT9PYauXSuvNFouLP6UrFY345wYA/O+mBY7ZdhyTTn39jqVrXvoBf9O/P5DVU8J9sM8NBEEQxJYXjbU5fsGd0bMONRfsasjJ62ywwuB2pAxlC6f6xiwMTJ7oE0lGv3KREeZ4fuWj3+35v5sW28501ZPjBVXP/rLf6YxK/gLuxpnjiFGX5qREc5h0p7PdPP3z/g/uXDnFWWVwRyWN7U/9uM9pZ3lkyNwyd/zvZ3MdO7lbLNZHv9/z1i3L3CleZDSbP/7n3C8nrxAbkCG3anLSt0cvOf6tt8lUXx+6+PUhYpyATCbxmAwei+HFZkYFCJND/VPCAlLDA4fxOxCf7xQr/2IyWfLyGgAgPj6QzWYAQEZG+KlTpbW1YrFYKRLx8BLtAf52hdc9tZ+hQSKBUMhNTAyaMD5i4cIUNptO3AIZW3rP/SGIowdWTrOtruCIy2LMTI3Ca0SU2FQ2J5idFu3vzW3rVGGrf53Jf/6mBfab2Dl0uQwrhwIAZDJpxZQk+/Zu/9h0hPfxYm+Y3ctF5/3Lpw4kccagUV+/c6mLFKHHkUmk+ekx3x3MwlaxpL+bPPgOjkZDfG70pB/vYEoEccB7QqjdDapJcaG2qwAQ6ivAl7HK4wPRp2Murm+znUC4pxw3ZnxMd6vBaKpr64zquWAoPvcDACSE+i2d1EuJUhGfszQz8e8z+djqhZK6DrkKHyhga4ScGwiCIP8qbCp9bdiEtWETxHrV2fby8x2V+Z0NLVoZcbt+YVJocV4B8V4BKYKQyaKoQJaAuAWCjCSniqrXvvXzfYsnr5iY1FPnmJZO5VcHL+zOKnJMwGGeWTfXnV4+thg06nXTUn867iS7qtYZHvp6540z0+9cMEnIZRObr6lskXx/LHv/lZKejgoZMhwG/fFVs17Y5iQRqzOYHvt+z6pJyfcvmRIkdF5Sw2S2nCqq/mjPGXTjZIQIEwnWT03763zXb5m+slisco1OrtGBRF7c0LY3uwQAQkWCdVNS1k1NFXB6v73ncUGBAmyhU6oGgOLiJq3WAAATJkRg8cxJUadOlQLA5cs1S5akYXVgACDg2gMxntrPIPn227t4XCYAkEjAYNC4XAbqz/6v0revYQQBAAaNunhiPDHqIDHMH0/XKrX6nvqrksmkdTPSvvynq4bDwezSx6+b3dPFJdjXk5maGO4ncJIyAwCpUoNXbQaA2WnRvU7OmRDmF+Tj1SzpGovUV8snJzrN3w2qSJuMpFpnMJktVIqTF5nAs+/gqDP054YLfX0HI/yFhIjQi00mkfDOTY6lz20LHOkM3X23+839Y+5UaPBlMonU018rxte+1bFLDk6jN54pqMFXl09OtGns0dTEcDzhDgCXyxsd0/Qj6txAEAT5FxIxuGtCx68JHQ8AUr26TNFSr5Y2aCTNGlmnQS0zaORGrc5sNFnMRqsZAKgkCpVMppEoNDKVR2PyaSwvOktAY/sxvYLYgiCWdzDbO4TtjXqyIyPZtIRwuVpX1NDdu0WsUL/+5/EPdp+ZFBuaGh4Q4sPnsRhkEkml09e1y7IrGy5XNdr2aSBYPiFhXloMMeqGO+ZN2nmxSOGsFIzJbPnlZM72s3npkUGTYkIDvHkCDtNitcrUOplaW9MmvVBW1+asY8dTa+fsu1JSVD+gvjttMpVMrVXpDGqdXqkzqLR6lU6v0hqUOr1Kq1fpDKprQWkPF5DzXviay2RwmXQui8Fh0nlMBodJ57LoXAaDy6JzmXQuk8Fh0nkshg+P42b+0WS2NEnl1/5pg/LaUal0BtW1A+sK6gxOC+ycKqxe9PIWDpPBY9I5TDqXxeAy6FwWw/Z48KMN9Ob16SbKqsykY/mVJwuriA0AVivszir653Lx+KjgSTGh4X7ePBbDaDJ3qrWdKk1BXWtWeYNaTxzrcP30cS2dijPF3Rfh/TAy38pR4dn1c9tkygG+/rYaxLKP95796cSV566buzij9+SAZwUGCbAFaacaAHJyarHVCeMjsIXMzChsAUuUd3Rc65keYNcz3VP7GSQ+Qi6f3/1jHPm36cNH9r/WBcnV98q2AECyV+yrKY8Rm/99xkUHcZi9D37x5tl9sqi0Bn4PX3jrZqRs2X8Rm9dRoze6mDq1rq0Tm5gUs6rn6VJL6tttVycnujUEclxUUL8TZ/PS+3NdO0Bc+zfCYDL3lPq05fF3cHQZ+nPDhb6+g0L7NwUAyCQSg07VXquC4pjUptmkjHVuTCHQK/eP2bY2C5XSS7qDZl9EDx/I4qigpgWbJxaT2UNVegLCrYjCmlbHhPuIOjcQ3BVx44uXD9arOuP5fm9kLovj+xK3GD2ON1fec/qP7tUVD4Rzu0bCIiOHWKWe/sE3+OoH65ctTx6KH6I5Dc0v7z9WL5XH+4v+b8XCWL8eR/n8SwgZnKm+MVNH8V88grjl+unjksP8b3x/m1ihto1rDcbTRdWni/o2kC4p1P/FGxYSo+7x5rKeWT/3uV8OEBuuMZjMWRUNWRUNxIYezEuNvml2Rk27dIAJ9we+2lHVKiFG+0Ki1EiU3R1BXFg7JeXljW69gGXNHZve30aM9oXRbG6TqQCc3Khw9MV9a6cnRhCjLr1+8+JbPtpe3cNLZ7FYL1c2Xq5sJDY4kxzm/9+1s78/mj3AhO/IfCtHBSqF/Ok9a34/m/vuzlO2P4UGSKbWPvXT/uzKxuc3zCe2DSa8FExnpxoArubWAwCTSUtK6ioT6uPDjY72q6pqz7laZ7WCWHItUd5DSZkB7gdBBoPzLAmCuBDr0IXWKULPUJO5x/SZjxdn7rjubPVfNr1QCWy7t/M5zDlp0TaNdmy7qQJAZIBbv1rD/fuf+EjtudDz4HGdweyJx9/B0WXozw0X+voOejm752E78sDxpgjFpmy6i85Q7nP/mG3LFhlMZvyugFMylV3HH29ejwOW86tb8GUSCcL9BN1tPfNi29VQkjq7Uh9R5waCsQI8dmF3qaxdYzJelTQ9n91jFgBBRjUrwBM7DpS1ibVGY25jy4v7jhK3QBBkLKKQyZlxoX587tcPrHdRrcVNMYE+n96zmknvf6e65RMSbps3gRjtl/FRwW/dugwAEoLt6h8iQ4bLZHxx39owkYDY0EcxgT5f3LeOTqUkhKBboMPmYnn9i78d+urgRQ9m23F/nst/f/dpYnQwBQUKsB+VMplGrzeVlDQDQFpaqO1EpljndJlMU1PbgZeCCQy0T7h7aD8IMhj6/2WM/GsF9lDrbSA2zB53JKccWy6tby+ua0sK97ffBKxW2JdVgq8uzUyw7bpLILMfgxbk49YxO/YOdhODRuW5LInePxartbS+vaJJXNksbu9UyTU6uUqrNRj1RpPeaNYbTXpDfzosD8Y7OIoM5bnh8Xew15GkvW7QKw8ec0yQXcK6pL59fGyPU5sW1XUPXqFSyCGiHq+BbAvHW60w5eFPbRrdRTgNnAYH9dxA3NShVTWp5fhqvrTFYrX2MlwCQUYhsUrdLO8eK1PQ3IZOdQT5N0iLCOQw6AAQE+jz4yPXP/rtnuo2KXEj90yMCXn/jpUDr6Hx+KpZNArl2yNdE/b0z7y0mNdvWoJdl6Is7TAK9Ob98PD1j363p8DmSrtPJsWGvnf7cuy8ikf3TobDqaLqz/adK2+26xjkcT+fuDIpJmRWchSxYXDQaBSRiNfRoVQqdUVFjSaTGWwKr2MmZ0b/9ttFAMjPq8cnO/W3LwXjqf0gyGDoZ2rmviv/E+s7t07+kEnxfJIRGeHcqUbSVxPjQqICfapbusaX7Thb4Jhwv1zR0CrtTrStnpZi00ik1OrxZRIJWPQei8LbYvVcO9411xOQ9kNVi2TbsZxT+dVO++EO0GC8g6PI0Jwbg/QO0ig93mTC9FTdxR0eP+aIAGGwiN8k7sqW7jxX4CLhvutcIb6cER3s4ix1Wlq0r/TOqusMzbmB9AlhZiEyiYTmGkLGJMJp7alTXW8ytSpUAODL5bDd+0xDEGQoTYsPx5fDfb23PbHpwz1n/jyf36dRiQwa9Z5FmXctyPTUXbr/LJ8+LiLw9T+Pt8q6f3y5icdiPLR02saZ6fixxAaKyGRSn54R4kEiL86PD9/w1cGLP524bOi5ZqMjBo1614JJdy/MxEfTBnrzBBymTO2BS3HEHVqD8ZXfjxzI6ZpWjYDNoMUF+frw2DwWg9rDj0SzxWI0m7V6o0ytbZWpWqQKfOovR+/vPj0tIWIgPyf7JCjIu6NDabVac67WYRG88DomOTmYw2Go1frCwkapRAUAZDLJz5fYI8pT+0EQj+tPwr1Z2ybWdxKjyL/GQEYpurBhVtrb209gywezSx9bP4uQcdt3sbt7e3yIb7zLvhK2k0PSqVQ3Lz7dzK85sq3aMUA6g+mt34/vvVjs4rtwgAbpHRwtBvvcGNR3kOy5M83W4B3z9bPHffh31/jEfZdKJieErZiSZL8JAMBPRy5nlzXgqzcvdDWWWaUlTuLkKYN9biD9IGJyQjmCBrUMW53sF+be24Igo4wPlxMi4DfKuu5QZkaEeORU31dU9uzuwwDw7tolq1LdmmIaQZChNDWhO+EOACw67bnr5l0/fdwPx7MPXy3vNT3KYdJXTUq6Y/4kf0+Pt5uVHDU5LmzHhcI/zuW52eneh8dePzV106wMb67dnEMMGjXSTzjAyt3IQFAp5M3Lp62bmvLd0ez9V0psp1lyikWnrZyUdPu8CcE+xF7A8cF+l8rrCUFkMCi1+oe+3plX211LE0OlkNdMTl47JSUp1L+v99i0BuPV6uY9WUUHr5Y5/uyrbe88XVTdvymX+yEoSJCXVw8AV6/WAYBAwI6MtBtCQaGQJ0yIOH26rKy8Va3WA4BIxKM43A/w1H4QxOP6k3fLk3XnPRHEU1ZMSfpk11msyrNGbzyQVXrdrDS8VWcwHbtaga+67t4OAEybFJiL2RcJrODwtTO01DrDPR/+WWo/cyOXxZgQGxITLArzE3hzWXwOk8Wgs+hUJp16trD2lV8O226M9GpQz43R+A4O6jHfMCd9z/miqmuDV1786dDpguqVU5LiQnzZTLpKqy9t6Nh5tuBsYQ3+kPkZsTNTIvFVR7Z3jJh06pREu1+qbooKdFKffVDPDaR/SAAfTF31wuWD9arO8aKQNyYtI26BIGMCCeC9tUte2n+sXiofHxr02ooFxC365VxVV28vBPm3+V/BK/WaBgB4PP7hDEH3b4rhdfPs8TfPHk+MOogJ9Hn9piVPr51zsaz+UkVDVaukUSJXafV6o4lBo3qxGaEiQVyQ7+S40Clx4YPXk4ZBo944K/3GWenVrZILZfXFjW21bZ1tcpVSqzMYzRQymc2gCXnscF/vuGDR1PjwcRGBthML2drxzK3EUF8M8OGDJDnUP++jx4hRGydaKu47/zu+emTxQ+FcoU1773IkDS9dPVCvlsZ7+fkGD7TEf5DQ64Xr5z+xetbFsrqsioaKFnF9h0x57bzishhhIn5MoGhKXNiU+HB2DyM4v3lwPTHUFyPwrVw+MXH5xEG5IR0f7Ov6DHHtuV8POmbbI/2F79y2PC5IRIi7iUWnTUsIn5YQPjMp8rlfDxKbAU4X1wxhwt0bW6ioaAWA8eMjHG8fZGZGnT5d1twsw1YDAwW2rRhP7QdBPK4/X8958lJiCEEGjMOkL52UsONsAba642yBbcL9eG6lWtfVrZVGpSzNTMCbnLLtHW+xWrHLCJt25wav56yb3vztuG3eM8jHa/PqGQsnxPZ08Tp4V9hj2KCeG6PxHRzUY6ZTKR8+sOruD/5sl6mwyNGciqM53TfPCCbFhf7fHUuIUXu2E8PSqdQP7l9l0zggg3puIP02XhSyb8ndxCiCjDkZoUF77ruFGB0AK8CFmu7BQwiCjC5ebOaijLhFGXHEhiEXFeAT5d5M8ogHWQGeyNrZpJEDQK606cWc/b/PuZ24Ud+xGbR5aTFDllRF+mfXpaLTRdWEIDa7skeGsyyfmHi6uOagQ7Gai2VDd58+KEiALZhMFnCoA4PJnBQFANZrvfED/IlDLsBz+0EQj3OeT3FBbzYUysuJUQTxhOtnj8OXSxvabZOA+y4W48tz0qJtM25OETZosSn+7oJ8WAvS1bV17reZFTbMT7D12ZuWTIrvKe8JACazhRhCejN458ZofAeH4JhDfAVbn900d1w0scEem0G7f8XULx9Z32uO28eLgy8rNDqDs2rs/TN45waCIMjQK23tkKg9MycHgiAIMsTEOhWWbccUdDZ7vPYjMjJZrfD90WxiFODx1bM8km3HrHDWr79Nrhqy0ywosKtnOoYw0ylGJOJFRXXXhwlwNtOpp/aDIB7XS14DU6Wqz5eX1Kgba9VNzdo2fPj8TZecDJBZG7zo5vA1xCjAX40Hfqv/BwC+m/SWgOYFAHWa5iOtZwoU5RJ9pxWsAppXBCc4XZA8328qmdSd68mXl75S9AkABLH8P814CY8T/OfqK83aNgB4KfnhNH6P3Z/1FsOZjuwCeVmVql5pUmnMOjqZ5k3jB7P843iRE7xTIjghxMf0RmVSv1T0ca26EQAiOaEvJz/MpXbngxD3xYX4josKyqtuxlZ3nS98JmweAEgU6ktl9fhmq6Yl48s9iQ22G2ZV0yKJ8Lf7IHaq1r0ChYPkaI7drawnrpvd630FmUpLDCG9GbxzYzS+g0NzzD5enOkpkeeL67CpSgVclkZnMFksXCZDwGXGh/pNjAtZOinBzcmHUyMDbFeL6toyYnqci7VPBu/cQBAEGXrnqoeunxoycI9efUpikG6Z+DmT4ta3IYIg/yqemkwbGfnyapvrOjoJQV8+d0lGPCE4EMlh/sQQgMVilat1hGkYBgneMx0AQoK9/fy8uttsTM6Mqq7u6ojp7yxR7qn9IIjHuZVw39968mT7RWK0v6QGuYDm9UfDvj8a9tuWvm01d7TqOqpVDQv9p9ts7klH285trd+tMHZVNsDozPoWc3uLrv1yZ8G+lhNbJr5BITmf4tkplUn9ctEnWLY9hhv+QtJ/uNSBllf7N9swOw1PuB+6XPbkhjlUCvnIlQp8Xns/AXeqGyWbE+2/P7LLG+am9z5urqSujRgaQg0d3V0YyGTS1KSI7rYelNjX3R4ZRvqF4OCdG6PxHRyaY373j5O/nbgKAGQy6YnrZm+ckzGQ3wsTYkPIZBL+mXC2sMZTCffBOzcQBEGG3vnq7s4KyAjXomuVGNDtWwRBuomY3BCOoBGfN14UPoDLZ2Q0ya50Ug5uSlzYQH5AORKwnWfVVTr90CTceTzm8WPPEKMO7rlnzj33zCFGbXhqP0799OO9xFBvHnpowUMPLSBGkX8ltxLus0STIq/1+zaYjVvrd2PLt4SvpZKJuekYbi/J0E6DfLs0/4+GfQDAoNBDWYEMCkOql7XrJWareYJ3L5Nh9tu31dsPtJ7CV1kUZhDLn0VhdBoUYoNUbzYAwBy/KX3KtqtN2leKPqlRNwBAPC/qhaTNLEovnUMR1xaMj3v/z1OdKi0AyNW6iyV1M1Iij17t7oS7YkoSmdz7V42Iz4kIENa2dv10OZFb+fj62VSXU1G3SpXF9cOZOFPp9Pgyj8VwfbQAoNUbzxXVEKPDjTDBzggsbz1458ZofAeH4Jj3Z5Vi2XYAeHz97BvnZti39xmXxZicEHahuKvn5t9nCu5ckmlbfr3fBu/cQBAEGWJSjfZKfRMxioxUhfLu2okIgiCATaY9ae1LV/fXq6XjhaGvTVhB3AIZo6qv/RixFenGuNs+MVudlwll0Z3Pl4sMmVPF1Zu/3w0An9+1ZlZipNFs/vtS4YGrZbUdnSqdXshlp0cErZmUPD3eeer1YkX9PV//DQARvt7/PH07sfmalW//WNvRCQBb7ls/JTYMC/52LveNnSdiAnx2Pnlru0L19q6T58vr2Az6wtTYh5dOx1I9v53L/eX01Xa5KsxXcNus8asn2dWfGODBjzFuJdzHCRLHCboKPKlNWjzhviRgVj/GPB5vv3BJkiukC26LWDfVJwNPcGvNumxpfgg70H5zzzjYehrPtsdyI24KX53sFYsXrrGCtVRRnSXN61PnerVJ+0rxJ9XqBgBI9Ip5PvGhfrwaCAGdSlk9LeXHw101y07kVqZGBuZWdfV5B4BVU3uvJ4NZNTXpk51nseW2TtWOswW2NeId/Xg4e6jqlTnHZ3ffrVFq9TqDyfXslN8dzBqBxaNZDBqDRsUqhwBAaUOfe0MPgUE6N0bjOzgEx7z1WA62QKNSXL/O7rt76WQ84a7Q6P5v69E371pmv0k/DdK5MXqZLJbUv941WMwAwKUx8tY/QdwCAAB+rbjy0pVD+OpDydMfT51t095t4b6vq5USAKCSyQXX/Zduf9t+V23hExf32EYIloclfTJtDTHasw6desquj7HlW2MnvjRhEbZssVpPNFcebiwr6GxtUsu1JgOHxuDTmfF8v0y/0LURqUJGnwertWmV++tLjjdXNqhlHVoVg0L1Z/HiBX4rwpJmB0bRyBQAwP6PjC7kaz3KLFbryYqao6WV+c2tLXKl1mDkMOh8FjPOTzQpPHh1WpKwh85ijvYUlPx350Fi1May5PgP1/fhY80KUC+VlbZ1lLZ1lLaJS1vbm+V2s1D8d+dB1//i1Wc2s9Fv7OGDEu4Igjga7xPyz4I+d7BFRjuZ2kkBT77b1xhuahTLiSEAMonkZfPzEBle1W3SmACfR37YU9rcgQdbZcqDuWUHc8uWZSS8vnGx685h/VPXIdPojfd9s6OyVQIAKp1h69mrzZ2KT+5Y9VsrWrEAAQAASURBVPWRS58dOo9tVtEifn77YSCRVk9Msns8AAzfwY8orhIrg+Si5KqQLngn7WlvOt82zqIwZ/lm2kY8RWvWba3rukkwwTvlqYR7qSS7J04CUqJXdKJXL3P62VaW15i1rxZ/UqWqA4AUftxzCQ8yKB7oX4kAwHWz0n4+chmbrONSaf2lkjq8dkR6THCYn8B2YxdWTkn6Zt9FnaEr8/vRjtPJEQHJ4U5KlQHAidzKv87kE6NDKzrIB1+2WKyHr5S5uLuw42zBD4eyiNGRITnCP6eiq1fd4ctl96+Y6ue52V08YpDOjdH4Dg7BMVe3SLAFi8WqNRh57hVqdy0jJnhGSuTZwhps9dDlMgqZ/PxNC1zfLQAAmUq7P6s0IyaIUD0GN0jnxuhFJZPjBX4F0hYAUBn1jWp5CMfuuxuTI7brSJsr7r5LaktrNtaquvrsxPP9CNn2wVapEGMLV8VNz2Ttw1cxCoNOYdA1qGRHm8o/yD91V/zkR1JnUdwbu2uwmL8qPv9l8XnszgRGZzbJDbpyecc/dUVhXO93Jq+Y5BsqoKPfMKMPi0YDgKsNzc/vPVrZ0fWBhlHo9AqdvqFTfqys6qPj5++YOuE/c6a6edp41kt7j27PKSBGkVFCb9GXKMqIUWRghuHvEEEQxBMMpu7rSZzWYCSGBiarooEYAggUetGpQ3p9jriQX9+y50pxRYuYy2SMjwzy8+Kq9IYr1Y0dCjUA7L9aarFa3725D/0z3GQ0m9/Zc7JBLF88Ls5gMp8oqgKAE0VV+6+WfXnkoh+fOzUuvKSxrbxFDABfHLrgNOE+XAc/ovSSmxgkd0ZuIGTbB9Xx9gsasxYAWBTmf2JvI2Tb3ce61oFda9a9WvxppaoOAMYJEp9JuJ9ORn2CPCbIx2t6csSZwhoAaJYojudV4U1r3JguFefjxblv+dSPd57BVnUG070f/vnAiqlrZ6TaVp9okSq2HsvZfjLPYrFSyGSzxfnQqiEwMzXq/b9O4b1l3/3jpK+zgvVVLZIt+y8dvlwGAHQqxen38fCamRqFJ9w1euODn+x49bbFSQ4pS6sV5GqtYEgqxBEM0rkxGt/BIThmAZfZ1qkCALPF8uDHf9+1dHJqZIAXm0kb2MXca7cvufmtbU3Xumbszyq5VFp3/ez0GSkR8SF+eOEpqxVaOxW1rZ0FNS1ZZfX51S0ms+XjB1d378jeIJ0bo1qqMBBLuANAqazdacL9itjukj1P2myxWvF+wbgyWQd2MxUAUoVOBrQ5PsSDqhRiADjYUPrIhV0ml2+Zzmz6vPhcQWfLt7Oup9jca3dKazbeeXJ7VoerYtn1qs4bj/3y8oTFc4JiiG3IiMdl0A8Ulz+540Avp43J9OWZS4UtbV9vXE0h93LaeHziO/PYHmsz4jVrW86Iz5cqytt0bVqzDkjAprB8Gb5h7JAkr8R0QZrjKNgadV2hvLheU1+vaWjRtuHzWt1z+SH7DQEAVgQtvSF0PTF6jcQgPdV+pkBe1K7vUJs0XCrHn+mXLkib4zeLR3XV42F3096/GncBwGfj3+fT+ADQoGk83n6qRFEmNXRawcKn8UPZIWn8lNm+M/COR0fajv9cuy2EFfxm2iudBtmvdb8VyIuZFOYk4fgNIeuwZ3qk7fjB1iOdBlkA039pwMKZvn0YQ9wnhfLiUx1nK5SVcpOCRWEFMQOm+GTO8Z1JJVOpvf06a9d3XJFeLVWWN2gaFUalyWpkUpg+dJ9ITsRUUWayV9fwblsefO79+NcJCuXFZ8Xnq1Q1MqNMZ+6uEEjwXOJ/E73iiVEAo8V4VnwhpzO3QdMoNynoJJqQLkzmJ87xmxnC8szUOAiC9A+H4aQrZ5PESYf0frNYrdvP5hGjAKnhAcQQMnyO5FcAwIapaU+umIVX7rVYrF8cufD1kUsAcDC3bPG4uAWpnv99sSOr8Lv7N0yKDgGAD/ed/f5ENgA8+9uBcJH3toc3cpkMo9l848e/lTV3NHcqqtok0f7d3fgww3jwI0c/U88DwaWyp/ikE6ODKV9eii3MEE3kUTn2jX3ApDABQGvWvVb8WYWyFgDGeyc/FX8vrbfrOaSvrps9Dku4AwCW4wMANoO2YHxc90ZuuHnB+NMF1Vcru5K/Wr3xg79Pf7b7XEywSMhj6wzGFqkST9iRSaQPHlj1+Jd7hit3FuorWDopcX9WCbaq1hke+mRHfIjvuOggby5LbzRLlZrC2la8vzCdSvni4fVPbdkrVWq69zICXDcz7cdD2XjhkeoWyc1vbQv1FYT48mlUisFoVmp0UqVWolDz2Iwjb99n/+ghMhjnxmh8B4fgmJdMSvjp8GVsuaiu7fGvnBQMIZNIHCbdm8eKC/HNjA9bPCm+147wfA7zwwdWP/TJjg65CotIFJov/zn/5T/nyWQSj8Vg0qkanVGjN7p+1xwNxrkxqqV4d195l8naFwTH2jQCALRrVY1qu98AKqO+SiGO5fvaBgGgpLMNX3aacF8VnrwoJF6q13TqNVK9tlOv6dRrvi652Ka1K47RP21a1aX2ukcv7MbTpnQyJYYvEjE5RoulUSVruDYvGeZ0S/X7+aeeGjfXNkhgtlrvOf0nIdtOJ1PiBL4+DA42JgA7eCvAKzmHe03fIyNQraTzpX3Huk8bCiXG10fIYZkslsZORaPM7uQ/U1n74YnzT86fYRt0tDIlYWFCjFSt7dRoOzXaTq22U6P99tzlNmXXB1pfLUyICRZ42UY0BuOWc9n46uKk2AR/4p+kLdSjrX8sVsvvDX8dbDmCZ8wBAKygsCgVRmWVqvpE+2kmhfFB+tuE3PeR1mNnxF2DsvvNCtZdTXv3NO8zWboGZgGA3KiQGxXlysq9zQc2hV8/23emzSOc6zTI+DT+zqY9Oxv/sX0iOnN7m669Vl0/12+WzeYAAK26Np1Z/07ph43aJgDQmrWHW4+J9ZLH4jbvatr7d+MubLMGTeM31T8AiTRTNM324QNntpq3VP94TnwBjygtyjKjskxZcbTtxGNxm7k9/+gT68Xf1fzsWMZHbdKoTZp6TcOpjjMZ3uM2x9xHJztJew3wuQ/wXwcAvUX/ReWWnM5cYoMDEpCcfu8UK0q3VP8g1ncP2TGBSaNtatQ2HW49tjhgwY1hG2zHdiMIMpRCRQJiCOB4QeVT6+Z4qm/KD8eyq1rtBu1hZiZGEkPIsMqMCX1x/XzbCJlM2rx4WqNEvi+nFAC+O541GDnrtLBALNsOANdPTcUS7haL9a65E7lMBgDQKJSFabFlzR0AUN0mdUy4w/Ad/MgxDAn3KE4YaWgH+VUq67CFFH7f0rUEbArTbDW/W7alTFkNAJOEaU/G393v/vKIC9OTI4JFfDylhVkwPo4wIWevKGTyJw+tefCTHQU1Xd0zAcBgMhfXdSd9MGQy6cWbF85MiQz1E+BTJg69ZzbOLW/qqGzqLnRQ1thR1thhs0kXNoP23n0rx8cGp0YGnsrvHgQwEnCY9LfuXr750522KciGDllDh6x7o+E2SOfGaHwHB/uYH1gxtbJJfK6olthgw2K1KrV6pVZf3y47mlPx0Y7Tm1fP2Dg3nbidvZggn23PbfrvN3ttp3kAAIvFKlfr5GrbWB8M0rkxetlmxktlTmZluCJuxBbiBX4NKpnGZACAq5Jmx4R7saz7NUxzlnAHACaFGsT2CmJ3pw531BZ4JOEOAHec2m60mAEghMN/Im3OguA4NrX7a6VaKXk798TRpnI88n1Z1u1xk/xYPXYR/bk8+0JbLb7KpFAfTZ29MTqdR+u+Y1Qu7/is6Oy++hKL1fr85QN4HBktXtl/HMu2Bwu8Hps3fUF8NFZkBlMj6Xz36JljZd0fiT9ezLltcoYvt8dkH4ZJpQbxeUF8Hh7ZlVfS74T7nNjIObF2P5LFKrVtwn1BfPSq1N77zCJ99VfjzgMth7FlX4YonBPGo3JNFlOHQVKvrseG2EZzox17mk8VTQ7jhGLLRovxj4Yd2PLGsOvwCa5wURznGZAt1T+e6TiHLQto/DheDIfKURpVZaoKpVGpMWu/rf6p0yBfE7zC/nFEMqN8R+OenU17AIBBZgSzAhkURqdB1qEXm63mdEEq8QEAJqtpa/3vbfr2yT6TjBYjlvzN6cy9IMna1bTHm+6dwk+qVdc1aBoBYEfjbo8n3L+p+v685BK27E0XxPPimBSGRC8tU1Y0aZvfKv1ARBfaP6KbF82rVt11o5ROpodzQv0YfnQyTWaUlyjKdGYdAFztzPupdus9UXfYPRIABvzcB/ivA8CXld9i/yiTwlwcsCCcHUoj01q0rUfajnfoxQBAAtJ90XdFcML8GL6OPcNyOnM/rfjKZDVhe4jnxQrp3nqLoUpV3aZrt4L1YOsRmVH+UMy9hAciCDI0nHYzb5Opfj+Tu2lWBrGh7/6+UPDpvq7vDls8FmPBOGLHGmR43TJrPDEEAAD3L5yC5awLG9rqOjrDfb2JWwxMSmj3SRgs5HMYdLXeAAATr2XhASDYu+v3mriHrnjDdfAjxzAki71oxCvOwaY0df168WM4ueviPhaF+WXV1jxZV1fQdcGLUbZ9kJBJpPUzU/GpCzGr+1JPBsdh0r957Lpv91/6+egVYw91MIJF/BdvXjgpPhQAIgOEw5g447IY3z6+4Y3fjuP9+p0aFxX00q2LIvy9ASA1MsD91OeQmZwQtuXxDS/8eJBw12REGYxzYzS+g4N9zB1y9bjooNyqZrXOQGzrgUZvfOePE81SxePriV3qCHy8ON8+fv3+rJLvD2bVtnUSmx2E+ApWT00aFx1EbLA3GOfG6BUv8GVQqHqzCQDK5E4S7jnXEu7jRcFeNEZ2RwMA5Eqaro8aZ7cdQMm1hDudTIlzSMcPAexZTPIN/X72DWwqsedgFM/nq5nX/ffinp21hVjEaDH/WZ33ULLzggASnfqDgtP4KoNC/XXuTRki4kj8OL7vJ9PWpgmD3sw9RmhCRgWD2QwAE8OCt2xa6zitaKSP9+c3rHp618Hd+V3Xh0az+c+rhQ/OnGy/ITIG6cy6Q63HAIBMIj8Qfc8Un0m2rRarpVpdc1GSncp3cgWbyk/G4xqzBk+4z/eb61h/xqmjbSewbDuFRLk1YtNcv1l4lyaz1XK49ejvDX9ZrJa/G3eFs0MzvIkfyLZOd5y7LM3xpntvCtswSTgBz/hrzdqczrxglvP7o6fazz6b+CRWrmR7w997mw8AwFdV3wYw/V5K/h+bwjJZTS8Vvl6vaRDrJU3a5mBWL1++7svpzMWz7SuDll0Xsgbvjq0yqb6r+fmyNEes7+5JQEAn05cELKzX1M/ynZHslUgld/+g05i1X1d9h6Wzz3ScXx+yRkh3kggYyHMf4L9eqii70nkVABhkxhupL/syRFg8XZA233/Oq0Vv1mkarGAV68XTRVPsHgkAAGK9+Kuq77Bs+zy/ORvD1rMoLLz1nPjidzU/GS3Gi5KsRK/4eX6zux85CN7KP/J9xUVs+fSyRwJY3ffaG9Sdu+sLLnbU1iglcoPWCuBFY4ZwBMmCgMm+EbMCYjgOX+KOjBbzxY7abHF9iay1RimRG7Uqo4FBoXKpDD8WN57vnyEMXhycxO/X9CptWuWBpuITLRWNalmHTsmgUP2ZXnF8v+WhybP8o/sxU/ru+oL/Zu8iRm0sC0n+aPI6YrQvLFZrjqThdFtVVkddu04p1WusYBUxuP4s3jS/yHmBcUkCJ3leZOhNSwhn0Kh6Y/fQJcxH/5wNEPDmpfW/R7BUpflwz5k9WcQRNphNszJ6nRALGUokEuDdzAkifL1DfQQNEhkA5Ne3ejxnHSDo7hECAHw2U603kMmkwGtJdgDAC646nqswrAc/cgzDn5PtVcUQ0JsNZmtXN1sWpT/fprhTHVlSgwxffbdsi+PUr4inrJmW8tU/F/BS0aG+gowYYhbDTQwa9aHV09fPTDuSU36moLpJrJAoNWC1+gq4iWF+c9NjFo6Pw+dHjgoQnrB/+BDzYjPfumvZ3Usy/7lYfLWqqalDrtTqAYDHYgSL+MkRAfMyYibFdXWJAoC0KI/9evGs9Oig3a/ccTKv6nRBdXFda4dcrdIa6DSKF5vhxWaG+XnHh/omRwzzVd1gnBuj8R0cpGOWq3Xv/3Vq/6USvGw3iQRebCbbvi6hyWwxmEwKjY5QgvjXo1emJoU7FpQnIJNJK6YkLZucmFfVfKm0Pqeisa1TJVNp1XoDk0blMBkBQl6Ev3dimH9mQmhUoLu3XQfj3BilKCRygsAvT9IMALVKqd5sYlDsvsfxHu7JggAWhYYl3K/aT6MKAFaAMlnXyIkkb39qb0WuB4mIydky63rHbDuGBPDShMWHGsuxfvoAcLG9rqeE+87aQnwzAHgybY5jth13d8LkrI76Y00VxAZkNBBx2F/duNox244hAbywdO6R0krNtQnNsmobUcL936BZ12qwGAAgnB1GyLYDAJlEjuFGx3CjCXGP0Jn1fzbsxJZvj7h5jt9M21YKibw0cBGJRNpatx0Afq7bliZIdVpaBJMtveJN93415XkBze53DYvCcpq0xURzo/Di4PP8ZmNJZ4vVsiJwKZvCAgAqiZopnFCvaQCAZm2LBxPue5r3YQuZwonXh9qlILlU7uaY+18ofBXrYN6T1cHLiSEAAGBTWA/G3PPo1adVJpUVrCWK0umiqcSNBvzcB/KvZ3fmYAsL/Ofi2XYMnUxfF7L6w/LPsM1WOxvZ8EfDDq1ZCwCZwol3RN5MaJ0umqI0KbHTZlfTP7N8pw9Z97IOnQpLuGvNxncLjv1WfZkwNYVEr5bo1XnSpm3VV2b4R30/4ybbVoI8adPWqstHW8pURj2hSWMyaEyGdp2ysLPl79rcV3IPbowc/0TKvJ4uDBwZLOavy859XXrWyUzpiva9DYVhHO+3Jq6aKAoT0LtvZgy7062V7xYeL5N3dX3ANZg6G9Sdl8X1nxSfmuoX+WzawgS+P2EbZIh5sZnLJyTsuNjV/wOnN5oe/+Gf9VPT7lmUSciHuma1QlFD656s4t1ZRTqDk9woAAT78O+cT/wiQ4aXL4/rtKA/JibAB8tZV7VJiG0Dxmfb5U6x2Yn4LKZtUSN82Wlt1WE8+JFjiL5BhwB2veuITqGRgISVI9T3sI2bpAYZCUhLAmcXyyvqNE1Sg+zt0q9fS3nMcaTeGOPjxcn58jFitDeLJ8Yvnth1JdoPFAoZbP6YV/Wre7utACHvlgUTblkwgdhg76HV0x9a7Ty3QvDY+lmP9db9tt9igkVu7nxiXEiv786wvIMAQCaT5mXEzMvo/034oeHxcwM8+g5ueXwDMWTv9AcPEkM2Qn0FrveP8+AxA4BEobn7gz/qrvU6T48JvmPxpAmxIT0VhjKZLTWt0iNXyn88nG0yd31n/3LkSq8JdwyZRMqICe73bbmeDMa5MRqleAdgCXez1VohF6cIu2+V6cymos5WbDlZGMChdV1XVSrEapPBtgNanVKKp6edFnAfGo+lzrKt9+KIR2PMC4rZW9/V96fw2rNztKO2AF8WMTk3x/ZynjySMhMl3Eeph+dO4zFcnjYMxtzYqH1FZdhqUQsxo4GMSXhPcKmh02gxDuUvgnPiCxqzBgCCWIGz/WYQmwEAYJH//EOtR8V6iVgvyZZecbwlYOvm8I2EbHuvorgR+LIvQ8SkMLFyKAk2U3SKrmWE5UYFHhygdl1HlaoGW3ZaLYdCIi8PXPxV1XfEBvcwyIxxgpRz4osAIDE4H742eM+913+9Rdv1rRTGdtJzMIzd1T2iVevkU0hulGdJL2PLPU3DO89v9l8Nu/QWfadBViQvGeesoNBgaNMqU72hU6+569y2ws4WYrO9mf6ufly8kXf4x8pLxGgPjBbzL1XZ59trfp9zO9+N/LjWbLz77LZscVdRIKfq1Z03nfrpxfSlcwJdHSeBp2pzOzJbLS9e3f9nzVVig4ML7TVrjm15Nm3RbTGZxDZkaD24dOqh3HLH8cFWK/x1Pn/XpcIJ0SEzEiPign3Dfb1FXmwapXs4hdFsVmr1HXJ1s1RR0yYtbmjLqW6S9FD0A8OgUT+4YwXq3j7SeLFdXXx6c7o+shRa4p3FgXM6tY/tadarYTz4kWPs/EUpTWpiCAAASEDiUNkqkxoAxHppDNet3I1TAprXUwn3xvOixHrp0/nvyIyKClXt55W/Php3B3FTZMAOZJUaro1MIZNIK6ck2bcjCDKivfrrETzbvnhi/Bt3LnP9O4JKIccGi2KDRRwW/eMdZ7DglYpGk9mCdyRHhotdGXd5u23CPV/ajJW3ppDI8Xxfr2u5bIvVmidpnuYfgW9pW8B9uBLuTAp1ZXjvt29ThIF4wl1h0JmtFseeoRKdusymov2C4Dh6byPHk70DQjh8wgSzyMjHpFJXpPR++zk5yB9PuCt0erPFgvUGQsawEFYwj8ZTGpVyo/z9sk9uj7w5gDlEPUPxKTczhRN6mhyLTCJPEk7ASsznywtdJNw5VPYk4XhitDc+9kXSuVSOzqwjk8gimxqe+PDinrpG9UOFqgpb8KELQ50lnQEgxVkZH/f50LueApZGdzSoz931v262dvWqplOc9BzE51m1gJP+hkWKUmzkdyg7xI/pS2wGgGtl5cuVlQBQqiwfsoR7h06lM5vuOf+bbbadTCLxaEw6mSI3aG27k88NjMWXHc0OjHFMuPuzeEFsvheNqTebWrSKOpXdzYwqpfjxrJ3fzdhkG3RktlrvO/c7IdtOJ1Pi+H5CBkdl1DdpZPhM6a/lHaSQltlu6drK0JSFQQlSvbrToOnUazsNmk69Zkv5+QFOY2OyWO6/sP10a6VtkEIix3j5ihgcs9Ui1qurlWJ8NKrFan0971C7Vvnf1Pm2D0GGmC+f+8qNi/77417CCGCMyWy5VF5/qbz7VKSQyUwa1QpWo8liNHf/sbiDSad+fPfqhBA/YgMy3Fzfh2PQutK5Gn3fvmXcQSY7+6edxXoyjAc/coyChDs+kM1kcT74BQDEeqne3OP7FMUJzZeXAkCxonKKTwax2W3BLP94XhQAiBjCpxLufanoI6PFdEacHcoOXB+yhLg1MjB7LhThy1OSwv0EXJtGBEFGtNpW6ZmCamyZSiE/fcNcl1+4dhZkxOIJd6PJLFVq0J//sEvped7UnGulY2L4IgaFGs4TetGZCoMOAK5KmmwT7iWdw59wHy8Kcafqqw+DbbuqNOgFDGKvN0LP9+kBEbarPRkvCkEJ91EnIzSIQ+/9tBGy7U4Spd4gYHWl25CxikIi3xi24Zuq7wGgSFHyVN7zaYKUOX4z0wVpg12Io0Zdiy2Ec8LsGuxFsLtaq64lqZ2K4ET0lLV3gUPl2K5iVdQ5FLbtrkjX7lbiFT4Hrknb9b0Twu5xWBuf5sWhstUmVz06XcDHLjjLdAEM8nN3/a/jZWRatK3gbd8G0Kzrylb7Opu6rPrayIBQVo8vHQDgYx0k+qEb6d+uU76WezBf2gwAXBpjU9SEeYHx44RB2A1vi9Var+682F57pLm0WSOP4Nrd8CCY7heVKAgokbV60ZjzguLmB8ZNEoUL7b/ZmzTyr0rPbq/JwSNn2qqyOuoyfV11zvulKutiRy2+yqRQH0mac33keLuZ0hXtX5Sc2d9YbLFaX7zaVfvITUwKNYjND2J3jzXZVZ8/wIT7e4XHbLPtIgbnkeQ5S0OSvGjd31BSvWZ3fcHnJacVxq57PFvKz8d6+a4JT8O3QYbewnGx/7tu/ht/Hcdvh7hgtliwOS37KsSH/+7ty5NCh+huMdInTmuj43TGrkqGhHqtbtK53PnADerBjxZ9vhak2nTg0pp1bs7qMxAcate3o9QgN1pMNGcl4K90didnHaUJ4rGE++mOrE1hqzxyzPG8qAejb/644kcA+K3+n1B2YKZwHHEjpL8qmyXFdd2pmbXTU2waEQQZ6a5UNOLLiWH+Ai4xWekCPvsKMnLE8UVMClWHzZtqn3C/0tGALSR7+wMACSDZO+BCWy0A5NqXcS+59kAWhRbt1ZUvGGIJArc679Dtx0saneVK8Hr0mBj3nlGUl5MMCDLCxfu79eYSxt6a+ti/DBmlZoqmMcj0n2u3yY0KK1jzZAV5sgIulTNNNGW+35ygHqYbHTiFqSsHJ6AJ7BrsCegCbEFhdJWz86L258Y2zdlNhSGYrAsbuAwAXjQv+xY7XCrXdcLdCtZqVU2hvKRR2yjWS1QmtdasM1qMRqvRRTcvzMCfe7//9YnC8ac6zgLA4dZj8/3nsCl2eeQ9TV0Z3gxBum0cIzd23fE9L7mEzzrrAv5SD4EdtXktWgUATPWL/Chznbd9fpxMIkVwhRFc4cao8djViGtPpsxr1yqXh6Yw7WedwQWz+a+NXx7K8X6v8Bge3NdY5CLhLtGrPyo6ia8yKNSfZt6S4UMcYxHn5ffR5PVpwuC38o8QmobexY7aH65NSwsAcXy/X2beQnhtAUDIYN8RO3lJSOLNp35uUHeNT30pd3+GT0i4y3sbyGDbMD0tUOj1wtZDUpWrT7P+oVLIN85Mf2DJVPTja8TqVDsZ54TDywTx+9XDQ65xtfOBG9SDHy2cfwO5wCDTGRQ61p28TtM0BFOGBjH9aGSq0WIyWU1Z0rzpogmEDQwW457mo4Sgrfl+0/9o2G+wGJUm9ZdVWx+Nu6MfnTgczfLNbNC27Gg8ZAXrRxU/vJHyZASH+I2L9M/vJ67iy/7e3Dnjom0aEQQZ6SSK7otCPqdvX6L17TJ8mUwiibzsOpEhw4JCIicK/K9KmsCxh7ukK6ue7B2ALaQJA7sS7pLma1sBABRf6+Ge5O1PcX/Ig0cFczx20SLV2/3yCXFvz/6sPsxwhYwQwXxXST0EyRROTOOnHm8/daTtuFgvBgCVSX249diR1uMTheM3hW3Aa3l7isVqMVq6uobRXRaOZ1wrMILNk9mT/vXHx7p1Oxj0j3d8Ui7Xzx0vruLUZWnO9oa/W3Xd/Xv6ZIDPfSD/+jhBahwvtlxZITPKn8t/eVXwslBWKJ1Cb9O1H2o9gpWC8aYLVgQ5GX6tcXkaOLI4u988SLBs+2Tf8O9nbHIs42arpxy6rZn+bv14vDtu6o66vGqlGFt1XZl9d32B7UzpjyfPc8y24+6MnZLVUXe8pZzYMLQ+KzmNd43mUOnfTd/kmG3HBbK8vptx4/IjXxstZgDQmoxflJ59e+Iq4nbI0JqRGLHrudu+PHhhx4VC112G3cdh0ldlJt06Z0KQEF3hjGgKrU6q0gi5zv9sK1u7BiHFBtp16MErrRt67vzRIlNqDV0XEoOkfwc/xvT+deUogRedJysBgF/rdkdxwrxo/ekT4T4amTpOkHhZWgAA39f8Gcjyi+J0zQYDAO16yWeVv7Tq7DqaEXjRuNeFLN1WvwcAzoovy43Km8JWx/IibLeRGRWF8vI6TdNNYatt465tClvVpGm7JM3Vmw1vln71TtrTfBr6LT1QdW2dtvVkNs7JQFVQEWR04bK6BxI1ivtWQGP7yVx8OTZY5Lx+HDLkUoQBWMJdqtd06NS+TA4AVCkkMn3Xr/cUm4Q7tiDVa+pVnWFcbwCQ6bX4mOjhqicDAO7Uk3GT0qjHl0kALPf2zKa6Sg8hIxNnTI91RTyCSWEsC1y0NHBhobz4dMe5K51XjRajFazZ0iuF8uLH4jYn2sylOXBkEplOpmOVwQ3XMu9O4blpFqUPQ81GOPwuAn7XwSkXyeJ/mvf/0bADW+ZSuWmClHB2qIjhw6GwGRQmg0w/1HoU60U+GAb4r5OA9GjcQ++VflStrpUYpD/U/ErYIIDp/2jcQ1xnoxYY5K7Ls0hORDQ30r7RicEbouEUk0J9P3Ot62y7Z5FJpEXBCV+Vdr3aLRpXl6w76vLwZRGDc1P0RJtGJ/6TNGt4E+7Fstasjjp89d746b3e9Y/g+twak/ld+QVs9Z+GgkeT5wSyUE52mPHZzGfWzb1n4eQ9WcWHrpaVNrW7UWPGiUBvXmZs2OyUqBmJEXgFbWSEO19Wt2JCIjEKUNkqae5UYMtpYXaf1V7Xfol3yNUGk9np9KdnSroqjA2qfhz8GNOfP7PlgXOxhHuNumHz1ZeSvGK9aXyDxaAya6R62dLA2fP8phEfMzAbQpZd7Sw2W80yo+KpvLcSvaKDWf4mq7lF21GhqjFbLdHccG+6F5aUd2pdyOJ6TfNZ8WUAKJCXPVPwDp/GC2D6Msh0nUXfrpPIjAoAiOCE9CnhTgLSI7G3/6/wvRp1o1gvfbv061eSH3Va9AZxk95oev6HAyZz1yWyiM+5YU663RYIgox4UYHd409rW6Wn86tnpUXZtDtntcL3By8dyC7FI0sznXxDI8PCNkteJmv3DYgEgBxxIxahksl4nfcMUXdl2KuSJizhXmIzY2qaz7BdV7E8l+/WmroTPQwK1c37QiyKxw4AGTJM9KMUcQ8JSKn85FR+ssqkOtZ2an/LQY1ZqzVrP6n48v30N9keTXnzaV4dejEAyAwyYpuNzmutrquvjC54ERWlyzo5PZVDadA0/tmwE1teFDD/htD1jn3h2dcqmnqcR/51HpX7bOJ/Xyp6rVnbSiPTLFYzCcgcKieMHTJJOGG6aIrjPjFe13qGRXMjb4u4yb5x+K0OS/Nj9pIR9rgYXvcAFLXJYLJYqM56ekn06nJ59wi/+UHxvc+ULggMZguaNDJiw1A53NR9RU0mkdaFu1X/dkNEOp5wN1ksh5pKbo+ZbL8JMjx8eOw75k+8Y/5EiVKTV9Nc0the29HZLFFIVRq5Rmcwmk0WM4lEolEodCqFy2J4sRg+PHaQ0CtYyI8O9EkI9vNH02KNQj+fzlmWkeDYBe2bo5ewhXHhgSE+dgNtw3296VSKwWQ2ms3HCyuXpBNv+euNph9PXiEEB0M/Dn6M6c9PiAneKRtCl/3ZsB8A1CZttjTftlXjbDr1AYrhhj8ce9tnlb9gvUWKFZXFikq8NZYb8VTCfcfaz7lIuJOA9GjcHRGc4L8aD+rMegCQG5Vyh6s04ongBgaF/kzCA0/nvy0zKsqU1V9Vb/tPzK3EjRD3lNa3v/H7sSKb6u2PrJ3JpPfnLEXGsENlFb9eyStp61AZDFw6PUTgdf/UzCUJscTt/mXqOmULvvoBALIevd+b5clf9f2QGR8m4nPE8q7fuk9/u+8/a6avn5nWU2cKtc5wtrBm6/GcwppWPBgs4q+fmWqzVR+MqFdjbMA7sANApUI8IyASAHJt6sngQ7z9WTx/Fg/rz54raV4dngI2BdxhWHu4exCL2n0yGyw9Dtgk6FeHJARBRhkulbs6ePkUn0kvF72uMqlVJtWVzqszRZ7skBTNjcIS7jXquonC8cTma2rVXf1bozi9d2ceLYLZQdhCo9aucJktnVmnMHb1niO4ILlkBSsARHDCbw7f6LTQqLqHZP3AeeRfN1gMb5e+36xtDeeEPRn/CD7Haa+iOZHH4CQA1Glc1U4ZLguDE4ihwce1me8UAAwWE9XZ7Yqizhbb1Wl+bv1BjfcJGcaE+2VJ97ucyA/otXs7JoonCuN411+r5J7dUY8S7iOND489Ly1mXloMsQEZi0qa2v+7df+L6+fz2V1lWi0W6xeHLxzILcNW75mf2b01AADQqZRpceEni6sB4K3dJ8N9vROD/fDWZqni+e2HGiQyPDJ4+nHwY4zz3EevNoauSBckHmo9U6aslhrkVquVTWUK6YJwdnA8t/dujP0wQzQxjht5oPVUgby0TSfRWwx8GjeUHTRDNHG272QKiRzS25A3EpDWBi9e6D/jZMelAllZraZJaVIZLSYGmS6kC0LZAclecdNEPV6wuiBieD+TcP8LRR8aLcaT7RfDWIGrgxcSN0IcfLHn/Kn8Km8em0GjGk3m+vbOZondlfHccdHLJ6P+rYid36/mv3DwGADQKJQAHldvMhW3trPpqNPoyEImk565Yd6T3/yDreqNpvf+PPXZ7nPjooLC/b15bCaNQjaYzFq9sU2mbGiXVbVILBa7VCSXxXjzzmVoDp+RI4bvy6LQtGYjAFQquqqd5ku7fn+OF9mVMc0QBR9sKAWAgmsb4FOtcmmMSN5YKNVn+xPdYrXqzCZ3qsraFqJBEGRs82f6TfHJPNp2AgA6XFa/tC2hrrPomBS7DKBT6YLUi5IsAMiSXr4udI3TvK3FarncmYMtp/CT7BtHsZhrPzY79OJmbYvTsifFilIsr+0Iu1EBAHG8GKevGwBgldAHg0f+9YOtRypV1QDwYPS97mfbASCFn0QmkS1WS5Wqpl3X4cf0JW4xrNKF3SPkhkxP7wJBmaK73wAAuDn3+/Be8ORLu3pFAEA8vzvd1qt4vj+ecL8qabBvRBBk6IyPDG7pVBzOKz9dXD0xOiSAz9MYDJerm9rlKmyDVROTZic5ScDet3DK2bJak9kiUWo2frQtIzIo0ldotFjqOzrz61vNFktyqL8vj4Ml5QdJvw9+LOn9x2FPEnjRCbxoYrRn14UsvS5kKTHaF35Mn9si1hGj10z1yfh72hfEqAMulbMicN6KwHnEhp65s+dYXsTvUz4mRhGXNHpDRVPXRaejhFC/1+4Y0AmDjEmfnr0EAKtTEl9fuoBBpQKAUq9n01DCfcSZlxHz1PVz3/vzpOValUGdwXSptP5Sae+dqiIDhO/dtzIyQEhsQIYPhURK8Pa7Km4CgEq5GAAMFnO5vCuFlOFj9yM53acr4V7S2Wa2WikkEp6jT/YOcOun7YgnoNuNnGjWyKPc+F0tN3SVvEcQ5N9Ae23gL4fqagJwOpnOIDP0Fj0ANGgaBfzeU6iTfSb9Xv+XzChv1bUdbzs1338OcQuAw23HxHoJAPBp/Mk+E4nNo1YgMyCCE4513t/V9M+DMfcStwA42HqEGLqGdq3/ssJhrDPmrPh8/6YzdYdH/vVCeTEAUEiUAGYfsqgA4E33nuKTeV580WK1fF/z838THqWQeqmLMmSYFKoXrasLpAdZrNZiWWupvK1C0d6qVcoMWplBqzUZdGaT3mLSmY16s4n4GGc6CTOlswW2qz1xs1P5YFAZ9TqbpxbCEXS39QYrBoiR6NXYhZxNO4IgQ4TNoH1z3/qHf9hT0y49W1pLaF01MenV65339E0J9X9945IXtx/Wm0wWq/VKddOV6u47cKlhAR/dvnLnpaJBTbj3++DHkv4n3BFk8CwcH/fiLQvZDJRFRew0yRXtKhUAPDxjCpZtBwAeo/eOYMiw2Dg3PSUi4KOdp3Mqur/gXYsL8b1p/vjlmYmOtd6QYZcqDOxKuCskAFAqazdZuubbmEDo4e7TNd5fZzZVyDsSBH5Viq6Z6NOE3aVpRrV4gV2ao1Iudifhjr8OCIKMAbub9nXoOyb7TErgxdHIdletVrCe7Th/UXIJW03lJ9u2OorjxRTIiwBge8PfEeww3rVa2z2hkqi3RGz6tOJLAPilbpsVrPP95+B9dS1Wy5G247/V/4mtbgrbYNuJfgxYGbT004qvAOCCJMuf6bc2eBX52kybOrP+t/o/ShRdw9UdRXEiznScA4CrnXlN2uZgVtcXFgBYwXqy/czPddu6t/Y0j/zrWIl2s9W8rf6PJQELvOlC9ycavT50XYG8SGlUFilK/q/4nRvDNsTx7ApTGCyGCmXlVVm+1qy9J+oO26ZBxfN0tr1C0fFj5aXjzeUSvZrY1nf9nCmd4tZmg0FutLvBT6ic4xqX2r2xFUBu0AoZvcwrgCDIYJBrdBG+3n8+ftNfFwsO5ZbXdnSq9QYhl50eEbR+csqU2DDiA2wsy4gfFx7w27m8SxX1jVKFzmgUctjRAT7LMuJXTkikkMmR/oPbuW0gBz9mjKlrL2R0SYkInBjX0dAhV2n1WoORy2T4eXPHxwSvnJqcHO5P3BpBAKSarmvHIP7YmftrbEuJDPj28evr22Un8iqL69pqWqUSuVqjNxpNZgadyqLTOEx6sIgf5ieIC/GdlhQRIOwlxYAMo1TvrmH7nXqN3KArvFYuJpDtFcC2e+NShIFUMhlLxxdIW0RMDv5LdWwUcAf7ovYAcKG9blFIvG3EKfxFQ5BBhzokDj6dRXeq4+ypjrM0Mi2EFeTP9GNT2Fawyo2KalWNzCjHNpvnN9tp2RNbiwLmYwn3OnX9k3n/S/CKE9D4BotRbVZ3GmQL/OfO9p1BeEimcMKqoOV7mveZrZafarfuatobz4vhUDlqk7pMWSG/VsF8ScDCaaIp9g8d9TKFEzOFE7KkVwBgV9PeUx1n43lxLApTZpCVKSs0Zm0IKziA6Y9X1LE1TTT578bdKpNKb9E/X/hqpnBiEDOATKKI9eJ8eZFYL2ZSmKtDVvzduIv4SE/wyL8+23dGnqwAAA61Hj3UetS2iU6m82leUdzI2b4znN7m8aELH4l98IOyTzRmbaWq6rXit3hUrj/Tn0FhGCx6mUEu1kuwajzpgjTigwcT2XMfWVqz8dXcgzvr8vBBlgOHldTD9GGmdM9N1d5XGpup3QGAaX9H0DXCYatMepRwR5BhYTSZAYBBpd40I+OmGRnE5t4EC/lPrpxFjF6zKC224L3HCMEbp6ffOD2dEASA/c86uf86OynKcQ+4AR782IAS7sNp1/envn51FyH44c5HEzLCCcExacmk+CWTek9PIAhOa+y6dqSS3e3I8+/h5qX/sAjzE9y2cEgHs4/kV2P0SrXpnN6kluPzoBIKuAMAk0JNEPgVSlsBoFTWHsnr7kAxZhLufixutJcP3mP9cGPZ/9IXuP5oatYo8KL2CDLYOPazm6j0BttVxCPo13JYRouxRl1Xc22GUhyZRF7kP//GsA2EuKN0Qdra4JU7m/4BAI1Zk9OZa9uqNTuvRrUhdK03XbC94W+dWSc3yrEENI5BZqwPWb00cJFtcMx4IOYeUhX5kiQbADoNMqyiPSacE/ZY3OaLkiynCXc2hf1o3EMfln+qNmlMFtN58UXbViHde3PM/aHs4B2Nu3uqAj8QHvnXxwlSp/pkXrB5yjiDxdChF3foxZck2bN8p98ddbtjjfJ4XuzLKf/7pup7rBC80qRSqroq6trypguIodFAZdTfcvqXIpndty2PxsgUhcfx/SK4QiGDw6ez2FQai0JjUminWiufu9I155ALTEr3J+qomCmd0KXd9oZBrzQmu+8Lnk2HdwRBhtIwfoYM3Kg+eE9BCXcEQUY0hU7/n51725SqNpUKzxfEvvkhvkFmWMjWm4g/Zcs6xN9funKxrqFDrWHRqPG+onWpyevSkmy7z2gMxnHvfxYr8tl/z61Z9Y1bLl7Oa25V6vUiDntKeOiD0ydHCr1tdtnFbLHsLynfW1JW2NIu02rpVIoPm53g5zsvNmpdKnFGMncOox/MVuv2q/l/5hVVSSQ0CiUlwP+uyRPifZ1P35Tf3LqnuDS7vqmuU6YzmXgMeoyPz7KkuBsz0myTg3O++C7Ii/fNhjVP/nPwfG1duLf360sXpAUFfHLmws9XcsEK69OSn5430/bI3dwzbkd+0Z95RaUdHY55H8c30f2Xrk+vBjIQ0V4iNpWG9ZlqUMtKuxPuTmY5y/AJxhLuFXJxsrcMCwroLNvCoKPd+si0d/JOYMutGuVvVVdviZ1gv4mdb0ouoEtPZMiwaDQmlaozddXwLWqxm/EP8Yi1wavieXF5svxqdV2HrkNlUhutRjKJzKGwA5kB8V5x00VTApnu1tFaF7I6hZ98vP1khbKq0yizWq0sKsubJghlh8Rye5w3a4H/3EnCCSfbT+fK8tt07RqzlkNl+zP9xvFT5/jN5PdlRs3RhUqibo65b5Zo+qmOM5WqaoVRyaKygpgBU30mz/abQSVRg2yqtRDE82LfSnvtUOvRPFlBu67DbDVzqJwApl+G97j5fnOYFCYAhLCDGzSNxEd6wgD/9aNtJ/5u3KUyqSkksh/Dz5suwOuwm61mrVnbomvTmXUAcLrjXDg7bFHAfLvHAwBAIDPgpeTniuTF2Z05ZYoKmVGmMWtpJBqf5hXICojjxWQIxoWyiXfTR4VXcg/YZtuD2YInUuYuDUnqqeoOyyaT7gLXpoZMX2ZK75rFYegJaHYzzahM3SVxeqWyr5/jZT9pDYIgCOKm3r8nEARBhpHVajVZLD4ctg+HrdIbitvaASAzrPs3QKK/b/fWAADwe27BywePma1WCpnsz+V0arXZDU3ZDU37Ssq+3rCaTrGbHqq2U7ajoPiZvYdIJFIAj2sBa6tStauw5Eh51V+3bYwR2RVlFqs1D/6952pT13U8g0rVGox1elldp4xOpRAS7n06DPdZrNaHd+49XFYJADwGw4vJvNzQdL62/rFZ04ibAuQ1t17302/YMotGC+BxO1Tqy41NlxubTlfXbtmwxnbjCrHklcPHz9fWA5BK2zse2vHPvVMnfXr2og+bLdFqvs+6EivyuW5c1/DkPu0ZAJ7df/ivvCI6hTItIozHZOQ3t9Z1ygAg0d83MyxkQojdr2L3X7o+vRrIAJFJpESB/xVxIwA0qGT4jKmOPdwBIN0n+JeKKwBQoeioV3ViwZSxUsAdsy4y7dPCs3ivsbdzj4/zCUrroQv/4caybZVO+loiyOBJDfbPrmvClvcXlT08Z6o/j2u/CTJQSV4JSV4JxGh/xfFiCAW13cGnea0OXrE6eAWxoTf9e9RC/3kL/ecRowDvj3uTGALIEKT9MvlbYtRz0gQpaYIUYhQAevunBTT+DaHrbwhdT2y45o3Ul4khzz33/v3rALCv5eDv9X8BwDhB6h2Rt/jQnVTgNVstfzbs2NdyEABOdZx1mnDHJPOTkvnEziKjWq1Ksru+AF+N4Ar/mHsnYZJzAqPVre7q3vY1VVo08kg3Jm6RG4Yt4c6i0rxoTMW1jH+9Smrf7kqdzcZCBgfNmIogCNI/KOGOIMiIxmcx8b7PuU0tG37+HQAcu7TjLtQ1vHTwGJVMfnnR3OvSkrGu1udq6v6799DZmrq3j595YeEc2+2NZvMzew+tTE54dv5sEYcNAFcamzfv+Ees1nx4+vzn61biW1qs1gf+3pPb1MKh0x+bNW1ZYpwvl2O2WBpkitPVNePtU8Z9PQz3bcvJP1xWSSGRXlu6YF1aMoVE0plM3168/OHp88RNAcYFBaxNTUry910cHxvoxQMAo9n8Y/bVd06cOVlZk1XfaHvrQqbVNSuUlx97QGMwLtvyc6tS9eax09/dsHZWVMTXF7LfO3n2UHkFnnDv057P19b/lVfEoFL/vv1GrO+5yWJ5bPf+g6UV/lzu8wvm4FtCH1+6Pr0ayMClCgOxhPvF9jqsAxSTQk0S+BO3A8i41u29Xasq7GzFlsdMPRmML5PzcMrMt/OOY6tas/Gm478+mjrrhqh026HcTWr592VZv1RcMVutFBLZbO2aaRZBBtuc2Cg84a4xGO/8dcfbqxenBBH/YK0AMo3Wm+0qJ4UgyLAzWAw7G/8BAA6VvTnmPqwvvCMKibwmeOX+lkNWsLbq2ojNY9qBxhLb1WfTFrnOtgNAp955vSaCOC/7mdKVHe4k3KuVYmJoCI33CT3ZWoEtl8r7MMjJduMMHyedKhAEQRB3oIQ7giBjynsnzlis1sdnT9+YnooHp0eGPzd/9mO79/92Nf/RWVN5DLtahCmB/u+uXILXKpkQEvTg9MmvHj5xobbBdrODpRW5TS1kEun7G9bi6XUKmRwhFEQIidOA9OMw3PRDdg4A3DIxY8O4ri5dTCp184wpJW0dh8sr7TYFAIB3Viy2XaVRKPdMmXiwtDy/pe1qU4ttWhwAbpuUQadQ6CzKvNio7bkFGcGBs6IiAGBBXPR7J89ifdJx7u/5aHkVACyKj8ErvVDJ5AemZR4srThTXWu2WCg2JWj69NL19dVABijlWsb8RHPXy5smDHJaQSic6+3NYHfqNWCzseuEu85sUhr1SqNOadCrTHqlQa806pVGfYdWjW9TpRD/WJ7NpTF4NAaXRufRmFwanUtl8OgMN0eFe9ZdCZnHmyuyO7o+KzQm4xtXj72XdzJe4OfDZGtNpmaNvEElw1rJJNLXM6+778xfKOf+L6czmVQ6vVJvUOr0Kr1Bqder9AalTi9W2ZzqYsnPl65yGHQeg8Fl0HlMBpdB5zLoXAaDRXP36n3jhLQt57Jl2q4ejpUdkvXfbgsXCkK9+XQKRW8yK3Q6iVorVqm9mIxzT9xn/2gEQUaWRm2z3qIHgDB2aE/ZdgydTCOTSGarFZ9m4F+iXt01og4AKCTSTP8eazHhiu2rvfck5dq88ZiL7bULg3of2lLY6dbOB8kk3zA84V4ub2vSyIPZvdeYqlB0NGlk+OoEn9DuNgRBEKQv3L1kRxAEGflaFMr8ljYAWJEUT2iaFBoMAEazOa+5dUak3bzEG8alECqDpwT4A4BSr9ebTAxq1+ckVrdkVlQEoTO7o/4dhjua5Ir6ThkArEwmXuUvTYxzP8UcLvTOb2lT6on1HCO8u+prY2UH8Py4gMUEALW+9wmXnO65TakCgFC+3VV+CJ8PAGartUOtCbhW5aBPL52nXg3EfbbzpmLwnuyO0n2C8FQ7xkXCvbizbeWh74hRB6Wy9tdyjhCjAACwbd5Nk/36/Dc1QBQS+bvZN9x24rerkq5+xABgsJgdJ0elkEhvZC6fGxQTwfPGp1odFX7Oy335ZFcvfgqJVPHwY/btdjbv33uhseHATbf6cTjEtt58fzXn/06f/Hjp8pVxxD//QTWQY+6HktaONd/8Sow6KGsTv37oJDEKAAC/3LohM8KtLodcBv3D9cvv3rbTbOm+x1MnldVJZdiymW21UIFmcVIuIHPLV2wa/eTtdxIbBsHd57aebasiRp3JWvmUF81VnhFBxjB8+lOsRLsLF6XZ2J3d4J4L2Y9JtjXTuTSm0w4BtrQm46lWty4XfZncKJ4I77F+pLns2bRFrvffrJEXdjYTo0NoWUjyB4UnsDPBCvB3be7DSbOJGzn4qzYXXyaTSAuDidfYCIIgiJtQwh1BkLGjtL2rqPSMz7bYt3STqDWESJzDBJscetfMSGZL9xyH5R1iAJgQ2vtPl/4dhjvwPuaxImLVTqdTvAKA1mjcW1x2vra+Uizt1GrVBoPeZDaazQBg7X5yXXiMrieO1UnnMbs6kmM3JCz23XLd37OQzQIAsbq78yYAdKjVAECy+Uehjy9dP14NZICieD5sKl1jMuARpwXcMRk+wbYJdyGDHcT2smkfIzhU+q/zbvq86OyW0ktGi/NSsKFcwZuTlk31jwCAaC/R6Eq4L4+NixEKO3W6t8+eblEqic32rABsKs1xcmOP21tedrS66qMly4gNfTdkx+wpF5oatpXmu/ncp0WF/Xrbhqd2HWzolBPbAACA5PBFgCDIyBTMCmRSGDqzvkZdd7TtxAL/ucQtAIwW4+mOc9vq/8BW5/jNtG8f4/g2BWRURp3WbHQ9+u2L0jMyg1slZQBgXfi49wqPYcutWsX2mpyboifab2JnS/n54f18DWbzl4Yk7W0oxFa/K7+wPiLddSf3GqXk16psfHVhUEIYB11RIwiC9BNKuCMIMnYo9QYAIJNI4UIBse0aFp145c21Sfi6gPXaFjB771vXv8Nwh9pgBAASAItGfDh+k8AWXo+eTCLF+4nSgwL5TAaTRjtTXVsj7SRuDUCl2HXVcTFLUp/2PCcm8vfcggOlFZtnTMEKvgPAj1k5AJAZFmJ75H166fr6aiADRyaRkr398QoqADDeRQ93kd3dKRfd20c7JoX6RNqcG2PG768vOd5c2aiWiXVqq9Xqz+KlCAMWhcQvC03E+8HFePkctn/4COfDZk9jhwHA15eze024f75sBTE0OI5WV7WpVMRovwzZMXvK5dYmU1+qEo0PDTq0+Y5jpVUnK6rzm1vblWqV3kCnUPgsBp/FjBB6JwT4pgURB68gCDLS0Mn0FYFL/2rcBQA/1W490nY8ySvBhy6kkChGq1FhVLbq2sqVlVpzVwY5Uzhxhmia7R7GvFgvX3zZbLUeaCxeFz7Opt3OHzU535SdI0Z7tjY87fOS0/hM6e8UHE0TBqV6O++Ic6S59PfqK8TokHsocebR5lKd2QQAWrPx7rPbfpl9q4jhfDhXq1Zx97nf8K4DVDL5gYQZ9psgCDIUZidFFbznakTpSDaqD97jUMIdQZCxg0OnAQAJ4OA9t7nfXREfousam06Haxlh1/p3GO5g06gAYAXQmUzMa7VuMDqTyXYVALRG00N//yPRaCaHhXy4epkvt/vy+qEd/zimxd3X1z3Pi41eEBt9tKJq2bc/z4+N5jHoec2tBS1tfCbzxUXzbLfs00vXp1cD8ZTf599CDPVgun9k1cbniNEeJHn7u7+x+3yZnH7sdkVY0oqwJGK0N0Fsr7sTJt+dMJnYYO+JtDlPpM0hRpG+MFut5xvqo72JQ1s8RcTllL3Y558Ky5Pjlyf3XgwnMcC3HzvHma3Wqd9+3dfnTiGRFiXGLEqMITYgCDKqrApebrSa9jYfMFvNzdqWZi2xfBmGTWEtD1qyMsitcTBjydyA2DfzDuP9yv8v75AfkzfDP8p2GwCoUHR8XnJmf2MRANDJFEMPo9MIfJnczUmz3i3o6uSuNRtvPv3zo0lzNkRk2M2UrpH/WHHx16rLI2Gm9Gie6IVxS/6XsxdbrVKKVxz56uGkOStCk23Lc8kM2j31BZ+WnJIbumvyPJE8L0mA7sUiCIL0H0q4IwgydmA1x81Wa0lbR3KAH7F5YGJ8hNUS6dWm3qsxDt5hhHkLsIVqiTTJ327PTXK57SoAZDc0SjQaAHh35RLbnDgAiPtV0AbX1z2TAD5dt+LWbX9lNzQdLK0wWyz+PO4N6akPTMsM5tvVGOnTS9enVwNBkMHzT3nZIwf24au59z/k5TAptMVq3V5UsC0/v1YuUxvs7lxWP/I4vkwhkb6/mrOtIK9RofDncKeHhf132gxvVleVgK0F+X8VF5aJxTqTSazRRH38Af7Aiv88ik2/jNWCz77n/l2lJdsK85uc7QfcOGY39+Pm83LHrtKSrQV51Z2dGoNRxGYn+vquTUhcGhuHtbrz3OFazf3c+x+ql8vePncmr7XVYrVGC4XvL1oaI+xK0/f63J169dSJH3Ov3jYu46U5c/FgVlPjF9lZV1tb9CZThMD7uqTkOzLGuxgdhSDIQJCAdF3Imlm+08+JL5Yqylp0bWqT2mgx0sl0JoXpy/AJZgUl85PSBaksSvfH1L9HOFe4Kix1d30Btqoy6u88uzVREDDeJ0RIZ+stJrFOnd/ZXKnoKmBIJ1N+mHnzwxf/kujV3Xvp2Z2xU060VFwW12OrWpPxzfwj7xcej+P7+TA4OrOxWaNouDZxK5lE+nLa9Q+c/8OdnLvObFIadSqjXmnUq0x6pVHXNW+8rnssV5VS/FNlFpeKzRjP4NEYXCqDS2Nwaa7mjd8QmVGpFP9QcRFbleo1L1/d/1ruwRgvXxGDYwWrWK+uUnSY7ctBrglLuzNuqm0EQRAE6SuUcEcQZOwIEfBTAvwLW9u+uZj98ZrlxOaBmR8Xfbi88nhlTVFru+tc8OAdRqiAH8z3apIr9hSVElLM2JyutjQGIwCQSSRCTrxWKstrbrWN9FU/9vzmsdPZDU3vrVyyOiWR2GajTy9dn14NBEEGz6zw8K3rN3RqtZ9culgu6ZpTjuCts6e/zbmyOiHxgUmZnTrd15ezGhWK52bOnh0RYbvZtzlXyiXipTGxy2Ljspqafi8sKJeI/7r+Rqw12tt7Y3KqyWp94fjRSG/ve8dPxB9Itp+87j8H9uW3tS6NiV3ubD/g3jGDG/tx83n16usr2W+fPZPi539jShqJBPUy2dn6uhihEE+4u//cAeBYTdULx4/NCAu/PT1DqtWerK0J5HLxVjefu603zpxyzLbvKSt9/NCBCIFgQ1IKk0q91NTwxplTV5qbvlixCmXcEWTw+DF81wavhOCVxAYE4MX0pSXytnJ5Ox4pkbWWyJxcnbKp9M+nbpgkCksXBh9rKSc2O0MhkbdMv/GOM7/mSpvwoMFiLuwkDjWgkEj/N37FnIDYcK4Qn2q1JyWy1tXHthCjDsrkba/nHSJGAQDgl1m3TvYNJ0aveTZtoT+L907BUcu1rLrZaimTt5XZb4a7L3764ynz0Mc4giDIAKGEO4IgY8pzC2bfsu2v/SXlVDL5/mmZsSIfAJBpdfUy+fGKKiqZvHnGFOJj3LMqOeGHrCul7eLbfv/7v3NmLImP5bOYZqu1Q6W+3NAk1WhvnZiObzx4h3H7pIzXj576MftqnMhnTWoSmUQyms2/5xbsLiwhbIn1FrdYrVuv5N02KQMLnq+tf+HgMavjfKl90Y89/5lXQCaRQgR8k8WCF7N2qk8vnfuvBoIgg4fPYE4NCQWAP4oKnSZw9WbTL3l5KX5+Hy5eikXifXyu/3N7m1oVK/Sx3bK4o33Xxk0Joq46vHfs2nGqrjanpWV8YCAATAkJnRISqjebXjh+1I/NuSEl1faxtnJaml3sB9w4Zozr/bj/vHq1u7TUm8XaecONeF91s8WiN3cXOnD/uQPA/44d/W71WuwJAoAV7Eqnufnc8X7q754/+23OldvTM16c3Z1t79Rqnzt2JDM45Je16/FjfuzQgd2lJUerqxZGReNbIgiCDBkejbF11m0vXd2PVYzpyXifkDcnrIrk+QBAuk+Imwl3AOBQ6T/PuvWL0jPflV/ocaZ0jvfrE1ZM8Y0AgGieqNeE+xC4M3bKFN+It/KPXOyoJbbZyPAJeSplwQRR13cHgiAIMhAo4Y4gyJgyKTT4g1VLn9l3eE9R6Z6iUiqZTCKRjNdyFquSE+w37wMqmfz1hjX3/bmrtF38/IGjzx84yqJR9SYz1ltkZlS4bcJ98A7jlokZ52sbTlRWP73v8P8dPeXNZrUrVXqT6f+WLfy/Iye1xq6pnAAg0sd7VXLCnqLS/zt68ofsHBGH3SRXiNWajODAG9NT3z5xxmavfdOPPS9NjN+RX7Txl+14hEWjBnl5zYqOuG/qJB82G4/36aVz/9VAEGQYtanUerMpybd7JEqiyBcA6mUyPIJZERePZ7cBYH5U9Km62hpZJ54od9PQ7Mf959UrEZtdKZVcbW2ZGBSMRShkMtvl7UkXlsTE4tl2sM+2u49NpQHAhxfOf5mddUf6+Bdmz7Ft3VtepjEab0/PwLPtALAqLn53acmJmmqUcEcQZLjw6cyPJq97MGHGjrq8K5KGBnWnwqgDAC8aM4QjSPMOXhScgGXDMenCEHzZHUwK9fHkuRsjxx9sKjnRUt6olon1aqvV6sfipQgCFwYnLA1OwjuXRHuJjvRejXIoJAkCfp51S2Fny/GW8vPtNW1apUSvIpPIPgyOP4s31TdidkBsmtD5HLAIgiBIP6CEO4IgY82yxLiM4MCfr+Sera6tl8nNFmsw3ytUwJ8THbk0sWtsfv8EefH+vn3TzoLiA6UVJW3tCp2ey6D7cNgZQYFrUolTLA7SYVBIpC/Xr9yak/93flG1RCrVaMaHBN03ddK0iLBtOXlFrd1DaAHgnRWLJ4QE/ZFXWNcpk2q04d782yZl3Jk5oUosBWdpcff1ac9VEqnFYqGQSFYADp0OAFawao2mKom0SiI9WFrxz10385ndcze5/9L16dVAEGS4iNhsKplcZ5OGrpXLAMCPY1eWCgBsk9cAgH0yyHXd07i5aWj24/7z6tVjU6fduvPv6//cPjUk9Lrk5KUxcYS5oPskxc+fGOo7HoPxY+7VT7Mu3piSRsi2A0BBexsA3L93DyEOAGKNhhhCEARx8EzawmfSFhKjHhLH93Nz55N9w8vXv0CM9iaIzb8zdsqdsb2MWH08ee7jyd1jg5xKFAT04wD6J8U7MMU78OGk2cQGBEEQxNP6fymPIAgyxNKDAyuefYwYdSbQi/f03JlPz51JbLDBptN62lucr09PTXQK5Yb01BvSXY3lx7lzGP1AIZNvnZhu26Ees+uOmwgRCpm8afy4TePHEeKJ/r6EJ3jywbtsV++bOum+qZPwVW8Wi7C9+3su75Bc99NvNAr5qw2rZ0SG411+rADlHeJ7/9jVrFDuLiy5dWJXaRqM+y+d+68GgiDDhU2jbUxJ/TU/7/9On5wXGSXT6T65dJFJpd6clk7Y0tdmvMtADM1+3H9evcoICDx66+1fX87+u6T4wqGG106dvG/ipHvGTyT3awJSoc20rv1W1Sn9v9MnAaCgvVVnMhFuACj0egC4a/wEH4d/K5wvIEQQBEEQBEEQ5F9lcBPuWo1h9Zy3AOCb3+6PiHY1xyCCIAgyJv2YnaM1Gu+fOm1OdKRtnAQQ7yuaFxv165W8JrnStglBkLHnhVlzWlWqH67m/JyX681kjQsI+GjJ0niRiLhdv/LLTgzVftx9Xm7w53BfnD33qekz91WUf3056+2zZ8Qazf9mDls/RLXB8O6ixQq9/pWTJ546cuiTpXYTWXPpdABYEh07IQiVIEAQBEEQBEEQO4ObcP9XaW2QXDpaVHCpqqGqXdIm12n0VBqVw2MGhouiEoPGz4yfMDuBRrd7wSlUiu3qwBl0xsrCxsqixuri5vqKVkWnWq3QquRaK1hpdCqHx+ILOQFhPqHR/vEZ4WmTozlexE5JA1db2rLrh9O558olbXI6gxYQ5jN+ZvyKW6b7hwiJmwIAQEV+wz8/ny24VCVpkzPZdKGfV9LEyNkrx4+bGkPctI9GwquBkbYrirKrS6/Wlec3yCVKlVyrUmipNArfh+st4iVkhE+en5ycGUX19PngyGq1luXW512oKMutb67tkLYrdBqDxWJhsuh8H25gmCg2NSRlcvS4abFDcDDIv0SrUgkAfFZ3xRhbtVIZAPhy+1x+AUGQ0SWrqelETfVHS5evjIsntvURhUQGAAs4n6J5iHnweWGYVOr6xKTlsXGLfvnxj6JCQsJ9KJ+7H4e7NiEJAMrE4t8LC+J8RJszJ+Otqf7+O0qKLzY2oIQ7giAIgiAIghCghLsHlOXV//L+gZwzZVar3e8fs8mg1xqwZOs/P5/1EnJW3Dz9uvvmsTgMbAM213kGqq8Uneqs48XnDxXknCnTaw3EZgAAMJsMOo1B0iavLmkGKAAAKpWSMTNu5a0zJ81NJG7t0vtPbDv6dza++tO5F/2CvbHl7V8c/fn9AxazBVs1Gc3VxU3VxU27fzh993OrVt1uVx3CbLJ883+79vzYXe7ZaDApZZq68tYD2y5MXZT6yFvX84Vcm0e4ZYhfDdfyL1bu/uH0xaNF+GuCMxpMWrW+tV5SklO787tThFYX3vvzP8mToojR3qiVuj0/nj74+8X2pk5iG4BaqVMrdc214iunS+HzozwBe8H6SevvmesTwCduiiB9FO/ne6a67ufLudMjwiOEAjzeplR9fSH7bE0dg0pdmhDb/QBkACR6dbvOyXABXwZXxOzzxymCeNC5hjqz1RopEFis1v6VScFRyWRfNqems9NgNtMpw3x72CPPywrQpFCEeHnhEQqJRCaRyQ7TnQ7Lc3917vzqzs4PL5yLF4nw2VBXxSe+f/7c91evrIxPCON3Xy2INRoeg86goJ8YCIIgCIIgyL8XuhoeEIPe9M1ru/ZvPU9ItTulkKq3fXL44O8Xn/zgpowZcQDg5T3QTp1luXW7fzh9Zl+eyWQmtvXGZDJnnyjJPlGSkhn9xHs3BoT5ELdwT1VRI5Zw3/bxoV8+PEhsBgAAo8H05cs7TCbzurvnYBGrxfrm5p/OHcy3287GhcMFbY3S9/96mMmmE9t6MBJeDZxCqv7w6d8vHikkNgw5q9W6f9uFH97eq1ZoiW09UMo0O787tW/r+Y0PLdjwwHzU2x0ZiHunTDxSVlktkS78+ocIoUDIZlus1nalqlmhBAAWjfr2isXB/O40EzIQ7xUe3VmXR4wCbE6cvTlx2ApTIKOX3mzKb21TGfQqg6FTq7UC7Cot4dLpXDo9Vujjw2YDgNliudraojIYlAZDq0oFAHvLy3w5HC6dHinwDuB23enZkJTye2HBqt+2Yqt0CiXEy+vGlLQ7x08gJpXdsDI+/vurOTf+9cesiAizxSLVav9v3gLiRj1z85jd4ZHnZbFYZv3wbZp/QIqfnx+HqzLoT9XW1stlj0yZStx0OJ47lUz+cvnK1b9vfezg/h033BjnIwIAbybzg8VLN+/fu3zbLyvj4gO4PIlWUymVZjU2nLj9LtubBwiCIAiCIAjyb4MS7v2n6FQ/f9vXFfkNxAaXpO2K/9361b3Pr1lz5yy+sP8Jd61a/+ymL8ry6okNfVeYVbV5+XvvbN8clRRMbHNDZVHT1EWpeRcqf/3oELHN3vdv/TNuamx0cjAA/PrxIRfZdkx1cdNnL/z15PubiA0ORs6rgSnLrXv13u+l7Qpiw5BTK7RvPPRTzpkyYoMbDDrjz+8fuHyq9H9f3C70Q7+ckX7yZrF23XHTL1dyj1dWV0ukDZ1yCpnMZzEnh4VMiwjbMC4F1ZPxoAvtNcQQggxAo0Jxw1/bbSOPHzqALbw8Z96t49IBQKHXX/+n3TbPHz+KLTwyeSqWMq6Xyx7av1fIYm1MSfNi0AFAZTBebKx//cwpCpl8e3qG7cPd8eS0GXQKdX9F2RfZWWwqra810905Znd46nmRyeR7J0w8U1e3q7REbzJ5s1jR3sJPl61YHhtH3HSYnrs3i7Vl5Zr1f/x2z57duzZu8maxAGBBVPTujTd9eTnreE21VKsVMJlhfMET06aLXM40iyAIgiAIgiBjHsmdrtn9NoYnTdWodE9e92lNaTOxwW33v7R26qLU26a/Soh/uPPRhIxwQtCpp274rOBSFTHaX0I/rw93PeoX1FUcxgVCSZnJC5Jf/PrOB5a8W1/RarOVcxPnJL724721ZS2bl79nNhGrrDgikUhfHX4qLDaA2OBguF4NR8214sfWfaSQqokNAABAo1MFPlwun63XGeRStfu9znHul5SRtMqf2fRFY3U7saGPAsNFb217EC8chCDIyFSlFC8/8gUxCgCohzsy3G7a8Ve5RHzq9rvYNBoeNFssk7/9Oloo3H7dDTbbjiZj9XkNsbvPbT3b5tYlXNbKp7xonqnHiCAIgiAIgiCDp8893OUyzYZF78UmBH7+8z1XLlX98fP5itIWo9EcGiFauipj+boJZLKTEbQUCjk/p+6PX86XFTWpVTqBkJs+MWLTnTNDnBXuuHimfN/OnLKiJpVSy/NiJaWFrt04OW28XQ4aS+WHR/lu+f0B9/dcU9n+19YLeVdqpRIVk0mLjPFftHzcohXjSM6O2QWr1frWf352kW2PiA8MihCJAgRms0UuUXU0d1YUNhKqeH/zf7u5A5ulc8P9812kmH0DBeFxATxvDo/PJlPIKrmmo0VWnlevVeuJmwIAgLRd8ckzf/zfz/cRG3pTVdR07mA+nm2PTw+PSgoCgKtnylsbJHabAlw+WdJSJ/7xnX14tp3jxcqYEScK4Itb5FnHiwx6k+32Vqv10PZL9zy/2jbo1Ah5NQx604t3fOOYbafSKPPXTVp43aS4cWG2c+c214qzjhfv/O6k09LqAMDls4MiRIFhPoHhosBwUVC4T2xqKHEjZ+RS1bM39ZhtpzNpCenhPgF8L2+O1WKVS1XtTZ3l+fVO74K01Imfu/nLj3c/NnjzyiIIMnAX2quJIQQZGa62NE8ODrHNSgMAhUymkSlKvfPZVkaFsfq8EARBEARBEAQZiD4n3DENdeJ9O6588vY+Op0qFPHkMk1lacunpS1Xs2teePM6x/z1hTPl3312FEgkXz8vi8Uqblcc3Z9/7mTpJz/cFR7pi29msVjfe3X30f35AMBi0339+Z1S1bmTpedOll5/y7S7/0OsUNnUID2yL++9V3f3umcA2L8z55O391ksVgqF7OPLk8s0BVfrCq7WnTxS9Or7G2n0PlSp3vvLuewTJcQoAIlMWnnLjBW3TA+N8Sc0KWWaS8eKtn50CM9BW8yW957YZr9V30yamxgRH1hb1oJHAkJ9Ji9InjQ3MTY11GmBeIvZcvlU6fbPjxZfcVJ24Mrp0pKc2sTxEcQGl8Qtso+f/QMA+ELu81/dkZLZ1fnabLJ8+fKOfb+es9sa4Pu39mYdL8aWV946446nV+CzyLbWS56+8XNC6vni0UJ3Eu4j5NX456czTTUdhGBAqM9LW+6KSAgkxAEgKEK05s5Zy26a9ulzf9iOG8A8/t6NC6/LJATdYTFb3tz8c0OVk2z7uGmx1z8wP3VytG3eH6NV6y8cLtj2yWHHp9BU0/H2I7+8+sO9hDiCICPHOZRwR0YqPoNZ1SnVm022c2nuqyhvU6vmRbo1ZmtkGqvPC0EQBEEQBEGQgehzSRmshzsAkMmkex9ZtOq6iVQaxWKxHtmb99Gbe81my3+eWrbyuonYxnhJGRIJ5i5Ove/RRd5CDgAU5TW8+vQfnVL1jLmJL769Ad/5T1+f3PrdaTaH8cQLq6bPSSCTSWaz5fTR4o/e3KvVGDb/d+mqDZP6t+fcyzVPb/6VSiU/9MTSRSvTqVQyAORcqn7nlV1SsWrNDZkPPrEE39g1hVR9+8zXHHtGC3y4z3x227ipMYS4LYPO+MM7+3Z9f4rYYMP9kjIAcOzv7Pee2Mblsxesn7j4+ilOU7qOrBbrrx8f2vbxIWIDwIyl4/735e3EqD1CSRkMiUz6eNdjsWl2na+tFusjqz+sKHBe5n7xDVMefZs42vryyZIXbv+GENyW/aq3L48QdDQsr4YtrVp/+8zXCN3b2VzmZ/ueCAzvvcTqK/d8R5hkVeDD/fbEc/3oV/7bp4d/fr+rzC6OxWH898Obpi5KJcQJzCbLltd37/7hNLEB4LF3b1y0oT83ABAEGWxmqyXzn3fUJuedalFJGWR4bcm5/OaZ04ki3+VxcV4MplSrvdzcdK6+zp/L23HDxgBu71/xI9NYfV5DDJWUQRAEQRAEQcYYMjHgtnlLUtfdOJlKowAAmUxavCp9zQ2ZAPDX1gvETQFiE4KefnkNlhMHgORxoZvunAUAV7O7u+Mp5Nq/fj0PAI8+u2LmvESsNA2FQp67OGXzf5cCwI9fndBqiKkEd/YMAN99dsxqsd7xwLxla8dj2XYAGD856r5HFgHA3h1X1CpiAr0n27846phtp9GpL317t+tsOwDQmbT7Xlyz9i6PZT1mrx7/1Ec3b7308n0vrnUzvwwAJDLplseWLL95OrEBIO9CRV/vwWAWXpdJyLYDAIlM2nD/PEIQ4+XNued/q4hRgAmzE0SBAkKwuqSJEHFq2F+NK6dLHYvJ3PToYney7QDw8JvXE3qdyySq/duc/EG51lIn/v2zI4Qgm8t8/++He822AwCFSr7/pbVO37gf39mr1xL/BhEEGQlypY09ZdsRZNjdM37ie4uWsGi0L7KzXj55/LurV+R63X8mT9l/0y2jOis9Vp8XgiAIgiAIgiADQawp4b5ps+MJkXlLUv/edrGlqbOtReZvnzNdsjqDUGcmNjEQANQqvcFgotOpAHD5QqVeb+LymLMWJNluCQBzF6d+9u4BlVKXk1U9fU6CbZM7e+5oU5QVNwPAnEUptlsCQOr4cAAwGc2lRY0TJkcTWh1p1fqDv18kRgHu/t8q97ul3/P86uriprwLlcSGvqNSKXPXTCBG3XPP/1ad2Zer6LRLECtlmprSlqjEINugOxZe1zX4gGDyghQanWo02FVmB4B5ayc67bhNIpGSJ0ae+ueqbbCppmPCLLv33alhfzWuniknROhM2pKNUwjBnniLeDOWjTux64pt8ND2i05z3y788sEBQil8AHj8vRsjE9x9IgBw65PLcs6UVRXZ3ero7FAe+O3imjtn2QYRBBkJLrQ7KY2FICPHusSkdYnEC7wxYKw+LwRBEAQZyVq1BWfbPpQbm3wYUbP8nxIyIolbIH10oeOLfOl2YtTGFN8Hxgk3EqOjR53q/MGmZ/HVjZHb+PRgm3bk32uQzo3+93APDPYmRMIiurrxNjVI7VsgMtqPEGGz6dgCPkljbXUHAIRH+TpOu0qlksMifQGguqKN0OTOnquvzee5afmHizJftf1v0/IPsSaZVIMtuHZmX65GpSME/YK9l900jRB0gUQi3f2/3ouSDzYGi77YWS64pqTHyWB7QqNTE3qodU5nUKOSnJypk+f3+Os0wiEvLGmVEyIe55FXo+AS8SZKXFoYm9uHsc/p02IJkaaaDklbH55+a73k1N5cQnDKwpTpS9IIQdeoVMptTy4nRgH2byUW5UcQZCRABdwRBEEQBEGQfwfr8ZbXJPoqk0XXpi0+0/Y+sR1BEGS49T/h7jjjIoNJI5EAAHRaI6GJfW1WTBe0Gj0AsNnOt8TS6GqHZLc7e8bKxZDIpJBwn57+Y7JoxIc5c/ZAHjEEcP0D86nUPsy5CgAxKSFJE4b/HqxjehcAlDJiUZRehcX6u3gFQhxuipBIpPj0HgcECP28CBG5Q52WwTDwV0PscGMgOtnJzQYXIp31pid0M3ft0B+XLOauW024jZsXEiLumDg7wdehvE9DVbvtzLQIgowEKqM+X9qHDwoEQRAEQRAEGaU0JqnS2N0Xs11XagXiT2Ckr0gDSA8iCOKImDR3n86hlLNWY8DqXbOu9THHYYl41zgcJgBoNMTy6BiNxgAAHIfOwu7sGTseEsB32x8k1J/pE6PBlHuughAkkUjTl44jBN0xc3l68ZVhrgAQkxJCDAEoZW519rfluka5Y9LWP0TI6vlOicCHS4g4jioYDAN8NUxGs2Nxfy8BmxBxjedse0KhG9cIFWkAIDwuIH5cGCHoDhKZNGFO4sHfiEXkL58siYh3t0Q+giBDIEtca7ainxkIgiAIgiDIv4FdVocEJJJ9BOmHKb73j/e5RWeW4/9pTZ0XO74kbocgiHv6fwursZ5YN6a+VowtBIUI7VvcEhnrDwB11R1mh/65JpOlvqYDACIc+kq7IzLGHwAsFmtVeVdtmf6pyG9wrEUekxrimCB2R/p0J/2phxiPz3a8A6FSaAmRXokCBMSQDceaKv6hrs4QBpM42sDxZR8MA3w1lHInqXkGi3jzyTU6g/jcAUDnMFdwTxqq2tsaiX+YE+ckEiLui0slToQLAGW59cQQgiDDCtWTQRAEQRAEQf4l2FRvHq27B1gQO52Qgkf6h07meNGC/JiJYZwpcV6LU703ELdAEMRt/U+4nz5aTIgcP1gAAEEh3v6BfEKTOyZOiWZzGCql7tSRIkLTiUMFWo2BxaaPz4wiNLkjIEgQmxAIANt/HlD56fL8BmKohzok7giPDehrNtbjSGQSy6GGj9ViJUR6JRC5uuXgmEB3LBpji0ojVqcxGc2EyGAY4Kvh+DQBQK3sW998tbP8Pl/IIYZ6kHeeOAIDANKmxBBDbguPCyCGAKpLUOUKBBlZzqOEO4IgCIIgCPJvQZof+LwPI5pKZoZwJs4K+C+xHUEQZLj1P+F+/lTp1u9O6/UmALBarIf25O75MxsA1m+aStzUPRwu45Z7ZgPAx2/tO32s2GKxAoDFYj11pOizdw8AwKY7Z3K4xHyom+5/bBGFQj51tPitF3fWVXdgQYVcW1bc/NPXJ3/99rT95s41VhGnbAWAkGh/Ysg9JDIpLKafj/Ugd2ry9IrrxSKGbFAcEuhOC6fgKA7l4N3Peg/QQF4NNpfJdCim1NHcSYi41tbkZHtvXx4x1IPKwkZiCCA40pcYchuX7+Sd7WiWWbHqUQiCjACtWkWNUkKMIgiCIAiCIMgY5c9KuS7i+7tiDy0PeZ9L7U8hBARBkEHV/xrut94756evT2774YzI10up0KqUOgCYOS9xxboJxE3dtn7TlPZW+c7fL/3fs3+x2HSBN0fWqdZqDACwYt2E62+ZTnyA21Izwp95bd37r+0+frDg+MECKpUMJBLeb3reklT7zZ1rruuqmWMrOMJV+XLX/IK9Kwqc9JofdZgOHcNdc+xIPjZEJQUXX7ary19kv9qromxiN1USmRTq9o2Z2tJmQoRMIbsu4OMah+ck4W40mNQKLZfv6q4JgiBDBnVvRxAEQRAEQRAEQZCRo/8J94XLx8UlBv7564WK0hazyRyTELh0VcbydRMcq2D3yQOPL548I3bPn9nF+Y0dbXKeFytjUuTydRMmTe1/WQzM7AVJSakhu/7IunKhqqW502yy+AcKAoIEk2fEzpqfRNzamc4OJTHU23yhrrmurNJvVou1uU7cWNXeUi+WtCk6xUqNQqtR6/Vag0FvMuiMBp3RoDfqdUaj3mQyeaBaC53RtxOJRu/b9gMxlK/GhJnxhIR7S524MKs6xb1SSGaT5fjOy4Rg/LgwvtBVxR5b7Q4d5C1my8qYJwnBgdNpDCjhjiAjBCrgjiAIgiAIgiAI8v/s3XV4G0faAPB3V4yWZMYY48R2yGFOA03TJE3KzHSla7/Cldu74rVX5l75ypQ2TA0z20nMzCyLWdrvDzmyPBas0LIzv6fPnfTO2lZWK+3suzPvYFjk8D/vaTZZps3OmeZx5U8en73t6HNoFAAA0rPi3DUVTsv0Wqvdv98cGy++84HFdz6wGG2gRynXoCFXK4LSJ/BYicVXLXVdh7efPbmvovxUg07jW+nwADF9TKCTjIDuytAxJHtjwarJ372zFSm38tVrG177+T7moDo5g637Zt/gjPmcZROQiDtWi03h6hANhfAsY4thmFcUwOFO32bSYBiGYRiGYRiGYRgWOr7lSZ2dh0WcDToTGgLg8FwslUkTTxCEyioURR3cembNZ7tLTwxZzoUMpPZ5UA3t3khKj5m7fOLeDaecg6Un6t569MeHXrvG8zyA/ZuKv3x1PRKMSZSsoF1JSacxhK3Y/fn36cewCFWh7OgxatEohmEYhmEYhmEYhmFDxFMGEEM4ar47sLksIoBc8+DVQX1VU9Ly3lO/VBY3og1h5v8+CKZI2Bu3/mP5sV2leq3RObjrzxN1Za3X3L9k9kXjmYOWkK0vb/vts107fj+GxAHg9idXcnjoQqzumIxmNIRh2EiHC7hjGIZhGIZhkcNGWVt1pxq1h3qMNSpTi8mmNdv0DJLNInkCRkwUO0XGyUriT4zjjiUJWvmoKtW2nW0vo1EnWaKFi5OeR6O+MNm01aq/2vTF3YYqg1VhtGoosKEbDTI15vbC6JucIzqL/NuaS+2PC6SXzY570P6YAluj5nCdZm+XoUJj7jDb9CySz2WIZZzMRP6E0eILuQyJ45fQYaPMLbpTbfriHkO1wtRotKnNNh2DYLNJAZ8ZLeNkxvMKMoXzOQwR+pMjlNbSXave1aA5pDa36Sw9DJItYMbIOJlZokVpgmkkwQIABuHzYNlg7ed1TQ+26YoAYHbcgwXSywCg11R/vPvLFt1Ji80gZiVnixdPkF3NIPqTP5WqrWd718iNtQyCLWGn5YiX5EtXE0A6NnAnWK/ZpWB9UlzSWeSN2oONmsMKc7PeIjfZtByGiMeQxnHHpAimjRLMZJL+1BcJ0bFBB60vOMxu8KB+BsP74e4BI7DKKtt+OfLBM7/RLO4hEPMEIi5fyOXw2DwBh8tn8/hsDo+95afD6KbDU4TsjYS06PtevOKNh79H4vUVbf9+4H9sDjO7IDUmUSIQc81Gi1qhqy5p7mlXIhvbXXPf4gWXFKJR92zhGt6OYVjkwAXcMQzDMAzDsMhAlSs3Hu/+SmvpRhosNoPFZtBberuNVTXqXQDAJgVZ4oUFkstkHC/1hEOKAtuJ7m9O9/5itunQtsD0GhvsDzr0JXvaX+811Tu3mmwak02jMrfWa/Yf6/p8vOyqKTG30UmndhpKS3r/qNccMNnQSa42Sm+26bWW7i5DRYVy837inTzJymkxd7HIYJYyjjRWylwk//5Uz3dWqn8AosVqNFrVcmNdtWqHmJW0IPHJRN54DsOHNRRDtJ8VpgYAaNef2dj8qMXWV/q411R/rPvzBs3BlalvM0kuALWr7dVK1VZ7q5UydRpKOw2l9Zr9F6e87uE2VYhes13oPikAYLSqTvT8r0Txh40akNDTW3r1ll65sbZcuYnHlBbKbqJ518EuRMcGfW7fKmwwFpuJDHI36F0UmaFvUALfB5t/OPTeU7+g0XNEEv6EWTljJqVnjElMSo+Jjo9yuU6p1WILPMUcCSJqbyy6bIpaof30hT/RBgCT0UKz1s3q2+bf/NhyNOqRy5I1kmjhkqumo9GACaPofi9jWNBZKVuTtrdW3V2j7m7RKrqN2i6Duseo1VvMBqvZaLPYKIpNMlgkg00yuQyWlMOXsflSDj+eJ04XykYJZRnCGBlnJKz6a7JZT3QP5Zye4cVis5UoWmvU3Q0aeaNW3qRVqM0GvcWss5r0FhOTZPAYLB6DxWeyE/hRKXxJikCSLoyeJEuJ4dJduXrE6zFqK5Qd1aquKlVnvUauNhs0FqPWbNJYjADAZ7L5TLaAyRazuCkCSZpANkooSxPIRovjeMyQDBvBwsBGUaWKtjJlR626u07d06JTaC1GrcWktRhJIARMjoDFFjI5qQJphigmSxSTJ0nIEcehv8UjBkH3wily4DORncKk391edbiztkTRLjdqlWY9n8GWcPgxHMEEWcrUmLTpsRkCJt3Jmi7JjboDnTWHOutKFW1yo67XpGMQhIDJieYIMkQxY6LiZ8dnFkiSIqe+5WD4aHHHYDVXqjrLlR21qu4Og6pTr+kyqLUWk9FmMVotNsrGYbB4DJaQxUniR6XwJenC6InRKQWSJA7DxVXPyDPs+i1WyrSz7aVa9R60wQ2TTVumWJ/Cn+I14U4/v+Yri82wqfkfbfpitIEGPlPGZ0ajUSf21Gqtes+OtheQNCLCQhlP9nzbZai4KPnfJIFOiHd2sPODM72/olE3bJT5bO+aFu2JVWkfhCifOOTovIMqc+u6xr/PiX8oTTADbXMjdPu511Rvsmm3tz7vyLY7dBpKj3Z/NivugSL5j45su7MW3YmTPf+bEnMb2gAAoXzNQG8/u+P1k9JlqNjc/Lje2os2DKS39B7ofLdRe2hx0j/ZpABtHoTOa/bj2PDJeXGuChY2h4WUCqFslMlgZnP9vIzUqdHPGE2VxY0fPfc7GgUAgPypmVfevXDKgrEMZqhOS5EmAvfG6tvmJ46Kefuxn1wutOtZlEz40GtXz1hSgDZ4w+G6uJ7h8Ni3Pb4CjWLYcNNpUB/vbiyWNxfJW8oUbSYbWuALYbBaDFYLgBEAWnQKtBkgiR81UZYyUZYyJz4rUxSDNkc8tdlYoezY11FtsOJaUl6UKtr2tFcf62442dPkYXdZrRaj1aIAPQDUqAcMy0oVSAujUxckjL4gMYfL8POMP6yd7W3d3lq+o62iWtWFtjlRmvRKk97++GRPkyPOIMixkoTJ0amF0alTYkZFc7x3kbEhZ7CatzSX7umoOtRZpzj3tg5mMul6TToAKFd2OIJxXNGc+Kz5CdkLE3NZpKfEgR1vmHys8JnIWbte9Xnlwd/qTyHfqyqbQWU2NGrkJ3uavqo6JGCyr0ifdHP2jCR+lPNmdDRq5J9XHfyzoRjZ1WYAg9XSY9RWqjq3tpS+W7orgSe+KqPwusypEnakjAjBR4s7Voo62dO4r6PmQEdNmbLd5nEAms5i0llMPUZtg0buCLJIxtSYUctTCpYkjxGz/CkvEOGGb7/lQMe7SLadRfKj2Ck8hoQAhsmm0Vq61OYOgP43nceUpgvnOP2Ea9nixemiuQaLwmBVOv4rkv8weBy9r3a0veScj5Ow03KjLorm5LBJgcmm6TKUlys3qs39JzguQzI/4VExK1nMSvJa3UJr6W7VFe1oe9GRbWcQLCk7nceU2iiLytymNrc5b9+kPXqs+/PpsXc7BxFpghmDk6oCZoyQFc8hRVbKpLF0KE0tzq29poYdbS9enPIf5+DIQIFtS8uTSEaVQbBknEwuQ2K26dTmtnMHCXWg410inm5SKHT7udfUcKb3N52lh0Gw4rh5NrB26EscH4pSxdoxUctPdH8NAAyCFccdCwTZoT9jo/pOImd6f58UfYNz5RmH0L1mCOUnpVV3akvLk2bbgK6miJUoYsUzCa7RppIb653H1Ddpj65vemhV2gdMwtOKmKE7Nnzic8I9SsLfdvQ5NHp+iIoWDs6f6rRGvxPuGpXbCxjPPnzud4sF7beRDPLOp1etvm0eEh/xInNvTF+U/+Xepz97ed2WHw+hbW7Ep8hW3Dj7omtmCKP8GcPC5bN5Ag5yT2jwEYsFrlTRdtnOz9DoQATAiUue4Ac2qgtxw96vj9MeznxoxaNStj8Hkju37Pv2cJeX+Rm/XnDHOGkSGvWXlbId727c21G9r726UtWJNgemVads1Sk3NZcAQKYoZnHSmMtHTRwllKHbRQYKoFnbW67sKFe2lys6ypUdLq/GPfigbM8HZXQHHPnn4pT8t6ZdjkaHTodeva7p9NrG055zxHQ0aXubtL1rG0/zmKyFCaMvT580K87LUKzws1K2/D9eQqMD/bTgtomyFDTqnsFq/rH2xP+qD7fpVWibL6yU7Wxv69ne1m+qjxAAE2QpS5PHLkkamyKQoJtiEaBG3f1j7fG1jcVq84AeBX2dBvWahqI1DUXRHMGVGYVXZ0xO5HkaPCVkebpkGloj+ExktFomrH0FjZ6zNDnv3elXoNFz1jedeaFoE50jRGsxfVN95Mfa4w8XLLo5ewbNUeg2ivq88uB7ZbssNu+VYQGgXa96r3T3N9VHHs5feHXGZLQ5XEbw0RIUdeqeNQ1FfzYWdxkCujwx26wHO2sPdtY+fXId2hYMPy+4bYIv58pgGe79FoWpsUy5wfE0hjt6Ruw9SfyJyOB0s03foT/bpDtWr96nMreOiVruoT6GMybBEbLihax4R6RStTXAhHuD5mC9Zp/jaZ5k1Zz4h5xfcKpg+gTZdbvbXq1W77BHDFYFSTC9Dsl32NT8mI0yA4CIlTAt5s504Rzn5KPC1Hik69N6zX5H5HTvr+OkV3gYDpwimBLNye4xVrNJYbpw9ijh7CT+BKT+u9rccUr+bZlivSPSpD3apitK5E/s32hEONv7e4vupOMpk+BMibltrGSl8/BnubHuZM83NepdFNj2dbzpiHsWuv2st/Se7PkmmpO9LOU1ATMGAFp0JzY1P2ZPqVsp8+aWJyyUMZY75qLkV+xHQoe+ZF3T3+23bUw2Tbv+TDLfxZkudK85dJ8UraV7e+vzjmw7STDHSa8okFzm/Em3UdZm3dEjXf+VG/sqqXYbKvd3vL0g4QnHNoOF7tjwCa1vN8xOGiNsrEKDnc1ySbQQjdKj9Svhfvpwtct1QR989aoLfSweYjH33WsdviJ5b+zfVLxnXf+HHADikqUWs1Wj1JnNVi6PLRTzhFH85IzYMYXpYwtHjZ2UTpA0r0Rci02SNla1O0cMOpNBZ+Lyg5n2xUaL49kkw/NgJQqgUtXpU27LM4vNdra3FY26VyxvXpAwGo0GoFw54NAajEmSuVH9p0a/2SjqeHfDxuaSbS1l9oGToVar7v5vxf7PKvbPjc++JWdGGK5JvNJbzJWqzgp7hl3ZUaHs0FoCqmB2XmnS9n5cvm9t42krRStTQ5/eYt7YXLKxuSRPknDH6NlLk/MYEVzEYLA2nWoiveSM1mL6vubo19WH5cYgfwYpgCJ5c5G8+bUz2/Mkid/PuwVXm4kcnQb1OyW7/mws9jzmlL4eo/aT8n2fVRy4LnPKA3kL3I1FdRcfQvhMVKYYMO7SgQJ4qWjz97XH0AaPTDbrv09v29dR8/70K72ORVCZDfcd+vlYdwPa4I3SpH/+1MZDnXWvTl4Vzi8WfLR4Vanq/KBsz/aWsuB8s4w4I6Pf4jy2XcCMuST1XRbpYugPi+SlCKamCKbOjL23Q39WxEpEtwijIvkPjsex3DFIDtGOQbAWJD7ZZaxQmprtkVLFujTBzIFbuWWlTACQyBu/LOX1wcWyJey0pckv7Wp7pVK1zR6xUeZy5UbPy0tOj71bZ+nJEi90N8JXxIqfF/+omJV0pOtTR7BavdNzUnXY0Vt7j3V/4XjKINgrUt+O5+U7bQIAIONkLE76Z5x87KGuj5Amz0K3n22UdVHiM/ZsOwAk8yePFi8tV26yP9WYOxgE+8KkFxz3XeJ5+ZmiBdWqv+xPO/RnXSbcIWSvOXSflF1trxisSvtjFsm7OOU/CbxxAzcBkmCkCWYm8SZtaXnSkUOvUG7OFV/k7mWH+tigDyfcfZCQFlN8qBoJttR1jZ6QhgRp6mpToCEa9q4/hYYApiwY62t+GQCUvehaCsNOxO6NL1/b8OvHfff3AIDBJK974MKr71sS0uI2o0YnIAl3AKgtbcmbkoEEsUDYM8tnvKW/K5QdQUy4lyjaDFYf7gkVyVuCmHBv06s8lBSwyxXHs2mUDvCgTaf8tf7U7w2nOvRqtC30KIC9HdV7O6rnxGc9Me7CbHEsukUotetVjtHr5cqORq08WAmv80qXQfNu6a4/GoqDfsmKKFW0P3z099Hifc9PunhytJ99gPBr1/f1aD3b3V75z1Ob2gMb1U6HyWYJZ1IM88A+oPjjir16ixltC5iVsn1bc3RD09n/y194VUYh2gwgCep8rACdz2ciZ03aXo3ZiEw+oACeP7nhl/oBo0noO9BR87dDP/131nVc9wW4e0262/Z9V+btHr8HW1pKe4zaz2Zf7+GvBAs+WrxSmvSvntm2tqEY92lcGkn9FufqKMn8yS6z7Yh4XgEaCiOTTduhL3E8HSe9YnAO0Y5BsPIlqw92fmB/2qw9bqOsniutO+MxpRel/Htwtv0cYnb8Q3WafY5Bvq26Is8J91TBNDTkygTZNRXKzQpT39jENt2A2hojQJVym3Mdkmmxdw7OqDqMl13dqi9q0BxEG9wL3X6O5eZKOQPyMxmi+Y6EOwCkC2c7D/EGgCT+JEfCXTWwEpGzULzm0H1S2nRFLboTjqfz4h8dnG13YJLchYnP/FR3veNNPyn/brmbhHuojw36Qt4RGUlSMl30Y5pr/Z8wWF/uJWHnUslxF1Udll8/Cw3RoJIHM8U8JCJzb6z5fLdztp0giUfeuO6C1a7vQwZRTkHKvo1FSLDkeB1OuAddgTSJTsIdDQXAuSAyHcXyvnvLQVGu8H7pWxBAMZl9HdXf1xzb21EdCVnm/R01qzo/fTBvwZ25c0I1CsjJ7/VFr5/d7qh8jfntj4biV09vVZn9XBzFD5Wqzhv2fL161ITHx10YOYWDPfBaGcZks/779NYfao+jDaGxICEHDWFDocugefTYmiNd9WhDUPWadM+d2rCvo/qVyatEA9O40shYDfJ8PhMNRgGUKdunxoxyDn5YtsfvbLvd0a76/zv628czr0EbAABAZzHdsu/bwLtPx7obHjn6+4czr0YbggcfLXRsby3756lNPcagXWGNMCO43+J18cNI0G2opKD/PkeSm8ydXSJvguOxlTIpzU1Sdnp/s0dTo2/3vMAjmxSMEsxy1OLoMlQMbPcTAWSGaN6pnu/sTzUW/9NWkalCtcXxmMeU5ksudWp0YUr0raFIqvqxn+O4eUgkhjOgS5zEn+T8FADErP4Lba0l0KpTPr3m0H1STjtVnI/h5GSLFzs1usBnRueIl5Qq1tmfNmuPaS3djokCziLk2ABwc2sCcylnXCoaAjh9uAYN0aOUaxQ9GjRKg8sUf+HcXDREQ/XZYKbkhkQE7o3W+u6vXtvgHFl545wwZNsBYPwsF8mL4oODCiFhASuQeE8uO68gFzhfE+6n5S1BvAikM9bMj+rtFpttbePpS/765M4DP+xurwriCw6QlbK9VbLzzgPf0ylQG6BOgxpn2wPUZdDceeCHJ0+sDedVqx0F8EdD8aU7/+v1DlwkaNN5Srj3GLU37Pk6bNl2AJiPE+4R4Hh34+odn4Y62+6wvbX88p3/Rc6P0lDmfbzCZyJ3kLfpUGfdR+V7nSP+2dVW+XNd/4g2Z8+cXB94tt1uR1vFdzVH0WjA8NFCEwXwdsnOBw7/irPtLo3IfouUk+543Kw93qwNX3fCP853BQggXabtHATMASMvDRaF81MPmAQnW7wIjQ4Sw+2fl2yyaRwrZAbIOddptukca7eOAHprr6OiNwCkC+cwCC+TJmO4o0WsBDQaDL7uZwkbnWXCY0qdh40PLn3OZUQ5HltsQfiep/+aQ/RJMdv0jdpDjqc5URc6NbqVwp/q/LRNV+T81C6ijg2ccPfBmEmjBtcDKTtZp1HqkCAdp/ZXoiEajHqTxYx+/4qlAv8WbvXvNUSOyNwbf365B3lVV/xtofPT0Bk9PlUaK0KCJ/dXtDf2IEEsQAXSRDQ0SHDXyzrZ0zfniyatxVStDvTut0OZwvsFsB8j3B8+9vvjx/8M7o4Kov0dNbft/zb810KYT0oUbVfs+mxfB1rwLZzadMrr93zlLoUUOTyUlGnUyK/e/cXp3ha0IWTELG5haGa1Y/Tt7ai+48B3Yc6INWp7b9z7dZHTNKxojqehf6GGz0TulDqVcddaTP84/kew8suvndk+eOnv72qO2lcEDZY3zu7oNAS50gs+Wugw26x/P/zLpxX70QYMAEZuvyVTON9RO4IC2+aWxw91fqizRO5FqHPFCZJgAHiaH4Ks7Gp1n51ExPMK6FTX4Q1c2dJkC855GRlZb6WCXzVuqHQbBqRuUvhTnJ+6E6IqRr7uZx5TgkQIIBkk2/EUSVsDgHPK2EIFIeFO/zWH6JPSaSh1vrHkrio9ArkV0WEodX5qF1HHBpo+xjzg8NgFU9F7TVaL7eC2s0iQjv2bPFVKcofBdFECieNXflmj1B3fXYZGh5XI3Bsn9w2YBSaM4scmSpwjoUMQxMJBQ+kpG7X2631IEAtQtjjOa21Qjdk4+HrSP43aXj8SIs7pjAB5XTGVy2Dm+F48dFXaeDQUYc70tt6+/zujL9XzsXDa2lJ6/Z6vh6R4LsJksz5/auO7pbvQhkjirqRMg0Z+475vmrUKtCGU5sZnhW7pNoyObS1l9x76yafVQYJFbTbevv+7E+duJA9twh2fidwpc6om93H53i6DPxNzXdJZTMhg+Tad8o2z/cUYg8JgNX9QugeNBgYfLV5ZKdvDR9dsby1HGzAAGNH9FiErfry0v46TjbKc7v3l+9qr/2r9V4vuhHNJigjhnHC0UmaLzdOdKse6jnaDE6buRHOy0JArJDkgg+FhuDFm1+M0hBkAJOxRzk/dGTy0fEhwSDEaAiChP7XFZaAbEE6tVIiXfECE6JPSoXdOohIStotqIoNxGANGl7ocQR9Rx4aXhBGGmHXR+MHrpv7y0V+LL5tCMny4eyHvVB3zK73LZDF4Ao5eO+CmlkrhzxD73z7dpdN4+rREvsjcG8hauGaTxWK2Mlku7g2EwsXXz17zxR7KNmAI0ob/7V+4enLOeFrfYhgdDIIYE5XgNaNdruxI5kvQqO98rSdjV9TTfFV6IRr1ncZsbNb2TyVzaUxUAoPw4TvQbmFibqYoplbdjTZEkjO9rS8Ub3q58BK0ARtqv9SdfP7UhuCMtwySj8v3Ga2Wf4xbgjZEhh6DxmyzsgYubtymV92873/hv/hfkNg/exoLv2PdDY8cW2OxhfWazZnWYrrjwPffz7slT5IYzRWizWGEz0TuVKu77N8Yjdreb6qPoM2BWdt4+v6xCxJ5fTmFV89sM1jdDq/z25rGogfzLwjiHR18tHj1zMn121v9uch1xiYZXAbLStkMVkuoVxMNpxHfb5kWe6fBqixXbnREbJS5Rr2zRr1TwIzJFi/JjVompZf8CgNkqGyXscK5/DSiy9B/D4kkmM4FtT1Dlr4MLgps3YaqHmNNr7FOY+k0WtUGq9JCGSw2o5UyWSij1WZCf2akQBK7NOuBeC6H4k7Q97PzYHaXGISXDbwK4msO0SdFY3aeK0Z9XunPt5DeqkBD4T02vMIJd98sXD35i1fXmwwDeoQtdV3bfjly0bUznYOeffOfjcgvoU8SI0JSzEa9qb6iLT3Xe40Lh6rTTX98GeRBH0MiAveGKIrfY+j/kBv1ph/e23bTI8ucNgmhpPSYhZdO2fH7MeegxWJ97cFv3133sEDEdY5jgSiQJnlNuFcoOxYl+rOiAMLXejJ2wVo3tUzZ7vXawI8C7gBAANyWM/OZk+vRhgjze33RzNjMFakhmWiG+Wdd45l/Fm30emSG35dVh0iCeLRgMdoQASiADr06RSBxRFRmw50Hvm93M/I9dBgEMTc+G41i4dKo7X3g8C9mG1qUL8z0FvN9h37+beGd0RwBl8EckrH2gM9E7llstipVV54k4bOK/UE/Wiw229dVh54cvxQADnfVbWsJNEXrksVm+72+6K7c2WiDv/DR4tkvdSf/aPB5DjeLZEyNGTU9Nj1fkpgmlCXwxGynG8Mqs6Fdr6pSdp5VtO5tr64J2d0OCZuXJpClCqWxXLQ+Z1CcD/0WAsj5Cf9IF8451PWR0jRgtJDW0l0s/7FY/mM8r2Cc9IpM0XznitVDQsJOE7ES1ea+2lnlig0e0ojOdxESeOPoVImxo7+lT3qNdad7f2vQHBgW69OGgsnmPOmKYJG0shxMeps5hGg/MwbWXRkMKczik6C/5hB9UowD3kE/WSkXtw3Cc2zQ5P8beX4SRvGXXD514/foCrYf/+uPrPwUmiOI928q3j4wH+qTsYXpbQ1oV2PnH8dve2IlEnSns6X3n3d87nfGP6JE4N5IyYzt6RhwV+3H97eVHKu98MppoyekxSRKuDw2QYZwHv3Nj158cMtp5D5ES13Xw5e9+68v70hIjXaO06fo0Rzcevri62ahDecrOiXLK5TOd279598I91p1t8psELMCPXnQWf2Vzt5w6ZK08e+W7gpkono8T5TCl8bxhHFckYjF5TCYXAbLYrMarRaFSd9lUDdqe6tUnQGmcl47s21h4mg+M9DhBlhQbGspe/LEn35XE2aSZI4oLlkgSeJHiVlcHoPFZjCNVovBapYbta06ZYNWXq/u8fO3A3xeeTBTFHPZqIloQwRo0ysdCXcrRT189PdqVdeALcJigixFMqTrZJ7P9Bbz3w7+qAhgrWYJm5ctjs0Sxco4fAGTwyYZeqtZbzXLDdpGbW+DVt6mG9AL8qBNr/r74V+/mXtTNEcYrCJsfsBnInfKFO3xPNG6pjNoAwCXwZoSkzYmKl7K5hME0aJTHO6s8ykZuqHp7OPjLiQJ4sOyAeVlnDFJcpIsNU+SEM0RshkMuVF7Wt56rLveSvv7f21jcRAT7oCPFveqVJ0vn96CRj1K4kfdkj3j0lETRSwO2naOmMUVs7ijxXHLUwseH3dhtarrx9rjv9afNPl7E4gAiOOJ0gSyNKE0TSBzPPDwGgJ3XvVbRglnpQln1Kh2nu79pcswoNQqAHToz3boz0axU2bE3psuDOZn0w8FkksPdX1kf1yp2pYsmDJavHTgJgAAxfIfW3QnHU8nyPor53jFJIN8XFlshv2d71Qqt0ZglZ5wci5swiTYnguLO7AIup3PkO5n5/owQRS61xyKT8rAtHgwhfrY8AlOuPvs2gcu3P77MSQ/azKYn7/9s6c+vLlgmpcqXTt+P/b24z8hFT98Ujhn9M4/jiPBtV/vm7diUnZBChIf7Pie8v889J2q1+d60JEpAvfG4iumDa47dPpw9enDaNAZQRBcPlso5okk/PQxSTnjUifOzvFpnL5DbKLk7udWv/P4z0i8sar9wVVvX//g0mXXzmSx6X72FT2a4oNVu9edPLarlMtj44S7Q4HE+7tTQSNV7ZXKbKjxKyNGAZyWt8yJ9/Kl5JVzFVd3/BvhDgBsknFj1vS3Snyo3DpKKJsoS5koS8mTJGaJYoQ0LpCsFFWqaDvQUbO+6YxP6QCHLoPmk4r9D+cvRBsCFs0RZPte/t5ObzHTTFHJOHxZ8ObUu5RwrjJAqJUq2h87/gf9bItDblT84qTcefHZYyWJzqPnXFKbjUXypr9aK/5qLfdjBYXnT21ME8imxISkGmAgnAezv12yY39HjVOjJ1FsXoE0aZw0KU0gTeRFJfDEPCaLx2CxSabGYlSZDWqzodeoq1J1Vig7KlSddeoeD3UAFiTkoCEsXF47s82/ghiJ/KjLR028IHF0niTR87VLp0F9rLtxV1vFX63lXpOGJ3oa521+a2iXecRnIncOdtaUKtqQguBSNv++sfMuGzVxcDJ3f0fNv4o2NXkrQ2fXY9Qe727gMFjHuhvQNgAhi3NHzqyrMydL2ej4uGat4qXizbvbq5C4SzXq7kaNPE0oQxv8hY8Wd14o2ky/djyTJO8bM//20bO8no4R2eLYZycuu230zBeKNu+hdwwAwHhp8sWp+WkCaZpAliqQcrytwxRc52G/hQAyW7w4W7y4y1BRodxUrd5htA6oXKc0NW9teSpbvHhBwuOBV8/wW770snLV5l5jnf3prrZXGjQHR4uXRnOz2STfaNX2GCvLFBsatYcdP5Ipmp8m8KGwQXCZbNr1TQ8ha0KySUESf6KMkxnFSuEyJRxSzCJ5TJLDJLiN2sN72l9z3njEYBL9X6QeFvxEUEDrYzgc93NIX3MoPilMon9QIJPk0lzaFCHlpKOhEB8bvgrryWZkiE6IuuHBpV++tgGJ93ap/3HNhytvmrPihtmp2fFIq8loOX24+qcPtpccq3UEuXy2QediEoRnM5eOE73IVw+sVG4ymJ++8ZMHXrlyzjK38zsqixt//WTngS2nKafz/eAa6MNLBO6NBasKt/585OxRulkMO4qi9FqjXmvsalPUlrXa7yKMmTTq0tvnz1sxCd3am6VXzyg72bD15/6vPDuVXPvx82t++XjHgpWTxs/MyZ+aObjIjKJH01zT2VzbWV/RVnyoqqGi3XkXYQ6Zohg+k62zePoIN2rlBquZy/BnIV+HUz1Nfr8BRfLmwBPuXldMFTDZGaIYNErbtZlTPq3Yp/W4J8Us7pz4rLnx2XPis2J9r/bLIIhx0qRx0qS/jZl7rLvhg7I9R7rq0Y28+aH22N9y5wzOLwToqozCqzL8LLV/sLP2tv3foVFXrsucev/Y+Wh0GFKZDQ8e+ZX+JT0AkASxPKXgpuzpPt0WErE4c+Oz58ZnPzth2cbms59VHvBpJLjZZn346O8bltwT+BST4GrT9SXc93ZUf1GJTtcbLFMUszR57OKkMfnubzHymCzHp/KCc5XZDVbL0e76fe3VezuqGzTy/q0BAGA+TrgPkYOdtT/VnUCj3qQIJA/nL1qanEdznds4rmh5Sv7ylHyN2bimoejTiv2esz9y44Be3JA4z89E7mxsLkEik6JT359+ZYybf/6c+KzfLrjj1v3flSr65p57tqahyOVki3HSpPemX5nIj0IbAAAgRSD5eNa1/zy18Wd6B/Ou9qqbs6ej0QDgo2Wwjc0lLm+cuCTj8D+eec0EWQraQFsyX/LJrGs/q9j/VslOtM2VBq18WXJ+PC8ktWI8O8/7LbHc3Fhu7sy4+xs0B8uU65u1x8Epq1Wt+sts012U/ArNIahBxyBYFyW/sq7xAa2l77ZWrXp3rXq38zbOkviTLkh8Go2G0f6Od5wzqiJWwrSYuzJFC0jC9f2YoI+vjxwsRv9AIgpsFsronGZ1x2Tz1BtxGI77OaSvORSfFOeFYRkEa2nyy06NAQnpseErnHD3x+V3XXBsd9mZI2hGlbJR677et+7rfaNGJyRnxEbHRxEkoZJr5Z2q8qIGZFC8QMT9z68P3HfxG76OducLuZffdcHXr/dXR7JT9Wpfvufr1Oz4GUsKMscmiaUCBoNUK3TKXm31mabTh6tb69HxEZfePj85I/aDZ35D4sNIBO4NJpPx3H9ve/X+b07tH3CD0Q/lpxpevf9/O/848eC/r5bG+tZHfODlK5VyzeHtZ9EGgJ525e+f7f79s90AwOYwRVIBX8Ax6s06rdGgNVosfs7QPN+QBJEnSTje7am6uo2iKlWd46XJaIMv/KsnY1csb0FDPrJSNq/99XxpUiDdZBGLc1XG5K+qDqENABI2b3HSmKXJY2fGZjLJ4JR6nBoz6pu5N21sOvtC8Walq+t8dzRm4x+NxddnTkUbsHChAP5x7E+aYyftpsWmPz1+aW4UehecPiZJrkobvyK14Nuao++W7tJb6A6U6DSoXyre/PqUS9GGIdWuVwJAj1H7xPE/PXc+5ifk3Jw9fVbcgIWS6OMymPPis+fFZz8N0KTt3dxcsqahuF7TAwCJPHEg7wjmN4PV/PSJdWjUIwLg9tGz7h+7gOvXgFAhi3NT9vQr0ws/LN/zZdUhv8sphAE+E9ExXpr8xezrPSdwo9i8/8669pIdn9C5j/Jn42k0BDBBlvLVnBs8/xUC4LmJy8oU7ad7vfdzjnc3Bjfhjo8WBAXwQdluNOqGhM37bt4tmQEM1LAjAO7KnSNgcV4s2oy2DaI06Z87teHTWdeiDSGG+y12DIKVKZqfKZqvMDWe6P66Wt0/QaRBc7BatSNbvNhp87ASs5IuG/XZvo636jX70DYnLJI3QXZtYfSNQ1h6XmlqqlJtczyNYqesTvvYOWs5mI0asdf1XHLAP1xj7pCwvc/PMFr7J3q6Mxz3cxhec9A/KTxm/8wzo1VtpUzBmuwSumPDD/70njGSQT7zya0PX/ZuS53rPFRDZXtDpacxoUwm44n3b8oYk5ScHttc24k2e3Pp7QsObT1TUewi09dU3dFUTauKxcJLp9z5zKrBeedhJwL3Bk/IueLuhW2NPe2NPWib747sKHnsqvff+O3vkmgfBsgwmOQzH9/6zuM//eVxwQCT0dLTrgzCqzwvFUiSPCfcAaBCGcKEu4zDv2fMvJeL3VbMLJY3U4ENGqlWdXmtkkmnuo5nN2dP/7bmiMXWV4CCQRBz4rPttQtY3qbQ+md5asE4WfJdB36wZwBp+q3uVBguXDF3fqk7sbud7o1MJkk+lLfw9tGzAjn+HRgEeUv2jFlxmfcf/qVx0Hhtd9Y1nlmanBeUlZODpU2vAoDnT230kAsbExX/1Pil02LT0QZ/pQqkd+XOuSt3zsmepjUNRbh6+1D5uuqw/QCgictgvTZl1dLkPLTBRzwm69GCxfMTch468pvnoe5DC5+JPBOxOO9Ov8JzHtwuhit8cvzSx479gTbQEM0RfDTzajp/hUGQT01Yes3uL9GGQYrkbvtRfsNHi7M97ZV1alqvikEQ702/MvBsu8P1mVNrVd3f13q62LHb0161p70qzPOrcL8FIWGnLUp6LlO94K+2fzryfaWKdUOYcAcAPlOWJpzRrD1qoYwAwGVEmW06G2VlMwRcRlQMJyeJPylbvJhN9g+bHRI16t3OT2fG3uc5owoABqsCDY0UMs6AESG9pgY6SVWFycuVOwzP/Rye1xzcT0ocd0D3stNQnsgb7xzxW+iODT/ghLufxFLB6z/f//SNn9RXtKFt3rA5zMffu2nKgrEAkJWf7EfCnc1hPv/FHQ9f+m57E63OzWArb5pzz78uIwgiOSM2Lkna2erDjfdIE1F7QynX/Pnl3o3fHUCq3ASopa7ruVv++86fD5EML7cKnTGY5CNvXjemMP2/L/4ZxFVhMQc6K4V6rcfimcVmO+N+9NZYSaLn2aYqs6FO3R3IhU0ZjTL04wK7owAACTzxipSCPxtPR3MEV2dMviZzchxXhG4UbGkC6bfzbr5m95c0y6ADQJmyvU2ndDfJHQupHqP2zbP9Q6I84zJYH8y4KvB6SojR4rif5t92075vvE77cHj19Nb58TnBGucYuEaN/Luao3+1lqMNAABAEsTduXPuH7uAZuUQXxVGpxZGp6JRLCwUJv0XVd6LCDmwScans66dHrz7LlNjRn0//5Zb933rU9I/nPCZyLP7xs6n/0dXpI77b8WBKpXP1zjPTlwWTXvFkYmylHHSpDO9rWjDQF0GTbteFdyFRvDR4uzbGu/5brsbs6YH8W6u3WPjluzrqG6kMYr83dJd4Uy4436LOxmiefn6S8/09k0r7zSUDWwPtwOd753t/R0ACCBnxd1fIL0ssNFKoaIy918SEkCmCqY5NbrWbahCQyNFLHfAbaFW3ckM4VzniEuDV/EdbDju5/C85uB+UpL4EwkgHeu7NmoOByvhHrpjww8h/CYd8WRx4rfWPLj4ct9GDSRnxL7x299nLR1nf5qV72f1OmmM6N21/2fP2vuEJ+A8+tb1975wOXHucnri7PD1PEIkQvbGzj+O33HBqz99sH1wtp3LZ8ckStJyEkaNRv9Ly0lISIuOTojyvJBp1ZmmzT+6mLvq1fLrZ/33ryc8lLOnKSs/+bYnV6LRQT7adyT3xbdzX3y7W9M3iq2ys/uFzTuXf/K/ya9/OOm1Dy788KsHfl3/y8kzyNpBB+sa7T940UdfO8cRF330tX2zg3UDbkI6fnxrWRUAWG2234tKbv9+zfx3Pyt45b2p//lo9Wff/Xv73maF0vmnAlQg9T6yu1Lp89Wms1Jlm4cV5/IlCWOiEhiEp2/yAKvKlNEow0pnP3h1d+7c16as3r3sob/nLQjDVatdLFf4yaxrvK5D5Wwn7ZFKWHD9+/Q2mssqchjML+ZcH/SrVjsZh//N3JsSaSdumrUKmlWGw6NG3f2SmzkxIhbn89nXP5h3QYiy7djQ+rRiv9psRKNuEABvTbs8iNl2u3Rh9Dfzbo6K4CkO+EzkTjRHcG3GFDTqHgFwXaYP29uNlyZf5OOMiotT8tGQK/4tFOwZPlrsFCb94c5aNOpKFJv3QN4CNBowLoP5SMEiNOpKqaL9IL2XGhS43+JBAq8vGQIAVspko9xe7IRalWq7PYcIADPj7iuQXh5IDjGknGtMsxlCkvCUOgAAi83Q5LSI5QjDZ0Y7D1uuU+/zehRpzB10kqrDcT+H4TUH/ZPCJgUpgv5+QplyndmG5tD8E7pjww9e3gnMM56A88ib1y29esZ3b28uPlSNNg8kixOvvnXe6tvnO+dVs/L9Hxkqlgle+OrOnX+c+P2/u+rKvQzuAAC+kLv48qnXPLBEGjOgUzhxTu62X486R4ajId8b/3tz84/vb0OCmXnJy2+YNWFmTlJ6jCOn74GqV1tX1lp8qHrLT4d6u9RI6w/vbbv4ulkE6f33IOJTZE9/fEtjVfvar/bt31Kskvd/I3tGEERmXlLh3Nz5Kwt9PVY71NoYoeCDvYc/3HvYuWxrg1zRIFeUtHdeVdjf0wqimm55p1pz3y/rT7f2Dy03W62q9q6y9q4fjhe/vHLJyoIxTj/hv1HCaBGL4zmFUUFjhLgHHurJAECeJJHLYOaIY8vd/5UiefOlo/y/3eJ1hHsUm5cqkKJR32WIojNE0Wg09HLEcX/Pu+CNs3+hDW4c7WoIw+xsDHGyp2l90xk06goB8O/JqydHe5856LdojuCd6Vdev/crRzEBzz4q33vZqIk8JgttiCRSNv+LOdfnBVweCotMGrPRpwTKLTkzFycF50SJSBNI3552+R0Hvo/Meu74TOTOJWnjOT7W8V+Wkv9S8RYrRet70u6WnBloyJs58VmvndmORgepVXf7vSKFO/hosdvRWoGMoXHnxqxpAhrFgvxwYXJehiiaTlmbX+tPBv1IcAn3WzzTWPoHJHEZYq/5wdA50/ur/QFJsPIlqwe0RRiOU2Vqk1VjsRmYpKcVbk/KvzWEpix1hMiNWnak61P7Y62lq0y5Pl9y6cBNBiiS/+i8Zq87w3E/h+E1h+KTMin6xiZtX+bNaFXvbX9jUdJzAzfxU4iODT8M2VfbSFIwLfPfP97XUtd1ZEfJ2aO1TdUd8k6VQW9iMkmBmJeUHpuVnzxl/thJc0czmeh4hMK5uZvr30aC9BEEseiyKYsum1J6ou70oeqSY7VtjT1qpU6r0hMEweGxJdHC+BRZxtik/KmZk+fmsrkuTpwXrCq8YFUhGnXvkTeve+TN69Coe8uvn7X8+llo1L0xk0b5t0+GZG/YbfrhIJJtJ0jirmdWrbp1Hp08u4NYKpgwK2fCrJzL77rg2Zs/LTtZ79wq71RVnmnKneBnhywtJ+GBV66894XLy07WlRyvqz7b3N7Y09Ou1GmNJqOZzWHx+GyekCuJFiZnxKZkxaXlJORPyRBL6U7sRXRptO/vOfTB3sMAwGOxsmNlPBarQ61pUagsNtuC7Az0B4LkbFvHzsqaM60dBEBeYnx2rIzFYNR1955saqEAjBbLE2u3ZkRLCxL9X4zIgQDIkyQe6apHG5yozIY2vYr+uBKE14Q7AIyTJnlOuKMhX5QrvJTEoVNXJ8LdlD39+9pjbTol2uBKicL7/Tws6D4o24OG3Lgua+qyFN8GSPphgiz51uyZn1UeQBtc6TFq1zQWhTTfESA+k/3l3BvGRiWgDdhIsbbxtM5iQqNujBbHPZy/EI0Gz6y4zGszp3xPuwbFeSLCz0Q0B5I7k7B5E2UpJ3oGzEf0QMLmXZjk81zVLFGskMXReBz6AAB1vtQ9j3wRdbTs6aBVl4AAuGzURDQaJATApWkT3irZiTYMsrOtUmsxhSjv7+x867dYKdOJnm/GRC0Xs7xfFxisKsdQWRhUyjnMeo315x7aLJSBTfiwZFqYyTjpjscU2GrUu3KjlvU3D1Sm3HCq53s0OrKMFl90oucbi61vHsnhrk/iuGNjua6HC9Rp9pUq1qJRV4bjfg7Daw7FJyWRNz5NMKPx3Fj7avUOoo0xL/4Rz3cLAMBgVVaptifwxiHVYxxCdGz4ASfcgyY5I/ayOxZcdscCtCEs8iZn5E0OVQZz2Anz3uhpV/73RfQjevezq1fdOg8J0icQcR9587o7F75KDRwzcmp/pd8JdzsGkyyYllUwLSSTFp2tKS7ZVlYVLxI+vmTe0rH9pQA1RtPOypqsmFCNCdpRUQMAWTGyNy+9eGxCrCN+prXj7p/+7NHqLDbbh3sPf3z1qv6fCUCBNMlzwh0AKpTtfifcT7lPuItYHPvQ8nHS5F/rT6HN51SrOnUWE531xwZr1Sm9Tob1XER+WGCTjFuyZ7x6eiva4EqzVqE06SO5JMLIc6a3leYc8DSh7LGCxWg0NO4dM29t4+lOAzoVyaWfa0/4dOEaTiRBvDH1UpxtH9l+oLGioMMT4y8M0aqPDg/lLdzaUtZt0KAN57FIPhOJWdx8v6a/TIsdRT/hviDBn7LRJEHkiOM8dJbsOvS0vquHi4g6WorpDewYL0tOCmUp+aXJeXQS7kar5UhX3cKQLQpqdx72W2yU9VTPd6d6vo/njU0VTE/hT4nmZA/Omhmt6jrNvhM9X2vM/UOFxkhWOG0SbhyG2GLpAgAbZd3Q9Ehh9I1x3DwuQ0QSLkbmDa00wayD8KFjHO7BzvcFzJgUAfo29RrrTvT8r0a9EwAYBMtKmZENRgw+UzY5+pYjXZ/Yn1pshnVND06NuX1M1HLndTvV5o4zvb+UKP6gwEYSDMdqve4Mx/0chtccok/KBYlPr2m4S23uq2FbpdrWrDtWILk0VTAjhptD9JdAp9TmToWpodNQ1qI90WEosVGWi5JfPdeKCtGx4QeccMewQK39Zp9RP2DgWGZe8iW3zHWO+CE5IzYzL6mmpMU52B3Agq5htrWsKl4k/P2O62KFA8bICznsS8b5PILJJ2Iu95sbr0D+7rik+CcvnP/oH5sBYH9Ng9lqZTGCkFAokHhPN1coOxckjEajNDRpe7vc5yPGShIJAPA2xtxKUWd6W/0rxVtGY8XXAr8uwiPN6rTxb5z9y2yjdZatVXdPwgs/htHH5fvQkBuPFSziMgLq9tHHY7JuyZnxOo1SBgBQqeo82dMUmeuF3pw9I9SpB2xoHe9urKFdwHpefHYY6i2IWJzbcmbS/PicPyL2TFQYnUb6Ml/TwXP/BDHfr54SAGSKor0m3DtHVsIdIuZo6TSoad7MmBEb2rFQo4SyRH4UnVH/hzpDnnA/j/stVIe+tENfehy+AiDErEQeU8YmBQSQFkqvMXeqze2ONRLtMkTzvK5naKGMJqvWZNOYbFqzTWe0akw2rcmm0Vn6Z64oTA1nen9jkwI2KWAzBGxSwCL59qeD8/7OcsSLi+Q/2h93Gcq3tjw9sB0AgACSRfJ5TEk0JzuZX5gtXsQmgzC811dR7OQc8ZIqVd+sepNNu7H50WhOdgKvgMuQWCmT3trbqS/rNdXbN2AQrOWpb25veV5vpZNAoMw2vcmmM9k0JqvWZOv7z2gd8AFv1Z1iEGz7Hrb/xyIFbAafTQoZgSVe/TNeelWj5mCb/rT9qcVmONT54dGu/8o4mTyG1EIZNOZOlblvlg8B5NLkl7e2PO05rxri/RwSYXjNIfqkcBnii5Jf3dT8qNbS11PVW3qPdX95rPtLAkgOQ8ggOGab3kLpPb9rg4Xi2PADTrhjWKD2bypGIkuvnu5TJRl3UrPikYS7knb59Ujw9NIFSNY7PG6dUejy7y4dm/PE2q0Wm81ktdb3KHLigjDKns74br/LuHuuJ5Mv6RuRmhsVx2Ewje7XVi2SN/uZcPdWTwYAxkmT0dAwFMXmFUanep2sYNdO79oSC4oWnWJXWwUadWW8NHmJ7+UIAnFVeuEHZXtoVupY01Dk+4VryKUJZQ/mXYBGsZFla0spGnLvztzZaCg0rs6Y/En5Pq+TqM4rEXsmypf6OQNmTJQP5fsmx/j5DZnEk6ChQWiO6h1GIuRoodNRtJsoS0FDwTZOmkQn4V6i6BtKGSK433IOpTK3OvJZLmUI5y5KfBaNDtRjrP6t/nY0OkiPseZg5/toFAAAVqa+m8SfiEbPmRJzW4+xtkl7BG1wQoHNZNOYTBqlqblWvftw18fTYu4qkF6Gbhd6c+If6jFWy4398yd6jNU9RhdLCbJI3oVJLyXyJsTz8uo1B9DmQUoV6/Z1vIVGB2nUHnYUAEHclrOFRYZqJo07JMFYlvLaxuZHOvT9XR0rZR68ACYB5PyEf6QJZopZyQqTl6lXodvPoRPq1xy6T4qMk3HZqM+2tz7Xrj/jHKfA5muheWchOjZ85fPEPQzDnCl6NG0N6MCxYBVs4fLRMiAWS5DvuYWOmMtdMiYbjYbF0rE5aAgAANgMRpyo7y6rwhCci/wUgUTibZauhwLrnnlOuDuWN2QQpOdrWr/LuHt95TFcYTxPhEaHp9lxdD+27Xr/z/2Yr/5sOE1zCRs/VtsLkJDFuSCR7pDM3e1VNP8h4fTU+Au5Pi6EiA07O+ilfgBgbFTC1JhRaDQ0BEz2qrTxaPS8F5lnojH+lpxK5EXRLE+UxI+K4/rZnUigUbVPYdKjoeEvEo6WFhoJbrsccRwaCrbR9P6E3+NgaDo/+y1MkjNedjWHQfdTLGIlLEx8+sLkFxkEerUbZlpLdwKvgEXy0Qb3zDb9gc53D3V+iDaEHpsUXJL6XpZoIdowUDyv4LJR/00RTIGhLpEfBiySvyL1nUnRN3iobSJmJS1PfdNe1lzK9t7PGY77OdSvOaSfFD5TdknaexckPiVh0yqeLGYlTY25I4E3Dm0YKBTHhq/wVRaGBaSn3UVHMzree9efjp4O9JfzBBwkErEKEuP8m4AcIA6TmREtRaPncM4tXGy2Bu3WRb406UBHDRp10qDpMVotHN+zWjQT7gBQIE0qlg+YDOGMZnnNwUq9DQKiM8B/uHDMGPCqx+i2zg8WdGub+mYCehbHFS1NDuswMbuLU/I3Np1Fo650GzRne1sj6iMzXprsX7UrbBgpVbS10s6IXZExCQ2F0vLUgm9rjqLR81tknonShTI0RA9JEIn8qEaNHG0YJNfjuAHPZBzv1/8Gq9lK2RjEiBpqFglHS6tOgYZcYRBESAu42yXzJWjIFa3FpDDpvQ6X8dv52W8hgJwZe++0mDva9WfbdEW9pga1uU1r6bbYDBbKCECxSD6bFErYadGc7FHCmQm8AoAhuE50ZrCqDnV+UKXa7lTlhuAyRMgwbRtltVAmo1XtKJBtd7r3l1TBtMFlskONwxAtTnq+0HhjhWpLu+6MytxqsmkAgE0KxazEON7YDOG8JH7/2TyeV9D/wyMUk+BMi7kzL+qSWvXuBu1BtblNZ+kFoPjMmFhuboZwbqZoAUn0XYlLOKNAs2/gL3BhOO7nEL3m8HxSCCBHi5fmiJe068+2aI+36Yu1li69RWm26Zgkh00KhKy4KHZaLCc3WVAoZaejP+9GKI4Nn/icAMIwzJlW7WLIDJMVhE8WRVGNVegQjITUaCQSsWSCUHVkPZPxeWFO9BdIEj0n3K0UVa3u8nXBMZXZUKPuQqPncBmsDGH/wTBOmgxwzKl9ALlR16jtTRO4vQ/hksps8JqmoVPCfrgYTftqX281oyEsNE72NNHJ1ADAspS8IcmkTI9JZxCEdeDq1u7saa+ieeEaHnePmYOGsBFnd3sVGnKDJIgLw1vcYKIsJYkf5fVEc16JzDORfYV2/8RyhHS+xnPEsWiINjHbU4FmB43ZGLqFQ4dEJBwtNGv1yDiCMHTOY7leigU7dOhVIUq4n+f9FgbBTuYXJvML0YYARHOy787dg0YDprf0rm16QGnqG9uUwBs3Kfr6RN5Ed0VRbJSl19RQq95dJP/BRvWV8Szu/WlwGpHPlPnxgrNFi7JzF6FR92SczJmx96JRV5L4E+m8njzJqjzJKjQ6rAhZ8eNlV4+XXY02DDQt5s5pMXeiUTeCuJ8vSX0XDQ10a84mNOQkip3s+fc7BPE1Qyg/KS4RQCbyxifygjwDMhTHBk1D8C2PYSMJm+Nifop80Mh0P5w+VN3RjPbYMsb4lrQdQkFZktQP3GDc7fAJnTXB/Ji+WiRvtrnvDY+Jine+dPG6cqkfg9zLadTlHCfz/m8fLmK4QppXPib35fKx4KJfCmNpsg+TIoNIyOLQL7bgec5KmMVwhQsSXFffwkaSE7SPusLoVPrpqmCZQ7smxnkiAs9E0RxBIIs6RnNdrKkzWLrTGAJfiVn0Eu4WIxoa5iLhaNFZaKXyw3OrQ8iiOw9YGbISQ7jfMlzs6XjdkUPMFi1alfZ+mmCmuxwiAJAEM5qTNTXm9mkxdziCrbpiR0oRw0Yk/EkJEK2TNIZh7sQmStAQwIm9dDtb7phNli/+vR4Jkgxy4uzzffq/wRxxX9Z0Eu5ei6EP5rmPi4yXzxTFCJieaiD6Uca9jMZrHkkj3AmAGHp5AUPILlwxxMGO/pV/PBCzuGFYjc2dfKmX210OZ3s9LR0WZqvSxtPM1GDDl42i6N9tnRWXiYZCz78FvUewCDwT+V1a3c5z58Qhked/vREOvfsBZlvQaglGiEg4Wgz0xs6zyXCMhqH/V4y2UO0Q3G8ZFhSmxgbNQftjkmDOjn+Qfn2bDNF8x2MbZdZbFf1tGDay4E9K4PC1FoYFJDohKjoevUj488s9eq3/42jMJstbj/5YdRrNt05flC+SeK9TObIp9MFZ7DSIEnniaI6XCx4/Rrh7Trg7F3AHAJIgkAiiqIduzsWhTOllhHsSP4pO4dRhhOYgPivlKGCHhZDcqCv3dhDaTY5JC8NcdXeyRHQrIajMhmatAo0OkUWJuWgIG3EqVZ0aM93eyLSYdDQUetNwwn2QSDsTxQQ270HApDXoODmAAt80V3622MK0x8JpyI8WI71UPiMs52j6PYEQ7RDcbxkuWnVFjsex3NFchg/fP2zSy0Ufho0Y+JMSOJxwx7BAzbywAIl0NMtfufdr/3LuNSUtD61+Z/e6k0icIIir7/Whstuw4yhBY3K/nGmrUq030xpKE2ZeB7n7mnC3UrbT7hdBBYA8KTob1HONxQpVh6/jm7yWlPH6rx52OLTHRmFhcKiz1m1NpYGmRKehoTDKFPlQCcHrQsThIWJxJsiS0Sg24ng+jzhjk4whOSRiucIA87kjT6SdiWiOoXaHRdIqMBjIYUBzso4lNDnWoTXkRwuH3t0OU1imFxjpDbcH2jcqfIX7LcOF3trreMwhxU4t3ilN/WOYCCD5TD/XlMawyIc/KYGj1UHBMMyDVbfOYzDRj9LxPeX3XfzGrj9PWMy0upgquXbvhqInr//4/uVv1Ja6uEJedu3M3Imj0OgIEsXtGwPVqda6y7nvqa5DQ5GhwNvcTIVJ36FXo1H3yhTtHmbpsklGjigOCXpOf1tsthKFD9NCzTZrjbobjQ40kurJ2A3haCNsMM+TPJyNob1wXCjE+lJvoUWnQENDYWpMOs0UFTasVbtfeRuRLY6jmRgNutFi9HR2nou0M1GAa0uySO9fNWySwadXecYlmt9mIRrUPLSG/GihWUBfZzGhoRDQ0v4rPIb/x5sHuN8yXDiPvVWZfbg+AoCzijWOxzJOJoHzadjIhT8pgaN1UxrDMA9SMuMuvX3Bb5/uROJtDd2vP/Td+0//OmnO6PQxScnpMcIoPpfPpigwGcxGvUmr1rc3ydsbexqr2uvK2ygPK2ROGnX385ei0ZElPVrKZjBMVqvZav2rvPrifLTcgcFi+fLQCSQYIeiknitUHfE8uh1cz132HHEcc9AVrOcR7gBQLG+ZTHtATZWqy2u1U69/EcMCQX/lg9FDeuEa462ilLM2vQoNDYU8CTpFBhuR6tQ9aMiN0VFDlvXOjYo72FmLRrGIIWTSyqi6Q9LIhksDK09HM+nsoZuN+U1EL+HeZdCgoRDopD20JYpN62X7CvdbhgspO93x2F6lepRwVn+zW9TJnu+qVX85nueIlzi1YthIgz8pgcMJdwwLgpsfu7i2tOXkvgq0AUCvNR7ceubg1jNoA23jpmf984s72JwR/mllMxhzskbtrKwFgJe37h4lk+Yn9l//tyhUT6zb2tircEQiCp3Uc4WyY158Nhp1w3PCHVkx1S5VIJWweQqTHm0451RPM+SgQXe81qAkfFlzCcP8UKmideEqYLJjA6hFELgoX4Z/tuki4sJ1aMfWYWFTp/EyUckhVzxkh8QooQ/FDbDwE7FoFWEPBM2kLRaBaK7lY7Cae006KZvWxn5rpjcWmySIJL4EjQYD7rcMF8mCQj4zWmfpuyf9V+s/p8XeOVZyCZNw/XVnsmkbtYfPyH/rNJQ6gmJWUp7kEqetMGykwZ+UwI3wFB6GhQeTyXj+s9vfeOSHfRuL0LYAMFmMK+5eeMNDFw0uWTMi3Tt3xt7qeovN1q3VXfHFD5NTkzJiZBarrV7eW9zSbrXZChLj40QCe1I+osRwhXFcUafB08gan8q4e06457nJdBdIk/Z31KDRc4rlPqybWuatgHuaUEZzHjGG+aFVp1TTW+wxgedbScGgY5EMAoDmyMmOyBgpli2mu2AaNnyZbNZWnRKNupEqkKChcEkc6o8w5hnNVU8DwQtNQW0sDOjfvq1QdsyIzUCjQVWh7ERDrsRxRewQVNDC/ZZhhAByTtxD21qftT+1UMaDnR8c7f48npsvYadyGCKSYFkpk9mm11q6VKYWubGOggE1qdikYFHSsywytPeQMGxo4U9K4HDCHcOCg81lPfXhzfsunvDFq+s7muVos48YTHL+ysLr/n5hcsZ5lBYZlxT/2qqLnlq/zWix2CjqWGPLscb+cvbjkxI+vGrlb0UlEZhwB4ACadLONhdTHBzozzNt0Sk85+7dlYPwnHDvNKjb9CqaqQ2vr9ZzyXgMC1CVitZlMwDE0zukQ4pFMmiuCKez0q0wG1Lx3KHfaViodehVNto1NEI03pOORH4UGsIiCZfeqpiB4AVQwB0bWvk0airaFctbQp1wP91La2RJiNaNwP2W4SVDNG923IMHO9935ActNkOL7kSLznv9Uil71JLkF6Xskby4GobZ4U9KgELehcKw88rc5RNnLCn467dje9afPHO01mYdcIvPKyaLMbYwfdbScfNXFkpj6db7HklWFOROTEn4/ljxofrG5l6V3myWCfg5sdHL83NXjx/LIMmsGBn6M5GhQJroOeFep+4x26x0VqXzPLydQRDu5v57rWxT1NOcmJKHRl3xWlLG698KP63F1KlXy01ajdmotZg0FqPWbNRbzQarxWj/X9u5B1aL4VzcaLM4NvBath4Lm3baI6oOdtaOWfMCGo1UHhZDDhsRi8Nj4vGkI1+PUYuG3Esauqz3kA/2DK6RdyZihz7hziVD/ici0wg4WlIEEs/1DB32d9TcnTsHjQZPlaqzg14N9ykxaWgoGHC/ZdgpkF4WxxtzuPOTNn0x2uZGNCd7vPTKnKgLz9sVILHzEP6kBOI87d9gWOiw2Mxl181cdt3M3m712SM19RVt9RVtbQ09WrVerzXqtUar1cZkMlhspkDEFUkF0fHi+BRZalZ8Zl5yzrgUDm94D/O5d+70e+dOR6O+SJFEPb5kHho9Z+nYnIpn/w+NAszKSHMZR2y59xY0FCReR3xbKVu1umtslOvB6c48J9wzRbEcN1e/XpPgxfLmZTQS7s1ahddZsXTWiQ2dNr2qWtVZp+6p0/TUqXta9coug1pvGbGXBOchmpfNw04kHKXRnKEsHYuFDf2EO5tkSHwp6RtcIhaXQRBW2oPxI8d5ciYKwwh3xqB14EeeEXy0zIjN2NLSX67XnRM9jfTnWfphQ9NZNOTG5NAk3HG/ZTiK4+Zdkvae0tRcr9nXZajoNTXoLHKLTW+lzAySzSJ4bAZfxEqMYqVGc7JSBdOELNdjnjBsZMOfFL+FvAuFYectaYxo7vKJc5dPRBuwkchrshsAKhQdgSfc893UkwGAOK4olivsMmjQhnOK6JVxL/M2vJ0kCJcLt4aOlaLO9LYc7WooljcX97Z0u/83YiOD56pKw5fRZkFDYReG9BkWCegn3MVDl20HAAJAwOSozAa0IfKcn2ciduiHnzOIEZhwP3+OluWp+XQS7jaK+qn2+P/lL0QbgsFotaxpKEKjrsRwhRNlqWg0GHC/ZfiKYqdMkF0LABq1Ydf2kpLixprqDoVcq9MaCYIQirkiMTc+QZM7tjw3Tz1pagaL5X2+skPJ6ab3/7O5tUWekRX3f0+uSM8MSUWj84G8R3PNircdT5964bIFS/Kd2keOIweqnn30J8fTr3+9LyklIqb4Oz4pGH0h70JhGIadD6RsfiI/qs3jCnUVKi+F0QFAYzZ6rgKZ5zHTPU6a7KGyTamijU5ZG68rpmaKYsJTksJgNe9ordjZXrm/o0ZJY8IyNmJ0jtCRYlbKtzpjoeBuigw2wvQadWjIjSFfAVvM5kZywv08PxORBIGGgi0MfyJszsOjZV58jpDF0XibGQkA39YcvSl7ejRHgDYE7Ke6Ex6GmzhblpzHCM3xhvstw5rNRv30zf4fvt5vMqE3GOTdGnm3pqG26+jBaiaLsWbrY/QT7hQF/37+j452JQCUnW1597VNb396C7oRhmEjF77owjAMC44CSZKXhLvSUybdrkje7HmZO28Jd09rt5ps1lJF+wRZMtowkNcR7nSG8wfoRE/jmoaiLc2lWsvIXKwJ84xOQVjMP2EYr4pFAj3twrtDnnAXMYf4BbiDz0QwsrLhIXXeHi0cBvOi5Lzf6k+hDYPoLKYXiza/M/0KtCEwbXrV+2W70agbl6dPQkNBgvstw9qbL63bvvk0Gh1k/MQ0Ls+HIUe9PRp7tt2uoqyVslEEib9UMex8gS+6MAzDgmOcNHF7axkadVKh9D7C3XM9GQZB5LkvKQMAXpPpxfJmr9uUexvh7rVgfSB2t1d+XL6/mF71G2ykGsGLdGFYeJis6DA9d8IzY8kDr/Ouwg+fiRxIwLkhL/DRctfo2X80FNFZiWFLS+l3NUdvyJqGNvjLaLX835Hf6IyvB4AFCTljokJVWRj3W4av3dtLkGw7k0mmZcRKZQKSJDVqvVplaGvptVpt02blOG/m3cCvT5IgAN/CxLBwMZks3Z0qAJBGC3lDtFAiTrhjGIYFh9c0dI9R223QxHA9rVjoOeGeGxXPZ3o6W4yXJpME4WGMfJG8+SbwtKqt0qRv06vQ6EAhGuFeJG9+oWhTqbd0P3Y+MJwHNUMxLKTMNisacoNJDHG+O6IS7vhMhMAj3D3AR4tdmlC2Km0CzSrqr5zeymWwrgjGSHOD1fLQkV9pLlBEANwzZh4aDR7cbxm+fvn+kPPTa26afdWNs4TCAVOvTCZLXU1nQqLEOeiVVCZMSJK0tyrsTycUjsJfqBgWNru3l7zx0joAePz51YsuGoc2hwVOuGMYhgWH14Q7AFQoOzwk3K0UVdzr6bJhkreFnoQsTqYoplrVhTac4/WyxGs9GSZJjqGx9KtPVGbD62e2/15/yu2NAuw8Q39wLhZ0lHEX1Xs3AABzDBmzDm0e6SjDFkrxdwAA9jRS9h3aPHyY6CfcySFesnLIX4AdPhNh9OGjBXHf2Hnrmk5bbN7rfdso6pmT66tUnQ/nLwpkTZFGjfyRY2vO9LaiDW5cnj7J6xTPQOB+yzCl6NVWV7Q5ni5eNv62e1ws7ctmM3PHer/QQxAEPPHPS997fVNrizxvXOpDT6xAt8AwLGROHKlFQ2Hn/0kOwzAMcyZmcdME0kZtL9rgpFLVOTs+C42eU65s11s8zUgtjPaScAeAibIUDwn3Vp3S8yj7cm91b0aL49lBHY1Yqmj7+5Ffm7UKtAE7jxnxhSuGBWYYjXBnBvWc4h98JsLow0fLYMl8yf1j5r9TugttcOOb6iO72qsezLtgWXKer7Mo1Gbj19WHvqw65LnP7CyaI3isYDEaDSrcbxmmKkoH3LO5eFWh89PA5Y1L+eTbu9AohmEhRlFw6ngdGg07nHDHMAwLmgJpkueEe4XK07qpnuvJAMAkGgn3CbIUz0tXFcmbFyeNQaPnlHmbGV0g9bRqq6/WNZ559tT6MFylsEkGn8nmMdl8BuvcAzafyeIxWXwGm8dkC5js90p3Wynvg7OwMKAAjxrEsIAwCbrDxof84+Zbsi0E8JkIow8fLe7cmTtnT0f1KW9dWYdGjfyRo7+/wdt+Sdr4+Qk5E2TJDI/fWnqL+XBX3V9t5ZuaS+in2gGAQZBvTbs8is1DG4JqyL9IMf8oerXOT7NyQlXlH8OwcKqtbkc+3UMCJ9wxDMOCpkCatKm5BI06qVJ6Srh7vkqJ54mS+FFodJCJ3ibMBphwHyf18vvp+72+6NlT6z1UnKePQRCJ/Kg0gSxdKEvgRcVyhbFcoYwjELE4IhZXxOJ4voqz+7BsjzUIrwULAi6DBaBHoxiG0Ua/MLqF9lj4EQmfiTD68NHiAYMgXp+yevWOT7UWE9rmXpte9WnF/k8r9rNJRrY4bpRQGs8VC1kcDoNJUWCyWRQmfYdeXavuqtP0+Lfn/zFuyfTYdDQabLjfMkxptf0r7hIkweN7WisLw7Dh4uTRoR/eDjjhjmEYFkQFEi+jv2vUXTaKcjd5tljegoaceC3gbpclihWyOBpzf/cR4eGvWGy2Wk03Gh0oWCPc1zWeeebkOn+unM6J4Qqnx6ZPiU7LkyTkRsVzGSx0C2zYol/XdUVqAc2PRiSgnwPFsACxGXQPNnPEjJANP3wmwujDR4tXqQLphzOvvvvgj37MADDZrKWKtlJFfzXtoLhnzNybs6ej0RDA/ZZhymrpPwO6vjzDMGwYOnF06Au4Q2Qm3A9XNt71ye8AkB4nXffELWizX77edeLTbYejxfx3b7skKz4abQ62/24/8sHmg2gU4LsHrxk/Kji5qiF05RvfVbR2AcD7d6yan5eJNmMhg/d85MuXJhHgaU6pwWpp0vaOEsrQBgClSd+iU6BRJ3QKuAMASRDjpckHO92eY0oUbe6S/rWabs8LXnEYzNHiODTquzJl+7On1nvYUR6kCWUXp+QvS87LjcKzPkcs+mmIibKU67OmolEMO++xSLqdfPrV3kPEj9xcUOAzEUYfPlpomhGb8cGMq+499POQf7EAwL1j5v09bwEaDQ3cbxmOTCaL8wh3DMNGBqVCV1LciEaHAt2++HD36bbDWqNJ22X6/dDZf6yejzZjGIYFg4DJThdF16l70AYnlapOlwn3s70DFu0ZjE4Bd7uJshQPCXedxVSj7spxlTev9FjxBgDGRCXQmePsmdZieuDwL35kWKbHpt+WM3NeQo6LewXYyMKlPVLMp6nrmG9c3ZbDhgsO7YS7xmxAQ+FlsPpQjjlY8JkIow8fLT6ZG5/9wYyrHj22Ru1+tmWocRjMf01asTptPNoQMrjfEuE0GsPev0p7utXdXeruLnVPl7q7S6VSDqgCZLNRF8580Tni7Ja7Flx361w06mTHljOv/etPNOpk/uL8p1+8DI3S8N/3t//2w2H74x/WPhgTJ3Y0tbX07th6puh4fXNjj1qlpwCEQm5CkiQnN2HC5PSpM7LpF8mR92iOHKg6erC6ualHIddqNQaRmCeRCkaPTZoyI2v6rBwuj+5dpTAgyL6vVcpGHTlYdWBPRUVpa2eH0qA38fkcURQvIytu3MS0xcvGR0n4A390gPtv+7yyrG9iTe7YpPe/vH1guxe3X/NxU0Pf7PCCiWlvfXzzwHZUd5d6787SI/ur2tsU8m41i82MiRVnZMUtWJI/dUYWk8UAACbTh2kloT42LGZr0cn6M6caa6ramxt6VCq9Xmdis5l8AUcWI8zMjh9bkDxvYZ5QxEV/chB5j+aaFW/bH6+6Yup9j1xkf+x4ByvLWjvafX4HAYCioK1FXlPVUVvdUVvVUVPZ0dmhdN7gtX/96fmzuXbn4zye973hB7onhhGDyQg0VUTHDfMKl0zIUWj1vRpDr1b3xtq9WiM+s2LYeaFAkuQ54V6l6lziqoT6WY+zaLkM5tioBDTqxgRvZdyL5S2uE+4e13QFgHHSJDTkuw/L9jRrFWjUo1SB9KnxSy9IHI02YCOUhO2la+WAL1xDyYcePxZpJBy6KwQqTUOccNcPRcIdn4kw+vDR4qv5CTlrFt718NHfz3gbTRIKmaKY/0y9NN9bmcfgwv2WCNfRpnjntY1odBjq6dHYk6pGg/nzD3esX3PcZhsw90bRq1X0astLWtavOTF5euar71zv3OqSWqX//st9634/ZnEqsAMAvXJtr1xbV9O5dUORVCa47ta5Ky+bQp7LdA8tLpcFAKVnmt9+dUNDXZdzk0Zj0GgMbS29B/dWfP3prsuvnXHTnQvcveyVl0158+X19scVZa3Vle3Zo+lecVeUtjqy7QCwdPkEp0aU2Wz96X8Hfvpmv9ncP/vHaLRo1Ib62s5d288mJUsffeaSgolpIjHd/hsiuMdGeUnLut+PH9xboRs0C0SvN+n1pp5udVV529YNRR+8uWXF6sJb71lIP2fdWN+330rPNr/9SkDvIAC8+/rGTX+eRKOR4XxJuP9t6YxPth5OjhZfM8fTxyBY+BxWRlz/CNYPNh/ECXcMO08USJPWN51Bo06qVQPOKA6eR7iPkyYzSbr3CyfKUtDQQKd7W65In4RG3b82h4KAE+71mp7/1RxBox4tSRr76uRLhCwO2oCNXAm8/gEanvUYNWgICxoWAABloPQ/U/rNYK0HSgNkNMGaBLzLCY6ncV6U5iNK8w4AkHEHgIwFALBUUrofKdMRsLYD2ICMJVi5wJ5H8C93m9mnjJT+TzDuoCwVYOsB4AAjkWDPJPhXAtNbGsvaRBn+AtPRvp+lTEAKgUwkWOOAt4Jgz0S3p8+mtMlvBEs5AAArj5R+A2QUuk0EiOYI0JAbKvMQL/SnC3v6CZ+JMPrw0eKfVIH0h/m3vl+2+5vqI35MDvAPi2TclTv7b7lzw195HPdbMMeY65Dq6VLDWFAqdE8//INjaLY7U2dko6FBKsvannnkR0WvFm0YqFeu/fDNLUcPVD390uV8wdB/uQkEnD07Sl/75x/ITQKE0Wj54ev9VeVtL7xxDcPV0NsFSwo+fW+7Rt038mDjHycefHz5wE3c2r652PGYx2PPW5Tn1DiA0WB+6v9+OFPkqchJa0vvI/d+c/8jy6bN8v6uuRTEY+OTd7at+Znuic9itv7567GTx+re/vQWmncL7An3fbvKXn1uTYDvIADYImf18EHOl4T7zQsm37xgMhrFMAwLNq9ritaqXa9K6jnhTr+eDABEsXnpwuh6jduB9qfdrJtaHfoR7p9W7PdcJh5xVUbhvyatCEcHFoskibQvXNt0KjSEBQlB8MBSb1P8DSxOJaqsbZS1DQybgLuSkLzmvSdp7QQyltK8T2k+BHD67FsbKGsDmEsI/lX9QSeU6TClfBKszl9WJrCoKUslpfuWENxMiP7hOlNvbaGUz1CmA2jcpgSbkrKUg/5X4CwkJO8A4X0CLMqmtPXefC7bPo6UfhmZ2XbwJeGuMRtNNis77PkpB7lRh4ZCDJ+JMPrw0eI3Fsl4OH/RDVnTPi3f/0v9yZBWdWeTjMtGTbw7d04if2i+k3G/JcLJokW33LUAjQKUnG46drjG/pggiZvvcFt8eHxhOhoaaOGFBbPnj1EqtCqFTqnQK5U6lUL3y3cHu7vU6KYBkPdojEbLM4/86JxRJUhCKOSy2Ay1Uu88gHr67BzHY5eKT9Q/99jPev2A294JSZL4hCgOl6VW6etru/S6/tZjh2seve/btz+9hcPx1v0Lseamnvde3+TI1bJYjFEZsRKpwGK1trcq2lsVzhsfO1zz9ae7br93kXPQjsNhXrh8wpqf+pLLO7edvevvS+iM1LZYbHv+KnU8nbcoz91P2WzUs4/9hGTbWSxGelacRCrQaY0dbQr7QUJR8MFbW/7OuNh5S/qCeGxMm5U9OOEeEyuKi48Sirkmk6WzXdXaLHdubazvfvW5P1555zrnoDs93erikw2vPt9/v8TvdxAAZs/PTUgc8M2v15t+/vag4+nchWOzsj2tocJihep4DtXvxTAMOz/lRSUyCMJKub3RWq/poQCQKzG5Udem99T/prliqsNEWbKHhHuVqtNgNSPrOxmtlmaPq7bymewMYTQa9YXSpN/UXIJG3VucNCacV60e3jUszBJoXzC3e/zgYIGgwED13gnWBiCEBHsKMOLApqFMx8DWBQCUYT0orITkHfTHBqJsXaB5n9K8DwBA8ICZTRB8ytoB1mYAC8FZgGxvRxn/ohQPAmUGACAEBHsKMOKBMlCmYrA2ANgo7Vdg7SQkfbUgByBllOXc9wzBA+ZYgpkGBAesXZTpCFBaAKCMO0H1LyLqVeef886msvXeAuZSAADWJFL2BRBCdJuIIaOdcKcA2nXKNFeLi4SBzmIKcw13fCbC6MNHS+DiuKK7x8ypVHUe625A24JhlFC2Om3C5ekT47gitC2McL8lwtkroqBRgF+/P9SfcAdwuQ19HA4zLj4qLr7/YNi++XRwE+493eoP39xSUdoKAHwBZ+Vlk2fOzc3NS7IP/qVsVGtLb9GJ+gO7yzs7lMmpns7sPd3ql5753ZFtZzLJS6+evurKqc6v32q1HT9c8+XHO+tq+kZlVVe0ffDG5keeXunYZki8/5/N9lxtfKLk1r9dMGturnOJ+ebGns8/3HFwb4Uj8vtPRy69arosxkW3beVlU/74+Yj921SvM+3advbiVYXoRoMcPVilVPQPF1i6YmJ/20B//nq06Hi94ymHw7zpzgUXryoUCPsnCtTXdn7/5b49O0opG/Wuv7WPgnhsFE7LzMpJqKlqFwq5M+eOnjF39PhJo5Ba6h3tyh+/2e9cy+X4kZrTpxrGTxrltJVbT//fDxazFYLxDk6fnYPcP5D3aJwT7rPm5i66aJxTe/jghDuGYVgw8ZisDFGMh9osBqulTadMGtgvP9Presi5HQEwyVuVGMTE6NQ/G0+j0XOsFFWmaEdGzddpemwer9zyJYlkYIsorm08TX9acSJP/OrkVQH9PV+YbVYr5cMQNiykkmlfuDZre62ULfC1fDEXTCcBgOBdSYifAqIve0uAldJ8QGk+BADKsAkMFxPcC51/CKX/nTJsA0Y8IXqC4C619zwJAKA0lGEHwXQ1odXaQin+Yc+2E/xrCdFjjrw2AUDp11KqZ4AyUoaNoJtO8K8Z8LMAQPAI/q1gKQPe5QR7JhD9A44ISk0p/kEZdwAApf+DED4IDLqVOs9l20sAANhTSOnnQNCt2Dsk4n3JPbUMXcK9x6hFQyGGz0QYffhoCdzv9UX/PrM1uAuoMghyvCx5dlzmvITs8dJktHko4H4LFh7bNhZ3dagAYNKUjKdevAzJgRIkkZwqS06VLV9daDR6+e76zwtrHSljHo/98tvXFUxAB3gxGOT02TkTJ6c/+9hPjqzx1g1FSy4eTzOvGiL2wdoFE9NefuvawUPLU9Kin//3Vf95ce1fm/suhy1m65b1p1zeUElOlU2aknHyWJ396cY/T9JJuG/f1H+hnZwqG7zr7BS92m8+3e14ymYzX/vgxrwC9Lo+PTPu6Zcuz81L/u/725Em+oJ4bADA7fct7OlSL1hS4G42Q3xC1EOPL09Mkn7x0Q5HcPf2EpoHhslkgSC9g5EMf9FjPgss4Yb5D+/54cJrofO6QVVlSjyumJopioli0yqI5uB13dRSRTsS8bzWK9D4d3m1u70KDbn36LglojDWPzXQvqLGwiA3ytO8P2cmm9XroYv5jz2ViHrJkW0HAAAGIXyQ4F1if0JpP3VqcoEybAVGHBm9huAuHzDOgxASvFXAyu+PnEOp3wRKAwAEdxkh/hcyipzgrSKEj/RtqfmgbxT8QITwHkLyHsGZ75xtBwAgRITkLSAlAABgo0yHB7QORDh3kim1rfdWMJ8FAII9g5R+EeHZdgAQsjj0q8q0eJzeFFKtOiUaCjF8JsLow0dLIAxWyxPH/3z65DrP2XYRi3NF+qRZcZnZ4thojoDHZDEIAgAYBMlnsqVsfopAMik69aLkvFuyZ7xUuPK3C+44eckTP86/9f6x8yMk2w6434KFiz2jOqFw1CvvXIdkVBHu8qR2p081OFLMAPDgE8vdpYwBgMNlPfH8pc5Z0R+/2e/UPjSkMsGL/7lmcK7WjiDgvocvcm4tPul2ks3Ky6c4HleVt1VXeLowBwC1Sn/kYP/ZwcPw9r82n3Gu2HPbPQsHZ9sdrrhuxow5o9EobcE6NuymTM9aumKi1y2vun5m6qgYx1PPdeoRQXwHI5aL3ffLweKXftsJAAVp8T885KUEz+rXvqntkAPAS9cuvWRqHtoMYLRY1h8r211SU9naLdfo2ExmglQ4PSft8unjshO9lCaw3/i12aj1J0o3n6qoae+Rq/UcFjMlWjwtO+3auROSZW7vJG85VfGPbzehUYBXrr9oxeSxaNQ9g8my6WT54arG0uYOhcagMRq5LGaMWJARK5uQnjg3LyM3KRb9mSAJZNcF7lBlwx9HSorrW3vUOgGXnREnu2hi7mUzCthMBovppcpnc49y59nq49UtVW3dco3OZLEKOOxEqSg/NX5ZYe70nDT0BwB+3F/06ppd2YnRax67qUul+fcfuw9VNPA57CXjcx64eDafw7Jv892eU51KTVqs5KYFhaumurhKB7/+OuJQZcP6Y2WnG9u6VVqd0cWVvN0X9145NdvF12WAb1wgex6LEOMkSX82FKNRJ7WantnxWc6Rs72ezus+FXC3Gy2O5zFZeovbA/isohWJuCsu7xBgAXeD1Xyc9mzidGH0xSmuP+MhgtewiihiFjdNIG3U9qINrpQp27PFoToXn+cI/i2AVsACACAE91H6dQAA5jNgqQdmOrKBM0L0dN+6qXTYuijDZvtDQtSXWEcQ/KspzdtA6cHWSZkOEpz56BYeEDyCM5/SrwUAsKH3HQdwJPopjU1+G5jPAADBnk1IP/an+PtQyBTF0Bw/XuVtAY/QadAOqAEaavhMhNGHj5ZAyI26Ow58X+pxQAkALE3Oe3bCRTHcATdWhyPcb8HChsNhPvGvS90tIEmTo2o5AGSPTlh4YYFTowuyGOHCpQUbz9UPOXGktqdbHR3jw1y6oLv5zgXOVVkGEwg50+fk7N7eVxasqtzt19HMubkxceLuTpX96YY/Tz7kcenUXdtK7OVQAIAkicXLxg9s77d9U39OQCoTOGf2XbrpjnmH91eiUdqCcmz4hCCJOQvGOG7AdHb4MIoiiO9gxHKRcF82aczrf+4xWaxnGzvqO3vT46ToFueUNnfYs+08Nmvx+AFFc+yOVjU999O21t6+AxcATBZrdZuxuq3nx31F18+b9MjKeaT71ZwFXHaXSvPgl+vPNvZfEZmt1vKWrvKWrp8PFP/z6iXLJ49x+okgW3P47Dsb9yu0euegzmhu7FI0din2lNZ+t/fUX8/fyQzBAR3grguExWp7/udt64+XOSImjb5X03KytuXng8Xv3nZJFN/tdWarXPWvX/46VIn2TVV6g0pvqGjtWnPk7Pz8zDduWs5xtS5BQ6dCZzTf/ema6rYeANAYTN/vO9Xaq3r3tks+3Xbkwy19ZZiq2rqf/XEbAQRyjyfAvw4AepP5ie827zpbgzYMQhDAZLjY/4G8cYHseSyi+LFuqucVU30t4A4ADIIYJ00+2lWPNpzjYoS7Bn1ViABHuJ/tbTPRXi/r6oxC15+TkAn/KEvMs3xpIs0L12J5y8rUcWgUCwaCPR0N2TEzgJEG1kYAoMxFhIeEOxnlpebMQJTpMIAVAIA5Ghhu7pETPGCNtVe8AdMx8CnhDgDkua9om8dkNCkAAKC0NvntYC4GAIIzj5B8CISna4OIkiGMplk0uVzZgYbCpUET1oQ7PhNh9OGjxW/dBs0t+7/1UF8RANgk45mJy65KL0Qbhi3cb8HCY9Gy8QFmuvV605ED/QO0PeSLnU2enuVIuANA8ckGr2n60OFwmBfQ+Os5uYmOdK1GY7BabS6T0SRJLF9V+M1nu+1Pd209e7fHpVO3by52PJ48PSsm1vXboejVOmrfA8DMebkslpcBlNm5ifGJko42BdpAT+DHhh9GZfSPcNfrTBaLjcl0sZMRwX0HI5aLtKOIx7mgIGtrUSUArD9e9sDFs9AtznFkBpdMyLGPQXa262zNo99sNFutACDgsAszk+OihAaz+UxDe2O3wkZR3+452aXSvn7jxcgPOpAE8eCX6842dhAEjE2Oz0qQsRiMus7eovoWigKjxfLsT1vT46T5qS4mcF0wLmvDk7f2avUKrb5Xq//8r6ON3Qp0I49eWbPzp/39HyQhlz0qVirgsLtU2naFWm8yA8AlU/NCkW0PfNcF4pkft246WW5/HCsWTs5K5nNY7Qr1ydqWmvaeuz75PVHq9jMsE/LLWvqu2bhs5pikuNSYKA6L2aXSHq9u1hpNALCnpPbl33e+cI2Ly2+z1fr62t1NXcqlE0cbzdbdJTUAsOtszeaTFZ9sOxwXJZw5elRZS0dlazcAfLTlEJJwD/CvA8CT3/dl2wUc9vXzJo1JjmUzmfVd8h/3FbfIlQBAEsRL1y0dmxyXEhPFYaIfnwDfuED2PBZRxkQlMAjSQ2FNZCZpt0HTafC0nM4kWSoaomGizFPCvVrVZbJZ2WT/Wd/z/Fb7yB006ovBtxk8uCDR//l0/mmJ4AvX81O+JGlzcykadeVAZw0awoKClAEpRoPnEMwcytoIAGDxtP8JZr5vBQxNp+3/TzBzBzYMQJBxfStOWD3drXSNcHRZPa1aAYQQwEL13g/mUwBAcBYRkvecfnYYyBD1XwJ5VjF0CXfPKbmgw2cijD58tPjHYLXcdfAHzx9tIYvz8cxrpsbQKvU7XOB+CxYes+cHOuS07GyL1dp/oTpxSnp/m3sZWXHOT8tLWoYw4Z43LpXHd5sQd5BI+c5PtRqjOMp1mdZlqyZ9/9Ve+0Kser1p19azF692fTuwubHHvjCp3dIVE5waB0BGZBdOzXB+6k7+uBS/E+6BHxt+4AsGjEQxmy1Mpve3JujvYGRCM4Z2q6bm2xPuG0+U3b9slsvK0VabbfPJvkVjBxf3aJWrnv5hiz3zeNWs8Q+tmCvk9u/NDSfK/vXzX0aLZcupiqnZKVfOdH1Lrai+FQAy42X/vuHiMcn9s67ONnbc//mfco3OYrV9su3w+7ev6v+ZczhMZlqsJC1WYn+67lipTwn3nw8UO7LtBWkJDy6fPTUr1TEw2UZRxfWtO8/UXDFjXP/PBElQdp3fdp2tceR871g07f5lsxz/aoXW8MKv2/86Xd0q7x++jeCymTfOLyxv6Vo9LX96ThrbqQSKxmB86vut9hz6umOl9100K17iYvLgH0fOfn5PX6mWdzbs/3LnMQB48ofNo2Kk3z90jZDLMVut1739Y0VrV2uvqqajJyu+v0hLgH/9eE3zzjM1AMBjs3577AZHwaJ5kHH1rAk3vvdTeUuXjaJa5SqXVYkCfOMC3PNYROEwmDniWA8DBhsHzqAfXN3FmZTNzxB5L0Y02ASP66xaKVuFssO5Sky9xlPCPcDh7eDLhWssV5gu9OefHAjPkwyw8JsRm46G3KhT97TplIm01yvD6HKfbQcAIGV9DyiPSR/HZjTZ+nI0lGE91b5+YJsrbv86BebTlPEgWCooaytQCrBpAYxAGYEyodu6RAgo5TOU6UDfM+HdwyvbDr7UAVOY9NWqriEpceB5zfCgw2cijD58tPjnmZPrBk+jdMYiGSMv2w6434KFy9iCZDTko7IzzY7HBAEpabS+voSiAbPtFb0epwmGWEb2gOy/O6yBhQ0sFqvzU2eyaOGseWP27uy7Z7bhz5PuEu7Oy6WKxLxZc90OEHEe3g4Aaem0hkGkjKL1drgU+LHhB8JlvtiboL+Dkcl1wn1W7qhYsaBLpW3tVZ2obZ6S5SJrc7CiQa7RAUCSTDx4g3c37dcYTABw4YTRz1yxCGldMXmsQqt//c89APDJ1iOrp+WzGK7nVoh53M/uuSJWLHAOFqTF/2P1/Ce+2wwAhyoazFarux/3j8Zgendj3/XVvLyMt29difx+kiAmZSRPygjJ0RysXeefz/46an9w4YTRf18+27lJIuD+56blV7/1vX2AuTt3LnY9/VzI5bx247KlL36u0BpsFHW0umnlFBdp6/GjEh2F0a+cNc6ecLfZqNsWTRFyOQDAYjCWTMipaO0CgLoOuXPCHQL76ztOV9sfXD0bXR6Aw2Lee9HMv3+xDgD+Ol191xIXfyXANy7wPY9FlAJpkoeEe7teZbHZmGTfqM+SXk+XJROj0S9YmiZ6TLgDQKmizZGO6TJotBZPSajAE+4dBrp3jIYo6ROhF67nrXxpUixX2GWgVaN2S0vZrTkz0CgWKI8DTxyVVSjdgDjC1yQ1Resd70dZ0AgAZdhGqd8Aaz3a4AvKsBas/V/jNsUDZPQaH4rRR4Bx0iQWyTDTq4lxpLs+/N+9rTql3Ojx+Ak2fCbC6MNHix92tFVsaDqLRgd6fNySkZdtB9xvwcKCw2EKhYGWme06V6wcACgKVsx/1amRLpUirKdvRHyCBA0FbOXlUxwJ9+qKtsqyttFj0TqxFAU7tpxxPF20tIDpvkqMcuAuik+UOD91x12BGq+CcmwMRtmoqor2upqOuprO7k61WqVXKfUGg8lotJhNFqPRbDS66Ip7FYp3MAK5nuRLksTyc2N4NzhVlHbmqCdzyZQ85JZGt1q7raivJtSDKwakDh2umDGex2YBQJdKc7iyEW0+58b5hUi23W7x+Bx7LReTxdrQqUCbA7P2WInGYAQAAYf90rUXBTej7VkQd50fmnoUjnL5LnPKDJK8ecEUNEobj82aM6ZvHk2HQj2wsU9BaoLjcbIsSsDpu9p3vqmTJOsbc9et8uFb3utfr+vqG3TsciHc0eeCDV0uavMF+MaFes9j4ec5PW2jqBadwvG00uNqdX4UcLeL5ghSBBI06sT5loDn4e3gy0hJd3TuV3BFpPAlaCjEek26CqWn2x5Y+BEACxJy0Kgbaxv7JqVhweR5JDhl6HtA8AfEA0ScmyjKKiD413v9D7hLBvw4AKX9lFLc35dtJyUE7xJC9DgheZeQfU1G/0LGrCd4VyA/4pq1A4Ak+DeAvbiNtcPWew9QRnSzCMZhMPMk6LWiO4c669BQ6B1xX/csRPCZCKMPHy2+sthsrxRvRaMD5UsSr8ucikZHBNxvwcJAEIyMqlqtR0O+8y/NGix8gcdBIX6ZUDhqVEZ/ImjT2v6C9Q6nT9Y7rwu6dOXE/rZBtNr+TiNBANep/oEHNDcbLCjHhrOG2q63X91w9Yq377/t8zdfXr/mpyN7d5aeOl5XU9Xe0iTv7lQpFTqD3kzZPFZodCMU72AEcp1wB4BV0/LsD7YVVxkt6GdJazTZS10TBCB1tAHgaFWT1WYDgJzEmNRoCdJqx2UzHVViTtS0DGzst2SC65MWm8mIEwvtj5W6c5d8QeJIhi4rzJUIgnzUehbEXeeH4vq+IlMJEtHoJNcTXmblBjQeIeFcFXJ7RfXB4iUDbujZlwklSSJR2j+x3ZGFN5jRI9Mzz3/dXrELALhsFzM/uOcms9hcfaEE+MaFYc9jYVbgLcfhXFXGc/Fc/wq423ke5O78d70uW+f5FgIdOo8j6J0JmOdGzobLztZKK+Xiox3hmITbkzhCb6WbNYgo9Evilis7ShR9X6RY0FAubjD3s52bdEUEdVI82TdxjWBNIMTPe/+Pf8OAH7dUUOq3+34D/yYydi8R9QYhuJ3gLiPYs4A1EZi5QNIbOkTGktE/EOLnSOmnQMYAAJhPU8qn0M0iG/1btvs7qul/SwfLvo6+yYVhQ//fiM9EGD5afLW9tdx5QIlLt42eRfpVf2BYwP0WLNQcVWcDodUMp9EDLnEGLSEZFCsum+x4vGvbWb0OPQts39xfTyYrJyErp3+06GAGff/1F5vNpPnNx+X5+U8LyrFhZzSY33x5/V03frp53akQ1Q4K0TsYaVwkFu2y4qML0uLPNnZoDMZdZ2sumpjr3Lq9uMpotgBAYWZySjR6oXXm3FjdnETXqUO7mHND19sUrufrcZjM9DgpGj2HfW7uhr1qdhCVNPYloaZm0b1KCZZg7Tr/1LT3DXHNThxQp8VZtIgv5nFVej9vcrDOrTHrrotoz7A7MEgSAMQ8rnPPzPFVYs9x0+f5rydHi6EaAKCu00Xmsa6jL+/gGF/vLMA3Lgx7Hguz3Kh4zxP5G7V9R5TBakFKujtjkmQgQ8snylI8TOytchpZ7+E1AEA0R5DIc3Hk+8Tm8oPnCstpKdfw2Njsdi9FMg6Dbk9FbRqWXx1z4rOlbH6vidZkpk8r9r83/Uo0igXCpgRbjyMDjqAsffO6gEU3v0ALazzADwBAmcv8uG6g9BsAbAAArHxC/DSAq99ho9d3YmYAqxAAgJFESj+0yW8EykQZ1oM2hxD8Dd04Us2Nz/qq6hAadcVgtexsq1yRWoA2hIzFZtvfUYNGQwyfiTD68NHiq98aTqGhgRgEeQHtMeDDEe63YMMCl9t/BcHhsiZPy3RqpItmRfLhZcmy8V98tMOeKNfrTTu2nllxaX8K3mgw79vVX//D8/B2GLifTWa3aQEE7TNPqOi0xkfv+7a6YsAdQYGQM37SqIysuORUWZREIBLzeHwWh8PicFnHDlW/+fJ6540xB7cJdwBYNTX/bGMHAGw4XoYk3B11ZgYvlwoAPecKfWw6We5YB9IDd0PUpULekNwA79X2TbFJjg40weSrYO06/zh+W7SwLy/skkTgJe1LUXC2sf1wVUNVa09rr0qpM2gNJqPFYjJbTVYvY9KdVzp18Kmqj99/fdG4nD+OlADAj/uKrp41QcQbMFbls7+O2B8sKHBxQgrwjQvWnsciB4tkjBbHeRi60qTpS7hXqTo9XNHlSxI5DE9f1J55XjdVbTa26pRJ/CgAqPc4wj2QpL8D/X+IyhzW47xG3X2osxaNDgf0d6kyvLs0WNgk4/L0iZ9XHkQbXNneUlal6swRx6ENWAAo436CtwqNAoClCqx9U7UI1sQBTYEh2LMpYABYwVwM1kZgpKFbeGZtsv8/wZrsOtsOQJlOoCGvWJMI8cuU8jEAoNRvAyOb4C5Gt4lI02PTxSwuzS/VNQ1F4Uy472qvpPnCgoj+12aYX9vwPRONYPho8YnFZjvR3YBGB8oQRfOZI7mMAO63YMOCSHyufB8Ai8X452tXOTWe1/gCzsKl4zb9edL+dNOfJ50T7gf2lDvGvDNZjIUXeukyOVdNoWyU0WjhcLyfVrSasJ5QBnv/jc3O2fb4RMlt91wwb2Ee49zoVcR5MlbdP653md2ywlx79vNAed/6qHYdCs3xmmYA4LKZF05wMaxJbfBtiorV6jrZ5LKyR6jpTWbHuGlH6ZKwCdau84/e1DfnhTNwLWCE5/flr9PVK//91fXv/vj+poNbiipON7Q1dPV2q7VqvdFosbjPK/ZhuJoIQ/+2SyB/fe7YDPtCuF0q7RVvfPvLwdNF9a3lLV3bi6tufv/ngxUNABArFt56wVT0JwN+44Ky57FI4zlJ7RjhHrp6MgAwNiqB6/FysVLV99cdNwBcCryeDADwaA/HVpr67nqGxxeVBz1+N0SuKBYXDbnRoac3pDfyXJ0xmeYZgAJ4qXgLGsUCQ+m+AnAxJIfSfNT3iDUJGAF9TaEY8QRvOQAAWCnlswCe7pS7QJz7UNj6po4hKP2f/i2mSvBWEYK7AQCAopSPgMX7zfVIwCBI+iUODnbWel5TJLjWNBShodDDZyKMPny0+KRC1WHwOLYJACTs/jTfSIX7LVjkk8r6B/lp1AaTycsn97xyyWVTHI+rK9udU8/O9WRmzc0VR3n5QhNH8Z2fdjkVf/dArRrKhHtzY4/zqrDJqbIPv7rjgiUF7rLtAGCxuLhSwOw8JWLEPO78/MztxVVWm23zqYrr506yxzeeLLOPx1wyPofv6m6GfWVIAMhPjR83KmFgowsZcTI0NHQ4LCZB9M3j0If9q2dodx2X1ffXTYOq9jvzkOX/fMfR9zYesD+WCLizx6TnJsUlyURiHpfPYXFZrO/3nbSPIg+FAP86QcC7t62897M/zjZ2tPWqX/ptB7LBqFjpO7etdFnWP8A3LvA9j0WgAmkS1LkdR9l8LuHuObtBv/yuS0ySzJMknuzpG/I5WIWyc0HCaPBWUiYoCXcZZ0Cfw4MeoxYNhUyZsv3PYbtuVSxXRADQ+V4oU7abbdbwz3kPXKpAOjc+ey+9Qs9HuurXNBRdNmoi2oD5zVxKKR4mxC8AGXUuZKU071OGjfYnhPBv5+JBQwgfoYz7wSanTIeonutJ0ePALhywBaWnzKfAsAsoDRH16oAm1jjQrwEAyriTsFQBM8epzUbpfqPULzhFfEOIHgZrLWXYDpTe1vs3Mvp3d/V2IsqSpDFrG/svET37vPLA61MuRaMhUKvu3tN+ripRGOEzEUYfPlp80mVQo6FBwrmjhgrut2CRb2zBgDnQlaWtBRN9nFA4cmXmxOeNSyk902x/umVD0f25iQAg79GcOlbn2GzpigmOx+5kZA2Yv9JQ15WS5r3f2NTQjYbCaO/O/po5APC3By/0el9BpQzrLefhxVPCHQBWTc3fXlwFABuOl/Un3E/0DepxWU8GAGTCvt5JQVrCU5ctHNgY6UiCEPO49hIf7QpVQVo8ukUoDe2uE/P7iqj0ajx9ZtzVsals7f5gU98EuuvnTnpoxZzB47VFXBfZ6qAIyl+XCHif33PltW//UNcp5zCZFpuNJIgoPnd0csyS8TkrJo8d/DvtAnzjAtzzWGTynKRu0/fd4vYywj2whDsATJSleEi429P9cqNO63FlMM+j9WlK4kvQkBslijYrZWPQXhHUb1aKeqFos4eSPhGOSZIyjoDO5avRailVtHkuMRSx7hs7n+aFKwC8XLxlgiwlSxSDNmC+I7gXUuazlGEzZdxNsKcCIwFsOsp8DKx931oEbzXBuWDgDwUDI5GUfGDrvRsoNZhP2eTXACkFRjpB8CjKALZOsLbaC7UTnAXIjxLclZTmXbApgNLbei4luBcBIxMIBlhbKOM+sLYAISCE91Cad5EfpIcgot6grNeAuQysrbbe+0jZ/4AI92xIXy1IGB3DFXYbNGiDK+sbz9yUNd3z+SsoPi7fNyTfvfhMhNGHjxafqM3e5/s2ano79Op4nghtGFlwvwWLcOMnjSJJwmbr+yY5eqgaJ9ydrbxsiiPhvmtbyd8eXMpkknt3ljn2WEysaPL0rP4fcCMnN9H5afGJ+tnzxzhHXKoqd1uTNgzaWvoGBQIASRJ0/plVA6u9RwKCfomMEPPSLZgzJj1GJACAkqaOxi4FADR09Va1dQNAklQ8Ndt1JmjcqL4kdUVL18CW4WFsSt+dqBO1LQNbQm5od11WfN8Nt+pza3gOpjWaejSukzubT5Xb+39jU+L+sXqBy9x06EqQB+WvG82Wuz75va5TPiY5btMzt51648ET//n7zn/d9cldl10+Y5zL32kX4BsX4J7HIlOOONZDORe12Wi/MqlUuh3hniKQxHKFaNRHEz3mWGtV3QDQ5HF4eyJPHM3xtLoATSkCCRpyQ2cxneltRaMh8EHZ7lPu70YMCxki7wMl7PaFfXHCYJkgS16anIdG3dBaTPce+inM5XRHLO5KUvoVMDOB0lPGvZTuF8qwYUC2HRldHkTsKWT0b+CoDm/rBfMpynQQzCfB2ty3LCoAMAaNiiDFpOSjvvH4lInSr6M071DqNyndT2BtAUYCKfuCENzitQPsFsEjJZ8AGQsAYD5JqZ5FN4g8TJK8Kn3gFAH3KICXireEOp13qqdpqJZ8xGcijD58tPiES6MCj5WyfVi2B42OOLjfgkU4gZBTODXT8XTDHyccpckxAJi3KC9K0jeeUq3SnzxaCwD7dpY6Nli8bDzpqhIyQhYjTB3Vfy9t/54Ki+VcD9aNzg5lZXk4zibuOFeQFwi5TKaXDrNBbz52iO79xbDh8QaMhtFpvd8PDhEvu48kiRVT+m7CbC2uAIDtp/umf66cOtbdbYOZo0fZj7/TjW1NPQq0OeJNz+m7v7fxRJnO2FdcOzyGdteNH9V3C65FrqztcJ2AO1bd5O4qrKVHZX9QmJHs7tg4WReqexhB+evf7jl5uqENAF67cVms2IcMY4BvXIB7HotMDILMjfJUX6hNr+w0qHtNOrThnAALuNtNjPaUcK/TdFMATVoF2uCkQJqMhvySJxlwk9+z3aEvNbC9tezTiv1odLgZ6/EYc/Zj7XGTbbiW2Hs4fyH9kYMNGvmt+74Nc0XdEYlgFwIzg4xeS4ifAXYhkFIg2MBIJLgXE7KviajXAUJZpIiZQUb/Qsi+JvjXAXM0kFEADCB4wEglOPMI0cNkzAZC/CL6UwDAnkLGbCIEdwEzFwgeECwgY4E9hRA9RsZsBlYhEIKBpWZ8xEgkpR8BwQEASv8Hpf0c3SDyXJ0xmf4nqEje/EnFPjQaPEar5emT60Od03cHn4kw+vDR4hMpm1YFnl/qT35QtmeovgHCBvdbsAh33S1zHI81asPb/97g1Hi+Y7EYF62c6Hh6YE+5WqUvOd1/s3Ppiv5Wzy5cPsHxuLtT5ViO1Z1fvjs4tN+OzgvqajUGo8FLOvSHr/dFYEkZLo/lvD5tVUW7U2NYeT8NOOrGbC+uBoCdZ/puX1wy1e1t27go4bJJuQBgs1Ev/LLDYvVyGyfSXDa9wD6WWaE1/OvX7eHsEAztrkuPkzpG93+6/fDAxj7f7nH7HeEYAN7jtMSus/XHS+3zJEIhKH/9UGUDADAZ5KgYKdrmUYBvXIB7HotYBVJPl2qtOoXnejIBFnC3i+OKEnliNHqOwWpp1SmazhWUd2mcx38FfZmiGBGLg0bd+KHmGJ25yX472Fn78NE14fx6D5F82pUfeozayKz6Sscooeym7Glo1L0SRdtN+/7Xpusr3DRUNGbjj7XH99GeVx4hCM4FZEIlmVDZN46b4BD8m0jZT2TcETL+LBm7h5C8Q7BnoT82ECG81/5LiKjX0DZfEOxZhPifZMwGMu4YmVBGxheTsTsI6eeE4G/AHI1u7UDGEqJHyZj1ZHwxGV9Cxh0gZT8QgjuB6LuVTsasJxMqCdGjA38MAIDgXmR/5aTsO7TNgTWBjD/T9w8U3IG2Rp54nmhZitt++2Aflu052FmLRoOBAnjyxNpa9ZDVJ8VnIow+fLT4ZHRU37WMVx+U7bl2z1e72ysj+Z8TINxvwSJcwcS0abOyHU93by957V9/es2uAoBSofvj56NDW/YkDFZcOpk4N4b95LG6k0drHfVkCiakJqfK+jf1aMnF4znc/tk/n334V0WZ2wHsB/aUb1jjdgW48BiVGet4bLNRe3b0j+sfbNPakz9/ewCNRobRY/uvkff8VdLd5X2VkVDwnnDPSojOS4kHgPKWztLmjpKmDgCYlJGcGi1BtnT24PI5UiEPAI5UNd764S+n6tCjymCyHK5sfO3P3c/9tA1pGnJSIe+uJX0nyM0nK+7+ZM2ZBvSWSLdau/lkhWOJziAa2l13+6Kp9gebT1Z8uOWg42sFAHRG84u/7jhW3eyIIPJT+2Z27ymprRlYGsVGUb8fPvOvX/5yDgZXUP66PWtvsdr+s25Pq1xltfmQNw/wjQtkz2MRa5zEUzK0VafyUE8GglHA3c5z5e5adXezzlPCPVjFfAmAKTGj0KgbKrPhm2rXN58Ct6Hp7N8O/mgetsO9nc2ITUdD7r15dkfrUF/L+e2hvIXZ4v4uoFcVyo7VO/8bhiGHg1EAJ3oanz25fu7mt/5VtKll2O5zbCT5e94FTNJ7t9/OSlH3Hf456JUrKIBXT2/d1FyCNoQRPhNh9OGjxSdiFpf+abpY3vy3gz/N3/z2I0d//67m6N6O6mpVV69Jp7OYrCMlC4/7LViE+8dzqxOSJI6nO7acueny97//cl9VeZtzLoKioKNdefxIzXdf7n3knm+uXfn2x+9slfdoHBuMSPGJkmkz+25IdLQp9u+pcDTRH94OALJo4Y23z3M8NRrMj933v99/PIwUOeloV378ztaXnv7dZqMYDLq9tVCYMTvHuVzER29vPXHExQiMhtqul59d886/N1IUsFihnPDqrxlz+sfl6PWmJx/8vrLMxV0iigKlwvWA3aDoH2bvwappeaXNHQDw/qa+CQ6rpnkZJpMgEb19y8r7P1+rMRiL69tufv9niYA3KlbCY7MMJkuXStvWq7Lf056Xl4H+cMCUOoNco9PoTWqDUWMwavSmTmXfN8LhykaKogQcjpDHFnLZQi4nPko4uDb3HYumV7X1bDlVAQBHqhqvf7dRJuSnxkTx2Cyd0dwqV3WrtQCQmxT79+WzkZ/tUesUOr1Gb9IYjGqDUaM3GUwWe9Nfp6sbuxX2v2v/3wSJiDnwEzW0u+7CCaOXTKi0r5T76bYjaw6XTM5KFnDY3SrtidoWjcGYnRg9Kka649xEB2fLJ4/5aOtBhdagN5mvfuv7JRNyMuJkDJJslasOVNS3ylUCDvvOxdM/3HIQ/clgCMpfv2x6wf6yegD4fu+p7/eecm7isJgxIkFBWvyl0wpmjXHR+Q7wjQtkz2MRy3OqulWn6DS4vdcqZHFGi+mOFfJsgixlS4vbu9M16u5mLyVlPP0rfLIkacyutko06sYnFfsmR6fNjHPxefGb2WZ9r3T3Z5XBv1c6VBJ44jFR8eUep0o4KE36vx/59Yf5t7LJSOwYecZhMF+fsvqq3V9YaN8KVZr0fzv44/LUgscKFie4n+cRLBTAmd6WLc2lm5tL2vR9Vc4wLEKkCaRXp0/+vvYY2uCG3mK+48D3b0y97IJE9zMJfGGwWp4+sXbjkGbb7fCZCKMPHy0+uTgl/73S3WjUvS6DZmNzSSBfCwyCYDOYbJLJZ7JjOIJojjCBJ8oSx2aJYsZKEmhWuQkR3G85rxiNFq3GoNMatRqjVmt0PO51Skw31Xf/8fNRvoAtEHL5Ao5AyBEIOHw+RyDkOA+CDhtxFO+F/1z95IM/9HT3XZD2yrXffLb7m892kyQhFHHZHJZBZ9LrTVYfp++PDCsunXzkQN8NsD1/9X1N8XjseYu85EIRl1874/CBqrNFjfanBr350/e2f/nxzozsOIlUYDSYOztUjqVKCZL452tX/fPxX4ZqnyelyBYuHbdjyxn7U53W+ORD32flJOSNT5FI+CaTpVeurShtbajrsm/AYjH+/d4NLz71m6JX2/9bIsDy1YU/f3vAUe6moa7r/ts+T0qRJSVLmSyGyWTRqg2KXq28RyMUcX/e+PDAnw4aNNHs0sWFY95Yu9dstR4orwcALpu5dKL3zndhZvIPD137zI9b7UWxFVq9QuuiuE9clBANBezff+zaeKIcjQIAwLpjpeuODUg8vXjthY6yOQ4EAa/dcHFuUuxnfx2xl3GXa3TyQbVKXNYK//uXawePiLf7etdxJPLNA1dNykhGgkO46wDg3zcsIwlia1ElAHSpNPa7DnZjkuPeve2SrUUVLtO+Ih7nnVsv+fsX61R6g8liRd6CeInwPzctz0mM+XjroVDMHwzKX587NmNZYe7mk/3/ZAej2dIiV7bIlVuLKldPy//n1UvIQW9/gG+c33sei1iZohgek6W3uJ6dV6pob9O7HUIyXpo8+BjzzySPZdyPdzfWa9yu1psmlIlZXDTqr0WJuWySQbOSuMVme/DIr/+bd/OYqL75KwE629v6zMn1NHPTw8iSpLH0/1Fne1tv3Pv1e9OviueJ0LaIlydJfDDvgjfP7kAbPNrYdHZHa8UV6ZNuypqWJqQ7A5S+LoPmaHfD3vaqfR3VciPaT8CwyHHv2Hnrmk7Tr3phX8rvztw5942Zx3G/Bjgdx7sbnzq5rlEjRxuGAj4TYfTho8Un12RM+bzyoM5iQhtCxkpReotZD2alSY/UYyEAssSx02PSFyeNmRabzghSp9onuN9ynqipar/nps/Q6CC11R0fv7MVjQIAwH8+vGlCoYshfaGWnhn34dd3vPjUb84FygHAZqNUSj2Ai1TG+WPazOyEJEl7q8I5OG9RHrIgp1cMBvnym9c+8eB3ZWdbHEGz2Tp4wDVJEv/35Irps3OSUmRNDUNWfO/+R5bVVnXU1fRPxK+paq+pcpHh5PHYz//7ynET08YWJB/aR/fmdHjwBZynXrz86f/7wfnWRWuzvLU5rH1RWr3nKD53fn7mX+eWS108LkfAoXWQpcdJv3vwmsOVjX+drj5Z19yl1KoNRg6TGS3ip8dJCzOS5+dn5iTGoD8WGQgCbl809YqZ49YfLz1S2VTZ1qXQGowWC4/FiosSZiXIpmSl0rnx4J8h3HUsBuM/Ny1fPS1/zZGzpxva5Gq9kMfOiJNdXJh76fQCFoOREe/2xF+YmfzH4zd9v/fU/vK6pm6lxWqL4nPTYiXz8zKvmj3efthkJ0ZXtobk6yPAv/7zgeIPNh9U6gwMkkyNiYqLEjomH1isNo3e1NDVqzWaAODPoyVjkuOumzvR+cftAnnjAtnzWGQiCSIvKvFET98NbYTnCrlBKeBulydJZJEMdzOR/2p1fXvSbpwvK4Z5FcXmLU8t+KOhGG1wQ2U2XLP7i8fGLbk+s6/mkn+qVV0fle/d3Fzi9m7bcHZF+qSPyvdaKbrjIIrlLZft/O/TEy5ampw3JNefgbhz9OxadTf9Q8jOYDV/V3P0+5qjM+IyFieNWZSYG8jAMZXZUKnsrFB1nJa3nOhp9DxBBMMiRzRH8NT4i548sRZtcI8C+G/F/k3NZx/OX7Q0eSz9NQAdiuTNn5TvG5IiCe7gMxFGHz5afCLj8O8ZM9fX/HKIUADVqq5qVdf3tceiOYLVoybclDU9/KMNcL8Fi3CyaOGbH9+8Y+uZH7/e39zodgyWQ1Ky9MIVE/PHB+1CNWIRJLF89eQvPhrwhbbUaRFU+nh89usf3PTDV/t+/eGQxez6kjwxWfp/T6yYOCUdANLSY4Yw4S4Qct78+OZ3X9/kGNfvUt64lEefuSQlLRoAxhakRFrCHQAKp2a88dFNr7+w1jGBIPxoJdwB4K1bVqAh2maMTpsxOg2NujdjdNrpt/4PjQ6y7olb0NA5r16/7NXrl6FRv0TxuTfMK7xhXiHa4N73D16Lhvzl664Lotlj0mePSUejAAAwPy/TwxsUKxY8tGLOQyvmoA3n/PbojWgI4No5E6+dMxGNAmx8+lY05PEF+PfXAeCrncff3rAPAOaOzXjmikWJUhe9MavN9u7GA/ZpCn8cOesy4W4XyBvn957HIlOB1G3C3bMgJtzZJCNPklAs77+pTl+BFJ2CE6Bbsmf82VBM/wLSYLW8WLR5S3PpTdnTFybm+pQgVpkNu9uqfms4dbSrHm0bhMdkvThp5VMn1tIcyBY54nmiRUm521rK0Ab3eozah4/+nirYeVP29Hnx2aN8GT9loyi5UdtpULfrVW16VbtO1aJTNGsVL09emROkIkievThpZbtedaizDm3whgI41Fl3qLPuxaLNyXxJgTQpT5KQzJck8sWxXBGfweIwWCySYbFZTTar2WbVW00Kk15h0vUa9a06ZYtO0aJTNGrkeNo1NnxdOmrC1pay3e2+XRQ1axUPH/09gSe+In3SvITsAkmS5wlYRqvlrKL1YGftpuaSOrWXq3cWyXgo74L/nP0LbQglfCbC6MNHi09uz5l1uKv+QEcN2jCkeozaLyoPflN9+NK0CQ/lL4zmCNAtQgn3W7AIR5LEkmXjFy8dV3K66eSxujNFDV2dapVCp9MZORwWX8CJSxCnpMXkjEmcNCV9VEYs+vMj10UrJ/7vs93mcynypBRZwUQ/kzwcDvPWv12w/NLCvTvKjhyobG9V9Mq1FEVFx4pyxiTOnj9m3sI8JrNvWENaesyBPQN/PryEIu7TL1523S1ztm8qPlvc1NbSq9UYAEAg5CYkScbkJc9ZMGbC5HTH9mMLPM2nH0L541O/+uW+g3srjhyoqiht7elW67RGFpshFPHEYl5yqiwrJz43L8jpDmcE5b68BoadJwwmy/znPtGbzGIed+tzt3uYwKEzmmc+9QFFAYfFPPbaA2gzhg2yvunMY8f+QKPekARxbOXjAqbbQ9FXr5ze+r/qI2iUhm/n3TyV9ophND1+/M+1jafRKA3xPNHCxNxx0qTx0uR0YfTgBQC1FlObTlmt7irpbSuSN5/saaI57pskiA9nXH1B4uib9v3P61XuxSn5b027HI0OqWpV16odn/i9zlg0RzBRlhLHE4lZ3Cg2j0MyrZTNZLMarGatxaQ1G5Vmg9Kk7zXpug0ahUnn8g/9dsEdQSz375nGbLxp3zelChdzGyPQPyctvyZjMhoNNitly//jJTTqytSYUd/OuxmNYueNboNm1Y5Pe4z+l9oUs7g54rgsUUw0V8BnsrkMltFqMVjNSlNfiqda3UW/ZvGzE5ZdnzV13qa3PSxq4nB05T+CVeUMn4mMVsuEta+g0UF+XnCb56XXPXundNcn5fvQ6EAXJo99b/qVaJQ2ldkwbf3raHSQQE5S+Gjxid5ivuvgD8e6G9CGyCBicR7OX3Rt5hS0IZRwvwXDhiONxnDN8rdN51ZkvPVvF1x7s9uRnRg2GN0R7hg2glW39+hNZgDITY7xkG0HAC6LSRKklbJxBy20i2EuFUj8ubobLY4LYrYdACbIUgB8TriTBJEf1JIydo8WLP6rtVzre4nPDr36x9rjP557ymWwxCyukMWxUDaj1ay1mDS0axMjnpt4sX1hwJmxGV4vXCNQtjj28vRJv9SdRBvo6TFqd7S5WLsiYglZnG/m3nzPoR+Pd/szfQTDzmcxXOFHM6++ad//jNa+C0hfqcyGEz2N/k3eQixLybs+ayoA5EkSO9u9J9yDCJ+JMPrw0eITHpP1xZwbXju9jf4qzeGkNhv/VbTpYGfdK5MvEbE4aHNo4H4Lhg1Hu7aedWTbCZJYcrE/9WSw8xl6mx3DzkOO4SZag+vFLR22FFVYbTYAyEqIRtswzJV0UbTQ9978pODVk7Gb5NfwtExRDD+oeX+7WK7whUn+lylzMFjNnQZ1rbq7USPv0Kv9vmp9OH+hYyDPzLiMgY3DxqMFi5P4UWh05BKxOJ/PvmFBQqhWUsGwEWyCLOWVyavQaNjlSRJeKrzE8XhgY8jhMxFGHz5afMUmGc9OXPb13BvD/9GmaXtr2U17vwlkro+vcL8Fw4adrRuLHI+nTMuMiXVRdhjDPMAJdwyDzLhoPocFAKXNHT8fcL2mjdFi+eVg8T9/2W5/evmMgoHtGOYaAZDn+yDxIBZwt0viR8VyhWjUG78nX3u1PLUgzJN53Xk4f9Fduf1zA8dJk4I7tyBsxCzuG1Mv82NJw+GLy2B+OPOqG7OmoQ0YhnmzPCX/yfFL0WgY5Yjjvpxzo+P7duxQZOXwmQijDx8tPjHbrLvbK7e2lKn9vakQBmXK9hv2fq006dGGkMH9FgwbRuprOyvL2hxPL7pkklMjhtGCy2JgGHDZzNsWTv1g80EAePn3nT/uL5qWk5ogETEZpMls7dHoGrp6i+paNYa+maQXThi9ckregF+BYe4VSBJ9ne07SRbkhDsATJSlbG8tR6MejfOrHg5Nz0xY1m3Qbm/1YanP4GIQxLMTL0aKVDIIcmpMuq8rCkaIwujU16asfuzYGhcV1kcoBkE+PeGi6bHpT51YpzIb0GYMw9y7OXu6gMl+7tQGm6tVGUIqQxT99dwbJWyeIxKK8mV04DMRRh8+Wug43dvyc92JbZGdaneoU/c8cOTXL2ffMLi8fojgfguGDRd//tJfFCsmTjxrXq5TI4bRghPuGAYAcOfi6SaL9cudxyxWW22HvLZDjm4BAABCLue2hVNuWzQVbcAw93wdJx7LFaYIJGg0YBN8T7j7+sp9wiCIt6Zd9vDRNUNy7Spicf4z9bIFCTloA8CMuAi6cPXVitQCndX0r1MbXa5rOlItThqTL0l88sS6w111aBuGYe5dkT5JxOI8cWKt3uKlpF4QzYrLfHva5VFO2XYASOJHRbF54RxqaofPRBh9+GjxbHd71cfle4vlLWhDZDvaVf9+2e7/y1+INoQS7rdgWIRrbuzZ5lRPZvWVUxmMMN2Ww0YSnHDHMAAAgoD7l81aPS1/w4my4zXN9Z29Sp3BbLFyWEwBh50kE2clyGbkjJqblyHkRty0TSzC+Zq2DnoBd7sJsmQ05BGDIMdExaPRoGKRjPdmXPl2yY7/VhxA20IpT5L4zrTL04QytAEAAGbGRmI5VPquSi9M5In/7+jvfheHHY4S+VFfz71xS0vp62e2t+qUaPMQIQlibnz2lOg0tAHDIsbS5LzR4vj/O/pbubIDbQuBW3NmPlqwmEEQaAPA2KiEIck94TMRRh8+WlyqUHa8WLx5+C4H+nnlwYtS8sZGhbWwFe63YFjEMhotr/3zT4vFZn8qixGuugIPuMT8gRPuGNYvJTrqbxfOQKMYFpg0gdSngXtBL+BuN06axCBIK9XXdfAqNyqOwwj5OYIAeDh/0eTotOdObejQq9HmYGOTjDtzZ9+TO8/D3OHRUfEyDl9u1KENw8fc+Ow/F9797Kn1hzqHIHs1hC5KzluQMPqrqkP/qz7SaxrKdzCGK7wkddy1mVNSBVK0DcMiTIYo+pcL7ni7ZOe3NUcsNrrnCF+lCWXPTVg2Jz4LbTgnTzI0CXfAZyLMF/hocWajqP9W7H+/bA/97mUEslK2N87u+GIVnsQwAAEAAElEQVT29WhD6OF+C4YNoU8/2vHrz0fQqAObQVhthJW6495FHC4LbfVdyZnmd9/e0trSm5EZ98g/Lk7PiEW3GApyufaqS991PH36udUXLMLFk4Mm5MkUDMMwLF+SeLCzFo26EYoC7gDAZbByo+JLFf1rv3hWEMoC7oj5CTnrF9/zUdneH+uOG60WtDkYCIAlyWMfzV/kboCYAwEwIzZjU3MJ2jCspAgkX825cW3j6Q/L9jRqe9HmkYvLYN4zZu6tOTPXNhZ/U32kVt2NbhFKYhZ3YVLuypSCGXGZLsfwYlhkYpOMx8ctuSZj8htn//K1+JhXXAbrztGz78ydzSYZaJsTPxYYDy58JsLow0cLAGgtpv878tvejmq0wT0ekzVRljJBlpIliknhS6K5QhGLwyaZTF+WfLdQNitlM9usOotJZzH1mnRyo65Np2zRKSpVneXKDj9m+B3oqCmWt/g6GTQocL8FwyLZrHm5i5eNR6O+oyh45cW1HR1KACgrbXn7zc3vfnATuhE24uCEO4ZhWMgVSJNoJtw5DGbo1o6bJEvxIeHuYyWcAIlZ3CfGX3hrzsyvqw/90VCsoD0hwKtojmBFasGV6YXZYrrjCGbEDcGFayisShu/IrVgQ9PZn+tOnOxpQpuDRMTijJMmyzgCtGHocBnMqzMmX5Ux+VhX/ZaW0u2t5V0GDbpRkJAEMVocNyc+a35CTmF0KsOXrAGGRZRRQtn7M64629v6Q+3xTc0lBmughd0TeeLrsqZenTFZzOKibYOMlYS1noNL+EyE0XeeHy0qs+GWfd/S7FUSAPMTci5PnzQvPjvw2ZOccw+iXXU8bBRVqmjb0VbxR0Nxu16FNrv3U93xIUm42+F+C4aFH0F6uckUEyN6/J+r0ahfeuUae7bdrqK8jbJRXl8ANtwR1Pm0rhqGYRgW+Uw26862ip1tFfs7avybIm2/liiMTp2XkDM3PgtfSwBAo0a+paXsYGftKXlTgMPxJGxehigmRxw7QZoyQZacJY6N8N4iBXCqp2l/R02RvPlMb4va97FviDiuKDcqPk+SUBidWhidJmI5Lv8xbIRQm42bms/uba8+0l3v63DRRH7UvPjsCxJz5sZnD9+vX3wmwug7344Wk816495viuXNaIMr02LTnx6/NDfEywINZrZZv6k+8m7pLrPNira5ImRxDlz8SOD3A4IC91tCx2SydHWpAUAmE/B4eG22UBku+/m9NzZtWHMCgKDsFzMEUP/P3l1HtZV0AQCfuJEQ3N1darTUW+puu213u+4u37q7u3alu9vdurvQlpZCobi7u4SEuOf7IxDCkIRAEggwv7NnT3LnkcLLMOTdN3NHa3PU+x9csOPuRM1TU0CVW4hE/NlLL1nDqpKxLykzUfqGWaCEO4IgCGKlVADUcLtKOe1lve3NAnaHiNcl5gnkUolSLlXIiTg8CYun4AkkHIFJoLhTbd2pth40pp+NQ7Sdh80UvpYwTKKQV3I7K3s7q7idraLeLjG/S8zjyyTqswoAIGDxJByehMWTcXg7EtWRZONEtnEi010odB8be3+6o845ZROFulNVcDtbBOxmIadF2Nsp4gnlUrFCJlLIJAqZCgACFkfA4khYPJ1AZhIpTCLVkUxzp9p6UJmeNGYg3cmWSIFfF0EmKYVKWdjTUt7bUcdn1fFYrUKOQC4VyqVChRQLMDQ8iUYg2uBJnjS7ALpjIMMpzNbV+Gm5EwL6S4QYb4r0ltdzTx2tz4ejQ2AxmOciFj8YnDiOOaXUjurHbh0wcneK3xN3GthnYrygzy3mdfF84eefnAEAvPL6uqXLIuFmxEwmynm+drn43Inc1hY2nyeWiGVUGokrGVje9/BjS7bdOUvr8NFTqcDd239qb+Oon86Y6f/x53cOOmKcjH3CfaL0DbOwilu4CIJYs38K896+cRWOAgAAcKRSs+5/DI5OGT/n3P7sViocHaE1QSHfL18DR63PqcryQ6VFJd2dfKmUQSLFurjtio5b4O0LH2dWGAACGU6BDKd1IApuQ0aLhMNH2blHjW3JIOuh6VRwg8nQUIlMSjgMNs7BK84yu3lPCOgvEWK8qdBbrrVVGplt/3T6hrVe43we5rkEPhW28OsS3X+dITmsRitMuFvuc8vUlJM1PrtzTzUT5TwvSopclDSQ81UolMsXf6LVbjYYDHj1jXXffnWhtYUdEen5/P9WwUdMGROlb5gFSrgjCIIgw3jl6qWDpUWapz0i0dX62qv1tS8mzH1iunlu+yMIgiAIgiDWTKZUvF9wHo7q8lTYwnHPtqvdFzT7v5qsTjEPbhiioKcFDiGTi0oFcnPr4Shibug86xQR6bn7zwfh6BQz1fqGVZeHQxAEQcbdxdoq7Wy7tq8y08q6u+AogiAIgiAIMukcqc9rFQ7s+6dPBNPtkZC5cHScELG4td5Gpf4bBT1wCJlcams6OGwBHEXMDZ1nRJ+p1jdQwh1BEAQx5GCJ7mw7AECpUh0uK4ajCIIgCIIgyKTzX20WHNLlf1FLsdawG2C/RGd/OKRLm5CrUBlV7R2ZoKZULYtxhM4zos9U6xso4Y4gCIIYkt/RDoe0FBhsRRAEQRAEQSaBInZrNXf4dY3BDOcEJz84Oq4ijdu3RqFS8mUSOIpMIjnZUyvZN17QeUb0mWp9AyXcEQRBEL2UKhVHLIKjWlgiIRxCEARBEARBJpeU9ko4pMsqzwg4NN4YBDIVT4SjuggVMjiETBa9HGFxURMcRcwNnWdEnynYN9CmqQiCIKO0NijU15bZIxaxRaIesYgtFvWIBv4vlE2Jj+wYa1oyjCAIgiAIglhCVncjHNJltnH1W8YYnUASyqVwdAiZQg6HkLGlUCjz8xoyb1XX1nS2tLAFAolYJCUS8RQK0cHRxsPT3j/AOTbWJyTMHY83NHlUpQKtreza6o6ams7a6o7q6o7ODq72AZ98eOqTD09pRyCnL7xIoRi6T/PrT1cOH8xUP95/5CknJ7qmqa2Vk3y5OC+3vrmRxeOJVQDY2JDd3GwDg1xj431mzAygUg29sraeHkFGetXtjJrm5h52j0AgENPpFKYdLSTUbcZM/1mzA8lkAvw1xjHLK4/BeZ6Iki8VG/6pFy4Of+PtDXB0JAQCydXkkqKCpqqq9l6OkM8XK5Uq+KAh7ntgwc5diXBUCxbbd2mvUqoyMqrTblSUl7d1dnLFIimVSqIzyH7+ztExXknLomyZ1MFfCkN9A6CEO4IgyKh5MhieDAYc7SdRyHtEfcn3T9JvlHR1wkdMBFgMxp5CNTCN3ZVmA4cQBEEQBEGQyaWM0waHhsBhMGFMVzhqBXAYQ8lZDTJ++AwjYiEqFTh/Nv+fPand3TyoSSyWicUyNltQXdVx/VoZAIBGIy1cHL5h0zQ/f2foYLVvvjx/9nQeHLWYHhZfnXCXiGW//Xrt1IkcKPvJYQs4bEFZaevpk7nTZ/h98sV27VadeFzRv/+knTyeLZcP2lqAzRaw2YK62s4L5wrs7Gg7dyWu2zBNkyc1hhlfeYzPMwIAUCpV//5988ihTKFw+JuII6W+y1JS3PzV5+ca6ru1m/h8MZ8vbmvlpN+s3PP79S3bZt1z/3wD3QP1DYAS7giCIBZCwuHdbOhuNnQAgANlmDvA1izGxfVqfS0c7Zfg4QWHEARBEARBkEmkRyLkGVHf3JlMJ2JxcNQKGFmcnYqb2LMpJy6pVP7xB6dSr5fDDXoIBJKzp/OmTffTl3BXKsd0/1tWNw8At95e4av/O1hZMcytqRkzA+DQEJUVba+9fIjDFsANg7HZgh++vZR5q/rNdzZSaSS4WRfzvvIYn+eJwkAa2kRisey1lw4WFhi13ghib0+zdxhmqhyVRrp+rezjD05CN2MgEon8v71plRVtH3yyDYfTfTsT9Q2AEu4IgiCIYTsiovUl3GlE4o7IaDiKIAiCIAiCTCId4kGlAPRxJA+TzRkXMqVCIDcu4W5cqXfE7H749hKUbadSiR6e9rZMKg6HFfAl3V3cjo5eldascTs72py5wQPPB5s7L8TVlakdEYmkB/bd0jydvzA0IMBFqx1GIIwgV8Zi8SUS+esvH9LOtmOwGBsbMoGA43FFMplCE0+YE6h5rFN+XsObrx4WiQbNX3Z1Y7q42JLJeC5X3FDfpT27Oet27QvP/vfND7tIpGG+Z7O/8hif54li8dKIxHkhvRxhb6+wt1fE7RX29goP7ssYunpjpD7+4KR2tt3L22H5iujAIBcqjcTniyvL286fLejo6NUcYMukPv/iKncPpru7HcmIGkHNTT3ffnVek20nEHA+vo5MO5pCrmxr47S3cbQPzrpdu+f36w8+skg7qIH6BkAJdwRBEMSwJX4BOyKj9xUXQnEqgfDzirVOVBoURxAEQRAEQSYTI2eIk3HDJ3TGXhW3S6GdqdXDiWyDRVsTjYemRta5M/map0HBrg8/tjgm1geaJiwSSUuKW3Kyam+mVrS1clasjjFQxn3W7MBZswfltXt6BNrJvjmJwUuXRWq1m4TF4v/w7cXyslYAAJVGWrc+fnZiUGiYu3ryr0qpam1l5+U23Eyt6Ozgenjaw1+vhdXNf//t45qcOB6P3bRlxoZNM5xdBgqZKhTK7Nu1v+9Oqavtq1laVdn+/dcXXnxljeaYoSzxymN8nicQEgnv7MLQPreXLxaZmHC/lV6VljqwefXa9fFPPbtc+9dk5qyAO3bM/uzj09eulKojvRwhHo/VtxBkqO++vqDOtru62t7/0MI5c4O1S/k3NbJ++/Va+s2B7+HI4dubtszQOXEe9Q2AEu4IgiDIsD5cmJTg4XWgpKi0u5MnlTpRaQt9/B6bNtObYQsfiiAIgiAIgkwuMuXA/NwJJ7+nGQ7p4k93hEPImLihNbfd0ZH+5bd36dxTlEIhTp/hN32G3yOPLykpbnZzY8JHjJ+L5wu7OrkAgLhpvm+8vcHWdlA1UQwW4+Fp7+Fpv2ZdnEQyzMa8n350ure3b/csCoX48ed3REbBBTxxOOys2YGxcT5vvHo4L7deHbxwvnDZiujoWO9Bh2qx3CsjY+PgvgzN45BQNyjbrkYg4F56dW1lRXtLc486cvpULpT4NkC9FCMq2uujz+4YumGpl7fDux9s+eyjU5cvFasjcpni/NkCwxuxTmV6bwkiCIIgiMbaoND/NmzNe/CJ6sefu3Xvwx8vSkLZdgRBEARBkKmAiDVqoh5PJoZDVuBSSxkc0gUl3MeLdp2KuGm+OrPtkIhIT52TaseLOtseE+vzyed3Qtl2iL7aLGqF+Y25OXWap8+9uHJoTlyDRCa8+sY67azovn/TtNoHsdwrI2NDKJCUlgzcO9y0ZcbQbLsagYBbtyFe8zQ3u16hGEE5dTs72gefbBuabVfDYMCTzy7Xbs3Pb9BqRwZBCXcEQRAEQRAEQRAEQXQzsrh5o4A9fOmWsVXHY93uroejukQw3eAQMubYw23mabVIJPxrb67Xt4GkkY4cvq15HBjksnhphFajDvYONkuSBo7JzqpjdfO12gdY7pWRsVFZ2a5UDoyv0bE+Wo2w6JiB5QhSqby5qW+2uzHufWA+Tf82uQAAGo2kvQ9BVUW7ViMyiEnDAYIgCIIgCIIgCIIgk5gdydCkXQ2hXFrD7YKj4+qH8utKIwq4AwASXQLgEDImfHwH1hbkZNflZA9MxJ5Ali6LcnA0adK9SCTNvFWteZq0LEqrUa/pM/y1nxbomm5suVdGxgxH614UBotxdKRrNcIcnQa19nL6SgkNi0TCL1oyzM0YAEBQ8MDtST5fPKIZ9FOKofUsCIIgCIIgCIIgyGT115GM3w7chKMA7P5oZ4TWFbWR9p3K2nP4lgOT9snLG3w9HeBmLWk5NS99fBwAEOjr9PcX98DNiJVxpTDIOIJYIYMbhrjaVhHIcIKj4ySlvfJsU1+tYcMCGU5ulIHtDZGxNH9B2G+/XFPn7FRK1esvH1y/afoddyZYVdGYYc2dHwKHRqistEU7cRk3zXegTT8//0G/bmWlrUNnr1vulZExIxINDL943DAbPOPxOO2nMrmxm3CER3oaU9OJyRx0C1YgkDAYFO0IooZmuCMIgiAIgiAIgiCm2nP4llAkbWpjn0ouhNuQiQwDgD/d0B0Ujf11OQqVVcx2bOD3vJZzCo7qscw9DA4hY8XZhbH1jlmap3K58uih2zvu+PGDd0/k5tSptMpoWLOwcHc4NEKlxS2axxgM8PSy12rUy4ZO1n7K4eioyWO5V0bGjHaZF5lMIRYbuv3J7d8dVw3KjxvgH+AMh3QhEAYl9OVyqxjzrRCa4Y4gCIIgCIIgCDIV3bFm2qLZwb08EYcr4nCF3/+dIhRJ4YNGzsRCxogVinfwLuUMX6u3Tdj7d3Xm/UGz4Yax1SRg33tzb4/EqEIKOAz2Dr9pcBQZQ/c/tLC3V3j+bIEmIpcpUq6WplwtdXSkL06KWLEy2tvHene1JZHwNjaD0tOj0NnJ1TxWqcCqpM+0Go3VyxHBIUu+MjJmoAUHlRVt2oXaIRXlbZrHeDzWzd1Oq9EQFxdbOISYAH0SQhAEQRAEQRAEmYooZIKPh310qMf8mYHrlkaTSSbNx7p/6xwqhRjo47R5RRzchkxw84wucf5t6bUidiscHUOZXfVbr/3eJuyFG/RY6h7qQjFUEBmxNCwW88JLq9//eOvQydfd3bxD+zPu37X7mSf+uX6tzDonvBveZNJIfL4YDo2cRKpj4rPlXhkZM17eDq5uTM3T82fyNY+H0r53FRnlZUyVGDXjj0SMYdInKgRBEARBEARBEAQBAGxfN337uulwFJkUZjn5MQhkrmz4zJ1EIX8kfd/viXeFM13hNgsTyKVflVzZX5tt5EapAAAcBvNk2Hw4ioyH2XOCZiUEplwtPXLodmXFwBRdtZLi5pLiZg9P+0ceXzInMQhqHV9YrBlmsgr4EjhkJpZ7ZWQsrd847defrqgfX75UHD/dL2m5jv1vD+3PyMut1zzVrtc0LBKJAIcQE6CEO4IgCIIgCIIgCIIgepFx+M2+sXuqMuAGXXokwp039rwZs3KTTyzcZhkiuey/2qw/q9KNLCOjsd1/RhDDqLLFyBjAYjGLl0YsXhpRWdF24VzhtSslPN6gezwtzT1vvXZ48dKIF19eTSROqnQWiTyQ6ySRCdOm+2k1GsvHV0fhHcu9MjKWNmyafvF8YX1dl/rppx+dvpVetWx5dECgM4VKFAgk1ZUd587kZWbUaL5k3oLQWbMDNU+RMTapRigEQRAEQRAEQRBkosAADBxCrNVO/5l7a27LlUbtjyeSy17LOXW8oeCFyCWx9p5ws5moACjsaT7akH+uuYQvG/E0Xmcy/enwhXAUsQLBIW7BIW6PPbk0I73q7Om8nOw67UULV5NLRELpex9txUyi8YPBoGgeEwm49z7cotVoEsu9MjKWCATcex9tef6pf7u7eerIjZTyGynlg48aEBvn88rr6+AoMoZQwh1BEARBEARBEAQZB1jsJEqYTXaeNObdAbP2VN2CG/TL6m64M+XPaDuP9d7RSR6hzmTzlEpvFLDzWc0ZXXXX26tYEgHcbBw8FvtdwlYGwdS9LhHLIRBw8xaEzlsQ2tTI+uev1GtXSjVNt9Krrl0pWbw0Quvwic3OnqZ5zOOJpVK5uabwW+6VkTHm7m7302/3f/vV+bTUSrhNC4VC3LY9Yefdiegv7PhCv2bIWGji9hZ1dlSzWTXsnlYer0so4IjFYrlcplTgsFgCFkvG4+3JFDsK1d2G7stkBto5xLi4ejGscYtkuVKZ196a2dpSw2bVstmdQoFQJhXIZBgAyHi8DYHoYmPjbkMPdXSKdHKZ5e5JI47nvhNciSS9uTG7raWG3VPHYXMlEoFMqlSpbIhEOpHkbcsMtLOPdXGb7+1rTxm47w3BY3FwaExMpm6DjCWlSlXD7insbK/qYdVzOG18Hlss4ojFUoVCplQQcTgqgUAjEKkEgg2R6EFn+DHtfG3t/O3s/Jn2NuPxC1vPYR8oLbrV3NTE7eVJJQwSyYVmE+/qvtjXf5GvvzGfkgRS6dGK0huN9aVdnT0ikQqoGCSSr61dnKtbkl/ADHdLTSubNNBQOcYmR5+fiGdeQ6ZQ5HW0FXV2VLC6G7mcToGALRaJ5XKpQoHDYkk4nB2Z4kyj+drahTg4znT3jHR2wVnZNEIVABWsrtstzRU93Q0cTjOPy5NKhDKZVKEg4/FUAsGeQvVi2PraMmNcXONd3T3oDPglEHNITit/++szcBSAt55etXx+OBzVhYDHAQAkUvnJy4VX08ub2jgCkcTOlhoV4rF6UeSsWF/4C7T8dSTjtwM3AQCnfn/MgUkDANQ0dp+8VJBT3NjF4ilVKgcmLcDHKSHOb83iKJ15h9aO3hu3q/JKm2oautm9QplcQSUTXZzooQGuSXPDpkd5w1+gZXT/+ukrRZ/8fBEAEOznvOfzXVqvp8OOZ/5saOkBALzx1MqVC6wisfhE6PxzzcUdor75lUYqZLcUslveLzjvT3ec5uAVYusSQHfyoNq6UBgknKGMhEgu48hEnSJep5jbJuTW8rpr+azK3g6OVAQfOnKvRa+w3NR7xLy8vB1ef2vDgoVh779zXKHoW2Nx5lTeZEq4h4V7aD+tKG+LivbSjoya5V4ZGXv29rRZCYHZt2slEjkAwNaWKhRKFAoljUZi2FIDg1xi43wWL40wy0a+iIkM/XlDLOSVq5cOlhbBUQAAACQcPuuBR+lEi/9uVPawlu/7C472e2pGwvOzEuHoCLUL+Ncb6q431me1NncL9ZbSUyoUMoVCKJP1iESA3aPd5EyjLfLxXxEQNN/bF2vuy7x1h/4t6uyAgiEOjhe23wMFNXLaWvcW5SfX1wikUrgNAAAAXyrlS6XtAn5BR/v5mioAAB6LneXuuTU8cmVAMBE3drkYhUp1pa5mX3HBzaYGha4tgzhiMUcsbuL2pjU1/A3yMABMc/PYGRmzOjCYMOT7pBHHbusMK+82k4lQJov49Ts4OnIFDz3JIFl8yDKGXKm8Wl97vqbyekM9W6z3Mkwsl4vl8h5R3wE5ba2aJgwAoY5Oczy9Z3t4zfLwMiX5fr2x/t5TR6Hg7tXrk/wGFdETymTv30w5VFqkvbVXj0jUIxKVdXf9V1zgx7T7YOHSOZ56L/hVAPxVkPvN7XSuZNAy6m6hsFsozG5r+S0vO8zR6a15ixI80AdrGBoqzThUTpE+b4VnfkRkCkVyfe2x8pK0pkaRXAY3AwD6v3m+VNrE7dUeIUcn0dP73w1b4agJVABktTYfryi7UFPJEevevFEokwllsm6hsJLVrQkG2zusCgzZFBpuJfc8EA0KmdDUyn750+PqzLJaZzfvSnf5lbTyZfPCXn9yJR43zIaE3T18Bybtz0Ppew7f0h5emts5ze2cyrrOdUujtQ4HAIC2zt5Pf72UVdAAxXkCMU8grq7vOnOlKHF6wPvPryUNNxV0RP960tzQH/5J4QsklXWdZdXtYYF6txUtq25XnxMahbgoIRhuHic2BNI3M7fcnfq3kYVlILW87lrewC8mAICMIzAIZDIOj8fisBiMXKlUqJRypUKokPFlYp1/nc3i2fBFO/ynw1HEus2dH7J+47RjR7LUT8vLRvBHasz/5I5YTKw3FotRKvv6fGZGtbnS4pZ75aGs/zxPdD9+d/n40SwAABaLeezJpRs2zZgo53yifJ9mNMynB8QStoZF6ku4SxTys1UVd0bAnwjN7mh5CRzqhwFgS1gkHDUaSyQ8U1Vxpqoip63FxM9HnQLBwdKig6VFngzG/THT7oqMGZrgMK8ado9MoRj6rxR0tL+bejWvHd4qfVhypTKtuTGtufFj2o1nZs7eFh41BhPErtbXfpx2vXrwFb5hKgCy21qy21o+vZX6ypx564PDtFttSRZfaDmhuw0y7nhSyd8FeX8V5rFEevNfxlABUNbdVdbd9Ud+Dg6DmebmsTk0YnVgsLnWqZR1d2knHzsE/J0nDtcY/FWt47DvOnH4uVmJT81IgNsAEMllj507db2xHm4YrKy7a8fxQ8/PSnxS14tMWWioHIOhctL0+Ql35oeSKRT/FRf8mpvVLuDDbROEUqU6X1P5XVaGdhrdeJU9rMrb6d9n3VoZGPzU9IRgB0f4CGRU5s8MPPD9A708US9XxOGJ/jma0dzOgQ8ySCKVv/jR0eZ2Do1CjAn3dLSzEYik+aVNLLYAAHAptUyhVL333Br4ywZjsQV/HEr/81A6AIBMIvh5OZBJhO4efltnr1yhnBPvD38BAHa21MraTvVjMokQ5Ovk4cokEfHdbEFeSZNQJAUApGXXfPlb8mtPrBj0lUOM6F8nkwgrF0QcPpcLADh5ucBAwv389b7rtaS5YWTS2N3THVacg9fr0SvezT8HN4yKWCETK3Tf/7Ocl6KS7g+aDUeRiSAyykuTcJdK5XK5Eo8f5oacGoUy6PO8UDjiiv+WRqOR4qf7Zd+uVT89eypvx12JVKoZLkMs98pDWf95ntCuXC5WZ9sBAI8+sXTj5hmD263aFOwbKOE+Dqa5ufvb2dfqueA8Wl5q6YS7UqU6WVEGR/vN8vDyHtXcn1vNTf8VF1yqq5YpFHCbaZq53PdSr/1dmPfZkuUzLblOXK5UVrFZ4Y7OmohMoXj/Zsq/RfkmXmB3CPivXbt8tLzkq6RVozu9xuBKJK9eu3Su2lA9L8Pa+bxnL507WFr07bLVTtS+Wm92ZL0lFEw3CboNMo5UABwuLf4k/YaBKe2jo1Cpbrc2325tfufG1eUBgfdEx8W6uMEHjVBZd5fmMVciufP4oXoOW6tdNxUAX2WmkXC4h+MHfaKSKOT3nDqW1dqsHdRHBcCXmWkYDOaJ6bPgtqkHDZXaLDpUToI+P0HPPCSnrfWVqxdHdHvJ2pR0db589WJJV196dNQUKtWZqorz1ZW7ouNemJVorvupUxmRgPdys/Nys1M/PX+tZKQJ98LyFgDA2iVRT9+7iNp/Na5Uqv48lL7nyC0AwJW08iVzQhbMCtL+KsjZa8XXMyud7G2evGfhwoRgzYx4gUh6M6va19Nh8OEAAEAmEe5YM62qvnP1osjpUT4EwsCtL75Q8v73525m1QAAzqeUPHhnorODocrjI/3XNy6PVSfck9PKtX9qbXKFMvlm31Z4q5eMfi6UhWz3ny5WyD4tugw3WD0bAunD+LXLPYyqd4RYoa5OruYxg0ExMtsOACCTCSQSXl2FAwBQVdk+uN0q7Lw7UZMW5/HEX39x7vW3Ngw6YrQs98qQCXGeJ66jh2+rH+AJuHUbpg1utHZTsG8YOzwh5rU1TG+tsey2loZeDhw1q7Smhg7985u2jnB6uwqA01Xlaw/+u+PEobPVFWa/ItVo6OXsOH7ot7xsuMGstLMDXULBnccP7TU5266R09a64dB/o5gpb4xqds+qA/+YkkLSuNXctPrA3uy2FvVTJtn80zYnWbdBxgVXInn47ImXr140e7Zdm0guO1FRVto1MDKMmvbw8nzyeWMyjxqf3UrN7xg0dLyRkmxk5lHjq8y0zJaRfcnkg4ZKnSw0VE7cPj/Rz7y2vwpy7zh+cOJm25Uq1deZ6esP/2d6tl1DoVLtKchdfXBvabfZXhMxRWy458uPLtfOO2OxmAfvTFw2r28h0d7jmZomnVIyKh3tbP749O6liaHa9WdoFOLy+eEh/i5axw64Z3PCBy+smx3vr51tBwDYUEnvPrvGlk4BAChVqtziJu3WoUb6r/t42MdHegMARGLZpVTds6Aycut6eSIAgL+3Y3igqbf8LeG+oNlvx67CYydSPiGc6Xps0UMo225VpFL5n7+ltLYa9QmByxVppvcCAMLC3bUahxcSOnB8ytWy7m6eVqNViIr2mpUQoHl67UrpJx+ekoiHXwLS2ys8diSrskJvBtNyrzyU9Z/niauhvm+Rn0qpEot1Fzq2ZlOtb0ykP5CTyaaQCAOlRQzUezGLo+WlcKgfjUhcGWho/shQGAB+yckq7oLroVuCQqX6KO36zzl9t/UsQZMdYItFO44fym1vHdxuKrZYdNfJw0PLx5uoqLNj29EDLbyBG/4m6hIKdp08mt7cCABwpFDhZpNNsm6DjL1uoXDrsQPJdTVwgwVQCYQNIYOKh4xOYy9HvQPEqcryKyP8zhUq1StXL2lu/p2uKj9SNuK/FEqV6u0bV7TLy041aKg0wBJD5cTt8xP9zGt8lZn2buo1xahKLVsDgVT68LmT32XdssSP0NDL2XR4/4WaKrgBGXPbVk/TeWF039bZ6gdl1e1Nw+XjnrlvsYNd35Ij05FJhIQ4P/XjTtbwGYGR/usbl8eoH5y8XDC4pY+mnsyaxVGDW6zIdv/pe+be7UAawQ8+XhgE8mvRyw8vetDbxh5uQ8aVQqHc92/6PTt+fuqxv//5K7WkuFmsKwvM44kvnCt49ME/2tt7NcGVa2IHjjBCwuyBMncikfTlF/ZXVuiYCadSgd5eIRwdKy+/vs7Vjal5mnyp+K47f/r375uVFe2aIuwAAJUKdHT0Zt+u3fv3zeef/veOTd/99P3lHpbeWZXAkq8MmRDneYJiMPoW1CoUypdf2J9+s7KnRyCXWWpeiNlNtb6BSsqMD2cabYGP39X6vkU9kOMVpc/NStT1sdMMBFLppdpqONpvTWAIBT/iEoEPx09/9pJ5qvgZ4/NbqcH2Dkv8Bu7QmlF5dxcAQCyX33PqqIWmgwllsgfPHj935y4HM2Vn6jnse04dNfskX5Fc9sCZ4/s2bItzdSPh8BJF39ofc5lM3QYZY0KZbNepI6Mr4zsKG0LCqIQRD4xDqQAoZ3VHObt8nH4DbjNCBav7cm31Mv9AgVT6wc0UuNk4FazuK/U10D6WUwQaKo1h3qFyQvf5CX3m1fYU5H6flQFHdbEhEp2oNFsSmUog8KSSXrG4TcA3fV4/GY93oxsqxGEYVyKxxBwFbRKF/MkLpz9fumJjCJrxOp6mRXrDIQAAAN7u9h6uzJZ2DgCgpKrNy72vcM1QdBp5QcLI5gwNy8Wxr/eq67kbMIp/ff7MIAcmjcURVNZ1lte0hwYMquTOF0jScmoAAAQ8bsUCq+6cMxx9ziY9/knRpRMNuu8cjDsSDr/ZJ/bJsIX2JPNceSGWoFKBstKWstKWf/akYjDA1Y1pb29Do5EwWIxYJOvq5La1c1RaSWEAwNz5IXPnhWhHhrVmXdyBfbe43L6Pgg313Y8/vMfDw87Nw46Ax0mlcj5fzGELe3r4NjbkwyeeGfzVY4TBoHzw8daXX9zP6u7LcbPZgr/+vPHXnzewWIyNDZlEwotEMpFIqlCM7Fa05V4ZYv3nWaUCIpFUKJQI+BKBQCIQSIQCiUAg4fHE2ocV5NUTiTgajUSjkaia/1OJNBsytC5Km0QiFwgkAr5YIJAM/BN8SQ9LoDmmsaH72JEsKo1kQyNRaUQajUylEtX/EIls6Kpz8dKIg/v7PtpVlLe99fqRwe0AAIDBYmhUki2TGhDoHBfvu2hJuI2N+Zfhjo719w3zQgn3cbMlLFJfwr2Zy73d0jzLwyIFPc/VVIrkOm4aq20LH1k9GbU1gSFfZNxs5ho7Z5CCJzjTaEwymYzHy5VKrkTSKxF3CQRGzkBTAfDS1Yspdz9AJ5LgNpOVdncBAD5Ouz7sBR6DRHK3YdgQiVgMhiMRc8QillCoMG4aXadA8EZK8s8r18ENI8eVSO49fcz4FJILzcaZRqMRiDKlgi+VtvJ4PKkEPqifWC5/9PzJU9vucqRSzTgnVG0ydZuJiITH7169vkckYotFbLGYLRL1iEXsvqcirkQyijmhY+btG1e0S1UYRiUQXG3oVDyBjMdjMRiuRMKVSngSiYGeD9kR0TcNzXRlrK6qnu52/qC5ckwy2ZNuCwCo62WrpwPr83dh3jL/wN152Z2CgU9sanZkii+TiQGYRi6nW2hoRsCBkqJRJB8nOjRUGvn7bPahcuL2+Yl+5vPa2z5Muw5HBwt2cNwZET3TwzPY3hE7eIKxRCEv7Gi/0dTwX1GBMb84dCLJx5Y56D8m04VmM+rpIwKp9J5TR4f9MKaGAYBBIjPJZDsyBY/FcsQitljMkYiNmRevUKn+l3yBSaYs8umbzoyMMSaDakPT2+39vBzUCff6ZhbcpiU0wAXqw6bD4/vyKarhPhGN4l/H47Brl0b9dSQDAHDiUsErjw1KuCenl8tkCgDA3BkB6so21oxJpHwybf1mn9hvSq7lsBrh5vHDJFJ2+M+4K2AmSrVPLCoVaGvltLVy4AYtc+eFvPbmejg6HCqN9MY7G17930HthHJLC7ulha111Pjz9XP6+bcH3n3raEnRoLJ4SqVKk6kcHcu9sjbrP89nTuV++9UFODpEZkZNZobuBZqnL7wIbQGqVlPd8cgDf8DRIWprOn/6/jIcBQAA8OW3O2NifeBov3vun19X23U7U/d3paZSqvh8MZ8vbmnuuZFSvvvnqw88vHDDpunwcePB+vuGeaGE+7hJ8guwI1P0XcMcLS+xUMLdQL2aADv7eFd3OGoEHBb7QMy0d1OvwQ397MiUWR6ecS5ukc4ugXYOzjQdCw95UklBR3tGS9Oh0uIuIXxdDekRib7PyngtcQHcYDK2WPT5rZv/FOXDDQAAAGxJ5FWBwQt9/Ka7edhT4I+/Aqn0dltLWlPDwdIivsEMAgDgQk1VWlNDopfewdRIb15PHrboPw6DWeYfuDY4LNHTm0GCL2k6BYKctpZLddWXaquFMvhmTKdAsP7Qf72SQTd7zWIydZuJCIfBGMhAKVUqjlisTr5nNDd9mZkGHzF+sttahq0s4W9nv9w/cLaHV7iTs76lJByxuILVXdHTXcHqymptqerRfSUf4+Ia4eQMR0frTFV5O39gSWaSX+Bj02bGubqpn0oU8oOlxR+nXRfLdc+Szmxpaujl/FOUpx2c7+379IzZ09z6Rm8VAKmN9a9du6wv85va1CCQSqfaVoFoqByvoXLi9vkJfeYVSuWr1y4ZSDfbUygfL1qW5B+oL0dIwuFnuHvOcPd8YtqsPwtyvspI0zelwI5MOXvn3W42o5/JPpQKgGcun4OK+A/lzbBdHhA0y91zhrvn0N9ZqUKR296a0dJ0saa6nGXoHq1CpXrq4pljW3YE2zvAbYjl0W3g904bk9H3R5zHNzTAMvtX2Y+USgXKqtuyChtqGrvbu3q5fLFQKJXI5FKpQqZnXBpqdP/6+qSYf45lKpWqoVunXkiZAPVkIDMcff5bcG9GV91fVRmpHdX6RowxQMLhF7gGrfWKXOAaTMTqnYWKWAkSibD1jlkXzhVAk4v1cXW1vfeBBUuSIkd4k6tP/DS/r76965OPThlO6I87e3va19/dfeVy8b5/05sadV+kaHN3t1u+KjoiavgMkuVeWdtEOc8TDqubHxHpWVzUJBQOk27SEImkP3x7qb2t99EnlsBt42FK9Q2UcB83eCx2Q0jYnoJcuAEAAMC5msp3FyweRXUXw1p43Nv6dw8b6Xap2u6IiPouKwO6fxBk77AqMHiJb0Cks8uwfxDpRNJcL5+5Xj7PzJh9vKLsg5spBqYTAgD2lxQ+M2P2SK+fjfFTTiYcAsCWRH5i+qy7o2LJeL2/NTQicZGP3yIfv6dnzP4tL+vnnNuGP2t+fTvdxIT7+ZqqU5XlcHSw+d6+7y1Y4mPLhBv6OdNoKwODVwYGc8TiX3Ozfs/Plg++RDewxa6JJlO3mWSwGIw9haK+qyQx+oJzbBiukOBjy3xn/uIFPn7Ddh4mmTzLw1Nza7NdwE9trE9tbLjRWK+dNjXj9HYAgPb+jc/OnPPMzNlajYCEw++Kig11cNx54jD0a6imUKl2nDjMEQ98ey/MSnxyRoLWIQADwHxv36Nbtq8+sJcl0jHtV6ZQZLQ0mbdyhZVDQ+U4DpUTus9P3DN/pLykQn/RrRAHxz1rNxmZIifj8Y9PmxXv6v7g2RM6lyOwxaI/8nPemLsQbjDB91m3DBf9D3ZwfHzazDVBoQa2RCLicAkeXgkeXs/MnHO5tvrb27cMbJEqkEqfvXT25NadBBxKz401Yv9Ecp1IxL4P3kKDu8NpZqOPyPXMqp//vdHUxoYbRmh0/7qzAz1xWkBqVrVILLt0s2xDUt/njdaO3qKKVvUBM2N9tb/E+iU4+SU4+XWJ+ScaCy61lJVw2sZsxaSPjf1sJ7/Zzn5zXQJpeFNHUWTMYLGYRx5fct+DC0qKmwvzGxsautvbON3dfLFYJpXIVCpApRJpNmRvbwf/QOeE2YERkV76B36jRER5/v3fY+k3KzPSq8rL21gsvlAgIRBwdDqZzqB4eNoHBrqEhI1mGqJ5YbGYpOVRS5Mii4ubc7PrCguauru4vb0ioVBCIhGoNKKzs62Xt31wiFtcvK+PryP89fpZ7pW1TZTzPFFwuaKff0hOvlysqa2EwQA6nQJNtJcrFFKpgs8TQUPvkUOZ02f6T59hFYv5pk7f0Js6RMbAtvBIfQl3gVR6sabaLNv0aTteXqrvIw8OgzGlfiUFT7grKkadCLOnUDaGhG8Liwx2GM3oTMDhtoVHzvH0fuz8KQP7lfGl0jPVFXeEj8W8j0RP76+SVumcvKYTg0R6IWHuNDePpy6eMTDVPaettZzVFergBDcYR6pQfJSWAkcHeyFh7pPTZ8FRPZhk8stz5q0JCnnk3El98wTNa3J3G8QSOgWC1MZ6ONov0dN79+oNo6u37kqz2RoWuTUsUqZQXGuoO1FRerW+jojDrQ0OgQ81h40h4VDmUWOmu+cj8TN+zNZx5w8A0Kr1u7kjMhrKPGq40GxeS1zwQvJ5uAEAAEBOe+soko8TFBoqtY3jUDkR+/wEPfMqAHbnZcPRfgwS6bfVG4zMtmskeHh9vnj54xdOww0AAAD2FORuCYsY9ecZSGFn+7e3b8FRLffGxL+RuACHxcINemAAWOYfuNjX/42U5IOlRXBzv7Lurh+yM5+bNQduQCxManC3N4mk764/lWzmFOreY5m/7EtVP7alU2bF+gb5Obs6Meg0MpVMJJHwh8/mnrmqt8OYxcblsalZ1QCAk5cKNAl3zXapqxZFjLRSjZVwIts8FJz4UHBij0R4s6Mmm9VQzG6r5HbovLE6as5kehjTNdTWJYzpGmPv6UZhwEcgEweRiI+L942L94UbLAOLxcydHzJ3vkkf8h95fMkjj1t8yjAGi4mK9oqK9oIbTGa5V9Ywy3m2hLXr49euj4ej5hAQ6JJ8/TU4ajI2W/DcU3ubm3rUTyOjvLbvnB0d662zrA0AQC5XNjZ0X08pO7jvllzeN/AePpAxNOFub08bxTe8aEn4oiWjTx4CK+4b5oUS7uMp1MEp0slF33XX0fISsyfcj1aUwqF+C3z8jE8o63RvdHxGS/P2iKg1gSGmzw/yZDD2rN207tC/bYMLv2q7VFtt4kWpMTaEhH2xZIXx13UaC338flm57u6TR/Td5AAAHCsvHfXi8b1F+YZry76WuOChuOlwdDgRTs5Htmy/89jBYcsvmMVk7TaIhVxvrNP3C+VEpf24cu3osu3aCDjcMv/AZf6BPKmkksUy+0ojAIANkWj4F/+x+Jl/5uca2G8DAOBAob6euBCOalkXHPrBzRSdhctKuvRO85x80FA51NgPlRO3z0/EM5/X3lqrf9f3t+Yt8mLYwlEjrAwMXh8cdrKyDG4AQKlS7SnI/XTxcrhh5BQq1WvXLuubEovFYL5cunJ0H4/xWOwni5e52dC/uZ0Ot/XbnZe1IzLahWYDNyCWxDFYOLint68WE51OHtxikuqGrt37b6ofb10V/9hd8zVT6TUMVJY3l5kxvupdYSvrOitqO0L8XQAAl26UAgAwGLB6kUlDgTWwJ1HXeUet844CAEiVihpeVxOf3ShgNwnYLImALRGypUKuTCxVyKVKhUypUKqUOCwWj8ERsTg8FkvE4m0IJCaRYkugMIhkexLNnWLrQbN1pzI9qEw0jR1BkCniy8/OarLti5aEv/bmBsN3Y/F4rH+As3+AM41K2v3LVXWwoKBRLlfi8SPOayGjBn+wQMbY1vDI4uu6E+7pzY3tfJ7rCKcgGZDb3lrP0btk0pR6Mmr2FMqhTXfAURM4UqnfL1+z5eh+uKFfRkuTUqWy6NSP+d6+o8u2qyV6+TwYN/03/RPNrtXXGs5B6KNQKg28LABgQ0jYKFJIaq40m9/XbFx/6N+hdYrNblJ2G8RyDGTNtkdE25LMeTVOJ5I0RaLNa2NIuCOVCke10IjEFQFBx/XfIgUA3BsTb/juAh6Lnefto7OUSo3+ZNwkg4ZKfcZ4qJy4fX4invkLNVVwqJ8rzWZ98Giy1WqPxM/QmXAHAJysKH91zgIm2dRBeH9JoYFx/vlZiaPLtms8PXN2XnvrdT0rpcRy+XdZtz5cmAQ3IJbEE4jZvUI7W91DRG1jX3Ekf6/RLC7RJ/lmufq+Toi/yzP3Ldb5C2e4arxZYDBgw7KYH/+5DgA4e604xN+ltKqtuZ0DAIiL8HZ3Gc29MatFxOLCbF3DbF3hBgRBEES/pkZWRnq1+jEej33ymWU6/2bpNG9BqCbhLpcpOByBo6PZEozIsEaZRkTMZX1wKFHPhCmlSnW8QvdVzegcK9d7HWtHpiwd+VLrMTDNzX2u/irnQpmsTv8tBNM5UqnfLFs16my72jMzZhtIEFSzezoFw+yiptOF2ioD9YLtKZT3Fpi0wC3Qzv65WYlwdIIY326DWFSz/goeM9w94JC1Wu4fCIeGWODjC4cG2xw6/Dq+GBfdl7WtPK6B3RQnEzRUGjCWQyXq89osfea16+ZDtoZH4k34VBPm6BTtrPsMSxTy9OZGODpCMoXiJz2VhQAAy/2DnjC69JM+GAC+WLrSwI2BY+Wl2nsGIGPjdkE9HAIAAFDX1N3e1fd3PzLYnLfAWzt71Q+iQz30ZS4Ky1vgkAWsXhRJJOABAFfTK5RK1dVbFer42iUTfno7giAIYrqC/IHPV0HBbrZ67k/rRKWhlUDjafSfuRGzsCWRl+m/Cj1a3lfCz3RSheJMVd8HuKE2hoSbcgFmUffHToNDWqp6WHDIfF5PXGhHpsDREaIRiZsMFscv0b+FlwH7SwzVlHxuViKdaOoy2Huj40Za49V6jGO3QSxK55Z9ag6UEXz4GEc4LHaa2/D3BuJcDWUWwh2djfn1DLRzgEMAAABUAHQKR3Orb8JBQ6VhYzNUoj4/lOXOvFypLGN1wdF+M937tokeNQO3NrPbTM1OHi0v0VdsB4/FmmtfVkcq1UDRHrFcfsR8H78RIx04na3s3wVO219HMtQPIoPdzTvdW1NAht0rHNzS5/z1EtM3UzWGLZ2yeE4wAIDdKyyqaLmZVQMAsKGRFswKgg9FEARBph42e+ATLIOhd8aATi3NA3/IMFiMvT0qmjemrDTHOqUYqOVSw+4p6GiHo6Nypa6mV6J3ws62cL3fw7ib5e5pYI65vgsz0wU7OK4LDoWjo7Le4PLnCv0XxvpwxOKMliY42s+eQtkaFgFHRw6PxRrOCFiz8eo2iKWR9CwJAgD0iHRfM1ubQDt7Mn74em7eDFsaUe+UBAM5L23udL0biHVZU/LRQtBQOayxGSpRnx/Kcme+hceVKRRwFAAAAAaAWBc3ODpCca56X8H0j6z7SgrhUL+tYZGeDL1v7kjtjIwxULTnrP4ZKoiFVNZ1vv31Ga5WCRelUvXbgZvJaX0VonZtNnVxAyQ0wEX94GZ2TV1TX9UaNaVKdSq58NNfLmkHLWrj8lj1g/MpfVn+pLlhQ2vKIwiCIFMQTWtDkdZWzkCDEU4cGyit6e/vjMXq/fCDWAL6Qz7+5nr5uNnQ9V1cHSsv0bc+ekQMbJca5ewS4mDOqojmRSUQIp2c9V3FWe76+d7oOAMXYyMS6eSCw2L1LWZvMbibn07JdTX6Xg0AsDk0goQzz6/2+uDQT9KuK/TsXWbNxqvbIJZmR9G76ORWS1Oi/ioN1kPfDNyh3Gg21VLdhacjnfoyBYY5U2lwqB9PIoFDkw4aKoc1NkMl6vNDWe7Mt/J0f54EANCIRBv9tzSMZGBD0U6h3vJNxqjsYRV16t7WCADwSPwMOGQCL4btDHcPfbV3CjrauoVCw7sOTBo9HCGXL+ILJXyBRCCU8IVSsUSubkrJrGxuZ9MoJBqNSKOQbKgkZ0c6HjfoRhGXL2b3CgVCCV8o4QslAqG0q6evB2YVNihVKhqFZEMl0qgkGpXkZG+jM4m8YFZQeU3H1VsV6bm1seGezg50kViaX9rc1dPXo1YuiEicFjD4i0y1fF74HwfTe3kisUR230t7FyUE+3g44HCY9k5uZkF9W2cvlUK8Z3PC7wfS4K+0gMhg9yBf56r6zgs3+q7XUD0ZBEEQRM3HdyBZ19TIupVeNXvO8EugVCqw79+0q8kDi/aWJFnvLNvJSseHHmSMYTGYzaHhP+ipWXmqqvyNuQsJ+id1GqNHJEppqIOj/QxMsbcSHnSGvotSkbzvqsC8SDi8KbuKQch4fKiDo75NwEaxyP1mUwMc0rImKAQOjZYTlTbNzeN2q+4rUis39t0GGQNeDL0ryg+VFj8UN928+6Zago8tEw7p4UZnVOvZ6THI3qgMJp1EwgCgMw3M1V+cZ9JAQ6UxxmCoRH1eJwudeZ5U730FswyPDP0vYmLp89N6tmMFAAQ7OBrfi4wU5+KuL+GuAiC9udFcyxyt3MufHi+taoOjAAAA9p3MgiI/f7A9OnTQWpOv/7hyKVX3G3c+peR8yqDiPK8/sWLVIh0XHcvmhT26c94rn55oaOnJyIMvWFYuiHj18eVQ0HQ2NNLHL61/+ZMTPIFYJlNAP4WzA/2959cGeDv+eTBdvbeqpW1cHvvZr5dkMgUAINDXKcTfqFuMCIIgyKQXF+9r72DTw+q7Cf3BO8fvf2jhmnXxJJLudK5QIMnMqDl25HZZaasm6ObOXLMuTusoZCzofoeQMbYlLPLH7Eydn+Y4YvGV+toVAcPfwjLgZGWZvll+RBzO+q8oDOxtJTbhotSAOZ5eBnY6HQV3G4a+hLuBUj/6GCiTak+hROnZ0Gx05nh6T9As0th3G2QMzPLw+j4rA44CAADoEgpeSL7w84q1Jt6htDRXG73zQyEM/eXFDdx40IYBgIwniOQyuAEAqWLy/xagodIYYzBUoj6vk4XOvET/j0kzxwcbKl7viwikUhUAo14beL2xHg71W+pr5tnNQP/+umqFne3W//F40ogK8XCwo/31xa6Tlwuvplc0tPQIxVI7W2pUiMfaJVEzoi21di0mzPO/b+47dDYnI6+uuZ2jUCgZNmRPN7vEaf4bl8dSKUQAgL+3Y3XDiGs/jsLy+WE//pMiEEkBAGsWo+ntCIIgSB8sFvP0s8vfefOo+qlEIv/5h+Q/f78eEeHp6WVPp5PxBJxUKheLZF1d3NYWdn1dF7QtCo1Geu3NDVSqqcsckZFCCXer4GPLnOHuqe9a/Wh5iYkJ92PleuvJLPcPMsuMJ4sy8B2qLDPrZJ63LxwyDYOkN4kgkeuutapPh4DfwtNbhWaWh9eor3V1mm5c2VwrNPbdBhkD093caUSivq1Tr9TV3H3qyFdLVxqo4zzunPSXvICQ8LrvHJBweHv9pXUgJDxOZ/JRrucu7KSBhkojjcFQifq8ThY680T9dxz5Mh2nZaS4Ur2zBAg43Kh/rdhikb55CQCAed7mT7mGOznDIS3FXXqL20wyv328Ew6NxNvPrH77mdVw1DiJ0wLSjryoeUok4Leuit+6Kl7rkOHduyXh3i0JcNRoDna0x+6a/9hd8+GGfn9/eQ8c0mLiv64TgYBbPj8cjiIIgiBT2Nz5IU8+s+zH7y+r+jPpErEsN6cuNwdeFjaUt4/jO+9v8vYZqEuDjBm9+zUhY8zAtqUpDXU9IhEcNVplD8vAZYNZtoyzNJyZaqkbz8CeYKNj4LpaqmdzM30qWd1wSEuMWedsAgDCHJzg0AQx9t0GGQMkHH57uKGZX5ktzUv/++uLjJsmFjewHOPzhvr2mTRQyH4oHEb3H3prSz6aHRoqjTQGQyXq8zpZ6Mwb+LwxihV1Q/WK9ZasoetfoDCs3LZWA4U7jN8GwHhM/ScKANDY2wuHEMSSLqWWqae3z58ZxLAx1DkRBEGQKWjDpunf/XhPdIw33KBfQKDzS6+u/f2vh1C2fbzovrBBxt7KgOC3b1zVOW1TrlSeqiy7N2ZkMz40jpYPqp+ozc2GPiH2GBxjGADCHM2cOjEw40ylu9isXjV66tuqmf07t6dQ7CkUU275IIh53R87bW9RgYGyCSK57MfszD0FudvCo+6NjjN75V8TGZ+TwuvJGxrOE0Esk9ObANBQaT1Qnx9Lrvo3NRVIpSyR0IFi0l6gdRw2HOpnZNkfncq69VbtoBNJlti/lE4iYTEYfVn+TgFfoVJZ6KYIgkBUKnD0Qp768Yak6MGNCIIgCAIAAGHh7l99d1dLc09aamVFRVtjA6unhy8WSaUyBYmIJ1OINCrR1Y3p6WXvH+A8Y2aAs4v1rvmeIiZ2wr22rLWmbGAfgKRN07UaJxgqgbAmMORgaRHcAAAA4Gh56egS7kqV6mSF7r2MAACbwyKw6FpiCDc6g4Sz3l8NA9e6AABfph0cMpkHnYGySIj1cLOhvzJn3rup1+CGwYQy2V8FuX8X5M739t0RGbPE1x+H1Z3LG2PGJx/1sSGiAnzDQ0Ol9UB9fiz5MO3oRJK+rVNvtzSvDAyGoyOR1aa7/iEwemNbncpYehPuvkwmHDIHDAA0AlHfiVKoVGyRyBKJfgQZ6sKNkur6LgBAsJ9zfOQIZi8iCIIgU42Hp/227WauZoZYiPVmFY1x9WTu0T9uaJ5O6IQ7AGBLWIS+hHtxV0clqzvYYcQrQdKaGjoEfDgKAAAAA8DWML11bCynnc9r5nG7BIIOAZ8jEfOlUr5UKpTJxHK5RCEXy+ViuVyskEvUD+RyiUIuMWH3sFHwtOLqzwCADoEADvXDYjDuNnQ4ajIPOqOoU29VorFh/d0GGUv3xMTfbG68UlcDNwyhAuB6Y/31xnpHKnVjSPiW0IhRDKTmpa9KtfH0ld1AtKGh0nqGyqnQ563nzGMAiHV1S9WzAem1hjpTEu4yheJmUwMc7TfDhJ0M6jkcONSvqLPD74cv4ajl6dwJAEHMLquw4YvdyerHj+7UW00eQRAEQZCJxdovYAwT8MxQjNJ6THfz8Lezr9WzCv5IeclriQvg6HCO6t8udaaHp7cJi3+NV9XDymlrye9oL+nqrOX0CM2xZ5dFOYykVuzY6xbpzSLZkSl4C8zhtSOPwwmZcN0GGUsYAH5csebx86ev1tfCbXp0C4W/5WX/lpcd5ui0MSR8Y0j4eE1dND11SLDAr/nkg4ZK6zEp+7w1n/mVAUH6Eu4nKsueT0g0UHbGsGMVpd1CIRwFAACAw2AWePvBUaO1C3hwaLyJLHNHBEGKK1v/OZrJZFCUSlV9C6usul0dX70oclas76BDEQRBEASZsEy9BBpfQr7udaAT15bQiM9upcJRAAAAJyvLXp4zf0TVJAVS6aXaajjab1uYoY0HTaQC4HZL86mqsmv1dW18q7uIMow5HkkT47H0lyxgkkdQ5dZ4DJKp1QCMNKG7DTLGSDj8b6s3fJd164fsTMVI9kIs6+4q677+6a3UhT5+d4RHLvYNGNG4ajoC1tTZvlZSG8fKoaHSekyaPj9RzvyqwOB3blzVuSW7TKH4JO3GN8tWwQ1G4IjF32VlwNF+c718nGk0OGocmULB1v8LO17kSh0nEEFM18sTpeXAS/TmTPP/38NJUBBBEARBkIlrYifcBTyr+3Ruos2hEV9m3FTo2sGpUyC42dSwwNsXbtDvXE2lvvWwNCJxRUAQHDUHkVx2oKRoT0FuE7cXbpsgSCbPxbMooUzHzrpqFkr3mF5+d1iToNsgYw+LwTw7c85Sv4A3UpILOvomiBlJoVReqau5UlfjZkPfERG9MypmzKYnm75zBgaY+gpTARoqrcck6PMT68zbksh3hEftLcqHGwAAAJysLAtzdHokfgbcYJBcqXzq4plWHhdu6PfotJlwyGgciVjHB18EmaTsGFQ/L8fObq5IIqNRSEF+zqsWRixfEG76UIkgCIIgiPWw6sTisCbfDHdnGm2+t++1hjq4AQAAwNGykhEl3I+Wl8ChfmsCQ6gEAhw1jQqAQ6VFn91Knei7xlnh0nVtOuesqRFxps4i1MmiJ2TSdBtkvEQ6uRzfuvNERenXmemjyIW18XlfZqb9lHN7a1jEo9NmulmgtDcEXVGPDTRUWo8J3ecn6Jl/akbCkbISfbMuPkm/0dDLeXv+IiO3iG/j8x4/fzq/ow1u6LfIxy/BwwuOGk2MircgU0l4kNu/X98LRxE98m7VvPrgn1DQ08/x9zPPQcGJ5d2n/r11tQyOGkSjk49mvAlHx4pMKt/3y7WUc4Vdbb1kCiEi3nfX00sDQt3g4xBz2/nEH40tOmoOEwi4q4efh6NGq6rrfO+rM20dvTHhnh++soFMNnNqyICtD/3a3sUFAMydFfjxqxvh5ing/a/PXrpeCgCwpVPO7H0SbkasjCnvl1Gfs63WJKvhrrY1PEpfwv1SbTVPKjFyDl0Lj3u7pRmO9jP7dqntAv7TF89mter9FycQHMaCSRPTGcgi4U1etq8TwTLJKTC5ug0yjjAAbAwJXxsUerS85JfcrHoOGz5iOCK57J+i/P2lRdvDo56ZOcfekhs5TODU44SChkrrMXH7/MQ9805U2gsJiR/cTIEb+u0vKUxpqNsVHbstLMrAiFfPYf9dlH+otMhAkXoGifThIpNKYUj0/7YiCIIg1uCzlw+nXipWP+bzFJnXywtu1/507El3b4fBByITw4ETWfVNLADA7fz6G5lVyxaEw0cgCGKyiZ1wF/InYcJ9qa+/HZnCFuuYSCVRyM9WVdwZEQ036HK8vFTf+lx/O/tpbu5w1AT5HW0PnDk+uslfGABsyWRbEplOJNkQiVQCgYInUAkECoFA7X9wrroir13vvKqpRlfBoT4WmkVooQrXqNsg5oXHYu8Ij9oaFnmptnpPQe7tkefIZArFP0X5xyvKnps1557oOAv9QiFjAw2VAA2VppnoZ/7+2Gk3mxpS9MzhAAC08Xmfpqd+lp7qZ2cf6+LqQrNhkEhUAlEglfZKxM1cbk57a/twpepxGMwPy9eYuDZoRPtwIAiCIGOsqa5Lk23XEIukx/9Jf+KNtVAcMa97ts1uaeP08kQcrrCXK6qu6+Jwde9ePmo4nFVPN0SQiWtiJ9wn5Qx3Ag63ISRsT0Eu3AAAAOBoeamRCfejFaVwqN/WsAg4ZIK89rZdp47wpXqr5WrDYbHRzi5RTi5hjk4+tnY+trZOVNqwswLLu7sselE6sRBxOH2LxCfQBl+o2yAWgsVgVgQErQgIqmR17y3KP1lZzpOOrPgYTyp5L/Xa2eqK75atdqcz4GZkgkBDJRoqTTEJzjwGgG+Xrb7r5OGizg64TYsKgFp2Ty1bx3L1YeEwmC+TVs4bSbVDnQxXefJkMHwYTDhqeTQCEQ4hCIJMSWX5jXAIAABAeWETHELMDZp7/ukPF84kF2lHRmf7xhmVtR3tndzEGQELZgfDzRPT3iMZ+SXNKxdHLJ0XBrchyHiYwAl3lVIlFhp1ITThbAuP1Jdwz25raejl+Ngy4YbBcttb9RVVwGEwm0LMlnDvEPAfPndi2CtSAg633D9wbVDoXC8fs9eOn2oMXJfKFBaZI6ZzF19ToG6DjIFgB8f3Fy59fe7CCzVVh8qKMpqbRtSPc9pa1xz8d/fq9dPdPOA2ZCJAQyUyapPmzDNIpH/Xb73v9LHc9la4zWR0IumbZasW+/rDDSNHNrhZ/Qr/oNfnLoSjCIIgE5mHj6Obl30vWzAhNqUT8HR/k5Ny+uMUEejrvPf7++HoBHf8fH4Xixcdhq7dEGth6AOulRMKJCpzX9xaiVAHp0gnl+Iu3TOSjpWXPjdrDhwd7Fi53untC3z8nGk0ODpa/7tysVtoaE0TDovdGRnz5PRZTlSz/aNTnIHr0pHO5DWSgcqto4O6DTJmyHj8hpCwDSFhLTzu8fLSQ2XFxm+syhaLdp08emDTtmhnV7gNsXpoqERGbTKdeQaJdHDTHV9mpO3Oy1Ka72PzLA/PTxcvH3b+h5EoeEO3KwTm/s1CEAQZdw++uOLBF1cAAORyBZct5LKFHLaAyxZw2cJejqCxpvP6eTPMYjYXGwYZDgEAAGAwqXAIQcZJQ3NPF2uYOngIMsb0Xo5av8l9Q3VrWITehHtFybOz5hioFCtVKM5UVcDRfmbcLvVyXXVqYz0c1eJKs/lp5bo4V7R9uTnZUyj6Moa9Yov8UugryzA6qNsg48KDznhyRsITMxLSmxr2FhUk11UbMx9ZJJc9fv706TvusiPr3VQQsU5oqERGZ/KdeTwW+/KceauDgr+9fSu5rgZuHqEge4cnps9aH2zOxdq2ZDIRh9O30fHoyugjCIJMCHg8zt6Jbu80aCeM8oImq0q4h8V4wyEAAAAxs8ywyAlBzCK7oB4OIch4G8H2CEqFUi7X/VF4XEzKHVM11oeE6VsO38zlZhncDPBaQ22vRPfJsSNTlphj8a/azzm34ZAWZxrt4OY7zXJFqgLD58WmDgeK3qkELLHIEmeKZdZrXdRtkHGEASDRy+eXVetu7HrwobjpxlSBaOFxX09JhqOI1UNDpZHQUAmZrGc+0snlkfgZrjQbuME4dCJpQ0jY3+s2X9xxr3mz7QAADAAGtl1t5XPhEIIgCDKGPP0c5y2HJ+05uzM33zMXCiLIeMkuaIBDCDLejJrhfulI1pHfrrc1suRyhU+Qy86nkuatNLRv5/6frsAhC+hu0z1zbXKwJZGT/ALPVuueqH6svHSmuycc7WdgevvGkPBhd/EyUgWr28BmXxgAvlu2xpthCzeMilguh0NTmLP+q2WZQtEp4LvoP2B0uoUCODRaqNsgVsKdzngtccFj02buzs3eU5ArURjqLeerK0u6OiOcnOEGxIqhodJIaKjUNlnPvEKl+jLj5i85t4fm+B0oVE8Go53P75WIpQqFSqUi4HBkPN6eQnWh0Xxt7UIcHONc3aKcXXEYA6srTeVOpzf0cuAoAACAxt7J/IEfQRBkQnjpk62evo4pZwu72ntpDHLCwtB7n0li2Omd3IAgY0kkluYV697aF0HG0fAJ9yvHc75+9bDmaUNVx0dP//vJ3kdiEgK0jhrkn68vwiFk5LaFR+pLuJ+rrnx3wWISTsfbJ5bLr9bXwtF+W8PNtl3qlXpDq5JXBgbP8tB7S2CkzF4Yd0LzNVgytbGXY/YsUjPXbJPLULdBrIodmfLynHnbI6NfunIhs8XQyqGfcjJ/XLEWjiJWDA2VRkJDpbZJeebFcvlj50+lNNTBDQBsCg1/e95iBokEN4y5UAenW81NcBQAAECvRNzK47rTGXADgiAIMlYIRPw9Tyfd83QS3IBMEK9+fPxmZjUcBQAAcHj3w67OI5tMUFXXef5qcVFZS1tnL18gUSiU8BFaUk/8Dw4BAADAYfvqbZRXt1+6XppT2Mhi8wUCiQ2N7OHGjI3wWr88xs1F9zcmFEnzS5pq6ruq6zqr67uaW9majWp+33fz9303Bx/e59KBZyhkIhy1gOLylosppXnFjd09fIVS5WhvEx3muWJRRFykFwCAQDBqCmwPR5CeVZNf0lxV19nN4glEUgIBR6MQPd3tQgJcFyeGRIS4w18DAACgvLr9oRf3AgDeeHbV8oURbR29P/19PbewAYvFRoa6P7Rzrr+PEwBApQInL+YfPZvb2tFrS6ckzgh4cMdcW4beMqqj/n6GMkv/AQAoVaq029XpWTVF5a1sjkAkltFtyK7OjLhI72ULw/29HeEv0MMs75dOOjK2kBN/6+is/31/2UDCHTGLuV4+bjb0Nr6OnR94UsnVutqVgcFwAwApDXX6LuGinF1CHZzg6GhltbbAIS33RMfBIRO08syWxZgEAuzs4ZCWsu6uGfpXP4yOvklno4C6DWKFvBm2/23Y9mLy+RMVZXBbv5SGOplCYa4VQsgYQEOlkdBQqW3ynXmFUvng2RNpTfA6aywG8878xXdHxULx8WJ4b+r8jnaUcEcQBEGQcScSS7/8JfliSgncMHIUMkEqlf/09/Vj53K1t9bicIUcrrCkonX/idsPbJ+7a2vCQFu/orKWlz84BketgFgi+/ynS5eul2oHm1vZza3sc1eKlswL/d9jyxg2unch1sgtajxwMiszpw7a7l6hUIrFMhZbUFDSfOhU9uzp/q89vZLJ0LvQpK6R1d3Df+K1/ZrtZG/ers4rbvzl07t8vRy++S352Lk8dbyLxTtxIT+vuHH353dTKfA9CXN9P8Cs/aegtPmrX5NrG7q0gz0cQQ9HUFrZtu945pK5YS8+lkSjGppWYpb3y4DhE+4t9d1wCICa0lY4hJgbFoPZHBr+Q3Ym3AAAAOBEZZnOhPu56ko41G+L+bZLBQBU9bDgUD8GiTTNzQOOjpZCqWzUs/Hd1BRk7wCHtBTp2Wt31Bp6OWbcCRB1G8Q64TCYL5aubOXxbuvZIUMok+W0tyZ4eMENiLVCQ6Ux0FAJmXxn/qO0G0Oz7QCAt+ctsp5sOwAg1sVQwj21qWGVrg+9CIIgCIIYY/3y2NAA116eqJcr6uWJGpp72jtH/DlErlC+8uHx3KK+4i12ttTYSC8mg8oXiIvKWtq7BmYSxEZ4hQS6eLgyPdzsNEEIjUr65IcLl28MTHgi4HFyhUKT1FUqVb/9l0og4LZvmKE5Ro1GI4UEuGieKpWqqrpO9WNHexsHO5qmSRu2f069hUik8v+9dzS/ZNCKPTwOK++fwX0ltby7hz892kf7gKHSblffyoarVhDwOIVCqZ3yvpVd++K7R3757C48TvfPVdfY/fPf17tYPCwGAwBQf61AKP3p75SNK+PU2XYsFqNU9r1mQ3PP0bO5d2+B73CY6/sxY/+5dL30k+8vyLQ2GcVgAB6H00RUKpCcWlZR0/7Dh9vt9fQHc71fBgyfcKdQSSKBBAqSKMNvNIeYbktY5I/ZmYPuIvVLaajjSiTQKmCJQq5vNTQRh1sfHApHTaBz6r1aqIOTGQt9lrO6x7LOqfXzsWXaUyg9enbn07cie9QKOtrhkAlQt0GsFg6D+WhRUtJ/e3QOuQCAClY3SrhPIGioNAYaKiGT7MwXdrb/VZgLRwFY5OO3y6yz9U3ny7TzsWXqWyZypa5GsXCpGc8/giAIgkwpCfF+CfF+mqeHTud8/8dVrXajHD2Tq8mW3rF++iN3zddU21CqVEfO5Gpe08vD7sn7Fqkf63MltZzDFQIApkX73LFuenS4B41KkiuUlTUd+09kpaT3VVf+fd/NFYsi7GwHzZuODHH//ctdmqd8gWTlzu/UjzesiL1n22xN01j6Y99NTfaWyaA+sCNxfkKQPZMmVyjrm7ovpZQeOZtbUNJcXjXMVcO2ddOPnstTKVWxkV6JMwMjQ9z9vB0oZKJKBdo7e1Mzq/4+dIvLFwMAKmo6ziYXrV8eA78EAACA7MIGuUzx+D0LNq+Ol8mVn/544VpaBQAgM6eurqGbRiW9/szKxBmBnF7hKx8dK6tqBwBcS6sYmnA31/djrv5TUNL84bfn1PcJXJwYOzbOTJjm5+psi8VgBEJpSWXrkdM5t3JqAQBNrezXPjnxw0fbdd4DMNf7ZYCOfxUSFKljOk9QhJkXYiM6+dgy9a15lyoUl2rhIlw3Guv11ZNZ5h9oSxr9UgiIUCaDlpNoc7UxZ2Hc6411cGjKm65/kl0Lj1vD7oGjJkhv7hsTTYe6DWLlAuzs41z11p7rFgnhEGLd0FA5LDRUapt8Z/6HrEydP9FTM8bnQtSwJb4BcKhfl1BwXVcNegRBEARBxszhMznqBzERnk/et0i7tjUWg9m2dtrKxX01FS6mlAqEUk2rTups+66tCd+8t232dH916Q88Dhse7Pb+S+s0SVupVG6WCiSW1tzGPngqW/3Y3o722xd3bVgRa8+kAQDwOGygr/Pj9y784q0tBDxOIh1myoWLE+PN51Yf3P3wt+/fsW3ttPBgN3XpeQwGuLnYbls3/fuPtmtO/tW08kFfrEUqlc9LCNq+cSaRiKdRif97bBmRiAcAKFWq9i7uE/cunDcrCIvF2NvRHtwxV/0l1fWdMtnAtHE1c30/Zuk/Eqn83a/OqLPt4cFuf39736ZVce4uTPUsfhqVODPW97M3N2tWRZRUtJ6/Uqz9CmpmfL8MGD7hfu+LKynUQUV8KDTSff9bqR1BLGer/jowQ7dUNVBPZpv+1xkFmRL+JdRGNGuZ4zNV8I+JJHp6wyEtp6v0jnEjpVSpdG6zNjqo2yDWL8xR70YXHD1zpRGrhYbKYaGhUtskO/MCqfSqrlWPtiRyrKsbHLUChovG/JbXd1GEIAiCIMjYa25ld/QX/Vi9JGpwY59VS/qSTlKpvLRy+DLUsRFeD+2cB0cBAAA8tHOeZlZyYamhLXasxJnLRZraLE/cu1DnPrTxUd5b1sTDUV2WzA11ddK7e42/t+OiOSHqxxXVhupkLpwz8OGKbkOOCO77BEjA45IWhGmawoP75pypVEC7tIuG6d+PufrP+avF6pL0BDzunRfW0gYnqzUeumuek0PfXJmDp7IGNwJg7vdLn+FLyvgGu/52+aWz/91qrusCAHj6Oa25a7a9/nM91EtfbfcJHKivZC4NVR2fvbAfjk46qwKD375xRee89ZtNDdpVZeRK5dV6uLKSmpsNPdHLB46agIw31HO4ErgG0ahltDSVdXfB0SlvmX/gOzeu6pi0BgAA4FBp8VPTEzS7fpsiramhQ8CHo6OFug1i/Ug4vb0U7Zg64aCh0jA0VEIm2Zkv6GwfKIOqxYlKtc7KLNPc3EMdnMpZus9MRktTWlODeT/NIgiCIAhiJO08rI+ng1bLAG8Pe81jTXbVgB0bZ8KhfrYMSqCfc3l1OwCgo3v4lxp3qZlV6ge2dMrSeQO5bMiapOj9J3Tkf0fKz9tR/UAglMgVSp0lUwAA/v2HqXm4MvOKmwAAvt4OZNJAnXAbGolIxEulcgAAf0hFcWMM+/2Yq/+cvlyofpAwzd/NRUeWXI2AxyVM8z99qRAA0NDc09HFdRmcxB6b98vQpYWGgzNj13PL4ajRwmJ9XL0GTpy5EMlToo48lUBYExRyqFTHIgi5UnmlvmZjSLj6aVpzo76rwc1hEeoVFuZCwuHJeLy+8qPdQvMUXlAB8Gl6KhxFAHC1oUe7uOorGdzG552sLN8U2tcxTPFXYR4cMgHqNoj1a+Xr/tMOAID2zECsHxoqDUBD5VCT7Mx3CgRwCAAAQJdQqFSpzPux0Fx2Rce+du0yHO33ekryhe33GL4vgiAIgiCIJWhXGiHgdc9DwmvFNTtP6kPA42bE+cJRLY72fTOU+XzdaS7rIRBKm1r7ilXGRXljsXo/ZXl72NszaT0c3R/SjKcuDqMmk8nxON0TvR36z6EaldJ3GJR9BgCQ+hPu6v+P1LDfj1n6j0Aora7t2x03KlRvJVg1N61J67WN3do/8pi9X2PxmZVhN2h/A3Oh2kyV3MfWsEidCXcAwKXaak3C/WJN3y0aCAaALaERcNRk7nRGrZ4CuCVdnVKFwvTF138X5OZ3tMFRBAAAwB3hUfqySACAzzNurggIohJMuimV196mb83EqKFug1gzhVKZ26578RoAwI9pB4cQq4eGSn3QUKnTVDjzvRLx6ary9cF65/KMo82hET/lZDZzdd/4bOjlvHTl4nfLV8MNCGIFlAplY01XTXlrTVlbbWU7p4cv4Ir5XJFYLCMQcEQSgcGk2jnauHs7+AQ6h8V4h0R7amcWLI3TI8hNry7Kqmuq62pr7hHyJRKxjEol0m2pdFuKm7d95DTfyGm+vkEuGIvdjeNyhNmplfmZtQ3VHR0tbKFAolSoKDSinSPdy88pPM57xrxg7wBn6KvweHiapFlY+fuF6CTgiYty6usq2usq21vquwV8sVAgEfIlAAAqjUSmEqk0kpMb09PXwcPb0TvQOTTai0gyf76rsabz5H+38jNqutp7cTisgwsjcprvis3TQ6O94EP7NdZ0nt6fmZ9R09nGweKwDs50Lz+necuj5iwJI/cnQK2fi/NAvrKjmxvkD/+2AgA6Ogf+gjvaDUr1DuXj6TB0HrQ2XH+rUqkj92pVmlp7NKsKfb10T9/W8PKwMzKB293Dz8qvr2noamphc3miXp5ILJFLpXKJVC6R6qiBMRTdZtA+jtj+pb10Gry/o2Yqhs7tf9RM+X7M0n+q6jo0395Pf1//6e/rg9v14vQOmjdjofdrKPMPQBA8Hkcd/B6bC82GAocmqeluHn5MuzoOG24A4EZjvUyhIOBwSpXqcl013AwAAGCmh6ePLROOmizE3kHfRalEIU9vblzoM7AL9ijcbm3+KP0GHEX6bQgJ+yT9hr41De183vs3Uz5elAQ3GE2ikL9y9SIcNRnqNog1u1hbrW9OKAAgwsn8tdEQS0NDpU5oqNRnMp15JxoNDvV77dplDMCsCw6FG8YbEYd7MWHus5fOwQ39TleV21Mob89fbKmMIGIdvn7r+MWjcNX++DmBH/12HxQ0xUNrvmmqg0sYbblv3oMvroCCBkjEspy0qltXyjKvl3M5utfBSCVyqUTO54paG1kluQ3qII1OnrM4fO2OWcGRnoMPH4H/3ft7UVaddmT/9VfsHOnakfLCpiN/pt66WqYYMluQzxPzeeK2ZlBZ0nL9fBEAwM3LfusD85PWxxG05iqarrmue98vV1MvlciGTJzk9Yp4vaLGms605JLfPj8fGuO19f55iUsH5opRaOacYze+75c1u3wi98vXj8LR4Xz214PRM0z6s2gMlVKVeqk45VxhVmrl0C6kxuUI1W9ofVVHVv+fWQIRHxbjFZsQMGdJuG+QsR/jzx68/f17JzVPF6yKfvXzOzRP//v56n8/X1Nq/TY113U313VfOJK9aHXM0+9sgLY/VCiUe765dPSvm6r+atEAgOY6SXNd962rZc5uzBc+2hwz01/rK6yXl7sdk0FV73R6I6Nq7sxA+AgAbmT07SmIxWCiwj0GN8KYtpMnoaddhoXJGObngpLgOuWXNP25Py2/pEl/9nt4WCxG34pGfXPM9TH9+zFL/4Hy5saDNj41+/uljzn/lOpEt8z0dgAAiULA4bBDPzpMSlvDIj+7pWMBslAmu93Wkujpnd/Rpm+xs4FtV00R5+p+Xs+cegDAj9mZplyU3m5tvv/McZnC0PZlUxwFT9gVHfdDVgbc0O9ASWGYg+Ou6Di4wQhKler5y+cre1hwg8lQt0FM8VHadYFMeldkrIGtTUetnc976/oVONrPnc4ItDN/bTTE0tBQORQaKg2YTGc+wtEZh8HoLOMulMmeuXT2x+yMlYHB8a7uPrZMRwqVjMebZUsDE60LDjtQUpTR0gQ39Pu7MI8lEn6yaBmNaM5ZgSyR8ERF2ZGykj1rN7raDMpXImNv2cb4oQn3vIwaVgfXwWVgipwpKoubh2bbAQBJG+LhkB61FW0n/7117VyhVDzMtD6dBDzx5ZO5l0/mzl4c9sQbax31F6IdkZrytulz+zqwSCD5+eOzl0/kqnSNAzq1NfV8986J/366+spn26LMkUhVKJT/fJ98dM9Nudyooa+8oOn9Z/bFzPR/4aPNzm5MAACDaZ5kgnW+X8iwctOrd39+rr6yA24wgkwqL8yqK8yq++f75MBw96T18UvWx9nQR5Y7qy0bWJT266dnj/+TrtU4yLWzBd0dvR/uvk8zrV6pUH70/IG05JLBBw7obOO88sCfb3+3M2GRNS47gxDwuA0rYv46dAsAcOFacVyk18rFgxJNWfn1/x2/rX6ctCDclj5MHpM8iWpEi8RSzWPt2ug6UYY74Lf/Uv85POjixc3F1tvD3s6WyrAhk0gEMolQXN5yK2eYJbaaJQJD6cnD62aW78cs/YcvHDjPRCLeQCkYCLREybzvlwEWT7jb2umdX2M6Gp2s79b0JLMpNPzLjJs6r5pSG+sTPb2T62rgBgAAADQicWVAMBw1hyW+/h+lXYej/bLbWv4pzBtdCuPf4oL3Uq+N2RXpxPVo3Ix9xQU9IhHc0O+dG1eFctmj8TPhBoP4Uumzl89d0dOjTIS6DWIKgUy6r7hwX3FhhJPzhpDwtUEhLjQda81GobS784kLZ1givX9QzFLpGxkXaKjUhoZKwybTmWeSyfO8fVMaBs1+1VbZw6q8fQuO6kfA4Yg4nB2Z7ESl+dgyg+wd4l3d41zdDOw1PQoYAL5cumLlgX/0LUwBAJypqijoaH9j7sJl/jqmR40IWyxKb248XlGW0lCnsPoV61NHRJyPh69jS323dlClVF05k7/tgfnawVG7ciofDgEQEuXpE+gMR4cozKrb+0NyUXY93DAqt66WleQ2vP39XRHxPnDbyNWUt02fGwwAaG9mv/X4P401fbVuR4TVyX3lgT8ffnnV+p2z4baR4PWK3nlib0leA9wwnILbtU9u+fGNb3ZEz/AzvTitNb9fiAEyqfyH909dPJYDN4xKdWlrTVnbzIUhI024Nzd0S8QyEplw7WyBgWy7WlF2/Z5vLj7ycl/psz+/uWQg266mUqo+ffnwD4ce9/B1hNusz87Ns9JzaitrOlQq8NF354+fz4uP8mHaUgQCSWF5S15Rozpf5e7CfOK+hYO/dJIjaeVkocnUQym1ljsMdfJigSa7bUMj7dqSkLQgXFPOXuPfo5mGE9zmYsbvx/T+Q9G6SfPa0yuXzB3lYk0zvl+GmfMjsk4MSybcqVMm4e5Cs5nv7XtN11XTreYmAMC1eh1NAIA1gSEmVqfVx9/OPsrZpahT793m91KvYbHYuyJj4Ab9Sro6P0q7nt7cCDcgutCIxBcT5hrYXkwFwKfpqZktzW/PW+RrRPlphUp1urL80/Qb7QI+3GYmqNsgZlHS1VnS1fnRzZRoF9elfoFzvbyjnFxGNzezhcfdU5C7tyhfqj8RRsbjR9QnEauChko1NFQaY5Kd+WdnzrnRWG+gFueIyBQKmUIhkEqbudy89r4ZfxQ8YZGv37bwqAXevoOONoE7nfHJ4uVPnD9l4Ptu4vY+cu5kuKPzrujYZf6BdmQd06D04YjF+R1t6c2N6c2NpV2dBv4VZBwlrY/761t43L5yKs8sCXeFQplyvhCOGj29vZctMFf2Vo3LEb7xyF9f7H04INQNbhuh2vI20Jcx/6O9mQ03G02hUP780RkqjWTkORmKyxG+dN/vo5uYDNTn5NG/3/3h7rjZASQyQTKqaelq1vx+IfrIZYp3nvw3J03vmrNRiJ8d6OY54uWqKqWqrrLdy8/pl0/Owm26nPj31uptszz9HEvyGo7uuQk36yISSP746uJb3+2EG6wPmUT47I3NH357Liu/HgBQVtVeVtUOHRMb4fXW86vtbE29VTax0LWKX3H5Yq0WHQwcoFAo/9jX120oZOIvn+708dRdYVznnqJmZ97vx/T+Y8cYiLPYeivBDstc79ewxiDhrvtMmQVN1yqDyWprWKTOhHtJd2dDL6ecpWNRJLBYPRm1B2KnGaizqVCp3kxJvlRb/Wj8jDme3nCzFp5UktJQd7C0OL2pQedlz67ouEOlRWL5MLeepqDtEdEXaqpuNNbDDVpSGupSG+uT/APXBYXO9vRmkuG7+gKptKCz/UZj/ZmqihYeF2oFAKwNCj1XU2mumV9TpNsIZTKeVMKTSnkSCU8qMTB1up3Pv9FYTyeSbIhEOonEIJIsdJPMeHKlkieVcCUSnlTCk0hz+xMrOl1vrHOh2dgQiXQiiU4k0YnE0SW+R0EFQEFHe0FH+5cZgEYkxrm4RTm7RDg5+zPtfWyZ+k6jCoAugaC+l327pTmtuTGrtVnn4iFtj8TPMNdUemRcoKHSaodKKzSZznyMi+uLCXN11iQ0F5Fcdq668lx1ZaiD05vzFho+J8ZbGRD02tyFH95MgRsGK+3ufOXqpdevXY5ydo12cQ22d3CnM+zJFDIejwFAIJMJZFKBTCqQyrqEglpOTy2bXcvpMbDeBbEeS9fH/f19snbVYwBAQ3VnVUlLUISHdnAUslIre3vgC3UiCb9wtVH30uYujXD3dmhtHL6eGB6Po9qQxCKpVDLMb7pIKP3wuf2/nHjaxD0ea8rbFArl+8/sM5Btx+NxFBpRwJdo16HW6Yf3T4VEeQ7dyHRYcrni/Wf3DZttp1CJeAKOzxXrLHojFcvee+a/b/c/audoY+DHGZY1v1/Wg2FH9fBx4HKEfJ4Y+r0bF798cnbYbDsGiyGTCQQSXiwc/i0DAKy6YwYcMk5tRXv24EFD/b7r/EdVStXRv24+8+6Gnz86A3Vsqg1JJJTqPL23rpV1tnKc3Zlwg/VxsKO9+FjSk6/t72LxCXgcgYATi2UUCsHRnh4R4r50XuiMWF/4a6YAT7eBKTsNTcOMNi1tHDjUr7y6nd1fpnztsmh92W0AAHu023iOiNm/HxP7j7+vIwYD1L9YpZWtAEyDjzCOud6vYVn8L4SlS8rAoclrqV+AHZnCFsMXCQql8pfcLCio5m9nP83NHY6az9qg0D/ycwxMBAMApDbWpzbWu9nQ41zdwhyd7ckUGyIRACCWyzuFgmZub2l3Z2l3l4EMxc7ImHfnL67uYY3L7DDr99mS5esO/Wtgp0cAgEKlulBTdaGmCgDgRKW52tjQCESFSiWSydoFPJZQqOPPfr/pbh5fJ62s6OmuZA1a2DtqE73btPN5WW0tPImUJ1XnoyVcrcS6OkPNl0qGzeFqZLe13HPqqHYEi8Go89f9WWwinUQaeEoi0YlEX1u7ONfRTKu51lDHEgo13zxPKuX2PRj4KUaUAHr6Ijzdg4In0ElEG/V33v/92xBIdFLfD8Ugkhb7+Zu3CoFAKr3Z1HCzaWDZMp1IcqBSbUkkIg6Px2IkcoVILhPKZB0C/oh+wBgX1yemzYKjyESDhkqdLDdUTlyT7Mw/Nm0mHov99FaqgW/GLMpZXTtPHN4eEf32/EVmGd4fjJ3GEYt+zM6EG4ZQqFT5HW35HYbuDSMTjqOLbfzswKEZt+RTeaYn3K+czINDAMxeEm5krQkMFrPpnsQf3j8FxQlEfPR0v+Aoj4Awd/8QVztHumb7RKlYVl/dUZLbePF4tr40dGsj6/jetDseXAA3jERLA+urN46VF8K7IITHes9aFDp9brCzG5NuSwEAqFQqLltYktdw+0ZF8sk8uUzHOj+JWPbtOye+3Psw3DCcvd9fgXZz1SCS8IvWxM5fERkS6WnDoAAAlAplL1vQUN2ZkVKenlzaqZXaEAkkrzzwp0hrd7tRsOb3y3rMWhA6a0EoAECpUPJ6Rb0cIZct4HKEXLawlyPgsoXnj2QJ+Sa9EcYry288e7CvlDPEw8dh/oqo6Bn+Hr4OTi62mP4KzjKpnNMjaKjuqK/sqC5rzc+o4Qy+qWbvRB91nfS0SyXV5a0AAAwGs25nwrods9297QEApXmNP7x/qq4SnqKbeql45oKQ6tJW9VMXD7sdjy6amxRBo5NlUnnKucKfPjwt0ipFDQBQKVU3k0s27UrUDlqn6vrOp14/wBdIPFyZn76xyUAGdixhtEqSGzPV2uzoNmRPN7vmNjYAILeoUalS6duttIcjaOvkwNF+3T0Dy2eD/Q3d7MwvaYZDFmD278fE/sNkUAN9navqOgEAGTm1AqGUNnibYiOZ6/0alhk+EBtm0ZIyUyrhTsDh1oeE/VWQCzcAcKBEx6JIAMDWsAg4ZFZYDObjRcs2HdlnoBSDWhuf11bNO1ddCTcMZ7l/0LsLlgAAEjy8LH1ROkG50Gx+X73xzuMHhTKj1lp2CQVdQkMpJ21uNvQfVqzBYbHhjk7myiJN9G6T0dL83OVzcNSslCoVVyIxUL4WALDY1/+PNRvhqBFeunJB3wbL5iKSy0RymeHM5q17H7b0rnTqmwpwdIQ86IyfV64j4Ea2jTtihdBQOZRFh8qJa/Kd+Yfipid4eD12/pTOlRnmtb+ksKqHtWftJvUdCBO9mDDXjkz58GaKgXtdyCS2bOO0oQn3lHOFD7+0ysBGcMPi88QZKeVwFIBlG+PhkH7LNsTv/fGKesYrhUaamxQxe1FYfGIgmaK75xPJhOBIz+BIz4275ty8XPLNm8f4PB1L1E/+e2vzvXOhvd1GRKVUXTk16HaCb5DL46+vjR6yAyoGg7G1p81ZEj5nSfhdjy/+4rWj+Rk6diUpyW2oLG4OjvSEG/SrLm09vEf3wpqYmf4vfLgZmsaLxWHtHOl2jvTYhIAHX1hx+M/U/btTNFub9nTxtA8eHat9v6wQFoe1tafZ2tMAcNKOp18pHbOE+8Hfrg9d9EChEh9/fe3SdXGaJLs2AhHv5Grr5Gqr3sNApVLVVrTnpFVdP19UU9YKAFi+efqox42c9L6B6H8fb1m8NlYTj4j3+fzvBx/f/ENnK0cTBADwuaJPXzqkfuwb7PLx7/fbOfStlCUQ8Ukb4pkONm8++vfAFwAAAMi7VWP9CXeVCnz4zXm+QAIAeP/l9SPNlloOhULAYjDqGnqt7Ry4eUwkzgw4eDIbANDDEdy4VblwTgh8BAAAgPNXi4f07gHavbRX17CjlplbV9vQBUctwLzfj1n6z5qk6K93JwMABELpnwfSnrp/EXyEcczyfg1rlIOOYSeLP9L8d9fTSXCz+VCnUsIdALBtJPVhcBjMxhCL7/IX4eT8wcKlcNRMNoSE/bhiDQ6DAQAkeIzgc95UE+XssnvVen0FNEbNmUbbv3GbupJGuKOh+5kjhboNMiH4Mu32b9zmZuEbA8iYQUOlNjRUGjCZznxaU8Or1y7ff+bYGGTb1bLbWh46e0Jupgn1D8RO+2XVelvS1PrAj6jNWRKmngGtrbdHkJU64rtc2m5cKJIN2SHN0cU2PiEQChpAJBPW7UgICHN/+u31+1JeeeHDzXOWhuvL3kLmJkV8e/Bx9TRzSE8Xr/C27onho7NgVfSPR58cmm2HOLrYfvDrPYlLdU/VOrE3HQ4Z9PuXF3QWq1mwKvqj3+8zXDQDT8Btf2ThV3sfptoMFNg13UR5vxAAgJAvyb4J32nDYDFvf39X0oZ4ndn2oTAYTECo27YH5v945Indp5/d/sjClVumwweN0IJV0drZdjUbBuWhF1dCQQCAWCQFAOBw2Fc+vUOTbdeYMS946Ka7FUMWplihjm5udX0nAACHw/p7O8LN4weLwbi7MdWPM3JqOVzLTi/TaW1StGaS9Hd/XO3s1nGzsK6xe++RDDiqxdvDXvM4Q88epPVNrA+/tez8Pw3zfj9m6T9rl0W7OtuqHx86lf3P4QwDCXG5Qnkjo6q9sxduMNP7NSyLJNyJJLzmP+xobyQaY0rNcAcAhDk6RTgZezG/wMdvbIoObw2LfHf+Yn1LMEbt4fgZXyWt0hSDjnVxI+MtviBj4kr08tm3YZsDxWxbJgTY2R/ceIePLVP9NMxx0BwH06Fug1i5JX4BJ7fu9GL0/TlHJgc0VKqhoXJYE/3MK1WqExVlK/f/c9fJIwdKCi29sAmS0dL0RcZNODpay/wDz2/fleDhBTcgkx2BiF+4KhqO6ikIYzxoArja0vW6p80asP3hhT8eeWLVtpmaOiTG8/BxePHjLXAUAADA0En9ozZvWeTLn2w1clYvHo97/oNNzv0ZK22Z1yt0Vp3WqSSvQedM+eAIj/99vMXIbyYw3P29n3bhCeacOW797xeiVlnSIpfDK8xmLQiNTQiAgkby9ne65+kknX17RO56fDEcAgAAMHtJmK297qIOSRvjfYNd4CgAAIC5SfBMSi5HCJXBsUK4/nFSoVB+8fOlusZuscSolaNjIHFGXw/h8sXPv3M4p7BBKJICAFQqwBdIGppZecWWvaXh4+mwcWWc+nEXi//Qi3tPXSpQF0BXKlWNLT17j2Q89so+gVBqq38rSm8Pe1+vvnnfWfn1X+9O7uUN1JTuYvH+OnTrof/tZfcK9W0ral7m/X7M0n8IeNyHL68nk/pmUP32X+qup//cfyKrqKyluY3d1tFbU991K6f2wMms1z85se6eH1//5EQnS0cy3Szv17As8il/zHgHuoTEmGd3poliW1jk211X4aguW0YyHd5Eu6Lj3OmMF5Mv9Er0LjMxnh2Z8sXSFYt9/bWDBBwu3tV9DFZeT1wxLq7nt+96IflCqsGNAY2xKjD4s8XLaVrrwc2eRQKo2yAjN93N43RlhemFYgxzptFenbNgQ8go6zwiVg4NlWioNNLEPfN1HPZLVy5mt7XADWPo97zsTSHhwQ6jnL4EcbOh79+47Wx1xcdpNyw3VT/O1e2O8Cgnqu68CTIulm2MP3MgEwpmpJTzeWIj661D2pvZpXk6fuOSNsTDoeGYOKts1oLQkCjPiqJmKF5ZYp7fXHsn+vMfbBrRN0mjk7c9OH9orXMBT9xQ0+kbpDtvCDm1T8dkQCwO+/wHm0dUeiVymu+W++Yd2J0CN4zWiE7FUJZ+vxCNjhY2HAIgZuagv55jz9PP0ctP92c8PB4XM9P/xoUiuAGApev60nlDBUd6wCEA2pt6mFq5+9YOzo2MKoFAwhdKBEIpXyARCCW1Dd3qVrlc8cSr+2lUIo1K6v8/ydWZsWwBXOSAL5Ccu1LEF0oEAolA1Pc6za0D5/mNT08ybak0CpFGI9EoJBqNZEMlbVmjY1R0cqDHhHsWlDYDAM4kF51Jhn9qCploz6QGB7gsmRs6LyHI7BMXDLhz/YzzV4q5fDEAoKq289m3DgEASES8TKZQl5qxpVPO7H0S+irzenTX/IqajpKKVgBAD0fw+U+XPv/pEh6HVSjV3wIAAMydGTg/Ieij785rf6G2J+5b9PL7R9VfcOxc3onz+Y4ONnQbci9XpKmo7u/j9OEr63c8/ruByd3mYsbvx1z9JzjA5ePXNr79+Sn1213fxPrprxT4ICOY5f0ybGIn3FdvT1i9PQGOTmrrgsM+TLs+bF1ROzJl6eCLOktb6hdweee9H968frqqfKB7jhABh9sZGfP0jAQ7so6bSGNT6nRCc6LS/l63+XRl+RcZN5u4OhbODMvHlvnWvEVQRgAA4EChOlFpxlc0NhLqNsiIbAwJX+oXcKSs5HBZcVn38HXiRsrHlnl3VOzOyBgLzTlFrAQaKuE2NFTqMRHP/MXaqmcunpMo4IoZGu50xgw3jyhnFz+mHZ1IZJDI+P4Z9zoplEqpUiGSyXolkm6hoJnHrWB157a39ogGpjgNpVCpvsvK+GHFGrjBBKsDQ5L8Ak9Wlu0pyDXjnwBnGm1dUOi28Kgg+9HUEkUsKjjS0yfQuaG6Uzsok8pvnC9ctW2mdtBIV07nDa0NHRHv4+EzDu/+8s3ThyZwWxtYUGR0HnxhBYU24qosS9bF/fb5eUl//XSNsoJGYxLuIoEkPbkUjgKwcFW0vnm+Bmy5f97Jf9OhvSXHkUXfL0RjaPcDAIxiXYJ5RcT5wCEtodFeQxPuFCoxPFbv3FDvAB11C6AdCyprOn7ck6Id0aZSgcIyuEN6e9gPTbiz2ILv/7wGBbVV1HTAIQB0JtwBAO+9tO7Vj46XVureqFwklra0S1vaOdfSKiJD3D96baMxE5/NwtHe5rM3N7/52ckuVl8WGAAgGVJAzKIoZOJX72z96Lvz128NlD7T3sR19dKoZx9a0tDco4kMlRDv98pTK7785bL6m1eqVJ3dPO2CJ3OmB7zx7Cr1tp9NWjdOLMS834+5+s/0GJ8/vr7n+z+upmZWDfmrPkiAr5Ojve7KH2Z5vwxDOYUJhkkmJ/kFnq2ugBsG2xASNva7/DlRad8sW/X49Fl7C/NOV1WMaEaYH9NuU0j45rAIA+WSZ3t6AXiOCwLDALAuOHRlQND5mqr9JYWZLU0Gx58+WAxmhrvHPVFxywKC1IVlhwpzdOpqNHMWCaBug4wQnUi6Lyb+vpj4eg47paEurbkxv6PNxGoJ3gzbhb7+K/yDEjy9dPd+ZNJBQyUEDZX6TKwzf7Ky7IXkCwo99dPneHo/HD9jnpePvhlDxlMBkN3a/EN25g39K0Uu1FaxxSKdtxlGjYjDbQ2L3BoWWdDRfr6m8mJtdT1nmEs7nWyIxFkeXome3olePsEoz27dkjbE//7FBSiYfDJvlAn3U/lwCIBlI5/ebhaRQ4o4AwB6unkqpWqk9W0gzu7MRWti4KgRKFRicKRHUXY9FG+qNeoWV1Zq5dD6+ACAdaOaIWdDJ89bHnXpeA7cME4s934h2mi6yvc390/rHi++Qa5wSIurpx0cAiAwwsPAugobBhmPx0HFc7gck65oxsD1W5X/Hcssq2qHG3Qprmh9+YNjv3y20/RPHUaKCHHf+/0D568Wp2fX1DR08fhiAACdRrZjUv29HSNC3OEvsAAqhfjBy+vzS5ouppQWlDR19whUQOVobxMT7rlqSWR0mCcAwMfTHoMBBtLEKxdHxkV5nzifn11Q39zGEUtkNjSSPZMWE+65aE5IfHTfjZzIUI9hE9xmYa7vx7z9x9WJ8eErGxqaWSnplXnFTc1t7F6eSCZTkEkER3sbH0/7yBD3GXG+gb46bm5pmOX9MgAz9CY/gphOoVTmtLdmtbaUdnc29va2C3h8qVSqUOCwWDIOTyUQHChUTwbDi2Eb5ewy3c3Dg86AXwIxhx6RKK25IaettZbDbuCweyUSgUwKALAhEulEkjfDNtDeIdbFbYGPr3kviUcHdRtkdNr4vKoeVi27p4nLbRfwOgUCrkTMlUoFUqlUoZCrlAqlEofFknA4Mh5vT6bYU6gedIYf0y7YwSHOxd2ZNsoCAhs8nhALB+rbvPDjfUk7ErXax1leSumrG7+Co0OQqaQTLT/CUfO5eSrn309OtdV3OXvab3t2pVWdIg00VBrJyvu8pY3jmTdGaXfnhsP7ZLoWQRJxuDfnLborcjQJOANUAHx0M+X3fL3psM+WLN9q4QqHnQJBXkdrUWdHY29vC4/bLuALZVKRTC5TKsh4PI1ApBIINAKRSSb72DL97ez9mXb+TDsvW6a+e2YTzg9ZGV9mpsFRAI5t2RHn6gZHhzDxy8cAm8W/a9GniiGbcO658IKblz0UNKwsv/G5nb9CQRKZcODGq6OYDG46lVK1KubNoeXRT2S/beR+nv+79/eirDo4CsC2B+bf//xyOGqc3Z+dO/Y33CWWbZz2/AeboOBQX7957OIxeEBwdmf+c/l/UNBIt69XvPX4P3AUAE8/x9/PPAdHLcz098t45QVNz+74BQrS6OSjGW9CwTFz34ov25rgaZ6f/fXgsFvyjlTB7dqX7/sDCjq4MH4/89zYzHM/e/D29++dhILv/HBXwqIwKKhRWdLy9LafoOCaO2c9+eY6KKht+4JP2IP3aXz4pVWb7rHej1Vf/nL5xIV8AACNSrpj3fTpMT6O9jZ4/MBNBalMweWJahu6T1zIL6/uS6p++MqG+QlBmmOQKWtq9h80wx2xCBwWO9Pdc6a7J9yAjC17CmVtUOjaoFC4wSqhboOMjpsN3c2GPt/bF25AxltjZdtH9/+qVCgBAE1V7V8+sccr2C10OlyJZdyhoRIxhjWfealC8czFszqz7RgAvly6ck1QCNxgMgwAryYuuNXSVNI1qOKHRlZri6UT7s402nL/oOX+E/hiDDHMzsFmxrzgjJRyKJ58Mu/uJ5dAQcOSdW2XOm955Lhk2wEAGCyGZkPmc+HqTFKJ3MQE7oKVUXDIaA7OOu4U8rV2yTOgJK8BDgEwPXH0v55R032xOKz6U8S4s9z7hWgLjfbCE3By2aA/Z6wO7levH335820j2gnAjHT+XmjQdI0hrh46pr1rI5LgXJzOBSJW4sK1EnW2lEIm7v78Lm8P3fc7PVyZYUFuS+aF3vHIbz0cAQAgK79+QidMEbOYsv1H7yIXBEEQBEEQU9w6lw9dJ986qyPfgSCIiU5UlFWz4bmHavfGxFsi266GxWAejpsBR/uVs4wqQ4GY4v7Yack77zu8+c5fV63/eFGS9jbOxjDxy8fGso3T4BAAV0/nj2ihtlymGFpkGeh58TFD1VU9A4zgx9KBSCb4h4x+dYLO3WgF3OGraYkEkuY6HXU/wg0WvzaMQiN5+ppn72WzsMT7hUBIZML0ucFwFIDUS8Uv3v1bdWkr3DAmmA66a0CrEYakzgEA9k56q8mpEYjwzQOowoxVUWdLAQCrlkTqy5ZqkEmEyNC++i3d7IGK6siUNWX7j46hAUEQBEGQic7Rw37x1gRuD5/bw+9l8bksnkgwUAxkbLA7euFIFxeKIAhiuj8K4DIOalQC4Ynps+CoWc3z9sHoyTg1c9Hvu8VRCYQAu4Fr1y8z0wTSEWwyaeKXj42ZC0MYdlQue1B147bmnpLchshpvtpBAzKvl/N64bnJLh52UdN9oeBE5xvgbEpJcZ2TtaHpxjo11evItgMA/EIMFb8elm+QS2ON7jU0yGS1+d65GdfK4CgA5YVNT237afaSsG33zw+N8YKbLUnnjSgNAgFOnQMA6LbDFCHEDanwPrRgkfWoqe+7gx7oZ6gitoasf9CgknUMKchUM2X7D0q4IwiCIMgk5BXk+tLuB7UjMomc28M799eN/z47rR23HHsXWyjiNNykBgRBRqqOw65k6U51LfULcKBQ4ahZ2ZEptmQyR6xjAixfZnWpW2QiwuNxi9fEntibDsWTT+UZn3BPPqljfVXShnjMZKnmr+EbbFKCe9RaG1hwCAAAgIlT1J3dmXAImeyipvsuXR+n83dWpVKlJ5emJ5eGRHmuuXPWghVRRDIBPsjcMBgMeeTl48erVpWl9I+UItHwf9kFQmlhWbP6safbMKV1kClhqvYflHBHEARBkCmBQMI7uNnZu8JJcMuZvTrurw+Oa6rKEEj4hVssO9kWQaag2619lyVDzfH0hkMWYEem6Ey4yxQK1cBFFoKM3rKN8UMT7qkXix9/be3QOshDcTnCrBuVUBCDwSStj4OCphMJJE313S313awObk8Xj9crEgjEYqFUIpZJJXKJWCaVyCRiuVQik4hlxswcHykHF0PFpi2H1aljRQuDSSWZlg91NFg723Tj/n4hOj3+2tra8vbaija4oV9FUXNFUfMvn5xdsDI6aX1cWKwF/9gRiLhR3JkzZmiaQLzc7apqOwEA568Vb1wVhx8yPV9DJJa++9VpgbAvr7pwjo4CQchUM2X7z6QaBRAEQRAEsR5eQa6v73l078cn2+q7PINcH3hni1fQ+My8Q5BJTN+epQCAcEejlu6aSF8mgozH625AkBHyD3ELCHOvKRtUvlnAE9+6WmbMBqHXzxcOLY4cM9PPZbhdDY0k4Ilz0qpy0qpK8xqb67tHVFze7Kgjn4prFr09AjgEAMPO1BU2Noxh6nKMglW9X4hOVBvSZ3898PELB3PSq+A2LQKe+Nyh2+cO3fbwdVy2MT5pffywldNHgUAcTdJsaMWYCW3Fosiq2qsAgKrazqffOPDg9rkxEZ7aP6NSqapr7L6VU3v8fF5nN08dXLk40s/bpDUuyOQwZfvPaMYOBEEQBEEQYySujU9cGw9HEQQxH5ZoUG1rbfYU8+eqhmKL4NLYajTC+CT+kElp2Yb4nwcn3AEAyafyjEm4XzmVD4cASNpghr9N5YVNJ/amp18plUrkcNs4Ga9CFgK+jmUuNnRThyCawdrZI2WF7xeijw2D8sHue07vz/z7u8sCno7epa2lvnvP15f2fn9lztLw9XfNjjBhq96h9N1UHsbovspabV4Vl5pRlV/SBAAoKmt55q2DBALOxYlBIRMUcqVQJO3q4Sv6l7SqJcT7PffwEu0IMmVN2f6DEu4IgiAIgiAIMlH16irnomZDtHjKu0soYIt1J9w96JatBTFelCpV1O7vhTJZtLPryW07tZty2lq3HN2vfvzHmo2Lff21W+85dfRGYz0Zjy9+5Gnc4FyMRCE/Vl6aXFdT1t3FEglJOLwbnZ7o6X1neFSww8Se3mUui9bE/PbFeaimR25aFZvFt3Ow0Q5CWuq7ywuboCCFRpq7LBIKjkhrI+vnj89m3aiAG8abzl1Px4DOcisEoo7NJEcEr2s7ylGw2vcLMQCDwazbkTB/RdR/P109fyRLZx/TJpcrblwounGhKCLOZ+fji+PnBMJHjArWhF2IJw0cDvvl21u+//PaqUsFSqUKACCTKZpb2fBxAAAAHOxou7bO3rAiFp06RG3K9h+UcEcQBEEQBEGQicpANQSOWGxLMuf80KGu1dfBoX7+duap12FtsBhMuKNzdltLVQ9LqVJhtVLnue0DU7DzOtqghHtZdxcAINzRGcq2pzc3vnTlYgtvoAS2VKHgsSSVrO6/C/Pui4l/NXEB9CVTEINJTVgYevNyiXZQoVBeO1uwaVeidhCSfDofDgGwYGWUKbXFk0/mfffeSalYBjcYjUgmUKhELlto9nom45WhkMsHTU5UM72qBh5vhoS7Nb9fyLCY9rQn3li77cH5R/+6eeFIttiITRdL8hpee2hP7Cz/x15b6xM4FqXVpgIiEf/Co0k7N828mlaRX9LU0NTTyxOKxDI8HkchERh0spe7vZ+348w435jwQdVCEARM1f6DEu7I+Cvsal935F842m+xj/+fqzbBUQRBEARBEMRg5ZZWHs/HlglHzerf4nw41C/WxQ0OTRZRzi7ZbS0iuayxl+PLHLivkNM2kHDPbx+03R9LJOwSCgAAUc4u2vHLddVPXDgjUygAADQicaabh4sNXSyX5bW3NfRylCrVH/k5nQLBd8tXa3/V1LRs4zQo4Q4AuHIyz0DCXaVSXdWVcF+2cRocMtrhP2788dVFODqYgzMjMMzdw9fBzcve3onOsKXSGGQKlUSmEMgUIplCxGAxAIAN0981Jns4IejMj6hnMo4v9H5NDk6uto++svquJ5ZcOp5z9kBmSwMLPmKI/MzaJzb/sPOxRXc+vFD9DiKmc3W23bFx5o6NM+EGBDHCVOs/KOGOIAiCIAiCIBOVB0Nv5ZZrDbWzPb3gqPmcqCgr6uyAo/3meZmziq5ViXbu2/+5jNU9KOHe3gIAWO4fdLG2qqCjXQWAJsejnt4OtL4WANDM5T5/+bw6274zMuaVOfO1qwCdqCh75eoliUJ+uqo8wcNrR2S0pmlqmj43yM6Rzu7fTk2tprytvqrDN2jQbQyN4pyGjhZ40bqHr2N4rDcUNNL180UGsreB4e5J6+NnLghx87KH2yY7nbVfhq0BMiylUsfEeeOh92uSsaGTN+1K3LQrsSir7sKxnJuXiiUGFy7I5Yq/v0+uKGp+7avtRBLKfSEIMqYsMuj89O4J7aeb7p/vaoG/YVyOMPt6ueYphUaavTRCqx2ZMGxJ5LmePj1iEVss6hGJJAq0iQ2CIAiCIIhRQuwd4FC/U5Xlz89KJOMt8oG/gtX91vUrcLRfqIOTv535P/9bicj+WeoVrK6VAUHqxw29nG6hEABwZ0TUxdoqnlRSw+4J7D8JpV2d6gfaM9w/z0jlS6UAgFWBwR8sXKqJq20ICesRC99PTQEAfJd1a2tYBAGnI6c5dWBx2CXrYo/8mQrFk0/mPfjiCiiolnwqDw4BsGy026VyegTfDb7O1XB2Zz711voZ84LhhimDqmuzVp07qY6IKTPK0fs1iUXN8Iua4ffkG2uvnSs8fzirqqQFPkJLRkr5568efv2r7XADgiCIJVnk8/fpf9O1ny5YHWuJhLuQL/78xQOapzgc9lj++0QTivEh48WHwfx37VbNU4FMdqa6/OUUvZMRJp/iro7bbc1kPH5HeAzchiBWqbGitSi9sqaoqbaoid3J5XMEIoGETCVRbMh0JtU71N0/0jNqTnBEQl8awiykEtmts/k5V4tri5s7GrtFfDEOj6Pb0ZhOjJB4v8g5QQkrYym6rveMJ5cpMs7nZ14srMpv6GxiiYUSIolg72rrG+4Zvyh84aaZNkyq5mA8EQeEWl88QuNyDicfHltw61x+ZW5dXUlzV0uPkCcWCcQ4PJ5KJ1HpFDdfJ48AF98wj+i5IZ5BA7NKR6qhvPXAl2fzb5Tx2AJbB3rknKCNjyWFTh9UnRkAkHmx8NTuKxU5dVKxzM7FNmJW4Ipd86LnhkCHWZUx6/NjfA6VCmXOtZLi9KqyrJqu5h4eRyAWSGwd6A7uzPiFEUvvnG1Kf7A2c/RPJO8Q8D9Ov/Hu/MVwg8ny2tseOnuCJ5XADf3ujoqFQ5OIP9OOSiAIZbLy7m5NUF1PxolKm+vlQ8ThpApFXnurJuFexuoCAFAJhID+SJdQcLa6Uv34pdnz1A8g2yOiv8xIE8pkHQL+zebGRT5+8BFTzLKN04Ym3K+dLXjg+eVDS0bIpPKbl4qhIAaLWbouDgoaaf8v1wQ8HRnkwHD393/eZedIhxumElu7gT8WGlyO7h2VjafzhBsJvV+THoVGWrV1xqqtM8oLmo7+fTMtuVSp0L0kIvVi8Zn9mWu2z4IbEARBLMYiCfex4ehqi8FiVP2F4RQKZVVxS8R030EHIRMQjUCwI1Pg6KT2W0H2yaoyOzIFJdyRYZ3dk/L98wN7HmBx2L3Fnzm4MgeOMFpDeesjs9/Sjrz820OLthj6JNpY0Xrpv7T0s3mttX0z9bQJeSIhT8RqY9eXtdw4ngUAcPNzWvfQ4vUPL8Hqquw5VPrZvPfu+lHz9EDl10wnOgBAIVee3H3lwJdnuT38gaMBkMsUEpG0u5VdXdBwdk8K3Y62/pEldzy7ijCqRaOX96X99f5xVjtHOygWSlprO1trO9PP5O5+/dCGR5fs+N8aMpUEAKAxqHzOiLOPlj6H40Iqka1zfQyO6vLjjbcDosxT4KKxsu2v94/fvlgwdMW6Qi6ViqWcLl5rbWfO1b6Cvw6uzDlr4pK2JwbH+w46WkvmxcK37/xO/Xj7C6vveWMjACD1RPZnj/4uk/StvmK1c64fy7pxIvv+tzZvfaZvTqVKqfru+b3n/76hfgoA6Gjs7mjsvno4Y/0jSx77xEonVVmiz4/7OVQqlKd+u3r85+SOxoFMqBqrncNq51Tm1h/46izUBMHisOe6d8NRa+XNsA13dC7t1jGkAAD2Fua50mwem2a2cpliufzX3KwfsjPk+ks9eDIYm8PC4egkgsVgIpxcslqby1l9hWJAfz2ZCCdnPBYb6uBU2Nme1962NSxS3Vrav2OqZpPV9OZGhVIJAAhxcNRXap+CJ6g3aAUA3G5pRgl3b3+n0Giv8sIm7SCrk5uXURM/J1A7CADISasamm+dNifIwUVvFSYDpGLZ5ZO5cBQAGzr53R/uHkX2VqVUSSSGqmFMLPZOOs4Ah8WXyxQ6q80Yic0a9MHPeOj9mlJCY7xe/2p7S333X99dTr0I32ZT++fH5KUb4sgUvbueIAiCmJf1Xr0PC4/H2TkM+ktZWz6wTxGCTCBpzQ1wCEH0WLh5FpE88ElRqVBeO5Sh1T4Cl/cPWo1EY1AS1+id85V/o/zVjV89nPDWke8v6swU69RW1/XrawefW/5xdytcQdUYVfn1AABuD/+V9V/sfv0glG0fiscW/PvJqf+t+QxKIA5LKpZ+cM/PXz6xx/AXSsXSQ9+cf3rRBy01HQAAhj0NPsKgcTmHk9Xej08+lvh2+pncodl2fVjtnNO/X3t6yQfXjmTCbbpU5TcAACrz6j99ZCBTrKFSqv5458jNUznqp7vfOKSdKdZ28tcrh745D0fH29j0+bE/h92t7JfWfv7LqweGZtsnt13RsXConwqAz26lPnnhTDOXC7eNUI9ItDs3a8He37+5nW4g2w4AeD1xIQk3mhufE0iUkwsAoInbK5T15eDUM9wjnZwBANHOLgCA/I42dZNUoahh94DBBdwLOtrVD0IdnDTBoZxofb93rXxT38HJIUlXQZgrunZGvXGhCA7p+XJjFGbXCfk6lnTsfHzJ6DL4vF6RZurYJODuraO2lUqlamvugaMj0dnKgUPGQe/XFOTh6/j6V9s/+PUehtbiPA0uW5h8QkeNKQRBEAuZwAl3AIC986CEe1ONsfkLBLEe5ayubtEwEwYRRGNoWhzKmxtJpVRBmXoolQ+pKWzMSymFo8apyKl7Y8s3Au6IlxVX5tWLBJLXNn1dlN636N4Y5dm1r2/6Wio2tuinXCp/c9t3mqzfsBor2/63+rPW2k7bwTd9hzUu53BS+vqpv/777LRCbijfpw/FhpywMhaO6lJV0KBSqb599h+5FM4Ua/z62kG5TFF4s+L4z5fhNi37Pj/DYwvg6PgZsz4/xueQ28N/ed0XxbeqoDgWh7VzZrj5OtHtRnbDYALZEhqhKVSi09nqikX//vG/Kxeu1NWI5COYpClTKPI72n7Pz7nrxOFZe375OP1Gp2CYN+LOiOgV/WXNJzF1KXalSlXVwwIA8KVS9YNwJxcAQLSLKwCgktWtTsdX9bDUk9m1C7h3CfvO5MnKMr8fvtT33/n+sjMcMTxZe2pauCp66OaH6VdKpYP3TpTLFBkp5doRAIANgzJnSRgUNFJ5YTMcAgCLwy5cHQ1HjcMZbkybWDz9dN83qqvou7E0Oi31o7x7it6vKWv63OBP/rxfZ5HJrNQRXFAgCIKYCP6wMrEwB68Fa20Y5d9j6/fPJye7mnte+OE+uAGZ+G6i6e3ICC2/a672FN2G8taq/IagWL01fHXKTSmFZrYu25mo/RSy6t75+z4/DSV8KTZk/0gvv3APW0c6zZYqEUlZbZzSzOra4kFrvQEA9WUtv791+JlvdkFxw8qzan988b/qgoHfETwBF5UY4hvmwXRm4LAYTjevPLu2LKsGyr3Wl7Xsfv3Qk1/epR3U56dX9hekwtfkeCJ++pJI7xA3piOd3ytktXFyr5V2tfTN0urp6H1n+/e2I1yPPC7ncGzgcLikHYlcFq+XxeexBb0snqBXpFJZZCLYpf/SLv57EwoyneiRs4Pd/Z3pTBqBhBdwRdweflNlW11JC7uzV/vIRVtn6bwGG6q3m3f692s1hY0AgNj5odFzQ1Uq1bUjmc1VA7mDrpaeW+fyD3/bN/naJ9R99qo4GoNSkFqefWVgRbNYKLm8L23TE8s0kfE1Zn1+jM/hR/f9op6JrxE1J3jrMyui54aoS+IAAFjtnFvn8g99fa5zyKRLG1uqm5+Tm5+zu5+zR4Az1GrlcFjsJ4uX3Xn8kDqrq5NcqTxSVnKkrISEwwc7OPgz7X2ZTCaJTCEQqAQCFoORK5VShYIvlXIlkk4hv53Pr+OwG3s5ipH8Lid4eFmiZLwV0qTOy1ldMS6uue2tSpUKABDn4goAiHFxAwAoVKrCzvYED6+y7r7KM+qZ72o8iY7ptwYYeHOnFBqdPGdJeMq5Qu2gSCDJvF4xb3lfAR8AQE561dAJzgtXRxOIo7z+bWuCBw0AgLe/k52DDRw1TnlBIxyayOi2FBcPu44WeDVeaX7j/BVRUNB41aWjXMKO3q+pzD/E7e4nl+z+9BwULytEbyKCIGNnlB84rASdMajSN6tz0i60vHbkdlt9F0q4T0qpKOGOjFDM/FAXb0ftggnJB9JHmnBPHjwv3ifUPWSaocqwFBvy6vsXqqs6eAS6zF07bfaq2JBpfpj+WrTaKnPrf3jx38q8eu3g5X1pdz6/ysXbUTtoWFbywGJwIomw9ZkVm59cRqXDezy01XX99PK+rMuDVo5f2Ju6/cXVDm522sGhyrJqzv8FV7FYec/8+9/ePHQybEFq+Y//29dY0QoAaKxsA5V9tQKMNC7ncGzg8NgXfhz0F0qpUHJ7BFUF9W9u/VY7biKlQrnnvWPaETtn28c/2zF3bfzQ7fLUWqo7cq6VZF4syEspUyqUq+9dAB+h308v7QMAPPfdPcvvnqeObH16+cvrvizLqtEc89sbB9Wp281PLnvwva3qd3PrMyt+efXAiV+SNYflXCsxnCweM2PZ58EYnsOsy0X5NwbdRdj6zIr7394M/X45uDLX3L9w4aaZb9/5XUlmtSY+ojLx1mm6m8cbiQveTb0GNwwhUciLOjuKOgfdnDCLRE/v39ZsIOJGX695AvFj2tGIRIFUqq4VU9jRDgBws6G72tABAIF29jZEIl8qLexoT/DwUpd6pxGJfloLEagEgvpBlLNLnIubJq6P4UUMU8qyjdOghDsA4Pr5Qu2E+81LfRt4aFu2cRocMprORWYOTgw4ZLT8zFo4NMFFxHkPTbjn3IRXHRmvtqKNP6QKv5HQ+zXFLds47bfPz0NVgHgckUKhxFnxrkgIgkwmEzvhTmOQtZ+yu3jaTycT4Wg/aiBWji0W3W7VseARQQzAYDBJ2+f8++kpTeTakcyH3t9m/J5UIr44/eygIobLds7VfqrThkeXdjaxVt4zP2ZeKNw2WHC87xfnX351w1clGQNXWXKZ4sbxbM0GiSNCt6N9cvJFfZttuvk5vXfg6Y8e+DX1RLYmKJcpzvx5/Z7XNwwcN4RKqfrhxf+gidiPfnznhkeXakc0YuaF/nj9rTfv+Db/ehncZpxxPIdjDIvDMp3orj66F5iPWt71Mu0Z60QS4bMz//MKctU6BOYR6OIR6LLuocXsTm5eSmlAtDd8hEELNs3QZIoBAEQy8fHPdjy16H1NRJ0pDpsRoMkUq+16bf3ZPSmawuWlGQO53XE09n0ejNU5PPzdBe2n0XNDhmbbNWyY1Nf/fuyB6a+L+H2fr07/fm31/Qu9g4dPelqze2PiRXL5Z7dS4YYx8WDstFfmzMdhp0oiA4vBRDg6325tru5hAQDUm9bGu7prWmOcXdOaGws7OwAAlT0sAECkk7N2j3Sg9FUZjnVxe3fBEq0WZBhxCQFOrrZd7QN/DgAAt1MrxSKpekdEhUKZcQ0etXwCnYMjPKCg8XRuXU6m6q3FZ5hIKM26UQFHJ7j4OUFXzxRAwaa6rrrKdr9gQ3+p9cm4Bi/GMh56v6Y4GzqZaUeDNt1VqVRioZRGH5REQhAEsZCJnXAnkvomhqiJhMZW7J1wBDwdt+gRwwQyWUpj7e3W5pLuziZeL1cikSkVNgQik0wOsneMdXZbExjiw2DCXzbYpxk3fs67DQCIdXE7sWmnOtgh4J+oKrtcV93C53YLhbYkkpsNfZ6X77rAsFCHYWae1vdyylidZd1dZazOUlZXC29gWQZbLPL9+QutYwd5KGb663MWwtEhxHJ5ckPNjcb6wq62LqGwVyK2JZGdqLR4F/clvv4Lvf1xerIPGmb/kSeBp06fudXUdO6eXc79G5eNyD95+e9evap+jMNgKp9/bnD7aCTtmPPfZ6c1WTMui591uWj2qthBB+mXejJHIhoYMHF47JI7Zmu162bvYvvK7w/DUT2IJMLLvz10f/yr2ntaFqZVjCJZjMFi3j/0jL5suxoGi3nmm115KaV8jlATzEspNZxwz75SrC52obF4a4K+zKMagYR/+78nH0l4c2g9CmOM1zmcNOpKBt2hTFgVazjbrs3OmbF4WwIcHc66h+EsWFCsj1eQa5NWURQAwJanlkO5XSqdEjYjoPBm3/W5SCBhd3LtnEc/t84sxr7PgzE5hyKBpFRrujoA4I5nV+nLtqvZu9guvXP26d/75oMrFcoTvyQ//dXdg4+aeB6bNtOLYfvy1YuanTzHQICd/bvzFyd6jWyh1SQQ5exyu7W5mt0DACjt7gIATHPrS7gDAGJd3dKaG4u7OgAAQ3dMBQDEuLj9W1wA+pP1iPEwWMzS9XH7f03RDkrFsuybVXOTIgAARVl1vF746smU6e0AALqubRh5vQOfOkbk1H+3hn6HE92shaE4HFahUELxU/9lPPPuBig4LJVSdfl4Lhw1Gnq/EIEALioFTLjpgiAIMlITO+GOHbx+XKZ/S64JTSqRGdhtDBnqdlvzX0W5yfU1UsVAlkqNIxFzJOL6Xs7luurPM1M3BIW9PXexHRmuUDFUNZulfvBfScEH6SnaG451i4TdImFRV8cvebe3h0e/NnsBjaD3D/mqw39b6BpYBcDBsqJvstLaBYPu5LNEQpZIWM7q2ldaEGTn8PqchQu9/bQP0MdcPzIAYM6vuzv4/C2REZ8uX64JPnHq9IWqKkcqNfOxR7WOtUYqANT1beEG46wOCQ50sGeLxJ/duNHGM89CHBdvx5h5Idr1Ey7vTzc+4Q7tszpzWTTTia4dMQtnT/vZq+O0Z53XFsF1yY2x+t4FodP94egQNrbUpO2J2vsuVhc2yiRywpCt1TSuHLyl/RRPwN371ibtiE4UGmnny+u+fuovuMECzHUOJw2oILuzl4P2U7Mjkomh03T0vfBZgdrJYjwRP2NZlFZ7H98wD02yGADQ0ditM1k8lsa+z4/NOSy7XaN9XwpPxMfMC9Fq123a4ghNwh0AkJ1crNU4ga0JColzdXszJflaQx3cZm7eDNsH46Zvj4jGT5mJ7doinVwAAK08bq9E3NjLAYMT7uoqMQ29nG6hsI3HBYN3TAUAzPX2wWEwCpUqv72toZfjY8vUbkUMS9oQDyXcAQDpV0rVCfebyXA9GRwOu3htLBQcEeaQolsAgPrqDpVKZfj23lCdbZwje8ZnJYpF0W0pMxeE3LoKry24fCJ3y31zPXxHNkfn2tmCttHe6AXo/ZryGms6oY2UAQBOrraongyCIGNGbxpiQhD0LwRWG/UeOGPg4LcX4JDRJCId92YRfZp5vXeePKjet2pYJ6rKynu6D2+4k04kwW2D8aXSDgF/T1HuL3m34bZ+SpXqv5KCclbXP2u2GE5Am51UoXjh6vnT1cOsu6xis+49e/TZGXOenT4HbhvCvD8yAYfLbxs0mbGgvZ1OGua0W4kf1q6BQyPhQKXO8fYGAOzOyjJXwh0AsGznXO2E++1LhdwePsPeRusQ3TqbWMXpldqR5f9n766j2zi2BoCPmMHMzJjYTpzEYeY00CRNkzIzv7ZfmRle+ZUhbbhNGmZmJ2ZmZjFrpf3+kCOvxrIk25JM8zs9Pdo7K8Urr7XaOzN3NtmvJzMwaTMSiMlimdiiN8gRJBJp3VNL4Ggfxs9MICbcMR3WWt/Z1whojUp78UAuMTL9pgm+wZ7ESF/mrp/y3YtbzcUoXGrw7+FoAs1sa63tIG46XUisP4Vq5cYsIMKiVE5YfCD0g5l4+AmIm3KJkrjpfkNyzrvnPYSWgA6M8KU68J0wxLKATHtDl0qu7r1KxEgUxOP/vHx1dkvTt9eunKqrcfBLkeMYFOrs8IiVcQnzIqLtzpwbxUwroBpw/GRtDQ4Ak0pN9PY1t4737z7BTtRWm34B0Ah3fw53eWz87rISA46/dPLoryvWjM1+i4EJDPVKzggvvFZLDGafLceNOIlMunQC/ko8cUbcgFfLNAmPtegvMZGJVaV5DQnj+1GsTKPWvf7I5tE6XHr5hsm9E+4YZvj05b8//O1ex3Odog75Dx8dhKP9gX5fIxFuxPV6A73vsTKO273ZYoSBSUxyEBxCEARxGSd8lg2hlvruEbgm3GF8j/TLW3/DodFCopOUyMuqFNVyTCbXK3RGHQAgjh+7NngNvKtbBPMEiyJjDlR15xODeYIJ/oEJ3r7eLDaTShVr1DltLQery83DzEu7Oj65cv71aXN6XqIP7148vaeiBADAozMWRESP8/X3ZLLUGFYh7tpXWdaskJl2u9ba/MSx/T8uXmXx5BsOrbuTeN8r1Wpu2rXZ9FjAYO5Zs8ncBBH0nZvGAXjw8J4TddXmSChfsCAiJkroyWcwJBpNqajjaE2leeT751cvaDDshckzzPv3xSmHbBLp4VHR1aXQ6bh0OgCgXalskcsnhYRUdVn8FSOOm7Yi/evnWOYloTAddvrvq8vvnW25lxXHt10kVnD28OVPnJ9KaHemkDiLfJZei2nVOgbLVt8MJHFStIMJQQBARCL8NVrRR3oOAFB6tZpYVwcAMHnxOOKmDVQaJX124vm9A5/p7LjBv4ejSWBkTzILAHD5cF59WXNoXM+QUufqa31aD1+LLHBfhb+h+ezaoS58NyTnvHveQ7nIoiOKK3DoCyFXYPHiAACZSDk6Eu4mEwKCflq2qlUh31tRdrKuOrulWd9r5p/jqGRyjKdXZmDw1JDQrKBQDn2MfgoRRXh4mtZNPVJdAQBI8fUnZsy9WOwQvqBBJj1eWwUA4DMYob3GsP9nyvQz9bUitfp8Y/36v7e9OHXGhACLC5ka019vaT5eW63Q6T6cu5DYhMxfmQ4l3GUSVUVxE5lM7myzmA4FAFiwMh2K9FfalGgSiQStgQEA2Pz1ibe/v8PBQdPiTvnbT22pLmuBG0aL9Kzo+HEhpXnwbLyinLpPX/77mbdXWy2tDhF3KZ6/6yeo+nZ/od/XSKRUau+c/9GsZeMWrZ4QnTjwb3cn9uUd2G5lxNjkWfFwCEEQxGVGcMJdq9aX5tQTIw7eXyHOUiov29u8v1AKz9kEAPBoVspT1CrrJHqJ6XEMN4ZDhW90neXBtMzLzY1r45NXxiT2rjC+KWn885Nn3Hdwd15795enP4vynps0zfYAbQCAKfW8KDLm/VkLhQwmsemZzKlvnT+1uSjXtHmstupAVfmSqFjiPiahfIsUg0jTM1yCTCKF97oTc8T/cq6Ys+0UEumlrFl3pKRDI85eyZr9bc6Vz6+eN33r/C7nSoZf4PyIaOI+vTnlkE1ivL3KOjsLWlunhIYCAPJaWigkUrSnJ5Rwv9LY+O3lKzktLVoMC/fwWJOUdFdG97F0KJWTv/vf1vXrN+flHq+qmhoW9sXSpT9fu/7dlSsBPN7Hixcl+/WMZNlTUvJHbm5ZRycAIMnP974JE+dGRZpbwY266jmPPlIvkXx49mxeS6sRx6M8PT9esjjaszu9u6+07In9+81PyXn0EX6vbo+81tadhYVXGpuaZTIjjod7eKxKTLw7I33A9WccR2fSZ66eeODXM+bI0S3nHUm4H9tqMeJj7vopVsefOkXvApp6HdavZHHarAQ41Ddur3+OWNIdUtWrNkvarEQoYkPqtLgBJB8HYPDv4WiSNiuRTCEbb9SH1Wux51d88uw3d2fMTbLc0Tk8fKxULwEAQO+/p7/FB7sZlWbxLav31GY3G5Jz3j3vodFokVIhlpexQdvr1UblX5Y/l3df2oT70iboDIaijvbCjrZaiaROJmlXKkRqtUyr1RkMeqMBAEAlk6lkMoNC5TMYfAbDg8ny53KDeYIQviDKwzPOy5tOocCvPraRADCtm3q8thoAkHFjxVSz8X4BDTLpqboaAECyj1/vbwYBXN53i1fcs2+3XKe93tq8dtdWDyYrQujBotE0mL5dqWySy0wDNeaEW3yNMelUqcQatVynlet0cq1WrtOqse4qlIeqK+qkEi6dzqMzuHQ6j8EI5PKgEfSDfPqQm7Eo5dt392ks+xHzLlfre30C8D3YmbPioGB/CT05sclBZQWNUPzahYqfPjl8z9MLSZbFTiE4jl88UfLlm/+KO5022XF4uu/Zxc/e/kPvTPfxf3NEHbKn3lztGyiEmojOHi784eOD7c0SuKGf0O9rhFLINfu2XN635XJErP/kOQkTpsbEjwtxfG6EuFO+5X+n/v3rEtwAAF/InrnYVWOMEARBehvBCfeD2y9DX7ACw1xby3XwPtzzDJNjkbV0hFqheX7lJ3B0SOmMut/r/jzbcQ5usKlcXvFn/RbT4zXBq1YEDqpMhw2pPv6Xb3/Qxl2BL5vz4+KVM/780VSXXG80XGlpnB1q5U4GMs434OsFK3rPnmZQqG/PmNepVh6qrjBFvrx20Ub22YlEatVnVy+YNz+YtfDm+GRCezc6hfLEhCkcGu3tC6dMkf87c3RmaITdm2dnHbIvh+vFZue2dCfcc1ta43x8KJbfdP8tKX3m4MFwD+Ha5GQmlXq5seG906evNTd9s2KFeb93Tp0K9/CYHBJ6rLLquUOHyzo6NoxL3Zyb++KRo3tv654f8P6ZMz9czY709FiXkoID/HRN7f27d784c+a9EzJuvEy341VVrx47PjUs7I70NJFKfbq2JoDbM914enjYn+vWitTqLy9eKu/sJDyvxw9Xs8/U1k4PC5sfHYUZjEcqK987fVqp0z2RNQXe1QUWbJxGTLiXX6+tL2/pa6CoScnVqqaqNmJkwcapxE3nolgmywYgMikYDvWNwYJ7RGys7VFVYNFl6+ErcKQgj1lQVE8Hj0sN/j0cTbwDPaatyDjzz1VzRNwufenmz8ZNj1/35OL02YkOjllzUO8uHBMK1eKTU+htPacMdWUZMDgH5GZDcs675z2ECrt3tUiIm33pbBYTN0lkkmBwFSeGOTqFkuYfkHajzgniFKm+fleaG02LBhELuJuk+QfsrSg1tUIF3M0mBgbvXnvrs8cP5bS2AADEGrW4tWc0hpkfx8rJed/+3blt1sfefn+953PSZMeaW6Dh84N8+pBjsenTFyQf3WPREViS3yAVwZPb5i4fT7X8zBmY9ffNfPPxP+EoADt/OVtW2HjrA7PHT47sfRlqaxLnXKza/eeF2nKLL2AsNn3cpKhLJ0uIwVEgKT1s+YZJVjOeORer7l322exl42csTI5LCebyWQAAHMeVck1TXVf2ufKLJ0oqi5uJT0mZGFFZ3Ky2tvqlXcP594XjuEalUyo0SrlWqdCozA/kGqVC01hr5b5Dq9H/74P9HC6TzWVyuAw2l8nmMTgcJpvH5HAYbB6TNbjlQHVaTKXUKuUa84+hlPf8VFIx/GcFANiz+eL1C5WmH4bDY7I5DA6PyeYyOFwmm8tgcxiOTGjoS015a01565bvTnJ4zJSM8PBY//AYv/BoPy8/PpvLIKbgpSJlS4Oosrj52oWK7HMVfX35v/2xeQymleJ1CIIgLjJSb+MrCht//eQgFIwbFwpFhhUyhZySFdv7om6XAeseyjdMqA3q90s/qlXWwQ32TPGevLVhuwE3AADOdpx3XcIdAGAj227iw+Ysjoz5u7zYtFklFjmScH920rTeqWezl7NmHa2pNOA4AKCkq6Ogoy3Fx/rNlRP9XpirNXR/q5gaHGo12252z7gJeytL89pbAQAdKuXOssJbE+3UE3DWIWNGQ1pgQF5rdxn33JaW9MAAzNhzbovV6peOHp0YHPzHzWsoN359Tx84uKek5Hhl1bzoKFOERqF8vnSJzmDI+Pqb/WVlp+69J0QgkGu12/ILNBjGpFKvNzf/cDV7UnDwz2tWM6lUAIBqmv7OXbs+PHNmenhYnLfFjIeXjx77afWqySEhpk0cAOKhCphMU9OOgsK+Eu5vzJ3DptFZN1Kij06ZPPvHn7YXFron4R4/ITI0LrC+rOfO5PiWC3e9Zqua07EtFsPbTa9AjAw3wTb7DwYD6ngIivIlbtoVFGn9VEdc7YF31+ecKpZb3vjlnS3NO1saHOO/9K6Zc9dN4TspbcrkwF04VtFHyP3bkJzz7nkPo8eFETe7WiUttR0B4RZl4nsrutjdYWwSnhA0mNQAMjYlE9Lo6dZGuJsfQwXciSI9PP+++dbzDXWHqiqutDS1KxVyrZZBpXqz2JEenhMCguZFRMX1mrKJAAAWrEqHEu45F6t6p9vmD7qejEnW3MS4lODeg6YBAAVXa168WsPlMaMTA4VeXAaLrpJrZBJVS6PI6mBtCoX80mcb+EK2sxK4w8q9zywqzW8sL7TyRum02OFd2Yd3ZQMAWGw6jU5VyjWGGxPXIL4Bwlf/u/HNxzcXZNfCbQ4Yhr+vHz8+dOZwgUquUSq1uOXcLLswveGf33tGWfVGIpNMmfcpsxMe+j+HbrQLsms/e+VvU27dwclhROd7rU4MYbLoHB6Tw2V8v/dJuM1hSrnm0qnSS6csFmZgsugMFk2nxbQavXniow2TZ8UvXZ8JR8cGg8FowIxOqYyPIEi/jLy/Oo1ad3Dr5d8+O6RVwxOBkyeEQ5Fhhe/BGUC2HQBAoZKZbIZGNZCOfacz4savK78bQLYdAMCjcqO5UWXycgBAu7a9Sd0cxILvTNwp2cffnHCXaO0vBOfBZGUF2erUCeYJMgNDLjZ1DyE8XV/TV/bZifZU9nztuz05jdBiBQmATUnj89oPmTZ3lNpJuDvxkHEcpAcE/nr9OgDAiOMFbW1rU5KzG5vMO+wrK1Pp9Xelp5mz7QCA5fFxe0pKTtZUmxPuKf5+AAA6hRIiEMi02hCBAAAQyOPjAEg1GiaXu6OwEADweNYUU7YdAMCm0R6dPPmuXX9vzS94bc7s7pcGAACwKCbGnG0Hltl2B3mxLQZvcun0eB+fi/X1Rhx3Q1UZAMCCjVN/fHWHefPYtkt3vrK6r0myei12+p8rxMiCWwc+vB3TYfXlLdWFDQ1lLZJOuUykkImUaoVGq9Hp1HqtRqfX6HtXbOiv3kWWnUUhVRE3vQI8iJt2OSWl6573cJTx8he+s/Op1zZ8IW6XQU2NFa3/+79tP722c9KicQs3TZswN3mQ+VMHF2N3cLchNyTnvINvjoO79SUsPjAg3KeFsIju3h9P3v/2OsIuMANmPPj7GWJk0kJbF0QEseqm2ISbYvssfZbmH1Dz6DNwtA9TQ8Kmhlh0Hdn1z9pb4VB/DPLpw0HyhPCAYM+WRpE50nsodFRCYKTlaiiD8dKnGx5f/42k1yB6E4Vck3u5Go72QqVRnv9g3YRpsbgR5/KYCrn925CRhc6kvf7Vpmdv/6HZcsU1iFqlU/exMgcAgO/Bfuu7O3gCVlRC4MAS7mD4/b46WiVWE/pOgRtxhVyjkGvaHZvmBQBQKTW2f0eDpFHrNGpdVzscHzzTK8PRPqRMjHjxk1sGlooZBX7/79HtP5w6WPIe3IAgiIsN5Pbm8I4rTdZmOfVl/5aLl092pzUHzGjElXJNS11nWV6D1c/WwDCvpAkRcHQ4GdidqgmHzxomCfcT7acKpIXmTSaFMcVrcrIgOYQVxKZyHr3+BGFfKxL5CaaEOwCgWFYytAl34jKk2hs1K21I9vGzMdbbZGpQqDn7XNBhMZbQFbrUqhpJ94x4Cok0M8T+n8C88O7MNQCgoKNNpdezaX2OK3TuIacFBnx4Vtkil8u1WqVOlxYQQEy4F7S2AQAe3PNvzxNu6FT2JIkEN0rJs2g0c0UaOpUCANAbjQCAovZ2AACxnjsAIMXPDwBQcGN8vRm02wBoMGx7QeGpmpoasVim0aj0etPMcRzHgb23zinmrp/yy5u7zPNgulrEOadL0mcnWu7V7dKhPGJNczqTPnNNv8d6qOTq8/tyzu3Jvn6qWK+1/4czSCxuv8twOUgls7hfcnAcrhmT3b/9idz8Ho4+senh35x9/Zvn/zq7OxtuAwDTG87vvX5+73WfIM9l985eetfMAXfbOJivd3C3ITck57yDb46Du9mw7J7ZP7yy3by5+7tj6bMTJ8ztc9bX9y9ta67uyQHQGbQld84gtCMIMgKQSKR5K9P++Oo43ECwYJVzhreb+AYKX//qtpcf/E1xY9X6/uLymC9+ckvG1BgAAIlMSs2MvHB8sHfKw5CnD++TP+57+cHfq0p6JmI6zjdA+MY3t4VF+wIAohIG3l+Cfl9jHIlEWrx24sP/t4xKc0JRqRFKqRh4FxGCIIMxkIT7qX25uRcq4WjfTv6bA4dcYMXtU4dzp+Vv19+jDWIWD4fP6mqVwFG30xq1/zbvNW8m8hMeiLpPSBMQdrEjihtpflyrrO1pGAr9HYAcIbA/GDDao2chgQqxC8cLmOR39GSQI4Se5jHdNngwWf4cbqtSAQDAjMbCzrbMgGB4pxuce8gpfv4UMjmvtVWm0XqwWGFCIbFVptUCAO7JyPBks4hxAABxT2KxIDLJSoJGodVRyWQunU4MClksMolk+ieIPHr9W/0i02rXbdla0dU1NyryrvT0AB6XS6d/cOZsQZutjgfn8vDlT5yfeulgrjlybMuFvhLux7daTESdtjydw+/HO6DXYnt/PLH10wMykQJucxk6o88OoUFSyS1uvZj9XCyRQiVTaZT+Tr8dkvdwVPLw5b/0y4NFD1T89s7u/HNlcDMAAICOJtEvb+za+sn+lQ/OW/fEogF03vTzKjHcDck577b3cPm9s/b9fLKlpnuQu9FgfO2WL25+bNHKB+dBFd6rCxt+f2f3pUN5xOCaRxf4hgz3pYAQBOlt/k3pm78+0XuJThMqjTJ7qZMnr8SPC/lm16PvPL3Faq0S25Izwv/z/lriqqHjJ0eN1gSuhzfv878e+PGTQ3u3XHak6IfZlDkJT76xSuDJMW1GJwxqhBb6fY0gTBbtpo1TDu7K7muN9H6JTQ5++KVl8ak9s5nHJtUg5mQgCDIY9tNzI0JUYtCSWybD0eHEL3RQd3HPfXu3ehj0TOZJ8qX67in8wezgp2Ifp5P7d7sewOwZodCigYcbO51Uq7nY1FAq6qgUi7rUKqlWI9dptRimNRi0BsyRUe1Ewhtjq23wYXd/NQQASB0oUzNIInVP9sTf2mpaVvlxeKaEOwCgS90z3rk35x4yi0ZN8PHJbWmRa7XpgfBYFVOKfGFMTEbQoL5V8xgMzGiUa7U8wgwGiVptxHE+IeIUv13Pqejquicj4/9mzTQHqYMep9lfCzZOJSbcz++7rlZoeucWpZ3yq8cKiJEFm6YRN20TtUlfXf9FZV4d3EBApVN5Qg5XwGJyGEw2g8lm6LT6vLOl8H7DUl91eGyg0qj9Sj6O+vfQ/ZImx3y497nS7Op/vj12fu81q78OtUKz5eN9h/84+9int01ZMh5uHsPccM67E51Jf+GH+/+z/CPtjXmQBsy47bMD2z8/GBLj7xfqzWDTVXJ1fVkLtFYqACBradptL94EBREEGRF8A4XjJkXmXqqCGwAAAEyeFc/vY+nmwfANFH6y+f6T+/J2/nK2rtKhehkJ40Nvvmva1HlJUHz85J65p6MPjU596MVli2+e+Oe3Jy4eL8H6WPjaLDkjfP19MydOjyUGQ6N8aXRq79L8jkO/r5GCSqU89H/Lbnts3plDBRePF+ddrRlA5p3NZUydmzR72bi0KVHDeUSm2yhRwh1xNszQqtae1+jydFgFZmgxGDqNuArHdSQSlURikklsKsWPQvGjUcIZtAQGLYFOTySNluRzv4yGY+bwmC/+d+Mgq38OczGWq4ENFWIxmXXBa/qbbQcAeDE8KSSyATcCALp0PfUWne5sQ+13uVcuNzcSl+UcJPPCmDZwaD3viVwHj6d2OilhyDY0ptsGPmFPscbWBdjph5weGJDf0irVapfGWXyTBgCk+vv9U1x8qbFhkAn3cf7+hW1tBW1tWaE91edNQ84HX0AGUtHVBQBYHNtzLAajsUYEp3JcbdLCcUIfnqRDbtrUqnVn91xbsBEuzn5y52XiCsx+od7jpscR2m0Rt8uenPdOO6FGqonQhzdxfmrqtLiwuMCgaL/e4+VLs6ufnP8uFBwm2DymOTEHACA+dpDBYOe+kWhUvofDRPyEyBd/ul/SIT/61/lDm882VVqZYiJqk76x8asNzy6746WVcNuY4eZz3v3iMiLe2v7E23d+K+vqmUGC43h9eUt9eQthRwsLb5v+yEe3Dr6mDYIgQ+X9n+6GQ65HpVLmr0yfd1NaWX5jfnZN0bW6loYuuVQtl6kBDuhMKpfH8gkQBId7x48LGT8pKiDEE34JAAAAoZE+h4regaOO+ejXe+HQoM1ckjpzSSocHZzwGL+XPt0gESmvnC7Nv1pTV9ne1ixWKbS4EWdxGJ7e3JBI38S00Ekz44MjvOEnA0ChkPfmvAFH+2k4/L4AAC9+fMuLH98CR4fOpJnxgzkcF+HymEvWTlyydiKGGWrKWqtLWxpqOlsaRF0dMqlIqVRoNCodhhlxI85g0thcBpvL4AnYoVG+kbH+kXH+cakhg1kgdOn6zP4ur+rhzRvA2/i/PXaK8Vr14l0/wiF7Koub4dDoIlftahU9BkcBCPU7yqDBfWbIYOAAk6v+lir+0OiuwW0AAABwXIfjOiOQYQaLwbVkEpvJmOjv8QWF4kOMj3oD+SRaecc0Dy9e7sUKcefQz4gPCPV6/X93BoVbuTYjTld9owgMk8JMFvRZF9UGEiAxyEyVQQUA0BgGWErPNqVe//TxA4drKuAGAMgkEo/O4NEZTCqVRaXKtNo6mQTeqW+mEuG24aBnQitpIGtw9g+xz76PqbRWGC1+SFucfshpAYHbCwr1BkP67FlQ04r4hE/Onf/52rUV8fGmpVBNOlUqHp3OcKBajsktqSlb8vO/vHgpLSDQ1GGg1mNfXbpEAmBt8kBOWhv8uVwAQLNcnga6B+x/d/WqxGYfhitQqOQ566b8/fURc+Tolgu9E+7Htl4kbs6/NcvxQR9fPPU7lCn28BXc9erqueunUKgjNUvF5rGIq25qei2zZptei/Wr/PqofA+HFaEPb+0Ti9Y+sajgQvn+n0+d3ZNN7GEy2fLxPk8/wfJ7Z0PxMcLN5/yQSJ0W9+25139/Z/eRP8/3VWLCLGZ82Mb/LJ+8eDzcgCAI4hgSiRQ/LiR+XAi4B25CIEJPzoJVGQtWZcANboR+XyMLlUqJSQqKSQqCG8awvmbzIIirqbWX28XP6LBquMEBRlyl1eVTKIMq+zESOZrDIpo0J3HSnEQAQE1py/XzFbkXKgquVmvV/Z7sM0hMFn3Jhsm3PDyHN9DF0JD+kt+oJxPECqRYK5/tCCaFYUq464zOP2eMOH7Pgb8vNTeYI5FCzxXR8ZmBwZFCTz8Ol5hf/LMo76UzRwkBO9R6+z+wirAPz+Eh5wPmwewZDKvUOzpWUaHr+SGFTLjwCJHTDzktMECDYRQSKdXfH2oSspifLFn82N59S3//Y3l8nD+X16VSVYpEVxoaTtx7TzDfogKvDYm+vs9Mm/rR2XMrNv8xMyICx8HpmpoasfjJrKwkP194774ZjMaclhaFTqfQ6loVCgDA/rIyHzaHy6BHeHj4cbkAgJWJCb9ev/768eM1YhGDSr1U35Dd1DQxOOgqYTFYLYblt7YpdFqFTidWq3EAdpeUcOl0Hp0e7eXlxXbOx9fCTdOICffCC+XtDV3EesSNFa3ESiYkEmn+hizzpm0FF8ovHsglRvzDvD/c9x/fYOtjf4jsJryGEDSWXNwuJW7apZCq4FDfRut7ODylZMWmZMXe++baHf89tP/X05jlJPTvX942Zcl470APYnCMcOc5P4QYTLpGpTP/4bA4DCaHIRcrjUacw2dxhezgKP+EzKj02YnxEyItn4ogCIIgCDKs+Yd4zl2RBkf7dnzP9dZGd8/ARkYZqfKvDvELOBj4yBs2cxYAA0whjlwDSbibRcQHRMQHrLlnBqY3FF+vzTlfkXO+oqKoqV+LovQLlUrx9OUlpoenTIqctijVFSX5hhCmNzSUt0hFChKJJPDkBsf4D7fVtBWY0vSAS3W0XHhv5jw7k2wr1TswW0sKzNl2EgCvTJ1zV2p6X4N4iUOzHdFps9y5Sauyu6wHAEBIyIa7iDer50+gSdEzbtG2FsKeXoRX6M3phxwiEHiz2T4cDptmZSXMeVFRuzdt/O7KlRNV1SK1WshkhgqFT0+b6t3PrPSDmZlRnp4/ZGdvzc8nAVKCr88z06YSC784QqbVrt+6jRh5+egx04PHp0x5ImsKACDR1/eHVSs/O3/huytXaGRKRlDQ9g23FLa1ERPujTLZLdssXueZAwdND16bM+f2tPHEpgELiw+MTQ8vv15r2sRx/MSOS7c8vdS8w5nd2ebHAIBxM+L9Qh2dGHRi+yUo8sw3dzuSKQYAKCT2T6GhEhDhU55Ta95stFaHxIbeZaBtGK3v4XDmHejx0Acblt87+717/ldV0NMLq9diu787du+bawn7jhXuPOeHiqhN+szi981Lp2bMTXr6q7u8/IUWOyEIgiAIgoxMUfEBmx6dB0f7Vl3aghLuyGAo1Pvbxc+BfmbPIBzmXDg0Bgwq4W5GpVFSJ0WlToq64+lFVcVNj970X2LrS1/eFpMSTIwMAJlM4vCY7F7LAI4OFXl12z4/mH28SKPqmd9NZ9LSZyWufWxh0qRowr5DiU1hyTEFAEBr7N88dDMjbjQNbwcA8GgDz9r3ZUdpgfnxxqTxd6emExphxALojqgSw8WXe6sQd5kfx3q6fMrMOF9/ColkwHEAQJ1UotLrrSayiURqVbuqu+OESiYnedsqa+6sQ77wwP3mx5cfetD8+O35896eb/F1Ic7b+7MlS4gRMx8Op+qZp82bu27dYH5834QJ902YYN4EAMyPjp4fbesP5/a08baT3R4sFvGf68vMiIiZERHESJy395qknmpxUZ6ejrzO4C3cNM2ccAcAnNh+2UbCvXfBGRvyz5URN8MTg1OyHO29kHQ42g/kflEpoaf/vmre7GqRWF1sti91pT3dKnaN1vdw+AuO8f9g73OPzXqrpbY7AwsAuHKkYGwm3N15zg8Jo8H48s2fm7PtE+Ymv77lseE2dgFBEARBEGTA+B4cOGTTaM2hIe6BGdraxM8MMtsOAJnNnAXHxgDnJNyJIuIC6AyqjlDl08Ob5xc0FuduO2jLpwd+f38PboTPYJ1Gf+lQ3uXD+Wsenn/P62scr7bsOnwa35Rw79L25Fj7pV7VYMS7J0B40J1/VpSLen6wVbGJhBYrykQ9+RdHFHW2281on2/sqdqR4mMrl21C/KUOoHAEj85I9PYt6GgDABhx/ER99bIoO8tgHq3tqfuW5O3LsXk4rjhkxEVmrZn0v//brtN0VxaqL2uuLmyITA4BADRWtNYWN5r35PBZ05bb6ouCdLVIiJuJmf0owlBydfjWGYxK6VlWFwCA43jOqeKsZY6+M1X5PYOm7Rqt7+GIwBWwb3lm6WeP/WqONFW14jg+HK6qbubOc35IHN92sbqw54d8+MNbUbYdQRAEQZBRIy41JDI+AI7axOWjhDsycCLZx0Zjn8O/qJRgNmMKg55CIXuRyTwAyDiuNRplmLEdw5p0WIVOX2Ywipj08RSyQ3O7RxnnJ9zJFHJYrH9FQU9yB7Fh+xeHfnt3NwCARCYlZkZFJYcIvHg4jku7FJX5daXZNTiO7/z6CIVKvuuV1fCT3c6f6d+kbgYAdGg7u3QiL3q//2bypPnmx/E8O6nh/jLiuIpQx9yTZau8iVSrOVlXA0dt0hqwo7WVN8UkwA031Eol11qbzZuzQu3n1Hh0hvmxQq/DjEYqmUxot29tfLIp4Q4A+L0wx3bC3Yjjm4tyzZsr7fVJuOKQERfh8FlTl6Wd3HnZHDm755op4X72X4tlxGeuyaQz7VTbN8N0GHHmDQCA78kjbtpgNBizjxXC0WEjfmIkjUElLgJ56VCe48nHiwdy4FAfRvF7OFJEjwsjbhowo16rd/yvYNRw2zk/VK4S/li4QnZgpC+hEUEQBEEQZGT7fNvDcMiemOTgzJnxcNSVdFg1AN2DLKlkXzLZ0cXYkOHGYBTLVNvhKAAAACrFz0f4Dpe1yG5ldj1WY8SdXCJ1pJxjdt6agYmMD4RDiDVNVW2mbHvKlJifr7z9yb7/PPz+ho3PLdv0n+WPfLDhs4Mv/HTlreTJMQCA7V8eri0e+qnc44Qp5sdH27rrWTtOZ9Qdbzth3kzk95nGHRgyiSRg9PTf1kr7LFWGA/D6uRNyXf9KygAAPrlyTtnHOqI4AO9cOGm8MUo9xccvwcvHchcrqGSy542655jReLWl3z1V6+JTPG/UYb/S3PhnUZ5lu4Uf87LN2XkBg7k+vucX2henHzLiOlChmHN7usvInN97nRhfuHEacdM2Kp0K5SXVCg1x04bj2y+1N9qvSjRUOHxW5oJUYuTUzitdrRJipC+FFyta6zrhaB9G8Xs4UqhkFl/yWBzGGMy2Azee80OFOJVEKVM39bNIPYIgCIIgyCgzd0XaG9/dAUddRo/V17VOq2udYfpPrt4N74GMHArVvzhuJRdEpfiF+B7gspY4klKmUSMYtJ6Ku4M3gs4x++/OAPR3ksuYtfv7EwbMGBDu8/b2JwLCrWQqAyN839nxREC4D27E9/58Cm52u/HCcRRS9+zsI63HyuUVlu12/FLzu1TfPRslgOkfy4uxbHeCdP+ezp6vrl3SGQyExm4yrfaJY/v+KS+GGxxQL5PesW9nc6/lSbUG7KXTR4nVWh7PmEJotyUzsGeFg7cunJJqHc3EmTCp1Len95RBf+Xsse9zr2LG7u4+M73R8MW1i+9dPG2OvJI1y3atGBNXHDLiIuNnJviG9JTRb6hobanpaG/oqszrKfsTGhcYl2FRdN4uL38BcbPsukNTQzqaRD+/vguODjNz100mbuq0+t/e/ocYsQrH8R9f3QFHbRrF7+GIcOVoz/IeAAC/MCsX3DHCbef8kCAuRIwb8eeWfbj7u2N1pc0alXYARdsQBEEQBEGQflFpz8AhZMRSak/BIQAAAN6CN6iUIcv6jqBzzPklZQAAkQlD9taPLDmnSwAAy++ZzWD1OdSOwaIvv2f2969szz1bCre5nYAmmOc353DrUQCAATd8Uv7ZneF3TPGaBO/Xi8ag+aX2t0tdV8yR5YFLSRYFzLthRqNCrxNp1OaIBsM6VEoencGk2j9dNySknqirNj2+1tq8bOcfdySnJfv48eh0pV5fJ5NcbKrfU1Gi0OkAAGvjk3eU9qNWQ7pf4PW25uzWptl//TwvPGpCQJAPi601GCrEXf9WlBJT0kuiYudH2Fqxk2hDQuqh6u6ui+LO9vlbf1kTlxzv5c2kUjUYJtFqOlXKFqViWVTcrFDredIlUbH3jMv4Ke8aAMCI4+9ePP1HUe6CiOgYD28enS7TastFnYdrKok/4c3xyTfHJ/e8RB9cdMiIi5BIpPkbsv78cK85cvVYAZRmWripH8PbTZKnxBAXnCzNri6/XhubHt6zRy/tjaJX138hbpfCDcPMpEXjQ2MD6stbzJEjf56PGR++/N7ZhL1g3z6/pTS7+3PGQaP4PXQnrVr34QM/LrptesacJDLF0REDpdnVe747ToxMWTKeuDmmuO2cHxKzbp5ELKslapN+9+JWQrsFKp3KFbD4nrzI5OCEzKiZqzKFPo7WekIQBEEQBEF6U2lGTDIUsUuj7Z4xT0Sh+PLYS+GoG42gc8x+BnMAIuJQwt0hnc1iAEBEYhDcYCkyORj0WnNvqNwUuPxi12WZXgYA0Bi031V9f7Dl0FTvKYn8RH8mvGCm3qivVtbkSwpOdpxSYj0z+mO40VO8ugfZPX38QI1ULNfp5DqtXKdV9apecqGpfuJv3wIAqGQyj87g0umm/9+bOmFBrwzv/IjoZVFx+6rKTJvlos6Xzhy13KXbnSnpr0+bc76xvvfY7b48NmHy3orSv8uLtQZsf1XZ/hv/CiQzMPjj2YvhaN9mhkYsj47fW9ndodKuUn6b05MvMEvztfVn9UrWbBaV9tW1S6bNBpnUlH+36vbktNemzYGj1rjokBHXWbBx6l8f7TMn2QsulKvlPXMmKFTyHMvxrY6YvHj80S0XiJG37/z27R1PhMZZqR6G6bDj2y7++NpOuVgJtw0/FCr54Y82vnDTx8Tg18/9WVPcePera7jC7mJNZvVlzd+/tD37eD866kyGw3toNBhVCo1Kpha1WiTxjUa8saKVzWexeUwmu2dVicHAcVyj1Krk6paadqiptbZD4MVl85gsLrO/y5Yajfj5vdfP773u5S+ctCh1wtzk8TMT2DwWvN8NcrFy308nt3y8X6ftubJQ6dT5G7IIe40tbjvnh8SkhakLb5t++I+zcIM1mA6TdMglHfL6suZTu6788PL2ueun3PfWut5vAoIgCIIgyDCnVmpzLlbWlLUqZGoOjxke6582JZrDc/OKqUa19hwcQ0Ymg7HTYOyCowBwmHMB6K57MRRG0jnmkoQ7h8/yDfJobxLDDYg1JLJDGQdjryIhQ4JD5Twd+8T7pR9qDFpTpE5VX1dfDwAgjlgvlBY9fP0xYpLdTEgXPhbzMJnUPTjxcktjk9yhlDdmNIo1avGNwe+LIqxXpPls3hIPFuuPwly44QYOjfbC5Jm3JY8HAKT7BTiecBdrNB/NWRzj6f351QtaQ8+ic2ZkEmlT0vgXJs9wpFQL0SdzFvPojL+KbZVft+vZzGlpfgHvXDhdLemz4nMYX/jcpGnLoh1dNcV1h4y4iF+od+q0uLwbE2Lyz5VpVTpza+aCVA/ffq8okrU0LTwhqLakZxmJ9oauR2a+Of2mCemzEwPCfWgMmlKq6myRFF2quHI4X9TWk89d+8Si0qvVBRfKzZHhZvyM+LnrpxzfdpEYPPDL6SN/np8wNzk0LkDozVMrteJ2WeGFcuKbMH5mAk/IPrunz54tIje/h5cO5R3fdlElVyulapVMrZRrVDKVWtn9oQ3RaXT3Zr5sekymkNk8JpvH4vBZbB6LzWNy+Kxb/7M8NLbPDr/m6vbf392tlKlVco1SplbJVCq5RilX40brFTzeuv0b0wMSicTiMnv+OT6TzWPNWTvZkeHnXa2SA7+eOfDrGRKJ5B/mHZ4YFBDuwxGw2Tym0YBrVNr2RlFdSVN5Tq3RAF86b3122RhfS9M95/xQefK/t3v48Ld+uh9usAfTGw5vPpd9rPD9f58NifGHmxEEQRAEQYarvX9d/P2/RxWynjoBAAAWh7Hhwdk33zOjv2NcBkyjyzcYJXAUGZn0WAMcAgAA4NyC7P01ss4xlyTcAQCR8QEo4W6XV4CwqaqtrrR5/HRbCdC6kmYAgE+gB9wwRCI44U/GPP515bdyTEGM46AnvaIz6nTGnjSfmQ/D+8nYxwU0i3LGzkUjU96aPm9T0vhtJQVXWxrrZVKFTkshk71Y7GgPr2nBYTfHJXndWGU03T/QPBzeLolGQyGRHkrLvCkmfnd5ybHaqka5VKRR8xnMQC5vRkj4ypiEWE9v+GkOoFMo786cf0dK2o7SwuzWpnqZVKbVUMlkAYPpwWRGe3gneftMDwmHn9bL3LComSERJ+trjtdW5rS1dKiUMp1WwGD6sNnpfoGzQiPnhEVSyY7WYQCuPGTEdRZummZOuEs75cSmBf1ZLtWMRCY9+cUd/1n2EXGYsF6Lndh+6cT27kkVVi26ffrdr63Z/t9D/UoWu98Tn9/WXN1ecrVnQQIAAKbDLh3MvXQwlxg0C47xf/HH+0/uvOxg8tHN72FNYcPZ3VYmANplNBgVEpVCYtFXunDTNBsJd3G79NSunnJhjsNxXCVXq+RqAHq+LYTFBTqScDfDcbyltoNYrse2ueunrH9qCRwde9xwzrsfpjec2H7p3x9OEFet6K+uVsmLKz/5+vSrAm9UXgZBEARBkBHg548P7vjpDACAxWGERvmy2HS1Sldf1a5Wan/+5FBbk/jR11bCz3GNEVRcG7HLYOyEQwAAAGjUMDjkRiPrHHNVwj0hLawsr970mEofwukGw1pqVmxTVdv+X04vuWMGjW79d6HXYablUtNmJsBtQyeBH/928hvfV/9UJOvH0qPjhKn3R97DpXKJwfOb7iduOkucp/erU21VpDW5OzXj7tQMONoH8xDvQC7/4fRJD6fbL17fL3Ge3i9nzYKj/UQlk+eHR80Pj4IbBsTVh4y4wrQV6V8/x1JaDnAAAAh9eJkLUqGgg+InRL748wMf3PeDRmV9lDSERCLd8szSO15aCQDImJ34yxvDeuVPOpP+7j9Pv3f3/64cyYfbrIlND3/tz0cF3ryYtHC4rW+j+z10j8GMzqHSqeufXLzphRVuG+MznLnnnHenutLmD+77obrQYiSOV4BHSKw/V8CmUC16mo1GXK/F1ApNV6ukpabdgFlMg+hsFv/+7p7HPt1EDCIIgiAIggxDBVdrdvx0hsWmP/zKTbOWjaNSu5NvGGY4tS/vm7f27N96efKcxAnTYy2f5xIqjUNl/ZARwWi0Uq8CAEAmDeWolJF1jllP8g7eugdmr3vAfrpzjFty54xDm8/Vl7e8vvGrp7+40ytACO3Q0ST65LFfGytbKVTyivscKrrtNkK68D/xz5TKyw63Hs2T5BlweNq+GZlETuInLg9cGsdzx6e8K1mvkDCqjcFDHvHoTPrM1RMP/Ar3/c5dPwXKOvXLlCXjvzr1ypfPbDYPn+9LVErIA+/ekjotrnszNVTow5N0WIy1H25YHMYbWx87+NvZP97bLW7vs8wUi8O4+fFF655YTGNQAQDRqaFkCrl30ZK+uPQ9PFdV98TOfVMjw75YuwxuG2aaN0Rq/XsKr7Pqlf67anua+8ZkMz4/+n//fn/i/L7rWrWVSVRWMVj0rKVpm15YERQFLzQylrnnnHeP6sKG/yz/iDgzY8HGqWufWOxIZRitWnf1aMFPr+0kzpM4vPnsvW/ezOK6uewpgiAIgiBI/+z+/TwA4PE3V89aOo4Yp1Ip81am0xnU957ecmDbZTck3HFcrdFdhaPIiIUD63dbZPKQLXc04s4xknltPWRIfPfStt3/Ow4AoNIoqVPjolJCBF5cHAfSTnllQX3BhXLTwKs7X1p5yzCeBa8xaKuUVZWKKpFWpDSo1AYVnczgUjl8Gj+aExXPj2NR+lzUbpj74NKZb3O6qyU8P3n6Q2mjf4j3GDxkpF8q8+rO771edLmyubpdLlbqdRiDSRN48wIifOPSIyYtSk2Y6JwJFkNCr8Uu7M+5ciS/Mq+uvVGkUWnpDJpXgDAiKThjTvLM1RM5fCd8mtl4D73Tg7/HmwAAJx6/J0jYj4L7Hxw98/PFa1QyuejlJ+C2Yeav7LzS1g6xWl3S2tEglk6JCP31tjXwTjZhOqzsek3hpcqmytbWus6OJpFaodGqdFqN3lSGnsNj+Yf7RCYHx6ZFZC5MZXGcsxjsqOSec9519FrsoemvN1a0miOPf3rbkrtmEnaxr71RdF/my8RenFc3P5K1NI2wC4IgCIIgyLBz67R31CrdzquvUShWRlYZDcabJ73JZNL+OvcS3OZsKs3Jps6NUNDX430B53Yo6Fxy1a5W0WNwFIBQv6NDW218pJMpt7WJn4KjQ/rGDtU5NmCuGuGOOOj+N9fqNPoDv53B9Ibrp4qvn4IrtJDIpI3PLhvO2XYAAJPCSOInJvET4QYEQUad6HFh0eOGsnCbS9EY1JmrJ85cPRFucCob72F1p+j7b36Dow6YGhm2/XrB/PhouGH4uXVC9wCcL09f/Oq0rRL2faHSqUmTY5ImW186G+kX95zzrnNi+0Vitj1zQWp/s+0AAN9gz0mLxp35p2fIDPE1EQRBEARBhie5VO0dILCabQcAkClkgSens0UKN7jAyCqujYxEI+4cQwl3N1Fh3cOm2FQ6MU6mkB//ZNPUZem7vj6Sf74M0xvMTXQmbcLc5PVPLIpLjyA8A0EQBEFg06LCrj3/CBxFkNEOWsR10e3TiZuOg+rPSLtsVXBCEARBEAQZDrgCllSkNBqMZGs5d6PBKBUpuQJ3zFZUaUZYMhQZcUbcOYYS7u6gMxrS/n3f9Lhs9auWjQAAkDE7MWN2olatqytrkYsUAACBNy88PpDax0qqCIIgCIIgSGV+HXEzZrz1uSN2QavposV1EQRBEAQZ/uJSgi+fKr1wvHjagmS4DYDzR4vUSu34ya4t+Injeq0+T6svgRuGI4NGl6PSnNbqS3RYlcHQYcSVOI6RSQwymUelBNKokUx6KpsxnU6Lh5/qGkZcqdZeVmsv6vTlekOtwdBpxFU4jpHJbDKJT6OG0KmRTHoGi5FFow7wW25/4bgOM7TqDfVww9AZUedYD5TPdQe5XgOHrGGw6LEDvVFEEARBEAQZa2QiJXGTKxjgOk5t9Z3ETaE3j7iJIMio93tezuunT5geU0ikiseetmwfW45UVT64f8+L02belz4BbhvJRvpxXa9vfnPv8XqRNNbP+62b5sf4ecF7IGPP4nWZl0+VfvbSTgNmmL4wxTzO3WAwnjmQ/+UbuwEAyzdOIT5l8AxGsVZfpNUV6fTFWn2RDqvAcT28EwAAgHbxC+3iF+CoPULuXT7Cd+BoP5FIFms4GYxdEsUvMuWfmKGNGDcx4iqjQYUZ2jS6HLlqFwCATo0UcG8XcG4jkVw1P0CtvSRV/qFQH8RxKwlDo1FuBHLM0KTWXpIq/wIAMOipAs6tfPZ66NAGBDcYRZihFTO0YIZWzNBm6H7QghlaDUYxvDtBfdt8OGRTgNf3XNYyOGrPiDjH7EIJd3dQ6LVwCEEQBEEG7fEd+w6XVJg3Y3y89j1kZdEYlU6f9v5XptYrdY0/XsjOb2qVa7TeXPak8JCHp08K9/KAnwOAwWg8UFx+oLCssKVdolLTqRQvDjvez2d2bOSqcfCiHSfKq7dfL8hvapWqNUIWMy0k8PZJaZlhwdBujhvYz4yMNQwmTa3s+ZYlFytZXCah3SE6rf7SoTxiJCwxiLiJIMiotzQ2LtrTS6xRf3D+TIvcHUWl9pWXHaup+nzhsF6pCxk+cBw8t+Ngs0QGAMhraHn932N/3rce3gkZeybNTpi7Iu34vznvP7P1qzf2hEb7sjkMlVJbV9GmlGsAACtvn5o2ZbCLPBlxhUpzQqsr1uqLtfpCzDAClrohk8yDJ3CJ4tcu2QdGo4y4g206rLpD8rpY/p2P8F0uaxHcPDhafWGH5A219jzcYJNWl9+uy++SfeLN/z8+Zx0AA5yOKZJ/IZJ90lf+eqiMxHPMLpRwdwcF5lDCHdMbGspbpCIFiUQSeHKDY/ypNAq8E4IgCILcMD8h2pPNEqnVVR2iyo4uuNlSrUjyT17xi3sOk0gkfz7XiOOtMsWe/JJjpVXb77kl2sdinFSnUvXotn9zGltMmwwqVa3T12kldSIJnUIhJtwNOP7insN78ksAABw6PUDA61SojpZWHi2tvDdrwnPzBlhT26RfPzMyBnkFehAXOL12omjxHTMI7Q7Z/P6/cnHPSHk6g5Y8JZbQjiDI6OfFYmeFhAIA/nftqnsS7sdqqtoU7viHkNGhU6E0ZdtNCprajDhORgXQEACefvdmvyCPnb+cVcjUxdd7Su2xuYyNj8xbfec0wr4DpNUVt3Q9CEeHNzKZCwAw4so20ZMK9X642TGYobWl624P3kPegpcHnOC2ZOiSfSqWfYkDDG5xjMHQ0SZ+Sq7a5e/1DYXsDTc7wGiUD7dsOxiZ55hdKOHuDnZHuFfk1W37/GD28SKNqmdPOpOWPitx7WMLkyYNtkNyuNEYug+TSRn8XBgEQZCxa3ly/PLkeADAjpzCl/cehZst6Q2GF/ccXpYS/8KCmd4cNgDgekPzY9v3dipV/z114cu1y817GnH8kW3/5ja2cOj0J2dnLU6K9eFyDEZjo0R2urImIySw50UB+Or0xT35JVwG/d0VC+bFR1NIJIPReLC44pV9R3+8kB0o4G+cOI64f784/jMjY1PqtDhiwv3PD/dOXZ7O9+QSdrEFN+JbP92//fODxOCsmzNZHPT9BEEQFzLg+IWGuigPT7gBQfoApdbJJBLJOek/xB20GNYmUwAAvLkcNp0GNw8OmUK+7fH5N90+9drZ8rrKNrVSy+YxI2L9M6bFcnj9nvY3WpDJJDaOa5o7b1NrL8GN/SSWf4vjOh/hW3BDPxmN8lbRQ0pNd/mywVBpz9W3LQjy3kKnxcFtyLCBEu7uYHuE+5ZPD/z+/h7ciENxnUZ/6VDe5cP5ax6ef8/ra0bN+l0Yjj1w7WHT498yf7JsRBAEQVwoKdDvw5WLzOOh0kMCH5ox6a2DJy9WNxB3O1xSkdvYQiaRftq4Ku1Gep1CJod5Cm/PTCPuKVFrfr5wDQDw5rJ5CxNizHsuS47TGwwv7Dn8+ckLK8clcOh04rP6xcGfGRmb5q6fcuCX0+bNzmbxUwvee/KLO1Ky7AxRx3TYhf05O744VJHbMxYMAMBkMza9cBMxgiAIYpLX1rqzuPBKU2OTXGbE8XChx+r4xLvTMsxXqB+uZ7937vS1+x/eVlSwtTC/RaEI4vFvTU69J32C+Ubuz4K8ncWFZV2dGgzrVKkiv/jkRguoePQpCrm7/jIAYE9ZyR/5uaWdHQCAJB+/+zMmzI3oWfnQkX/LQTgAv+Re+zM/r1Eu8+dw1yYlJ3j7QPvYPvYOlXLSj99tu3n95vy8Y9VV00LDvli89Oeca99mXwng8T6ZvzjZ18+R1zEx4vi2ooK/CvJqpRKlTmeOAwCqH3/G/PhKU+M32ZdzWlq0Bixc6HFzQtJdaRkUwus4clwjiBeHE+whaBRLTZuZEcGjJT0wJhwoKPu/v48AAD64edGKcQlwszPwhezZy8fD0bGKTOYCQGoVPTb4bLuJRPETg5bM5wy8jpMRVzR1rtfocuGGgcIMrY0dq4N8djJoLjmjkMEb2Qn36pLmqpJm8+b81cN08RN53yPct39x6Ld3dwMASGRSYmZUVHKIwIuH47i0S1GZX1eaXYPj+M6vj1Co5LteWQ0/eWRSYSo4NIw9P3nG85P7PTl9RBvFhzz7wx9MIwucZdm4+A/XLoajCDKM3ZyWDM0+TgrwAwDItVothjGo3d8KjpRUAgCmR4ebs+19OVtZq8EwPpO5KBHOby5PiX/r4EmZRnOhun5+/MCnajn4MyNjU9Kk6FlrMk/tumKONFW1Pbf0w6jU0AlzksISg3wCPRhsBgBAq9ZpVNqORnFrXUdVfn3hxQqt2iKPAwAgkUhPfXmnbzAac+o0d/+y61JVPRwleGf1glXpSXAU6QP6JmOVFsN2XSs6WlRR0dYp02hZNFqop3BqTNhtU9K8uANcSNmq769dPVNfOz00bF5kNGY0HKmufPfcaaVe98SkLOJuD+3/t14qnR8ZRadQjlZXvXvudKdK9cK07m/XUR6etySnYkbjKyePRQg97s+YaH4imZBtf//cme+vX4308FyflILj4FRdzX17d//ftJn3Wq72afvfctDHF859m3052tPzgfSJYo3697wcHzYH2seRY3/7zKlwocfk4JCj1ZXPHT1U2tlxa/K4P/JzXzx+ZO+G2xx/nffPn/nxevZNcQkPTZgk1qj/d+1Ko0z2f9NmzgyPMO/zb1nJ00cOhgs91iYlM6nUy42N7547fa2l+ZulK8zfGBw5rhGERAIf3rzojb3H60XStJDAN2+aB++BDGPnKy1690ccEolCJvPhKBFuNOJWLk8kEpNE6vewm8GvU0omcaXKP61WkqFS/FiMaQxaAo0aQiJxAK43GMV6Q4Nae16jy7FRa6VD+hqHOYdCGUi/HY7rmztvt5Ftp5A9WIwpTHo6hexFIXsAEslgEBmMXRrdNZX2gtHY3dMGMRjFzZ23hfoeoFB84ba+kUlMO79NAAAAOK6zupormcQBpH7UviYBh06AEXeOOWJk36ae2HN9109nzJvDNuHeV0mZpqo2U7Y9ZUrM01/eGRAO/+k217R/+thvhZcqtn95ePaaSeGjYgkvtcHKHy2CIAjiBnG+3lCEe2PsuYEw0aqivRMAAJWOsaqiowsAEO3jSRxTZkIlk6N8PPObWsvaOgeTcHfwZ0bGrEc+2thU1QYNVK/Kr6/Kt5Xn7Y3OoD355R0zV/ckvxAEAQDgAC+QXi+S5sj10kyv6eOFmQAAvVEvxyQ8qoBG7vddrnO1SOQP/P5PZXvPKiZyg7aoua2ouW3L5bwvN67IjBj48t2QN2fPZdNoLGp3OYjHMqfM+u3HbUWFUMK9WS47cOvtQibTtM9N2zb/mJN9a8q4UIEAADA5OGRycIjWgL1y8pgvh7M+KYX4XJPrLc3fX786KSj4l5vWMKlUAMCz+ml37N71wfkz08PC47x6Lou2/y1HNMll31+7EuXhueeWTaZDezRz8ootm6HdHDl2GoXy30VLdQZD+vdf7ysvO33nvSF8gUyn3VaYr8Ew04HYfR2tAfsjLzfZ1++zG8vJxnl5r9u5tU2piPHsXrhFrFb/34mjmUHBf6y82Twn4KnDB/aUlRyrrpwfGQ0cPq6RJS00cPcj3V0XyAiC4+BS1ciel8mkZ0QFlsJRAh1WWddqpavPR/i6gHM7HHU9zNDcLn4OCrIYkzx5T7KZ0wHo6d0keA4ztIrlX0oUvwNggBsBMBplIvlXPsI34AYHdEhf62usPZOe4cl/ksOc03eNeKNctU8k+1iHVcItAGCG5hbRQ8E+O/t+OsyT/4wnv2e2UF9kym1t4qfgKADBvrsZNOcPlRhx55gjRnbC3bTs8mD8VHERDrnA5Y5aOAQAAGD39ycMmDEg3Oft7U8wWFa+rQZG+L6z44kHp7/RUtux9+dTj328Ed5jBFIb1HAIQRAEcQsuw8q1pje5VgsAELDsl31UanUAAE4fL2uqJCPTWO91dpCDPzMyZvE8OB/ufe6jB3+6sD8HbnNYSlbsIx9vDE8YDSMbEMSJjLjx55r/5kmyTZsRnO7SYRqD6o2ip5cFrJ3vv6Jnb7cz4vgTW/YSs+1Eco32ib/2/vv47T4854xr9mJZjJfn0unx3j4XG+qhtStXxiWaMuAAAD6DcWvyuPfOnT5aXXlPWoZ5H9u2FxcCAB6flGVKUgMA2DTaY5mT79yza2th/msz55j3HPy/dbS60oDjG1PHmZPgfhzuqvjE769fJe7myLGn+voDAOgUiinPHsIXAAACeTwcAIlG48/lAgdep02h1BqwRJ+e0ZqmOjD10p4BnvsqylR6/Z3j0okVeFbExe8pKzlZW2NKuDt4XAjiBmWtHV1KV83y3/zVsZYG0YqNU+JSQ+A25AYSie4jfFvA2QQ3WKJS/H2E77CZs1u7HjLiSrgZAJnyLy/B82RS/+ZOKdWHpYpf4SgAJBLNR/iugGM3y0fmsVfw2EvbJa9YfR219qJE8auQexfcgAy1kZ1wVykGdQ8PAPiwwM4Scy6Vc7oEALD8ntlWs+0mDBZ9+T2zv39le+5ZW709IwhKuCMIggwVB9fXYtPpAACFFi640RuPyQA30u69mUqv8ph9XuMc4eDPjIxlLC7z1c2PXD9Z/NdHe4suVeK4o1MfWBzG5MXjl9w5I2UqWnIKQaw41X4oT5I9wXPqBI8p31V9bI7zaIJobkKBNGdoE+6ny6oLm9rgKIFUrfnzUu6T86fCDQOiwbDtRQWnamuqJWKZVqPS63UGAwAAx3HiipaRlkuhxnp5AwAqRdZ7Bawq7mgHAKTcqHtuYtrMb2slBgf/b1WJRACABO+eBDe48TpEjhy7gNm93DSLRjOnwhkUKgAAMxpNm3Zfx5vNppLJdRKxaX8AQK1UAgDw5fT0mhS0tQIAHty/xxwx61R158gcPC4EcYPzVRaT8Jzr3OHCusq2mUtS4QbkBhKJHui9mc2YBjf0gcOc5+/5VXOXlfy1EVcq1Yd57FVwQ9+MuKpd8hIcBYBEYgZ5b2UxMuGGPlF8he9SSHyR/Au4BQCR7CM+e42dkiyI243shLtSPrJTt53NYgBAhL1CMZHJwQCArhYJ3DAyoYQ7giDIMBfl7VndKcppbIYbeonz8wYAVHZ0GYxG4kAzAABmNFZ1iAAAsb1qwiCIK6TPTkyfndjVKrl8MK+qoKG2pKmjSaRWaNQKjcFgpNIoLA6T58Hx9BP4h/tEJAbFZUTEZURSaf0oQ4kgY80l0elIbuwd4Q/DDQD4MwNzJFfgqHudKKmGQ72cLK1ySsJdptWu3bmloqtrbkTU3ePT/bk8HoP+/rkzBe1wxp9OsfhU8WSxAABKvfWeaavkOi2VTDbXTzMRslhkEkmmtRhwNvh/S6HTAQA4tO5h4CYcusWmg8dO/BoALb5i4sjrsGm0W5JTN+fnvn3m1JyISIlG88WVi0wqdVPq+J7X0WkBAPekZUDj5QEAYUKh6YEjx4Ug7nGhsn817vqlvVkMAEiZGAk3IDf4eXzseLbdhMNayGOvlqv+hhsAUGpO9ivhLpF/hxms3FL5erzfn2x7Ny/BcyrteY3uGhQ3GCUSxY+e/KehODK0RnbCffAj3IcDEtnK15HejDfGBYx0KOGOIAgyzM2NizpaWnmyvKaopT0pwGJ0GGRaVBiXQZdptAeKypenxBOb9haUKnU6Dp2eFRlKjCOIS3n5C5fcNROOIggyIB2atjl+S+AoAAAALpWvwhRw1L3KWjvgUC9V7aLeXcID8Gve9YqurnvSMl6aPsscpFnmu01Ulvlu02QvDq0fk714dAZmNMp1Wh69e8w4AECiVhtxnM/oiQBn/FtsGg0AIFJb3KCZRp2bOX7stjn4Oq9Mn9WqkP+Se+33/BwPJmucv//nC5cQK9ebuiIWRcdkBPQ5cM2R40IQNxAp1dfrm+CoE5FIdCaNxe7HX/2YwmEt5LFvhqMO8OA9ZDXhrtH1o6fZiCskih/hKABc1lI+ex0cdQjF1+PD+ra5cBgAqXKzB/9x0gjP8Y4yI/uXMfga7kPLK0DYVNVWV9o8frpFkgJSV9IMAPAJ9IAbRia0aCqCIMgwtzwl/pdL18raOu/avOvZudMWJsQIWEwDjnfIldn1TWKV+rbM8aY9eQzGozMnv3/kzGv7j9Mo5PkJMRQSyYDjh4vL3zx4AgDw0PRMnmV2AEEQBBkpaGSa3mh9uLREL+JQeXDUvaRq+6OvjDgu02g92Cy4oZ9MdVoWR8eaIwajsVos6tnjhgrLii4lnR0AgOgbC36aUEhkAEBfK3+P8/MvbG8raGvLCunpsc5vbwMAJFvWmXHk37ItytMTAFDe1TkjLNwcNNVjMXP82G1z8HWuNDeerKn+fNHS5bHW75FTfP3/Lim+1NhoI+HuyHE5i95guFzTmF3bWNLSUdsplqg1Sq2OQaVwGQwfHifO33t8SMDCpBi+A0vjmP2bV/L8zkNwlGBxStyn66x3htn24aEzv5zvHh578rn7/Plcc1ODWLo3t+RSdUNNp1im0eA44DMZQR78pEC/zIjg6THhVtfsqRdJFn72i+nxfTMmPj2/eyix3mA4VFhxrKSypLm9Q6EEAHhzOUFC/qy4iEXJsf6CgXx6GHE8p775bEXt1ZrGdrlSpFThAHhz2L58blZU6Oz4yASbw0R6c/q7geOgQSwpbekobe0oa+0saWlvkcqJOzy/85Dt3+y1Vx5l92cqRnC4d0VRk0qhZXPR9+3eyN4CK+VcHMGgJTFoSVp9ERTXYw1GXEEm9ZwqNsiUOwxGCRwFpMEMRWfQEpj0CRpd99oqZpihVa05x2bOguLIEBrZCXeVwmmp2/+kzL8zehIcdZJfKi59VHgMjgKQmhXbVNW2/5fTS+6YQaNb/13oddjen08BANJmJsBtznaw5TAccoES+SgpRo+MOHdPn9AokopVaolKLVKqxSq1WKnW6DF4PwQZBuZ88RMcAiBQwD/5xD3mzRNlVRdrGxQanVyrrekSAwAaJbL7t+zmMeg8BoPLZNw/dSL/RkHVfqGSyd/dsvLBrbvL2jpf2XfslX3HWDSqFjMYcRwAMC0qzJxwBwDcNTmjWSr//XLOEzv3c+h0Tw5LpFSbBtltyEi9d+pE854AgD35JYXNbTKNVq7VlrV1AgCKWtof2LLb9APzGPQnZ2cNfhwigiDIqOT+bzLhnOgiWe5KfAOZZDEMuVPbfk18MUWQTgwOWxRr5U36y4/DBQC0KHpyZ99duyrRWLkb3VNWcm/6BB82BwCgxvR/FeSRSSTTSp5mVDLZh82pkYh0BgNUFgYAcEty6pbC/C+uXEwLCDCt+anG9F9duUQCYG1iMnFPR/4t2+ZFRL979vSfhXnrklJMw+dlWu3usmLiPo4fu20Ovs75+noDjkcIPaDVaM1WxMV/cvHczznXlsfGhwoE5ninSsVj0E1V4x05rsHLb2z983LuiZKq3sveqHRGlU7fLlcUNbf9fb3orX0n109MeWr+tH7lUl2tQ640pZg1euzjw2e3Xs0zWPYCdSlVXUpVfmPrlit5U6PDfrxjNbG1t+qO7i6NS9X1r+w+1iiWElsbxdJGsfRyTcOnR8/fO33CAzMzGTeWBXbEmfLaT4+eLWvthOINOmmDWHqtrunLExcnR4Y+v3hGvL8PtI8jnPJuvP7vse3ZBXDUleatyqgoarp4onjuijS4bczjMOfQqf34PIQwGRN7J9wBwPVYA4PmUHZOrtoBhwDgMGc7+PS+8DnreifcAQBKzVGUcB9W+vEBNww5cYS7F4NjGmjgCny69d7sJXfOOLT5XH15y+sbv3r6izu9AoTQDh1Nok8e+7WxspVCJa+4bw7U6nRbG7bDITcy4sZOrcyXKYQbEMRJbpti5VuIFsPEN25ZxSqNpPuBWqxSFza2QV8TEWRYOV1Zu/VaPjGi1utPV9SYNzdkpA4s4Q4ACBTwdt576+684kPFFSWt7TKNlsuge3HY44MDVqYmQju/tHDW7JjIzVdzcxtbWqRyIYs5OSJkQ0bq9OhwaM8DRWWnCD8hAECm0RAjj86cjBLuCIIgVrn/m8wC/5u+KH/7q8r3ZvksAgAoMHm1orxCUXyy/aDBaJjvtwJ+gnsJ2cwGe0OWqRQyj2n9XsxMa8Dy21oVOp1CpxOr1TgAu0tLuHQ6l06P8fIyFQpfGZ/4a+71104drxaLmVTqxcb67OamiYHBV5sboVfzZnOW/fXHgqhoDybrUFV5lVj0QMZEYl7YZHls/M+51zbs2jYjLMJgNIrUqrfnzDc1Jfn4Pjtl2ocXzi7fsnlWWAQO8FO1NTUS8ZOTs6AR7g7+WzaECgR3jU//KefaTds2z4+M1hsMR6orwwTCemnPmeP4sdvm4OusTUreWpS/Yutm0yadQgnmCzYkp96dlmHKvnswWZ8uWPLowb1Lt/y+PDben8vtUqkqRaIrTQ0n77g3mM8Hjh3XIL138PTvF67D0T7oDYbNl3IvVtX/ed96gQND3a32NDhdu0wBgvzEKvX9v/9je/1hAMD0mHA41Itp8Z5d14te23MUylYT6Q2Gb09dvlTd8OMdqx3pgTAYja//e3zntUK4oZdL1fVrvvnz+cUzb7f2aWmbU94Ng8PLtjvL8g2Tcy5U/PDB/qj4gPBYf7h5bONzBlJMxoxJS7X6eWEwtAMHMuZ6rF6jy4WjAHBYi+BQPzHpGXAIAACASnseDiFDagQn3HEjrlHBPckD5kEf7DRDG3hU69fUmHFhN90/Z/f/jl87WXxH+oupU+OiUkIEXlwcB9JOeWVBfcGFcgNmBADc9vyK0NgA+PmjS4ms4aHsr6K4AVneifP8xkdw0dUCcQcGleov4Fmd1fjpkXM/nrkKRxHElSK9PctefQqO9uGNpXPfWGqlhF9vbDqtr5eN8fXqq4lOoaxLT1mXngI3WJMVGepIrfb/bVgJh/owsJ8ZQRBkrHHpN5lobvzt4Q9vrf/pB/lnAIAT7QdOtB8AADAprLsjHw9khcBPcK94f5+CxlY4aiklyN9u6rJRJlu/cxsx8vSRA6YHr8+cc/u4NABAko/vDytWfXbx/HfZV2gUckZA0I61Gwra23onnZ+clFXa1bG9qKBNqQzk8V6aPuvuNCvJkWezptGplAMVZd9kX2ZTaXHe3sTWBydkRnp4/nA9e0thPokEErx9n82aRizGYuLgv2Xb/02f5cvh/lWY91tejj+He1vq+FuTx43/31fmHRw/dtsceZ16qeSRA3s9WexbklP5dAYAQKHXXWpseOfsKQqZdOe47kkV8yKj9tyy6dvsKydqqkRqtZDJDBUIn5kyzZvds4yq3eMapJmx4b0T7n58boCAx2cxdRjWLJHXiyTE1qoO0bPbD/xgbWQ0ZFlq/LyE6Bsdad09aj+dy26TKeBdB6FDodTosQf/2E3ML5NJJB6TQadSpGqNDuupej8rLtL8uC8NIsmZ8ppXdx81zYkEAIR4CPwFPBad2qVQl7d16gll9HPqm+///Z/f7r7Z9kgLzGB85K89Z8priUEKmRzt6+nF4RhxY4dCVdMhMv+LRhx/78Cpdrni2QXTiU+xyynvxvyE6CAhnxhR6fQ/nu35HF6YFBNncwB+7ykvtsmlqlsfnvvFq38/tuarSbPjoxODmNbqua+83QlrR480FDZjFhzrDwrF4mPZzIhblAnqi0p7Gg4BAADgMB26fbOBQYslkVg4Di+OqNNXGnEVmdTzMYgMrRGccFcptbjz+g89GC48Kbl9L1xz/5trdRr9gd/OYHrD9VPF10/B09xIZNLGZ5fd8tRACrSNLFe6ygAAVYqWKkVLIMsTJdwRBEEQBEEQZGhN8MyK56dcF1+qV1WrDSommRXKiZjgMZVDdaiCrUvNTYzaYa96w/Lx8XColygPz+rHn4GjvcwKi5gVFkGMxHl535yQRIwAADCj8dGJkx+dOBmKQ5hU6n+ypv8nq8+c4IKo6AVR0XDUkoP/lm0kAO5Ln3Bf+gRiEHpDbB+7D5tD3P/vdbeaH0OvbPt1AAAvHj/aoVSevvNe06qnJgajcdJP3x2sqDAn3AEAcV7eny+0dY/syHENRlZUWHyAT2lLB4/JmBMfNSc+ckJ4sCfHYhhfs0T2v9NXiDVGzlXWXa1tnBgeTNjLOiaNGiDgBRD60vbkljg34d4uU7y9/2R+YysAgMug35I5bk58ZGqwvykDbsTxBpH0UnX9seLKFqk8zEsIPb03gxF/9K+9RhynkMkbJ4+/Myud+PPLNdqd1wq/OH7BXAjrWl3Tbxdy7p5mq5fo06PniNl2Ly778blZi5NjeYRJnCKlem9eydcnL8k1WlPkp7PZMb5eN42HJ2Xa4JR3Y2ZcxMw4izO8U6EkJtznJEStGGd/cLTj1me9bX58/mjR+aO9S6AAMCYT7gxaPJls0fnRX2Sy9dlCON59mtmm0pyDQwBQKQFUyuCH0lJo1GCdvgIOA6NeX8mgp8JhZIiM4IS7E+vJAAA86C5NuFsf4Q4AIFPIj3+yaeqy9F1fH8k/X4bpe3pN6UzahLnJ659YFJdu8ZE9WuVKqk0PKCTyLF/0GYEgCIIgCIIgQ49L5c3w6a52MqxMiwkfFxKQ19ACN9yQFOi3Ot2i6Lkb4MBpY8Lscue/5R45rc2TgoKJ2XYAAIVMppEpcp1DSS53embB9HaZYklKHJNmPa8SKOS/cdO8EE/BJ0d6Um8H8sscSbi7wT85xa1SOQBgcmTop+uXQGsLk0mkMC9hmJdw/cRUx9eK0BsMFDLpiw3L5sRHQU08JuOuqRkZYUF3/LzD/IJfnriwYny8N5djuW+3S9UNv17oXtQUABDr5/3r3Tf3XgPZk8O6Iyt9YVLM7T/taLhRR+uNvSfSQgNDPYUWu/bNFe+GG8SlDvFMo2GLQXdokq4NfQ0Vx3GHTgCt3kp/MI1qfW5Ef5FJ1vsS9IZmBkDJtOHC+oXBKqPBaMRxKrV/M1xcx4krpgIXJ9x5VDsldDNmJ2bMTtSqdXVlLXKRAgAg8OaFxwdS+1hJ1dVuCVm3wN9V36oPtR7e3rATjgLQrum+NMbzQzh9FOFBEARBEARBEAQBAJBJpM83LLv/t78r2rrgNgDSwwL/u2E5fdjcvSKOEDCYVWKR1oCZ1j412V9R1qZUzIlwTqLKiaZFh8Eha+6eNuGfnGLzgqJX65os24eMKb+cGRH84x2rbNd16atHwaqNk8b3zrabpQb7P7tw+tv7Tpo2NXpsT07JPdMtJiKYfXPykrmoAYdB//72Vb2z7Wb+At73t69a8dUfpsI1ap3+21OX31u9EN6vDy56N1zt820PwyEEAAAA3Ump7YEx4io9VgdHAaBTw+HQgJDJVurIAQAMxnY4hAwdhz4pjuy8uvOH0y31XRhmCIvx2/jY/OmLbfWZbPnmOBxygc6W7vzsYNwdMwUAQCaRuDQ7OfHB4PU9wp2IwaLHjnfomu1qfBrPdUvIcqjWu69FOrnpQRR38FNsEARBEARBEARxgk5te740u03TrDGomRSWHzMwVTDBm+EL7zcU/Pjc7Q/duuta0dGiivLWTtMS34mBvivTEpekxlPI9sq3I8PM3WkZ7507vXrbX0tj4vgMhkijzm5uOl9f58/lPZY5qMo5Q4hMIs1PjP7f6SumTVNid5hg0qgfrV1sO7/cLyQSuGua9ey52foJqT+cuWouj/NPTpHVhHtJS/vV2kbz5r3TJ/jx7VSyCvf2uG3K+J/PdQ+K35df+sTcLKtLXFjl9HcDGUJUShAcciM9VgeszUCSKv+UKv+Eo85jNMKF3ZEhZD/hfvyfa5+9uMO8WVfR9u7jm9//44Fxk/vstPz9s8NwaLh6PsVV47iJXJrNdwWuK2sysinWO6WxGxNzBDTrGXkEQRAEQRAEQdwGB/iepq0n2vZDpUt2N/4112/piqBbSGDoM9oMKvXWSeNunTQObkBGoPvSJ3ix2H8V5n2TfVmDYRwaPVwofCxzyp3j04VMhwaxDU9RPl7mx0qtDjMYqZRhkdVdMS7Bl+fMe/+UIH9/e2lxKoU8NyHqr8t5ps2qDlGnQtm7qszR4krzYzKJtCoNXi/BqjXpyeaEO2YwHimquD2rp/S/bU5/N5AhRCF7wiE3wgx91jpzKRwMu9JbY5n9hPvu33rKjZn9+eVRGwl3BMKm0l9PWwpHhzEezdFO4AFg9ZFwF9A4nVoZAEBj0MFtCIIgCIIgCIK418m2g8fb9vkw/KZ6zw1gBXOpPK1B26SuO9d5/FjbPh5NMMfX1qqVY03vJTpdx53/lputTkhcndCPtS5HBC6DTtzUGQzDJOE+LzEaDg1OUqAfHLJmSmSoOeEOAChubp8RCy9cl13bU3snPsDH7vB2k0gfz1BPYb1IYtq8WtfkeMLd6e8GMoTIZIdOGBcxGDrgkHvgRjiCDB37Cfem2k44BEBVcTMcQvpGAmBDRJ9Lb2vVuvP7cypy66RdCgPWs2hqby/+cB8ccg2eK0e495VwD+f4mxLunToZ3IYgCIIgCIIgiHud6zzuzfB7Lv5tFqVnvasYXkKW95yPSl8+13EMJdwRxBGkoZ8KYt34ECdXc43w9oBD1kT4WIw+Lmvt7J1wL2hqNT+O8/MhtNgR6+9tTrjn1Pcjc+X0dwMZQiRgsfaymxnx7opJyFhmP+HOYjPUSnhWAoM1lOfuaHLtZPEHD/4o63Lor9FtCXeXlpTpK+E+xTs+W1QOACiQ1MBtCIIgCIIgCIK4l0jXOdNnATHbbkIn08cJJx5r2wfFEWRsMuJ4cXN7WVtnRVtnm0whUWkkarVap9fqMS1m0GCYVt9dPXVYYdKoPKaTi98K2A5V/gm0rKsuVWuImwAAhVanIbxpwR58QqMdoZ4C82ORUmUw4o4s5+CKd8MNfv7kUECI5+J1mXADAAAATG/Y88eFkCifzJnxcNuoRxrKFbNxHE6iImOQ/YR7THLQ5ZPwiOOYpGAoggxAU1Xbm7d/o1UPlwoqi/0XAgBIJFJfOXGn6KuG++KACT9XH1Fimk6t7FJX6WSvsXdJQBAEQRAEQZBhw4PuieF6OAoAAEBlUAhoDg1lRZBRrLK967cL10+WVncpVXDbsMdlOD+/zHPsNVl0zFxGSgABAABJREFUGplEMuLdi0PINXB2EkrBQzV5bCMeF44DqVrjybGegiByxbvhBjt+PJ0yMaKvhDuVRvntv0ci4vzHYsJ9SOFgOPaxIW5mP+F+57OL8y9XqVU9SWEWh3HXc4sJuyADtOubo6Zs+9Rl6eseXxgSE8DmOdQh7CK3hK6DQy7QVzafS2U9Fbfq7aItAIBvKvaNE0awKCPymocgCIIgCIIgo0CW95wz7UeWBtzMtpz/KtNL8iTZM3zmE4MIMqZo9Nhb+07szik2Z41HHEfGfbsOjULRYt1JSeJgdhO1zqKrj0Gzn7kyY1rurNBqHUm4D+274ToCT05LvQiOIi5GAtZzWR68B9nM2XDUeWiUcDiEDB37H1vhsf4/HP3P/j8vNtZ0AACCI3yWbZri6dOPGT3/+XRDWLRDS2f0S11F24fPbIGjI0rumVIAwLhpca/8+iDcNnoxKIw7wm+DowAAABb4p7dqxD9WHapVtr2Y9+sbKZsENHixcgRBEARBEARB3CDLa3axNPeD0pcnek71YwZQSTStUdOqaboqOs+nCgJZobmSK8T9xwutj7JEkFFGodXd8fOO4uZ2YpDHZEwMD4718w7zEnpyWAIWk02nM+lUFo16urz25X+OEHcerTQ3cui24TjQGXr2ZNHhksXQkPbeGXkboGT9SCwU40RUGkXcIYejiIuRSdaH0lLIPmzGdDiKjFL2E+4AAC9f/u1PLYSjDksYH+YfYrEmhlPQmfCH8ojT2SIGAMy7JQtuGNVIgDTHdxYcveH28LneDP7nZf9cF1fefunjm0OmzfYdF8z2hvdDEARBEARBEMSVXsh/wPTgcOtuiwYAZHrJ91WfQMEv0/+EIggyKr219wQx2x4k5D81f9qi5BgKmUzYqwerPwO0RzQo2d0XlU5HnBjAZcIVYwQsi3ylQtuPMrzEnUkkwGdaT32OBSqFtqtNhpZgdD8KxXrJNYMRzTYYQ9zxuc/3gJfZcQo2d1h0VBpwXKpTKzAtj8bg01iU/ixATqGQAQD+oV5ww5gk0sk7tNJOrQwzGjI94850FIp1ih+qDv1QdYhHZXnQuQ5WmPkh8wk4hCAIgiAIgiBIP60MuhUOIciYV9sp/jevxLwZ5iXcev8Goc3FQjGDEQ6NUm0yBRyyplFssUygBxsu+cKi03hMhrm2e32XxKLZpjrCzp5s9uirFSPqkMskPWsGaNT62oo2Qns3qUi586fTeh2WMD4UbkNcjEoJhEMAAACMRjEcQkYvlyfcqVQKm2vr2jNgHC78oew2LWrZkaaSq511OV0NXVqluWuWBIAngzPeMzjDO3R+YHwox3qnlplPkGd9eYukE03wAQCAlWffhEM3yDG1HFPDUQRBEARBEARBXGau31I4hCBj3qGicuLmC4tn2s62AwDEqrFyM1vb6VA+sbrTYpxvnL8PcdMkPSzwdFmN6XFZW4dloy1lrT07jw8NILSMElu/O7n3r4vmzYrCxodWfN7T3MvK26fCIcTFqJRgOAQAAECHdZ/SyFjg8oQ7zzXD2wEADBaNQiEb3NtXXKcQfVt2dm9DAWa08u/iAHRplcdbyo63lH1ceGx+YPyDcdMThf7wfjdkzk+pL2+5fDh/+ooMuA1BEARBEARBEARBkOGkQSQ1P6aQSdOiw3va+gBVex/Fcuqb4ZA1FyrriJuJAb7ETZOJYcHmhHt5W2ezRBYotL+UYGV7V5OkZ/h8emgQoXEIkIDzx9evv39WRJz/9QsV+ZeriUPdewuJ9Nnw4JwpcxPhBsTFqBR/CtmzdwEZrS4PAAMAFCiOjEouT7gLPFy46CWHx7T9+eJcu+vzX8/dr8YcqkpmxPHDTSXHW8qeTpp7d8wUq5+yqx+ef2TL+eM7LmUtTctaMh5uRhAEQRAEQRAEGX4kevGFzhNLAtbADQgy2pnrnAAAuAwGlWK9bruZWqc/UzFWhrU2iKWlrR3x1kasm+kww8nSavNmnL+3J8dK9YLFKbGfHTtvMBoBADgOdl0vemzOFHinXnZdLzI/JpNI8xKjCI1DgG25HqyyP8Xo++Llx1+8LnPxukxMb1iV8Vpcashb398F7wQAnUE1FTFGhgSDnqLSnIaCRlyl1ZcwaMlQHBmVXJ5w57sy4c52Y8L9o8JjP5ZfgKP2YEbjhwVHy6Rt745f0Tvn7uHLf2vr42/e/u1bd3w7a/XE2TdPikwK5ntyKVTr/V0U6mj+uPx+Iqq9jiAIgiAIgiAjQIem5WDL3yjhjoxBxPU8FVqtRo8xba6J+t3pKxKVBo6OXt+cvPTFhuVwlGDLlbwuZU8aZ3VaEqGxR6CQvyg5Zn9+mWnz53PZa9KTbA9yr+kU/3kp17w5LzE61FNo3hwSLDqNSaNq9Jhps8ipcx2oNEpYtB+ZTGKx4VVnkSHHYmT1TrgDAFSasyjhPkbYujA4hYtWTDXh8Kx0hLrC75WXe2fbQzkecQK/UI4Hl8ZgUmhqTK/AtLUKUZm0rUklIe65pz4/f9EBYsSERCIxOQzciOM4fnLXlZO7rsB7WDrU+T0cGkXi+darXCHDh8GIl7V2lLV2lLZ0NIplHXJFh1yp0ul1mEFvMFDIZBqFzGHQPdgsLy47xFMY7i1MCvRLDvJjWXbsI0OlRSIvb+us7hDVdIraZIoOuVKkUKv1ei2GYQYjlUKmUyh0KoXHZHhy2B4cVqCQH+YlDPf2SAr0s1ubcvgQq9SFjW1VHV31XdImiVSkUItVarlGqzcY9AYDAIBGodAoFDadJmQzhWyWD48TKOQHCvkR3h4xft7D/0hH/QEiI9cY+ZAh0hsMOfUtRU1tdV3imk5xm0yh0upVOp0Ww6hkCoNGZdNpvjyOH58b6iVMCPBNCvIL8xLCrzJsSFSaS1X1JS3tNZ3iui6xVKVV6XRqvZ5BpXIYdC6DHuwpiPLxivHzmhQZYjvrYUIdZkvVjcFT1HXUxrFSk9r9RtmFvkUi35dfeqmqvqZTLFaqyWSSkM0MEPAzwgKzosMmRYbAT7AJx8H5yrqz5TXX65rbZAqJWk0lk/lMZoiXIN7fZ0pU6LSYcHofw9ecJcbXy/zYYMQPFpat6iNlDADYkV3ww1k7t/mjzNHiyj8u5tw2JQ1uAAAAkNvQ8tnR8+ZNDoO+fHwCod3CQ7MmHy+pMmWrNXrs/t//+e3utV5c6ymmVpnigd//Mf2NAACoFPKDMzMtdxkayUF+2bVNpscHC8oemzPFj8+13GXgohICWhrguiVDoY+xobh5xcMxh8uc3yV9D44CIFVu9uA9CFxQa2i0G3nnmMsT7q4uKQOHXKBU2vZewRHzJo1MuT0q8+bwtEieN2EvCxWyjl11OZurruqN3R/3VuE4rlaMob5uZIRS6/RHiipOlFRdqm4gzqCEGA0GvcGg0uk75ErQBi5W1cN7DMK0mLDv71gNRxEHVHeIzlXUZtc25da3dCqUcDOBDjPoMAPQApFSXdclgVrDvIQTwoPnJERmRYcxqC6/dvSXFsMuVNadLqu9UFnXKO4prGmVwYhp9Jhco22TKeA2AHx4nHEhAWmhgRnhQUmBfpThkS0a9Qc4Iqz+enNpi601uxYmx352y5AtMLjsv79Vd9i645odH/n1ppvg6KCN0A+Z63VNm37YDkcBAADE+nnvfuw2OGpJhxkOFZYfLCi7UtOo1lkvNmgwYloMk6k1rVI5MR7kwZ8eE7F8fHxaaCAxPoSkas2enOK9uaUlLe1Ga/ctKp3edH2v6RSfLa81BSN9POclRq+fmBog5FnsTcCmD/2YuxF6ig4hmV5CAiQeTQAAUBv6nEws10vg0KDtzC58dfdRODo4R5+5J8jDfufQkBsRF/q+fkH/WTzjzqlW1iSTqDQfHjy9N6/UVBXETK3Tt0jk1+uafjhzNdrX66HZkxanxBF36MvR4sovj12obO8iBjGDUaNXtMsV12qb/ryU68Fm3Tp53D3TJ9oedT4Ys+Ij3z902vxh+e7+U7487tToMIudAKhs7/rm1OWDBWUAADqVosNsZQZGmXcPnMprbHlw5qRoQueEQqvbkV3wxfELWqx7uDcA4Im5WR7sPodRRvl4vrR09is3zrqqDtGKr35/dM6UZanxPCbDvJtEpdmbV/LVyUsydU925al50xKslYZ3v1lxkeaEu0qnv+e3v99fvTA5yM9yL4DjQKJW23g3rFp3/yyZuM8ParehkKx3IRhxW5fd0Y1Oi6fTYnT6Ciiux2pUmrNs5gwojtg2Es8xV12EzFxaUsY9Cff3C46Y7z1COB4/Tr01nNtz2bAqhu/zQsqC9eEZ9134q0EpBgAoJ7KFdFaWbyS860jzR92fAppguvdUD7oH3GZPu7Y9R5xnehzCDk7k99mVjQwTzRLZj2ey9+aVOKXYHOI2OA5y6psPFpSdKK1qkVgkegasrktS1yXZda2QTaetGJ+4cfK4KMIX6CFU2d7116W8/fmlNnqD+qVDrjxWXHmsuBIAIGAxs6LDZsdHzkmIgiowus2oP8ARZHV60rv7T8FRgpOlVXKNlngH6DaFTW22s+0AgFXpfY6/66/R/SFT3SkyDXaGGwAAAMg12p/OZu+4WiBWDXB4b5NYtvVK3tYredG+XvfOmLhsXDyZ5LR0WH91yJVfn7i4J6eEmP5wUHWH6PvTV346e3VWXOTj86bG+Fn5ffFZQ/DnAEb7Kepq75W8QCcz3kj+LwDgP3n3wc2Is42CC315ayccAuBabdPT2/Z3yO2kQirbu57ZduBoceUbN82zcQFVanVv/Ht8X14p3NCLWKX++sSlf64Xf75hWe+cplOEegqXpyb8m1di2lRodff+9nd8gE9aSKAnh6XFDF0KVX5Ta9WNjgE6lfLTHWue3LqPWEfFBo0eU2i1co1OrtEqtTq5RivX6hQaLbHLsLqj6/eLOVwGncdkcBl0run/DDqPyXBdT4Mj/m/JrPcOnsJxsD+/bH9+mT+fG+Qh4DDoIqWqoq0LutZMjgzdOHk8MdLbzRnJVR2iX89fM22KlOo39554Z/+paF9PLw4HB3iXQlXV0WUwWvQWrxifcJe1TqAhsX5i6o9nr5rLClW1d6397q9QT2Gop4BGpWj1BrlG06VUdyqUPCbj3PMPWD7bjqAw7yC4r2cIkMnWs0MGo5UPh7FDwLmtQ/IqHAWgS/YhmzkVLZ3aLyPxHHPJZ/GewnfNj6muLDvOdn3CvVjSerG9e4UTPo35x4w7AliODpGI4HltnnHH8mPfyfSa9vs82wF4Z/aSVI8geL+RQ2vUnu44qzfq/2nakypIuTP8tn6l3Zlk5taG7UbcCADwYfh8NO49V6zZjTiFQqv779Hz267mYwaLASnIMNcklu3ILvg3twQaUOlEKp1+65W8bVfzlqTEPb1guo2Bja5W0yn+79HzR4srrA3HdA6pWnOwoOxgQRmTRp0RG7EqPWl6bLjbUmOj/gBHnGXjEj46dNY8Vbk3HWY4WFC2bmIq3OB6e3KK4ZAlDzZrVpwTev3HwocMZjBWdYji/OGJjEYc//ta0edHz4mUA0y1Qyrbu17YeeiXc9feXDkvJdgfbnYxg9H4/emrP5692tcIfQcZjPjxkqpTZdXrJ6Y+MX8qlC8jVjp2j7FwirpaDC8RJ1x4AljBQponob2bRC9qUTfCUaQ/Rs2FvqxXwv1iVf0jm/eY61bbdaigvEUi//HO1RyGlWkxco32/t/+yWtogRv61iyRbfph29ebbuo98NwpXl42u7S1o7yt58BLWzqsToNj02lf3rp8QnjQuJCAE6VVcHMvpS0dq77ZDEd7KWvtfO/AKTgKAADgt7vXZkYEw1F3mZMQhQPw/sFTprO6VaZotTYPAwAwITzo2003OXI2Pr9ohi+P8/Hhs+ZxkAajsay1EwD4xDO5f0bmk/OmOvDCbsJl0D9dt/S+3/8hTvWoF0nqRZKenUY4EolGJrGNONylpNHlQpExhc9e1yX72GiUQXGN7rpI9oUn/ykojtgwEs8xlyTc6QyXvGxvbhjhfrKl3Pz4kYQZjmfbTfxZ/McSZ72Td8i0ebq1ckQn3Mvk5XqjHgBgxI2l8lIOtX/TF/g0fiw3plReBgDo0HbUKGsjORHwTsgwcKGy7qW/j1ido4oMW2fKazZfzLlQWW+1GoDTmcatHC+pemnZ7DUZyXCzi2EG43enLv9w5qqN1KdzafTYkaKKI0UV/gLeO6sXTIkKhfdwqlF/gCOUkM2cHR95pAieGUq0J6fE/Ql3zGA8cGNJsb4sH5/Q15BtB42pD5ny1g4o4S5Ta57dfuBcRR0x6BRlrR23fr/tkTmTH5g5yW3ZgQaR9LntB/IbW+GGgTIY8b8u550ur/nsFoshpf2dGj8YY+oUdam7Ix4nbi72X53mMYkYMbkmvvhrzVdwFHHMKLvQV3V0GYxGCrn7KlPV3vXon/86nm03yWtoefyvvT/euQb6JNRi2L2//l3Q/88rHWZ47M9/tzxwS5y/D9w2aDwm44971r6+94SpYkxf0kID31m1IMLbAwAwLsTfkYT7SCdWqm+fkhbn7/3yP0f7Ko5Ep1LunT7xgRmZjlfbv2tqxuTIkA8Onrlc0wC3EYwPCXh24fSMsGGXcpkSFfr7PWtf2HmooY/3xCl0WszQx2g5N6yqSqNFa3X5UFCju24wdlLI8CCGMYJM5nvyHuuUvgM3ACCSf86gj+Mw58ANSN9G3Dnmpsy4i4RG+8WNc+Z3hd4udFSbHpBJpBUhA7mFXhGS8n7+YQOOAwAuddQ8ljAT3mPkqJT3fEUYLxxHJ/f7UzuBH29KuAMASmSlKOE+DP1y7tqnR85Ck/KQ4ezf3JKfzl6taLMoZ+keGj32yj9H8xtaX7tpriPjU5yiXa54asv+nPpmuMEt2mTyIAfWCRyMUX+AI9qq9CTbCfec+ub6Lkmoe1fFPFNeY7e8yar0RDjksLH2IQMAKGvrXE7YrO4QPfTHngaXjUQzGI1fHLtQ2yl+Z/UCc8bKdbJrmx7ZvMdZxSuImsSyTT9se23FXHP9Ig+OOxLuY/AUdScu1foQfibZHb/cUWn0Xeh1mKG2U2wqsqTRY09s2TewqTMXq+o3X4IX23x778kBZNtNNHrsmW0H/nl0E43iaGLXcXwW89N1Sx6cmbk7p/haXVOjWCrTaAEAfCYj2EOQEuQ/Pyl6UkSIef/xIcNl3Q6XMl1cJkWE7H/8jjPlNQcLy8vaOttlCh1m8Oaygz0Es+IiFqXE+fd/1dCEAN9f7765qLntRGn1par6NpmiS6kik0heHLYvnzs5MmRGbESq26eLOS49NPDgk3edKK06VVZd0NTaLlMqtDo6lSJgMgRsZpiXR7y/z8B+/vqq9t//eyT3UpVS3ucCgQdL3oNDzsaiT+6dDMVxnVj+P2/BS1B87BBy75Upt+iw7ryiGY7rWzrv9PX4kM+5BWrqL62+WKbc5iN8A24YdUbcOTayE+5LN0xeumEyHHWqNnX3dNRInrcnw/py2LYJ6awonk+5rB0QXm2Eqlf39Ccn8QdSCjaGF21+XKus7WlAhofPjpz74cxVOIoMbwfyy4Yky2C2I7tAi2HvrVnkhlRDfZfkrl92Oqsg7wBMjgx1aS511B/gSDctJtyHx7FdkXZPbvFjc7PgqCv9m9tdRrYviYG+gxnfN6Y+ZEzKW3vKAtR3Se74aUeXAp7B6nT/5pZgRuNHa5e49DBPlVU/vXV/f0eeOk6HGV7+54gWw27JHAcA8OQM5Mtzf43BU9Rt7ox4NIhtvSIHk4IS7gMxWi/0Za2dpoT7/05fsbumiA2fHTm3KDnWh9c9kfpQQfmua4WWu/RPdYfor8t5d2Slww1OEuvn/Z9FM+CoNZkRwSVvPQVHe4kP8HFktwH7z6IZDv7AA2NeG5ZOpcxLjJ6X2HP77xRJgX5JgX6PzZkCNwyIq98NCIVMmp8YPd+p70lTbeeT679RK53fid5fLMZkieJ7OAqAWP4dm5HFZs6GG8YGEonh5/lFQ/tNAMDzmXCAtYmfVmnPePH/Q6OGQ6126bAqlea4TLlDqy8CAIyJhPtIO8dGdsLdDTq13VU1vBn97oM182ZyTQn3Lq3FLXpns7i6qHHCnCRy37O81QpN6bUaAEBiZhSD1e8R5c7Voe2pkhbNjSK0OCqAGWB+3KZpJ7TYoTJo9UYMAMCmMGlk549QQAAA35++Mmyz7Qwq+rDq0z3TJ5wpr4Gj7vVvbkmkj+f9MzPhBqdqlyvu+GnH0BY7Wp85kKlODhr1BzgKUMikFeMTfjqbDTcQ7M0tfXROltvybjK15lQZPGoGMsjlUsfOh4xZeWt39rZNprj7l11uyLabHMgvC/MSuq7D5kpN4+N/7XX16iw4Dt789wSZRFo3MdWL646E+xg8Rd0mw6PPrFYEJ/q91O/gKGLTKL7Ql7d1LgFxjWLpr+euwW39odFjv56/9tyiGQAAlU7/wcHT8B7998Ppq7dOGueKQe5IbzhA86Tdasu3J9RKrYcX95aH5sQkBbE4fa487Goc5hwKxddg6J3kMTR33enFf17IvZtEcrAotBGAPlNkIw6Tnu4jfM3q6qkAALlqt0K1j8u+icuaz2JMo5CtLJpiYjBK9FiVTl+u0l5Ua89ihjZ4j9FuxJ1jKIdlh3lVT8ogbp3NzzStF2p28WDu189v8Q70+OHCGyyu9dOCRCa9uuFLvQ578Yf7Zq6aCDe7l0QnMT2gkMh+zIGs+e5BF1JJVAzHAABivQRuJtAY9MfbcrJFFYXSWpFOrjd29we+k3rHdJ9RVShzmDhXUfffY+fhaB+ifb0mRgRnRgSHegmFLJaAzaSSyVK1RqrWtMkU1+uasmubcutbBlCVkkQC3lxOiKcwzEsY4ikI8RSGegpCPIVCtvU/EAQAMDEiOCXYf8CTbZ3li2MXMiNCxof2dKo5F2YwPv7n3qG9R/XisufED6Sv0RGj/gBHjVXpSbYT7o1i6bW6pgnhbqoferCg3DyazCoahbJsXDwc7Y8x8iFD1C5XSFQaPovx7PYDzRJ4qSuX+t+pK1Ojw9PDnF95oLpD5IZsu9lbe0+GeXmEeArgBhcYg6focEAmUfqqNjNgKcH+98/MFCvVYpVarFKLlWqJSi1Va0ZHqcPRfaEva+0AAPx45qoWG+wEmq1X8h+aPZnLoH9/+opT3i6RUnWkqHJpahzcgCAjX96VagDAy19sSky3PhvJbUgkugf3/k7p23ADADiu75S+LZZ/y2HOZdLTKBQfMomDAwzHdUajzIhLDYYuzNhuMHToDU0Y1uTn+SmXtQx+lZFMyL1XjzVIFD/ADQAAAHCAyVW75KpdAJDo1EgKxYdC9iCThTiux3GF0ag04nI9Vm8wDnzy0Ogw4s4xlHC3w5PBVmE6AECn5eD0fjE/18tymPz1UyUAAA6f1Ve2HQDAZDNSsmKvnyq+dChvyBPuWmP3TCU2hUMhDaQ7iARILApLjskBABqD9RJjOMB3Npz7o/a4RGf/PdcZsedyf8RwAwBgScDEpYGjbWCRe0jVmud3HHRkjbHpseEPzZps9WbSh8fx4XGifb2mRocBANpkil/OXduRXWC3hiObTnt07pRQT2GIpzDEU8Ckoc+lfrtn+oQnt+yDo32gUykR3h6RPl7h3kJfHtebx2HTaQwqVYdhMo1WptZ2yJV5DS15DS1StfU/UquMOP72vhPbH7rVRUVsfz1/rV/r+wV7CBIDfYM9BcEefE8Om0mjMqhUOpWiwwwaPdalUHUqlA0iaU2nuKq9y8EjXZORPMhlJ20Y9Qc4akT6eI4LCchraIEbCPbkFLst4b4ntxgOWZqTECVg9fk1w0Fj4UMGUtbakdfQcq22CW6wRKNQkoP8koP8QjwFAUK+6UiVWp0pS1jVIbpS3VDTKYaf1jcjjr/8z5F/H7vduX+MGj322J//yvrzhgvZzMlRofH+PmFeQh6TwaTRdBim1utbpYpGsbSoqS2/sdVGaRqD0fj01v1vr54PN7jGGDxFR6U4f29ovWIAAI4DmUZjysJLVGqxUkNMx58qq3bkG+xwMLov9GWtnSKlek+ORYkzDzZrYXJseligD4+jNxhqO8X/5pYUNtkZlanW6U+UVM2Oj/zzUi7cBkB6WNCsuIhoPy8eg9GpUJa2du7MLrA7D2l/XilKuCOjkqRTwROwhzzbbiLg3i5V/q7H6uEGAAAABmOXTLVdptoON4wNPsI3SCS6WP413GAB12FVAKuCw8gNI+scQ4ktO3yZvEalBABQKeuQ6TV8Wr9vWWV6TaWsuxKoH8tiGEhjZSsAIGOOnYnecenh108VVxc1wg1uZx6hTx5Qtt2ESu4+6/RGK3lYlUH7RuGfFzvtlKM1o5OpPCrrTEchAECqU6KE+8B8duS83QX3OAz6R+sWz4qLhBv64MfnvrBk5u1ZaY/++W9pS08x3N5UOr0Xhz0nwSXDbcaIeYnRoV7C+i4J3HADk0adGBE8JSo0LTQwMdDXkUm1OA5KWto3X8zZn1/m4GSF4ub2QwXlS1xwPyNRab49dRmOWhPr533r5HHTYyIChP0YdtcolhY2tl2tbbxS01jVbr0QMIkEbp7gquk1o/4AR5lV6Um2E+6HC8tfWjbbDd2H9V2S3HpbPwkAYPXg6smYjPoPmd7e2nui3uYqqdNjw1emJc6Oj7L7i+5UKP++VvTr+WsSlUMZsdpO8d/XC9dNdGbZh08On3U87z8zLuK2KWmTo0JtJ471BsPpsprdOcUnS6usZjzFKvUjm/+Fo64xBk9Rd+rUtudLs9s0zRqDmklh+TEDUwUTvBm+8H6uQSIBAYspYDHDgQfcBkDKq58brJ5/w8yov9C3SuUbv99qHt5OIoE7p2Y8OmcKi04z7zMtJnzTlLR/c0te+vuIwWhrts2hgvJmiUyp1RGDkT6e76xeMC7EYtzPwuTYB2dlvrDz8OHCcmIccqm6XqPH7H5cI8iIw+Yxmcyev7KhRSZxA7x+aWxfYcTtD50cg7wFL9GoYR2SV3B86Gvuj1Aj6xxDlxw7Mr3Drnc1AAAMuPFgY/H6iH4vt7K/odBwI089xTeC2CTtkgMAAsLgcRwQL38hAEDaOWRL65hxqByZXgYAUGIDP7lVWPcABFavpZaMuPH1gs2XukqhuG2z/FJNCfd6VUeVoiWKa2XwNWJDXZdkZ3YBHLXkx+f+cOfqaF8vuMGeQCH/r/tveWrrvtNltoqrfnDwzMy4CP6gx2COWWQS6a6pGW/8exyKC1jMuYlRi5JjMyNC6FT7yQUiEgkkBvq+u2bh0wunvbHn+PESh3ra/7iY44pEw7YreXanSnhx2W+unDd7QBOlgz0EwR6CRSmxAIA2meJ0WfWp0przlXXEDMvU6LBgD1fVRhj1BzjKLE6Jff/AKRtjexVa3fGSKjcMprO7XKovj5sV7YRBT6P+Q6Y3G4v+TY4KfW7R9IQAR7ON3lzO/TMzN01J++HM1e9PX3YkN/jdqStrMlIoZFv5bsdl1zb9dTkXjloT5iV8/aZ5kyJD4AZraJTuBfFKWzre3X8y295sAJcag6eoe+AA39O09UTbfqgu8+7Gv+b6LV0RdIu5/CZi21i40NcRerxev2ne2gkpPW0EK8YnMKiUp7buhxsITpdXn62oJUbSw4K+v2MVm5C+N2NQqZ+sXyJVay5VWR/zCADQ6LHc+ubJUaFwA4KMcHEpwdnnysVdCg8vi2oKQ4VBSwjw+r5F9JDR6NaKfCOFgLOJSc9oFz+t0eXBbYPSv284I9oIOscGPk55jJjuF21+/EXxSbHOzmw1SKdW+UXJKfPm3ACL798quQYAwPPoXoS9L6Yd5JKB57idhUPp/lExHJPqB3Jyawwac10aDhU+8M11J4nZ9mC2961hs15NuvWj8fcS9oJlePT8jrJFFYQWxCG/nb9utHn3TyGTPl63ZADZdhMmjfrRuiUhnkK4gUCkVH170qFRP0hfVqYnenK616ajkMmz4yO/3Lji7AsPvL1qwbSY8P5mGYi8uZwvN654fslMCtn+JSOvoaWyj3FVg7E7x07RjGhfrz2P3T6we1SIH5+7bmLqN7fddO7FB95ds3BaTJhpjKdzR5tCRv0BjjI8JmNeYs+lx6o99n6ng4fjYG+enYT7TWkJzkraju4PGQfRKJRXls/56c41jmfbzdh02hPzsj67ZZkjQyxbpfKzFbY6qh2H4+CDA6dtXue7zYyL2PHwRgez7UTxAT6/3rP2yflTbQ6Idzl0irrCybaDx9v2eTN8Vwbd+lD0f56Lf+vxmJfXBN/myww41rbvZPtB+AlIH8bUhX7DpHF9ZdtNFibHLkiKgaMEOA6IQ+D9BbxvNq2wmm03IZNIry6fY/svNNfm1DQEGaHW3jsT4OCHD/bjw2atCzZzdqjvESZ9PNyAAAAAYNASQnz3+3l8SqM6YUwMjRrhLfi/iABb60uNPiPlHLP/jX+MS/cKiRP4lUnbAACdWuXtZ37/cepGqDJMX5pV0nvP/ynSdufoJ/mEJwktBl9z+Gxpl1zaqSAGe1NIVQAAJpsBN7idF8OjRdP9TaVMXpbp2e+a8hWKSvNjIc1ihIVMr9pSd8r0mE6mPhm3cmlgpiOjZjzovACWZ4taBAAokfU5rgGxSqPH7Nb/vX9mZsbgihFzGfRP1i9Z/91fNm74/8kpfmL+VEfSEIhVDCp14+Txf13OXTcx5ZbMcT48uENrkO7ISgcAfHDgNNzQy4mSqgF3z1hV3yUhjpnqjcugf73pJk8OPGlmkHhMxsq0xJVpiW0yxcGCstnxjtZT6q9Rf4Cj0ur0pH15tuZjXayq61QovblO/kskul7X1CCSwlFLK51RT8ZkFH/IOIjLoH+5ccUA8tFEC5JiuAz6fb/9beOCaLL7erHjZdxsOFBQVtRsp2IyAGBWXOQXty4fcHFnMol0/8zMAAHvxV2Hbffiuw46RV3hXOdxb4bfc/FvsyjdnRkAgBheQpb3nI9KXz7XcWyO7xLC7oh1Y+pCL2Qzn1owDY728szC6UeLKxz8tHh52Wy7E2HDvT1mxUXYmIlSZK92PDLkjrftOty6FY4C8GjMO6HsWDiKAAAASJkY8fS7N3/6fzsbazoXrpkQEevP5jJArw7w8Bg/KOJSNGpoiO9ehfqwRPGjWnsJbraJRo2gUNz60w4FMp9zC5+zTqE+LFftVGpO4rhDVQdNSIDKoI9nM6dzmLOZ9Alw89gwIs4xlNuyg0wiPZs8977zf5k2y2Xti49+fV/s1NVh422k3ZtV0p11OT+XX1QbumcOkkmkF1IWWO4F/EK9pF3yoiuVN90/B2oiKr1WAwDwCfKEG9wuhhtTKO1Ozl7uujKAhHu2+Lr5cRTX4jvfibY8Jdb9KfOfhLUL/NOJrbaFsX1NCfcGVQfchth0tqLW9vxWDoN+1zQnfIgnB/nNiI2wUVhGptYcLiy/KS0RbkAcdte0jHtnTHCkLu3A3JGVXtjYuj+/DG6wdLai9v6ZmXB0EArs3SCtyUgO8XThFGk/PvfOqRlw1HlG/QGOSpMiQwOF/GaJDG64wWDE9+aW3jXNhW+s3e7StNDACG8rJY8HbLR+yDiCRqEMPttukhUddufUjF/OXYMbLJ2rqMUMxgFnwE1wHHx70v5NSJy/92cblg7y3wIALB+f0KlQfXToDNzgLmP5FHURka5zps8CYrbdhE6mjxNOPNa2D4ojVo2pC/26ialcBh2O9hLiKcgIC3KkFFVSoJ+DSz3NS4y2kXB3fB0LBBlBHlz+eVNdJ47jFYWNFYWNcPMNB0veg0MuR+GylnBZS/RYrVp3VaO9ptUXGYwio1FmxGUAx0kkBonMoZK9KBQ/GiWUTouiU2MZ9HEUshB+JZt47DU89ho46gwMWlJMcDMcdSYyl7WYy1psxFUa3TWNNlurL8UMDZihxWhUGnE1iUQmkzgkEodM5lIpAXRqJI0aRafFMOnjySSXVxDic9bzOevh6PDipnNswFDC3b4ZftFrw9N21OaYNpWY7vPik1+UnEoQ+McJfIPZHlwag0Ghagx6hV5bpxSVSdvLpW1Qb/1zyfMShf6WMZAyJaY8p/bCgdyW2o6AcB+o1aSrVXJmdzYAIHmyndnrbhDP6ymJc02cU6+qD2X3oxBep7brXMd582Y8P57QCK6Iuu9eYnhB/cq2AwD8mN0JhQ6tnbF+CORUaTUcsrQyLdGRL82O2DQlzUbCHQCwO6cYJdwHww3zA15cOutYcZV5RSyripvbjThue6m9fqnpu5KyydJxFh8mI86oP8BRiUQCK9MSv7GZytyTU+y6hLsWww4X2qmitsp5w9tNRuuHjCNeWjbLKdl2kyfnTz1WXNVgc1FWlU6fU988MSIYbuiPC1V1NorRm9CplE/WL2VQnfPLvWtaxuXqhjPlti73rjOWT1EX8aB7Yrj1kRkqg0JAc2aX3ig2pi70K8YnwKE+LE2NdyThfsskRyvh2J6SW9clMRhxZ5VZc4Xfaj8skl4FAMz3Wzvffx3cfMPR1u1H23YAABL46XdFvAg3AwAAaFBV5krO16squrStGoMKBziDzOTTPL0Y/qHsmGhucgh76HMLvU33WZoinKzC5EpMpsBk+5p/1xrV8E6IpbpKO/15Q45GDadRw/nstXADcgOZxGYzprMZ0+EGxDHD9hxz+bfS0eGNtKVtavmZtp5yKEYcL5K0FEkcqgR3V8zku2OmwFEAFt02/e9vj2E67LVbv3r9z0cCI3yhHTqbxa9v+lqr1gEA5m/IglrdL4YX483w6tR2AQBwgH9Z8e1rSS9xqQ71remMui8rv8bw7vsTDpWTaJlwr1G0mh5M9e53ypVN7a63o8K0li2IHTn1dvpsnZgBz4oK82CzxKo+vzblN7YO8+/BiCeHvSo9aeuVPLiBQK3T13SIopw3m97GOWMS6spBYW4w6g9wtFqZnvjtqUs2psOXt3WWtnTEB1jvUB+kEyVVco2tSx6TRjWtnjeyDMmHjF3TY8OdW/uYRqFsmJT64UE7I8Gv1zUNMuH+16VcONTLnVMzIn2cOY3y1RVzln7+m+2U9Mg1PE9R18nynnOm/cjSgJvZll/4ZXpJniR7hs98YhDpy9i50PsLeI5/nqSFBcKhXihkkt1FU8yCPQQ8JqOvi6PBaOxUKP34Dt26jlwyvXhX4/9KZPAkKpVBoTIoWjX1RdIrAIAAVviTsR86Ur7Vnehkpi8jCNyopHu4dStKuNv197U34BCCIMOD/amj3765+++fzzRUtcMNYwmFRP52yi13x0zp7xWJSaG+nb68dzEZk5AY/6V3zQQA1Je33D/19Xfv/X7fz6cuHMi9eDD3wO9nPn7kl7szX67MrwcAzFw1MS49An6+21FI5MX+i8yb7dr214verlbaH8TUqml7p+T9WmWdOTLfby6DfONaCgAAQKLvXhU2kNXv+xMaubvraKjKho5Qco22rsvW5EoGlRrv77RUEYkExoUEwFECtU5f2d4JR5FhZtOU8XCoF9uFSvvLdtUjAACb7pxJGENl1B/gaBXsIZgYbicZ6rqlU//NLYFDlky1wuHoSOD+DxnbKGTy/y2dDUcHbXV6kt3h2KWtg7omilVquyPN+Sym04ufBAr5Tp9dMawMt1PUpbK8ZnszfD8ofXlf846ronM54suXuk7vbvrrg9KX+FRBICs0V3KF+B/8fAQAMJYu9BkO5NDNon29OPauU6nBAQJ71duJwryEcIigQ959vzlaKTDpN5WvmLPtJEAS0r0DWOG+zCA21aIcbggrarhl25GBYbHpjvwHPw1BENez80VfrdTu++uS0WD84b19vkEeE2fGL7llUmRCP66jowaVTH4+Zf5M/+ivS85c6exJHPeFQiIvDk58OH5GFM8bbiN48O11nc3iS4fyMB12Zne2qXoMJCUr9snPb4ejQ2SGz7RjbSfMS6d2aDveLHonWZA0w2daNDfak24xsVSOKaoUVRc6L2WLrxlwgzkupAkW+MEjYvTG7pFQjBvZc8cpse6ubx4NLjGJ2FDbKbbdQ5EY6Dv4iq5E40L8T5XZKmKT19Aa57wUP+IKkT6e3lxOp8LWHUurTAGHBsHuzVi7XBEo5MPRkWPUH+Aotio96UpNn+UyAQD78kufXTTD6RN3RErVuQo7X0VGbsbT/R8ytq1OT7KdwRkYPouZFR12ou9ywwCAirZBJdxPlFQZjDYv8wCsn5jCptPg6KDdNS1j29U8298xRq7hdoq61Av5D5geHG7dbdEAgEwv+b7qEyj4ZfqfUAQBY+lCnxjoB4f6RiaRon298hpsTRlP708GHwAQIOAV9l0xf9Qn3Pc1/y7StQEA6GTmkoCNaR7TWZSe5aMVmLRGWVIqyymQXsr0mtvztMEJ9RSWvPUUHEUQBBnz7GQ2S3LqjAaj6XF7k3j/XxfjxoXYTbgXZdcSNyPi/dncfvRLD2eTfSIm+0QUS1qPNpdkd9bni5s0BosJs3waM90rZKJ32JLgpEC2/bmBVDr1tT8e3v/rme1fHGpv6IJaPXz4qx6at+bhBRSqM5Oeg0En0x+PeeSN4rc0hu7JejjAC6SFBdJCAACHyuZQuEwKU2vUqjCVHJNbPBkAAACFRHk05mEOFc6Me9C5bRoJIAx1d5xpxVQAgJDe85UCscvGcn8m0c6eDR1hb5Kp3R8JGQ7SwwKPFNkqHt3u1ESDkM2CQ5aya5tWjB/Bt6mj/gBHsYXJsW/vO6nU6uCGG7oUqvOVtTNinTxHbV9eqcHY/fXMqiAPfmaE0wqOu5+bP2Rsuy0rDQ45SWqwv+2E+yCviUeLemohWkUigfWZziyVYxbiKUgLDbxeZ6ds3cg1rE5Rl1oZdCscQvpv7Fzoo3ztfNWH2C3wktSfDD4AwIdn62ZQ0Ue1mdFBa1TnSy6aHm8KfzqeB1+8uFRBimByimDyquB7qSTnd7UiQ0ut1OZcrKwpa1XI1BweMzzWP21KNIc3ShJxCDIS2Um415TCHc4xSXZmTwMAnt3wDXHz4y0PJ00IJ0ZGukShv3kFVIVeK9WrVZieS2MIaSwWtd+XLhKJtOyumUvvnFFX2lyZXy/rUhhxnCfkRCQFR6eEkJ06vtgpAlkBj0U/+nXltyqDCmpSYiolBgeJaGTafZF3x3CtVOLzZQpNCfcSWf0q0I+C9QbcWCjtHugXx7N/fiJmdkd58FkWZX8Gj8e084JStQYOIcNPUpCf7USDRu/M0r2+fFv3TgCA7VcLHF+haxga9Qc4ijFp1EXJsbuuFcINBLtzip2ecN+TY6eezMq0pBG9XqObP2RsSA8LdHrfs1lKcPeXyb5o9Jhco7V76bRKbzBcqWmAo5bGhQS4blDt4pS4UZxwHz6nqKvN9VsKh5D+GzsX+hBPIRyyyV9gUeekt2i//n0CC9i20ouKvjvIR4EObYtpiWM+zaN3tp0IZdtHn71/Xfz9v0cVMouS9ywOY8ODs2++ZwZpRH8pRJARy17Cvbx7HUsTOpMWGu1LjCBcGoNLG8iNEIREIoUnBIUnBMENw1KyIPH1pFe+qvy2XlUPt/XNh+HzaPRD4ZwwuAEAAECGR0yBpBYAcKa98LFYNY9qZySI2Zn2Apm+O8uf4WkllY/0RWWvoOTAbvJtsPuCMvVoHngyanjYG6jl3ERDWqidaVXX65q2Xcl30ThNNxj1Bzi6rUpPsp1wP1lSPeCcqVWV7V0lLbZW1iGRwErnrXc9JNz8IWPD/KQYOOQ8cf7ecKiXLoVqYCdPUVO73XdpXoILvzVlRVv/vjc6DJ9TFBkRxs6FPlBoJ4EOsT0gnUQCIf1cTpZjsxq+3WL6I5re2H0bxaTAU8ndrEKef018ul5VIdOLdcY+R1M9EPV6FDcJjg6OSNdWKL1arShq1dQrMCmGYwwyU0j3CWFFjveYFs1NgZ/QS7umKVt8qkZZ3Klt0RjUJEBiUtiedN8AVlg0NyWBn04n2+rUGeTTB+bnjw/u+OkMAIDFYYRG+bLYdLVKV1/VrlZqf/7kUFuT+NHXVsLPQRDE9ewk3NsaLRZUDIv2G4YDrpEh4cf0fTP51WvinAMtB6sUtqpyAwACmAFLAhZN9Z5CIVHgthum+ST9WnMUAKAyaD8p3fVa8kZHFnKR6VVfV+4zPeZQmVO9R3aKwc3s3g3arTjZX3YLxcpH9UzPUcP26CEAgN7Qs2bD4EX7enlx2V0KW7Nn3tl/kk2nLR+Zo8NG/QGObulhgeHeHrWdfS5ArcWwQ4XlayfYv8dzkN2FWDMjQoI8XDVs2T3c/CFjw+y4SDjkPHymncMEDlyp+3K9rgkO9TI5KhQOOU+Et4cfn9s2WiqrQIbPKYqMCGPkQs9jMhhUO+kFCIPa570hAMCTw+7vCzJt3mtgNquxjXR8avdqal3aNo1BzaTY6Rd0BZ1Ru6X+v0XSq3BDLyRAspEZGACxrmNn43cV8nworjYo1Wpli7r2iuhEIn/CxrCnaGTrd7hG3Hig5Y+zHftxYLECiQKTKjBpvarictcxOpn5YsI3HMsVaE0G+fQBK7has+OnMyw2/eFXbpq1bBz1xt8UhhlO7cv75q09+7denjwnccL0WMvnIQjicnYuYKJ2KXFT4GmrCxoZa0iANMEjfYJHulQvLZOXVyqqpXqpElOqDCoGmcGhcnhUXgQnPJ4f68uwPzEilhc01TvxfGcxAOBEW57OiD0dt9qbYStlUK/qeCX/t3aNxLS5KjiL6/C4eAQAYHcdvwHf5/fFRqVjExrq0hsJ+PaGW+LOXilvbkL09qvwF2gizGB8YdehvIaWJ+ZPHdho0KE16g9wdFuZlvj50fNwlGBPTomzEu5GHN+XVwpHLa0esculmrn/Q8YqXx431AXLpZpRKWQmjWr7UqvFbLXakN9oMUu1Nx6TER/gA0edKjnIb7Qm3IfJKYqMIGPhQm97uLpVDJqtdIQ/v995Sdu3Evobq9ONSl4MfwHNS6rvMuDYkdatK4LugvdwvS31X5iy7Qwya5rPkkBWOJVE79A2X+g8KNK1AwBIgLQ+9NEgVoQXw9+5lW24VH6Tusb0mEZmBLLCveh+NDJdrpdUKYq0RjUAoFiW/U/Tj+tCHrZ45g2HW7ec6egeyedJ9w1kRXCoPAzHxLr2ZnWtxqACAIRxYvtKlw/y6QO2+/fzAIDH31w9a+k4YpxKpcxbmU5nUN97esuBbZdRwh1B3M/WFQ4AIJNY9MNz+SibiVghoAkyPSdmek6EG/rpoZhl18VVaoMWAHCuo+hKV9k0n6SJnnFhnJ4bQpleXalorla0XugsPtVeYMS7vzYFsbw3hs0274Y4wu63eZmzK6pL7VWMYdkcloIME7ZvZlzhzqnpO7MLjDbzFzgO/rqcd6Cg7L4Zmbdkpo6sc2nUH+DodlNa4hfHLtj49V2va2oQSfs7L96qS1X1tjOYXAbdpVVQ3MP9HzJWjQuxU2N98PhMpkZv6xeqwwY4ULqqQwSHLMX5e5NdXNQ1zt/nuM1VYUeuYXKKIiPIWLjQC+3N/OjN9gB2D06/X5BCsvW3aXu98VFgus+yfc2/AQDOdR5QGmRLAm4T0Pq3jO1gVCuKi6RXAAB0MuOpuI896d1D7hJA+hSvBV9XvtSsrsUBLtZ1pHvMsHimM9DIjOney5rVNRM9Z0fzUojZfI1BtbX+y2JZNgDgmujUQv/1Ahq8NoDWqD7XeQAAQCaRN4Q+MU5osaScETc2qCrzJOdjeRZJbbNBPn0wSnLqmCz69EXWB3ZMW5DM4jBKc/tRBxhBEGexdUECAOg0FmXOuAKUcIcZcFykVdUrxWKdymDzK9QA4EYnv+AwF8r2eTv1dvP3JJ0RO9GW90HJ9oezvzbv80HJ9rsvf/Z20ZYTbXnmbDuLwng39Q4Otd/fycY4uwl3py9havcFPTlDXHMQGZ7CvT3mJTpUa1ii0nx06Mzcj3/877ELdpcFHj5G/QGObn58rt1y1f/m2qkD46A9uSVwyNLilDimzQGDiOMSAu3Pzxsk26M7AbCcl+4wgxGv75LAUUtx/q4d3g4AiOnnaocIMoqNhQs9l2HnzqI3KtlWOkJob7GE3mx3Iw7sE3UEme6zNJ6fbnqcIz73Qcmj2xu+rlWWQkVOXKRQetn0YIr3QnO23YRGpi/wX296bN7N6eb6rb4t/Jl4fjo0dp5JYd8a9iSbygMA4ACvUhQRW03aNU16ow4AEMiKgNLlAPw/e3cd19a5PgD8ORIXgnuBQqEu1H211be167p10rnbnd+7u+3O3X9zd+3adWu36uqulAqFQnEnxPXI749QSF5CBBII4f1+9rk3ed6T0lOSk3Oe87zPCyRBpsmyL0m+sfWfF9HFl3eFXmtWxcipDm4DkxQZESXTa83oAIZhweflLN9udymrEYp62W32IKkx6zZVnTnUWHasqaLJamz9+iIAokSykVEpo2P6zUka2E/W0katIya95Ytnf5t33dSs4WgPzd8/3vrbB5sbq5tjkiIXrJy6/P75FO3+GBpmxkZlvzby5udO/dRs06NjHUgQR7444oYMedDL0MJPvygVGnJ1rr4JDXXN2doGNOSqXyAqQLGw9J+FF+0vqfBx1oXGZPl4+4HPdx2aM3jAleOGj8tIQbcIPWG/g+Ftae6Q3UWlaNTJH8fP3D1zIhr1k8lm33L6HBp1taT395MJHWnB7CcTVFXNWq89xDNig172mByJv9MxrE3Yf9ErxO5bY3ea1OMKqGFsc92vm+t+RaM+IIC4Pv3R9dXf7Gn8mwee4e2H1dsPq7dHCePGRM0YEzVD1a6yO4DqrdWOB0nidJcBAABIFLeUJjRc2Kw7CUnRQMWoo807AUBjb0SHASiiJTOmtTUxvN3fdjddfHlXyCMkWrWRYzm3qy1yLKdVG3HhLIb1CDefSWcCgctCFiaDT+cHYazMoP73kbWzN7774omNm6sLGp2y7QDAAzRZjVtrzr6av3nupvfuO/DraY2nBpp71h9b9+WOe2Y+31DlMu33xzf/+ui/PzdUqXmeb6hSf/3S2nce/NZ5g/A2Jir7q/EPLk4eLyS93BASkPSSlEmfjrs/S56EjmE+GJQU53k6+cmquk5PZnfrWLmXE6zMuCCeBWK9WrxS/vQls9CoRwzL/Z1/9obPf53/1pef7jzkuRFHjwv7HQxvMwdlKiWeZllVqLW+LGLp2eZTRWaby9RDREZM5Mh+iWgU66ygNnAPqhqt96qFJFWA28i2lxgR9B+BYb1I2H/RiwUBTjJKe1tTnVBAEdQlyTfem/3yYOUYAlou9NS2+k21P7985u6fy99z9FIPBpZvWXREQLqZ69C6VGnrJPVuphLEOB5YWTfl3gniVBmtBAA9o/mi5KUGaw26hUddfHlX5AxLMRute7e6n0m5Z/Mps9E6aCRa34lhWDfwktAUS0U2a9tiTc2NIf0dH2y/l594+vh6M+PpWrcVx/Mbq85srTn74JBZNw2Y6DapeWz7aQDIHpUem9xWZFRb1vj96+sAQB4hHTt7aOHxsqriuk0/7Jl79eQhE3yahxgGIoXyRwYuu7X//G31eXmaktPacrVNb+MYABCQVIRAlqNIHR2VdVHccM+rqmKeSYWCjNio4o7L2G0Mm1dRMzZANTUWO3Oqqg6NOqFIYkQqThV1n2aTuUFvbNAbG/VGg9VmtNoMVpvJarMwjNXOWBnWYmesDGOxMzaGsdgdD1jHKPpndYt5w7KL6hs/3Ob3RNSyJs1bm3a/u2XPxMy0S0YOmj04KzR7boT9DoYxIU0tGp7zw4E8dMDJ2mNnctOS0ag/vPaTCbXy9l53kEF0YgHAENFkcFmEya3EiKCfQUXJpBRJhnLT5N7+FsV6nfD+og/4X8lr061wpRREKukO58rrmGadvRmNukqR9L8h4zGNrfFw8/Yj6u1NtjoA4Hj2SPOOE9p9i5OunxB9MfqaLosSxjlW7WiwuqkwqL8QRLrNdBuKaKklddtehySoRYnX/VzxPgCcM+S/XnB/jnLUuKhZg5S5rdXrHnTx5V0xf/m4A9sL3vrvKpZhp84d1lrnzrLczr9O/N8zvwPA4mu6OskSw7BO8PLhj4yR65rbOscV5Vc6DfYtr53c8lnhXjTqDcNxr+ZvPqute2XMZe1z7iWnKgEg96LBzsHVH25mbIxQJHjzr8f65SRaTNb7Zr9YXliz6ae9fSfh7qASypakTFqS0tIEzcYxDM9KKTc3zLFOm5ad7iHhDgA/HTwRqIT76qOnLB4vUIelJOBKluDRmi35lXUnq2qL6ppKG5vLmppNHktlQ9O9sybJRaI3N+1i/V/iguX43UWlu4tKpULBxUMGLMkdMiY9xeMcjx4Q9jsYxpaMHuI54b7hZOHjiy7yvECcB3U6w8GSCjTqhCKJS0YNQqPdKDwOMs4i/W8fHCKajN4T7tHyoO8dQYBSLGo2uakl7BHh9xbFeqMw/qIX0i6T47uOJkNm37rX+KjZcxKWo9ELNtf+4mPDGZUwZnb8stnxy4oNJ3c3/n1ae4gH3s7ZVld+CgABz7kPjRh/SP0PAOxp/HtC9MUSyuWm9T91qx0PBkeMcY4HFg98helckT6/1lLWbGs0s3oLa2Z4u52ztRbgd2R01EUCUvR71ecGRssDX6A7WqA7KqXkuZHTJkRfHCf2UjPRxZd32vgZg2ZdMmrrH8defuin955Z2y8rTioTmYzWsqI6o94CAJetnDxqYt/KI2FYiPBy1ZeQElVW1FaRqm7Qnc0rzxnR5yakfHPuQPtsez9ZZE5EfD9ZpFwgElMCM2M3MNZSg/qstq7KpHHecm35iQSJ8sEhM52DAODoJJM5NLU1YrPYt/6yHwDmr5zaLycRAMRS0eyrJn7x7Oozhxw3jPsuIUkLvb1jMX8tGjHwy91H0KiTTacKK5snp3S5DSvH89/uPYpGXS0YloOGsK6xMezB85WOa7OSBpfWVb3XjVNGD06Ke3z1xhqN954Jbpls9t+Pnf792OnUqIgluUOWjRkaIw+hOtaw38FwNSQpPjs+prDOTWNQB73F+s+Z4vmdPdD9cfwM53Ft9slZ6XEKORoNsrA8yDhIhQIBFeDkUbdRG73nuJViT02QAkUh6eGEexi/RbHeK1y/6AN+zCQJL/1vMR9lyodmyodWmkt+Kn+33lIFAOuqvx2hmozkxLtooHJUumxgqbFAZ29+q/DhmXFLEsVpAlLUZKvd1bC+1FgAAEpB5EWxl6KvDJCT2gN/1Xzf2IV2LsNVEwcqR+1v2ryn8e9mWwMAmFjD7sa/9jT+PTRi/KKklZHCWPQ1Trr48k578MVl8cmRq77cZdCZTx8ta41L5aJr7p699IYpTttiGNZ9vKQv03MSDmxzmb/8zdubnv/8ZqIv3W0u0Na9lL+p9amApFZmjluWPqq/IsZpKxdFuobfyo59V3zIzrX0v/747O7pCVmjo13uVZiNVgCIjG+b0rvv7+NGnRkAFt44vTXoyLw3VIbPRUKB7qzjwUBlJ/MOWKAMSozLiov2sDgqy/HPrN368fVLPHd79+qTHQfLmjRo1ImIphcMx++HgDlRWbvm6Km/8wt9XJurdxnfP/WPe1e+tWn3z4dOdKJArFWFWvvulr0fbNs/e3DWtRNGdrHdRwCF/Q6GqyWjh7zy1w406mTtsTNdSbijIVdLRw9BQ8EU3gcZAOj0XIRQYPFWuC2i6YDXorqlEPXYxMSwf4tivVpYftETXbtYaC/Qf15flyLpf0fmM68V3G9mjTbOckZ3JDdyGrpRFziWbP3i/IsVpnMaW6Ojjt5ZrChxZfqjUjooy3tsq1/zd80PjsdSWpGjGJkkSY8UxEoomYgSC0jR7oa/HAX4nglJ8bTYxVNjFxXpTxxWbzupPcjwdh74fO3+IkPe9emPZco9nW518eWdQ1LkdffNuXTl5CO7CsvO1ZmNVqlCnJGdMHpKtkzRHTfXMawHNdVqTuwpLDhSomnQ69QGm8UOAEMnDrjxiSXopt3Oy7XE0DEZP8M258jR3YVvPPbznU9d1nc+ui/nb2qtKUuVRX42+ep0uZd1HQcoY/897OIr00ffuveHCmNLh7XX8rf8dNFNzpsJRQKLyWo1t10UOcrbc3Iz+mW3dbJWRMgAwGK2tUZ6NRtne6ngVcfjr8d97jqI9YDbpo979Ne/0aiTPefK3t2y919zJqMDPjtQUvH+P/vQqKulo4dEyaRoFPPfjrPnP915qOvLM4Y4mUj4xOKZV44b8dqGHbuL2ko5OoFhuQ35hRvyC0ekJt40dczsQVmhcIEX9jsYlhaPGPTGxl0M22HH6j3nypoMpmi538e6k1V1ntt/RUjEMwb2R6PB0UcOMgEv1exONtbLgufdk20HAPpCM9nu1EfeolhvF35f9FSP/FTMH3I6YpBy9NHmnQBQZwl8u2AZrbg983/vFv673lpFEwIOOAIIKSVPlKQPixifGzmtdenUwKqxlG2o+dHxeErMgvmJ17T/QRLKj7MvAohsxYhsxQgTo9/XtHlHw1oLa7Kw5m/L3vj3wPfE3v6oLr68c5Qq6YzFI9EohoWv/L2FP73115FtblYMVka5mfVblFemrtM6Hg8ZlyVXBeWT6MxLwn34hCypXGwyuBSGbP396KEdZ6ctGJ47OTstOyEyRi6WCMO15v20pnZf/XnHY6VA/O206xMlvq4xlaGI/m7a9Yu3fKSzWwDgmLryRHPV8Mi2uoOYpMjKc7V15S3Tz+srmg7/cwoALr66pWu5g81qBwBBuCwaY3K3LDjWgxYMz/l4x0HPqZxPdhw02eyPzpvWiSvnv06cfWLNJs/FO1Kh4Lbp49Ao5qeiuqbn1/1z6Hzgz55D1oD46E+uX3q0rPr/tu494LG9tS/yKmru/+HP7PiYu2ZOmDN4QChcNob9DoaZKJlkenbG1jMdtoBjOW7diYLrJ+WiA954LW9fNGJgNySI+9RBphPfd6HDxnhJuHfDu8Whm/8Z+9RbFAsP4fRF380/Dusc2YUCcw68fFN0gp2zfVL8XL21KlmScWPGf5SCSHSL4DjevJsHHgCSJf0XJ99AgJv3ooltW5vQd1JaMSt+6UjVpP8r+o+JNZgY/SntwdFRF6HbdaCLL8cwzC2bxf7eoz9s+mEPOuDRqf3nPvrvz47H1z9+2YoHF7iOB56XHK5QRM+8dNS679HSVF2zcd33+5zjrasht/fotR+hoeBYX/AyGuqybTWFrY/vHjTN92y7Q4JEee/gi17I2+B4uqP2nHPCfeDojMpztZt+2HPx1ZMpivz06VUcy8mUkpnLxrduAwB15U0A0A23X7qHGSfcQwxJEI/Nn3bb12vQAVff7TuWX1n70NypY9J9naxaq9V/tP3gL4dOoAPt/GvO5Hilm5uQmI94Hj7defD/tu5juQ5La8NYblrSlzctO1FZ+8Wuw1tOn/Pc59qrwrrGf/24bnhKwuOLZgxPSUCHe0LY72A4WTp6iIeEOwD8fvS0vwl3luP+OlGARl0Fu59MHz/I9Dp2bxXuNNnheXtgddsPwm9RrFfDX/RYt6mztMz+iRB4mbXfCbsa15WbCgFgRdr93ZZtBwC1rd7xIEM20G22HQAcTeQ7J1qUMDJyyt7GDQDQZGtb49BHXXw5hmHOTHrLo5e+fu5EOTrgzcxl4z97ehVjZwFg0w97ej7hDgDLb5+xZfURr/1MuI4nUHsYCn17G0ocD0iCuCR1uOugTy5JHfbyiY0szwPA/obz9w5qa84+Z8WkLT/vKzhy/obRj1M06UisL7ljtkTu0q6n8HgpACSkddgyvnex4IR76JkyIP2qcSN+OpiHDrjKq6hZ+dkvQ5Pjl44ekpuWnBUX7baxe5PBdKSs6p8zxX/ln/XQWqHV1Oz0qyeMRKOYz0w2+wM/rdtVWIoOdJmAoiRCgURAS4UCieM/gUAqFDQajEfLqtGte9rwlIS3VyyqUGt/Opi3+sgpbdea9p6orF3x8Y9XjBn+yLypMhE6KbVHhP0Ohodp2RnRcmmTwYQOXHC2tuFsbWNOgh/f6TsLSz2vgZmTEDsoMQ6NBg4+yPQ6lLc0dxfTeb4LeE9nt/BbFAsP+Ise6wobZxGSLmmE9s4bz5wztNRC5ShGuowFQpH+BABQBBUjbGuQ2w1aG8gYmJZ+EYgjzTu6spgqAFjYllO7zvWg7+LLPdjy+9Gje4qW3DBlwBA3VXF/fLf34I6zV9w8bcSETHQMw3ohjuVevOXjTmTbAUAZLR80pn/+viIAqCltKD9b41gvM3i8J9xjE1W3Pb743Sd/Qwf6hjpzy9rx/RUxUaLO1JirhJJMRWyhrh6c/jSHEVNy5qyYtPnHvY3VLX3eM4emLr9vnvM2AODoMzNwTH8k3kt11FLm/aJ1jgfXpc9UCvz7p97fVFBnaQaAsVHZSZLA36vvCx6dP+1waaWH1VNbnayqO1lVBwAKsSg1KkIpESvFIiFN6cxWncXSqDdVNrs/0XGrf2zU68sXuE3cY74wWG23f73mWHlnLvtJgugXrcqIiUyNUiVHKmPk0hi5LEIqVohEcrFQKhR0lLL58/iZkE00pEZFPDJv2r2zJv2df3bV4ZOd+5dx4Hn45dCJ3UWlb121cFjIFIiF/Q72dhRJXjJy0Je7j6ADTv44fvqReX4sU7b22Gk05Cqo5e34INMbeW3RznBeSuB7EfwWxcIM/qLHOmdd9beV5uLhERMy5UOTJBkU4fJFYGC0h9XbttSt4ngOAIZGjI8VJTlvEBACQggALM+uq/56auyiCEEU6frXCJIUSeZh2A4Ap3WH6ywV8eLU1iEe+INNW9dWfdEacWtr3Wq1rW6EalJ/+WCaEDgP8cAfUe84rmlpXpEtH+E86tDFl3fFgW1ndm86mTM81W3CXRkpO7K7MDJGjhPuWHhY9+WOw1tPtT6VyEQzlo0fPWNw+uAURYR0ec6DTtu6MXLaIEfCHQCO7TzT8wl3AJh/1fjmRv2372xCB/qARqvB8SBG1Pl+FzFiuSPh3mRFG4c9+M71A0dn7Fl3DACGTcpeeudsodjlAJ2/r6i+ogkApl82xjnee5lZ98UaP5fvcDy4LGWCvwn3bXV5f9ccBoDbMxdckz4DHcZ8IBbQn9249LpPf61Qa9CxDugt1tPVLdP3OicjJvLLm5YpxCJ0APMNy/H3/fCnX1diFEmOzUiZ0D91THrKoMRYidDlgBM2xAJ6Se6QJblDShrUq4+e+vP4mQY9evj1UbVGd+2nvzy/ZM7ikYPQsZ4T9jvYqy3JHeI54b4ur+DBi6dSvi1+o7dYt59tmWznFk2Ri0YMRKMBgg8yvZTQW4t2uw/zzwIi2A1e8FsUC1f4ix7zH19pKq40FQMASVDRwjgZHSEghQxn19qbmm0Nji7nAJAg7nd5ym0uLw2QsdEzC/THAGB341+7G/9yHhKQQgWtSpVmjY2ake2uuN7AaI2M3sKaLJzJwposrMnOtXRZyNceaLTWiimpmJSKKImEkkYIYpzvKIyKnLqp7hcTo7dx1ncKHxummhAnSiYJqtlWf1Z/vNnWICIlM+OXbqptad/cnpUzH1L/c0j9D00IEsSp0aIECSXjgdfbNZXmYp29pT5yQvScOLGbvHYXX94VJQU1ADBmWjY6AAAAQ0enA0BBXlfXh8CwUGAxWX98Y33r05FTBz760c1R8RFOm3gxcHRG6+NzeWVOI0HhU8IdAK6+Z3ZGTuL7T69pqtehY2GttQVYV1Zdb32l436yM4IkFt4wfeENbX1mEEPGZf5R9T5BEAKhr7+sEGdmTGioy2LFKseDIkNLTzqsE+IU8q9uWnbDF6t8z7l3RW5a8jsrFkXL/bu5gjl7a/Pu/cW+TqfKjIu+ZsKIeUNzVFIvs03DSf/YqIfnTn1gzpS958rWHj+95fQ5r2sJtmdn2X//tsHOckGtI+6csN/B3igrLnpocrxjJpBbDXrjvuKyKQPS0QF3/s4v9Pw7nZHTP1IqQaMBgg8yvZRI4OWk0WSzcTzfDdPLTFY7Ggoo/BbFwh7+osd8JCTbapg4nm2w1jS0a6JCADE66qLFSddLKBkyFBADFbkjVVOOa3ajAwB2zqa21att9XmavWOiZlyReifSbP2r86+Um1oqTxE76v9AIndlPZcua6s2kFCy69Mf+er8K2bWyPD2Y827nLaFCEH0tWkPJEj6ba79pfWuA6K1KQ3D2yvNJZVmtNaBJMjJMfMXJq5E4g5dfHlXaNQGkiITUqLQAQAAiIpVECTR3OjSaAHDeqmDm/KbG1oy0umDk5/54R6RpOWj56PUAW2TvSrOdXixFiheTsedTZwzZPS0nM2rD29dc6Qgr5zn3B+qwkyUSGpibADQ2K443Xetr432v0yepEhhxwvSBoPjS6ijxUa6rqMK966IErb8w5Yau1RwjSWqFKvuuvrJNZs3nXJ/uhMQJEFcO3HUw3On0t373g4zp6rrvvJYRdsqXil/eN60BcNygp9aCVEUSUzNTp+ana4zW/7MK/j54Alfuic543n439otSSrFhMx+6FgICPsd7HWWjh7iIeEOAL8fO+1jwv2P46fRkKslQcue4INM7+X1HgzPg95ijZAEPe9stgcx4Y7foljfgb/oMa8WJV0/NGJ8kf5EpblYbavX2ZvtnI3lGSEpltLyeHFquixnpGpKlDAOfWWA7GvcuLH2JxNrIAkqWhgfIYgiiZZ0E8czFtbUYK2xcmYAOKzelizJmBwz3+X1XZMhG/RQzlu7G/86qzvWZKtleVZKyWNEiYOUoyfGXCwiJQCQIO5XY3Ff0zon/or+skFndEcd/3omRs/wdhIoMSWNEyVnyAflRk7z0ISniy/vCruNpWmS6uCymqRIoZC2moP4XYxh3ebItrZmMjc9udTfbDsAxKZEUTTJMhwANFSq0eFA8yPhDgBCEb1wxYSFKyYYtOazJyrKz9U11mp1GqPNynBMS+22XmvK21/s/Krh4zOVqt5axBonVlQaNQBwTtegs1uUAr+vTHR2yzldg+NxvEThOhhaKs1VX53/5ryxlCCIgYqcmzKujxK63Cn94NzHzk87p9rix7RfHynpljeYzt75+yKYg0IsenvFojVHT727ZW+drqWlUgANTIz93yWzRqQGt1tWX/Diuu2+rHo3LTvjlSvmdUNWpVdQSsTXTBh5zYSRh0urvt179J+CYtbnm8csxz22asPae1eGcmlk2O9gb7Fw+MBX/tppZRh04IJ/zhQbrDa5t1XsKtRaz32iY+Syqb4l7jsBH2R6ryiZl4Q7AGhMlm74rXVx1UfP8FsU64PwF30Yuz79UTTkzpyE5XMSlqNRAABIlw10rvvuTtvr1/5V8x0ADFTmLk2+VSV0szg8x7N/1/7gKFc/qP4HSbjfM+BF56edoBRELki8ZkHiNejABQ/kvI6GnGTKh2bKh6JRn3Xx5Z2mVEmb6nXqBn1UrJtck15rslrsEVFBmdCAYd3s7LFSxwOJXDx6RmdKjgiCkMjEBq0JAEx696tLBpB/CfdW8gjJ6KnZo6e6aRRVVdp4y5xXnSMr/zV3yJh050gvMi4m7WhTBQCwPPd35ekrM3LRLbxZX3GSvdBJZmJcW8OgEPTF+a+KDSUAADzka09+fv7LR3Iect7ggPqg89PQIaRa+m/q7UH/zPQRS3KHLBie88P+vDc27vLlatYXw1MSbpk2dtagLFxf1nVHy6p9aVl78ZABb1y5oKM13zotMG+IHjUmPXlMenJls/aznYfXHD1lZ32and2gN769effTl85GB0JP2O9giFOIRbMGZ/514iw6cIHFzmw6WeR1av/f+R3+CQ6XjBoU8A+4Az7I9GrRcu+X1rVafVq0Co0GFMfzGlOwTszwWxTr4/AXPRY67Jx1S92vACChZNek/ctRTt4eSVBz4q/YWf8nD3yj1fsBHPNF1pDkpnrdzr9PXLZyMjoGsGfTKQDIHBiU4noM62bahpbmSGkDkyi6k6d2YpnIkXC3WoI+86OTf0UPYvzpWB/6psZntT5+9/S2ZpvJadC7Rqvx3TPbW5/OSsxpGws9lSaXBuhFepeZCqHMxrZ8VFrvbWBdd66+6Y/jp7uYbScIyEmIvW36uD/vW/nTHStmD8bZ9sD46WAeGmonJyHm5WXzAp5lAACLvcO63d4lJTLi6UtnbXjgxktGDvLxnfnbkZMVai0aDVVhv4OhbEmul2T6n3ln0FA7G0966e61ZNRgNBQg+CDTq8UrvfcwrGpuaYIZPBqT2ffaW3/htyiGAf6ix0JDraXCxlkBIEmS3lG23YEmhARBAoCA8DLJD/PR9AXDAeCbdzefPoZ2yzl3uvqLNzYAwNR5w5AhDOuN9JqWhhYKlffKko7YLC2rMUvlQZ/s1ckKdw9EEoFMKTHqglXP0s1yo1NzIuLPausAoNFqXLnzm88mX+NjZ5hqk/aWPd+rrS05+vGx6UNUId1GI04cW2GqdH7qNBjSio0tC8LI/e/5g7n1zd6jr23YxXLub2BkxEQmRyqrmnXNJrPJZrezLEkQAooSC2ilRBynkCVEKDJjo7ITYkekJkTJemtHqZDFctyOs+fRaDtPXzpb7G3dvM6xBLMnb/dLVCleXjZv2Zhh//ltg9cMFMvxPx3Me2TeNHQghIX9DoamiZn9EiIUtdoOV6k6eL6iVqtPiOjwjKK8SXOmxtPCJMNTEjLjotFoIOCDTG/XLzqCJAjPt8zLg79AevCSevgtimHO8Bc91rMcOXQAsLJeskB5mr0czwJAvDgVHcM6Zdr84X9+v+/M8fKHr/14zJTsIaPTFRESo8F65ljZwe0FLMtl5CTMunQU+jKsz+M5tanOzRtDFPEKLb0KjYYGqVKiazIAgNXckjT3F8dyBm3LYUoZ5b08pYuCcg4aE68Mm4Q7SRAPD511654fHE8LdfXzN79/a/bkpWkjPaTdq03aVWXHvijcZ75QeU0SxL+HXey6Vci5Pv26j4o/abQ2AUCsKOb69OvQLS6IFEZGCJRo1Ddau67Z1oxGu0DPmDfUHHE8ThIHJfXQp3A8/9Tvm1cfaVuPwhlFEndcNOG26WMFFIWOYd0lr6JWb7GiUVcTM/sFr1F+vT4MF0sYk5686q5rbvxiVUFNAzrm6q8TZx+eO83HOrLQEfY7GGpIgrh01OCPtx9ABy7geVh/4uzNU8egAxdsOFmIhlx57UjTafgg09uJaDpJpaxs9pTv9noo6LrSxkCe7znDb1EMaw9/0WM9JV6ULCTFNs5SaS7Z17hxYsxcdAsAhrcfUm9bV/2N4+m46Fmu41gnURT55HvXPXv3twV55Yd2nj2006UbYUZOwtMfXi8QBiXvh2HdLDJW6Ui411c2oWO+KT5ZwbEtRaUxSZGug4EXlA9edHxEWVEdGu21psVnXZE+6tfSY46nRsb29ult757ZPigiISciLkUaKReIRBRtYe0Gu7XMqD6rrS/U1iE1RY8MnT1YleAaCzkD5Fmvj3hFa9cRAEqBkoAOz8IWJs6bE9/J3n8bazf9UP4zGu0UludOaM6/V/RHk7WllGOYKt1lC8xPPA//XrVhXV4BOgAAABES8XvXXDI6PRkdwLpXQa2X6ygAuGTkIDQUOF6Lp3qpCIn4ixuXXfnRD56rMut0hvON6v6xUehAyAv7HQw1Szwm3AFgXV6Bh4S7534yIpqePyxYferwQSYM9I+N8pxw9zx/IiDO1Xfycsgr/BbFMLfwFz3WIwSkaEbcZRtrfwKANVWf7Wn6O0s+TCWIJgma4W0Gu7bRWlNqKrBcqH8frpo4OnK6yx+BdUFktPzNH+7YtTF/z+ZTZUV1RoNFIhWm9o+bOGvwRYtG0DSuk8PCRHJmfFlBNQDUljXWV6rjUvz+Fju0+WTr42GTBjiNBEVQEu4x8Z2sfQ5Zz4xaWGfW76w71xrheP6UpuaUpqWTiWc3Dphw04CJaDQkEUCoBN678MvpDqv7vZJQUr1dpLZKAWDRzv+hwwC3HXyX8K3iwsRYGd5lgaAFiWOdn2L++mDbfg/Z9u9uXR6k9gWYX843qNFQOxOz+qGhwOmGNE1PUUnFz14258YvVqEDrk5W1fXSy9Sw38GQ0i9aNTo9+Uipy/oozs7WNhTXN7k9rlaotZ4/aHOGZCnEIjQaIPggEwaGpcTvLPTUdKVBbyxv0vQL5rqp+ZW1aChA8FsUwzqCv+ixHjEzfinD27fX/87ybL2lqt7i/uRHTEkvirt0RtwSdADrGoIkps0fPm3+cHQAw8LIuNnD9q5vqYT+49N/bnlmmeu4F1az7c/Pt7U+HTU9iJUZDkFJuEeF17qpAEAR5IcTr3rj1NYvi/Z5aofZjpiinxgx/4p0N62RejUF3fluR1JKwvMExxMAoLO7WYRWz3SyH9ElyRMy5KE+jSCU5VXUfLBtHxoFAACCgDevWug2K4R1vwZvM9mVEnGcovMfUs+aTebyJg0aDSPj+6eO7Jd4vNzT/dSK4Pc+Dp6w38GQsjR3iIeEOwCsP3H2vtmT0CjAplOeytvBh0VZuwIfZMJAbpr36Wj7S8qDl3BnWO5UdbCy0vgtimEe4C96rPsRQMxNuGps1IyjzbtKDKcarNUm1sBwdgEpFJGSSGFcvDhlgGLYQMVoMSVBX4z1EpbmW1nLJjTqBQWEkCDEBKkiyBiCSiLpLJLOIYVjCBLnFjD/jJ87nBZQjJ0FgN8/2Tpx/sghE7LQjTr2zoPfNTe0zFBMyUoYMs6P13ZOUBLu4VfhDgA0ST42bM70hKz3z+w82FiGDrdDEeT8lMF3DZyWqYhBx3o/eRcS7hJaIqYYucBmZmiWb1lfpetmxY+8P/tSNIr544V12zpaX23xiEETM4NYKYb5xWj1skhIrEKGhgJne0EJGgo7Fw8Z4PkytdnYyfuCISLsdzB0zB2a/fy6bWZbh+srbjhZ6DbhvtFjA/dElWJ8/yCuNoYPMmFgZGoiRZIdLX7usOV08fKxwaqGO1JW5fWN1Gle/2T8FsX6OPxFj/WIKGH87PhlEO9f2SkW1ljgzTxv5rlmAJeJdySdTYnn0ZLLSDrTOY5hHYmMUy6+ecaaj7YAAGNnn7jynfvevG7G5ePQ7doxGyxvP/DtjjWHWiNXPTCfIH3qq9EVQUm4R4ddhXurCbEZE2IzTmtqN1efOdxYfqK5ysIyzhsoBeLc6NSxMWkLUoYkScP230Eh6EpLGYmQYmIpAwA8Nfj5w+qiw+rCPE2J5cICs36JEMhGRPZfnDR+fHSwWtn2EUfLqk5Wdbj0wvWTc9EQ1nOsjMthpz2JICjHdoe/TrgsxROW+kWp0JArK+PSzKrXCfsdDB1SoWDe0Ow1R90vQw0ApY3NZ2sbchJinYM1Gr2HAzIAXDZqMOlb77XOwQeZMCARCkb2S/Q8wWJfcbnaaI6SBaXYMKhZafwWxTDP8Bc9hmEhjmMKOUOh3fB/lGi6UPEvUhBubSGwYLj6oYXbVh3QNOoBwGy0vnL7Z6ve2zRr+YRR0wYmZ8UjG9us9sJjpYc256//eqdB09ZdY8j4rJnLxjttGCxBORmNDscKd2eDVQmtK6Aa7Fat3Wxi7HKBSCWQSGiB67bhqSstZSROk8gy5YmZ8sQr+03T2U2t/dw/GXtfosR7S0ECCCktogm8Bkhg/J3fYTWlSioelBiHRrGeI6K9HLoN3kr/Oq24vmlvsfcpPr2dTCREQ67EwUzldIOw38GQsiR3iIeEOwBsOFmEJNw3n/bUT4Yg4LJRQewnA/ggEy5mD87ynHBnOW71kZO3TAv8+jcMy6074X5JmIDAb1EM8wx/0WMY1kvwrHW72bqDliwVRjxLEJ1PNGF9gSJS9uxP9z126etmo9URKc4vL84vBwDnlSCPbj+9LOtfzkn2VtEJqie+vIOkAtZsw4Og/IyY8K1wb08uECVLVQOUsYkSZdhn22/PvOX2zFvuyLxNSHo5h/NA6q5rm1IgTRBHOh4rBJIIgczrf0qBFGfbA+hoWTUauiAhovMTGrBgkAq9HGo0pmBNE37vn/0d9R0KJ2qjm+9mZ/KgLVbZPcJ+B0PKmPTkVI+VhltOty3J7rC5XcTZmPSU1Kjgnmjhg0x4mDPYe2/Kb/cds7OBL3TdfLqoyeDlONMV+C2KYZ7hL3oMw3oVnjH/Zm6YzzGeik4wDACyR6Y9/f09ymj03gzvdH5mNdvcZtsT0mJe+PX+yLhuqhEPyp1tVbT8uc9vbn2ano0W9mO91KToiWjIf84V7s4y5Um1lmY0inWXGm3L8hHtee2UinWzOCX67YLQmi3B6BKw91yZ577SYcNzNw8ASInspi/pIAn7HQw1S3IHv7tlLxq9oLi+6Xxjc0ZMy11ntdF0rOM7oBDk5VId8EEmPCSplGPSkw97LHJv0Bu/2nP01oAWuXM8/8G2A2g0oPBbFMM8w1/0GIb1Ojxbbmm6Uhz9A0kPRMcwzMmIKTkf7njq9bu/PLbjDDrWsbGzhz3ywU3KqCAu84MISsKdIIkx03BDbcw9ISl8bmhL9xhnWYrEPY2eJt1jQWXqeE2/qmZdeZOmX7QKHcB6SIq34laeh/3F5QuGB/I43Ggw/nvVRjQajliO33zKU30xAPSP9d72KmSF/Q6GoMtGDX5v6z6u47LY7QUlGVNGOx7/c6bEw5ZSoWDukAFoNNDwQSZsXD1+pOeEOwB8tP3AgmE5yYHLvv14IK+4vgmNBhR+i2KYB/iLHsOw7kRLrwJw23uABc7A8wae0/JMEc8b0PF2eK7Jor5RErOOIKPRMQxzEp2geum3B/L3Fq7+cMvBzSdYhkO3uICkyFHTB614cMHQCUG/hkIEJeGOYZ71k/ZDQwBZ8iQ0hHUjmVBoY9zPv+Z4/tk///l45WUUGZQmVJi/fGmpv+FkYQATDXqL9a5v1zYajOhA8FU2a5NUyqCuD4lYc/RUZbMWjToRC+ghSQGbuRX2O4gBQEKEYkJmv73nOuz7vP1syY0XEu5bz3jKkswbli3x1kyj6/rUQSa8zRmSFa+U1+k8XeKabfYHf17/3a3LBZTbq2X/FNc3vblpNxoNNPwWxXoR/EWPYVh4EymfBcJrlyqeY8o4+3HGvJq17gLoMD3Ks9VW7b/FkZ+iAxjWzrBJ2cMmZZuN1oLDJWcOlTRUqQ1ak1FnFkmEyiiZKlY5aEz/YZOyZcoAT3n0EU64Y6EiS5EopoQAQED3nY9irVKiIpo7bni691zZtZ/+8tQlM325xMWCbVhyPEWSLNfhaQoAbD1z7nR1/eCkAPy+1EbTXd+u9To3OUg+3n5wX3H58rHDLh89NFouRYcD7Wxtwyt/70Cjrib07yekA5CWcgj7HcQcluQO8ZBwP1pWbbDa5CKh2WbfX1yBDjtZGvx+MtDHDjLhjSLJW6aNfWHdNnTAVX5l7aO/bnh9+QKK7NI5WJ3OcPs3v5s7njMXKPgtivUi+IsewzAMgCDpdJJOpyWX8WyNTf8SY16LbnIBa9nEWrdRohnoAIa5I5GJRk0fNGr6IHSgp+F61U5ieU5jMzdaDP7+h/5B2AXJkphNF72w6aIXkiR49lAPGJmaiIZc5VXUXP7+91d+9OO7W/ZuKygpqmvSmi0WO9Nx5wMsWCRCwfj+qWjUFc/DE2s2db3/fl5FzRUf/nCishYd6EbVGt3bm/dc9Oont329Zl1egYf2R110oKTixi9Wef1HWzI6wBnPsN9BDABmD85UdLxCHctxh85XAMDe4nIrw6DDF6RFq3LTktFoEPS1g0x4u3LscF+awm08WfivH//syi/0dHX9VR/9WK3pcEmYAMJvUax3wV/0GIZhrQgqUaR6Vxz5OUF02E3bZngXDWFYb4Mr3P3QYDH8WnrsYGPpqeYand2CDvvm7NKn0BCGhYD5w3K+3XcMjbaTX1mb7/81J0USQpoW0VSUTBotlyarlJlx0TkJMSP7JclFQnRrzAfzh2V7qJZ1KKhpuPeHP99ZschDms8Djcny0fYD3+075qGddHdiOX53UenuolIRTU/ITJ0xMHNadnpChALdrlNqtfoPtx1YdSTf674mqZQzB2ai0UAI+x3s40Q0vWB4zs8HT6ADF+wrrpgxMHN7QQk64KQblktt1QcPMuGKpsiH506974c/0YF2tp4pXv7hD/+7dPa4jBR0zCOj1fb5rsOf7TrEsJ5KzgMLv0WxXgd/0WMYhrWixLNFkZ9Ymm8A3s09SM52lLOfJgWD0QEM6z1wwt0nLM+9dWrbV+f22zkWHcOwsDCyX+L4/qkHSjy1Mug0luPNNrvZZteYLCUN6kMX4hRJDEmKnzs0e8HwnHil3PklmGcLhw98c+NuD12AHPYXl1/y7jf/u3TW9Oz+vvcOLW/S/Ho4/+eDJwwdVEgpxCKpUOC5KXDwWBlmx9nzO86eB4DUKNX4/ikjU5OGJMdlxUX7u8yA2mjaU1S28VTRjrPnPbcmaPXQ3CldbLngVdjvYJ+1NHeIh4T70bIqANhdVIoOXEASxKWjuu+qoy8fZMLP7MFZC4fnrD9xFh1o53xj8w2f/zo9J+OaCaMmZfXz2nX6bG3D+hNnfzmUrzO7r0Tx2kG+0/BbFOu98Bc9hmEYAFCiKULFf2y6Z9EBAABgLOuFOOGO9WY44e4dy/O37/1pV52nRcwwLAw8fensZR9873UWagCxHH+isvZEZe2bm3bPH5Z9x0Xj+8dGoRsFh8XOGKxWvcVmsFj1FqvBajNYbHqr1WCx6i02vcVqsFjP1DSgL3N1oKTi3u//UIhFMpFQIRbJRUK5WCQXCV0jQplI6DVn4S+xgL5+cu7bm/egA+3U6Qx3fbs2LVq1dPTQMenJgxLjxAI3R/4mg+lMTf2x8uqdZ0tP19R5KI8S0tQH1156srrulb+8dAjtBhVqTYVas+rwSQAQ0lRatCotOjI1KiJGLouRSyOkYhFNCyiKIIDleIvdrrdY1UZzrVZf2thcWNdUodagf6JHUwakzR8WsCX4fBH2O9inDEtJyIqLPlffhA4AAMDZ2oaCmgYP+btJWf2688YkPsiEmScXzzxcWuXhDebMkQqMkIjH908dmBibHh2plIgkQgHDchY702gwVmv0RXWNeRU1nv/AiZn9nr501tw3v0QHAgG/RXv7mYxXHM8brTa9xaq32IzWCzvVtss2g9VqsNi8zj94Ys2maLm0o12Ti0QKsVAmEopoN++KboC/6DEM68sE0pV245c866bsj7XuBsUjaBTDeo+eObHoXf7vzHacbcf6grRo1f9dvfiu79Za7B12EA4SluPW5RX8nV94zYSR/5oz2e2VcCfsLirbcbbEYG257HRcmzkuSgMy7b1Bb9x6phiNtkMQIBUKHVd6CnHLA8cl3x0Xje/cPHcAuGHy6NVHT5U3adABd8qaNG9t2g0AFEnEKxUKsVAuFpEEYbUzeou1VmfwcY07goCXL583Oj1ZLAzM7yiAbAxbVNdUVOc+m9l18Ur5K1fMR6PdKOx3sC9YkjvktQ070SgAALAc/84WT6nD7uwn44APMuFEKRG/e/Xi6z//1feveK3ZsulU0aZTReiAb+IU8teWL4iUSuQiYUd14l3UF96i4X0m4/D25j0ak7k1n25oeWAz2Wzecuk+8XH6poCiFGKhTITu4Lj+qXMGZ6FbBwf+oscwrM8hBALZLTbd/9A4AMecAt4GBO5Ai7X48Y31ABAVHzH32inoWGcxdlbbqAeAyDglSfk3ycyr7jhT7NXUVtOXRfucI1JaOCNhwJDIpCihVEgF4B/QarbtWX+s6HiZtsnAMp5a1vzn01vRUGhgec7Mmlje01/erQhBBBrCetSEzH7f33blgz+tL/Pt8jWwWI77Zu/RfcVlb69YnBETiQ777+D5iu/3H0ej3Y7nwWi1Ga229pWAV48f2enLVCFNvbJs3nWf/eLXJTfL8Z1e0Y4g4IlFM+cNywaAgQlxwcuhhKBIqeST65dGSiXoQLgI+x0MEZeMHPTmpt0dzfp3tBdwSykRzxrUTRmfVvggE2aGpSS8esX8f/24zmtFcNfJRcL3rr0kSiYBgOyEmKNl1egWgdAX3qLhfSbj8NWeIzaPV0Ddw86yaqNZbUSbFFnsTLcl3IMKf9FjGBaaKNE0NOTA2zm2kqT7o3E/8Ww1Zz/JMadZ+2merQVey3M6ntMBABBCgpATVDRBxpN0f5IeRApzSTpEjvksazvIWndzTAHPFPOclucNADxByIBQknQ/gkqnBENJ4ViSzgTo7lloPeLrl9YCQGScMiAJ9yPbTv/2/qYTewsZGwMABEn0H5wy44rxC6+fJpGL0a07xXu++MNnf49PiRo7fWBqZhw61gesLT9hYdtKgS7tN/zJEfMVgi6dVjo7su30K3d8pmtCT17dCqmEu8au3dmw64yuoNRYZmJN6LBvvh73eevjb85vcRrpvJUZs9EQ5o9BiXFr7rnu36s2dLqorYuK6pqu+/TnT65fOjipLx5z/DIiNfGJRTOeXrsVHQgCiiRfWHrxJSMHXXhKjEpL2lVY6rJRmIpXyj9auWRAfDQ6EC7CfgdDR7RcOi07fZvHlVHdWjg8R0hTaDT48EEmzMwenPXi5XP/u3pTR3d9AkIiFHy08rKhyfGOp9nxsUFKuAN+i2KYb/AXPYZhIYuk+xNUEs+6OVXg2UroZMKdYa0HWOsmxrLJ7Z/cgmd43sRz9QBnWOt2R4ygkmnxQoHsOoLq57JxF/C80VSL9qOXxG51m9znObXd+Clj+pHnmtExAJ7XAGhYthxgtyNTSZAxlHguLV5IiSa7btv9eKv2P4zpRzQMAAAC6XXCiOe6fm+guV5nNdtEki5NffjkqV9Xf7DZOcJzfPHJiuKTFeu/2PHYJ7cMHJ3hPNo5XhLuZqN13Q/7OZb79KV1ccmRY6cPXHDV+P6DktDtwtehxrLWx7MSc14Zc1lX3x1Oqorrnl35gdUc3NKYgGN57rfK1RtrNzO8r7OSffFZyUY01Ck44d5pHM/vLirdcvrc9oLzjQYjOtyN1EbzrV+t/umOFalReA6EF8vHDjfZ7K/+7b5JRaBIhYLXls+fMTDTOTgmPaUvJBpy05LeXrEoRi5DB8JF2O9gqFmSO6QTCffu7yfTCh9kwswlIwcpxKKHfl7ve28Zv0TJpO9evSg3Lbk1kpMQ4zQeePgtimGe4S96DMNCHEklse7S4jynQUPecEyR3fgVa/mT57TomG94tspu/MRu/IyWLhMq/k2QwbpVybM10C7hbjd9Y9O9BLwfJa0818iYvueZsz2dcOet2v92mG2X3SRUumkc1Dk15xvSBycDAMtwVcV12ia93cZExCiS0mN9KU5f++k/SLbdWU1Zw3+vePutDf/ul52IjvnJS8L9zLEy7sIkzfqq5vU/7MsZkeo14X7qcKnz04yBCVIf9jk0FerqWx8/MnR2ALPtAPDbB5sd2fbJi3KX3zc3dUCiVBHq/1Acz71V+E6+9iQ6gPVmZpt9zbHTX+856u/KS8HTbDLf+/0fv951tYDqgaLO3uWGyaPjFPIn1mwKUvZkUGLcm1ctTItWIfEx6W35lOCRibp077orxAL63lmTVk7KpcjAHvtdhP0OYoiLcvpHySTtuxZ4MCA+urVYuEeE90GmD5oxsP/Pd1z98C/rA94qekhS/P9dszghQuEczA5ywh3wWxQLbfiLHsMwzIuOktq8BY10iGet/9iNX7LWXehIJ3GM6RfWsl0U+SElHIMOBgLP1rg+N1s097CWTjZ+oEQz0VC34q3aJxjT92gYAAAE8juEiv+g0S6oLm2or1Kv/3LHsR1nbNa2NXhoATVkfNbld188bs4wp81dGLSmr55fg0ZdGXXm52/46KNd/+tiV3cvCffzBa7vAIABQ1KQSHsPr/jA+enrP941ZEy6c6QX0dpaLolTZKoMRQdHgc46vrMAAEZMyXnyqzvQsVC1pmptyGbbhSSdKo1Fo5g3G08WPr9uW5PBj5uo3aOwrvGTHYfunjkBHcDaWTA8Jych5ok1m/Mq0IN2V4gF9MpJuXfNmOC2l8Ww5ASxgA5SdqPVY/Onj05P/mznofzKWnQsaGiKXJo79M4Z4+OVcnQs0MJ+BzEETZGLRgz6Zu9RdKBjPVje3iqMDzJ904D46F/uvPrdLXu/23fczgagfbZYQN82fdxNU8a0/1Vmx8cQBAS7bzx+i2IhC3/RYxiGeUYQXT5S8YxV+x+erUPjXcNz9Rb1deKob4ORc+e5ti8FntNZm29gbUecxv1DiWehoe7D27RPMqbv0DAAAAjk9woVD6PRrnnngW+1TXo0CsDY2bzdZ/N2n52yOPfRD28WigXoFgA71hwyG62Ox7SAuuG/l01enCuTS6pK6v/47J9tvx10DJUX1mz99cCcqya2vdJ/3hLuhS6nBUKxoF9W3+qqbGRafhMp0gAs4YhorGkGgNlXTUIHQpWe0W+o3eQcEVOikaoR6dJ0hUBBE17eTp6tTPd+gGB5zsRatXZjqbG+zFjH8i3TLy5OyL2x/5xEcTRJ4PINP2hMlifWbPrnTDE60IFouTRCIlaIRQqxkCK93OvjeWA5juE4s81utNmbjWaNyezvQm1f7D589YQReH0nX2TGRX9/25Xr8go+3La/62veCmlq4fCB982e5OE6jabIEamJB0oq0IGAIgiYMzhrzuCsorqmtcdPbzl9rrzLe+dBQoTi8tFDlo0Z5mHHAyvsdxBrb0nuEN8T7hRJtvaM7lnhepDps0Q0/ci8aVePH/nu1r1/55/1a91RZwKKWjg85+6ZE5MjlegYAADIRMJkVURlcydndvsOv0Wx0IS/6DEMwzzjeTfJUwAAwucOEIRAIL3Jpn8JjXcdb7I23yGJ3UCQAZ6xx7VWuPO2LmbbCSqJpAei0e5i0z5lN32LRgEAQKh4WCC/F412mdtsu7Pdfx7VNxtf+u2B9iXqjrpnhyvum7fsnrmOx8po+aCx/fvlJH394u+OyJoPNwc34V5X6dKkPy0rvv1fN7xJaKHBbgUA2lt6sRMoigSAhH4BLpwPnj2N+2xcW8f5yTETr0u7RkIFJhl6S+Y8NOSR1m7cXHv0q/NbdHbT5tpj/aSxuHu7X+p0hpu//K2kQY0OuEpUKS4ZOTi3X9KQ5LgomRQd9gfDcjVa3bn6pvzKut1FpServN9/NtvsP+w/fvfMLh3m+g6SIC4ZOWjRiIF7z5WtOXp6V+F5g9W/JSKENDU8JWHh8IHzh2UrJd7Pb8akp3RbomFAfPTDc6c+PHdqeZNmX3F5XkXNicra0sZmf+/itCegqEGJsZOy0i4a2H9YckJP3bYL+x3EWuUkxAxOijtd3dazzoPpORldPPYGUHgfZPqm5EjlK8vmPTpv2uqjp9bnFRTWNaJbdCwnIWbOkAFXjh0eLffyFs1JiOmGhDvgtygW2vAXPYZhmHvuVgcFAIL0Y0U3WnaN3fB/PG9ABwAAgCDkpGAwKRhKUMkEGUEQKiAontPyXCNnz2NtBz1Ux/Ncg033kkj1BjrQNa0tZazahzvKtpN0BkHGAhlJkBHAW3hOxzElPFsB4PLFQYu8V68GiU37pN30DRoFAACh8nGB7HY02l3ydp/98c2/rnlkERIvOdl22jbtktFOIwAAVz0w/8DGvIIj5wGg5FRlfaU6LiUK2cZ3BO/xC/7m2a9Ul7W1dxwzLee5z292Gndv/oBHnZ/26pYyi7Z8VKSrB4DBqoQ1M29Dh7vmtkn/Ky+s+e8Xt09t92sOTe8UvXe0+ZjjcW7kqPsG3E10eYnhLmqy6u458mGVuREAHh985bzEwM/0CUu1Wv21n/5SrdGhA04y46IfnTdt8oC0IM0bOFff9PJfO/aea1uX2K3UKNXGB29Eo5gPWI7Lq6jNr6o9W9NQ0ayt1xk0JouVYewsK6RosYAWC2ilRJSkUiarlKnRqmHJCUOT493Omg9ZVoYpbWw+39Bc2ayt0xl0pqZY2dFkRXG8vCZK2hwhMoloO01yNpayMAKtRdZsUjaa4tSWfjrbQIloSL/oyMy46EGJsV1ZKsBi+t5s/IJlykkyVii5WKZ4lCC85J58h+xgg97YZDQZLFa9xWa02mwsy7Acy3E88DRJCWlKRNMqqThKJolRyPpFqdKiVV3fQaxz9JqHLa6rBomlKxSq150jvV1fOMj0NU0G077i8oLahvMNzeVqjdZkMdlsVoYRUJRMJFSIRSmREVlx0dkJMRMz+4V+/Sx+i2KhD3/RYxjWW1iab2UtLg0PHGQJhUCI0Kg/TPVTebYcjQJIYv8h6Uw02jGb7gW78ROnAEkJcynRHEo8m6QzwVPyimMsG+36tzmmrfzZFSGJ20FSaWjYNzxvNNUORoKkYJAkZoPd9I1N+yQyQosXUOKLKdFkt2X1PG/kbMdY6zbWupVjzgOAOOpLf3u485zaVDcKjQKIIl6hpVeh0Q7YdE/ZjV+jUQAAECr/J5DdhEa7Zl6MS0o2uX/copsuGjYpOzpRJRDQWrWh8Fjpxu92H9/V8kuUyETf5b8qU7qUCC/L/JdBawIAgiD+rP6AFqDfnjvWHHrp1k8dj+9789oFK6e5jvvBS4W7TuPS1lnu+hftC4ZHJjkS7ud0DWbGLqHd9ADqtHFzhpUX1hzYeKK3JNwrTJWtj5enLuvxbDsARIuUTw+75raD7/LAv1O4dmLMoAiBDN0Ic8Vy/CO//u05237T1DH3zZoU1GvOrLjoj1cuee7Prb8cykfHnFSoNUV1TQPio9EBzBuKJHPTknLTktCBMCKi6ZyE2JyEWJYpNem/s1r+4Hk3xYwimhHRTITY3E/VCFACsB8ASCoxOv4gQJdmL1lMP+s1LfeYWbbMbPiUZ5sVke+4btV5rTuIDmBYCOgLB5m+JlouXTRi4KIRPTYrObDwWxQLffiLHsOwPo5n69xm2wFokkpBYx4JZDfbjV8AMCSdRUuvpiVLCNLH8mSSFs+nRTOtuicY0y/oIAAAz5h+COzKnzxbwzHnbboXnYO0eL5A8RBJD3AOIghCRommUKIpAE+ytiOM+TdKOAndKPhsuv91kG0nRBHP09Jr0XBATV8y9uH3bxQI23LacpU0uX/cjMvHrXpv42dP/wYAZqN1228HF904ve1lAEZ9yzqdcpW0fbYdAMbOHkZSJMdyAHD+VBU67A8viQabpW29VwCQR/S5hPvspJZLDhvHbqk56zrYVUvvmqOMkm39df/ev46jYyHJyBgdD2JFMYniBNfBHpOjSBkZ2R8AjIzln7o8dBhr5+MdB46Uejpw3DVjwsNzpwY12+5AkcQTi2b2j/XyLXikrO1OD4a1ZzF+19www2Je5Tbb3hFaMNjrl6BXZuPnSMRiXs1z3dE5AcMwDMMwDMMwrFdjbXvREAAAkIIh/hbOE1SCMOJpcfTPktitAtnNPmfbLyBEoohXKNEMNA4AAG6r+7uC5zQW9XXAt+R/AShhxHOiyI88Z9sRlHC0KOJFP5rdB4hN97Td+BUaBQAgRRGvBjvbHpcajWTbnS27Z+7Y2cMcj0/sQbO4PNfS5UUocl9OLVWI0wa21GpUFXfYaMgXXnINdjvr/LSjv1AYuyhhQJaypeLgrVP/mBg/sjnOWIZr/19knPK5n+6Liot47voPX7n9s4Ob8xurm20We/stHf+hf2i3s3AWx4NYUWhVYYyOajkk7Wo46TqCoTQmy2c7D6FRJ3OHZt8zq/t6ptMUeffMCWjU1dlaP1rKYn2N1bxGr33Mr1S7gzAQre5YphQNAceyXholYRiGYRiGYRiGYYx5FRoCAABK6CVL4JZAel3nXngBKVK94TZ/zTElPBfgvATPVlx4SIujPhdIVzqPhiyb7lm78Us0CgBAiVRv0tLlaDjQ5l0zpaNsu8P8lVMdD4pPuJ08AQBAuStvd0jKiHM8qC3r0m/c018RAAQCymZlWp+aDC351r6DJIjnRy26dtfXDMdVmTS37v3ho4krFAL/7rMBwMKEO9AQAEEQYpmI53ie57f9dnDbbwfRLVxtaPwEDXUvESkys2YAoIgO35o9Ik6kcjyoMrctOYC59cOB4xZ724caIaCoh+ZOQaNBNmVAOkWSLNfhLaVKNa4XxtxjmWK95kE06huh2H3xQtfxvMvkMAzDMAzDMAzDMAzB2g6w1t1oFAAAaMkCNNQtCDJaIFnudiFQzn6KErn0JwkUoeKhjirru52XxtE23XP2dpO8AQCAFkW+Q4vRRUqDYcBIL830s4alOh5o1e4X0fUsJknleGC60H+mc7wk3MVSkXPCvbmxM3/X3m5UdOrrY5Y+fHg1w3GHG8vnbXrvvsEzFqUOldFCdFM/8Txv7lX3MKKFUZXmKgDQ2T21/+5+Yqpl7oXaqncdwVC/HPTUMP2SkYNSIv1YCjwgFGLRgPjogpoGdOACtbFLhzksjJkM77qtbRcIxwnFs2l6EElGASnhORPPa3hOy7JVjP0EY88HEFJUP/Rl/qPoDMaOTKyhaTrLNYJhGIZh3cRosh08fv5kQfX58sbaBp1GZ7ZY7SzDCQSUWCyIjJDGRslTk6Iy02MHZyf2T4shCS+X1n7pkZ/+5+YTq9Yfra7TRkVIp4zPunXFFLG4z03L7oPw7z1czVz+FtJowYN7b5qxfHHvWA8Pa4/njTbd/9AoAACQ9ABSMBKNdhdKfLHbhLtTQXogUcJJAvmdaLSnuKvub2XTPW83foZGAYAQiFXvU+K5aDygWluryyOk6Jgr6YX1R036zmRcxdKWGmuLyU2qwXdeEu6RMXJdc0vbbgAoyg+3TsrrK0+hIVckEBJaECuWPzNy4TPH/7JxbKPV+NSxdS+e2DAqOjVHGZ8sjZDRIrG3xVQHzM12PEiSdnc2M4Ay5BmOhHuVudrKWUWk35X+QdJs64u3gjqhpEFdr/f0b3XRwP5oqFtEyzwdMc12XC+MucFxaovpdyRIkBHKyE+EIm8TNfgO53n4RSK7Ra/5l2vkWoLsxcd5DMMwrJeqrNF89cvef/acdZurstoYq43R6sylFU2H8lpan8VGK1Z9eltAst499dP/2nry1Q9a+upWW7S//HFEqzM/cX/P1EVi3Qb/3jGs92Oszbdz9jNoGAAABHI3LSK6DSnMBaAA0K8zjq1HIgEhUDzkta682xCkHA1dYNM9bzd+ikYBgBCKIz+mRDPReKDJIyQ6tRF8KDxvrWymKJc+6ozNpyRAazd1qyWYCfeElKiyorYm8eoG3dm88pwRAagKDBEPHvwNDfnGwjL76s/vqz+PDnTk8pb/P7v0YZd4rzI6MndXw24AYHjmaPPxidHj0S16yPHmYscDhaDPrevrl8Olnu6ZUSQxLiMFjXYLldTTfVSeb1nXAsOc2W0HANCvTEXEa96z7QBAePn685FYegWAzWz8gmXKSCpRIr1OIr8Z3QjDMAzDgmztxrx3Pv/HbbLbg6z02C7mux168KevWn8UiWzeceb+m2cq5J7OLbHeDv/eMaxX45hSq/YBzoZ+kB1IwSBasgSNdiOCkBGkiufa9StuW+A0YEjBcEo4Bo32IMJ9wt2me6GDbLtYHPkpJZqGxoNAGaVwJNzP5VeMnjkEHXZScqol8SVRiHmeJy6cbOg1praNOsZcaMLsuVO8V14WTU3PSUAi37y9qXVRV6yvGakanixpWa53VeVqC2t1He8ZxYaanRfWSk2XxbsOYi4KPa4+GiOXKcQ9M2vBznbYwB0AZKKutm/CwpLdhi7/S1Fpom5v9ieWXhMZuzUm8VxU3C6J/DaA0FriAsMwDAt7m3eeef2jzf7muwFg4ugATG3s2Z9eWdOMRDier67Dy/+EOfx7x7BeirOfsmofNzfO7ijbDkCLIl7q8UsqglShIQCAwGfABNKr0FCPIggFGgKw6V+yG92tKElIxVFfdU+2HQCyhrcUf2/+ca+jt0xHtvy0z/FA12T449NtrfGCIyWtjy3GDrvNtOblJbIu3cT1kq0fOibjZ2j7ywHA0d2Fbzz2851PXSZTdOkHY70RAcSNGde/dOZVlmcbrY1vFr79QPZ9Eqoni8oPqwtfPP0zy7d82EaqAnDiHsaaTR0eUwBAJe2xX6Xa6OlOI064Y25xDLrmuEA0KXSm42EYhvUdHM+3VuQgs3exYCuvUr/03gY06psJuRloyE89+9M7Ymf8zv5jYQD/3sPDBy+uaNaatDqzVm/W6swanVmrN2u0Jq3OXFWrYTxm2bBQwgFv53kjzzXzbDXHnudsJ1jbPp71NOceAITKf5OCUWi0+xHuet4GYeY9KRyLhnpU+5YyNv3LdsNHSBAACEImivqa6sa//7BJA7avPggAledq33/sx7tfWUG6O+fc8vO+XX8caX368ZO/8Dy/6KaLLCbrj2/+1RrXN5vMRqtE5qbktKq4pdFLZLzSdcQ/XhLuwydkSeVik+vCnlt/P3pox9lpC4bnTs5Oy06IjJGLJUKCxDkOv3336p+pAxKmL/HpDcqxXPHJCn2zMSo+Im1gUuuciG42QJ51R+atHxV/yvLsWX3hYyceX5p82YTo8WKqqzdgPiv242Sd4dlmm+GUtqzc1LbSJk1QC5LGOW2FobRmzwn3rv4SO62ort10LSeJEW7usmIYx2uQCEXjW24YhmE94IW3/9q0s6UN69ov74xSyVzHsSD69rcDbqvLhw9KnjQms39ajEopEYsEZotdb7ToDda6Bt3Z4rrCkjqaphLju7roSM/+dABISYosKnFpqktRZFpylHMECz/49x7GBmahXRZa3fjA1+dK2y7/sRBhrG1ZsLDrBLIbBbJb0Wj4IkglSQ9Aoz3LtaWMTf+63fChc8SBIBTi6G+7+dbIRUvHffb0b47+7Ou/2lGUV3bZ7bOGT8qOTlQRBGExWYvyyjd8u2vrL/tbXyIUC2wW+0f//fmzZ37jOY5l2u7Y8Tyfv7dw3JxhrREHm8V++mBLz+p+2Ymug/7xknAXiuiZl45a931LNX4rXbNx3ff7nONubyw4PHqtm5shwbC+4GU05M2eBQ+ioW703at/Zo9M8yXhfnjrqbfu/7qpVuN4GpMUeduzV0y7LMCdnvY3HURDrkiCEJGiCEHE9enXfVP6HcMzWrvuy9Jvvi//KUuemSpNjRFGiymxkPS1HnlCdFt+/JvSrU4jnXFd+swYUZduQIU9i8fVR1muZ+oFTlXXeb4TkBETiYYwDIDndEjE7Qw4DMMwLNgOn0CnHGHdQ6szb75wq6OVQi5+7pFLRl+Yed2RrheK9uxPd7hi0egX3/3bOXLpxSNwI++wh3/vGBZ+BPI7hIr/oNGwRtJDQm1+tvMFNWP6zm74P6fBFgSpEkd9RwrQVHWwyZSSy++a892rfzqeFh4rffWOzwGAIAmapuztFkSdtGDk2DnD3nngW2i3XKpELjYbLD+/8/fY2UORaub1X+2wmlvWSs0emeY85C8vCXcAWH77jC2rj1gu/LyOeGig42Gox8WI0ekS3ay6tIFjuQObTpSerjLqLf2yE6YsHi11bddTVlD99HXvO78/GqubX7zlE4ZhZy4L5LKlHxZ/jIZ8Y+Nsp3VnTuvQE26vnBPuXbQ4efz1GXPQKOZKKmxZbdmtOp0RDXWLP455eedkJ8SgIQwDAB79TiWIHm72h2EY1geVlDWqNT1zCoHlna5k211qPXrnxV7z3QBAd1wv5aOe/ekO82cMYRh21fqj1bXa2Gj5pXNHXLFoNLoRFnbw7x3DwglBKIQRL9KSS9CBQOJ5toZjSni2iufqeK6R5/Q8bwTeDLyZ5y3AWxz/C7yFBwvwnkoVA4UgQ6yykBAC0ZIyYi1brNqnXIcBAAgyWhz1PSkYhA50i6sfWpi3qyB/X5FzkOf49tn26ETVva9fGxmnLD1TtfaTf5yHxs4eOnhs5tcvrT21/9zLt31298srlNEtmeH9G/O+fH5N65YTF3SphN97wj02UXXb44vfffI3dAALBIPGdOvEp6qcJsR98ezqJ7+6c8iErNbIqvc3MTaGFlDXPLwoOzejtqzhp7f+bqhSf/ifnybMHYFk5/uggcqUa9NmTovr7ttrvVGExNO7papZqzFZurmxTL3e8OvhfDTqhCLJsRmpaBTDMAzDsNBwOK8MDWHdJb+gCokkxUdMnxiw2f2e9exPb7V4zvDFc4ajUSzc4d87hoUFkpZcIlQ+QZCx6EgAcJw9j7Fs4+yHOVsezxvQ8R5HBqC1WgC1lrdz9uMWzT0AaMs4gowRR/9I0t39Rd+KpMjnfr7v1Ts+3/vXcXTMSdrApKe/uzsyTgkAd754VU5uxpoPt5SdrVZGyWdcPu66f1/SVKv55pU/eI7fsebQnnVHs0akKVSy2rKGiqLa1j9k2MQByf3j2v5Q/3lPuAPA/KvGNzfqv31nEzqABYJzth0ANI36/1373qd7n3W8OQAgf28hAFx89eQVDy10RMbMHHrH1Kf1zcZdaw/PvXZK62t7tVv6z0VDHaMISkaLo0SKwcp+uI2M79I99mbheH7rmXOXjx6KDgQNz8MTqzdZ7OjdSGcj+yXK8aKpmCuet3FcLQ+eOhH1NRzXaLNstFn3s0wBx9byvIEHniBkJBlH0em0YLBAOE4gHEu4Xf/HHzxvtVt32mx7GPsplinjOQ3PWwhCSJBKikqlBYMFwvFC8azwa+/D2Atslo1220GWKeY4Nc9bCEJKUrE0nS0QTRSK51FUiusrAjbfgue0dtsRhjnJ2E+yTCnPaTlOy/NGghAAISHJaIpKougsWjhSKJxKUvHo67uAZYpMho9s1l0cV0cQMprOEYnni2XXEISbDt1221Gz8Qu7bT/HNZKEiqSSReLZYulykkpGN/VZD+67A8uW2a377bZDjP00zzVzvIbnTSQZRZKxFJ0tEs8Time4/dcIlF7xiTuUV4qGsO5SXadFIrnD+nXbSk89+9MxDMOw3osg5JRksUB2GxmEVbh4tsJu+p4x/cZzLtm2UEMQoZXLIgg5AHBMqUV9E/BmdBgAgAXCzSqj3UksFT31zV37N+b9+n8bzxwqQVqqJKTFLL55xiW3zBAI29LdM5eNR7qDJKbFzrpiwpaf9wEAY2cLDpc4jwIAQRI3P70MCfrLp4Q7AFx9z+yMnMT3n17TVI/2zMW6SBEpu/mpy0dNHyQUC84cKv7ovz/XV6p//3jLjU8udWzQVKMBgKwRbXMz4/tFz7py4rovth/edipsEu4rM2ajISzQshO83Df+cveRS0cODtQkX69e+mv77iIvZXGXjRqMhrC+geOaObaSY2s5to7lahwPOK6GY+s4rhndGgAA9JpH9JpH0Gg7IvFcZdQXaLRjWvVKm8XXRSaEoosior9Ho13QWJPB821d3aLi91GUy1R9li036d+0mNYAoPeueF7DchqWKbRZNgEAQYiFohkK1RtEp4opOLbWZHjfYl7Vvns+z5t51syxdXbbYbPxG4IQiSSXSOX3UnQmsmVvZLcdNOpestvQZU54Xs8yepYpsVo2gPYZkXiOTPkf6sLCRwTZ1SQsx9ZaLX9ZLRvs1gPtf7kAwPNW4K0sp2GZYrDuAiMAEALheIn8FpF4Prp1x9T1k1im5VAskd0oj3je8dhi+k6vfaJ1Ri3Pa+22g3bbQbPxC2XUp7RL30bOoH3WbPy07TnfwHENjP24yfCBPOJZsXSF08beddu+e2Cz7jQbPrVZtwHwyBDH1nNsPWM/ZTW3zTn1TKZ4VKq4H4161Fs+cQzLHT9diUax7qI3oPeeU5M8VVcEVs/+dAzDMKy3IUk6gxROpERTadGMYKRuea7Rpn+FMa12ewIZcogQqywk5TyntjZfz3NN6BAAAPBcs1V9szjmd0dqvgdNmDtiwtwRJr2lKK9M06CzGK1SpSR9UHLqgA5XXUbc9tzyM4dLqorr0AEAALjjhSsHjs5Ao37yNeEOABPnDBk9LWfz6sNb1xwpyCvnOfTyA+ucu19ZcdHSllbmkxaOiohRPLTw1UNbTrYm3B3diGQKSetLACD3osHrvtheVlDtHOyid0e9iYaw8DKhfypFEmzHH96SBvX72/bfP3sSOhBoNoZ95o+ta46eQgdcKSXihcMHolGsbzBoHrNa1qPRPo9jq50T7hbTzwbtkzzvU/dknrfYbYcIshOVsKzJ8JFJ/wbPW9ERd3jeajH9ajGvkcrukCkeAcKPk43QwtsNumfMxi/RuBuc1bLRatkqUz4ild8NQJBkFLqJz+y2/WbDF1bLhvYTOb3h7bb9dvV+gXCiMvJdkkpCx71h7CcdD6zm1XrNY66DLVi2QtN0VWTsXxTVso6QXvOoxfSj61YteN6k1zxMECKRpOWsxrMe3PdWPK/Xax61mv9AB7pPb/rEnSqotli6o88p5pbBiL5JpNLA5y860rM/HcMwDAsFtPQqtzM7CaCAEAEhJshogoojqVSSHgCES14rsBjzHzbdf9tXKmA+IyzqmzimFA074Zgia/Pd4qgv3P7Su5lUIR4xJQeN+kYZJXt93SNv3//NgU0nnONR8RF3v7Ji8qJc52Dn+HdGLhTRC1dMWLhigkFrPnuiovxcXWOtVqcx2qwMx7SU8eu1prz9xc6vGj4+U6nq6hz2MDZx/kjnp0PGZ8kjpDVljc5BACBdi44dvYTUtehEzq6IEHSm5hHrRRRi0diM1P3F5eiAk092HIiRS6+ZMBIdCJzj5TVP/b75XL37u6bObpoyWizw7zCFYeGNY9vusxr1r5n0b7eN+UAongHg3xQWntNqm2+1W/egA17xjMnwnt22Txn1JUlGo6Mhj+dNWvUNfu44Y9S9xNoLFZFvdXqXO/Frbc9u29fcuDgyZj1J+Vrl4cDYTwPwHFvTUbbdgec0es1DquhVAGAx/dRRtr2VXvMILRzXrusOqmf33YFjqzVNy1pL/rtfr/vE4X4yPYtpt2YpTfp3kO+Knv3pGIZhWCgQKZ8NRq26v2z6N+2Gd9CoW4SUpNMIMp6g4ghCSZAKIGQEIQVCRhASIGQEKbOob+6oyjuMcRcqbzxjrdttuheFyifRgd4mMlb5zA/3VBTV5u8tbK7XyZSSfjmJI6cORLKvndbJTJY8QjJ6avboqW465VeVNt4y51XnyMp/zR0yJt05gjlQNEkLaJEEnUWiUMlqK9CEO0KmlACAxYTWlWCYZyvGj/CccOd5eGHdtlNVdY8tmO55kdVOOFpW/fmuQ9sK0A5ZbqVGqW6YPBqNYljfxrI1jgcm/VudSE0KRXPQkEccp9Y0Xs4yheiAz+y2I5rGZaqYX0kyBh0LaaxOfVtnkp4AFvNvQIhE4nnogG/EkktN+negXRsTf3FsrVZ9nSpmrV+N+3neyDKlJsPbPG9Cx1zZrfvstn00Pdioa2lB4wHPW8yGj+URz6EDrnp23wGA541a9Uq32XaKzhAIR5NkLBAintOwTLHddph3392yPZogfZp42xs/cXjFVAzDMAzDepbd8IHnbDtBxVOiOZRoEiUYTlCp6HB7hACN9FGU21mnduNnJJ1NS69EB3qh1AEJvjei8UsnE+4exMSHW5X0s8f/jhHLL08bGS/xexp+ubF5W03LVVO2Mm5inEsPIGWkvLlBp67TRjn9ozF2tqGmWSgSMHaWFlAGbcsVL9LDx9FnBsP8NXNg5oD46KI6L3drfz92+p+CkmsmjLhizLCECL/f+c44nj9dXb/jbMnf+YUlDWp0uAMUST63ZI6Q7vlpSlhPIchIzwWqHNuI9OYjyAjCh1mKhJ+9PuTKZ1nZLTyn5jg1x6mdH7BsJc/p0RcEk6PC3WpeZ9S/gQxRdJZAOJIgo0kyCniO4zUsc46xn+LYC4utE7RQPM3lNR7xvEXbdK3b3B8tHCkUTaMFI0kyiiAUPK/h2Ea77aDNupVtNwmRZQp16ptV0at60ZmrUf+6zboNjQIAIRCJLhaK51BUEkFG8ZyG4xrstkNWy0aOrWrdymL6gWU7mYWk6GyheJbNsqV9XCAYTguGUnQ6QUYQhJLnzTzXZLfn2Sz/MPbjyPYAwNhPm41fSuV3owMeWc1rLabfAYCiUiTy22jBCACwWf42GT5FTrgtpp9JKqVlTQWCFkuuEEkWkGQ8y5SYDG8z9gLnja3mNfKIZzxPsOjxfTdoH2fsZ5CgUDRVpnycFgxH4jxvthi/NepfQ25OEIRYKLqIpNMoKoOi0yg6jaJSfJl12+s+cTwP5VVNZ85dOMKEkmataffBc8dPVpSUNzaoDSazDXiQiAVRkbKURFVWetywQcnDByaLxZ3/J9IbLCfPVp8731B4vq6qRqM3WPRGi9lsp2lKLKJVEdK4GEVactSgAYmjh/eLifLpjotf7Ha2UW2w9dAVQc/+9BDB8fzpszX5BVVni+uqazX1TXqT2Wa1MTRFScQCsVgQGyVPjI9Iio/IyUwYkpMUFRZzvgtL6vJOVxWXNpSUNTTrzCaT1WS2kSQpkQgkYmFkhDQ1UZWaHJWRGj1iSIpKGQ677FBdpz1+siK/oOpcaYNWb9YbLBaLPUIpiVLJ0lOjp47PmpDbX9KFQ4qP9AbLvqPnj5woO1/eVFuvNZpsHMcp5GKlXBwboxg2MHnkkJThg1MCuCJXjx/rMMwr1rbfpn8NjV5ACkYJFfdToumez0Kx9ijxHJHyGav2Mda6Cx0DsGofJ+h0SuiyGCnmjOD5rpYRtbds9P+MuraSn9d/vKv3VribGfv49a9ZWYYiiGnxA54ZtdCvtHuT1Tj1rzdZngeAVFnk5rn3Ek6jT1z5zuGtpy69beadL17VGlz94ZZPnvwFAOZeO+Xul1ds+WXfuw9+BwC3Pbd86Z1ty4qe3F/08KLXVDGKnwrQnAuGeXagpOLGL1ah0Q4QBAxLTpiQ2W9EasKA+JjECCVFOr+LUSzHNxqMdTrD+QZ1SYP6VHV9fmWt3uL3VIxH50/D5e2YZ831MxnmrHNEoXpNLL3aORJsRv0rJv27zpFgL5oqFF+siHheXT+L51sS/QQZIZXfIZYs7+j+BMsUWi1brKZVBBWjiv4FHe6YXvNw+1YhAuF4mfIJgbCjrnacxbTaqHuO49B5WlL53TLl40gwNDH2/OaGhe2rOYSi6YrIt0kyDok7WEy/GnXPclyHtxXF0hUK1eto1B277YCmcSkAABBC0WSheJ5IfDFJJSObObNb9+k1D7BsBRInyeio+AOeb0Q5L5raihYMVUX/TJCq1ojF9KNe83DbFgAEIQeC5DkdQYiUUV8IRRe1DvG8vrl+Nsu6rKUZGbueFox0jrTXzfvujGWK1PUzAVxaZIhl1yoiXvJwhcbYT2uaruA5jVOMUEX/KhBNdIr4JPQ/cRaLvaS88Vxpw7nS+nPnG4rLGkzmtqNT5/z93b1ymR/z0Gcuf8tub/ts/vLRrYmutT41ddovf967aecZtl23E4RISI/Pzfj33XMVcj/m8zU0GXbuL9x54Fze6UqvP8KBIGD44JTli0ZPmzAAHfNGqzfXNegamgyNakOj2uB40KDWN6mNWr2PEyzcmzIu66X/XIZGXfXsT3f26POr9x3xaX4kAIwblf7GU8vQaEBVVDf/tv7o1t1nNTovk4GcpSRGThmXOX1C9pCcJMLT2XQoMlvsv/x5ZOP2UxXVzehYBwgCMvrFjBuZfvH0wQMy3H91ehYiv/dDeWW//HH4wLHzAUmc3HL1lOuvmIBGAQDgo293fr/6YOvTS+eOePiOtomJao3xi5/2btx+2mL1smxGXIxixWVjF88ZLhJ2vryym491Prrxga/PlTY4R+69acbyxfiasZtYmm9lLZvQKIAsobBHW8ow5oZ5HFOEhgEAQKh4WCC/B8DvY66pfjzfWrR0gUC6UuhtvqZbPG801Q5GowAC+b1ChcvZdbfhObWpbhQavYAgY4QRz9DiRQDAczpL02Uc49I53IEgoyQxf/g0Y6BP6vwh2IOYeKVzwr1XO9RUZmUZAGB5/kBjaYTQ18s2h2iRbHR0v4ONZQBQYWzOb64aHtl20Tjj8vGHt55a+8k/ZWeqc2cMFomFpw8V71hzCAAyh/Xb+N3uTT/saS1sP7Ql3znhvu+v4wDQLyepNRJ+zuorDzSdLdRVlhrr9IzZwFgIABktUQokGbKEHEXK+JicLHk4/wsEyfj+qTdOGf3l7iPogDs8Dycqa09UtnzZUCQRI5dFSMQykVBAkQRBsBzHcryVYfQWm8Fi1ZotXJfPRm+YPBpn2zHMLZY5p2u+rzXbLpIsUUS85HkdVIrOlsqzpfK7eE6LjnXMZt3ePvcnka2URzzn8eSBFEuXCYRjtU0rkBJvk+EjkXQpTQ90DoYmg+659tl2sexaRcTLHs7XxdIrhKKpmsZLkSxzJwiE44XiOTQ9QCy7tnVhUs8EoomRsRuaGxci9c4c12SzbhOJFzgHfUApVO84Z9sBQCxdYTF9b7cda43wvMHR/UUq/5dzth0ACEIhkd9j0P7bOWi3HfOacO/BfTcZ3kOy7bRgmEL5godsOwDQgsGKiFd0zbc7xXi99vGoOHczJDoWyp+4qlrNx9/uOldaX1Wj6fpXfGDVN+qdE+5/bT359mdbzb4t4mq1MflnqmQ+p/vzTlX+uv7orgNFXMeLz7vF85B3qjLvVOXIIalP/mtBXIynIzbitQ8379hXiEa7S8/+9NDUqDZ8/N2ujdtPdeKjUFnT/NPaw7+uO7r6s9ujVDJ0OIRt2Hbqw292qjVGdMAjnoeSssaSssaf1h7unxbzn3vmDcxyXxkQsowm22sfbtq622XCVrcpLK5rffzPnrOvfrDRaPLpHmd9o/6dz/75fUPey49flpIYiQ570yPHOgzrNMayqcNse8TzAul1aNRHvE/3mcISLV0uVDxBkC3nVwSpFEV+YWm61LW+BACA59QW9U3imN8Jojd9qXUbD2fwnRcdH1FW1Pb10Ksda2q7bJ6RMEBM+f0vNj423ZFwB4CDDWXOCfeZy8Zv/nHv8V0Fjv9a45nD+r3192Ov3PH5nnVHASAyTjnrigmr3t/00X9/vuSWGfII2b6/j//x2TYAGDt7aOurwsn2+hPfnN96ztC2NmArm03fbNOXGeu315/4uPivHEXK9Rmzp8QOQbfDPHrw4inF9eqdhefRAW9Yjq/TGep0BnQgcG6/aPz9syehUQzDAACAZUpYaKn2ksrvkykfcx33pPW0yQesQfskEhKJF8gjXkKCblF0mjLq0+aGBa49f1iT7jVl1OdOkVBktx1u37pdIByrUL7gIdvuQFIJEdE/NDcsbL0j0mkRUV+hIW8IUqWM/Ki5YT649kC3Ww/4nnR2EIpn0AI3iVqx5CrnhLsDQcgk8tuQIACIxBcjCXe3zVLa66F9522Wf5CQVHE/EN5P/ESSRbQ+x3nCDcsU2qy7haIpTlt5FtKfuPpG/ba9LtOJQkddU9tn7fMf93z1yz6nQe8m5GaQvlUad+IPb+/4qYo7/v39x69cGxuNuy70SrsOnHvpvQ16gwUd8MfksZm9KNvO8/D+V9t//uMwOuCniqrm+FglGg1t9Y36+578uapWgw50l+KyRpblKIr8ae3h97/ajg57U1bZdOsj373x1LLB2YnoWMfwsQ7rdRjTr2gIAAAo0azOZ9sBeN6PQqVwIlQ8KmjXkpGk00WRH1uarkEaugIAxxRam+8RR33uuUKlb/J+FdEJMfG97NvUgwJt252DyXGZTiO+yo1um16R3+ySQSZI4pkf7vns6d82fr/bZrEDAC2gZlw+7o4XrxKKBU9+dUf+3kJ1nTb3osEcx234bvfvH2/9/eOtrS9XRsvnXze17Y/rIRqb5oz+bLGhRM/o9HaDjbMBQI4y+4qUy9FNfWBirc+d/GFP42l0oANn9ZWPn/jqorjhjw++Ukyhy89iHaFI8t2rF9/7wx+7CkvRsZ4jFwmfX3rxxUOCNQkRw8KJSDzfr2y7X6zmtSzjMombJKMVqjedI57RgiES+Y1mw6fOQatlE8tWUlSKczDUWIzfoCEg5BEv+5J4BQCKzpQq7vdlHdFgoAXDhKIZNqtL4thuO+T81BdC0Qw0BAAAbtukCMUXE4SbjhwkFU+SMc6tTlimq7X/HnRx3xn7KaQdEEHIROK2ufyeiSSXMvpXnSM2ywbfE+59+RPXRQ2NLQn3r37Z14kk0aQxvp7bz5oy8Otf93WiqBnR0GR49PnfPnzp6q60j8d6xI+/H/rg6x1o1H+L5wxHQyEsINl2AJg6PisyQopGQ5jZYn/0hdVus+0piZFDByZFRkhFQlqnt5RXq08WVHtt8+JAUaRM6usVq83OlFY0lZQ3diLb7mAwWv/3+p9fvLnS98ZZ+FiH9TK8nbW5//YXKh9FQ77jTcD73RQ3PBBkNBoCAABKOEEU8YJV6+byk7X+Y9O9JFT+Fx3o83y6evSX8xKgvV2lsbn18cjozlyx9FfEtD4uN7pcywGASCK8+5UVtz67rKKolrWzyZnxMmVb15phk7JbH//n01tfuvXT1jVUI2OVT359p7xH194p0J/9s3r9Se0pdABAIXAzg6zUWKaxaxyPB8gHyGj0L29irQ8f++ykthSJe7W9/kSzzfDayJtxzt13Qpr64NrLXt+w8+u9R9GxnjAtO+O/i2akRoXP0QPDgockoxSqN9Bo4JiMaFWsRH6L58Y17Umk1yPpPwDOalotVdznGgwhPG+zWjYgQaF4jtty745IZNeZ9G/zfBBnAnkgksxFks4cW+P81BeOhVLbo+j+BCHmeZfqTkHHayWRVIpzwp3j6p0GA68r+87Y0ZMZWjDc9/NkWog2wbTbjiARD0L8EycQUB1VKbIs377LRHSkjPS43IszwrcC847UN+oBYNves1/8hE5MSUuOGpSdqFJKIpQSjuP1BktZpfpcaX1DU8tnk6bIsSPTXV7TsfTU6ImjM/ceLm4fz8mMz86IT05UKeRiuVRksdo1OlPBubr9R0rcrih7rrTht7+OXbN0HDrgToRC3NE/voNaY0LaKyvkYrHI+1tX5XTF0ZGe/enO7rt55hWLR2t1Zq3OpNGZtXqzVmd2PKit1xlNQU+L/LT2sIdsO0FAVkZcZlqsUiFWKaUEAUajrUGtP1/eVFrRZLO31QPGxSjGjUpve2VoO3ay4pc/3WTb42OVE3MzcjITkhIiZFKRUEAZzTaD0Vpbry0uazxXWl9QVMu4vjEunev+a8WzHvy9v/nJlmLXXuEAMGZE2h3XTcvJjEfiFqt97ca8z37cY3HtZyUS0uNGpScnqJITI5MTVMkJqoRYpe+HRwD465+T67fmO0coihw+KHnSmMyUxMgolVQopHV6c3mV+nBe2e5Dxe2brdc26N7+dOuTDyxE4h3pqWMdhnUOx5YAb0ajACTdn+xCVz2OQz/+GADQ0qs4pshu/AwdALAbPyEF2bTkCnSgWzB21t6pVdwlPvcV7Bzv50OdEE4V7vWWlsIZiiDT5VGugz6JlygFJGXnWACoM7ufYy4UCTKHthXCuzV65pAvDj5/aOvJxhpNXErU+IuHSxW+3qkOOBtn+6bs+10Nu9EBjwr1Rd+X/+h4fHnKkkuSFrmOw4dF652z7SRBjlBljI4akC6NixIppJSIA97C2hqsulJj3RF10UltaWsv0TxNyYfn1j+Qs6T15ZhXFEk8tmD6xKx+z/yxtUbj/s3ZDXISYu6fM/minP7oAIZhHRDLrvOnP4x/WKaEsR13jVES6UrXiHcUnUELhjL2k85Bm3Vr19N/wWO37eZ5NHsoka5AIp4RhFwonmM1r0EHugUtGI1EOL6tdMBHNN3RAZkgqQSkVTotGOr81BlJxYBT8oHndG1PgqAr+85xTUiEov0os6AodMI+53Mr/9D/xA3NSVr92R1oFAAAauu1V9yOZPnhizdXdlvHjPomXV2D7pX3N7bWYyrk4hWXjp03Y0hHmeLSiqa9h4s3bD8dGSH1vdQUAK5eMtaRhCIIyB3Wb+r4AVPGZnbUJWPSmMybrpp07GTFi/+3obYenZb+09rDly8cJRZ5L/x85M6L0ZCrlfd/db687bYWANy1cvqiOcOcI53Wsz/dWUqiKiVRhUYBAODT73d/s2o/Gg2ofUdKPuwg256WEn3d5eMn5GZEdHALwW5n8wuqDp8o27ansLKmeeGsYT52MQoFn/+0B6l0lkqE/7p11tzpgz1njU1m29H8igNHS7btLdTqzSmJkaOG9kM38kFP/d7LKps2bUfnW186d8SDt892++sTiwRXXjJm9PC0+5/8WefUcchmZ65YNHqUt8t8D3750+Xe7dTxWfffPLP9YSd3WL/L5o2sqtW8+sGmo/nlyOiW3QW3XTu1/as60iPHOgzrHJ5B3/AOZLtzQr9w/pRN9ClC5X85ppi1bkMHAKza/xBUOiUciw4ER/7ewu2rD+XvK2yoajZ3ttXbhsZP0FBABSXhHh1GFe5mtuVKMUIopojO9CQiABQCkdpqAgAT49M6Jx1RRstnLZ+ARrudmTW/XPBaqbEMHfBmYsyEnyp+YXkWAHY17EES7iWGmj+r206bpsUNu2fA4gRxpNMmLm7MmFNlbnyvcN2expaqtLVV+y5LmZQhQ4sOMM+mZWesu+/6r/ce/WbvUY2pk4eqTiAJYmJmv+snj54yIA0dwzDME1IivR6NBY7VshGJCIS5yPqZPqIFw5H0n92eB7wdiBC99LJbD6AhQiAQTUaD3ghF03sq4U5SsWiIt/O8mSDcJ4PaIwiph9s5JBnFQqlzhKI7PIYjCyjx7kqQAqgr+85zaGqeINwnF9wiCPRfjPN5jeK+/InrurJK9XPv/NW6kOCcaYMeun22TOqpXik9NTo9NfrqJeP87cQ9YnDK5LGZaSnRl84dkeTbxc6ooamfv3Hd7Y9+V1mjcY5rdKYDx0qnTxjgHMRCk85gefm9je2XCxYJ6X/dMmvBrKGeU88CAZU7rF/usH63XTP1bHFdbLR/M1d6UH2j/sRplxuHJEm8+sTSEYO934yUSoRTxmVOGZd5/62zDhw9DwDu0tSh67vVB5HfeHb/+H/dOstttr1VVnrsw3fOeeq1P1sjPA9vfrLl23dvdNqq8x64bdbS+aPQqJPkBNUb/1v2xCtr9xxyqU/nOH7138fvXDnNOegBPtZhvUhHyyYR7c8J/dFRmxoMgBRFvm9pvIxrvzITb7c23y6J+ZOgktGhgNI3G1++/bMj/6CTU0NQZzLIXkWHUYU7e2FtYrJT2XYHAUk5Hli5zkxzCCkcz71/7qNOZNsBQEHLs+QtvTLrrfVVZpeO9lvqjree2VyWMvH5YSs9ZNsdkiUxL464/pLklpsQHM9vrj3qugnmE4lQcMdF47c8fMtTl8wcmhzcOxYUSYzsl/jYgunbHr310xuW4mw7hvmLFuSQVBA/p3YrOntJ4HMragQtGISGeDvDFKHBkGG3o18iAsEYJGvsC4GwS2U1XUG2y/wCAPAuk9w9I0mPlyiEayqToEmywy9rwjXPyzuXuwdBV/adb7cGFPjzt+UB7WxAEL6WTvflT1zXVVQ3551qyQlet2z8Uw8s9Jxtd+Z7U+NWLz++5M6V03zMQDko5eJnHl7cPk2Xd6oCDWEh6Yuf9rbvm6SUi99+ZvmiOcM8Z9sROZnxUT3aDtQvJ89WI3cZJuT29yXb7oymyMljMyePbbkA7BV4HvYdKUGC118xgaa8ZwNmTMrJ6BfjHCmtaDpywn0Frl/uXDnNc7bdgabI/9wzT6VE32ZICt4rfKzDeo927zkAACAI97PcfMJbWcs/aBC7gCBk4qgv3LZ657kmi/qm9tOFA8hstD608NVekW2HIFW4x/hzaA5xEQJJk9UIADpb58uydPaWCho57es1QMj6p357vrateEpMiSZGTxgaMTRVkiylZfccvd9pWzcGKwed1bfcCjutO5MsSWodOtTUEo8Xq+4ZcElr3DMCiPuyLz3QVFBn0QDAwaazt2XORzfCfCMVCq4aN+KqcSPKmjQ7C8/vLio9Xl6jt6BJhE5QiEUDE2OHJMWPzUgZm5EiF/mahsAwrD06yMlcu/04EqHpLCTiI7epWI6tBMFgNBoaWDuamqQFnSnLoug0ghDxPbLaUvuLXT8RpKeyCQJczmRIMrqjSx0AAEAKq1nXp4HWhX0nCRUS4TgNEvGgfYE8SbrkXDzoy5+4AJo2YcBt10xFo6Ehu3/8+FEZ+4+edw7mF7jUnWChqaFJ/8emPCRIEsTL/10ydGDbVUxYaryw2kGrQQMSkEhYOne+XqtzufCXiAW+3zOYNWXgZz+43EbddaBo9PDOdNRpNTArYcVlvnZCj1BKLrl4ONJvp7yqyWiy+n4/snPwsQ7rfoS7Mx8A4PnOtzG0m37knZYgwtojqFRR5CcW9VXt61o4psCquV8c+UmQyru/en5NeWENGvWHKkYxcEz/QWP6DxrbUQvNgAlKwl0VLX/u85tbn6ZnB7EQL9gihC0JdxvHNlqNMSK/y9yMjM3MtPal8T6p2a237v+6+nzDa388jA50Lytn/aO6bZbcYOWg2zNvVQn8uL+SKW97T5caS9sGAOqtWseDGXEjhKQf70whSc+KH/lD2XYAqLdqkFGsE9KiVddNHHXdxFE8D+VqTUFNfVmTprJZW6vVq41mjclisNpsDGNnOY7nKJKkSVJAUQKKUoiFERKxUiKOkkkSIhTJkcoklTIjJjJJ5Sl9g2GYX+guLAHkFcfW8e3yjBSdjkR85LYpR7BXzuw0nje0XyKJojp3KkaRVBLLuFxz9hZ+1QQRBFpG10tR7XLc7ZdR9QBp5AIAJOVTMq4vf+ICKEIp+ffdc9FoKJk6fgCShHIs94qFuD8359vt6J3CKy8dM2xgcOfLhwKTpUutUHuvovPoMTMnM4HyobzdYXA2uqTHybNdzTjfe9MMv24oXzx9EJJw53k4U1Q7ZkTQJxbjYx3WzTpMuLsuOOQ7njfYjR+hUawdSjhGFPGyVfMQOgDAWjbb9K8KFf9GB7rMoDGt/3qncyR1QMLkRbn9chKlCjFBEE9f+z7P8QDwwDvXi6VCxs5qmwznTpQf3pqvUxsBQCCk//vlHcMmdqagqhP8SGv6jiCJMdNy0GjvlChRluhb7m4daiibn+J3idDRprZJZDFiPy5ineXtPltb1vM32fI0J7T2lluFKdKUB7LvE5L+lSonittOQWostU4jYGBMjgfpcr/v0KRf6NtuuDCZAAsIgoC0aFVatAodwDCs55Cdau7sI5Z1M/G5uWEhGuoCnuv8jLGg4lj0GhsASLqTVWkkmcBCIBPuPG9lmQKGOccxlRxXy3HNPKfneRPPm3neAryFb/mvq/+8BNI0xiMC/DsN6Jxu2HeBcDQAAdDWQIFlilm2gqJ8WuzOZt2ORIQin6qt+/InLoAumzuiE/1hutOQdjk4fzvIYz1iw3b0xptCLr55xWQkGJYiFGihWH5BFRIJSxpdyzVpq8Q4N/cyOxLXbrnm2obOV9oCQGpS5PBB/t3g6ZccLZOKjCaXaXaNanTKQjDgYx3WzQgqFTl/c2BthwBYgJbezj7jrc338WyXCqj7DlqyjGPO2Q0fogMAdsOHJD2AllyODnTNrj+PMLa2JpA3PbX0invmEk693URiocVkBYBxc4ZFOh26LSbrj2/+9cs7G+w25vHL33rmh3tyL/I7tdsJQUm4h5PR0f321Lc0cfur8lQnEu6bqwtaH4+M8u/LspVJHxIXS87NZJanXO5vth0AokVRFEE6OuM32dTOQyqBvMGqBQCx/3+skGyZtB4h9HsKAoZhWO/SfnnGAOLYOjQUaDyEaNEcxzWhIQDSY38VDzr9QgTDFFjN6+3WbXZ7PvDt+4wHAeHPyaHPnco7oTv3naQSBMJcu+2Ic9Bs+Ege8YJzxC2WLbOa0YVPheJZSMStvvyJCxSSIC6bNxKNhpioSPQE1c6wFqtdLELaLmEhpLSiqaauZQJuq4unDxYJ/TlI9lr909C+WIeOlx48VjpuVDoSDzNaPZog9qsTi1yG3vzrYsZ51hS/5zUSBKQmRRaccylu0xu7o80dPtZh3Ywgo0jBQM5+BonzXBNj/pOWXIbEPeJsuudY61Y0jHVMqHiMY4pZyyZ0AMCq/TdJZZDCXHSgC84caltgY8HKacvvm+c0CAAglAgcCXeL2eWIJ5aKbnxiSUJazDsPfGu3Mc9d/+H/bf1vSlaC8zbB4OvcqD5rbExbadvm6jNntC7fW15Vm7Sry9oa/42LSW8b84fRtZFcTym50ARGTImHRgx1GfMNAYSIbDkLsbAuO5UgaZkNpLX7vcaC2tYyVc3rOqsYhmG9HUGgRWcBxPNociEI0CKUEMHzaFEbdOVf2/+lVhE2yyZN46Lm+lkm/Zt227FgZ5yd+HVy6M8sd5/1yL5LZDchEbPxa5tlCxJE8LxF33w3uK65KhBNogXDnSMd6cufuEDJSIuJiUJLSkONXOYmYccwHBrCQsmRE2VoCGDhrM5cAfVGgwckIolmnofHX/59wza06j/MsCz6wWTaRTyw29EvLKGgS3doOtf/XSZFb4cbjF3K+/sIH+uw7kcJp6AhAACw6V7gWV/TdzyntahvtBu/QAcwLwix6h1SMAgNAwBvszTfyrNd7anl7PypytbHVz0w32mkhfDCvT2ryU25yfzrpk5fMhYAzEbrm/d9jQ4HgV/XVH3R6Jh+SdKWWkIe4L79v2p8Xj3VzNrv2f+LnWtp/BchlEyMzXDdxCdWs40NjW8p/YV+MsmSJIro5JtHTLV8Dds4lwUWpsQMcTw4o3MzvdqzfE3LtP3JMX5PQcAwDMNa8Xx3XI+FqHbL/gB0vkc54VeduCuOrdI2XaVV32i3HUPHgo8ITg7dRz247yLJJbSg5VTkAl7bfLPJ8BHPuzlrBwDGXqBpvKzdX5WQK59yjXSoT3/iAmRojk/t8nsW6VcDZiw0nC1B+4zJZaKs9DgkGK4EAuqSi9Ebh1Yb88K7f9/26Pf7jpTwYXovr31/Kr9K1NsXyKsiOnki4ZDRD51q4AuJGE24W536MAQPPtZh3Y+WXuk2sclz9Rb1VZzXJXl4s934mblhNtuuPSDmE0IqjvyCIGPROADPNVqabwJ3JU2do74w7SwpIy4uNdp1EABAJG5JuFs6mNNz9UMtbRtPHyzO233WdTDwOn812EdQBHlL9qRnj//teFpubF627bM3xy0dHumlOUypoenBg6tPaVraP0VsMfTPN29T71uwclrrNu8+9F3rYw/sVjcpgB5hYFpqz+V05yuJWvPs4gul7g5zEnK/PL/Jwtp3NZzS2U1Kga+nJnUWzZ7G0wAgJOk5CYGcsYJhGNbn8CFxf7eHuE0e+Nv8sVUnX8jYj2ubVrrtb9OKJGMpOpMko0kqiiCjCEJGEFLH/wJwuuY70Rf0Ej2976RC9a6mcQHPO52j84xR95zZ8JFQPEsgGEVQ0QQh5jkdy5TabLvt1n3t3zZy5f9owTAk2KE+/YkLjM5lozDMq5KyBiSS3T++T6UTr7t8/OadZ9r3/j5TVPPo86vTUqIvXzDq4umD2xdT92ppyVFIpP0yqh4UtbtPEx+jQCK+i1LJ2jfTxzDMGUkPoCULGfOf6AAAx5w3Ny6mxLNp8WJKOIqgEgBoAJ7ndDzXxNmPsNa9rHUbzzUjLyQFQwXye63NtyNxzC2CShJHfWpuuhKcT6EBAICzn7Fo/iWO/Dggk2JbW23HpaAHagfxhYlZeo37thlpA5P65SSWn60BgD3rjo6YkoNuEVA44e7d5Wmjvis+1Lp0aoWxefm2z6fEZ12eNnJUdEqCxKVJa7PNdFxd+Ud5/qbqMwzXdhEV9btOY+M+fWqVc8L9L9cFdkOflJLoGQMAWDn0g+QjjudMbMsNLoXAJWsfI1LePWDxGwWrjYzl1YJVzw69lvShiN7MWp899b2NYwDgxv4Xx4tV6BYBtaP22WLdJgAQURHXZK5Hh7EQ0+O/rxrTsRL95kZLgYGps3NGkqBFpFJKx8SIB6bKJqXIJqAvaEdtLdpe84zeXpMgGTEr6UXa9TYVhgWeuwUzI2O3EETAmm+SZKhmx9zto9s+M75B87C+YJnzmqYVPOdmgTWSihOJ5wnFc2nBCJLssH8ax6nRUC8RCvtOCwYqIz/WNt+CNLHhuAaL6ScL/OQcdEsqv1sivxWNetCXP3EBomxXjtqdbHampKyxvEpdU69rVBt0erPBZLVY7BYrY7UxVhtjs9mtNsZi7Y7aUiyw6hpaWla2yu7fV8rbHRRy8dMPLnrwmVW2dm1SAKCssunNT7Z88M2OmZNzFswcOnxQSnjcjRiSk0QQ4Fy/X16lrq3XJsT5tILOgeMtE69bjRmRhkR8F6XytQQt2PCxDgtlAvnDrGU7z6MHbQAAYFnLRtayseUZIQXeCtDShcItgkoVR31FEAorIXA7/xVrjxSMEkW8ZtXchw4AsJaNNv3rQsUj6ID/bBdqkQUdLAuhiGpp6alpRG8Vt8rJzXAk3M8eLUXHAg0n3L0TU/R7E5Yv2/aZiWmZUMwD7Ko7t6vuHAAoBWKVUCKjRSbWprdb1FY3V+Y0SSb2j60pqEtot/hM76IUKB0J9yarp+ozD8pNFdyFYq5IIXrNfGnyxBqz+oey7Tvr8+88/N6tmfNyI7M6SrtbWNvuhlOflWysNjcBwNyE0Sv6TUc3wrAeYufMO2qfKTfsdg5yPMNwFiNT32A5LSAlviTc85t/1NhKAaDKdLDMsCNTORfdAsMCym0HFZKMIql4NBp23LZr53lf+8gheM7tSb9nnK75rvYZZ4KMkCkelkivc3tLIFyEyr4LxXNU0b/omu/ifO776UCQSkXEqyLJYnTAo778iQsUty2Dg62kvHH73sIDx84XFtf51d8Z6y0YltPq0cu6KFVXF+fodUYMSfm/56986vU/6xrQ47ODxWL/a+vJv7aeTElULZo9fOHsoSqlm8NaLxIbLR+SnXTyrEvf4R9/P/zAbd6Xwq6u0+46cA4JThzdH4n4Tirp4dkD+FiH9QoknS6KfN+ivtFzJh0AvLY3IelMcdT3jgYplGAUazuIboF1gJZcyjHn7IZ30QEAu+E9kh7g5xq2bkjkYoPGBAAGrfsCdsWFdZurS+pcR9pExrbUTNeWtRRVBw9OuPskUxHz3oTl/zqwSmdHm7Lp7Jb2QWciin559KXT1mecO1Ge5W7Nk6+OvCj1WJtj1JtvHPNfNNoTEsQJVeZqAGiwNjbZ1NFC9/M4PMjTnmh9PFDhZvrGstSp9VbtltpjZ3QVDx77VCmQ5ihSUqQxSoFUTAoZnrWwtmabocxUX6SvchS2A8CQiLRZCSM31x3T201WjvFcVnhN+gw0hGGBtqfuFSTbThI0z3M8tJyqpsgmOo92rK1YiOxCS2gM8xFJuSnf4zh1X0j/kaSbLzWe67A+wrNOLIZpNa9l7G3fkg4klaSK/pGis5B4mAmpfRcIx0fF7TDqXjcbP0XH3CFIlUR6jUR2i9uPj2duX9JHPnGBIu6gyilIdh8s/va3/acLa9ABLLwYTdb2Pcp7PPvZIwZnJ3799g2ffr9rzYbjHNfuH+WCyhrNR9/u/PynPXOmDbp6ybj2jVl6kcsX5iIJ9zUbjo3PTZ80JtM5iLDamGfeXIesuZo7rF9OZueP5z34lsPHOqx3oUTTRarXrdp/t+9q4jtKOEkU+T5x4YqAFE7CCXe/CBUP8kwxY3HTWsCqfZSk00jBKHTAHwqVzJFwr690P6s1NqmlqPf86SrXkTbCC33ejTovd1+6DqdvfDU5rv+qGbfcf2DVGa0fFU+pssh3xi8bokoEgJFTB6LDALSA8lr2Lg+ZqWQjVMOONB91PN5ct+Wq1OWu417YONvWun9anw5WDnIahDsO/V+Zqd7IuNy90NlNh9SFh9SFzsH2TmnLHj3+ORrtAE64Y8HWbDtfot/ieCymIsbF3pcimyCmIgB4G2fU26ubLGfjxENdX+TesMgVTZazBnttqnxymhzP4cCCjqJS0BAAx9aA29XnwwtJurkkZtlyNOQbrl2xtldm47doCAhl5Ad+ZZx53n3FR4gLtX23W/dazaudIxSdznFqnjMBAEkqCTKCpBIEgjEC4RiBaApBeKqc8KAvf+J6nboG3cvvbzycV4YOYOHIZnNTJtkj0ylCgUwq/Nets5YsGPXFj3u27y3k2t+LuMBuZ//aenLDP6dmTR1469VTEuN9asMSamZOyflhzUHn1u08D/99ee1t105dtjBXIHCzRktJWeML7/5d6FpTSRBw9w1dOnunaTc/K9jwsQ7rpWjJUpIeaNXcyTGl6JhXhEQov1cgvxOc1l+lRBPthrfbtsG8I0SqN7mmcs6ej47wVov6VknMnwSViA75LCUroaa0AQCaajTaJn1ENLpCRtrAlrU28/cWsgxH0W66ZWgaOzELuZNwwt0PafKoNbNu21x95rPCvXnqDm+YOPRXxNwyYNKl/YbTpJvfcavWKQ8ekBQpkYvN/iyPHiQjVSMogmJ5FgA21W7JVY3KVgxAN+rYl+e/0dpbEhCJ4gTktad1nUxqYFioca5tn5bwhFMxOyEk5dGi7GhRdusGnkWJspamf4dGMSxoKDqNICRIHxW7/ahQPNM5EpYIUkmQKp7TOAdZpsT5qe9Y1r8rVZ7T222HkaBIPE8gHIsEPWu/7lPoC7V9Nxs+Nuiea+3CT5LRctUrIvF8160Coy9/4nqXM+dqH31utcZjMVSUSpqaHKVSSiOVkgilRCIWisUCqVggFgs4jn/6jXXoC7AQxrvLKZNkWDQp76y05KhnHl5cUd388x+HN24/bbnQS7c9juc37zyzY1/RDVdOvGbJuF7370YSxBP3L7j1ke+cm9czLPfB1zt+Wnto4ujMQQMSIiOkIhFtMForazRH88uPnSxv/5a554YZ2f3d3MsPZfhYh/VqpGCwJGYzY15tN37M+XYOT5DRtGSJQH47QaKTDinBaCDEwPd8Iq43IcTiyM/NTZfw7Xoz8lyDpflmSfRv4K6Npy8yh6Ue2tKSys/fWzRlca7rOGQMaSlkMerMu/44fNHSca7jAABnDhY7HsiC3wANJ9z9QwBcnDTo4qRBjRbDocby4+rKRqtBYzMb7FYxJYgQSqJE0mGqpLGxaf1kaINyt9rfk3FLppSEQsI9QhAxO37mxtrNAMDy7BuFb92Qfv3E6PHodu1YWMuXpV/vb2qbj7M4aSERiHWKMSwEqa0t3RuFpNyXRu0YFkooWjAEyX4ytpa5TWGPpgfYbYecIyxT5PzURxxbx3P+tZRhmDPt+06KJAuRiFcs2/tmf4fUvlvNfxp0z7Y+JckYVcwqivajvMBPffoT11tU1jQ/+PSvBqObWerRkbKp4wdMHZeVkxUfoejwAlKrc7mngoU+t1XMRlPLgl59WWpS5MN3zLn92qkbtp9et/lESXmHPXBtduaT73Ydzit74bFLe93kgP5pMc8+sviJV9YijcvVGtP6rfnrt7Yr3mznmqXjll8yGo2GNnyswzwTR/rUas9H1TXDCVKWGL8PHegiQkhLr6KlV3L2fNZ2gLUd5JlyntfwXDPwLEGIgJARVIIdaK11v1J2Q4TquQ7zooRAlnAWDXYKQchkif7V4gQbQUYF6a9EUPHSuANoNBCGTRzw01stj/dvyGufcB8wvJ8qRuGoYf/y+TW5Fw1RXlhG1eHIttPFJyscjxPTvfQa6boO3liYNzFi+fyUwfNTBqMD/lhf+5GPi7nLlJLG6sDUbXXRpUmL9zUd0Nl1AGBhrR8Vf/J3zYbJMRMHKwcniNEb+HbOXmI8f0KTv61hu5Fpu08+QJ41MRrNQl6Thju9YGHCyrYk2mSCeMA3lrDeRiiajqT/7Lb9PKclyF45MdwvtHAUknC32w7xvJUg/MsUMMxpNOSN2yU6KToHDXljt+1HQyEvdPad500G7ePOEXnE08HMtgP07U9cr8Dx/NNvrGufgVLIxTdfNemSuSMEPdHzAQs2ibu1AYwm9G3QZynk4isW5V6xKPdMUc2fm/O37DpjtrgveD+aX/7gM6vef+Eqt/cwQtnksZlvP7v8mTfXNTT5t5qLXCZ65M6LZ072+1usZ+FjHRZeCFIwnBQMF8huRUccLBvAup+k++GkaC8yYkqOVCE26S0AsH9Dns1ib23I7kCQxIT5IzZ8uxsA6sqbHpj30m3PLx89YwgtoKxm287fD3/4+E+tGw8Z70fjys7pvvcWz/Pnz9aeL6jRa4x6jdmgN/MdL7rSOXf97zI0FNrcdhRy65XfH2JsbTPaepCMlj2Yff/LBa9a2JYv4zJTeVl5OQA4V6yf1J666+i9zkn2Viqh6t4Bd5EEuu+3Zy1AIhjWS7EXlmqh8DKnWC8kFM8z6t9wjvC81WL6RSLv4IQ1jAiE483wiXOE5812216hyL9bwjZLyyoOvuPdzVclSb8rL+zWnWgo5IXOvtssGzjOaRUmghaJF7c9DY6+/InrFbbuKjhbXIcE42IUbz59Ra9eFhLzTCwWSMQCJIms07s5WPVxgwYkDhqQePcN09dvOfnLuiN1DS3tQ52dKar54Osd99/S+zpljRic8t3/3fT5j3t++fMIOuaOUi5efPHwKxaNjvahbWyowcc6DMNCHC2kJ84fufWX/QBg0Jq2rz548dWTkW2W3D574/d7HNnmqpL6/139HkmRMqXEqDNzrjOW5lw1yflpMHRHMujMsbLVn+/M21+s17pJvwZQr0u4+04V41Pnme6RIUv/14D73j/3oZ5xudvPX+h2CgA2zmbj3Ey6jBXF/Cv7vghB7y3awtXKvUsP/L5Y3sbxaG8EDOtFaMFgWjCcsZ9wDpqNn4tl1xBE0Fvd9SyhaBpBiPgL98wcLKZf/Uy481bL32jMG4J080XPg39Ts23WXYy9AI2GvNDZd7v9pPNTklBC8O+b9uVPXK+wdmMeEiEIePqhRX5loMwWN2fFWIiLi1aUVTndgQMoLmtwfoq1kklFyy8ZvXThqD83nfj8pz3t+4qs2XD8isWjk3rhGqpH8ys27TjjHElJVGl0ZsfNGLlMpJCJY6PlQ3OShg5MGj08TSQM+rdGkOBjHYZhoW/xzTMcCffMoanRCSp0GCBtYNKcqyZt+mFPa4RjOX2z0WkTAIDpS8amD05GggEX3O+D+mrNu0+sOrKrEB3AerlByoHPD33mk5LPT+n8mDU/QjX8tv43y2k5OhBK6s3553Qba8zHTEwjD6yUjokXj8hSzkuUjgKfC5bNrLrCsKfWfLzJes7ENNg5I0kIhKRMKUiNFudkKGbGiYegrwEAgEZLwR/ltwDAtIQns5Rz9faaQ40f1JiOEEDGSYaOjr41UpQJAAB8geb305rf9PZqMaVKlU3KjblVTHV4Ctvpv097amtRke6vOnO+wV5j4wyeM8s3Ze9GQxfwwJUb9lQY99SbT5pZtZ0zi0iFXJCQKB2VqZgbKeqPvqADAfl9ddHxpi/19loT22hiGkxMo5VtK+1ptJz9onCK07YtpsQ/lh3hvmpyS/V/yg270CgAACzP+FUuSESjHfit9GqtrRwAVvT/Q0JHAQAPXKVx/znd383W80amAYCTUNEKQVKSbGyabKpS2LLAiFuB+n1hvYVEfou++T7nCMtWGHXPyiNedg6GH4KQCkWzrZb1zkGr+U9W8YDvfUUspt84Fq0R84ok3VzQskwFRaWh0Q6xJv3raKw3CJ19J4B0fspxaqvl7yAtl+qsz37iQp/RZM0vqEKCU8cPGDbQv4s0La6M7oXSUqORhHv7+l/MGU2RS+aPnDE5+4lX/8g7Vek8xLLc2o15d66c5hwMfT+tPfzB19tbV0NVKaWP3Dln2gRfzwd6EXysw1qZTL8ZjF/bmWKeN1JkrEAwRCpdJpUsAgCWra+uHREX+7vB8JXZslEsmh4d9ZHe8LFe/x5FJ0VFvisUDHf6c1brjV/a7acBQCgYplDcJRFf3Drqlkb7pN7wmVx+c2TE861Bq3W/zvCOzXaU5y003V8mvVIhvxXA3wZHvN7wmcH4FctWUGSiTLZCIEC7Q9tsx4ymn6zW/QxbCcDRdH+Z9AqF/DYAEvzZd89/zgWcwfiD0fi1nSnleZcy1tTkthWJArTvYWXg6Iwld8weO3to7kXob7DV3a+sKDlZce5EOTpwQfrg5HtfuwaNBkEQs1ElZ6qfvPkLtbtpZVgYUAlVjw58qEB/dmPt5jxNHsu7zM5wRhLkEOXgxUkLcxTZ6FgoYXjLnrpXi3WbnIM6W6XOVlmkW99fMXtS/MMiUuk82l6N6ejJ5p8qjft5cPkH4XiW4SwmpqnWfPxU88+psklTEx4XUyrnbZxpbCUmpvGviruNTL0jUm7YXWM6trjfxyph+r76t85oVjviRqa+QPt7jfnYJf0+FZBoKVyg/j4AYOfM++pfP6fbiA74r86ct7f+zWZry/LQDmZWbWbVDZbTJ9Q/9FfMmhT/sJD0dG8mIL+vgDjR/D3Dhe7JpZFpkNBRenv1P9VPNFldbn/auUqdvbLKdJDhzKOib3IechaQ3xfWu4glS8yGD5B6YbPxW4oeJJFd7xwMP2LZSiThDsDptY+ron/05ayJ5w1G/Sto1AcU7bif6sJu3SEUublp55ZB9wLSCry3CJ19J9ul+HXqO8TSK0WSBTSdQ5DRBCFENgiIvvyJC3HFZY1cux6YF030+4S2oUmPhrCQNyAjbuf+IudIo9pQ26BLiO2O08veS6WUvvbE5bc8/G256+2KQ3mld0JvSrj/s+fs+19tb30aGSH9v+evTEuJbtsijOBjHeagN7yv0T4vFAyXy64DAIYps1h3CAQDQLKodRuN9n801V8smmy2bFA332+3n5bJrjMYv2xufig+bvOFbZ7TGz6g6Uy57BoA3mz5p7HpelXE/xTyO1r/HIRG+0z7bLvJtLqp+V6azpBJryIIidW6V6N9xmo7GBP1uV9z2bW6l3X6dwX0AIX8bo5TGwxfkFQcso3e8IHZsl0sni6RzON5u9myQaN9huMMEcqHW7fxZd99+3Oe0xs+kkqXKhT3cVyzXv8ew1aoIv4nFs9s3SZQ+x5+bn9+ORpyJZIIX1378HuP/vDPr/uRIYIgZiwbf/crK2RKCTIUDN4vHTuntkL96DUfGfEdznA3UJEzUJFjYa3FxuJzhmK1VW1kTWbWJCRFclqmFCizZJkDlTkSqvPvZjvHOjer8UpIduZdzfLWTZUP15qPOwdJgub4ltb5JfotJqYxSTraeYP2yo27K4x7kSBJCHiedU55Vxj3bqp6aFHqx2QHJdjN1vOHGj80MvWOajvHa+2c8VDDB4NUSxzZdgLI1j9Tays7rfltRNR1Tn8GQOD+PhzPbKl+rMZ01PFUTEUmSkeKKZWNNdRZ8g322tYtEyQjY8QDFYJkpdB9QUSxbtOuupc43u4UI0iCdorwJfotTdazC1Led5Rmtxeo31dARItyWNcGxFpbuZ0zAwBNiFUiNH0DAB7ubQyMuDRGPNDKaiys1spqNbZyg73tLncnmJgGvV2+rvxOM+ty2eMsVTYRDV0QkN8X1guR8ojXNI2XAbjMYjFoH+fYSqniEf/SjjxjtW62mH4RiS8WS1egoyFGKJoiEObabS2HOwe7da9B+5Q84gXPJ7g8b9E2Xc+x1eiAD0gyhqYHMoxrytX0nUR+B0l6vbznjfo3zIaP0XAvETr7LpIsNOr+59pTiLGYvreYvneKoAhCSpBKkoyk6SG0cKRQPIeiPM0ZcqfvfuJCnNvkUUa/GDTkzXHXal+sVxg1NBUNAWzYduqG5R2eNWEOErHglqsnP/Xan87B8soOT0RDkMVif/OTLc6Re2+aEa7ZdsDHOuwCo2k1SUbFx613ShUyPO/SKYgAYXTUBzxvq6oZbDKvTUw4QFP9OF5rNP7A8xaCEFtth/SGD0SiibHRPxCEGAAilP9paLxKo31eLJouEAxy+cMAAECre0lv+Eghv0UV8VzrGMep1ZpHRaIJcTE/t/59mprvNplWmy0bJeJ5rVt6xrCVOv37AjorPm4jQUgAQKl4oK5hLrKZSvVSFCFzbAAASuUDNbUTjaYfnBPlXvfdlz+H560G45dCwbDoyPcdEYFgYH3DpSxbK6Bb7nIFat/7LKlC/OiHN13z8MKda4/UlDYYdWZFpDQtJ2n83OFJGei9luBxn1zrujce+6Xbsu1xSaqRE7NGTu6tc7usZtue9ceKjpdpmwws46lBx38+DdHls8SUaIhy8BBlh3M6fGdkLFvrjh9RF5WZGuoszWbWxnVcO+/WzlmvoSEfHG38rDV7K6ZUuTG3pMmnSagojmc0ttJi3cbTmlW15uMNFpcWfu0NibzyjOY3nucTpCP7yabESYaqhBkCUgLA6+215Yadx9VfO1qONFrOFurWD4y4FP0jAACg2nSY45mxsXcNVi3jePvuupfP67cBQKVxf7OtREjKpyb8t598soXRbK5+rNFyBgDO6/9pn3AP1N/ntGZVa7Z9aORVo2NupwiB4ykP3OnmVQca3nU8jRD2Gxd7j+Nxe7Xm4ztrn3fk+uX0/7N31+FxG2kDwF8tM9lrZoY4TuLEYWZO2zRtykyX9itce+2VGa9wZbpy2jRNw22YE4fBMTMzLPNK3x9ra7Xy2l47u846md9zzz3SzKyqjeSV9GrmneAMxc0RwgkidggGDCuubzHl53eur9PnAIDaUru34ZlFkZ+6fQfgrePlFYsju66UpO21DzYbLwKAjBu9LOpbWm3fIoQTIoQTyNX8zt/Jf9vBUVtrT7d9YbR3sDBegnRhhCBbzA5nM/gmu6rDXFanP95mKgrkpdA/BgDeO17IcMTmjBGKH9P3SNNh0H1mMm4Siv+Py1uCMWS0WgrCbquwmI9ZLUcs5iMErgIADtfZa8OfCSXPq9quBdd3vUb9D3ZbtVj2Qc8eMQ5Wc45O89ylpBHn8OfbtC4fJ3CNpuNOieJ7t0lXHOy2Ep36FYt5P71iWPGT785gKISSZ3XqF+gVfSIIA2E34PYmm7UQjH+A+gUOb5ZQ/ASLMrC6X8P0L47jLluxxdrX3ezwYrF0vcinkkvpAwr7depCFb0I8XsjksNEQq5OT30DB3/ty7v9+olYX+9eEQCAMSOiaCVmi81ssQ2XFOeHTpZRM9GzmIyZk5Mp9Vca9FuHODAZSput1Gw5y+Vkd5exMNfnOw4nEwAwjMNiReG4msWMAgAWMwKAwHEVkxmi1/8GAFLxE44ANABgmEAifry1fbXO8Au1A7tjrhq15h2N9r9i0b0y6StkFQAYjJsJQi8W3UuNWwr41xgMfxpNezwPOhuNOwDsQuHtZBCcyQwR8FdqdZ9RmzEZLm+YGJiYw04zmY8A4GQ2mH6/O3iwHbu9iSDMbHYG2YbDTgMAm62aLPHWd7/KhccHr358Eb10CPnkgnfqQFHeqQp6qSuMgfEFXMfNyuBC83wh9+6nFo2alBge43JCDy9n9he8/cA3mnYdvcIdvw24e8ve5vPvFW3Q2wZzPlwKjbUur3OdY5nPUiyN/JLMlM3AWApugkKZECGcuLP+CbvrTHo9iVjB00NeUPLSRewQ1xpMzA5Nl98QJhi3peZuO2EFgErtvt4C3HbCEiOaniG/CQCYGGdS0FM1uqN2wkIArrM2TQ5+Klo0FQD4LEVWwD07658AgA5zmZ2wknFwB2/tT0HnesdCCH8ULZ6OASNdvqrDXFqq+RsAyjQ7spX/YDOE1DYOdsJ8sPEVR/RWyUtbEPEBtRmbIQwXZIcLsk+1fnqx81cAaDHll2r+SpYuI9s4ePF4XQ3Otn1tJyxKXtrssNcFLCVZLmKHBvJSk6RLccLmttOut47X8EUQWps1n8C1OKEhcC1BaJzL3at2nN6X2WrJ6WiZhjHEDEyCYWKMIXb8PwOTYAwRhkkwhpjJDGF291/wZwLxYzZbhdn4J60ctzdoVf/SwjMsdgaLncZgKDCGHMBO4HqC0ON4s91WbrdVEq4jP4YRNiebL7zLqKe/LbOYD7S3ZHO5czm8uUxmOMYIIAgNjnfYrBcspn02l/k2mXzhTUb9T5SS/vGF9xp13xCEnlpotZzpbJnNF93F5c1nshK7/1ptdnu91ZxjMe02m3YBZcQSizOKyQgdxKytl5f/fHe+8G4Atl7zOi2l5kDgFtMei+mAUPyoQPyo2x9Yt4bjX5xY2PUsTaXVmq6YnBtCAZdeBGB2F5nqw+kL1RXVbfRSxO8xmYw5U1I2uc4k2dis/vPvc9ctGk0tRHpiMrviUyQWk8Fh+yT44AulFc3UVaGQy+rxja4k6LcOcZBKnmxpu7GldTmXO1kouFHAX0IGzUkYJu1e4DMYXX8XGMYFAAKsAGC1XgQANsel2wGHMxIALJbz1EIGQ6zVfaPRfiAS3kKLtgOAxXIBANra76SVAwBuH8CZZrOVAgCHnU4tZLNTqKsAQBAmvWGt0bTXZqvAcRVBGLq79jsD7v1+d/BgO0ymEsPYNnuloz0AWG1VAMCk9Onx1ndHLi+fXPO2/kJPYeEgkQnmr8oeNSkxIT1cLOFjjK4nkKWpz9i6e3YvWJW95pVrHcs2i13dqdd06svy688dKz19sNigcz5LGPXm+qq2RasnkCV+xYbjrO6/wN7Ulze/cttnZqPLCJ2rVq6q8tX8tTg5K80QKlFvJfOrZAeucTsvZahgTLpspSOw2LdY8Wx6EYWcGxcjnunIPN5uKqZXU8SIZ5LLXKY4iJ/eaDgHAAyMHS+ZR1Yp+eSVg9BZm6Qc+ujXS98fjaVOZ+u66UyUun9DmChd7Ai42wlLi6kgXDCO3gKgVPO3IyU9A2PPCH3ZbVAeALIC7yvX7jHYWgEgr3NdzwCud4/XFc9OWETs0Hnh/+EyxfQ6AADorU+6t47X8GW1nFe330gv7Q9BmO22cnqpKzZnoizwD3qpX5LIP9RiTJOh65WbK9xmvWCzukQirhgiyfM2a57VcoJeQVjNpr/Mpr/o5a6Ekn/z+MsHGnBnMORC8RM6Df15A8db9Jq39Jq3AGMxMCkBVgLX0jrgOzBZsVLFj1bz0UsMOg89//nuuL0JCBOTGW6zub8mesym175HEHqh5Dl6Te+G3V8cm83k8dgmU9dDpkNJZXNinPuBIMOO1F2Kz8ZmdVhw1yN3v3Cc+Pa3o/RSZJhYNj+TFnAHgC9+OjQxK87zc+DqREvgDgAKuXAYjQzAXPdVrTEeOl56RU6X6oB+6xAHDicrNPiwVvep3vB7R+dRlfp5iXiNWPQgGXEGAGqHd8zdBJ44ocMwNgNzefZkMOQADAJXUwtt1jKV+UUAsFgukClZSDiuBgCx6P6eCQZZrFhaSR9wQgcAmOvDLAMTUVdxXNPStsxqLebz5olF9zKZYRgmUmtecwS+Sf1/dw+2g2ECoeBmnf57lfoFHm8ujqs02vcxjCcS3kHZjne+O3J5uY+zXAq9xnjuSCm9FGDxTRPvfXoJl+/S/daBzWWRAXez0Uq+D2fyGUF8WVCYLCE9fMGqbJ3a+Mc3BzZ+f8TSfVu/8bvD6g79P9+9gXZF9K4STUultm12aEq/AXQCYFtt3rrKM7md9Wa7TcbhZyoiro8ZPTeM/vbMYcNnux3R9slLxqx6ZH5kYqhATH9/ePVYW72fGm2PFYXECoNlbBGHwWJi/fzLX6Jq3WHHApcpjZPMca10SpIu9UoAV86JcyxYcB1O2HoLd8o5Lr+kYnZ4I5xzlLMolyIOQ8TEOHbCAgBWfDDd8frdH52tiVyWcWKcFRRSThS5rKekdKcqVm1xLEQKJ4jdRckdGBg7UjixWL0FANSWap2tWcQKpjYY4uN1BRgTcHdv0fY+eOt4IcMcUyz7gMlK0WveBBhYR6fhDWNLFd+rO26xWs7Qq/ojED0sED0AAAxGII4PrBMKX3S/zVpgMvbyPoaw4UQ7vbAbi5UiDfyVwQhgc6cAYG6j0v7ssn933N6i175tMv4B3dOBXDqD7nMWO53Lv4Ze0avh9xcXHxWYX9JILTmYU7p4tnOg9LAWFa6gFwGcPF+VNdJ529O3z388mFdEHwuFDBeJsUFTxyccPlFGLTSZrE+8vP79F68P9TgWeRXavvcirSQ+2jnO0v+FhchoJS+8t3XRrBEzJibFRgXIJAI2202sbfhCv3UIickMkUlflUqeNRi3aLWfqNSv2e2tMulL9Ha9Y2BiG2HFcQ2D4RzuhuOdADjGcPnZxAmdQv4Rgas71c91dD4aoPiCWstgiAGAz1/M5bjpzOc5BiYAANzeAZRgJAEu4wJ1+m+s1mKx6H7qN1VTP+AZD7cjk75itzdqdd/o9N8zGHIOe3SA/FNqdntvfXfk8qJH1i5d7skKMnpOumnNnFv/z9knl4bLYxu7s+MZDb2mgBBJ+Xc8sXDyvIyX7v++o1XjKNy3+axQzHvoxRUuTb3q5/KT6yrPBnKF18WMvjU+W8lzeRVGMtttj578Y19jCVmishgPNpUebCqdF5b63rhruEz6v/b5Q0UAkDkl+fnvH6BVXYXy1TWOhRCe/M3MO+NFvQb4vMuK69WWWsdyqGCMY5JSt6ScKD5T0cfMkx5iUqY+sxPWngFuBwErkLrKZggcC0I2PZrJYnDtdgsA2AaVQaXf/XFE8x161jowKD8muOucbw5WXN9h7npcCeL38xxO7bSuMldQA7hDf7yGOwbGjBHPoJf2x1vHC7kiYALRAxzuNJ36WavlJL3SYyz2KDann3PJr2AMiTRgnU79rMmwjl7XCwzjiaSvkdNUstgjLOYDLi08IJb/h8EMNOhcHjn6xeUvF8vewTARADAYChY7zWbNpzfye5fxu1tMezWqRxypz0kYxmdxRrPY6QxMjnVfhakIwgKEBcc7cHujzZpnt3ddnqh0mjc5vMUDmfV0mP3FjUyLoAXcj5+tOHuxZkyGp2EafyaXCuKiAitqXN6cbdl1YfWKsTKJm1OCiiDgf78d/W3zaXoFMqw8dPuMk+eqaLk16hpVDzy99vlHF43NjKaW96u0sqVTZcgeHUOv8DM6vfnh535bMidj7vQ0iWjAHcIO5pRs3Z1LKxxeOdBnTkz6+Nv9FqvzuNvt+NbduT2/FxWPxxYLuRIxPyFGmZoYOnlc/HDJr4V+6xAaDOMJBasE/GVNzdP0hl8HFHDncEZbrLkW6wUedypZ6OjizXGd3obJDBEKVgKAxVao1//C1qZIxI+StRx2ph7Wm83HLjHozGIlAYDVVsSDGWSh1eryJtVqLQEAAX8Jpcxms7m08YSH2zFbcoymPQGKzwT8FbQqB299d+Tych87uxTFF7rCpqS0MdG3PDyXVkjF4Tp3w9RffpXEjIgP1v/j4RUfaVQGR8nWn48lZ0bNXjHGtaF32HD8r7p8AGgz678sPjIzJLG3gPuzZ7dQo+1UuxoKnzhFfDxhFa0ffltjJwDMuXGSa7H/er3wrSmBk8crxvGYA77x6pcZ7xq4cFP0zCGLtgOA2lJLdoXrrfs2ScqJMho9CuAabG31hlOd5nK1pcZs15hxtQ032wizHTd7GBbnuHZJJiPLXIZLOQCQI7yI3hPyXMr+iFgh5LLe2hLAdZN7mtoLXsCkj3sCgHZzKZkH5lTrZ6daP3Ot75XRrqKu+uh4XcGknBjqkAgPeet4IVcMFjtNFrjRYj5s1H9jMR/wvAswi5XC4c3gCq5nsVLodX4Pw/hi2ftc/rV67Zs216STPbC4/MVCyTNMZqSziD1yEAF3AJZQ8jybO92g/Y/V0v/jK4s9Uih+ksObRS3kcKcNIujsBy7Pd7eYdqs776Ge1RjGE4if4Atuxdxcc3tlt5XpNW/Rctrg9nqL6W8ufzm1sF/D6C9u8rj4XzedopYQBLzw7tZXnlx6ZcTcp45PoAWhdHrzM29seuvf17hNwuBQVdv+yXcHTpyrpFcgw01EqOzB26Z9+M0+WnmHSv/YS+uzRkbdtCJ71IiIPrKTq7XG3IL68wW1x06V1zWqlszJ8P+AOwCUVbV++M2+T384OH507PgxsRNGx4QE9d+jv0Nl+GXjifVbz9AeSqRi/rTxCS5F/k0q4T94+7SPehz3vplMVpPJ2tquK69q3Xmg4L/f7JuQFXfXjZOS44dBZxT0W4cAEDZ7HYtyKwvABIwJxMDySQiFt+j0P2m073M5Yx3zlBKEUaP9AAATCrt6pdDIpW/abOVqzTtsdgo5I6hAcK1a87ZW96WAv4LFcr7dtOOtDEziyJzuCT5vnkr9kk7/o1Bwk6PTPY5rDMYN1DaO+U5t9gayf4RG+ynu2g/DEx5ux2w+DGBnseKAkiCeylvf/UplMVvzj5cVnqporG5tb1SZjRaz0YLbu8IXnvvs4Av0Iq/q9c5g0GorWmklNzw4i0zX7haH6xxhYdT3E3AHgKBw+ZP/Wf3CPf8jw4ufvrRxzJQkeaD7UPilyO2s11q7wpGRQvnoAOqvj9O+xuKttXn0UordDUVbay4ui3LpauRInhMS5SY66Z9KtKUl2tKfq9eOU2RNCZycKknBPJ4KrF/RgqBibR0A8Jie9wLzAgslDQuPKXNWuEMLgrvVZDx/rv3bRsP5wQ1pd8CA0Vvf7d76mPfm0vdHyonkMWUmuwoAqnUHo0RT6C0AqnWHHAsYMIL5Li+uHUy2TnqRZ2gTn3r9eF3xeMz+n4568tbx8il50MCeggaKw52qDKunlw65wFA/eobhcKdyuFMJXG0xH7JaTttshbitDsc7CMIIGGCYCMOEDIaCyYplsuJZrGQ2dwKDMZyGkLvF4U7hcLfbrBfNpl02y2mbrZzAOwjCjGECBjOIxUpmcydxeQsZTPqrYqHkX0LJv2iFHuJwp3G402zWCxbTQavluN1eheMqAtdhGAvDhAxmCJMZy+KM4fBmuI2rCiXPeZ46XBF0jF7UO2nAL/Si3oll74ll79FL+zOU3x0AcHuTRvWIa7RdJAvcwGKPoLTyCJOVIFF8rW6/zWJ2+XWymPcPNODuMCz+4jLTItKTQmmd3NVa4/+98Pv40bFTxifERQWKhVwCwGKx6fRmjc7UodK3d+ib2zQ4Trz0xBLqB/3Q9Uuzft96xuiapz6vuOG2//t+5ZIxU7MToiMCHLkt7Xa8uU17Lq/m6KnyoyfLqZkSUxNDlQGiQ8fdZN1E+qA3WMoqW3QGs95g1hnMer2la1nfXWKwtLRpaZ86n1d385r/CQVckYAjEHBFAq5QwBEKuCIBVyDgiARcoZCrVIhiIj19BLtu8Ziy6tZtu+k5UgDgTG7NmdwaDps1Mi08NEgqk/DFIp7NhhuMFo3OWNeoqmvsbG3X9t4lxt9ZrfYjJ8uOnCwDgLBgaXyMMj5aGR0RIBHzRAIun8e22XCj2drarq1t6DyXV3uxsN7aY7A7ADx810y303K65SfHfeXiMSwm4/MfDxn66xHYG5wgjp0uP3Gu8o5VE2+/fqIvk+B6wWX/rWtqUdc3qXUGs17vOMouR99R2Nispn3qh99ztu25KHQc4u6DTjsNoiMCAuTuJ6NCXNkbm7I5nFEcdgaTGYLjWpNpn81WJZX8k96wTxz2CKnkabXmjaaWuXzeLABwzCAqlTzJYbsfe4dh7EDFt80tC9o71gQrtzlmNGUw5ArFx+0d9zW1zBEIlrOYYXZ7m81WajLnhIbkuL4Y6AuLFS0W3avVfdncuoDPm0+A1Wj8m8WKsdmqyTYCwUqt7ptO1b9ttnIM45nMRy3mk1zOeHPP+Zz65OF2hILVOv3PzS3zHasYxmEyI0XCW8Wi+wAw8N53v/LYrPZf39+++at9OnVXD2x/NrDInSeaatqpq3wBZ+zUfoaPcXjOgLuHM4iOnZY8ed6IIzu77nuMevNvn+158IUVLo284URrFbncWyp2nCDeuribXGVijJvjx40NiGw0an4sO1lvUDnKPyzYvzQqg3qdVYYrakoaVT1uF/ycBbccbcs52pYTyA2YEjh5SuAkJdcLT3fXRU55o+A3ADjcmrcgNIte7TNW3Egu99sRmN1fgzNtX1/o+IFaImaHSjlRPKacy5SwMB6LwW025tXpc6htemJgTHpRtwG95PDK/jAwdopsxfn27wGgVLMjRDA6UbKI2qDecOpiR1cIJl4yl+suwmvB9eQyE+NgHuflpyarAW8fr6sBA3P+wHrOW8cLuSJhDCmXv5TLX0qvuKKx2BmsXh4SfIfFzmSxMwEeoVdcBYbsu+t1HxC4hloikr4+iGh7N0wgfoQWcLf2MzyiH/7/F/fAbdP+74XfcZweUzxxrrLvbo/hPbIk+yGpmH/XjZM//f4ArbxDpf/q58Nf/XyYxWSIhDyb3a43mN3GVSNC5e88d82Z3JrBBaGuZoWljY+95HYO4b5YrLaeM3bSjEqP/Pi1G+ilvXvygXl2O/H3Pvf9qyxW2+kLzsDNlaqhWd3QrKZltPfEwpnp82ek0Ut75yfHvbVdZ7bYgpWSStd+3wNlt+Pf/nrUYLQ8dPt0ep0/uey/db9uOv3n3+fopf3R6EwanYle6ur+W6fecu14einiBlMseshkPqg3/EkQJiZDwWInBEi+FPCX0Rv2RyJ+mM1O1Go/0+l/BsA47HSp4hnXRCt0DIYiMOCH5talbe23Bwf9zWAoAIDPmx+s3KHRfWIy7cHxDgYmY7FipJJ/MQfYvUAmfZHJDNbpf9Lpv2UyQkXCO0XC2+obnYFKDnuEMuBHtfYdjfZjDGNzOdlBys0Wa+5AA+6ebMdmq2rruJfBCBAJb8UwMQAQhN5kPqpSvwTAFIvucTTz1ne/kuB2/LkbPnKk5h4WvB8ZUXc4wzQAkJQZxeieBLU31JQyhu5k7v26/r4ZZMAdAPZsPHv3U4upsXuvKNY0k8uTg+IoNU476wurdc6r+4fjr5sXlupYXhGVec2+rxoMagCoN6jOttdkBUSRLbPnZtSUNJ7YmTt12dDFl72ozdy+qX7L5vqtSeLEqYGTxynG8Zie9lzoaX7omHx19eb6nMOteR+XbLk7fr7gErbmORbD+V/pt3Mu3p1kw60i9WYyus1hiDIDbosXz6OlYgeA3I6f+w5we4sX92ek4pZa3bF2cwkAcbjpjULVxjDBGB5TbsF1zcaLjYazju7zYnZYtnIN/cMAAMBmOIciTgt5NlY8m1I5AF48XkgfvHW8EARB/BlBmMwG2pjiCJ7gGmrJQLE5owFjUbvMEwOcO3fYGZUe+dDt0z/57gC94kpx4/KxZVUtOw8U0CsAAMBmx1WaXrtZxUUFfvDy9TKJYOzIaAwDt1EqxP8xGNgzaxZEhcu/WXvUPvBB61ezFQtGPX7fHHqpf2vv1H/9y5GdB/Jt3jvWv246lRgbNHdaV5TAP6HfuqseJpM+D/A8vbgbkxkUGd5IrgYrt5PLYtGDYtGD5CoA8HkLyOQwboWF5tJK2OzUiDD6Kz02OzVA/imtcOCwnntI/S4AwOPN4rlmKWSzU4WCrld0nn/3vrcDAJ2qJ3F7S2jIcQxzDryQgq2+cZTRuI0MuIPXvvuVY9t3B4dRtB18EXDXa11eMCpD3fR1peHynSlEaB/vQ9LIyLDogIbqrg71Bp3pzJGSiXPSXVtdKjKSjgGM6SWfzA/lzrdViyPSyWg7AMg4/DUp0/99dotj9UBTKTXgfu1Dc3f9enTv+uOTFo+etGgUWe63wvihDUaXXyUAIIAo1pYUa0t+ql47TpE1NXBKsiRpQL2wHTDAnki5NkUS8W3FzvW1h7c2HB8tT0gUhSl5UglbyMaYDM/62E4KHNh9DIchIpfNdpc+bj1Zem+AE/azbd84ltkM/pKoL3rLMI57nIn1Unh3f1gYb274u4ebXqs3nAKANlNhm6mQ1iaEP2p66As8ppxW7kBN/2KwuYyDGRBvHS+kb946XgiCIP7MZjlHEEZqCZs7DaDXQWaeYTEwOU44UyziuAqAcIwRvlLdsGwsh836+Lv9VqubbBJXgGfWLFDIhLRs9f2aPSXlqYfmCfgcAJBK+AkxQaWVLfRGyDCBYXDLteOzR8V8+PW+i0X19GqPMfpMteonWCyGMkDc2n5J47CDAsX/uGPGrGE1VyoA5JypeO3Dv2idpnlcdlpSaEKsUiLi89318LNa7VabXaUxtrZrSypamlrU9BYAX/58eMbEJDb7Ei8xvoV+6xDE18yW01zuRGq0HQAAWBjGxolL+tW94u1bf5xcZrGZU5dljZySHBqjlCpEbC6r367eQ8/7AXer6xzuov5mtQYAgdDZZVWvMVotNjbHox0bOT6eDLgDQP6ZKq8H3FuMXWd8mEAmYLnJLV6ubTvXXutYxgDWpNJHis0NT3nu3FbCTgBAUXuT3eZ8Ty4Pkrz62yOv3Pb5q7d/PuPacTNXjo9Lj5AoREyW+8swk3WZT6A3M16r1Fcdbcs53n5Ca6P/Fphx85G2Y0fajim5gY5UM4Fcemfqfo2Sx00KTNtSf9xkt+a0Fea00aO6/To0+116UZ8kbOd7FJWlylnhjsba6+11m7nIZO90LCdJl/UW3QYAo72f0Y5e4fX9EbACJgU/ub32HwZbKwNjMzG2DTexGHwhS6nkpcdJ5oQLxtE/QyHnxgNgjo7wrSb3/SY84a3jhfTNW8cLQRDEn9ls9OnuWaxEWskgEIRLpAbD2Fd2tN3hmoWjRqaGf78+59Dx0p7pZdxi9XLH64eYTMZDt08fNyrmf78dzStqoFf3kBwffPfqyROzXEbHjs2MRkGo4S4pLvizN1efya3Z8NfZ42crPX/DxGGzskZGLZo1YnJ2PL3O//C47HVf3HMwp3TXwYIzuTUWa/+9c6iS44PnTU9bNm8kjzJV27Bw9FT5c29vpnZs53JYd904afn8TM9z0ANAdX3HVz8fpmVWaW7VHDpROnuK+yy1fgL91iGIrzEYMpu1jCDM1LlPDcYtdnsTnzfMxgMNsbqyrgQkTBbj3S1Ppo5zn4PEf3gU1x4QzHU2ENze/12IQOySZ7m9RRMSoaCW9CZhRAT8fpJcrSyid76+dHp7V075EL7EtabLn9XnyeXJwfFxYnqIWcLmRQhkzJsvAkAt1C2Gg2QVhmE8IZfACYIg9m84uX+D87u4taPtK3rRkIsVxsQKY1ZH3XBRffFoW8451XkrbqW1aTW3bazfvKl+S4okeWrg5LGKLC4lDUgf/qg9/EnpNpzw2tg9T3CZYgk7QmOtA4BGw1kC8N5mKzXaO7TWXs8xg83Zly2Am0SpoWsyXqAX+YDX96fDXPZX7RoLrhOzw+eGv91HBN8tHlOm4CZ0mEsBoFafY8X1bAbtpa5HvHW8kL5563ghCIL4MwJX0UowRv9DM/tGEDrCtYMSxgigrl7B4mOUrz65rLlVc/xsZV5xQ2lli0Zr1OrNFrONzWbyeRyFTBAYIIoMU8REBqTEByfEBtE30Z99vz9GLxpC4zKjx2VGF5U1nTxfdSG/rr5JpdGZ9AYzi8nk89lKhSg8VJ6eFDp+TGxcFP2JAAAeun2615M4//jRHfSiIeTr//rYzOjDG/9JL/UDWSOjskZGGYyW0xeq80say6tam1o1HSq9yWy123AOh8XjsgV8drBSEhYsiwyTj0gJS0sKZQ+fN0wAwGYx50xNmTM1xWyxFZU1lVS0VNe1NzSp2jv1aq3RYLRYrHYcxzlsllDAEfC5AQphQrQyITYoMy0iMsz9gFcPXa7j3tque+2jv6jRdgGf88lrNybGDfiXKjpc8dpTy596bcPxs5XU8hNnK/sIuD9w67QHbp1GLx2UN59ZQS8aiMvyW/fYfbMfu282vRRBrjhi0X0q9SvNrYsF/KUMhhTHO8zmkybzISYzVCJ+nN4aobB0z+qclp3g/9F28EXAXSTlq9p15KpW7TJQ1y15gDNHBAA0VLd7GHCXuk423Vzf1Z/Xiyz2rvf5YrabkDFOEFtrL5Krq2LGUCqdQgRSZ+yTgiAIY39TfPgnJsYYJcscJcs02o0nO04dbcsp0ZYS4NKbiQCiUFNUqCn6sfrncYpxUwMnJ4v7Cvseayv8b8kWeumQiBJNyev8DQCM9o5q7cEY8Ux6CwAAKFX/7ejw6xZ1rkiz3c0oQoc6/YlOczm91Ae8vT/EoabXLLgOAGaHvTbQaLtDsnRpTsv7AGDF9Wfb/zde+TC9hWe8cryQfnnreCEIgvivHtNKE4TzJnZwLKZ9tBImaxg8EnhRsFKyfH7m8vmZ9IorRUpCSEpCCKyklyNXGwGfM21C4rQJXhgW48+4HFZmWkRmWgS94orzw/ocnet8co/dO3sQ0XYHDIPbrp9AC7gXlDZRV/0c+q1DEF8Qix5kMAL1+p802o8JwshgiFisWIn4MbHoXgZDRm+NUMSkhZecqwIAwrORlJed9wPuQolrwF3V68QapIBgl87jlUWNYyZ7dOMiljqn9QMA6n/XW/gsjs5qBgCbu27Xx1srm7tzzkjYvJmh7gPKAiZbP04AABjAwggvJ725vPhM/nTltOnKaW3mtmPtx4+15TSa6LcRJrv5cOuRw61HgrhBU5STpgRODuC4eaGytno/ucxlsKco00dIY4J5Mj6T42H29kFLki7J61znCM4eb/2vkp8uZNFvrTotlRc6fqQVUkk5zuz8dfqcdPkqSmUXlaXqUNNr9FLf8O7+6KzNHeYyAGBgTBlnkIGDZOnSi52/6qyNAJDfuY7HlGQqbuttlD1O2Gr1xwK4iSJ2KK3KK8cL6Ze3jheCIIjfYjDplw+btZhWMkCEUf89rYjNyaaVIAiCIH7FbLHRJgsNUUrmTU+jlgxUWmIoi8mgdplXqfuPjSAIcsUTCq4XCq6nlyL9WXbPzPf+8R0AFJ+t7GhWK4IvdViqr3k/4C6RCahZk6tLu5Ls9CE0ymWkbdH5aupqH+yurzXMxq70L14kZnEdAfdOs5ur4/qqc+TyksgRHIb7cYI4QbTcqwAAFoPxzIp76dVXhEBu4LKwJcvClpTrKo6155xoP6m10d9/tJhb/qzbtLFuc6okZapy8lh5FofBIWsrdV2R+nB+wIdjHgjmycgqX5NxYlJl1xSq/gQAg611S/U9YwLviRZN5THlBOAaS12V7sDFjrVWXM9lSnvrLS7lRMk4MY6s4vWGUzkt748JuJvL7PoJ0NtaStV/5Xb+bMNNPKaczK7uO97dH6z7nQdO2I+1vJsuv0HMDmVhLsmg+sXA2LPDXt9e85CNMAHAmbavyzW7E6WLg3gj+Cw5BkwrbjDYWlSW6mZjbpPxnNmuXRz5Wc8ArleOF9Ivbx0vBEEQv8VkxtJKLKa/CeLFHjNZecqg+8RqOUEr5PIW0koQBEEQv1JQ0mgyuyRKHTsq+hJnuGUyGRIxr4PSAVGjMxIEuKbgRRAEQTwy54aJ5w8V7VmXY7XYXrrl0+e+eyDIs+Qol4v3A+5RCcGF55wR89ZGlUZlkMj6mjo1IlZJXb2QU26340wPZpjVdOqpq74YVhAlUjQaNQBQpWu3EwSTcnlsNel2NxSRq9dFjyKXabS2rrFpPCZ95PKVJ14UFy+Kuynqxguq3OPtJy+oL5jsLkPzCCAKNIUFmsIfmb98kfUJWc7qfl2xOnrGUEbbHcYGPthuKm4x5QOA0d5xtPmdo83vMDAWTtjJtCRRoinRoumHm153+SRFtnLN7vqnCMABoFD1Z5Fqk4AVyGWKTXa1wdbmaCPnxs8Oe/2PytVDkO3Ei/sjZAUF8zObjRcAoES9rUS9jdaAzeDzmIpAXlKseHa0aFpvedUDuElzwt/a3/iC2a4BAJWl6lTrp/RGHvDK8fI3FlxXqt5uwfUWXGfF9Ra73oLrHNnqHfY1PsdjytgMIYchYjMEHIaIwxSmyXz4btxbxwtBEMQ/sTmjGYwgHHfO7YbjHTr1C2LZe70N6Okdrte8Y9A5b2wc2JxsFvuKGt2IIAhy5amqbaeVxER4YfoNs8VlvlkWixpOQBAEQQbmiU/uiEoO/fmdrSXnqu4Z//yEhZmZU5JjUsMDQ+UShZDNZbPY7rtBXxbeD7jHpYbRSkov1mVNdZ9rxSEsOlAg4hm6s5lr1YbTB4vGz+p/AFdFYQN1VSjhU1e9IlkafKK1CgD0NsuptqoJSmdPqG9KjlnxrilhR8jDRsjpX5zUZurq682/CgLuDkyMOUY+eox8tBW35qrzznSeOdd5wWB3GSVgtLvk9x8tj9/XfAEokfehxGbw50d8cLjpjSrdAbIQJ5x3SEnSxROCHlOZ+xp+ESGcMCXkmWPN79kJMwAQgOttLXqb8zE+UjhpWsjzXKZYyolQW2qdn/QN7+7PrLBX99Q/3WpyGWtJsuJGK16vtdZXavcH8UbMCX+Tx5TTGwEAQJhg7PKo/51o/W+17nDfUX4FN17ACqSXAoCXjpe/MdraT7R+TC+laDO5SXTg04A7eOl4IQiC+CsGV7DCqHOZlN5k+I0gDCLpKwyGS4+Q3tnNxq0G3cc2q7MfRjeGUPICvQxBEATxM5oeM6uJhQMby9uTwWjRG1yG4MskfXVDRBAEQfqGYdiqRxZkz8l44aaPW+o6Dm06fWjTaXojj+1oc3kE8DrvB9wT0uhx51MHivoOuGMMLCUz8uzRUrJk/dcHPAm4H9/rEvujpXT3ihkhiT+WdQ0Nfufinp+m3S5kcQDgaEvFzxUnyWZ3JEwgl2mMNmudvitfRxBP7Fp55WMz2Fny0Vny0XbCXqQtPtd5IU+d1zPPOwDcG7/wTEeZ2qrf3XRuYehYbMA9yy4VmyGYFfZak/F8mWZns/G8wdZGACFgBYbwMxMli4P5IwFAxo0GwPoIOyZKFobyRxepNzYYTmss9TbCyGGI+ExFsGBUrGhGqCDL0SyIN6LfALdXeGt/qnQHczt+bjMV0ivcaTHl7a7/15KoL3rr5y5ih8wOe0NlqarSHWwynNVY6ky4GiesLIwvYAVKOVFB/BHhgmwFN4H+SQqvHC/EE145XgiCIP5JKHrMbNhE7eQOAGbjFotpD5e/hMOby2KlM1mR4HJFw3F7k91WZbOVWS1HLOYjBK6m1DoJxU+yOaPppQiCIIifYbPojy0G06Wmq805U0EriQxz3yEJQRAE8YTJYP7+9U3bvztodR0/5J8wgvByKMpisq7KfslsdGZAC4lQfLf/aUoTNzZ8c/Cbt7dTS+5/btmK26dQS2iO7Lz4+pqfqCVjpyW/+u3d1JJLZyfwmTs+ImdGDeaLJypj28z6Yy0VePc/XYwo4K+5D/U2POxce+2NB79zLM8PT/vv+JWu9VcLG2Er0hRfVOeV6srKdV03Hz9kf0ttU2tofTX/1yJN7RRl+u2xc5LFEdRa5HI51vxekXoTAHAYonT5qjDBOAErkIE5ByLghNVkV3eaK4vUG9tMXf37Zoe9ES2aRrZBEAQZYgTAC/v2bi0u4jCZa8ZPuC1zFL0FggAAgMW0V91xF0AfN+5MjCHAMD4QVoIwEgS9I6RbfNG9IslL9FIEQRDE/+w8UPDaR39RS5bOHfnUQ/OoJQNCEPDwc79dKHAmhwSAO1ZNvHv1ZGqJv9lbV3b3/j/I1QMr7o8Ro5cEwwk6gkhvroBzw2K2PrXsvaIzlfSKwRp+Pdw5PPaYKUk5u/PJkqa6jqrippjkEEoruglz0mkB90wi5mEAAQAASURBVK/f3CYQcuetHEctJJXl13/83AZaYXpWDK3k0jExxsOpM547u9Wx2mzUbqrJdW0C/8qY21u0HQCOtjjfbCdIrrp8CzbCdl6Ve6rj1HlVrsnezwOqgiP+v6TlX5fvONKaf6Q1X8jiRQqUCo5IwhawGSwWJcLbh8eSr6EXIZegTLPDEW1nM/hLo76ScqLoLQAAQMwOV/LS4iSz11esMto7AKBefxIF3BEEuYyO1lT/knvBsfzqwQNLkpIVfO+PhEOuABzebKniW03nfQThMusMhZ3AtQR0db/oF4YJRdIXeYKb6RUIgiCIXwoPldFKDp0offiumXzeIFPC/vznCVq0HQCmTUiklSAIgiAe2vDpbrfRdoyBcXkcZo+BSped9wPuADBpzghqwB0Adq4/ef9zy6glNOExgWljogvOOhMu43b8g2fWH95xcfHqCWMmJ3K6L3VVJU37Np3d/NNRi8llGnEAGDnBJwkNVsaMPtxctrPefTKNlTGjZ4X2lTDncHM5uZwdGE2puZIRQBRqio61Hz/dcYaWq53EZrjcvlx35LVWs8uIbL3NVKTpK8+JWyjg7l1Fqo2OhUTJ4t6i7SQWxgvij6jWHQIAg50+9RCCIMhQqlE7ryl2HG/QalHAHekNhzdHFrhNp37WanEmDBwMjMXjXysUP8lg0lMsIgiCIH4rLSlUIRN2qPRkiVpj/Oibff/6x/zee9a5hxPEN78c+fnPrrS0pJGp4YmxQbRCBEEQxEP7Nzh/V5ksxpwbJk5ZOiY+I0qulGCMAf5SDwmfBNyzZ6WyWEybrWtCUQDYs+nMnf9cSAbN3br27ukFZ3+kFZ4+WHT6YBEASGQCLp+jUempyWqoYlNC08b4JJyNAbw79hopm/971VlqORNj3JU48bH0WdRCmhp954WOrjfbEjZvtCLStf4K1GBsPNp+7Fjb8Q5LB72uW5wwdqpy8oSA8dRCWrQd8RMd5q43Rh5m6LYTXX+hbAaaFAhBkMspWiojl7ksVqRU4qxDkB5Y7DRZ4EazabvJsM5iPgiUibg9wGCxM7j8RTz+SgazrzGdCIIgiB9iYNjcaanrtrhMvrd970WT2frI3bMUMo+ea3Cc2He0+KcNxyuq22hVDAz7xx0zaIUIgiCI5xorWx0LGIa9/vujo6aluNb7HZ8E3CUywdSFI/dvPUeW6NTGo7vyZi4bTWlFN2luetLIyJJc9z2aNSoDqAz0Uorr7p5OL/IeLpP16pgldyZO2FlfWGdQAUCCWDk/PDVMIKU3dbWh6hyZI39lzGgu0yf/4P5Aa9Mebz9xtC2nUl9Fr+smY0snBU6cGjgljB9KrwNgYH43AAQBcM45asXdj1SgsuL6ZmNXziUJO9y1EkEQZEhNjoq6JTNzS1GRkMN5eso0KZdHb4EgPXB5i7m8xQSuspgP26wFNluh3VZNEFqC0BG4AQAwjI1hQowhZTCCmKwIJjOexU5nccYwGMMsDyaCIAhCdceqibsPFVI7uQPA3iNFR0+Xz5yUPHlcfEKMMjRYyqD0eMcJoq1dV9fYWVPfceZizZncGq3OfQ7Vu2+anJbk5hEYQRAE8RBXwHHMlZo6Ls7/o+3go4A7ACy/fTIZcI9JCll5z/Spi0a6NqHDMOyRV6997PpPBzHb7NjpKbOW9xXN94o4ceCDKVPppX16KGXa/cldU79ymX118B+mbITtbOf5o23HLqov2gmcXg0AACyMNVo+amrg5AzpiD6i6gdmvU0vQvyAlB3Vbi4BgDLN36myaxhYrz8aVtx4oPFlK951kxojnulajyAIMtRemTn7lZmz6aXIZfX5xeNvnz3oWH5wxIR/Zfmww8SgYQwZl7+Uy19Kr0A8MyyO8pXNitt31pTsr6vI72huMei0VguLwZByeDIuL0mmHBUYOjcqMVLUT88hKi9ukAB4/viuLZUFHCbr4ZGTbk8ZQ2+BIJeDSMh9es38Z97cZLe7PNWaTNa/9+X9vS8PABgMjM/j8Lgsmw03ma1mzwIXq5Zl3bZyAr0UQRAEGYhRU1OObD0LAExmr3FFv9Jr7OwSJWdGJY+M5PDY1987Y9wMT988xKeFr3n5mg+eWU+v6FNIhOLJd2/ABppcbUhcqV3aCSBKtWVH246d7DhtsPc68iBWGDMlcPLEgAlClkej8BA/lCBZ0N5aAgDt5pK/6x4eE3BPMH8UgzKBLQF4p7myTp9TqPpTb2txFCZKFsk5sWQbBEEQBEEQZGicbK599PC2Br2GWmjF7UabtcmgLeps3VJZkCgL9DA+Dt7e4JGGqp+LHR2zzK+e3Ls0JkXBQ08KiF+YmBX3xtPLn39nq8XqPpKO44TeYNYbepthm47PYz9818ylc/vpeoggCIL067anl5/em28ymIvOVLY3qQJCZPQWfsaH4eA3f7yPL+TSS/szb+U4uw3/7OVN1BTwfUgeGfnil3dK5EJ6BeIbzaaWY+05R9uOtZrpmelIUrZ0UsCEqcop4Xw0Y9iwlyq7rlp3qMl4HgCajRf/rvs/JsYWsoPZmAAHmxU3GGytOOHy1xohnDAh6DFqCYIgCIIgCDIE8juab9v9u8nuPlzoIGCxxwd7OrOU1zdYq1ORyzYCb9BrUcAd8R+TxsZ/+c7NH3y1J7ewnl43ECwmY+70tHtWTw4KFNPrEARBkIGLSg59ff3/vX7Xlx3N6udv+O+/vrwnOsWvQ44+DLgPItrusPDG8fFpYZ++vKm3fO4OYqngunumX3PnVA7Xh98CoXq14I0yXdcUmj2xMNYo2cgpyikjpRnM3lPHIMMLA2POj3j/ROvHxarNBOAAYCesGkvXVMA0AlZApuL2FNkKDNAJgCAIgiDI5ZTX3nyyuZbHYt2UNIped+V68cQeMjjOxLDZkQkTgqOUfCEAqC2mFqPuYntzIE/AYTpHK/bN6xuMEsvIZS6TFSn2qF88ggyZhBjlp2+sPphTsn1v3qnzVTbXDDN9Y2BYUnzw9ImJ86enKwNE9GoEQRDkEqSPT/jm+Ksbv9iz9j/b7p/yUtKo6OSsuIiEYFmgWCwXcnhsFpvF8DjhTNKoaHqRV/lpqDppZORHGx7OPVF+aPuF/DNVdZWtNqsdAPgCjixQnDo6eszkxIlz0wUiNAHakOot2h4tiJqqnDwxYIKI5f27CpPdUqKt77To1FY9BpiELZBzRIniMD5zkG90kIFiYpxJQU+MlN9Uqd3XZLygslSZ7GobbmRgLBaDz2NKJOxIOTc2XDA+mJ9JzTaDIAiCIAhyuXxdcHJzRYGcy796Au5l6vbTLV29IjCAL2deOycywbXJwHh9gwAwJTTm1uTRmysLhGzuv7NmSDnogQ7xR9MnJk2fmKTRmU5fqC6raqmobqtvUukNFoPRYjRZAIDNYvJ5HLGIq5ALQ4OkkWHyxNigtKRQqZhP3xaCIAhyybZ8s7+mpLGmuLG2pNFuwwGg5Hx1yflqejuP7Wj7il7kVX4acHcYOT5+5Ph4x7LZaGWyGCy2T2J5//x488Fz5QBw7/KJ9y2fSK/u9tXmnK835wDAlJFxHzy6gl599ZGwJRMDJkwLnBwhiKDXXTIrbvu78fTfjaeLNLU9p2NlYoxEcfi8kDFLwrJ5TA6tFvEFETs0Q3FzBtxMr0AQBLkEWrN5T0X54erq0o72Bq1Wb7HgBCFkcxQCfoxMnhIYODEycmxYOI/Vzx2LHccT//shvbRbiEh07J776KWeadBqNxTkn6qvL+vo0JhNBquV3sLVpMion69bSS355OSJ948dBYDEgICdt97uKOw0mf4qKdlVXlqjVrfq9QRBSHm8eIUiOzzi+vQRISLvv8BGkKvN0cbBP4MNU6eanWMQJ4fGXHpw3OsbdHh1wrxXJ8yjlyID98CsN6tLGumlrm58ZN7tTy2hFRIEcWJ33qEt50pyazqa1WaTlctnywLE4bHK1KzYcbPTEkdG0T4yvJzeXxAQIotNvdRsAxIRb9bk5FmTk+kVCIIgyND67Olf6UX+rZ/HV//B5bPpRchlwsSYo2QjpwROzpRl+ih1zJHW/PeKNnRYtPSKbnYCL9LUFmlqv6vYtSZp2cLQsfQWCIIgiH/DCeLL06c+P3VSZ7HQqtRmk9psquzs3F9Z8fmpk0IOZ1Fi0iszZ3H7C7t7l9lme/PwoV8u5tpx+nvfwalSqew4zmQwNhcVvrh/n8bsMuuaUadr0umO1tR8cvLEg2PHPTJhIsMvJ4RHkGGhqLO1zainl17paijp0ccFe6FDjNc3iPiDjhbNa/d+W3imklpo1JmNOnNjddvpA4U//eevF769d+L8DGqDYaSxuu35W7+Yv3rio++uptddxZoM2r+qi/bWldfqVC1GHZfJChGIk2XKpbGpM8Li2AwmAHAYg+ngiBPE6da6g/UVJ1pqmw26DpOBACKQJwwRiCeHxsyJSEhXBNM/4xmvb/n1M/u+LjjpWM657h+hAmeG/RqdamNF/rGm6gpNu9piIgiQcLiRItkIRfDEkOgZYXFC9mXu5+ejI2jF7TlNNSeaawo6Wyo07SqzSW+1cJksEZsTJBClyILGKMMWRaf0Oxrphl1rTzTXAMDL2XNvT84CgFJ12/vnDx9rqjbardEi+fLYtHvTsrlM5838hoq8H4vOFKlauUxWnERxTVz6LUljmB7c/Xprn93SWs1bKgtONNfmdTR1mo0ai8lOEPRGPTwxatrDGZPopT20GvV768v215dXajrajHqN1Szj8AN5gpGBodPC4maFxwtYg4l8+ujcQC7RkD64IsNdlCBySuDkSYETxCwfzv3yRdn2tdUH6KW90NqMbxasO99Z/q/U6xm+if4jCIIgXmcniPu3bN5XWUGvcEdvsRS2tvQdbccwbEpUdKfJ2GE0qoxGo62v+f08YbbZbt7wx9nGBrKEgWEyHg/DsE6jEe9x5y3l8qJk0mipbHJUr70CrXZ7jVq9o6z03aNH6HUUVrv9vyeON+v1b86ZS69DEMQzRxqr6EVXAa3F+Rov0BszkXp9g4gvCMS8u/69jF7ajdZX3Wa1P3fzZ5WFDQAQFKEYPyc9JCqQxWbq1Ia6spb8U+Ut9Z1imWDszFTqp4aXc4eL6UVXN4vd/ll+zmd5ORa7nSw02W1qi6lY1bqlqiBaLHt30uLsoEgpd8D5cA7UV7x17kBRZwutvEanqtGpTrbUfnDh8OSQmOfGzkqVB9Ha9M13W3ZoMeocAXejzfrW2QM/l5ylxVXbTYZ2k+F8W8PPJeemhsX+NPsGau1Q8tERPN/W8GPx2V21pTqrSxcQALDZLHqbpdmou9jetL4894WTu29OGvXk6OlCVv9vHcrU7QBwuqXutr3rDLaugaGl6rb3zh/aU1e2du5qAYtNAPzz6LYNFXmOWrPddr6t4Xxbw66a0h9mr2Ixeg3s+GifHewE8XHu0a8LT+qt9M5Al05lNv334tEfi8/YXPvxtJn0bSZ9kar197LcQJ7w4ZGTPHzr4OCjc8M/ZUxKohf5t76eXRGE5tURL9GLvO27yt09o+1KrjSQKxGy+AQQBpupxaxuN2uoDf5uPM1jch5LvoZaiCAIgvitz0+dpEbbs8LCJkdGRUilIg7HbLO1G42l7e0XmpqK2lodDVZnjCQbu8XAsB+vvY5cNdtsJe3ty3/9hdJkYF45eICMtgcIBP+aPHVBYqKIwwEAncWyo6z0nSOH2wwGR4NZsXHfLF/R/dG+fHbqxMbCQsfyiKCgmbFxkRIpn81uM+iP19XtKS8jH/bW5V2cERMzPyHR+WEEQTx2uKGKXnQVsOLO521m7wELz3l9g4gvcHnsxbdOoZf24vD2c45o+6xrxz32/k0sFr3PY0VBfXNNO5szjAMF5w6hgLuT0Wa9fd/vJ5tr6RUU1VrVDTt/eSV73szwroy+nrAR+HPHd/5WdoFe0cPRpqrF2797buzsu1I8Gpjuuy1TtRh0EAAdZuMde9fltjfRq13NCIujFw0VHx3BV07v/V/hKXppL6y4/fuiM0caq/6Yf6uM20+38VJVm85qfujQJjLaTjrf1vDeuYMvjJvzRf5xMtpOdbSp6uOLRx/LnEqvAABf7jMAGGzWO/r7d+6Nki8M4gvppRS57U137vu93dT14NCbNpP+xZO799WVfzptuYjd/5yFPjo3/Na7W/5JL/Jvw/g6ilx5jrcXfVexi1xNkUSuiJg4JTBdwqZ3qFFZ9Efb8jfV5RRr6xwlG+uOZcriZgVnujZEEARB/I6dIH48f86xzMSwz5cumxPn/hawVa/fWVa2o6x0ecrAutpxWSylkH7t8Fy1SvV73kXHsoDN/v36G2LlcrJWxOGsTEvPDo9YuvZnrdkMAPsqK0ra25ICAsk2vdlQUAAAYi733Xnz58UnUKtuHzU6r6Xl7s0bW/VdeTA+P3XqCgy4e9plBxnOLvdR7jQb+37+vCIZbNae0Y1L4fUNIv4g/2TX2+57nl/eM9oOAHFp4XFp4fTS4cNitl44VkIvvVrZCeLu/X/Qfg85TGayTBnAE+isljqdusmgBQAC4MVTuz1PGGvD8XsO/HGg3mWoIgtjJMgClTyBnSBajfpyTTs5IhAniFdO7Wkx6J4eM4P6kZ58t2WaFqPOZLfdue93arSdgWESDpfDYKksRmqX4VkRLvdsQ8Z3R3BmeHzP4HWIQBwmlEg5PLPd1qDXVGk7qbVl6vZHjmz+sb+e/mXq9m8LT7cYdRwmc1RgmB3Hz7bWk2MHfi49tyox86MLRwCAw2SOCgjDMOxMS52te96+74rOPDRiIjXzDMl3+wwAjx7ZSv13jpMoro8fma4IFrE5Gos5t71xXVluvV5NNlDwBG9NWBAllkeLZPw+88DkNFXfs3+D3ubSaz5SJAsXSvgstspsLFG3UfvUH2youHHXr38suIXn7h+B5LtzA/GWvo4fggwlnMA/K93mWMYAeyhxyaqoqVgvT2wyjnBxWPbC0HG/1x76vHQ7AQQAfF3+97SgESzMzY0jgiAI4j+adTqyb/jkqOjeou0AoBQKb8nMvCVzqF+mbi8pJnua35Y5ihptJ0VJpXeMGv3xieOO1e0lJUkT+w+4AwCTwfjhmmtHhYTSKwBGBAW9M3f+nZv+dKzmNje16PVBwr66zPibElXblsqCQ/WVDQat2mwK5AkiRNLZkQnL49IcA7cHlEFSb7McqKs42Vyb39FSq1NpLGYrbhexOTIOP1EWOEoZuiQmNVoso3+MIv7Hd+wEESIQH7/+IQCo1qrePXsop6nahuPJ8sD7R0yYHdF1+hEAf5bnfV94plzdzmOyRivD7h8xIbu/pNWXvoc9Neg1f5TlnWqpLVO1qy2mfiOek0Ojf5l3I73UVV578+7a0qON1Q16TbvJwGYwA3j8JJlyenjs4pgU+QBHGXv3KHtFlbazsKOlsLOlsKOloLOlXuccCtlpNsb88DalrYt707OfHTuTXtott71p2bYfHMunVq1Rdvdf01jMf5Rd3F9fXqJq6zAZOQymki8MEYonBEdOC4/NDAzrezC4V06b4001Rxqrmgy6ZoO2yaBrMmip6V8A4OljO54+toNa4iDmcC+ufpRe6oMNOtgIPOHHd+ml3ci/zUFrMer21ZWfbK4t6GjpNBtVZhNOEAIWO0ggihJJMwJCsoIiJoREOjLYIgBgMnSFdfjC/rt8Dg6BE9elPmXUmx95+8aFNzuTGq/9YMdP//kLAK57YNY9z60gyw9sOvP2mh/4Qu6GwncwRtffTlVx45Ht5y/mlNWUNulUBiabKQ0QxaeHT1s6ZvryMViPP7E/v9pfdrG2sqC+trzZbsMBYOevOTt/zaE121z+Hw7XTWhM1abd8t2hU/sKGqvbzEaLNECUPCp6zsrsCfMzev63AKC5tuOOiS8BwLrcNyUKoapNu/X7w8f+vtDS0EnghCJYmjY2dtmd0xIyIumfHFo/FJ0+1lRNrvKYrMdHTV2dOEpM6TxbrGr9OPfotuoinCD+fcLN37hbb587QI2JB/KEj4+auiQ6RULJmt1hMmyszP8o96jGYnKUfJF/PFEWeF3cCLJNT77bMk2zUffiyd0X2hoBQMTm3po0ek5kYmZgKAtjAABOENU6VU5j9Y7a4ga9Jlbs5lZwCPjuCE4NjUlTBBd0NEs4vLkRCXMiE8cHRSpcU4fV69WfXsxZW3qeLDnUUHmiuWZ8cK/pEwGgzaT/OPdoqjzo+9mrgvkiADjaVHX7nt8dIXWL3X7XvvUmuy0zIPTrmdcF8UUAcLa1ftWuXxy5VjQW06mWuimhMS4bBQBf7vOeurJdtc4XdTcnjX4lex71Uj4jPO6B9AlPHNu2taproGqHycBiMFNkSrKNW81G3T8ObSKj7SwG466UcXekZIUJJWQbG4Efaqh85+yBIlXX0N68jqbnT+x6d9Iisk1Pvjs3EG9BAXfEXxxvL67SNzuW74ybe0PUNNd6NxgYdmPUdLPd+m3FTgCoN7bntBVOVQ7gKosgCIIMPaO1nwDiZXe6wZm6fVZcr4OIZ8bGkgH33GZn96i+3Z45ym203WF6TEysXF7Z2dU953xTI60jvN8y2KxvnznwU/E5aoL7RoO20aA91VL34fkjT46ZdmfqWJlnsd2TzXXfF57eU1dG7V/moDKbVGZTlbZzd23pu2cPrYhLezF7Tt8hY0fosM2kv+6vnzvMRkfhyea6k81/vJA9+67UsQDw3PFdvxR3Dbww2Kx768r311d8NHXp0lj3oyu8u4cOZrvtjdP7fyk+T/bzunQV6o43zuzfU1tGLTTbbTqruVqr2l1b+taZgw+MGP9gxoS+Y8QO3j3KXrRoy3f9vpm4RE0GrSPgvrEi/4UTu6nBaCtu12stVdrO4001H144mrPywVDKgzSVF0+bv6qLfyw6Sy+9BF7foK/V6dQf5x77szyfmvfGQW2xqy2mUlXb3rpyABBzuNuW3NHvO4yrRHCEwrGQd6Js7Mw010rvwBhY/IiIvBPlFQX11PL8011R1MIzVdRyR7OEjEgy2v7RU7/tWHuM2sZms7fUdbTUdeTsvLh7/YmXvruPlvTm+7e2Wi2DnL7l6N8X/vPYz0ad84+6vUl9bEfusR25WdNTn/n8DqGk17/EtiZVS33HS3d+1d7k7PpaX9FSX9Ey85qxlIaXQbvJ8J/zh8lVLpO1du7qMUr68IVkmfKTaSsyC06+fmYfrao3x5qqv+meehQAUmTKtfNuUvT4vVLwBHenjlsUlXzDrrXkDMzPn9iZpQyP6SV+7bst97S+/GKjXgMAk0NiPp62nPZfYWBYrFgeK5bflDTKZB/kqXWJfHcEHZ4ePaPZqF0ak9ZbT+pwofSNCQsixbK3zx4gC7dUFfYdvAYAG4F/NGWZI9oOAJNDYq6NH/F7Wa5jtUGv4TJZn0+/xhFtB4AxyvDF0SmbKwscq2db690G3MFn+/xlftf9PABkBoTSou0OHCbzP5OW5LU3VXZ3ov+l5Nys/vK0PHF0G3nnKWRxvp+9alwQvTMHC2PMCo+fGBx19/4/yBj6+vLclfEjetttX58biFe4P0cRZOgda+v6eVVypTdHz3St7MtN0TO3NZxoNqkA4ER7MQq4IwiC+LlwiYTDZDriTcdqa842NowJDaM3uqxa9DpyOVIqpdS4iJA4q1q688D06+aR/XTYHxMaSgbcW/X9ZHv0Ewab9Y496/tI4mGy2149ta9M3T43sv8kOXU69Y071/acmdatTRUFRZ2t6xfcLOb0leyyVN328sm95DMP6fVT+2ZFxJ9oqiWj7SScIP59fOeM8LieW/bFHprttpt2/XamxRmfYmCYjMvHADrN7ubp5fCixbIosXxKWDStinS4ofKB/c5+VW7prOb3zh063VL36fTlQnZfE4t59ygPO80GXUYAfJKb8965Q/Q6ihS5srdouy9OG//HAGxqWEyHydhhNqrMRqOX3ovsri17/Mg2Wh/83gTzRSjaTpq0YOTaD3cAwCf//v2tdQ+HRAXQW3hD4sgoWsCdwImis1VimcCoN5fl1tpsdjKhTXleHQAkjXLGldLHxe1YeywiPmj8nBGJI6MCQqR6rbGysGHL/w51tmrOHiza9M2B6x+aQ7YHgB9OvAxAAIDZaL1z0ssAMHPF2HtfXEFtAwA9u7ef3Jv/+v3/I3AiIFi69M5pUQnBPCG3qaZ917rjRWerzhwsfPXeb99Y+xCD6T4bQ+mFmh/f3a7p0E9fPiZ9XLxIxu9o1pScr754vDxjwmV+X/5nRR719/+p0dN7xuNI96Zln2iu2VPn8na2Nx/lHiV/yIRszvezV/WMiZNChZIfZq+at/Vbx7sxg8368cVj/5m0mN4OAHy55Z4c0fYJwVE/zFnl6NXem95iu77muyPoMC0sll7kzv1p4/8ov1iubnes9nEbQBoZEJIkcxn3uTAqmQy4A8DciARqF28AmBAcRQbcyZcoPflin3VW89lW54/Vnalje0bbHThM5q3JY145vdexeqSxykbgfZw8J5prqFO4vzFhQc9oO4nPYn84ZenMTV+RB/2TvJzeAu6+PjcQr7g8PxwI0lO+uutV3hRlOpsxgDOTzWBOVY74o/YIAOR1bwRBEATxWzwWa35CwtbiYgCw4fhNf6y/c/SYO0eP8Z/cKXpKH/w+kmOwKFMIOobB9itKKnOboIYqgO8cG6s1d42V9nP/PLKd+jATJpQsjU1NkAbwmKxWk/5Uc92+unKz3fZryYUKdQflc+5FiKQLopL+qi4mV8cGhafKgwL5Qh6T1Wk2nmtt+Lu6mOzRXNTZ+p/zh1/Kdgm+0Lx37vCFtsbJodEr4tKtuP3LvBPVWhUA2Aniq7yTe+vKAGBeVOL8qCSjzfp53nFHThKtxby1qvCmpFEu2/LNHr58ci8ZbQ/gCZ7OmrEwOskxZZbOat5RXfLW2YNtxq73OrMj4r+dvZL8rFuHG6ru3PMH2VleyOYsiEoapQyTc/lmu61Gq9pTW5bf0eyoPVBf8fChLd/OXun+ERMAvH2UvWvHsrtwcAay1WbT8u0/OpalHN7mJbeRVTRSSo6CvrUYdevLLpLR9mCBaFxQRJBAxGeyO83Gos7W3LZGG4HP7j3Pr3dPm0dHTbkrbSyt8N2zh7ZXFTmWnxozfVFMsms9AEBvWVy9vkEHBob9NPcGctVstxWr2shEPYOzpbLg/w5tpb64YGJYmiI4VREk4/CYDEanyViubr/Y3uTol3pjUj+vOa8q8SMiFt486e9fjjXXdtw/841Ft0xecsfU8Nh+siIMVGJmJABUFTUQBOFIyVJZ2GDQmsbNSlO16Upzayry65MyuwJJjrh8Uqbz3eGMa7Ii4oNSxsSQJQAwfs6IGcuzHpr3llFn3r/xNC3gLleKHQtGfddrGA6fLVe6f/tFMurN/3nsZwInEkdGvbvhES7f+dJx4c2T/vPYz3vWn7xwtGT/pjOzrxtH+ZzTp8+ulwWKP9n1VHRSKLUct+O9xeiHzIbyi+RyIE94a9IYSqUbj2ZO8SQkl9/RfKK5hlx9MH1CiKDrH783sRLFnSljvyo44VjdXJn/z8ypPd9N+m7LveExWR9NXdZHwPTy8tERHCgGhi2ITPpUneNYbTBoXOvdGBVI70mTrgimrk4MofcViKYMTWg2aCk1gzGgfb7Y3kRmkgSA3mLcDtnBkeSy2W6r1HQkSl1eLVB9Q8k4n64IXh7bz6CiIL5oeVza2pLzjtXDDZXNRh05UIDKT84NpG8DCGsiiE91WLp+VeNEIa41/YsVdn2ks3sjCIIgiD97esq0ozU1HUYjAFjs9i9Pn/r27Jm58Qkr09KmRccwKYHsy0LO41eDyrHcZjDI+e57V5GzmwJAoMAlg2RvUpW93pST2ExniN/mWWfYy2t3bRkZQwSAm5JGvZg9mzrb1V2pY+t06ocPbTnX2nCiz05GpAcyJpxorr0+IWNFXHqKnB4JuiV59L+ypt+7709H6lUA+KX4/JOjp/XRQftYY/XcyMSvZl3rCCjPCI+btfFrRzDO8WBzV9rYF8bNdjQeGxSxYMv/HMtHG6t7BtzB23tYpe1cV3rBsSxkcf5YeHOsREHWitjclQkZ2cGRi7d97+jSu7euvFjVmtx75tB2k+GxI9vIaPuSmNTXJ86jBZcfGzVlY0X+08d2mO02ANhXV/5dwemeIVcHXxxlL4py7b/cwXEOZWBgmOcZBvpwsL7yUEMlACTKAv+dNWNmd/Z/ktZi/qu6eJTSJehG48XTRsHl9+z4KaK0VPD4A/riXt+gW1wmi0yFPzgFHS1PHf2b/GXkMJn3p4+/M21sz5232O0nmmu3VxVdG3+Fj3/tbNUujHiEXgoAAEIx/4/Ct2mFa95YxeVzNn970GK2bvr2wKZvDySPjp57/fgZK7L6yJ0yII7ouUFraq7tcHSizz9VAQAJGZGaTn1pbk3hmUpHwL29Sa1q0wIAGX8HABaLSYu2O4REBWROSjq+62JtWdfLwku0+/cTmg49ADz63mpqtN3h7meX71l/EgB2rzveW8DdarH965PbadF2ALjs0fZ2k4HMBw0A8yITOZS7C7dGKEIiRNI6nZpe4WpHjfNawMCwlfEZlMpe3ZAwkgyL23D875riu1Lp/6S+23Jvro0b4Taa6Q98dwQHIZHSXV1vtdhwnNrppKc4SQCtJJAnZGAYOcar5w0M9Tfc6I0cPp7vc7vJOZyUgWF9v+ah1XaYDCClFjjpbZb9deXk6rWeTTAwLTSWDLgDwPGmmp5her86N/yBzWofXEoxvtC3gwhRwB3xF1pr16ORhD3gu3ARu+vXmdwIMsRMdvPtJ/8PAN7LfCFSQH+h3bcLqoIPSr4aKUt9POl+et0AXcpuIAgylELF4j9uuPGRv/7Ka+l6Zrbh+N+lJX+Xlsj5/OXJKdenj0hV0u/Fh0xGcPD5pq6AV05dbWIA/bHB4XidM6qYEeTSc6c3QUI/fa67FB9fOEouz41MeH3i/J69pCNE0p/mrlqw5TsP7/VHBoScWPWPPjqdBfFF38y6btqfXzoyVFhx+8nm2p4xUKpHMieROxYmlMyNStxaWehY5bPYT4ya2l0JKXJlskxZrGoFAHI8Mo1393B7VZFznt6UMdRoOylKLLszNeu/F7ryGm+vKkoe1evfyHvnDpHd4edGJn48fVnPgwIA18Slm+02cibMTy7mrE7K5LPYrq0AfHOUh5edNSUAMCk0+utZ1wpZ9MAcAIg53BsSR9JLXXn3tLk6vXJqL5lPWcrhfT/n+tFK97d8HCZzaljM1LAYesVVj8Fk3P/StTOvGbv2gx0n9+UTOFF8rrr4XPXXr26af+OEmx5dIA241EtVWEygUMLXa4yVhQ3dAfdyAEjIiNSpDdsBis5WLb9rOgCU59cBgFgm8DC5jTJMBt3hFVoa90E4sTsPAORKSVyam2wMskCxXCnpbNUUnaum13WLSw9Pz46jl/qBi+0uU8tM7iUjNk2WMrzfH/CTLXXkcpo8uO/oJCleGhAtljnGlgHAiZbanmFx3225N/OjkuhFfsN3R3AQHOPtSGbcxmK4uQ6SAl0nMgUABobxmCxyCFfPg8uhvMI32QYTPKXxfJ+puVlYjO6pJHpBm4Lb0vsI13OtDdQpeSb36NTvVrI8iLp6vq2hZ8Ddr86Ny+XisZIDf566mFPSWt9p1A1yQPCOtq/oRV51qZcot/ZvOVdd2pQ9IzV1dDQ588mw8PXmnK83d406QYaYmM3vtOgAQDfwoLne1vURIcvTccGI/8hVFxrtptMdufQKBEGuaDEy+abVN20oyP/i9CkyZTkAdBqN358/9/35c+PCwx8YO25m7GV4jl2WnPLThfOO5W/OnL4mJVXMpfeA0Fks35w5Q64uSvLomU3IdhPKHNaKVa253ff9TAx7dtys3u78RGzu46OmPn5kG72iF30EJR2UfOHC6KQ/y/Mdq+WajpnQa1xSxOZmBLgMoctShpMB94khUbROxImyQEfAvV7f6zBkL+7hqWZnlGFWpPs2ADArIp4MuF9oc3ncouowGcj/KJfJem3CvN4OCgDckJj5Zd6JSk0nAHSYDFsqC3tGjX13lIeXAJ7gk+nL3UbbPefF0+YqdLa1/nhTDbn67uRFvUXbryoCMe+ufy+jlwIAQB8h6aTMqJe+v6+9Sb3vz1N7/jhZU9JkNlq2fHdo35+nn/7s9qzpqfQPDASGYQkZkReOllQW1E+cnwEABacqASBhRITRYAaAwjOVjpZdCdwp+WQcCJzIzSk9c7CosqC+vVmtVRnMRovZaLWYuwJ2hDdGgJXm1gBAZ6umtyECDmajxWy09OwCD+723E8UqVqoqwlSj95n9OyY3NOFtgZyuedInT6kyIPIsDh1whKS77bcm9E9Mp/4D98dwUHo7aLfG2mPIUfgmn+s55TgDEradLs3po73fJ/FlNC8xW432KwCdz0PHGizAQX0+CIkal54DMBtX4qeaIMR20x66qqDX50bQ0/bqX/r/m/O7Ou6TfJnvV6AL8W2X44VnK1e98V+iUwwdnpK9oyUsdOSvTU8DblSyTliR8C9xuDy8+GJKn3XRxRc+ptSxP+NlKbubT6crRhNr0AQ5ErHwLDr00dcl5a+v7JyXd7F/VWVdko/kVP19afq6ydHRb01Z164xNN0nF6RFRY2PSbmYFUVANRpNDf+8furs2ZTZ3Y939T4wr69tZqufiKLk5JGBnuUD+2yZ8vxuv11FeRyVlB43xkn5kcncnNYjgQmXjEiIISMS6p6TIhKFS+lP+eEi5wnVZrCpT8RAATwum5cDVZnv6dB8HAPW4w6cjlKJHNWuIoQOsctUz9Cs62qiPxHnhuZGCzoq7MqBjA/KumLvK7x+Ecaq3oG3C/vUfYfd7nLW+ILHp42VyHyJRkAZAWFz4tKpFRevbg89uJbp9BLPRMQIr3+oTnXPzQn70T5rx/tPHuoSKc2vHLXNx///WRUkkfXtd4kZUZdOFpSWdgAAK0Nna0NnRKFMChCQeAEX8Rtru3obNXKleKK/HpwnTEVAArPVH745K81Jc7Xiiw2Uyjhy4PEOrVRr/HOHwVux3VqTzdls9rd/vWLpO5K/UCn609HhKiXtBeuQvq8XgCAzmomh5gAQGTvF6yeokXOa0e7SW8nCOrUlL7bcm94TJbE42k8hp6PjqBbOEHkdTQXdbYUq1qbDFqV2dRpMRqtFpPdZrbbTHYb9dB4gttfhhNqSrrB8eI+0/Lb5LU3URO10+R253wDABaDQU09T9NIyURPACSvfY9S6SnaaeC20Kfnhr8x6s1PLH6npsR5FPzZpZ7lPak79IXnuvodaFSGfZvP7tt89vp7Z9z11CLXhv4oUCpUyns9C1s7dW1qN++XEK9IlURU6BoB4HBr/oMJixn9df8h2Qn8cGueYzld4qddDJA+ZMrSvs/+kF6KIMhVg4Fhs+PiZsfFtRkMm4sK/yjIL25rI2uP1tSs+G3tbytXxSvoAVOfenPOvJXrfm3QagGgsLV15brfAgSCSIkUw6BOo6Fmb08PCnprzjznJ68yeZRhrVNCYyk1bghZnHRFMLXLzyWi9gMy2+2UGrqeo5sFlH7KoT2GNpOPgnaCsOJ22ghiz3m4hwbKPL3UJP40LMpuUN9O0Zyk9Jef5kE+jVTK+GW3fQMv71H2H4uiU+hFvuHhaXMVOk6ZHmBVAv3NEHIpRoyPf33tQ+s/2/O/N7ZYzNY/vtj7+Ps30xsNhCMne1VxAwAUnq4EgNSsWADAGFjSyKgLx0qLzlZNnJ/hSCmTONIZcK/Ir3961ScWs5XFYi68ZdKUxaNiU8PFsq7f8A+f/HXnrzlk40tBEF3d5BMyIv/x+vX0ale9pfp1TAnrhxwTfjhgrpe8PvTbTOU6l7vY3QwTvaHOCUEAqM1GBeXS7Lst90bMcX9M/YSPjiBNiartf4WndteVUvOYXzpOf3dNvaVT94TX9zleGhApktXqVI7V38ou9BFwX1d2gVweFxTpdpIVB7XF5ZQeHLevDYbm3PBP37+28RKj7bJAccrYuNSxcanjfD6K2vsB9/zTlT2Hd825NotW4p+umTHyvuUT6aXdvkIJZ3wpW5G8veEUADQY2zfUHb0+0plKtW/raw83Gjscy5OVlzT4EUEQBLmMAgWCu8dk3T0m63RD/acnTzg6mANAu8HwyN/bt950C3W0qa+FiETrV934xM4dZKL2doOh3eByZ48BXJee/tKMWYIrLlGM50pUzrcjCbL+B6vGSRVeDMV6fkrIenRNpHZ/c1frfBQk5/gaBA/3UMblg7bTsdxm1PfWjZraqz2g92jCecqo/HgPBhrLuM7wbmt35neqy3uU/YSUw4uV9NqRzbs8PG2uNha7vbjTOU3cuKAISiXiHSsfnL3lu0NtjaqCU85xLYPjiKE3VrfZbPayvDoASO+ObqSMiblwrLTkQnXW9JSm2nZw7eH+wzvbHHlj/v3lXY50NFQ2q9deQTFZDKGYr9cazSaL2zlahzUyWTYAcJksD39T3M7hQUXdLADwmP20p6JtXGu1UMPivttyb6gXej/koyNIMtqsL5zcvaHi4qXc5PTG896TA+K7fb4teczrZ/Y5lv+syJscGnOduzlOv8w/caypmly9Ny2bUkmn9UbA3S1fnxt+S6cybP/hELUkMjFk8pIxUcmhAjEPw7CXbvmUwAkAeOyj23kCjs1qV7frynJrTu+96Jgfm81hPfvdAxkTE6kb8R3vB9wLzlbRSmJTQqMSgmmFCEIzSZmm5EpbzWoA+LR0m4jFXxg6lt6oh831OV+UbXcsRwmUEwJQwB1BEGTYGxsW/t2Ka7cWFz2+c4ejG29ha+vxutpJkS5Dzn0tVCx+cFx2fmuL1mwGADmPpzGbmQyGlMeLlcnHhYevTEuPlsnoH7vKUPvveDJYtY8wsVtqiymnsaZI1Vqmam836dUWk9ZiNtvtZrvN8T/6B3rB6b3bOPRX2zev7OHIwBAySp7TVJMkC3St70LNXj0yMJRS44IaNL/u758pNf2z4na91ULrseXrozwsBPC9+aW8ctpcbTrMBjLIggHEDNX7j6sKhmGBobK2RpXZ5BL9HITgSIVEIdR06BsqWh2J2h093MmFkvM1dRUtBE4EBEsDgp0pES6eKAOA8Fhlz2g7ALTWd72b9Ir4ERG5OaV15S2aTr1ELqRXD2fU4JoF9/QtBQH9xDFpHc+N9gGcJ7SQOq2Due+2PEz56Ag66KzmG3f9mtfhHL4GAGI2d0JwVLJcGSuWK3gCGZcvYLH5LDafyd5fX/5Uzl/UxkPPp/t8e3LW+vJcsnvBE0e37a0ruy5uRJo8SMjmaK3m/I7mX0sv7K8vJz+yMCp5Vng8udoTj3IE+Sz2FM+mNqVJlLq5IfTpueHPDm89Y7M4b5DueuHa69fMp84byuVxTAYzAGTPzZAHOVNHmgzmX9//6/ePdlgttn9f98HLa9eMmZFG1vqO9wPuteXOfgcOY6cl00oQpCcug31n3Nx3Cv8AAJzA3yxYt6vp7DURk8YHJHMZ9HdxJrslp63wz7pjF1TOzhcPJS7189fUVwMGxijQlGxp2FWmrTLYjTK2JF2adG3EolAe/a3b+yVfnmg/R65GCML+k/kCpZ7uQGvO/uaj1YY6o53+rjhNkvRi+uPUEs93A0EQv7U0OeV0QwM5een5xsYhDrj/cP7cywf2A0CQUPjfRYuzw1FvSjeow1o9GazaxzxUNIcbKr/IO3Giqdbmjbmz+p6pcnBdsby4h8tiU38sOutY/jr/5LVx6T3jBTqr+ev8k+Tqomj3N9iXHq4143Za2Ml3R3kYucS5UklePG2uNtSME0I2F40D8AWrxVZX3gIAQRFeSOOWmBF15mBhY01bWV4ti80ku7E7upOX5dXWV7RAjwTuZqMVAARiNwN9Ols15GyrvWFzu0Iceg/ys4+fOyI3p5TAie0/Hln9f/Pp1cMZNcsKThAmu43nQdZs6q+9W7TJMLXWftpT6SiNsR6TQ/puy8OUj46gw/Mnd1Ej1xEi6VOjpy+KTuntZskfOkf7dJ85TObXM1besOuXpu7E639VF/1VXeTaymliSPQHU5bSS11RJ4blMJhfz7iOUnlJfHpu+LNCytCrRbdNW/XIAkolAACHz3YE3E1Gly/LE3DvfO6akOjAjx77yWqxvXr75x/vfTYiIYTaxhf6PyoD1VDtHHPqMGpiAq0EQdxaHJZ9pqNsb/N5x+qZjtIzHaUMjBEpCFRypQIWDwjCYDc3m1T1xjbaMKLbYmZPCkylliCXxZnO3LXVGwEggCsngGi3dB5qPXGq48JrGf+K4IdSW2YrRktYYq1NV2dorDP2k4fri/If97ccYzNYI6QpQqagTFfZZGoFgBhhZJokMVlMf7fs+W4gCOLP0pRKcnmIExkXtbW+evCAY/nrZSsygtHrOveoF2NPwl/9pvUEAL3N8vjh7TtrSugVAAwME7O5Yg6Xx2TxWWyNxVStVdEbuePdNLte38OxQRHTw+MO1lcAQJ1OvWrn2tfGz8sKCicbnG9reO74rlqd2rG6JCYls5ce7rbec7sPmi+O8lXI66fN1cZOeUXhyYyIiFs71h4bPzdDrqRPXAEANqv946fX6dQGAJi8MJNePXBJo6LOHCzMO1Gu6dAnj47mcLviX9IAUUhUQFNNe8GpSnBN4A4AQeHyppr2uvJmrcpApm4HAKvF9v7ja62U7o1usVhMRZCko0WTf6rCqDPzRfSXl1QLb560/rM9qjbt2g93xKaGTZjnpk992cXa4MgA6p4MC9RgHwA06DVxkv5foqj6S4IhYLElHJ6mu1l1dzI0T1RpnI0VPAHtr9h3Wx6mfHQEAaBS07GxIp9cjRXL/1x4G+0/R2P1uBu1jwzBPkeLZVsX3fHsiZ27at1cpklCFue+9PFrMib1e5oF8py9F9QWk9luu/SpYh18d274ucr8OnL5xscWUmq6kFcZs8HiWgMAsPDWqecPFR3ceMqoN7//yA/v//Uvegtv887xptJ0OgexOsQmu38eQBAaDLB/p91gsJtz2grJQpzAq/Ut1foWSkO6VVHT7omnv91CLou11RsnB467LWallC0BgGJt+X+Kv1RbNetqtjyRfD+15ZTA7CmB2QCwr+XIl+V9DXjPUxftbznGZrDfyHg6ShAOAHbC/t/Sb4+3n5VzpLfHrKJ/YCC7gSDI0DPbbFyWR3cgF5ubyeVQsZvogO/8VVLieLPLZjKpcX+ERszmGruHclNn/uwNbdx3TzhB3L13AzV3SpxUsSwmNTs4Mk6qCBaIqc83vxSfe/b4LkrBUPDRHr49acG1f/3coNcAQGFHy3V//xzAE0SKZBgGdTo1NUtMuiL47UluHjMchGwOm8EknzPfmbSwZ4b6vvWcqs7rR/kq5KPT5qpC7bWqs5oJgH6iHVcNs8m6/acj9NJuiSOjHPOXOnzz6ub/Pr0uLi08NSs2Ij5ILBMwmUydxlBd3HhsR257kxoA4tLDl94x1bmJwXJE0g9vOweUBO4OqWNim2raj+3MhR493KcuGb3+sz1GvfmF27649YlF4XFBFpO18Ezln1/try5pjE0NqyzsSsDVm4nzR27/6Uhnq+bpGz6+5t6ZyjC5xWzVdOg1nXra9+ILuU9/dsdzN31ms9pfvuvr0VOTx85MUwRJ7HZc1aatKW3KPVbaVNP++d5nhl3APVnmcutSqmrzJCRXrm6nF/UwVhm+rzuxRiFlWoV+FaqcT/RjlM43yiTfbXk48t0R3O7acfu5sbP7jlwDQKe5//EiPjU0+6zkC2eGxx1qqHBMVarg8nU2ix3HRWyugstPVwRPCIleHpsmZvf1Go80WhlGXb3Q3pgdFEktGTTfnRt+rqO5q99JWGxQUKSbKYW4vK6Au0lvdq3pctMTiw9uPAUABSfLLxwpzpzifrSot3j0uDsgBtcvJhDx3L4/RxC32AzWW5l3/lp98H8VOy14P/0XAEDGET6efO2MoJH0CuQyiRVFrUm8E+t+AkoWx18bsei7yt/y1L0OyOrXqY7zADBeMdoRbQcAJsa8Jnzh8fazF1QFdgLvmUrIF7uBIIi3fJBz7EJz03Vp6TNjYgME7p9gCYB1eRfX5V10rDIwbEZMjEsLH7N1j6Oy2u1P7tp5x+jRsTK5iMtF8R0aKZdHzuTpdr5NGlV/zz+/lV4gg5IYwPPZs+9MHdvbP7vLYLeh4qM9DBGINyy8+bEj28mNt5sM7SYDtQ0GsDIh46Xxc/pOb6Lg8ZsNXQclIyAkVRHkWj9gXj/KVyEfnTZXFTnPGV6xE0S9Th0hklLqr14GremTZ36nl3a78ZF51IA7ABA4UZ5X58ir3tP4OSOe+PAWNscLgQLHf7e5tgMAUsfGUqtSsmL2bzrdUtcBPXq43/jwvDMHCisK6ovOVj1782dkOYZht/5z0eipyY8v/4DS3I1bnlh49lBRY3VbyYWat9f8QJYLxfyeLxIyJyW+uW7NWw99396sPne4+NzhYloDAGAy6c8a/i8jwCVbQk5z9fyoJGqJW3ntzpQdvckOjiTD4sWdLfV6dbiw/7/EElVbXfcgLehl0mPfbXk48t0RpI6gYmLY9DCXl2Fu0TKnD72h2eeXT+35rug0ADAx7Lmxs+9I6fUy7YkJwVFMDLN3P1Dsry/3VsDdd+eGnzNou24ve0t6xhN0vQvRqtzfrEanhEUlh9YUNwLA0W1nh1/AnUYk7ee9E+ItFa0dSz5y3k8MpVXjRr60fDa9dLAwwG6KnrEodNzGuqN7ms/XGty83GZgjERR2KKwcYvCxvXM8I5cRrOCJpNhboc4YRQAGOxGK25lD+pgdVhUABDEdXmHqeQGAABO4CqrOoAjp1aBb3ZjyLy749B3R87QS3sXLBHtf+peeimC+DEciBN1dSfq6jCAVKUyLSgoURGg4AtEHLYVxzuMxvKOjoNVVTVqFfmR1RkZISJP398TAHqLpUXvvNOyE0SzXifmcAVsT//858XHf3nqpOMeeVNR4aYi59ArBwxAyOEECoQjgoLmxicsSEhgX8LEm8NXgjSgtHuOqVJ12zxIdK2nq6SM+3ZrfVnXWxYAuDl59F2pYymVdNTJPIeM7/YwVCj5R8aE/I5mR55NOZevsZiYDIaUw4uVKLKDI1YmZMSI6Ze8nkYGhOw2lDmWi1Stlx5w9/pRvgr57rS5eghZnCixrKY77HK2tX54BdzX/LJlX2FXMNET42Ijfrj7enrpJftgy+NH/jpfdLaqvrK1s1VjNloAQCDihUQFpoyJnrE8K821K/qlCAiROrK7AEDaWNce7lkxjoWQqADabKUCMe/9zY/9+dX+w9vO1Ve2AgHSAFHq2Njld05LGxdntdhYbKbNaqd+hEYWKP747yf/+GLvid15jdVtVotNKOYHRSgcueN7GjE+/n/HXtj9+4kTu/Mq8uvVHToAkAaIIhOCMyYkTF0yOjIhmP4ZvxfEF8VLA8g+rTtrSp7Lms1i9PXmoEGvyW1vpJf2sDQm9b1zhxyzUBAAv5flPpZJf43R0+/lueQyA8PmR7qJc/luy8OR744gNT++mMPte5sAYLBZD9RX0EuH1hDs86bKfEe0HQCeHTv7zpS+LtOeELO5k0NjDjVUOlbXlpxfM2ISbVL6wfHdueHnLOauAZTs7tQxNGJF19VE1dbVTaSn5DGxjoB78dkqep23eT/gLhDxqFll2Oyr8eETuXQyjvDOuHl3xs3rtOiKtXUqi15nMwBgUrZAzhGnSiKFLOeo0uGitkP1V27xycq66naVymC02nGZgBckFmXFhM9MiRsf550XnpcX2QmdxGd2HSk7gbv/XeyPhC0GAJW1awITB5VVAwAYYAKmm7d6vtgNBEG8jgAoaG0taHXzYpVqWnTMv6fNoJdSfHryxIGqSq3ZorWYtWaz3mKh9Q9t1esnfv0VADAxTMjhiDgcMZcr4nDmxyfek5Xl2rbLqJDQt+fOf/ngfr3FTRJAACAAdBaLzmKpUnVuKymOlcs/XLDIb1O9++4CNDIg5O/qrv6Axxqr/5Ex0bXehZ0g+u1wVNId2AWAa+LSKTVuFHfSpw4aAr7bw+8Lz7x0cg8ABPFFn0xflh08yOMyKTRmd21XwH1vbXm/O9kvrx9lX6O+cif8o7+4706bq8qEkCgy4P5nef6y2DSX6qvPF/ueoRf1JzIxeChnB/3l7Gv0IgAASBwZ9Xfdf+ml3bh8zur/m+92P9kc1tbKD+ilPQgl/NufWnL7U0voFb3gcNmLb52y+NYp9IpeBEcq+th/P7EyPuPtswccy40G7drS87clj3Fp4eqL/OOe/FyGC6WLolO2VBU4Vr8qOLkqYWTfXdErNB0/FDm7E82PTIoWy5zV3Xy35WHKR0dQRknPpbWYjTZr3/OLfnLx2CDSs3jXEOzzt4WnHAtsBvO2pL7+nT23JmMSGXBXW0xPH//746nLXZsMko/ODT/HF/F0KgMA6NTuO7CLu1/fNlQ0u9Y4yZUSx0JTj/lHva6vdyCDIwsQUVc1nS4jYRFkoOQc0YSAlAWhWSsjp66MnDI3ZMxYReKwi7YbLNbnNu5a9OH3H+05llNe06DSGCxWq93eqtXnNzT/eOzsnf/746avfitv6XpLOXyRcW0vGi3PAIDj7WfaLZ1k4V+NewEgVZLo9r/othBBED8xOiQ0sJdMMjRiLvepKVO/Xb6C32fO9/yWljMNDSXtbY1ara5HtJ3KThAas7lBqy1uazvT0FDc3mus/3xTY05dbb8TIpEqOztv+fOPknaf37oNlK8vQNPDnZ0WTzTV1us0lEq6Iw2VKnNfXXdxgjBYnW84FLy+zhO1xbS/e+z5kPHdHhZ1tr5yaq9j+ZvZ1w062g4Ai6KTOd3jLf6uLqpQd7jWD5h3j/IQoOZX1Vktjv6Sl5HvTpurzQLKqPmD9RUnm2splQiCuFgZl0ENSr55dv+F3ru47qwp+aXkHL20F4+MnMzrnv7RaLPevvf3NpP7+BcANBq0d+z9nZxZhMVgrMmY5NrEyXdbHo58dASTZIHksp0gaOnRaX4tPf95Xg69dMgNwT6TI/kIgjDY3Pe2GajsoMiZ4fHk6taqwseObiUnxelDh9n4v6LTF3tPAuOjc8PPiWVd8XRHOrKelGFdw0ArC+pda5w43Xne9RqfB6u9H3CPTnTp26XTGgm8jydfBLnydeiNN3/1259n8u19/i2cr2lc/eVvp6t6/WkYFmiJXLwiS54xVpFpsBufOP/yJ2Xf/a/yt2cuvrmn+bCQJbgr9kZ6awDwzW4gCOItCxOTjt5974/XXveP7PGz4+KSAgLlfD6fxWJgGI/FChAIRgaHXJ8+4qOFi3Puue+BseOYfY6R9Dobjj+zZ/e1v/26sbBAYzYHCgRLk1PuHzvu/yZMJP/38PgJ92WNvTY1LT3ImaxDaza/sG8fZUuX3xBcgNIUQWndGUtsBP7a6V7/BWwE/u65Q/RSVwwMk3Kdb0yrNO7vpwGAAHjpxB5H6pWh5Ls93F5V1DVPL4NJ/pMOTrBAdGNipmPZThAPHNjoYT8vs91GLwIAbx/lIcBiMBTd06nZcPxUs/tc1UPGd6fN1WZmRHyKXOlYJgAeObT1CpgFDkF8RMkX/t/IyeSq0WZdvWvtNwUndZTsHABQr1e/cmrPPw5tshMEq8fMWG4lSANeyp5Lrpap2+dt/fbnknMa13RYnWbjd0WnF2z9tkanIgufGj09XdHrcEDfbXk48tERnBWRQH1UfunUnsPdvbCpSlRtaw5vfub4DgKAfIt/uQzBPpOzsNoI/NY963bXlrYa9eTrnEF7f/KSSJGMXN1YkT914xf/zT16sb2JTO8OAARAvV59qKHyo9yjq3b9kv3Hx6+c2kNOn9OTj84NPxeREOJYaG9Uqdtd8h84RKd05Tm4eKzEbnPf2ULV5uaDPtJXf7HBSRoZefjvXHKVwIm6ytbI+Et6bECQYe3ZP3cWN3nU51Fntjz+2/bNj9wqF7hJk3LVwgB7POm+Vws+LNSUHm8/ixO4giOdHTzlmvBFSq6C3hpBkOGAzWROiYqeEhVNrxiUz5YspRddgqd27SQztj8xafL9Y8f1nRXxfFPjbX9u0FksAHCyvq5Wo46USKkN1mSPX5M9nlrStycmTX5ikvMe+lIMzQXokZGTHziw0bH8d3Xxiyd2Pzt2Fu05R2U2PXXsr7z2Xgd4ksYow/fVdXXv/eRizuTQmJ6PTBqL+bnju7ZUdo06H2I+2kOyF7YVtz955K87UrPiJAoRZ5Dz9D46asreujJHV/QSVduird8/O3bmgugkt49bbUb9sabq7VXFGovp1/mr6dUA4O2jPASyQyJ3VJc4ll89tffX+aullAHpQ89Hp83VBgN4ftzs23avc8QpmgzaFX/99Gjm5JuSRrlNL9Cg1xysrzzVUvv+FE9TiyDIleSetOx9deUnW7rGghhs1tfO7Hvn/MEUmTKAJzTarA16DRmzZmDYVzOvu2//Bk9GBd2YkFmmbv+m4KRjtcNkeO7EzpdO7k6QBSp5AgKgzagvVbdRQ4oAcG3ciHvT+rkj8t2WhyNfHMEYsXxFXPrGinzHqs5qvnXvujRFcJYyPIArMNttrSb9hbbGUnXXDSSHyfx59o0PHtpIm8h9KA3BPi+PTf8i/7hj+UJ7470HNrjWAwAwMEzE5gZw+amK4Mkh0UtjUiX93VrIufxvZl532551zd3R8zaT/v0Lh9+/cJiJYRIOj8dk6W1Ww8BH4/ni3PBz8RmRp/ZcdCxfPFY6ZekY13qITY9wLOg1xsNbTs+4Ntu1HgCg8GTXzZhQ0tdwQ6/wfsB9wuy0b9/eTi05d6zMzwPu7z28nF7kzn3LJ963vK+clQjS0/6iioPFbt6+9qZNp/9s3/Fnl8ykV1zdfqreUKgpXZNw51TlFXgjhSCI/zjT0EBG228ckfEPDwLlo0JCV2eM/PrMacdqblMzLeB+uQzZBWhBdNK8qMRdNaWO1R+Kzu6pK1sak5ogDeCx2J1m4/nWhl21pY5Ou0tiUrdVdf0Lu7U6KZOMS55pqV+y7fvbU8aMCAgRs7l6m6Vaq8ppqtlcUeDownN9QgZ1Lsqh4aM9nB+V+MXFrgybGyvyyadKEgYgZHOVfEG6ImR+VOKC6CQ2gx6xJSm4/G9mXrfy71/0NgsANOo1aw5ulnP5Y5RhkWKZmM214Had1VKvU5er22t1asenxgZ1Paj05N2jPARWJ2aSAfeCjpa5m769LmFEikzJY7FMNpvKYmoz6hsN2iUxKTMoCXN8x0enzfBCAOit5haDs8uencCbDToRhyNkcSgN+zI5NPqpMdPfPHPAsaq1mF89te/ds4dGK8PipAEyDg8HQmsx1+rUJaq2Rr0GAEIEYuoWEOTqwcIY3826/pY9v51rayALLXZ7bo9UFUwMe2viwlnh8dESuYcDR57LmhXMF715dr9jeBYA2Ai8qLOlt2QfD42Y+OTo6Z68Re5ty0nhF/6ReNBRghPYwoMPO5Y93/IQ69B+3qp6NSzgK7FgkO/8BnQEt0z7kc/YHC25s98j+Er2vMKOliKVM7NiQUdzQYeb9+VCFueLGddmB0eOCQzfXdd1D3BZ+HqfH8ucUqRq6XuqVZwgNBaTxmKq1Hb+VV30xpn9T46efkdKFr2dq2SZctviOx88tPF0i8t4OztBeDgA0a0BnRsD/ev2TxkTE3/7oGv5+I4LPQPuiSOjZIFiRx/2717bOGZGuqR7GlWHM/sLyvO6XlGExjjzFPmI9wPuEbHK1NHRheeqyZJTB4uW3XpF5dJCEM/9euI8vag/m88VPD5vCp/jpp/OVWtf8xEMsCBeoJ2wM7Fe4wsIgiCXaHtJMbl808iRlJq+JAU479hUpsHfOnvXUF6APpi65Pbd68kHiXqd5ou8E65NAAAezJhwW8qYvkOxcyMTl8SkbKvqemAvUbU9e3yXa5Mud6RmvZQ952hjdYNeQ6/zJR/t4ajAsHcmL3rp5B49Jdk3FQGgs5p1VnOlpnNbVWGsRPHRtKUjA7pG1/aUqgj6c/Et9+/bWKXtdJR0mo17u2O+g+DFozwEpofHLY1N3VrZtRstRt3nF7t6rlGNDgylF/mGj04bP/dJbs6B+gqtxayxmrUWs95qdumSCtBq1I9f/yk4ZrRmc0RsroTDFbG586MS70130zHN4f4R4wVszisn95KD/U12W05TTU5TjWtDBEFAyOb8Ou+mj3OPflVwsrf8GFEi2VsTF04KiQaABGmA5yG5e9OyJ4VEv3ZmX06TM/7T0xhl+DNjZo7r/Z1uT263fKg1qdagELNN98QdVXK1MKgtDzueH0EevhY8O4JiNnfd/JufPbGz74t1ljL83UmL4yQKABitDPM8eO0Lvt7nZqMuSxlxqqWut9uwnvQ2y0undtfp1c9lzaLXuVLyhevm3bypMv/Ti8cqek8rR4oWy66PH9lHNwgHz8+NQfx1+6HMKckCMc+gNQHA8R0XLCYrmZDdAWNgExZm7vjpCAA017Q/tuDN+15blTUzncVmmo2WQ5tOf/7v38jG6eMTnJ/0De8H3AFg9UOzX7j3f+TqmUPFFUWNcSlDdDuLDF/1xvZwfgC9dDgzWW055V0v0DynM1vOVDdMSYymV1xBTnfm5quLDDajwW5sMDYDQKup/a2iTwRMvoDJF7D4y8PmC1nOMT4TA7IOtOa8kPcuWcJlcAK5ilGy9OXhC6Rs1HEJQRDvKO903gTHyT1NWkW9NZdwuZSay2aIL0BCFueHude/cfrAryXnyf5oVAIW+/lxs1cnZQKAiM2lpZik+WDqEjmX/1PxOXpFNyGL8/TYGbcmjwaAMcqwoY9L+mIPz7c15DRVD2CeXk3Hzbt++2PhzcmyrpTWPSXLlFuX3P553vEfi871/W8OAHFSxfUJGfRSCu8e5SHwn8mLxWzu2pLz9IrLxBenjZ/L72imdejrjZ0gNBazxmJu0AMARItltAY0tyaPHqMM++D8kb21ZW7ORVfxUk9/zBHkisRjsp4cPf3mpNHbq4v21pXV6tRtJj0BRDBfnBEQMj8yaXF0Cpk9L0ESsNP1431LVwT/Onf1xfamPXWlR5uqmwzaNqOeiTECeIIQgXhSSPTM8PjMQb3adLdlVolWGsAT2OEihuk2L7x9cFsedjw8guUNAB4fQSmH98nU5WsyJm0ov3iqpa5Gp3IkypdweJEi6aiAsAVRSRNDnDeEY5Rd2bEvIx/tc6fZ+NrpvRsr88l7GwxAxuULXIde2XC7GbepzSbaReebgpPTQ2OnhsW6FtMxMey6uBHXxKafbq072lh1orm2yaDtMBv1VjOPyRaxOWFCSZw0IEMRMjk0OlHqaedrD88NR2MPzw2/xeKwJi4ctff34wCgUxsO/Hly3k30JJzX3D9n5y9HHTOJ1le0vHjTJwwmQyjh6zVG3O6STmfujT7vF+6TgPu4GSlTF44kM7kTBPHj+zte+upO11YI4sKK2+85+WEgV7IkbPyC0Cwp22XoRx9ez//tbGcZAEQJgz4YfR+9+rIqaGix44NJknWxrmkQ8Y5h5FznxT3Nh6klZtx8rjOPXJ0bPI0MuNcbm3DAGRiDIAg+kwcABBAW3FJvbKo3Nh1vP/tu5vPU6DyCIMigUaOIFrtdwPaor/fxWmdoO1wiodRcNkN/ARKyOK9PmHdbyuhNFQWHGyob9FqtxRzAE0SIpPOiEq+JS1fyu67s8VLFhbZG10+7YDOYr06Yd0vK6HWluaea62q0Kp3VzGQwAriCBFnglNDolQkZAbyun/0xynCy1/CQ8e4e2nD8ueO7fiu94FgN5AsnhUSHCcU8pvNGHQfCbLe3GfVFna353QOotRbz88d3/77gJrJZT2IO96kx0x8YMWFPbdnRxqq89uZ2s0FlNjIxhpDNCRGI4iQBo5ShU0JjyLko++DFozwEOEzmGxPn3546Zn3pxdMt9Y4ncxbGkHJ5ci4/QRqYrgjq9wnZi7x72iDpiuBvZl1Xoe7YX19+vKm2XNOuMhk1FjODgQlZnGCBKFaiGKMMmxoW68m5jSBXvDCh5N607HvTeh074vDk6OlPjp5OL+1PRkBIRkDIY5lT6RWXzO2Wq5s3mSyNg4i2P5s169n+OiN7n8ev0vvmiyOYIlN6+A8yITiq6tan6aUU6+b1dTcCABdvfIxeRBEjlve9fZIX9xkA2kz663f+Utnd63xcUMSDIyaOD47sLdGZDcfL1G3bq4s+zz9u677T/qrghIe3EwwMyw6KzA6KpFdcGl+cG/5p6d0zHQH3+BGRASEyejVAdErY3Bsn7Vp7lCzB7bi2U09pAgAw/ZpxMWkevY+5FBjhrn/KpdOqDY9e93FDtXO0wp3/XLjq/pmUJoiXVbR2LPnoB3rpkFg1buRLy2fTSwfodEfJ4+e+diwvCRv/VOpK1/peba0/8W7RH47l78c/Hica8HXXd7acL3z6jx30Ug+sGJ32xnXz6aVXpVpDw7MX32YxmA8n3DVSlkrmkyGAqDU0vF30aZu5446YVQtDPbroDgvv7jj03ZEz9NLeBUtE+5+6l16KIMig/Gv3rvX5XS//Plq4eGlysmu9G8dqa27/c4Nj8q4AgeD4vfd73knZd9AFaBh57PA2MmP7P0dPe2DE+H7m6W1ruGXX72T/8cPXPRApkro2QRDE76z5Zcu+wgHkdBoXG/HD3dfTSxHkioWrdGtV+h+t1iqc0FErkiOdKaodqpsXmCz5yZFuRvKZLOfU+nUG83GbrY4AnMOKlQivV4jvA3C5sGoMG1S6Hy3WcpzQs5hKLjtNIlhJy7TuSZu+OXK4hwf+z2wtVut/tdkb2cwIqehWhfh+AOe9Yqfuu5bOZxPDiyy2qlb16ybLeSBwDjshVPFfDjuRbKYx/KnSfme2FgIAl5OhED8k4s8lawGgvCETw4RxocfIkhbV853ab+Wiu4Lkr5GFRvPxds1/jZazBGHisOIkwlUK8b0AXU/ZndqvW1QvJoTlagwbVLqfrPY6FjNEwJ2qlD3DZFyBo4Xu3v/H3royx/LSmNT/Tl3u4U38l/kn3jy737HMZjALVz/R980b4i1fPvf7uDkjxsxIo1d0MxstTyx+pyy3hl7RLSYt/L0tT4pkPu+y6asTQiwVvP79vQFBzk5e37+/Y+f6k5QmCOLioqqKXJ4V7GnaXADIDnBGQ051lFBqLj+taZCDqTWD/eCV56/GvWbcvCR0zmj5CGr2dgywKEF4lnwkALSZ+8+DhiAI4omZsc7+Ka8fOlDc1kappDPbbP87d/buzZsc0XYAuGVkpj9E2wFdgIaP0y11ZLR9dVLmmpET+31gGxUYdlNSJrl62TuSIwiCIMglalW91tz5FJeVFKL4T7D8LTYrEgCUshdiQw7Qm/apQ/u5Rv8nl5UoF98tF91JEMZW1Stt6g9c23zW2P4wQZhlolsU4gd4nCyj+ZTJ2jXOzPM2HmpTv6fS/SDkzZKJ7iKAaFW90qp6nd4IQGfcVdtyLQMTykV3S4TX2u1tLJazK2Gr6rXG9jV2XCUV3SQVrbbbW+rbbu/QfkHZAF2r6pWe0XaNYWNNy0qrrVYqvFEhfoDBELeqXqlvuw/ApSduQ/sDbep3+dyxCvFDLGaYWv9Lfevt1AZXhnJ1OxltZzEYL2fP8/wmfmG0Mwxlxe1tJnofasRH7n9tVR/RdgDg8jnvbP7nrOsn0CsAMAybdf2E/2x7agii7eCjlDIOIRGK//z+jxfu+V9NWTMAEDjx4b//yDtd+dALK/hCv0hveoWJDVQceeb+Tr2x02DqNBg79UaV4/+Npk69sdPQtaozO/PM+pVibVeGRy6DnSmLc63sSzBPFsSTtZhUAJCnrr6BXn85GSxWepFnjIP94JWn3dIJACKW+xRDjaYWAJBxUM8+BEG8Y25cfJpSWdDaCgAtev2StT8vSkyaHhMTK5NLuFwCwGSztRsMNWrV2cbGQ1WVnSYT+dkRQcH/yB7v3NZlhS5Aw8V2StqQm5JGOSv6lExJkaEyGyk1CIIgCDLMEIS5U/cdj5MRGvCJo4TLTqlpWWGzN3PYSa5t+xEsewNTCBkY37EaIHm0onGSWr82UPoE2Uaj38BkKKKCt2HdATECbAThEifxpI2H7LgqJmQ3kxEAAIGSx6qbF3Rov5CJbmWzXDL4NXU+FaH8ScDtzkktJ8he8Ebz6Q7tZwLuxAjlLxjGAwBc+kxd6+pW1etC3nQuO7V7G85u823qNzu0X8jFdwfJXiVr7XhHc8dTAu6EiKDfyO/V2L5GY/hTZ9wl4jsHOBotp6OD/ya3XNd6s96032g5w+dkkW2uACeanYMkMhQhCm7XaeMJERtFNf2XQMx76vO7bv7n4kObzzRWteo1RrFcEJ0cNn7+yLDYIHprn/FhwB0AgsPl7//+j//8a13O7q6eO3v+PJOzO3/BDeMXr54QGnVFTY952WEYKIQChbCfFzU2O95pMDoj8gZjp95EhuMdVU1qrW9SDfWlwdjVSTlZEsFmDOzMjBUGOwLudYa+uiIOPQHHo+S/PYl56Oe7S7Qg4oKqYEfT/gxZaijP+ePYYVFtrt+RqypgM9gTAsZQPoEgCDJ4TAbjk8VLbtnwR4NWCwB2HN9aXLS1uP9MypOjoj5bvLTfvslDBl2AhosyNWWeXo+ndtRR5+nloEOGIAiCDGM2exNBmLnsEWQJl5MGAFZbFVniISYzkLrKYIi5nFSD6SgATiZ4YDGVFluZyXyWz+3KeY0BC8NcQhCetPGQRHiNI9oOAAyGRCq6tVX1qs64Qy6+n9pMzF/sjLYDUHPOqPW/AkCA9HFHtB0AGJggQPJYXetNat0v1A7sGCYAgDb1u+2aj+Xie4Jkr5BVAKA1bMYJvVx8DxltBwCJYIXG8KfOuIcacBcLllPj+CL+XL1pv8VafoUF3Fsp3dJlA4m2A0BVd9p3AGBgmJIvolQifiE8Pnj144vopUNoML8XAyIU81747Pad609+8uJGm9UOAHqtacM3Bzd8czAwRJqWFRMVHySS8kViPpfvflICz01ZkEEvQnpgMRlKsVApdt9f2GH8a58Neij6oLWbNY6FKMGA3ziF8rseUFvNateay0wy2LCFTNB1KUWWhc872XGu3tj06LkXQnlBYraYALzTonakkeEyOA8l3K7kord3CIJ4TYxMvvHGm948fGhzUaEnb5+TAgLXjB+/OCnZ81GoQwBdgIYP51lmteMe3psfb3ImpgwXomFeCIIgyDDGZCoxjE0Nr1utVQDAYgaTJR4iCJNK/6veuNdiq8BxFU4YHN3SCcCx7oB7gPRJY8vqmpYVAu5kqfAGsWAJGcgmedLGQxxWAnWVy04BALO1lFoIADxOr2l1zdY8AOCxXRo42pssLlluGAxJp/bbds0HMtEttGg7AJgsuQBQ33YXrRwA7HgrdZVHefkBAEyGHABw3L+CLZdOTOmyUKNTOSs88EOxc9K1FHmQn6SURPyKZzf1A9RU29HaqGptVLU0qNoaVa2N6tYmFY7TH1rbmtSHtg8mB1Zv/i59h16EDB8mvKuvlpTTTyf9noSsrouf0T6YQV6+Ex0opxd5JiEIRZC7iFmit0Y+u6Np/5nO3AZjc7O5jYkxRCxhmiQpQ5oyM2iyHOWTQRDE25RC4fsLFv5z8pS/S0vONDSUdbS3GQx6q5UgCAGbLWCzg0WiBIUiJVA5MzYuTj7In3qfQheg4SJU6Jzx6HBD5dJYZ4ey3hxtrN5VU+JYDuAJRinDXOsRBEEQZDhhYAKp8GaV7vsW1Ysi3lw73tmu+QDDeDLRwPKG47impmW52Vos4s+Vi+9lM0MZmKhV/TotKs3nZMWGHu7QfqLWrzd0HG1RvaCQrFGIH6DOcehJGw+R+W0cHFOP0iaGBQAms9dRbjiuxTA2gyGmFjIZcgCGnXAJgltsZS2qFwHAZLlAECbaSwI7rgYAufh+VnePexKbFUNdZTKdmeuuYIlS53iIcnX7nrqyOREub0fcIgA+vXhsc2UBWbIiNo1SjyBdfBJwv3PWW/QiBOkP1j1myo7jrjX9Y3Rf9nBiwJ/1qZQQJZvJtNrt9Ir+jIuNoBddxfhM3jXhC68JX0ivQJDLJK++Oafc2b2U5qbxmULupY7ZQvxBmFh895isu8cMy8Gz6AI0XMwMj/u9NNex/OqpfYmywBRKfnYas932S/H5t88eJOfpvTVlDOpUNYxs+vHol29tf/q9G6cv6rUnI9Ubj/164WTF55seUShd4iwe2vJLzuevb3UsM5iM7RedaQe8a4i/F4IgV54g2cs2e0On9huV7nsmQ87jjAoN+JSa1cQTnbpvzNZiufj+INmLZCGmdhP1YjGDg2SvKqXPagxbOrSftqpes9lbqZ/ysI0ncMJlqhWc0AMAAxtABhIGQ0LYqnBcw2A4X9Lb8U4AnIm5dD7DcV2o4kM7oWnpfK6x49GwgC+otY6QvZi/iM8dRy3viQzOXNkmhUQH8UUtxq6XH2sObXpq9PSbkkbzmG7OGQDQWc376yu+LTx1vq2BLIwSyW5OHE1phSBd3J9GCDL0JGxBm1kDAFqbgV7XH4216yMi1sASb/kah8WclBB1sLiSXtGn+KCApOBeH7YRBLnsfso5t/V8Ib2027JRqSjgjlx26AI0XMyNSkxTBBV0tABAi1G3ZOv3i2JSpofHxkkUEk73PL0mfbVWdba1/mB9ZSdlitSMgJA1GROd20KuOARB8PhsjDHIwMe0hRlR8UEaleF//9nR2uRHqQD6/V6H/s49vr/wqXduoFcgCHKFMpqP64x7wwI+EwuW0+s8ZraWAIBYsIQsIcBmsZU7W7jCMJ5UuEoiWFbZNF2t/9VtMN2TNn2zWLsGpTmYLQUAwGUnUgv7xuOMNllyTZZcAW8KWejots91TUTDYoZIhCsBwGwpVOt/aWenBEgeJWt5nEyNfr3BfKzfgPtVgolhr2TPfeDgRseqyW575fTed88fylKGx0oUUg6PzWCa7Tajzdpo0FZpO0tVrWSPBwcxm/vfqcuEbPToh7iBAu6Iv5CwhY6Ae5m2kV7XnxpDi2NByh5wOhpfu2n8qIHGOx6cMR51VkMQf3a89+7tCOI/0AVoWGBhjE+nr7h5128Neg0A2Ah8S2XBFso45d5MCY35fMYK/5mnF/GFZz+8iV40EDKFaNQEEQD88e0hvwq49/u9ju8vbGvW0EsRBLly6c2HAOxsVix1dtOBYjFDAcBmq4fuuT07NJ/acRW1DQBhtdWxWZGUEiYA07VPtydtPKUx/CkX389iBgEAThhV+h8BGCL+Anq73smEN6t0P7Vp3o/gZjkS1OCEsV3zIQAmFd5Ibw0AAMHyNyy28jb1u1x2KjkbqkRwTZv67U7tVxLBCjYrmmxss7cyGRIMG+T0P8Pagqjkl8bNfeX0Hrw7km60WY80Vh1prHJp506CNOCL6dcmSOn5eRDEAQXcEX+RKAqr0DUCQKmuQW3VS9l9TetKZbJbC9Rdwa8o4YAnXPW1qUkxs1Lj9xX2+l6dZvHI5EUjk+mlCIL4jdLm9latc0Z7BPFb6AI0XMRK5JsX3/bG6f2bKvJd+k31IlmmfDhz4uKY1ME89yOI38Pt+Pmc8og4NNoGQa4iUuFqte6X6uauMDSGcdjMSJnoFrn4PgAMAAjCbLKcx3GtndDZ8Q4AQmPYwMDEDIaIy0piMgMBQCq4rlP7TXPnsxZbOYbxDKZjRstJPne80XyC/A8RYK9oHM/jjOJxMljMYBzX6Uz7rLaqQOkTA2rjOTYrurp5noi/kMmQa43bLdYyhfghary7X1zOCKX06Vb1G9VN84T8WQCE3rjPYqsIlP6Tx8mgtwYAAAxjhwd+U928sLF9TVTwVsdMrUyGPFTxcUP7fVVNc8WC5WxWqM3ebrGVGkw5caHHXF8wXEXuSMkaFRj6xtn9J5tr6XW9SJUH3ZM6bkXcCJTWz4saKrv60Q6ZsFjfxg9RwB3xF5ny2J1NZwAAJ/D1tUfuiet6DduvLfU5ZtzqWB4li3Ot9AuvXTPvbtWGwsb+fz5mpsS9du08eimCIP7kWHk1vQhB/BW6AA0XSr7wg6lLnhwz7a/q4jMt9aWqtjaTXm+1EkAIWGwBixMsECVIA1IVQbPC4+Okvc6rhviCQWdePe2N8OiAzzY+Qqu6b8mHrY2qX4/8m8fvGk6ed7ryt68OFF2otZht4dEBc1ZkXXPbJAbTpbcmg4lt+vHo9nUnmutVAUHiURMT7nx0nkTu7Gty8K/ct/75G7n6x4kXhGKXie8cjHrzxh+OHt2d31DTjhOEPECUkhl5x//NC4kc2BniyT574tK/1/Z1J3b/eaaytNlisna26xam/Zus2nbxNebAdwlBkGHBaqtqaLuXyQiQim5hYhIAwAmdwXS0RfUyAEsuvhsArLbampZrqJ9qbH/YsRAkf10uuhMAuJwREcof2tTvdmg+AYzN52ZHBW0yWXKpAXcMmArxQ3rTAY3+T5wwsZgKDishMOALsWDZgNp4iIGJIpW/d2g/U+t/tdmb2MzwINmLcvF99Hb9UUjWcNgJHdrP1bqfATAuJz1M+jQ1eU5PTIYiPPD7muZl9W13RAf/5ZisVcSfFx38d4fmE71pjx3vYDJkbFa0Uvov1tUxS2pvRgWG/T7v5kpt566akovtjWXq9haT3mC1WHA7j8nis9hiNjdSJI2VKFLkQTPC4sIoM94j3nLXuOfoRT62o+0repFX+STg/uzHt9KLEKQ/EwNS2QymFbcDwK/VByYGpKRL+3/rW6Nv+a5yt2MZA2xC4MCmVRkaMgHv53tXvbH9wKZz+Xbcfd81MY/7wIzxd0zOQq9IEcTP5ZShfDLIsIEuQMNLmFByT9q4e9JQZlX/IhBxJ81OO7D9QlVJU0xSCFleVtBQW9Eye/loMtq+f9uFd5/+PTw6YN61WVwuO/d05Tfv/lVwrvq5j27CKH9gG747Ul3aPGX+iKnzMy6ertqx/lR1afP7ax8gG2RNSXzru3s0Kv3az/ZVlTaT5VTqDv2Tt31VW9GaOipq+a2TMIDK0qZzOeX/98oAJuIDj/fZE5f+vSJjlQuuH2e345+8vDk8JnDlXVPJKkbvCd8RBBnumjqfsuGtcaE5DMz5io6Q2srrR2uN2xwBdw47ITnSOVNlb4S8WULeLGoJl50qFVInhMCUsueU0Hdoz5M2/VOIH1SIHwSAAMmj1FzqNHLRnY4XBn0T8Rf0nYgmPuwCrYTLTk2MKO1ZGBrwKa2QJBffKxffSysUC5YnX0Ju/eEiViy/P308vRRBBssnAfcpC9yPakGQPgRwJfNCsrY3nAQAK2576vy3T6etmqocQW9HcUFV8UreWr3N5FidFJgaJfDTF7N8DvvVa+beN33c9tziU5V1Ve2dKoPJjuNyAT8pJHBaUuyyUali3tWYNA1BhhebHT9VVUcvRRA/hi5ACHLpZi8ffWD7hX1bz9/1hDPYsW/rOQCYs3yMY1XTqf/4pY0ZY2Pf+PYusi/2O0/9vn/b+eP7CyfOSiM/WFHU+NG6h2KTu2L3z9/3/ekjJYXna1JHRTlKRBJ+5vg4ANi54bTbwDQAfPnWttqK1rsen3/9PdPJQpvVzmIzKa364fk+e+LSv9fI7LiR2XEWs+2TlzcrlOIFK9HLJwS5KhjNpwXcidRoOwBgwMIwFo5rqIUIgiDDhU8C7ggyOLfHzjnQkusIoGttxmdzfxghjVkcNi5DFhvBD2RgGAAQQDSbVHnqql2NZ0+0FxPQ1V+PzWDeFefvY+EjFbIHZox/YAZ6a4ogw9W5mgajpSuHFYIMI+gChCCXYszEBIVSvH/bhTsfm48xMADA7fjBv3KVIdLM7K58hgf/vmg0WFbcOoma+WTG4sz9286fPFhMDV5PW5hBRqUBYPzMlNNHSuqr2sjAdL+MevOhvy+GxwRSo+0AMKBoOwxknz1x6d8LQZCrE5MhtdjKCMJMnbdTa9hiszeL+HMpDREEQS4Jk8UIiw2KTAqNSgql13kbCrgjfiSEJ38u/cZ/X/iBDKPnqavy1FUAgAEmYHEZgOntZpzAqZ9yWJO4LFEcTi9FEATxqpxylE8GQRDkqsNgMmYuGbXhu8O5pyodfbTPHy/vaNXecN8MR/wdAErz6wDglYd/pn7QQdWmo64mpIZRV8VSAQDoNEZqYd8qihvtdnxkd6x/0DzfZ09c+vdCEOTqJBff16p6tbp5sViwjMmQ2PEOo/mk3nSYxQwNkDxGb40gyJXo5bVr6EWuWGyWWC6UKkRn9uf/9wnnrUtwVEDauPiIhJDAUBlPyOUKOECAXmPUduprS5tKL1SXnq8mCAIAmCzGiz/9I3vuECVlQQF3xL9MDkx/fsTqtwvWk/OgOhBAkKljaBgY4/74hddETKJXIAiCeNuxMjRjKoIgyNVozooxG747vG/rOUfAfd/W8wAwe9losoFOYwKAa++YIqVME+oQFh1AXZUFDCzNek96rRkARO5mUh0Qz/fZE5f+vRAEuTr9P3t3HdfW9QUA/MY9uDuFUqBAnbq7u6xdZ513vs7d/Tdvt7Xb2q7u7kKpK1rcXQPE/fdHaBpukbwQecD5fvZHcu6DhuwmJznvvnNdBc/Sqe4N0s31Tb/o9HIqlc+kh7gJX3ERrKJRnfGjAQDdUfzkWDzUmsN/n//trW2G20OnxK14c1ZYbAcX0lWX1u/65cSRfxO0Gt2Hy3995ceVkx8agR9kA1BwB6Qz0at/ENfr15yDd0R5+NgDevF9VofPGugajg8AAIC1iRXK9PJWes4CAADo9oLDvXpF+l46lb76gzl6nf7y6fSIGP+A0Pu7B3H5LITQiInRUQOC7v9Ya4huRvogLo+JEKqvEeMDBJn/mM3R+b8LANBjCXmLhLxFeBQAAEykXc357c1thuXqT36yaMFzZrWc8vR3ff7rZf1H9/n8iT+0Gt2Pr2z2DHDrN6oPfpy13e/WBwB5hAt8fxrwzNpBqxcGjAzj+xq6t5vy5bjN8B38ddzjf8e/AtV2AIB9XMsv0eqaG14BAADoaSbOHSAVK25cyLp5MVsuU02c27xdqkHvvv4IoZQb+aZBGwnu7U2hUjKTi3XaVhotms+ej9l8VBoFIaSHhAsAAACAezQqzfer/zVU20fPHWRmtd1o+Iz+s54YhxDSaXU/vbxZo9biR1gbrHAH5BXtFBTtFIQQUus0DWqpWC3T6nUCBteJweXQ7u+mAgAA9nE5Fxq4AwBAzzVuRtz6b45ePn0XURCdQRszPc50dOyMuI0/ndy38dLY6XHeAa7GuKhOwuOzmSxrfu3iCznDxkddPp2+c8OFpU+NNcY1Gi3SE9g61Z6P2Xx0Os3FXVBWWKtWaRhMxzwGAAAAAJDKzbPpFYU1htsPvTaj5aBZ5j8zcf8fZxBCFUU1iQdvjVswBD/CquATDOgCGFS6B8vJg+WEDwAAgB1dzoMG7gAA0HM5ufIGje5950quTquPH9tH4MQxHRU6c9d8vfiLV7Y9N/+XMdNjPbycGuolxXk1qTcL/j7+mpefi+nB7dBqdZnJxTKJUiZR1lU1IYQSjqW4uPO5PLZ/sLubl9Bw2HPvzcrPLN/448nr5zMj+wUymfTKMtGti9nfbHoqONwLIaRSarLTSmUSpUyiaBRJ9Xr92UNJXD6Ly2MFhnk6u/KR9R6zOcz8uwzGTI/dv+nSG4/8NWhkb61W11gvfeGjuaYHAAAAAKBHOb/3huGGm49zcKRfy0GzeAa4+QR5VBTVIIQuH7kDBXcAAADA8cobmorrGvAoAACAnmTinAHXzmUihCbMub9dqtHQcZE/73xu5/qE6+czm0QygRPHJ9D1kRcnuRDZTVTaJH99xZ+mkV8+2m+4sfz5CSuen2C47eYp/HnX6t1/X7hy5u7hbVcpFIqrh2DYhChXD4HhgKoy0ZqHW/yeb9/cabjx7LuzZi8fZrhtlcdsDjP/LoPHXp7MZNEvHE/d/ud5NocZ3NvbdBQAAAAAPU1hRpnhhnege8sRAjz8XQ0F95xkm6+loxja3wBgKv6z38UKJR5t2+LBsR/NafEpGQBgsW+PX/jn4i082jYvIf/cG0/iUWBtu2+mfbD/FB5tzbk3nvQSWrlOAQAAAIAubfWWg2cz8vBo2waH+G98AvaQBAAAABBCaGHYy5IGGUJo8MS+n25/ER82z/tLf7lxOhUhxGDSD5X/jg9bFWyaCgAAAHQM+skAAAAAAAAAAAD2p1KoDTcaasQtRwhorG0y3KBQKC1HrA8K7gAAAEAH9Hp0La8EjwIAAAAAAAAAAMDG3LycDTcKM8qkTfIWY+aRiRUFd5v70jh7ttg8xhZsUnBPv1lo/M94CgIAAADoojIqqkUyS5I6AAAAAAAAAAAAOsMryM1wQ63SHNuc2HLQLMc3J6pVGsPtzjSCN5NNNk19fdn9Pjjfbn2m7+BQk0Fb0ev02Wmldy7l1FY0NNZLNRoth8fy9ncN6ePTb3iYwImL/wAAAABgnsu50E8GAAAAAAAAAABwgPjJsUkXMg23N315IHpIWCSRanP2ncJNXx003o2fEmsyaBM2KbibKi+ut3XBXafVHdtxbeuvZ+prmnvxYKg0avz4yCVPj4uIC8THAAAAgI5cySvGQwAAAAAAAAAAALC90XMG/f3JXsMSdZVC/ebc7x99b96sJ8YymB1UtjVq7bFNF9Z/tEcpVxkidCZ91OyBLY+yvg4eVudVFNfhIatqqJN8sOrvnLRSfMCETqu7cir96um705bEP/3ebCbL5n81AACAbkOp0dwuKsejAAAAAAAAAAAAsD03H+clL0/775tDhrsqpfrP93fu+vn4sGn9+o+JDOjt7RXozuYyDbuhqhTq6tK64qyK5ItZl47cqS0Xmf6qhc9P9vR3NY3Ygs1LzzYtuItqxGuWrysrqMEHWqPX649uv5qfWf75P6u4fDY+DAAAALTmVmGZUtPc6w0AAAAAAAAAAAB2tuTlacmJmalXcowRUU3T0U0Xjm66YLhLoVAYLLpapdHr9MZjMH0GhT702gw8agM22TTVFFZwr6tuun4+4/TeW4e3XEk8lpJ2I7+xXmp6ACE/vbvbzGq7UWZS8UdP/6vV6vABAAAAoDXQTwYAAAAAAAAAAHAgBpP+2c6X+o3qgw/co9frVQp1O9X2vkPDv9z9MpPNwAdswOYr3MuLahFC0ib50R3XTuy8XlZYix1AoVIiYgNGTomZuXw4i0Pgb75wJPnauQw8aobU6/n//XzqkVem4AMAAADAAy7nQsEdAAAAAJ1CwQMAAAAAIIbFYX6x++UDf53d9OUBuVSJD7eNxWGueGPW/Gcn0eg2X3puYPOCu6RRfmrvzb+/OdpQJ8HHEEII6XX6zKTizKTi/RsvPvHmjLEz++FHtGHfv4l4CCEKhRIa6RsQ6sHmMuuqm4pzqqrKWnTqMdj91/mJcwf4hXjgAwAAMhErlNmVtdlVtRWN4uomSbVYWiOWSpUqlUajUGuUGi1CiEWnsRl0FoPuxuN6CvleQr6/i1Okj0cfH09nLjSP6phSoymsbSiqExXU1BfUisoamiQKlUyllqlUMpVaqdYw6TQWnW54kt35XE8h31so8HLih3u6Rfp6unA5+G/sXkQyeWZlNR4FtgczE5ATzEwLQDYHJFQjlmZX1RbWNr+W66UymUotVapkKrVaq+MyGTwWk8di8llMfxdhiIdrLw/XUA+3UA8XGtXCL+oW/yD5qbXa4rqG/FpRUa2oWiytlUhrxdJaiUyuUis1GqVGq9JoEKIwaFQmnc6gUZl0mpDNcuFxXbgcVx7Hjc8NdHUOcncOcnPhs5j4b+++FGrNzcLSq/klScUVdRJpvVQuU6mYdLoTh+3jJOjl6Rrj7z0qPNjbSYD/ZOekl1ddzC5MKa0qqhPViKUylZpOpXKZDD6b6efiFOLuEuHtMTws0N/FCf/JrgZmpnVBNrcFvR4V1zcU1zUU1zcU1TWU1DfUimVytVqqVMnVGrlKrUd6DoPBYTA4TDqXyfQS8v1chP6uTv4uTmGebkFuzvhv7AGoNOq8ZyaOWxh/ZufVU9svF94tw49oKSDce9Ky4ZOWDnfxFOJjtmTzgjtC6Ic3d+Kh1tRWNn79ytai7MpHXp2Kjz2gMLsyMwlfchjZP+i1rxebltH1en3K1bwN3x7NSW2xq6pGrd3625k13y01DQIAyKBM1HQpt+hyblFqWWVFgxgffoBMpZOp1AihigYxKqsyHfJzEY4ICxoTETI0NJDDJHABTben16PMyupLOUWXcovuFJerNFr8CBMKtUah1jTKEUKouK4BG/US8mP9vUf2Dh7dO8RLyMdGuy6dXl9S35hVWXM+M1/f5hVpwMpgZgJygplpAcjmgIQUas2NgtLLuUWXcotyq9vbaUysUIoVzevmkksqjHEBmzU0NGBk72ALyqBshj2+etuHWqvNqKhJLqlIKq7IrKgurm/U6jps2arX6nQKdfOmOBWo9bcFNz43xs+7X6BPXIBPjL83t5u+5GvE0s1X7my/lixRqrAhuUotV6krG8V3ist330xDCMUF+CwdEjszrk8nz9ko1JodN1K2XUt+MDdpdTqlRiOSyUvqG6/ea6UY4u6yYGDf+QP7dqE6KcxMq4Nsbgs6vT6rsuZGQenNwrKbhaUNMgV+REti7f2UlFHRYimYK48TF+DbP9AnPjQgxt/bdKjbc3YXLHhu0oLnJjXUinOSigozyhrrJLImuUKmZHGYXAFb6MoPjvILjwty9XLM6UOK3gaFhGnhb+AhIuY+Ourpd2fh0Zb2b7z4x2cHTSMuHoK/TqzhCVpJBmqV5oc3d54/nGQapNGomxPfdfEg9jmph4j/7Hfj69kciwfHfjRnAh7t4rZcTfr88Dk8ahe/LJ89IbIXHu3uSuobD9y5eyQls+iBj4BdxcjwoD8fmY9Hifv2+IV/Lt7Co23zd3E6+drjeLQNZaKmHTdS9t1Or5PI8LFOi/D2mNM/cm7/6C70udxIplJnV9ZmVdZkVtZkVdZkVdbKVWr8IBIbH9nr1+Wz8ahVmTkzw73cDrywEo92BGamKUhAhMDMJBXI5oCccqvrdlxPOZiUQeg7TvsGBPkui+83JTqcTjOrDPrZobNbryXj0bYNDvHf+MQiPOo4ej26W1F1MbvwYm5Ramll+6cerYJOo8aHBEyI6jU+spenwPFnKFdvOXg2Iw+PmvBzEZ567Qk82pJOr19/4cbv564SfQIDXJ3fnjFmbEQoPmCeg0kZ3x1PrJUQ3j+PRac/NnLgU2OGkPaMEcxMW4BsbiNZlTUHkzIOJ2fWiAm/GDvk6yyc0jd8WkxEXz8vfAw4AhnfNPf/mxg3tNfQCVH4gAlsxTpCaOqiIa1W2xFCDCb91a8XF+dV52eUG4NarS7hSNLcR0eZHAgAsDe9Hp3JyN185c7NwlIbnP7rEXjmXeF4Kbdoy5WkC9kFOps90VmVNd8cq/nx1KXJ0eFPjh4S7uWGH0EmFQ3izMrqzIrmIntJfYPNnpieJb9GpNJomXQaPtAGmJnAPmBm2hRkc0Bal3OLfj937XZRB9ebW+B2UfntovKv+bzFg2MeGTFAwGbhR7Qk4LT+XZXk1FrtxZyik+k5idmF9VLrn3psh0aru5RbdCm36NNDZ4eGBq4Y1m9MRCiVQt5m+GWiJrFC2c5MqGgQr9l1zLLZWFLf8NzmA/MGRL8/azyh2neTXPH2npPnMts7VdAOpUaz7vy1A0l3f1gyIy7ABx92HJiZtgDZ3EYUas2um6l7bqZlV+G7WlpReUPTPxdv/XPxVpin2+OjBs2M7WPm+WBgIwTeqe3px3d2rT/5Bt+pzTaXhVn3r+wziBva3oIsBpP+6leLVs/5yTR4+VQ6FNwBcBS9Hp3OyP397NWsyhp8DBDBZ3dQcC+oFX1x+Nyl3CJ8wDZUGu3h5MyjKVlz+ke9MGEY0QuubUSp0eRW12VV1BoWsGdW1FhxjRswpdXpcqvronw98YEHwMwE9gQz00YgmwPSyq2u+/b4hcTsQnzAqmol0t/PXd1+PfmlSSMWDOzbTtHNidNmHZaEtDr9lbziY6lZp+/mOvwjk16PruQVX8kr9nMRPjFq0KJBMZ1srmI7WZW1g4L98ChCCKHiuoZHNuyqamp9Zzsz7budnltd9+cj85zMO39TUt/w5MZ9D/aQIaqiQbxy/a6P5kyYNyAaH7MvmJk2AtncRhRqzbZryX9fvGmLayXbkltd986eEz+durRy+IBl8XGETtEBK7Lf885g0kdOjek3LCykj4/Amctk0aVNiqoyUfqtwrMHble33Nq0sV56fNf1havGmAZNiQ2tMU2ERPpiEUyvKL9+w8OSLucaIxl3ipRyNYvTo7tHAeAQBbWiD/afulVoyfoOgGlnDx+ZSv37uaubLt/WaDtsX2hlOr1+3+30oylZr04ZuWJo/7a/ftqKWKFMLqnMqqzJqqzJqKgprK3X6mCdhp1kVda0X9bsyTMTOBDMTKuDbA7ISaXRfn8iceu1JLul/nqp/MP9p7dfS/lwzoTYNrroOneRPZMrG8V7bqXtvpnWydKwLZSJmj45ePa/K0lvThszqncwPkwCWZU1rRbcC2pFj23YXS22wlOaWlr52N+7N61a3M5XAIPCWtHK9bssaCPTKrVW+96+kwghR9XcYWbaDmRzW9Dp9duuJa87f82epXZTVU2Sb49f2HYt+e0ZY8f1sbAbFegMOxXch06IevGzhS7uLfpbuXoIA3p5DhodseLFSQc3Xfr7m6Mak35bh/+7vODx0RRq6184JE0tCu4MJl3ozDWNtGraknjTgrtGrc1JL+07KMTkEACAbRkaF649d02pad6aBnRSW5+282vqV285WFjb4nSmnSk1mi+PnL+QVfDFgikeAh4+bEv7bqd/dTQBjwK7yKxob2lMD5+ZwIFgZloRZHNAWvk19a/tOOqQRZoZFdUr/trx+pRRK4cPwMcQIvluDXo9uphTuO1ask1baVlFfk3905v2zeoX+eHsCWTbu7LVRCNWKJ/ZtN8q1XaDzIqaV7Yd/uORee1cUVHVJHns793WqrYb6PXog/2nXHncMRH2K6HAzLQpyOY2kl9T//6+U3eK7ze1dpRSUePz/x0YGxH67sxxfi5CfBjYkvUveDEtmhtMnD/ww3WPYtV2UzQadd5jo97830OmwaoyUUZS8wbZD1LIWmznLXQx6ztJv2FhlJY5Kf+u418AAPQcho+bP566BBndinisVq5QPpeZt3TdNsdWjowu5RYtXrs1t7oOHwDdVGbbZQ6YmcCBYGZaC2RzQFoHkzIWrd3qkGq7gUar++powsvbDkuULb6uIoRcyLrCXaPV7b9zd+6vm57etO98Vj7Ja5pGh5IyFv2+JavShg2RLdBqwf3dvSdL6hvwaOdcyi364/x1PHqPUqNZ/d9BW6wE1+r07+w5YYv9Hh8EM9PWIJvbglan+zPh+vzf/iNDtd3ofFb+/N/+O9Puts/A6qxfcE+/UWB619PP5YVPFphG2jJyasyEeQNNIxl32uyeqW/5bstgmrUFltCFFxLR4hK/kvxq07sAANsprBUtWbftYk4hPgA658Ee7usv3Fi95eCD3/QcqKpJsuKvnbeLSPSxA9hOq982EcxM4GgwM60Csjkgrb8Tb761+7hcpcYH7O5kes7SdduwoqQrr+MLsu3vUFLGpO83vLPnRE4VeU/ytaWgVvTwXzuSivHd3Rwot7oOa2S05WrS6bv3L7K3orXnr7Z1avarownp5VV41EpEMvkH+0/hUWuDmWlrkM1toUmueHLjvh9PXVI9sBDZ4cQK5QtbDn57/IJWZ+/GiT2W9Qvu185lmN6d99goJsvcxjULn2jRtD2z7YI7hsky94KdwDAv07tVLXvHAwBsxNBDkCSLB7sZrKXMpsu3fzh5kYRLQJrkiic37rXdp39AHmKFsqJBjAVhZgKHg5nZeZDNAWn9eOrSdycS8ajj5NfUYztkuvHJWHBXabW2WAdtNxKl6smNe28XkaX3tFKjKaytN96tk8h+OnXJZNyaNFrdZ4fO4lGELmQX7LiegketKiGr4Fp+CR61KpiZNgXZ3Bbya+qXrNt2Na/NRh1k8M/FW6v+3Ssl0yqTbsz6BffMln1ghoyNNL3bvuAIbzcvJ+PdsiJzL8Npu3cZzjvQzfRuXVWT6V0AgC2U1DdavYcgMBKw77eU2Xc7/etj5G1cLlepn9t8oLIRL3iB7iezssUFZDAzAUnAzOwMyOaAtL4+mvBnQpvtNRzFUNIynufjMhlshrkL0exmdr9Iku8Y0SGpUvXs5gMl9Y34gINkmFxN9cPJiza9fOp6Qeml3BaLFGUq9ccHz5hGbOR7G5/fgplpO5DNbeFSbtGyP7YX1TXgA+RzLb/k8X/2NMkV+ACwNusX3EW1978V8IQc36AWBe4OhUX5Gm9LGlvsjGoV3v4upnfFDY7ZLxiAnkOsUK76d68VVyiw6HQPAS/A1SnUwzXA1clDwGPSzWoq1V3x7q1wP5eZ/8H+UyRcp2mqRix9dvMBEl5kB6wrs+L+KXOYmYA8YGZaDLI5IK3/rtzZePk2HiWHkvqGJ/7dI1YoDXdJ2FWGQaOtGNYfj3Y1YoXypW2HSNKH2riFwN3y6v130lsOWt/6CzdM7/6ZcP3Ba7lsIa2syqYtqmFm2ghkc1u4mFP43OYDxrd68kstrXxkw656KZRDbcv659gb6++fKHNyIfyRQmDyI5JG6//v5wlabFYjFcNZHQBs6509Jzq5TZCHgDcyPDjW3zvK19PPxcmVh285pdcjkUxWUt94t7w6tbQyMaewTmL9d48HCdisAFenAFfnIDfnAFenKF9P/Ai7MLSUqWqSvL3nBNY1kpyyKmt+P3f15Ukj8AHQjWRWNK8jhpkJSAVmpsUgmwNyupBdQObrVBBChbWi13ceXfvwXCqF4sbnljeQ7gLrpUNi/0y43tU7DGRW1Hx77MJ7s8bjA3Zn3C/kz4Trdjiney2/JKuyNsLbHSFU1STZZMeTTzuup/QPvL9c0upgZtoCZHOru5Zf8uLWQ2qt49dGEJJVWfv433u2PLXEuHoPWJ31C+4a9f15xuIQ/j/HYN5/SAqF9Xe8YbFbdHtXq0h0shGQypLBsROjwhpkcpFULpLJRTKF4XaDTC6SKQzBBplcoYYp1J5/L92yeC9sJp02tW/vpUPi4gJ82m8bRaEgVx7XlceNC/BZFh+n16M7xeU7b6QcT8u21qpAdz4v0M0p0NU5wNU5wNUp0M050NXZmcvGj3MEPoup16O395zozHVhVArFQ8DzcRZwGAwOk8Fh0NVanUKtkSiVFY3iGrFUo7Xm5iobEm9Oig6L9m2xqQboTjIraxFCMDMtAwnIdmBmWgayOSCn3Oq613YcteKZMwoFeQkFPk4CHovBZTKpVIpcpVaoNU1yZamo0eLVi4nZhf87efG1KaPcSdnGXcBmLR4c88/FW/hA5wg5bE8Bz5XHYTHoLDqdRaeptTqlRiNVqmrE0hqxVGbt7W23X09ZNDgmwtsDH7CvzMoahFCpqPFMRnt7pXoK+CEeLkI2i0Kh1EqkGRU1Fu/3u+92+lvTxyCE/jh/vcPPBhQKCnR19nNxErBZWp2uukmSXVXb4U+16kRazoezJ3CY5m6nRxTMTKuDbG51t4vKnvvvgGWvoFbRaVRPAd9LyOexGCw6nc2gq7U6uVqtUGuqmySVjRIrXjCRXVX76o4jv6+YS6O2+38UWMr6BXe+kC2qbb4+xYKeMKZLzhmM1i9F0XfiQxWzZcFdY6UXPOh+6DSql5DvJeTjAy0p1Jp7BRG5SCpvlDeXQgx3G2TyOom8x/ZHq2gQ/3z6Mh41z8y4Pq9MGunjLMAHzEChoAFBvgOCfF+aOOLH05cOJbXYydlMs/pF9vH2MOZvEvbcNOKzWf9eumXB9iyhHq6Dgv0HBftF+3n5uwgZtNbfchFCWp0+t7rubnnVlbziC9mFnalSGWh1uo8PnNn57EP4gPWwGXSrfOpSa3VEV9YIOWz7f2jB9s51uFJRg1Sp2nkjFWamBSAB2Q7MTAtANgfkpNHq3th1jGiOfhCdRu0f6Du6d0h8aECohyu37eqhWKEsqBXdLiq7WVh2s7CM0Et7Q+LNRrmimHzdnA1WDh+w+codi88UUigo1MOtr59XqIdrmKdrqIebj5Ogw7YSVU2SrMqa5JKKy7nFaWWVnT9xotPrPz98btOqxfiAfdVJZHUS2cZLt1v9i/xdnJbFx02PjcCyvFqrPZeZ//vZq9lV91ufmelISuYb00bXSqR7bqXhYyYGh/gvGNh3XJ9Q0/2fEEJKjeZsRt7v567lVdeZxjuk1Ggu5hZNigrDB6wHZqYVQTa3uuK6hmc3H7D4VJkBhYKifb2G9QqM9vOK8vX0dRZS2z2hUSOWppVVpZdVXc0vTiqu0HXuOprE7MKvjp5/d+Y4fABYg/WnKV/INRbcG+okapXGdNF6h2orGoy3+cLWlwB0ZuU7NnVpNOt3sQc9CptB93EWtJN7ykRNk77fgEd7hq+PJVhwsteFy/ls/uRxfULxAeJ8nAVfL5w6Lab3u3tOimTEzv8xabTHRg7Eo6T0+s6jhHo1ejsJZveLnN0vMtTDFR9rA41KifB2j/B2nzcgWqvTJWQVbL5y51p+CX4cEWllVecy863yP7pViwfHLh4ci0eJO5me8/K2w3i0XQdeeLjDUmm3p9ejhb9vKYeZaUuQgCwAM9MCkM0BOf1+7qqxd4dl3PjcpUNil8XHmdlaXcBmxfp7x/p7PzpioFqrPZ9VcPDO3fNZ+WbW43bfbK8Y6lheQv6M2D4H7tzFB9pGo1Ji/L1HhAX1C/SN9ffGarjmMJxaHt075IUJw+sksoNJGTtupBR3bsvBm4Vll3KLRoQF4QP29dCfO6qa8ERDo1JWjx/22MhBrRZ8GTTa5OjwCZFh/zt18e/Em/hwu+oksuSSioSsgraaWng7CT6eM3FU72B8ACGEEItOnxYTMSkq/Isj57dfT8aH23UuI8+mBXeYmVYE2dy6FGrNi1sPWXzlE0Iowtt9yZDYiVFh7nwC+wN7CHjj+oSO6xO6esKweqnsZHrOlqvJRM+WmdpyNSnK13PegGh8AHQagVK4mZzc+CX5zf0x1SpNdkpp9KDgFke0TaPW5qaXGe/SmTStVvdgTdy0KG9g/kkdhbzFIggOl/D7LwDAHDcKSk+m5+DRjvi5CP9+bEGAqzM+0AljI0K3P7P0iX/2looIrCracyttXJ/Q8ZG98AHyMf/zn6+z8Jmx8fMGRNGo+Puq+WhU6vjIXuMje90oKP3qaELGvYbIFvj1zJWxEaHtnsIHXVgRzExASjAzCYFsDsgprazqr5Z7RRLCpNNWjRr85JjBLLqFX4cZNNqkqLBJUWH5NfW/nr1yIi3b/C+k5PT4yEHmlDWFHPaEyF5jIkKG9Qq0oJTZFjc+97GRA1cOH3AoOeOnU5c6s6Pj5st3HFvWRAg92CObzaD/vmLO0F6BWBxDo1JenzKKw2D8dvYKPtauH05ezKlqveI2MNjv54dmuXDxRtsYOo36wezxWp1u181UfKxtF3OK8JC1wcy0CsjmVvfB/lMWXI9iMCjY76WJIwYG++EDBLnyuEuHxC0dEpeYXfjt8Qu5lpbdvzhyPj40wNdZiA+AzrH8+0Nbesf4m949tZfA6dlLJ1JVyvvn3KrLRDvWnjUZb5adgi8RkknMvaAP63LD4VvtvRgAYGp9IuFvQR4C3uZVi62b0Q0CXJ03P7nYU0Bs0fEXR85bsAqAnOg06gsThh9/5bGFg/p2pnJkanCI/85nH3pqzBCLqz8ZFdVX8mz+MR2QGcxMQE4wM40gmwMS0un17+87qdVZ2GUi2tfr4AsrV08YZnG13VSoh+sPS2ZsXrUkwNUJH+tSwr3c2loBjRASctjzB0b/+ci8i289/fn8yZOjw61Y0zSiUSlz+0cdfHFlZ9ZaJuYUmH9i1T5oVMrPD83usNpu9Pz4oUQXFN9qo8dRjL/3HyvndVhtN3pn5ljzL+dCCNVKpGWiJjxqVTAzrQKyuXVtvZZ8ODkTj5rBS8j/dfnsTasWd77abmpU7+B9q1e8NX1MqxfQdEiqVL2792RXP21MQtb5CmGqT78WieTM/luFWZWmkbaolJrtD5TXt/56+tzBO1jw5B68iC9plOvNmx1lhS3OQfEEVujwCwDA5NfUX8wpxKPtotOovy6f7e3UZm+ETvIS8n9dMZv+wBUz7ShvaPr30i082gWFerjueGbZs+PiCf355qBRKS9PGvG/pTMt/s37bqfjIdBjwMwE5AQz0wiyOSCnA3fuZlVauK5wZlyfzU8uDnRzxgc6Z0CQ797nV8yM64MPdClPjBqMRagUyvCwoG8XT09488nP5k0eGR5M6NVnGQGb9fn8ye/MGGvZPn56PdpvxoJoe3py9JCR4cSWNn80Z2LnNyN15rJ/fmhWO9sSPIhFp782ZRQebded4nI8ZG0wMzsJsrl1lYmavjt+AY+aYXJ0+P4XHrbROn0albpy+IAtTy3xd7Hk7O+1/JKt15LwKOgcAvPbTNGDgqkmLxuNWvvxM/9WFHdwaYNGo/3xnV2F2XhpXqvVfbtm+9pP9tdUNCCENGrtpv+dSLmWhx2mkKvKizr4Jwywf8In0M30LgDAKv67kmTeKbD7nho9JMbfG49aVV8/r6fHDMGj7dp46XYnd0FxuMEh/tueXhrp44kPWM/k6PCfls2y7KPn6bt5nel8B7oumJmAnGBmmoJsDkhIpdH+SrDbhtGSIbHfLJpmo932eCzm1wunrRw+AB/oOoaE+Pf18zLcduVxnx0Xf/r1J9Y/On9GbIRVrgYgZMWw/h/NmYhHzXMuAy8XOFCAq/Nz44bi0Y54CHidn0vvzRxvwa5CYyNCCS1qTinFazhWBzOzkyCbW9enh85asNb+6bHxPy6b6cSx7ZLfaF+vLU8tIXSditEvZ660eqEMsJj1C+6uHsKhE6JMI5Wl9avn/LT37wttNX5Ju1nw5vJ1D65kN9Dr9Ac3X145+otFgz5cOPCDbb+fwY9ACCGUfDUXDz1Ao9beudSicVVwuG3fRADogbQ6/cn0bDzaLl9n4dNjiaVbyzw1Zgih3mSNcsXuW+Td4apD4yN7/fXIfFtcWYkZ1yf0lUkj8agZlBqNBf0EQVcHMxOQE8xMU5DNATltuZpEaK94oxmxEe/PGo9HrYpCQW9NH/P4qEH4QNfxxKhB0b5eXyyYcnbNqhcmDLfd+lZzLBjY99lx8XjUDNlVteUNTXjUQVaPH0poGa/RQ/Fxlv2gQay/9/TYCDxqBgoFze5H4FqNzuzWaD6YmRaDbG5dJ9KyL2QX4NGOvDNj7EsTh+NR2/AQ8DY+sciCC7ma5IrObI4CHmT5O3g75qwcgUVkEsVfXx5eNuzTNQ+tW/fpwa2/nt6zPmHT/058/+aOxyd8vWbZ2ru38ZaUU5fEc7hM04ikUa6Ut3k668jWqx12lUk8liKXtlgWFBwBBXcArOxWUVm9tMVmCR16asxgBs2SdmNEMWi0pwieSN91g8DGQaTSL9Dn+yXTLevjZoHHRw2ybCOgxOxCPAS6NZiZgJxgZmIgmwMSUmm0G4h3IkYIRfl6frFgCtXiLRSIeHXySKINuMljSt/eu557aG7/KLu9GbbvuXHD+gX64FEz2O2tsn2uPO60GEuq3gghDwFvVHgwHjXbc+MJL6s3GhNBYALn19TjIRuAmWkxyOZWJFWqvjySgEc78vTY+BXD+uNRW3Ljc39+aJYFbam2XE3qzM7AAGOTgntsfC9skbuBSqFOu5F/YNPFzT+dXP/1kW2/nzm991ar3WacXHlPvjXjmffn4AMP8A5ovlYiP6P8wMaLLQdbkEuVm386aRqh0qh9BxPIJQAAc5wiuPhOwGbN6d/KO4aNzO4XSWj1Ym51XUZFNR4lPX8Xp99WzLHzVZYfzJ5gwb94Nb9E19HpUtBtwMwE5AQz80GQzQEJHU/LJlo5QghxmIzvFk+3T/0IIUSlUL5ZNK2r76FKEjQq5cPZEyw4U5JaZvM+J+aYFdenM6vUJ0eH4yHz+Ls4jexEsT7K19P8zu9VTRIZCbp82FkXmpmQza1oy9WkajGxevTk6HC7rW031dvL/d0Z4/BoRxRqzZ8J1/EosJTl7/7te+XLRa4eBK4Nwbzy1WIunz154eBFT43Fx0z0Hx7+wifzjXf//PLwgU0XW13nLpcqv3jxP6y4HzM4xMWdcFMzAED7bhSU4qF2Te3b24KKg8XYDPrUvr3xaLtOpXfcsYpUqBTKlwumuHA5+ICNBbg6LRzUF492pEmuSC+rwqOgO4KZCcgJZmarIJsDEtpyNQkPmeHVySOD3V3wqC3xWExbt6/pOSK8PWYQ3402vcxhJTlT4zq3O+IIglutGs3pH2lBLdiISqFE3+uZbo6S+gY81AN0lZkJ2dxa5Cr1xku38Wi7vIT8T+ZOxKP2Mm9A9MBgPzzakQN37kqVKjwKLGKrgrvQhffB2pVCFx4+YIan350VPy7ScPvxNdOffHsmndHKeoS+g0Pf/nl57NBeAieuIaLX6dd9enD1nJ8Obr6cn1nRWC+VihUledX7N158dsYPNy9ktfwFaMyMflgEANBJMpU6r6aVy1baMTEqDA/Z2FiC1/lezsV7XpHcIyMGWJBcreKJUYNoVMKZJbmkAg+B7ghmJiAnmJkPgmwOSCi9vCqV+PaMoR6uS4fE4lHbGxkePIVgFQm0ZeVwwt0YcqvrlBrCuxpaF5tB729R1xEjdz7Pss0Px3eu0I8QCvd0w0Ntq26S4qGegfwzE7K5FW2/niKSEbvE6pO5k4Q23iW1HRQKem8m4UXuMpX6YFIGHgUWIfwR33wRcYH/27XaL9gdH2gbh8t8/dulcx8dZRqc//joP469PmvFcL9gdyab4eYpjBva67Wvl3y56UmBE5dOp81YPsz0+PyM8rWf7H9+1v+Wxn+8cMAHT0397o/PDlaViUyPQQh5+blMnD8QCwIAOimtrEqra+Uqk7bQadRBdi9zDAnxJ1TgSC+v6kJXSnoIeC9McMBlawbeTgILuhJnVdbiIdDtwMwE5AQzs1WQzQEJ7bxuSeveN6aNJjRPrOiFCcM6scgY3Bft6xXl64lH26XV6UrqG/GoffUP9O18IyNCK80NvIT8SB9iT9eDQokU3Hts02fyz0zI5taiUGv+vngTj7ZrZHjwqN7BeNS+Irw9RvcOwaMd2X49GQ8BixCY1hbwDXL7/fCrq96c0eFSdwqFMnpG3O+HX50wdwA+hpBvkNtzH85df+qNA6mf/3fpva82Pz1x/kD6ve0y5j4yku9E+CrgJ96cwWDa70oZAHqITIIt1fp4e1iwm0cn8VjMME8Cq0W0On1WZQ0eJatnx8WzGY58c5vdr/kSJfN1oacXWAxmJiAnmJmtgmwOyEar05/JINxGIMLb3YJag7WEeriOjejsQmNgMK4P4WeystHBVWCipdhWRfp44KGOWKVg6u9CoD8w0a7W3QnJZyZkc2s5lppVJ5Hh0bZRKOiNaaPxqCM8MWoQHupITlVdml26F3Z7ti24I4SYLPqCVWP+Pf/2u78+PH3p0IBQTw7v/pYIbA4zamDwwy9NXn/qjbd/XG7cAZUQJ1fes2Zsr2pq1LTYUdMccGkhAN1emagJD7Ur3IvARTBWRPTftX9St4yfi3DhwBg8al+jegcT7RqZW13X2u4boPuAmQnICWZmWyCbA7K5XVRmwXapK4e3spbLnh4fCVdUW8do4gtFq5rEeMi+Or/MHCEU4k64QtIv0BcPEeclJLDXXT2RQmQ3Q/KZCdncWvbfuYuH2jW6d0gYkctEbGdwiL+/C+FNvM9l5uEhQJydVvRwuMyRU2JGTmn+SqNRa8WNchabzuVbp5/R+DkDSvNrtv1+Bh9ozYAR4a9/swSPAgCsobyBWFIPse8eVkZE984qqm3AQ6S0bEgcnWbzM6ntE7BZkT6e6eUEzoor1BqRTObKa96QA3Q/MDMBOcHMbAtkc0A2p+4SXt7uwuXMiCW8paF1DQz283MREq15gQf18fFg0GhqrRYfaFtlo/3Kmq0iWkNsVYAr4UpZrL83HiLOQ0Cg4C7uwVssknxmQja3ilJR483CUjzarkccfbrX1PTYiD8TruPRdp3LzHdgx8VuwzHfMegMmos731rVdoOVr0x54dP5LE5717/QaNSFq8Z8vP5xJru9wwAAFitvIPYBgtDqCSvyEHTQ5wpTLe4CewExaLS5A6LxqCP0I75DVI/dbakngJkJyAlmZjsgmwOysaCfzOS+4cx7PUgdaHpMBB4CxDFoNKLLRZvkSjxkRxSKJbXyB/k6E2jtghCiUFAvgk9Uq5w4bPMvvpIoem7BneQzE7K5VRy4k0HoykJ/F6ehvQLxqONYsItyZkWNPc8MdVeOKbjbyPSlQzecemPRU2N9AvG3PDdP4czlw9Yde+2JN2cYm78DAKyO6M7d7gSTq7UQT+r267VnsYlRYa48whta2EK4F/4m3KEa+35sAvYEMxOQE8zMdkA2B6RSUCuqIFg2QghN7dsbDznCNCi4WwnR+rVSQ2DRsdW583lW2SCEzaAT6qnt4yTkEjm+LTQqhcdk4tE2SJT2qyCTEJlnJmRzqziYlIGH2jUthhTZxyja19OCt4XEnEI8BAiyQg4gFTcvp8fXTH98zfSGOkldVaNUrGCyGB4+Tm5exN4EAQCWUajVeKhdfJa5n+Ssi8MglnJkSmJ/l0NMjg7DQw5CdKEHsn3xCDgQzExATjAz2wHZHJDKnaJyPNQRVx53cIg/HnWECG8PVx63Xtpzm1xbC9G1t0qNBg/ZEdEibDvc+dyS+kY82gYrtgThs1kS83rFSM07rLsi88yEbN55+TX1JfUNeLRdU0lWcKdRqQOCfC/mFOED7UotrVw0yMEbHXV13a3gbuTsxnd2I/bGBwDoPIWa2AcIR13qS/TftecHI8vQadQR4cF41EE8CX7uRAiJe/bSmG4MZiYgJ5iZ7YNsDkjldnEZHurIsF4BRLcjthEKBQ0J9T+emo0PAILc+MQ2riD6PmZdhHqgt49HpAbq4yzAQ5Yyf4U+oQ7m3Q+ZZybRf4toVrUWov+uPbP55VxidWpXHrePtxU2TLauPj6eRAvuaWUEthcCrepWLWUAAA5HNPkxaMSSq7XQqMTe/cj/OXJwsL+jliQ8yJ1P7KpAhJCS4MdB0FXAzATkBDOzfZDNAalYsMJ9cEgAHnKceDI9mK7L/Pqvgcahr3d3gkXYdhAruDsR6/neDvMXHWt1RPpbdztknpmQzTvvEsGC++AQf3Kc7W2hl4crHupITlUd0fkDMMSmNQAAWJfKjj3sTBEtVRD9IGV/Q8hx3bQBm0En+ow5aiYAW4OZCcgJZqZ1OerxdL9sDh4kkskLakV4tCOkeo1bsDEyeBDR169ja8BWLLibX/hGCHk78fGQpRg0c4tFaq0OD/UkXWtmtg+yOUaj1d0oKMWj7SJJNzOMBXspa3W67MpaPAqIMPc9FAAAzEH0rLijzpoS/XcJfdJ1iNgAcn2XY9GJfQwi+n8EdBUwMwE5wcxsH2RzQB5ZFTV4qCPOXHaw9TpZd16ohyvR9ZvgQVRKV3oO3YhfutQWOpHJ48qzWqHf/Emr1fXogjuZZyZk805KKa2QqYj1i4/yIV0/GYSQp9CSd6RC4me7gSnyvjUAALoiolfoN8gUeMguaiXEtq7iEN/X254oFNTXzwuPOhTR4lEPXxrTXcHMBOQEM7NDkM0BeViwvD3C2wMPORSDRrPiVpagSxByWHjIUjQqgf4ULjwOHrIU1ex/t4cX3MkMsnknpZdX46F2USiot7c7HiUBNx7Pgn1NKhrFeAgQAQV3AIA1EW1EW9UkwUN2USOW4qF2WfGyUFsIcnMRsK32sd4q6GZfhWqg15P58kpgIZiZgJxgZnYIsjkgj/yaejzUkd5epKt3RJCyBANsh2ihsx3mrzRHCDlz2HjIUhaU5wDZQDbvpEyCl1j5OTtx7XUygBAaleLMJfzmUNnomPnQbRBbTQMAAO3zcuJnVxFo9VUqasRDdlFUR2y1VICrMx4ik2A3WDYFyAhmJiAnmJkdgmwOyMOCS9rJtsIdIRTo5oyHQLcmtF7hmxBH/buAnCCbd1JWJbGCu7+rEx4iDQ6TgaRyPNquisYmPEQ+dZUNKZeyM2/lN9SIm+olKoUaIdR3WPhj783DD7U7KLgDAKypl4dbYnYhHm1bZgWxq7SsJauCwCcPhFAAiXMnQigIvsUBUoKZCcgJZmaHIJsD8sivJbzCnYSvcW8nAR4C3RrPeivcCeEwocID7oNs3hlanT6vmlgC8iHxWz2TYEN/5LgrHsyUejl7+/+O3jp3Fx9ASOjKx0MI5SQX1Vc1n1KKHhLGd7b5dRLwdgzs5Mmze0+V5Jyf/1Sw4P6yskKxaOzePycFhP81fr7JsVZzuDDjVEnuT6Nm4QPAZsK9iO1/nV5WrdcjO1+wqFBrcqqJJXUL9vW2J1g2BcgJZiYgJ5iZHYJsDkhCq9NVEb+k3ceZdCUPHychHgLdGofhgEoLlUIhuiMI6N4gm3dGYW090d1cvZ1aqfOSBJP4m4Oc4IaxdqNSqH99Y+vJrZfwgXalX81d9+4Ow+1H3pm77NXpLcetj/AzDkAXcqokt1IK+zzYVb9AXzzULpFMnl5eZefN624UlKo0WjzaNjaDTs7dxo18neFbHCAjmJmAnGBmdgiyOSCJeqlcR3DHAhqV4iUkXcnDl3znAOxGodY0KRQShUqqVEmVKolSJVOpFWqNUqNRqDVKtUah0SjVGmNEodaoDEP37jYfSbDy5VgsRxTc2Y74R7uunjAzIZt3RqmIcEOVteeurT13DY92WQo1Gee2TKx4Y853uSnF+EBHxi+MX//Rbo1aixA6ufUSFNwBsJxWr79UUdRL6IoPAFsKcXdx5/NqJQS2PTmTkWfnpH4mIxcPtSsuwIfodnZ25srj4CEASABmJiAnmJkdgmwOSKJeKsNDHfEQ8AltMmkfHgJiWxd2RXUSWUGtqKC2vrBWVCOWVjdJasTSGrFUolThh/YADllpzqQTbhnRE/TkmQnZvDNI3lDFDkhYcNdpdV+s+sOCajtCSOjGjxwUmnolByFUUVhTnFURGOGDH2RVDkgDALRvf/7dTZm3M0XVCKG+bl5PRcdPDAgzDEnVqiE7f/PlC0/NeaLFzyA0cf/6cmnTzSUvcOmMLVl3duamZolqFFpNrVwavPFr42G5K9fQKfZ4d+7JRkcE772Vjkfbtv92+urxw2hUO126plBrjqZk4dF2xYcG4CGSceZC8QiQEcxMQE4wM80B2RyQQZ2EcMHdnW/zrqwW4LNYVAqF6Gp9kiupb0wprUwpqUgtq8yrrhcrlPgRPRjLEbVvEp5qcgiYmaYgm1usRgwFd9IV3A//k3DzzP35zOGxxi2MHzguKjjKX+DEXRzxqsmxreg3OtJQcEcI3bmQAQV30LN8eev8H2nXQp1cl4bH6ZH+fFn+qrN73h007snoIQghHoM5JzRqa3bSreqygZ5+xp9KravMbaxb0Ksvl85ACPVyclvWO06r07179WSI0PXpvkOMR9Kg2m57E6PCCCX1qibJsdSsmXF98AHb2H0zlehyhmkxEXiIZGC1JiAnmJmAnGBmmgOyOSCDeqkcD3VEyGHjIRKgUBCPxewGhb86iSwxp/BCdsG1vBKRjPD/nR6CSqE4pPbdk7/qwsxsC2Rzi8EKd7K1S1LIlNu+P2K8229UnzfWPeHqRWAH3T4DQ4y3c5OLTEZsAgrugERuVZf9kXYt3itg46TFbBodIbRGo155audXt86P8g3p4+KBEFoR0X9rdtL2nGTTgvu+vHSE0MKwGMPdod6BQ70DlVrNu1dPenJ4S8PjjEcCOxgZFuzG5xJakfTLmStT+oYziG+cTZRMpf4z4QYebVeMv3cQubfXo1IoPBYTjwLgaDAzATnBzDQTZHM7eDb+3fyUYoTQJ3tejZ/eHx8mN/s8+DriLWWEHBYeIgchh9V1C+5VTZKDSRkn03LuVlR1r2X6NkG11+pgjKP+XQeCmdkhyOYWq24i0IoH2MH1k6mimubG+sFRfh9vXc3iEPtIHxDubbxdkltlMmITUHAHdjV27594yMTO3BSE0Mv9Rhqq7QghLp3xYtzwlad2bs9J/mjIRIRQlKtnnLvPkcLMj4ZM5DGYCCGNXnewMMOXJxzqHWjyy4DD0GnUuf2jNiTexAfaVlLf8OuZK69MHokPWNt3xxMJ9bBDCM0bEIWHSMYOH4YAsADMTEBOMDPNBNkckIFcpcZDHRGyybjCHSEkZLPLUHOloKvQaHUn03P230m/nFvczfrh2JSjVppTKT2l4A4z03yQzS1G6CwFsINb5+5fq/H4+/OJVtsRQh7+rjQ6VavRIYRqSuvxYWuDgjuwqxnBffiM+68KiVp1pDDTeDe9vgohFOPWYo+Ovm7eCKHk2gpjZEVE/zWXjh4ouPtQ734IocSyglq59IXY4T3l80VXsGJY/02X76i1BHYb35B4c3CI/8jwYHzAek7dzd1xIxmPtsudz5s3IBqPkgzsjwTICWYmICeYmeaDbA4cTqUhMP0M+GzC38Dtg8XoSm8+So1mz630DYk3KhrE+BjoSI+pezsAzEwLQDa3jFxN+IwvsKmsO4WGGxw+e+A4S2YChULh8NiSRhlCSCa2ee8px5x6BT3WmgGjvx4+zfjfmgGjTUclKhWdSuUzWlwH6sLiUCmUJtX9CzBnhUQKmazt2c3vzvvy7yKE5vfqazwAOJyXkD+7XyQebZdOr39p2+HkkvtnVqzrdlHZm7uOEV0A8fiogSw62U9MMuyySzsARMHMBOQEM9N8kM2Bw6mIVIgM6I7onW0O0j4wjFan33I1aeJ3Gz47dBZqmpZxSAP3bg9mpsUgm1vGgjO+wKYaa5pf+EF9fGl0C99m2bzmeqNSYfMTKhY+RABsQcBkaXQ6sUltHSEkUsp1er2Qeb8Kz6bRF/Tqm1JXmVFfLdWoTpXkDPT0CxG6mPwQcLznxw9lM4ilQ7lK/djfu89k5OEDnXb6bu6qf/cS3WXbz0W4dEgX2AAA2iMAcoKZCcgJZiYhkM2BY1lQ7yDta5xO1gdmKqW0cvHarZ8fPge9FDqj57R2sRuYmZ0E2dwCZNsyFIgbmhsQCZx5LUcIUCmaN+nl8m3egA4K7oBE4tx9EEIpdZWmwdTaCoRQjNv9zQ0QQssj+iOEduWlninJlWvUC3s1b5dqytA7T48InjYFVuLtJHhkxEA82hGFWvPCloMfHzwjJbhZeVtkKvWnh86+uPUQ0YyOEPpw9gSin0sAAACA7gSyOXAsiwruJP2GS9oHZqDR6r46mrDsj20ZFdX4GACOAzPTKiCbW0BJPAEBm+IKOYYbSrmFE1Kn1UkamzvJCF35LQetz67zFYD2LesdtzU76afkSwM8fDl0BkJIrlH/knKFgtDisFjTI8Oc3IZ4BRwvyq6Vy1g0+szgPqajBnQq1YPDy28SqbRaZldYUdL9PD1myPHUrKK6BnygIzuup5xMy1k1evCiwTF8loWNOOUq9d7b6evOX7NsHcSsfpE2bVoHAAAAdAmQzYEDEWo6bEDazi10Knm/j1Q1SV7dfuROcTk+AIBDwcy0IsjmRCmJnxUANuXiIWyqkyCEqkvr8DHz5KWV6LQ6w213X5s3yYCCOyCRaFevNf1Hf307Ycbhf8f6hSI9OleWX9BU/0q/kX1b7qSKEFoR0e/FC4fOlOZODgwXmDScMTUrJPLvuzeXnNg6xi9Uq9PVKWRfDJuCHwRshs2gfzZv8qN/79LqCF9nIJLJvz1+4ZczlydFh4/vEzqsV6CQY9YlP3KV+lpBybmM/GOpWRJLT8X38nT7YNZ4PAoAAAD0PJDNbYeCunDfCfs8eAuq5zqiXYHthbRdRtLLq57euL9eakkVrJM4TAaXyeAyGRwGg8ticBgMQ4TDYHCZDA6zxd39d+5eyC7AfwXovmBmWhdkc6JIm016LL9eXkWZ5QihyqLa6tJ6T39X/IiO3DiVZrwdMzzcZMQmoOAOyOXZmKG9nNz+TL++LTuZglCUq9eaAaOnB0XgxyE0LSjCjX2mTiFb2PZ2qW8MGMOi0Y8UZv6WcoVLZ0S4eOBHABsbGOy3evywn05fxgfMo1BrDiVlHErKoFBQgKtzhJe7v6uTp5DvwuWw6DQmna7R6ZRqjVihrGqSlDc0ZVXW5NeItLrmk5aWEXLYvy2fzbP07D0AAADQzUA274zbZ9JObEy4ezVHVN3IFXACInzHLBw67bGxDBadwWrlu9jBtad+e3VTcLT/Hze/rKsQrX3tv1tnUrl89sh5gx/9aBGHzzYcs/fX43XlIr8w7/kvTpv88Cj8t9xz+0za6S0XM2/k1Vc2yCUKfPieb0+8Ezu6lS31iD54q2PSCa8K13Ru5vQ0aWVVT/yzR6xosYeWtdCoVF9nQaCrc6Cbs6eA5yHgewh47gKugM0SsFl8FotGJXAW4mZhKR4C3RfMTFuAbE4Im0G34CorYDtDJsZcPnLHcPvgX2dXfbyw5XgHlHLVoQ3njHf7j2nlY4912eNzEgAIob/Gz8dDCAULXAofeRMLTg4MnxzY8bkmGoVKo1A9OfyRviH42D1sGv3NAWPeHDAGHwB29NSY+IyKmpPpOfgAEXo9Kq5rKCZ+BRxRHCbjl4dmBbo54wMAAABADwbZ3AIatfaHZ/46s/WSMdKoFDfWZqVdyjr81+mPdr4iaLt/aGlOpVyieGfWN4XppQghWZN8/28nq4prP9r5ypYv92/6ZI/hsIK0ku+f+pNCQZNW4DV3hVT51WO/Xzl0G4s/iEKhUB+oa3fmwVuRJQX3e1eLgw5ZvaZJp1Fj/b37+nlH+XpG+XoGu7nQyd25HpATzEzbgWxuPhadLkbEJuGkqDCWfRvN9yjxU2LpDJpGrUUI7f/zzLBp/aKHhuEHte2nV/8T1TQZbvuHeUcPIfCzloGpYHNnr2e//cthhNCAPv5r312MDwNLXaoorJZLno0ZSiPt9ZkAIYQQhYK+WTRNJJPfKCD7yX8uk7Fu5bxBwX74AAAAANCzQTa3wHdP/nluR/NCQjcfl5iRERw+u6a0LvVSVtHdsrdmfOUZ4N7yJ+7TqDR/vLGlPK9q9IJ4tVJ95fBthNCVQ7fP7byy5Yv97r4uAyb0zUkqLEgtQQht+nTvgwX3rx9ba6i2cwTsec9P6RUXxGQxSnIqDq49VVlYgxCiUClr1j8dFhfsE+rJZDOwH+/Mg7ciBvF9mEi7wl1Psu4E9VLZC1sOWqWm6SXkT44OHxkePCjYj8PE5xIAhMDMtCnI5uazYI/W16eODnB1wqPASlw8hbOeGLdv3WmEkEatfW/JTy/+8PC4BUPw4x4glyh+fGVzwr4bxsjSV6ZRiFzIYhnCEwgAMtDq9T8nX2ZQaY/2IbzXNrA/Jp227uG5q7ccvJJXjI+RhiuP8/NDswcE+eIDAAAAAIBsTtCVQ7eNBeula2Y98uFC6r0FlU31kh+f23DpwM2qotr7P/CA4/8mfHP8bUOnlw3v7dj5/WGE0DePr/ML8/4p4UOeE1ej0rww6sP8lOLq4trijLLAyPtViZTEzMuHbiGE2DzWuutfeAc3t1UcMq3fzCcnvDL2k7yUIr1OX1VUO2HZCONPGXX+wVuLBQV30m5zJyfTA9Pq9K/tOFrVJMEHiKDTqNNiIhYNihkY5AcroIBVwMy0A8jmZrJgrbpMZWGfemCmh16bcW73tYZaMUJILlV+/fT63b+enLB4aP/RffzC8H0fVUp19p3CG6dSj2y8IGm4vxtEdHzY+IXxJgfaCuEJBIAD6fT6r26d59AZieWFt2vK1gwY7cW1x9WsoPM4TMbah+e+v//UoaQMfIwEon29fn5olo+zAB8AAAAAwD2Qzc237ZuDhhuj5w957JMWF7kKXfnv/rf6+eHvG9ant6XPkF7GvuozVo03FNx1Wt3i12bynLgIITqTPmrekPyUYoRQcVa5acH90oHmZVyznpporLYbsDjMh9+f/9Gi/yGELu2/8dBbc0xHDTr/4K3FggWGTdZYGGsLcpUaDznOhsQb1/It/z9Ip1GXx/d7bNRATwF8FwPWBDPTPiCbm4NDPAFJlSR6n++WBC68T7a/+Oac7+TS5lyfl1qcl1qMEKKYnF67ff7uwrCXTYvsRm7ezu/984xxGYFN2ePfeNDsl/+Kf/gHuQLmIiBGj9Chwsy1aVfrFNK3B459LmYYfgQgMSad9vXCqW/PGGtBO07boVDQsvi4/55a7PCMDgAAAJAfZHNzVORXZ93MM9x+6K25LcYQQgjR6LRFL8/Aoy1FDAo13vYO9uAI2IbbsaP6GONeQc19XeorG41BhFBpdoXhRmhsoGncoNe9YGluZcsRhKz04K3Fmdv8V5uvUd7m3rCOpVCT5ctvVZNk3flreNRs8aEBB19Y+eb0MVDTBNYFM9OeIJt3yIIEJFXCCneb690v6KMtq4Vu+MvctG+bUq5qtdruHeT++a6XXDyF+IBtED5j03lFFaKqOjEeBcAMNArlysJn8SjoUh4e1n9Yr8B3955MLW3lO56dhXm6fTx3Yv9AR16qBgAAAHQ5kM3bd/da8350Hv5uITEBLQebDZjYFw+15OHvZnpX4MKXixVUGtUr8H7zdC6fY7ihUrT4kq9WaQ03WFymadyAyWkO6lrbX9QqD95aXHlcPNQR0hbcZSqytJT59vgFhUX9bagUyrPj4p8dN5QKfTqADcDMtD/I5u3wdiJc9K+VSPEQsIG4kRFrEz747vl/7iQQuERj8MSYNb8/LnTl4QM244CC+/W0IjwEAOhJwjzdtj+97HByxs9nLpeJmveJtjNvJ8GTowcvGhTTY3eoBwAAADoDsnk7iu6WGW4ER/u3HLnPxdOJ78yTNLT55Vzg0uI7IY1ORQgJnHmm23xRac23tZrmCruBd7BHcgJCCJVkNS91N1WSVW644RXUotuMgVUevLW484kX3GUkLbg3yOR4yBHya+qPpmThUTPQqJQv5k+Z1a+5zREA1gUz01Egm7fFgoJ7RSOsLbYTN2/nL/e8kno5e+/a09dPpWg1rSwgMKDSqP3HRC57dXrfoeH4mI05oOB+DQruAPR4FAqa1S9yemzEoeTMjw6cVrX8lmhTvTzdHh7Wb96AaAu24QIAAACAEWTztohFzTv+tX/ZstCN307NmsFi4CGE6Eyzvr6NnDPoxMYEhNCB30/OfGoC36lF2Xrb180t2ofN6G8aN7DKg7cWC1a4d3K7RRtRa7VicjSX33o1CQ+Z59N5kx1b07zfLAB0RzAzHQiyeat8iBfcK6Hgbl8xw3vHDO8tlyozb+Zn3MivKauXNMqkTXIWhyl05Tl7CCMHhcYM780TNl8OaGdmfWKzIrlSfTvD8k0wAADdSUZFzcZLt+yT0V15nCl9e88bEN3XD9+9GgAAAAAWg2z+IMW9vbyMzVta1Wq/F6NWd/Qys1/C4KlxfYf3TrucXV/Z8Ozgd5aumR0SE8DiMsvzqvb9ciL9SjZCyM3HZdFrM/GftNKDtxY34ivcxQqlWKEUsFn4gEPVSVppJmt/UqXqgEV7JC4f2m9u/yg8al+WNRsBXQLMTDKAbI6xYIV7eQMU3B2Aw2P1HxPZf4wjT7y1inDBvbC8/khi+p3M0pKqBqlcRUGIx2X5ejiFB3oMigoY2S+Uw8bXYmQWVF1LK8oprskprimuEOnudbIf++QvLQ9ECKGVMwc/v2QUHkXo7wPX/th9CSF09Nen3Zx4CKG8ktq9Z1NuZZRU14t1er2bEy88wGNobPDsMX2pJhdaXk8vfuGr3QihIB+Xnd88ZoxjFr/xT1GFCCH0y1sLh0S3srmQgUKlOXE540Z6cWZhdYNYLpUrWUy6uzM/yMclJsxnRL/Q8MBWLsxsX5NE8dyXu3KKaxBCEUGev761UMgnvDkDAF2LVqf76fTlfy7e1OpsuCZAwGZF+3kN6xU4PCwwysfLzO+oAAAAADAHZPO2sLjN1V6Vor19Mtu5ArqTKBTKBztffm/Od9m38qtL6n5+8R/sAP9w7w93vCx0xfccQyR48KbYDLoTh020LXt5Q1OEN+EvZTZVS46C+/msAgv29AtwdVozdTQetbtuU9YED4KZ6ViQzVvl79LeZV6tyqmqxUOgByNQcNfp9L9sv7D9+G1jxdxA1SQTNcnS8yr2n0vhsBn7f1jlLGixXH/nqTtHEu+aRjqjViR1c+Kt33dlw76rpo+kVNFQWtWQWVg1d1yMyeHWdOB86u87LzaIW3TfkyvUJZWikkrRxTv520/cOfzzU4TaTjVJFKu/2m2otkeFev/8xnwBD6rtoJurlUhf3X7kZmFzh9D2USmUeQOimXRaSX1DjVjWIJPLVGqFWqPV6fRIz6DRWHQ6k07jMBiuPI6nkO8p4Hk7CXp5ukV4u/s6E86RAAAAADAHZPN2CJyb12U31ra32E1cb8PmJ05ugm+Ov/3CyA9LssqZbIZWo6NQKQIXXq/YwJFzB49fNoLVxgJ2Mjx4UyEeLknFrXSib0eZiHQF9zJRIx5yhIs5hXjIDG9MG8OkO77bg0Ld3hkg0KXBzHQgyOZt8XdxFrBZhLqB1Yil9VK5K88xDUwA2RAouK/bfWnrsVuG274eThFBnk4Ctlqjrahpyi6ukciUCKGYXj5YtR0hNGVYZO9AT8NtpVrz+86Lhturl456sE9TZKg3FsHUNkgu7M1bv+8KQojDYoT4ubFZjBqRpKKmUaPVjegXiv+AlXy78ezu00nGuzwOM9Dbhcth1jVIq+rEcqUaITRjVBShartYplz99e6somqEUEyYz09vLOC18cEXgG4jo6L6mU37a8RmNf2M9vX6aO6EaF/yXmgGAAAA9ECQzdsXGOlnuFF0t7TlyH1ysaKh2obb0ynlqrdnfF2SVR4WF/Tp/tddvZ3xI9pAhgdvKsTdlWjBPbuqdnxkLzzqUEV1DXjIES7lEN5NLdTDdQI5nkwz33BAVwQz01Egm7eDQkFRvp7X8on1xM6sqB4eFoRHQY9kbsFdplBtP3EbIUSlUj55dvqkoRGmozqdPj2/8tTVrKExrUys+Jig+HtxsUxpLLgvnNDvwf4zHTp0If38zRwPF/5LD40ZNzjcWOCWylUXbueF+rm1PNw6dp9ONlbbo3t5P7to5MDIAGPjGp1en5pTnnArd+5YAovrxTLlC1/tziqsRgj1i/D78fX5FjwbAHQtqaWVq/7da85ZYgoFPTpi4CuTRhI6iQUAAAAAW4Ns3qHIIWGGG5WFNcWZ5YF9fFuOI4RQUsJdfcvrhq1r7y/HM67nIoTe2vic+dV2RI4HbyrUwxUPdSSzogYPORoZCu5FdQ21ErPKaqaWDInFQw5S3mCnczzAzmBmOgpk8w5F+3kRLbinlFZCwR0YmFtwLyyvV6o0CKGIIE+s2o4QolIpMWE+MWE+WNwWzt3I8XDh//vJcndnnmmcx2FOG2GTHvlSuWrtruaTBCP6hX790ixGywuXqBRKXG+/uN7Ni0HaQqXef2+SyJQvfr0no6AKITQwKuD7V+dyWFBtB93c3fLqx//ZY057PgaN9s2iqVP69sYHAAAAAOBQkM3N4d/bJ6xfcG5SIUJo65f739r4HH4EQnt/OY6HrOr2mTSEEJ1B8wvr4AJiDBkevKkQdxc81JHMStIV3AtrRXjI7vJr6vCQGSZFNZ+AcSyFWlMvbdHZFXQbMDMdArK5OfoSX85/ObfombHxeBRYw7bvjyCEXL2cpqwYiY9ZSqPWGhrouXgKW92svjPMLbjT7/V+qa6XqNQaJsPcH7SFV1eMxartNnU4Md3QMIfLZn749FSs2m4+7r0F7FK56sVv9t7Nr0QIDekb9N0rc1hMRz6fANhBvVS2estBczI6k05b9/Dcob3a3LsYAAAAAA4B2dx8S9bM+nz5Lwihczuv+PbyWvHuPOMXOblE8dfb21IuZLT4AWsztGjXqLV/vrV13uqp7n4uNLO/xTj8wZsK9yJ8BXNJfUOTXCHkkGVnLK1On1FRjUftLr+GcNE/xN3F20mARx0BtiLsxmBm2h9kczPFBhA7Y40QSiqpkKnUXCYsqLW+jV8eQAi5eAqtUnC/de7unt9OplzO1qg0CCEKlRIa5T9uUfyMR0Zz+Nb5/GBunbeXv5uLgCMSy+sapa9+v/+NRycEehNea2AVAh577OBwPGpLN9KaG4pNHtbHqRPPu6E/u0yheumbPel5FQih4XEhX780y7FnLwCwA70evbL9SGWjGB94AIWCvpg/pcdmdAAAAIC0IJsTMnr+kAvzhiTuu44Q2vLl/uP/JsSMjOAIOPWVDWmXsqSNsuBof79e3pcO3sR/0kqmPjrmxolkhNC+X0/s+/WE6RCLw3Txcuo9MHTKI2MGTWqlJabDH7ypAFdnNz63TiLDB9qm16PrBaUTybEAFiGUW12nUGvwqN0V1REua/b1J1xsspGU0ko8BLoLmJl2BtncfL7OwlAP1/yaenygbRqt7mpeMdn2EelORNVNSrmqrY3fzfTnB7v2/n7KNKLX6fPSSvLSSo78nfDmn6v6DAwxHbWMuQvmaTTqC8vGGG7fSC9e8sa/r3y37/zNXLVG2/JAm4sM9qRSmpun28fd/CrDjYGR/i1HiOFxmBqt7s2fDqXmViCERg3o9c3Ls6HaDnqCvbfTbhSU4tHWLBkcNz0Wb1oFAAAAAIeDbE7UW/8+O3pB83XldRWi87uuHvv73LWjd6SNsrC4oE/3vR451IYV4cFT4sYtHoZHEUIIKeWqysKaC3uuvTv7m++f/kuva6Ubu2MfPKZ/YCt95NtHtOuuTaWVkaIk1yhT4KGOWNDPx0ZSu2BZE5gJZqadQTYnZGyfUDzUkUPJmXgIWFVFQXPjOK1GV5xVkXo5+/b5u3lpJXKJWW8mB/46i1XbTVUU1by76Mfi7Ap8gDgC1d4Zo6LYLPp3m87WN8p0ev3l5ILLyQVCPnva8Mj5E+KCfQnvZmMZZyEXD9lYg6S5J5evh1PLEWK4bOaXG05dv7de/tFZQyzuTgNAFyJWKH84cRGPtsaVx311ihUuDgIAAACAdUE2twCdSX/3v9VTVo4+/m9CxvXchpomnpATEOE7bvGwqY+OoTPpgRGE68hmOvTH6Y0f7xGLJDQ6zSfU093Xhc5o/t6hUWuljfLS3Aq5WIEQOrnpQlhc0JznJrf4eYc++AcNCPI9fTcXj7brSl4xHnKcq+R4MFKVGg91xIccXTt0ev2l3OYv0aD7gZlpT5DNiRrfJ/TvRGKXc53LzCNVW7Pup7ywprqs/sg/CXcSMlTK+28gdAYtOj5swfOTh7R29Z6BpFH272f78GhL0ib5Z4+uW5f4YSe7uhMouCOEJgzpPTw2ZO/ZlF2n7lTUNiGEmiSKHSfv7Dx1Z+yg8JceGuPjLsR/xtoY9E79wUTJlWqtVme4ze3cNQvHLmXUiCTGu2/9fOjBrV8B6H723k4XyczaSWZZfByf1alXGQBWRzPZ79pMmntZAwAAug3I5hYbNDl20ORYPIoQQih+ev8T8s1YcPazk2Y/OwkLIoT+Tf8eD7XxG3b+cGTDu9sRQkOmxr3w82OeAa30QNdqtP98sGvX/44ghI5vTHiw4G5A9MHbyIAgPzzUkfya+rzqul6erfztdkaekpw5/ZoxPHK8lpOKKwj1FAJdC8xMe4JsTlRcgK8zl91A5DoMlUZ7JCVrWXwcPgCs5KdXNjfWtdITSaPWJl/MSr6YNXLWgDfWPsG8t4+mqYR9N+RSpeE2nUF79N25I2YN4PE5ZfnVB9efPbfnumGoOLvizK5rk5a2fqWgmQjXEThsxvLpA/f9sOrnNxZMGhph6Iii16NzN3KWv7PpdgaJrt0jRKFqva0ei0k3NrBRmJw5sUCNSEKlUBZN6hcW4GG4+8aPB1QkaOcHgO3o9WjH9RQ82oY5/SPxEACOxiJ+KZJSA2/sAIBuBbJ5F6KUqbZ8sQ8hxHfmvbNpdavVdoQQjU5b/s5cCoWCECrLIXtLhCgfTwGbhUc7ciQlCw85QkpJJaFKje2otYSbwXLIse/fyfQcPAS6EZiZdgPZ3AI0KmVCJOEWav9cvKXVwRosW2m12m7q4qHb7y/9WdfaMrikC/cb/ix6cerC1VN8gjyEbvzIwaFv/rHqkXfmGkf3rW2z7YyZCBfcDSgUFB8T9NnzMw7//NQzC0fwuSyEkFSueuvnQxJZ87mCrqWpjV4/VApFwGu+EqSqo/+p7XNz4v3x/pLXV47//rW5rk5chFB6XuVn60/ixwHQjeTV1BXWmrUNjq+z0N+lU12bALAFJp3YpWAIoSZ5l8yDAADQFsjmXUhRRqlCqkQIhcYGcgTtXc/O4jAN10oz2WRfw0inUcdEEN6+7Ghqlr6V7vT2diyVFHV/hBCb+OZhZLhoT65S77udjkdBNwIz024gm1tmyZDWr/RqR6mo8WBSBh4FdpR8MWvbD0fxKEL5afeXiY+ePdBkBCGElr4yzbhdan56aXUpgf1yH2Rhwd3Iic9+bE78xk+WC/lshFCjRJFwKw8/yKEY93ruqNRtnjitrBPL21693ifI03DjTlZZyxFignxcYsN9EULeboJvXp7DpNMQQicuZ/578Bp+KADdxa1Cc181/i42b0gFgAUs+A5QLb7fPQwAALoByOZdCIXafHGuoUV7OxJ2X9VqtAihoCjCDVvsb2IU4QWGxXUNF3MK8ah9qbXaw6TZPY9FfA2BQt3md2S72X/nrlgBSxm6M5iZdgPZ3DJ9/bz6+nnh0Y6sO38drnu2Kb9Qz6c/W/zr2fe2ZXy3O/fHDdc/e/OPVf1G9TEesPvXE9ImvIFSY13zV3UKhRLQ26flIKJQKPOemWi8e/NsmskgYZ0tuBv4ezlPHtr8V5XVNLQYa8l0m1CpgnCvLgsI761Pr22QqjSt19wvJxfgIRODogMNN45fuitXWOedPSbM551Vza0S1+2+lHCL2C5AAHQV6eVVeKgNXCbZV1eBnsmFy8FDHSmqa8BDAADQlUE270ICI/w4fDZCKOdOwaE/TuPDCCGEVAr14T/P/O+5DYa70x4bazpKTqPCgy04Bf7PpVt4yL7OZuSZ2S7ZDizowlHr6P7USo1mA8HtCkGXAzPTbiCbW8yChuwl9Q3rzjc3BAdWN2be4HUXP5r3zMSw2EAXDyHfmesX6jluwZCv9r266qMFhmPkUqWxJ7uRVNyclPnOXON+8qYGT4wx7pVakG7uOapWWafgjhCSypur5073CtytYjPpHFbz+2luSU3LQZsI8HExrCVXa7QJN1upaytVmi1H2nuvnD02hsWkI4QaJYov/j6ls9KlidNGRD4yawhCSK9HH649llNsj2cDADurl5r7HaOqCRYFAzLyEvKNO3mYKbMC3s8BAN0KZPMuhMVlLn5tpuH2ry9vfLL/m7+9snHn94f3/Hxs2zcH163577253y0Jev6Xl/5VylQIodHzh0xcPrLFryAlDpMxIiwIj3bkal5xWpm5BSZbWH+hva+ZduYp4OOhjpSJmvCQff2deKu8wcGPAdgazEy7gWxusemxEc7c9kqdrdqQeCO3ug6Pgk7zDHB7/bfHGMzWT8MvXD1l8MQYw+2US3hXN72uuaLLvFeaxnAF7KA+vobbZXmd+ghhbsH9nwPXPlt/8lpq0YObfOr0+sOJ6SevNl8rFx8T3GL4AbG9mx/67zsuiu6dW7AdJp0WH9P84eyH/85lFVabjlbUNr383b7S6gbTIMZFwHlsdrzh9skrmS9+vSc9r6LlIaiuUXrySubvOy9i8fY9u2jk2EFhCCG5Uv36D/tFTQ4+TwuA1TXKO7ic2aigtr7J7IMBsBsmnUZ0kbv5V2sCAECXANm8a1n25uyH3ppjWLdVnFl+cN3pDe/t+PPNrf9+uGvfrydunEiWNckRQjwn7qMfL3pn82r858lq/sC+eMgMXx09j4fs5VxmnvnrSe3A11mAhzqSUdHiu7OdldQ3rk+8gUdBtwMz024gm1uMRac/PnIQHu2IRqt7ZfsRqdIevT16lKnLR7ZVbTeYtnKU4UZeSnHLkftorS1vN/ANae4rXllU23KEmPYeoimZQnUoIe1QQhqTQQ/1dwvwcuZzWXq9vq5RlpFfWdsgNRw2b3xssK9ryx/FLZnc/1pqEUIoq6h60et/9+vj7+7MU6o0YqmiWiRZNLHfrDGWfJZqx+Nzh15JKdRodfWNskc/2BIX4Rfk46LR6EqqRGl5lVqtLjLEy92Zl3gnH//Jex6dHZ9XWnvqahZC6EZ68Y30Yhch19/TicNiyJTqipqmukYpQig80OO5xQRWiFAo6KNnpj316fbsoprKOvEbPx787Z1FhvX4AHQPdKq5Z/UUas22a8lPj20+uQUAefi5OJm/HgQhVC2WZFbU9PHxwAcAAKBrgmzetVAolEc+XDh55eiz2y6lJGaWZleIRVKVUs3iMDl8tneQR2CkX//x0fFT+3GFxM4oO9aYiBB/F6dSUSM+0K7bReWHkzNnxt1v6mofaq32fycv4VGH8nUm3JQ5tbRSrdUyaA74fqrR6l7bcUSusk5DV0BmMDPtBrJ5Zzw8vP/Wa8mVjWJ8oF151XVv7Dr+6/LZRK+ZBu0I79fBFW9hMQGGG431llyr4e7rbLgh69wacXML7oaeKgghlVqTWVCVWYCfq6dSKYsn939p2Rgs/qAR/UKfmDd0w76rCCGxTJl4u8Umq8bWNFYUFer94dNTP/3rpEqt0en1dzJL72SWGkeje3l/89LsAwlp7RTcKRT06XMzwgM9/jl4zdDGXdQke3BBugUvIQ6L8d0rcx/7cGtdozQlp/yrv0998NRU/CAAuiwBm4WH2vbbuav9An3jQ5vfHAEgiUgfj9TSSjzarv137r7l03FCBACALgGyeVfkE+K5/J15y/FwF0alUJYOif3uRCI+0JGvjp4fEupvQduKzlh77hrZOgn09nbHQx2RqdRX80pG9Q7GB2zv62MJjm0HBOwGZqbdQDbvDBad/uLE4e/sOYEPdORcZt5nh8++N3O8BQVDYIpKo+q0OoQQ34mLj7VkXE8g62gD+Vaxuc2vFIWsUwVqc09wrZo37Pe3Fy2fPnBAH39vNwGHxaBSKUw6zdWJ27+P/+Nz4rd/9egry8dSqWbNoKfmD//z/aXTRkT6eToxGXQGneYi4IQHekwbERUT7oMfbQ2Th/XZ8fUjy6cP7B3kweey6DSquwt/SN+g95+c8tf7S91d+CEdLcynUNAjs4Yc/N+TrywfO7J/qPFJ4LKZwb6u4waFv/bwuJ/WNPfmJ8TLTfDtK7OZDDpC6Eji3f/abSgPQNfiR2TBgkare3bz/i1Xk6y0UQIA1hHl64WHOrLvdrpYocSjAADQNUE2BySxYFBfC7ZOrZfKX99xVHuvbasd3CkuJ2HHiVAPVx6L8EaIe26l4SHb+zPh+parSXgUdFMwM+0Gsnknze4XGUH8/BBCaNu15A8PWG0/SNsheR8hvpOxjN7BwnO5pPkPod3b/tRAo8J7pLfK2N5dqehUwZ3A55WBUQEDo6x2diuut2/cvWbu5nh8Tvzjczp1PYuvh9OLbS/AHz+k97XNr+LRBwj57KVTByydOgAfaJs5vzm6l0/i3y/iUQC6vkjf5u5XZlKoNZ8fPrf7ZurSIXEz4vrwiX/2AsDqYvwJF9zFCuUfCddfn9LcPA4AALo0yOaAJJw47CWDYzdevo0PdORmYdnnh899MHs8PmADJfUNq/87qNHq8AFHo1Ioff28ruWX4APtOpORW1grCnZ3wQdsZvOVOz+eIlc3HmBTMDPtBrJ5J1EplA9nT3x4/Q4LzuDuvplWJ5F/uWCykEN481Vbk6vUR1KydlxPiQvwfm+WPRKlZYSugqZ6KUIoN7Vk4PhofNhEfnpzUxOOgK3X6yn3Li4QN+B9Slqlubd3afud4jtk7gp3AACwwOBgfwuunMqqrP344Jlhn69dvHbr10cTdt9Mu5xbVFArqpPIJEoVCb/AgO6tj7enG7+Dy9YetPHSLaKNaAAAgJwgmwPyeHpsvGVFn+3Xk785dgGPWltxXcOqf/eKZB0svnOUEWEd9L19kFan/9JeG8/q9PqvjyZ8eeQ8PgC6O5iZ9gHZvPP6BfqsGj0Ej5rnXGbegt+3kOcbol6PbhWWfXzwzJiv//xg/ylS7fLdqrDYQMONU9suG3rLtOX09iuGG011koN/nTPGM2/dbySukLa5nN9Yl+fwOnV2pFPVegAAaJ+Ps6BfgO+d4nJ8wAxanS6trMpaPfJoVAqDRmPS6Sw6TcBmeQh4bnyup4Af7O4S5uka6uHmzO3UmynoxigUNLp3yL7b6fhAu7Q6/YtbD217eqm3kwAfAwCALgWyOSAPZy571ejBlq0z/ffSLbFC+f6s8Uy6TfZavFNcvvq/g6SttiOEJkeH/3DyIh7tSGJ24ZarScuH9sMHrKpOIntn74nE7EJ8APQAMDPtA7K5VTw/bujF7ELLytNloqZlf2xfOCjmpUnDXbiO2bdcr0dpZZXHUrOPpWZVNUnwYRKLGR5+fu91hFBpbuVvb257/utl1JYdYwxO77iSePCW8e4f7+/U6/UzHx+rkCm3/XDUGBeLZHKpksNrZWODsrzm/7kuXgS6MD0ICu4AANt6aGg/y5K6dWl1eq1Oo1BrEEI1Yml+TT12QICr86Bgv8Eh/qPCgy1Yzgy6t/GRvYgW3BFCVU2SRzbs+vOR+UFuzvgYAAB0KZDNAXmsHD5g69XkarElZYI9t9Kyq2q/XzLd38UJH+sElUb7+7mrGxJvanXtrblzuEA35whvj6zKGnygI18dPe8h4E2ODscHrORkes7HB86Q+VwFsCmYmXYD2bzz6DTq14umLvx9i+HxE6XT63feSDmWmrVy+IBl8bGuPDv9dU1yxaXcogvZhYnZhfVSszqrkM3Y+UPWf7TH0J/9yL8JOclFc5+eEDu8t5uPM4VCUciUOcnFxzcnntl51fgjTDZDpVCve3fH+o/36HU6reZ+jtbr9amXs4dMijFGDFQK9d3reYbbgb07tckoFNwBALY1PSZiQ+KNzArCn5/srKS+oaS+Yd/tdBqVMijYf1pMxIzYCAs28AHd0pjeIe58Xq1Eig90pKS+cfHare/PGj8zrg8+BgAAXQdkc0AebAb9/dnjX9hyEB8wT2pp5ayfNq0aPeiJUYMt2IIVo9Xpj6Zkrj1/rbBWhI+R0pIhMZ8cPItHO6LV6V/bceT1qaMfGU5gMzNzpJRW/nAi8XpBc79d0GPBzLQPyOZWEerh+tXCqa9uP2LxPqhihfK3s1f+unB9WkzEzLg+8SEB9NYWa3dSeUPT7aLyO8Xlt4vKcqrqLH60JMETchY8N+m/bw4Z7mbfKfzmmQ0IIQqVQqfT1A9siDp8er/Bk2J+emUzemC7VA6fLZcodvx0bPDEvsYO7wZH/k1Qypv3Su3dj3C3K1Od/YQBAADto1DQF/OnLPtju1KDvwOSk1anv5Zfci2/5PsTiYsHx6wY1t9LyMcPAj0MnUZdOKjvuvPX8AEziBXKN3Yd2349+blxQ4f1CrKgc2I7lBpNeYO4TNQ0IMiXy2zeTh0AAKwOsjkglQmRveb0jzpw5y4+YB6lRvPb2as7rqcuGRKzeHCsh4CHH2GGkvrG42nZu26klooa8bHWCDnsJnmbHWPtZm7/6J9OXW4k/ki0Ov3XRxMuZBW8O3NcqIcrPkyQVqe/kF2w7VryxZxCfKwNfBaTw2TUiAmvfgBdAsxM+4Bsbi2To8PfnD6mk539VRrtgTt3D9y5K2CzRvUOHhTs19fPO8LbnUEj3PdMq9NXNYnLRE1FdQ1ZlTXZVbXZlbUWvKBI7qHXZiQnZqZeyTEN6nX6B6vtbj7OL3y3wsVTWJhRduDPFifzBk/sGzW418YvD6Rfzf3qqfXPf7VM6NY8qa6eSP7ns33GI4dN72+8bQEouPcIWp1OolSJFUqpUiVWqMQKpUShFCtVEoVSrFCKFSqJUilWKCUKlVihFCuUEqUS/xXtOph093JuEZ/N5LOYAjaLx2IK2Kx7N5h8FovPZgpYLP6923wWk0a1/uk7u1FrtZLmZ08lVigNz63hruGZFCuan1uJUmXBe9y7e09+x2Ubn0k+i8lns4zPpOFJbn5W2Swei8ljMq1bwrO6Pj4eH8we/96+k13rlKpYodyQeHPL1aTHRw5aNdoKa6BAl7ZkSOw/F29Z/Nn0dlH5qn/3+rs4TYwKGx4W1NfPy8zWhCqNViST10tldRJ5rURa3SSpEUurmiSVjeKKRnG9VGZ4WR1/5bFAaFzTA0ACAg4E2RyQyjszxl7LL6lsFOMDZquVSH87e3Xd+ev9A31GhgfHhwaEebq1s4JSq9OVNzSllVUll1TeLCy9W16NH9G23l7u259ZNueXzSX1DfiYfbEZ9BXD+v129v4V94RcySue/fOmSdHhiwb1jQ8NpFGJ5QCNVnezsPRcZv6pu7mE/t8x6bQ/HplXI5a+vO0wPga6BZiZdgPZ3FoeHta/XNS08fJtfIA4sUJ5NCXraEoWQohBowW6Ofs48X2chJ5CHpfJZDPobAadSqGotTq1VqvWapUabZNc0SBTNMjkIpmiuklS0SgmeU8zq6DSqJ/uePGbZzZcPpqEj5kI6uP70X/Pu3gKEULPfrE0YkDIvrWni7LKha78cQuGPPzW7LrKhk1fH9Tr9An7blw6fDssLkjgzKssqinJqTT+kphh4X6hnvd/KXGOn6PAMiX1DcYv25J7X7nFhqK5svm7t/GuXKXGf96qFGqNmSs7jDhMhml1ns9i3i/Ks1n3vtI33/ZxEnBsuXJTo9WVihqbSxim5yEUSrHS9DxE81NqccXNTE1yBaH1L1QKhcditji9YfLsmd42PMl+Lk5EP4J03rwB0Rqd7qMDp7tWXkcIKdSa389d3Xs7/csFU+JDA/Bh0GN4Cfkrh/f/68INfICIUlHjv5du/XvpFkLInc/zduK78bksOp1Jp+n1eq1er1RrlRqNTKUynB9tlCts/QYOHAsSEOhaIJsD8hCwWV8umLLq372dLDFodbqbhWU3C8sMdz0FfD8XIY/F4DKZDBpVrtYo1BqZSlXZKKkRS7Q6S6Y+j8X8cdlMNoMe6ePh8II7QuiJUYP33EonVFU0pdPrT6Rln0jLduFyBof49w/yDfN0C3R1cufzTL+y6fVIqdEYlgiUNzRlVtSkl1fdLa+2rOvxZ/Mm9w/0FcnkFArqcu8/wEwwM+0Gsrm1vDFtTL1MfigpAx/oBLVWm1ddl1ddhw8AhBBCbC7rg03PXT2RvOuXExk38nXaFp8BvIPcZz0xbvaqcQzm/XL3+IXx4xfGmxyFfII8JiwaenrHFYSQRq3NvJlvOooQolApT3y0EAsSBQX3Lkmr00354R882qXIVWq5Sm3mhVefzJ20cFBfPGo9mZU1i9duxaNdh06vN1RkKs0763HujScdch3WokExPk7Ct3Yf74p7dFQ2ip/4Z88zY+OfHTcUqkU91pNjhuy5lVYvtc6+SbUSqQVN4UE3AwkIdDmQzQF5xIcGvD9r3EcHzuADnVAtlli2HWs7Ppk7MdjdBSEU4e1xMr3FhfAOwWbQ35g6+tUdR/ABgkQy+cn0HNO/iEGjseg0KpWq0miUGo21anlrpo427IXjwuWEe7pnV9XiR4BuAWamPUE2twoKBX21YKqQzdpyNQkfA7Y0dErc0ClxMrEiJ7mooaZJIVVyhZzgSL+AcG/80DY89enijJv5ZXlV+ABCCKFnPl/SZ2AIHiWoC7f1AAB0OSPDgw688PC8AdHULtiDQKfX/37u6qvbD6u1WnwM9Ax8FvPDORPxKAAA9DCQzQF5LB4c+9jIgXiUTB4bOXBaTIThdh8fj5aDDjM1pveM2OZHZUWGvmdNcoVCbbWa5lNjhpj+Lx5CgjWtwHZgZtoTZHOroFDQuzPHrZ4wDB8AtscVsONGRoyZN3jKipGjZg80v9qOEBK68r47vCZ+ciwWd/Vyev/fZ+Y8OR6LWwAK7gAAu3LmchYO6js+shc+0EWcupv7/H8HLLvkEHQDk6LCFg+OwaMAANDDQDYH5PHalFGTo8PxKDksHhyzZupo491I0hTcEUIfz50U4u6CR0nmydGDX540wjRChiYSwKZgZtoTZHNreW7c0I/mTKDToMTalbh4CD/euvqvK5+8+P2Kh9+c/cznS77Y/fJ/KV+PmDkAP9Qi0FIGAGAPGq3uUm7R8bTssxl5YgWxXXnJ5mJO0Tt7T3y/eEYXXAoArOCt6WNzquruFJfjAwAA0N1BNgckRKVQvl8y/d29Jw9atYtu583pH/Xh7BYXxnk7CZw4bAt2tLYFLpPx24o5K/7aSdqGEqsnDHtu3FAsODjYj0qh6Ky1ShmQD8xMO4BsbguLB8dG+ni+tuMo0Q0OgWMFhHsTWhpvPii4AwBsq7yhaeeN1N0300j7mckCx1Oze3m4PT8e/6QFegI2g75u5dyV63dlVdbgYwAA0E1BNgdkRqNSv1wwVUCmLrpz+0d9Om/ygwWgPj4e1/JL8KiDBLu7bHhswSMbdhHaLtsOaFTqR3MmLBjYyiZeQg47wtsjo6IaHwDdCMxM24FsblMx/t57nl/+4YHTx1Oz8THQ88D1DgAAWympb3h378kpP/zzZ8L17pTRDdaeu5pcUoFHQc8gYLM2PDY/xt8mZ8IBAIBUIJuDLsHQRfe1KaNoVAd/w6VRKW9MG/3FgimtbuXXx5tEXWUQQhHe7v8+vpBU21m78jjrH53fak3ToIv27gCEwMy0Osjm9iFgs35YMuPz+ZNdeRx8DPQwDv44AgDolmQq9XcnEmf8tHHf7XStTocPdws6vf79faccvkkLcBRXHnfTqkXGbdAAAKD7gWwOupwnRg3avGqxn4sQH7AXZy57/aMLHh3R5j6uEWRq427Qx8dj57MPkWQZwcBgvz3Pr2i/cDkk1B8Pge4IZqa1QDa3v3kDoo+98tjK4QO6Sld3GpU6OTp8ftvnk4AFusb/ewBAF3KjoHTWzxv/Tryp0XbPdG6UW12380YqHgU9BotO/37J9I/mTOCzmPgYAAB0cZDNQRfVL9Bn7/MrZsb1wQdsb3J0+L7VD7dfkiPVvqlGHgLe5lWLV40e3OqqfPtgM+hrpo7e+MSiDhc1Dwr2d+DjBPYEM7PzIJs7ioDNemv6mP2rHx7XJ/TB9mLk4SngPzsu/vTrT/y4bGaUryc+DDoBergDAKxp7blrv529YvF2MQwaLcjNOdTD1VPId+dzBWwWk05j0GgWZCiNTqfV6XV6nVytkavUMpW6QSavl8rrJLJSUWO9VGbpY2xh/YUbiwbFMOk0fAD0GIsHx46JCP3yyPlTd3OsMqkAAMDhIJuDLk3AZn2zaNqy+Lhvj19IKrZHk4EgN+f3Zo0fERaEDzygl4cbg0YjzzJMIyad9urkkZOjwz8+cCa9vAoftrHJ0eFvThvj4yzAB1rDZzEjfTzTyuz9IIFDwMzsDMjmDhfq4frbijl51XWbLt85mJSh1GjwIxyEz2JOig6fGdcnPjSASuYTAl0ZFNwBANah0ere2XvicHImPmCGKF/PydHhg4L9Y/y9GDR7JEiFWpNbXZdRUX2zsOxqXnGNWIofYZ6qJsnh5Mz5A6PxAdCTeAn5Py6bmVVZs/bcNSi7AwC6NMjmoNvoH+i79amlJ9Ky/0i4nllhq33OQ9xdVgzrv2BgXzNLPHQaNdTDlbT7rvf189r13EOn7ub+cvpybnUdPmxtNCplfJ9ez4yLj/QhtqwyPjSAVGVNYGswM4mCbE4qvTzdPp478eXJI3ZcTzmYlFFYK8KPsBcvIX9MRMiYiJDhYUEsehcrCMslis8eWzdwfN/4KbF+ocRemw5B9uf35eXrMlNLjXf7xff66q/HTMa7j1uXcz5/ffuAoWHv/bAMH7M978RGpuj+qTaFO6N6eJutD/UmZ78o7daVDEe2f0w79BTLf9ZinXzMPZZWp39959GT6Tn4QLuYdNqcflGPjBgQ6uGKj9kYm0Hv6+fV189r0aAYvR5dLyjZdi3ZslLpgaS7JEzqwP4ivD1+XDazTNR0IOnugTsZJfUN2AEUHaKpEEWLEEJ6CtIxka5zSdhDwIv1944L8IkN8HFgv1oAQLcB2RyPAuuRyw+L6p/Co+3y8DzFYHT2f8qUvr2n9O2dUlq543rKsdQshdo6qwupFMrQXoEPD+s/uncI0aWBkT4epC24G0yKCpsYGXYtv3jXzbTTd3PbX4+/IPbWsyPOYsEX9i7PqPLFgqZ6ebpNi+m9YGDfDtt0tCo+NGBD4k08Cro7QjPTMrabmaavlPKyZww33D0OMZltbvlgMcjmeJQcXLicZ8bGPzM2Pqeq7mR6zqn0nOyqWvwgG3DlcfoF+g4M8hseFhhBso27Cbl5Jv3Wubu3zt398/2dgb19fj37HpPNwA8iE4regilsR4d3XMvPqmxskOZnVlaU1nfjgvtf3x/fs/EinU47fPtjfMz2zH+e66SynKpakUzx/YnEyiZx2scv40eYeHn74dSyqp1PL3Pjc/Gxjmy6fPvLYwnfL54+3Yw9CY+lZp3NzP920TR8gLjOPOae7KMDZ3beSMGj7RobEfr2jLEBrk74gOPcKS5fs/NYeUMTPtAuKoVyZs0qyz6TgW4sq7Lmcm7xlbziO8XlUqWKokd0GUItU66WhXRmf0hg0enB7s4hHq6h7q69vd1j/LzNvL4VAADMBNkcsrntOKrgbkqqVF3NL7mcW3Q5t6iorgEfNoOQwx4RFjQmImRU72AXLgcf7o7ECuWlnKLEnMJLOUXVYgk+TKTg7ingxwZ4x4cGjAgLCnZ3wUYBIKTDmWk++8xMqeSvxsYPsaCNCu6QzbtKNi8TNd0pLk8uqUguqciqrLXWOSQ3PjfC26O3l3uEt3uMv7f9z6DYyK9rthz+J8Fwe+D46M93vtRynHQ6t7jO9mYuiTfc+G/t2f/W4onczuqqm7avT1j25FhXD+vXOAYM63Vsz40R46PwAbsw/3l243HdQgMRQhsSb1Y2ifHhln5cOhMP2cbZzPyqpk5lWSO7PebuZPfNNEIZnU6jvjltzPKh/fABR+sf6LvlqSUr1+8sqW/Ex9qm0+svZBcsGhSDD4CeLcLbI8Lb47GRA/V6VCpq/PnwxZO3s7Fj6BqKjk3R6nRMGp1Jp7EZdBadzmLQnTgsdz7PQ8DzEPDc+TxPIT/IzdnPRQj99QAAtgPZHLJ5t8djMSdE9poQ2QshVNkozq6qLagVFdSIiupE9VKZTKWWKdVSlUqr03OZDB6LyWMx+Symn4uwl4dbL0/XME+3IDcXEm6KaFMCNmtqTO+pMb0RQjViaUZFdWZFTamosbJRUt0kaZApWIxWSgr+Lk48jp+HgO8l5Pu7OoW4u4R7ubnzefhxAFiqw5mp0GhUGo1So6FSKDQqlUmj8VhMPpvlwmV375kJ2bwLZXM/F6Gfi9Cwy7dKo82rqSsVNZU3NJWJmspETTViiUylVqg1CrVartYo1RoKBTFoNMN/XCbDmct24rCduWwXHtfHSWD4bf4uTk4cNv4vdQu5KcXG2yNm9DcZIalWsiNoy7ULWYe2X5uxeIgtCu4Dh4fvvfw+HgVm0Or0V/KLQ927yVm7LqdU1Pjl0fN4tG0MGu3HZTPG9emFD5CDoRn30nXbCZ1evl1U3lWSOrA/CgUFuDohHR5HCNEQ5faHL1J72Fd3AAAJQTZHkM17GG8ngbeTYHTvEHwAtM1DwPMQhGBPmlSCGhtPmkYQQt8unmaLdbsAtKrVmdkzQTZHXTabM+m0SB9PotsG9CiVRfc78MSN6mMyQlJQcCfgzpVcPARaczQ167WdR413r7/7nIDNMhlHCCGdXr/7Vtr26ynF9Q1Spcp0KOPTV4y3qRTKpsu3t99IKWto8hTwh/UKfGXSCOP1m9tvpOy7nZ5dVatQa+okssj3/2f8wbSPX6JRqehea5qLbz19KCljx83U8tZ+DzLjMZv5e8z8u7qTTw+dlavUeLRtn86bRNqMbhDp47l4cMyWq0n4QNtuF5XhIQDMoNHqdHo9FUHBHQDgYJDNEWRzG2Mw+vD5z+l09S3/a0KtnpEGAABAHGRzBNm8+5I0yQ03GEy6b3AXaEYPBXdzadTa5BsFeBS0ZmRY0L+PLxRJ5b+fv5pTVYcPI4QQ+u5E4j+Xbs2K6/PU6MENcsX6CzfKGpremDp6dHiw6WH/XLqVU103JTp8at/eNwpLd91Mzamq3fbUUsNoqLvrokExGp3u44Nngt1dnhg5yPiDVArVeBsh9OqOI6llVVOiw6e19nuQeY8ZmfF7zPy7uo2bhWWJ2YV4tG0LB/Wd3S8Sj5LPYyMHbr2WZP4OF6WiRqVG0+W2+Qb2FOzZSkfIXt5udFqLNysAALA/yOYGkM1tik4PEzq9h0eRTqcT6XT1EvHvMtkOfBAAAIDZIJsbQDbvroyL1AQuPEpXuEbcMVOwMKdqz8aLyTcK6mvFbDYjpLf3xNn9J88Z0PmnjNBv1mp1F06kJhxLzblb1tQoZzBpzq780N7e8WP7TJrd3A+orLhux/qEvMyKorxqjVqLEHpm/i+mv2Tx46Mff3myaeTl5esyU0t3XnhHIOQc2nHt1IHbpUV1SK/39HEeNbnvimfHmx782avbLp5ON94N6uX5x74XTcZx5jxmg6y00nNHklNvFZaX1KsUap6AHRDiMWZqzPRFg+l0mumRVifksONDAhBCe26ltVq8Vmo0W68lR/l6frOweZvTcE+3Fet3VoulvTzdTI/MrKzZ+fRDEd7uhrtPbdqXmFOYVFLRL8AHITQkxH9IiL9So/n44BkPPm/hwL6mP2sqqaSind+DzHjMBu3/HvP/rm5j7bmreKhtLlzO61NG4VFS8nUWxvr7JJdU4ANt0OtRmaip2+xGAmxhyci4LQl3sAtfnpk61PQuAA6RkJ6/JeGO4fa0ARHzhraZTEF3BdncALK5I1CpVDcq1Y1G88ZHAAAAEAHZ3ACyeXfFd+aKqpsQQmqVBh8jJQcU3I/uvvHrZ4d0Oh2NRnXzFDaKpKm3ClNvFV44kfrRzysYTMsfEqHfLKqTfPLy1ozk5qb7TBZdIVOXS+rKi+sYTLqxeN0kklaUirh8dkRf//Q7RQih3tF+LA7T+Hu8/VtZtIgQqipv+OGDvVfPZyKEmCyGSqkuyqvuVVKPHTZiYpSTK69JJC3KrynOq8ZGMWY+ZoRQZmrpy8vXGW6zOUw3L6GoVpJ+pyj9TtHNSzmf/Pqw8UiHqBZLlRqNaXeqPt4eCKGS+gZjxGBa3whjdRshNK5PaGJOYWGtyFgoN5N9fo/5f1f3UFLfcDX//rYVHVo5vL+w62zfMSjYz/ykjhAkddABdyFv08tLfzyUmFFaLVepI/09n5kydHB4AH4cAHZ3/HbWtezmN/PoAK+Wg6D7g2xuCrI5AACArgiyuSnI5t2Sf5i3oeAuaZRpNToanexXilte3bZM0vX8Xz47SKfTVr81a/LcAYal1rev5H733p5bl3PX/+/Es2/OwH/GPIR+s16n//ilLZkpJRwe65HVE0dP7uvqIdBqdZVlopuJ2VH9g4xHRsYFfvv3EwghuUw1b+gnCKFXP50fHNbx19GfPt5fU9m45vOFw8ZFcvksuUyVerPAyRXf/3rc9Lhx0+MQQsf33vzxo/3YqCnzHzNCqE+M/8RZ/XtF+oycGO3h7YQQ0qi1+/67vOF/J65fyEq9WRAzyJE7irjzuHQatbiuwRgprm9ACHk8sD94lE+LxkyG3Zab5ArToDns83vM/7u6h4NJGeZf2MWg0ZbGx+FREiO6XUmTQomHAGgpzMft16fm4lEAHM1YbQc9E2RzU5DNAQAAdEWQzU1BNu+W+o3qk3o5GyGk1+mzbhdEDSH19gMIIXufEPj7xxN6nf7RFyZOX3i/scmAYWFPvT4NIXRk53WphHAN1IDQb048lZaZUkKhUj5f+8jc5cNcPQQIIRqN6hfoNmf5sPAoX+ORFivMqfp6/eMTZvXj8lkIIQ6XOWR0RERff/w4sxF9zK9/vmDeiuGGajtCiM6gLXpsVO++fgihu8klLQ61Ow6TsWhgzI3C0i+PJVzNLz6elv3mnuNsBn3ZA2/6blYqVdvn95j/d3UPCVkFeKhtw3oFGs5PdBW+zkI81C5Cu9MAAABJZJfX1olleBT0JJDNTUE2BwAA0BVBNjcF2bxbGr84nnpv/7Orx5NbDpKRXVe411Q2ZqeVIYTGTovFhmIGBiOENGptZkrpwOFh2GiHiP7mS2fuIoQGjQiP6hdocqw1xY+NCA7veCG8+azymP0C3bPTymSWntWworenj6lqkmy+cnvrtSRnDifW3/vbhdN7e93v1mJAaaX3viXs9nvM/Lu6AbFCmV5ehUfbNjrCkRdVWMCZS+wjiFwNSR0A0PVczSrCQ6AngWyOgWwOAACgy4FsjulMNtfp9ScTM05ezMguqG6UKLRaHX4EQk8sGvbEouGmkfyS2nNXs+/cLS0orRNLFHQ6zVnICQ/2nDg8YuLwPq3WkSpqmhY8/xdC6OiG55wFHFGjbPfxOwnXc6tqm3R6vYcLPybCd+G0/hEheF3Rgn8LWfp3IYREjbJdx+9cuV1QVt2gVGqchZyoMJ9pY6JGDQpr69+yEZ8gj5mPjTm4/hxC6PA/5xc+P1noxscPIhO7FtzzsyoNN5ZP/KblyH2N9RI8ZAaiv7kwpwoh1LdlGxbrCovEl5x3EtHHrJCrEo6l3r6aV1JQ3SiSyWVKlVJj2PfV/EuNbOdmYVlCdv53i6ZPj4nAxwiiUagIIR0Z/iqr/l0kl15WRegpjwvwxkPkxmEy8FC7aFR7XzAEAACddxX6yfRskM0xkM0BAAB0OZDNMRZnc4VSvebr/bfSmj8es1kMrDAt4LH9vJ2CfFs0iP/qj1MHz6SYRjRaXWWNurKmKfFG7pHz6d++MZfBaO7D8aDaeklVbdMbX++vMSlaFleIiitEk0dFmhyIkKX/lmV/F0Lo/LWcz34/LpOrjJGaeknC9ZyE6znxccGfvjyTz2OZHG5zT3y4IPNmfnZSkUys+OLJPz/f+TKZO7nbteBuaOpCoVL8At3wsXvYJvuRmo/obzYcL3Di3h+2Nsv+kHYQeszpd4o+e3WbqE5CoVJCe3tHxgbwhRwWh3HzYk5ZUS1+tCNczivW6vRBbs46vZ7aufNidBrVnc8rrBOpNFrmvW5CjmLFv4vkMitr8FDbKBQU5tnma5OcVBotHmoXl+CHAAAAcDi1VnsrrxSPgp4EsjkGsjkAAIAuB7I5xuJs/tt/FwxV6UXTBqycO8TNhadQqhNv5n2/4UyTRBHg47Ltf49RqXidJ7aP78EzKYG+riMGhkaGerm78qUyVW5xze5jd+oapNeTC3ccvbVizhDsp4wy8ir/3HGpsUk+cUSfuD5+Ah6rTiS9m1uZlFHaLxLvSm3Zv2XZ33X5dv57PxzS6fXuLvyFU/sF+7tx2IzyqsbD59LScyquJRe+/f3Bn95b+OAP2g6Lw/xsx0vvL/sl63ZB0oXMtxf8780/nnDzdsaPIwe7Fty5PBZCiIIof+1/iWLV/yVEfzOHy0L3SthdhfmPWalQf/rK1oZ6aezgkLe+Wmzo9m7wadXWzhTclRpNWlmVRKGSKFUimVyvRweTM/gsJp/F6uXp6sbjIoS0Ol1SSYVUqZIoVVViCULoaGqWO5/HZzOD3Vy8hM1XfCwYEL3rZurCtVsNd5l0mp+zcPGgmEeGD7SgTD09NmLT5dsr/941KjxYq9PVS+UfzZ6AH9Q2Mx+zOaz7d5FZeYMYD7XNjcdj0e36btN5UuX9s7jm4LGsfI4NAABsLbmgQqHS4FHQk0A2x0A2BwAA0OVANsdYls1Vas3hc2kIoYF9A195bJwhyGYxJo3oI1eov/rjZEmF6NKtvFGDm1tVG00eGRnk6xod7mMaHDEwdNKIPivXbJLJVScvZj5YBDf6bsMZVyF34zcrQwJanAjR6fQP1rIt+Lcs+7vkCvVnvx3X6fV9enn9/tESNuveOYwYNGdi7Ge/HT+akH4rrfjkxYypo6NMf9DWhG78bw++/ttb2078dzHlUtZjg96duHjY8Bn9+wwK4Zu3QNlu7PoyM/Q01+l0eVkV1u24QvQ3B4R6lBTUZCR3pcuozX/MqbcKG+qlCKE1ny80rbYjhES1lnTsMSoTNa1Yv9M08ubu44Yb780ctzy+H0KoSaHEjvno4BnDjefHDV09fhhCqLi+4eUdh115nMWDYwQsFkJIqlJdyy/5+vgFGpX68LD+pj9ujlcmjmDRacdTs/9IuM5hMnp7ETtha85jNofV/y4yq24iMJfc+OR64zNHnZTYLoIWn0UHAABHuQIN3Hs8yOYYyOYAAAC6HMjmGMuyeVFZvVKlQQjFx+GdnAfHNkfyimsfLLjTaVSsAm7g6+k0MDog8WZeUVk9PmZCrdZ+9NIMrNqOEHqw2o4s+rcs+7sOn0trEMsRQu88M+V+tf2e51eMPpqQbjjMbgX32nJRfVVjXWVDfVWjm7eTh59rTVm9SqE+uunC0U0XEEJMNoMn5Bg3Vu3QltRv8JBV2bXg7u3nEh7lm3O3fOffie98uwQf7gSiv3nYuMjLZ+5eS8jKzSg3p0CPEGKymp+rxnppyxE7Mf8xy2UqhBCFSnFxb7E0u6y4Liu11DRCVKiHa8anr+DRlly4nA6P+fDA6Vqx7OSrj5u+D2p1utHf/HkiPcdQmF45fMDK4QPu/wxCCKHpMRGt9kZnM+ivThr56qSR+IB5v8ecx2zO7zHn7+o2JEROMrMZdn2rsYrsSmLXgngKCFwJAQAAZHA1q+Oz+KB7g2yOgWwOAACgy4FsjrEsm2vutTVnMfGniHmvK7rUpJu5OTzdBAghtUarVmsfbK1uEB7sGdfHD48S19a/ZdnfdelWHkLIzZkXFuSBDSGEXJy4bs68ugbp3dzmDTXtYEXsm3ioJZVCrVJYvl+u1eFPt609tWb6W6v+vnAilU6nLlk1JqiXJ0KoqUFWWSq6mpBJo1GXP9N8gQNRhH7zuOmxezddKsiufPupfx5/ecrIidECJ45Op6uvkaTdLmwUyeY8NPT+r0YIIUSjUQNCPEoKanb9kxge5cflN+8MoFFr6W28bKzL/MccEu6FENLr9Id3XJ+7vHl1dtK1vJ8+OUCSnUWTSioGB/tjZx1pVCqdSpMolabBrqW7/l2tUqgJdCGweNMSB8qoqMZDbaNSKEFuznjU7vR6lFpUcSO3JK2osqimobZJKleptTo9h8lw5XP83Z2iArwG9vIfEh5AN/usL1FldY0J6fk3c0sLqkU1jRKZUs2gU/lsVrCnSx8/z5FRwUPCA7rifOgeVBrtteziSxmFmWU1JbUNEoVSrdFxWQwPJ36Ip8uAXn6jo0MD3Z3xH+u0nIraLQl3rmUX1zRKmQyav5vTsIigJSPjfF2F+KEIIYTSS6p2JCbfzCutaZRwmAx3Ia9/qO/U/hGDwwPwQy1ChleKkV6P0oorL2cWphdXFVaLRFK5TKmi06hOXLYTl+3tIuwf6jsg1C8myNu6LxydTp9dXnO3tAofAD0MZHNT9szmer1KqbygVJxTq9O12iKdrkmvV1OpXCrVm84IYzHjWexJdHow/mPWo9WWKBWJKtUNjSZPqy3R6SR6vYJCYVGpAhotiM7ozWIOZbHHUqmu+E92T3qV6rZKeVmluqPRFui0VXq9TK/XUalcKtWVRg9mMGJZzKFM1ggKBV/l181otcUK+Sml6opGnavTVep0MgqFQaUKabQgBiOaxR7DYo2lUFr2aqBYuaSg1yvU6lS1Ok2tStNosnU6kU7XpNc36vV6CoVJpQqoVDcaPYhOD2MyBzCZw6jU1j9OdIZanSGVrFcqL+p0lQix6fRAFmsMj/8Ijdb6RxG1Klkq/VepvKLTVVIoXCrNi8kczOHMYbFG4IcSRIZnw0CrrVKprqtVt1XqZJ22Vqdr1OsbEWJSaW40qjuTOZDFnshkxtvlNeL4FywZXimmIJubsjibB/i40GlUjVaXmlW+aFqL1ZZp2eWGG8F+radFnV5/J73kWnJhblFNrUjaJFEolGqFUqO6979Gj9qsxUX2IraHLdF/y7K/KzO/CiFU1yAdvvh7bMiUQqlWKNUPLoEHyP4F95iBwW9+teiHD/adPZJ89kgynU5DFKRRN2+AMH5GnOnBZw4lZd8tkzYppBJFQXYlQig3o/yD1Zt5fDaPz+IJ2CtXT6Td+zJM6DfT6bSPf1nx4Qv/FWRX/vTx/p8+3s9iM1QqjV6nRwgNHB7+YMEdIbTsqbHfvL3r5qWcJWO/dPcUqtWaRpHskdUTFz7aysJqc1w9n5l0LU8qUUolitLCWoRQVXnD+89v4vHZPAGbx2cvfmI0X8A2HGz+Y/YPdh8/I+7skeR1Xx/Zt/myixuvqrxBVCeJjAucsWjw+h9O3Pv3mxF6nq1CyGbn19QrNRrT3mHH0rKrxZKxESEmB3Yx3fXvahWhlvRyFYlOM5pDq9MlZhfi0bb5uQgdu2GvRKHceiFp79W0ivomfAwhiUIpUSiLaxsuZxatP3XdicuePSRq5biBnk6WnPlvS1px5W9HL1/JKsLO62lVOoVKU9skvZlb+l/CbW9nwYqxA5aN6mdayrySVfTM2r0mP4Q2v7w0NriVa+WMimsbZn32DxZ8fMLgl2ZZ+Ib865HLf526hgUPvfeY+QVopVozZM0veLRdz08f/tTkeDxKXEphxcM/bjeN/PHcgqG9A413lWrNxrO3tiUm1Uvw6zHFcqVYrsyvrDuTkvvd/oQh4YHPTRvWL6S966ge9P7WEwev3zXePf7BEz73iukbTl//9ehlna55Wqi12qyymqyymq0X7rw6e/Sy0f2MP4UQ0up03+5P2HYhyRhRabSNMkVeZd3uy6njY3p9sGSSC59z/wcIsucr5cEp+vXK6VMH3L8oSqfT77mSuvn87aIakclRCCGk0eoUKklVgyS7vPZCej5CyNtZsHLcwAXDYtgPrEwxk1iuzC6vzS6rySqvyS6rya2sU7b23ezvMzf+PnMDj7Zt6ci4txeOx6Og64Bsbsoq2VylulVbM8s04ua+g8UaZbyr1yskkrVSyT86Hb5eT6dr0umaNJpshfwoavyIxRohEK5hMgdjh3WOVi4/JJX8rVLdxEcQ0utlWq3MUFaTSf+jUBgs1gS+4HkmcyB+aHeh0zVJpX/LpFu12lauA773f6RQqTgvQT9Tqc5c7mIe/xkajVhxpEtQqe6Ixd8qFQmoZaVGr9dotXLDrJBK/6FSXXm8R/iC5ygUnuEAKqVFC1OL6XQiheKUQn5cqUzQ6+X4MEKo+cHItNoqtbr5UweFwmCxRnN5j7LZBHbwQgg1iF6WyXYa73p5X6fR/A23JeJfmpq+Qci4SaNarU5Xq9Ol0vVC4Qc8/uP34gaaxsaPpJK/jff1epVO16BRZ8mk/7HZU51dvqVS8U4RHbLzs9E+pfKyVLpBIT9p8pwYqbQaiRYVqVS3JJI/8cG2uXvsZzLbbGndFjK8YB3+SmkVZHNTFmdzPpc1eWTk0YT005ezosJ9Fk7tb/jGmpJV9uO/5xFCLk7csUN7Yz+FEErLLv9y3cmC0jpjhEGn8bhMN2euWKaUSDtYfCngNS/nNYcF/5YFf5dOpxdLO94/0kCj0SECf0EPYuHXts4YPSUmMi7wwNarty7nVJbWa7U6L18Xb3+XIaN6j5rc1/TIhBOp1y9kmUYkTXLTyPJnxpsWgs3/zQghTx/nn7c+c/pQUuLJtLzMCqlYweOxnN34kbEBE2a33vpj/Iw4Dpe577/LuRnl1RUNXD4rpLdXYGgrl1eY6Xpi1tFdLb7WKuSqG4nZxrszFg82FtwRkcf82mcLovoHHd9zs7ykrlEk9Qlwnbt82PyVI4rzaxDCC+5En+fOe2T4gG9PXFj6x/apfXsLOSyRVH6rqPxKfpG3kP/suFZOdXQV3fXvahWhtmj1BHuuOdyVvOJGubkJBiEU4o6fELYbvR7tvpzy0+GLYnkrybVVjTLF5vO3d15KWTVpyOMTBnd+Da9Srflu/4Vdl5PNuYSmskH83f6EfVfTvnlkRphP89ePzNKalkeBzsosrTYW3JMLK97adLS8tRIzRq9H17KLr2UXz42PfmvBOA6Rl7mpjLIaQ8H9jxNXfz92BR9GCCGk0mi/2ntOo9M+PLa5jqPT69f8e+RMSm7LA+87m5pXVt+08aUlFjwwMrxSMsuqjQX3/Mq6NzYezanAy21tqWwQf7Pv/L9nb/7w+KyYIALfG/8+fSO5sCKrvKbVcwwAQDY3ZaNsrlanGgvuKtUtUf1zWm1Jy0NapVcqLyprLnK5S52cP6NQuPg4cSrllYaGNzWaNt9mMXq9WqE4rlAcZ7OnODl/RaN54Ud0bXqpdLO46Qudzty3R52uQSL5UyrdxBe8yOc/b7vFs3am1yubGj+SSjdhBcRW6XT1YvH/ZLKtzi4/GyY2heqCH0SQSnVbKt2gkB/W6wnXAfV6tUJxRqE4w2QNdXH+H40ehB9hHrU6zVBwF4t/EDd9hw8jhBDS61WNje/pkZrPf/peTFdf/4xCftT0MFMKxfG62hJ3jwPmv4TJ8GwY6XT1DaJXFYqT+IADOP4F6/BXSjsgm5vqTDZ/+bFxucU12QXVP288v3ZLoocbv0miMFSxBTz2F6/N5nFaXriAUE5h9eqPd6nUGjqNOmdi7LihvcOCPIT85jrel+tOHjqb2vIncBSzT5hY/G8R/bv0er3hq31EiNfrqzo4gcd94DmxkQXPTcJD5OaAgjtCyMPbadWrU1a9OgUfaOmTXx/GQx0x8zcbMJj0aQsGTVswCB9o27BxkcPGReLRln7c8gweasOL78958f05eLRdZj5mGo06c/GQmYvxk8a9+vgcT/kMC1rwPHfS4yMHuvE5O26k/nnhukKt4bGYQW7Oz44dunJYfyfO/RMMXU53/btaRWjj76omiUylJvQ5wLH+uXgLD7VrQBCx5cDWIpYr12w8ciWzCB8wg1Kt+e3o5UsZhd8/NtNd2LzywgINUsVz6/aml1ThA+3Kq6xb8b9t3z46Y1RUCEIos4zARYLAHJmlzU/piTtZ7/53Qq19cEVSe/ZfS88orV77zHw3gbnfD01lllaPj+l1I6dk7fHWq+1G/zt4cXBYQB9/T4TQuuNX26m2G2SV1Xy+6+xny83K8kZkeKUgkxNLVzKLXv3nkExJ+It0daOv1XAfAACMH0lEQVTk8V92frR00oxBHXwUMfov4XaduIt9rQL2BNnclI2yuVqVZrghlx9sEL1AtIgmk21Xq1Pc3LdRqZav8kFI29T4pUSy1pw60YMUihOq6ivOLr+y2RPxsa5Jp2sS1T+tVCbgA2bQ6xXipm+UinMurn92g5MQOp2oru4htSoZH2iXVltVV7vMyekjHn8VjfjybSO9XlJXu0SluoMPEKdSXq2pmeLmvofBiMbHzKBWpbHZU5XKS+Km7/GxlpoaP2exRjAYfRFC4qYf2qm2G6jV6Y0Nbzu7/IQPPIA8z4aBSnVbVP+EVkvsQ74tkOEF69hXSocgm5vqTDbnc1l/fLrs6fe3ZRdU02jUyuomNpsRFuQxrH/I4ukD3Jxb+S7wx/ZLhl4un78668H9VDUEv4W1z+J/i+jfRaNR+VyWRKZUqtSt7tHqEE9+sggPkZtjCu4AzOkXNadfFB7t+rrr3/UgVy4HD7Urqbh8eFhnF1nYx+2i8it5xXi0XSPCHfCnVTdKnvxtd2E13oyCkKSC8kd/3vnXcwuMDUAIkSpUT/62K7vc3FW6puQq9at/H/r1qbnxvQON1WFgLZllNQihC+n5b28+rtU175NDSFZZzRO/7tr00hIhl/D5wszSap1O/8Wecx1e9KDV6X45cum3p+flVtStP3UdH27N4Zt3H58wKNTb3C8tZHilGGSUViOEkgsrXv77oELVSjsXc6g02g+2nQxwd26/5xIAZoJsbspG2VytTkMIKRSnRPWrEbLkta9W362tWeDucYhKdcLHzKDXq0X1qxSKU/gAETpdU33do07On/J4j+FjXY1WW1lXu0ijycMHiFCpbtTVznNz32nsQ9IV6fXiutqFanUGPmAWXWPjBwhR2BxiZ8FNUSh8RCH8MaMtOl1Tfd0Kd4/DNJofPtYRtToVIW1jw7tmnJTSNDV95eb2n0adKRb/jA+2RibbzRc8T6e30onCFHmeDYSQRlNYX7dSp6vHBxBCCFEoTCrVnUp10uvlOl29+avOLUCGF6zDXykdgmxuqpPZ/ONfjmYXVM8aH7PmyYnmXOGalFGKEArwcXmwAo4QqqoV46FO6My/RfTv6h3ieTu9pLhc1CiWOwmITTBgAAV3AIAlQjyIXah1PqugSyR1pUbzwX5i30hdeZwoH8uXS1hGJJE/9fuetmqILAY9Jsjby4nvxOPo9XqRVF5R35RWXNVq4bWktuHptXu3vLpMwGHhY+3S69Gbm462U20P83EL9HDxcuJrdfp6iaxSJL5bWmXs5Y0QUmm0a/498s+Li4trGu7/WJfFoNGemhwvksobJHKRVN4glTdIFQ1SuXFfeHsqqhblVNQ+WG1nMeh9A73chXxXPkev11c3SgprGvIr7zcBNFVQVf/6v0fWPTufavZ1jgaZZdWnU3KMvzYmyDvCzwMhdCWruKyuscWhCF3MKCypbfjp8EXjQxVwWEN7B3o686saJIl3C7BW43o92ns1/fW5o02DbSHDK8WoQSrPqah9498jD1bbhVx2lL+nq4DryueqNNoGqTyjtLqktgE7zECj1b2x8cjuNx/msy18JAAYQTY3sl0212jy1eqMBtELWLWdQmExmP1pVE9Df2ettkKjyddo7veWNKXR5Irqn3Rz345Qx1+SW9KK6p9sp9pOpwfT6b2oVA8qVajTibTaao0ms401rbrGhncRovN49r461op0urq62sVtFe8oFDaTOYBK86ZSXZBep9PVa7WlKlVyq2dKNJrCutql7h5HbbdNpY3pRfXPtVNDpDP60OkhNKo3QjqtrlanLVepUrAu3o2NH1E69+fz+c/VK9u8Ho5G86UzIqhUFyrFCVHoel2jVluuUt3R66X4oQghhLTaqoaGNW5uW/GBjqjVaXL5UeMLkMkcQGdEIYSUigtaLV7sUyrOajSFTU1fGicGlSpksUZTad5abYVScVqvx/rX6WXSbUKnD1sGW0GSZ0OvV9bXLX+w2k6hMDichVzeEgajn+mOoBpNoVJxWiL5s9XW6gghKtWJRg+h04Lo9GAaPZhOC2IwYvGDWkOOFywpXintg2xu1Mlsfudu6flrOVQK5dXHx5tTlUYIKZRqhBCP28pFBnUN0tR7u5JahcX/lgV/14iBvW6nl+j0+n0nkx9d0N06JNsHFNwBAJYIcSfWhO5QUsark0eyGWR/z/n66IX8GvzDZftG9w4hWI3sLJ1O/8bGIwVVrTzOIeEBj08YPDDM/8GNYqRK1fnUvHUnrj5Y3S6qEb29+divT83F4u3bcSk58W4BHkWISqEsGRm3eGRcqBf+ya9RpkhIy1934qqx6tooUzz8v+26DhdCdwVUKuX56cPxKEJShUoklacUVry9+Rg+ZjM6vf6RH3dIlSpjpF+I75OT4weH+bMeeBn+v737jm6jyhoAfmdGM+qW5F7iGid24vTeO0lIARJCSSih96XzsewuZWHpS12W3skSOoEACRBI770nLnHvRb2Npnx/yJFHT7IsyyVK8n6HwxndN3LGY41m5s5795XUNX+15eCXW4NU4d9ZWLFiw75rp7eWWQ9Tvcn25JfrAMCgUb58w8IROa1dq3hBeO7bDV9tRUfjvrp6y+Zjp7zLV04aes/CyarTM91XNZtv+u83SP3xjUdKwkm4R8mRInXda1/ZXH434XNH5F02YcjwnFSKRK99q5vNH/255/sdRwKf2dQarV9tPXTDzNFIPNDrN1/s4YIPL22yOh786CckOH9k/mUTw7oH9kqIaEZZLHrgs7lPT57NhabGi0XR5nvNMKO02nsZ+QQioDcr5zlpt39qt38c2M3W7d5is72r0YRbu9LLYn42aP1lglBqNLcolZfI6Dy0DUSW3e90fGu3fxaYtzKb/iaTZcvlk5D4WYI3ttwetIq9XD5Jo72TYcZL04heomhzOX+1Wl/mOPSyh+NOmYx3xsZ9hsTPCnb7xy7XH2gUAIBUq5erNdfJZP2QBkEwuVy/WS0vS3LQvMl4j3SdzlIoZsrofM5zwhehqAyF8gKFfCbNDCWDl73mXa71NuvrQef+dbs2sOzezs70y/O1ZtNDAECScbFx7zPM2NMtnNn0qN3+iWRdAACL5WmXa513Wa2+Pkb3N9/cmDxX3tR0GZJ6drl+DSfhHiV7w27/MPDTTlEZsXEf0XSQonYyWZZMc5NKfY3Z9LB0KlovveEVleoKJBieqDhgo+RICQ2fzX26eDZvNtoAQBDFtZuOzRyfpwljOtPk+JiaBnN5dYvF5vKVUwcAj4d/5q1fPZ7g1+GRifjfiuD3umTWkBU/7DKaHR99u6NvZsLkUX3RNQBOltanJOikW4JJRfsBhmFYdMpPSSAICEzPtcfsdK3cefD6SZ272utl72zY+cUuNBXYoctHdyI51S3eX7drV1ElElTLmX9dPXfG4CAnQi+1nJk/asDcEXn/XrXp8037kdbNx0pX7Tx6ydgCJN4ek935+uotaBQgVqN6Yfm80f3S0QYAANCpFBeNGThneP/Xf9q6YuM+b1CaFD4nqRWMWsHYXb39a/p2LEWSj10xK8Qft29y3CNLZlwwrP//ffJzYL3vN9dsnzcyv7Ply61ON0kQ/711UUF6Wx8TiiQfWTL9SEXdMf+i/+sOFnkXFo0b9MiSGdKmPnG6f1w28853vpcGK5pMTRZ7h5sUDUcKQpptTzFon776wpF92x3onRan+8dlM+cM63//Rz9ZHC6k9YvNB5ZPHxmYpkcMykhGQ6cFnUc3Sa8dfvoBCXY+wGdznx49m0uy7TK94QWV6kppq5SMztPpn1Yo5xtbbheERqTVavm3SrmYpBKReHvc7i0225toFEAun6Q3vERRwU/WAATDjGCYESr11SbjvR7PYf9W3thye2LSRpJEH6tHP6v1P243evVCEBpD7OsKxVwk7kMQGqXqUqXqYrP5n3bbB0iry/WHw/FlpPnEM0YQWizmZ9EoAEnGG2Lfkssnog0AAECSepXqcqXyIovlWbvtPbQ5UhrN7SbjPSSpU6ouU6mWBk3p+qMUilkKxQyr5WWr9WW0EcBmezs2ttObJwgWADIubgXNDJWEZTr90yy73+M5JAmCy/mzd0GlWqrTPy1tomSZev1zzc1XS4McVybwDeEcvGd8b4ii3Wb9LxIkCG1c/BcyWRYSlyIIud7wqjfXLI1bzE8rFBd2vl95VBywUXWkhIDP5j5dPJuPGZoVp1c3m+zPv/v78+/+7ovTNJVg0Awf2GfZwtHZ6XGSd8CM8f1X/LDb6fI88Ox3N18+IT011s1yRwprVv60p7SyOTczobgcPZtHLOJ/K4LfS6mgn7p3wb3/+sbD8Q+/sGr04Mxxw7PjDWqeF4xmR2lV875jlTX15hUvLccJ9/Z0cJ+GYRgWVKxalZfcucm7/vvn9hpTkPxOlHhz/Y7X1m1Dox0ZkJI4LKNXKylXNpkCS12rFczH91wRIofoQ5Hkw4unXT9zFNoA8J+ftwZWumjP+7/vDkyUMzLqtZsuai/b7iOnZQ8tmnrNtBFoA9YDCAKevWZuOAniUbl9Xr/54sD+707W895vO5FgOC4aM1CabfciCSLoxw8A9GrFAxcH6bc+MT8rSY92ow5Ry8grSo6U9qQYtB/cdVmIbLvP6H7pz11zYWBXnXqTbVtE08BimBQ+m3v11tmcMMS+ESLb7iOXT4iN+ziw/7soOqzW15Bge0TRYzb9HxoFkMunxsataD/b3oamB8TFfx1Y+UEQms3mR5Fg9OO4MlvA3iMIbXzCDyGSdxIyne4pjeYONAxgsTwrik40Gt1s1v9IR114EQQTG/dRezlEH4JQ6HT/1GhuQRsipVReYjC8kZS8X6d7Moz8sg+pjXlQrV6OhgFY99bAMSLhUKku98+2e5Ea7Z1oDAAASNIQtN+6XDGdotCvFI/nGBIJ6ozvDbdrQ2AxGW3M/aGz7T56w4tIr3NBaHI4Vkgj4YiSAzaqjpQQ8Nncq+tnc0EQ50wOctx5PHxNg/nnDUeve/izHQfKpE3LF4/LzUwAgKNFtfc+/e2ld7637L6Pnnnr17Kq5puvmPh/N8+SrtxFEf9bEfxeADCiIP31xy6LN2gAYPfh8v98uuHx135+8o01//ls40/rj9TUmwGgw94/5zO8azAMi9DkflloKCQH6/nL/1a7/MsxRwObm73/y5/f+GM72hCGq8YNQ0M97M0125GS1gDw1LI5/VPjkWAId82bmN8H7WLTZLF/ux3pxRacw+35bkeQNe+/eEr4Ezk+cPHUDlPzWNddMXHonOGB5QKCG5SR/H+LpqFRgB92HUMKoYTjojHBs/xTC3ICC7kAwIJRA4OWRycICOxzXd5oRCKIaDhS2kOR5Bu3LEqL06EN7Zg4ICvoH/FAaQ0awrDOw2dz6K2zuVp9nVJ5ERptB8MM1+meRKMADseXYc5P6HCs5LgyJCiT9YuN+zCwCEN7SDImLn4lRaFPT52O75EOv9HPan0xoLI2GAyvdCanCdqYh2l6EBIU+AaH/X9IMJqJot1u/xyNAsToHg+/9kiM7vEOE45hIghaqVoc+IQpHDG6xwILrQiCKUTF7RBUqsvREAAAKBSzgx41StWSdjpuEwwzBglxfCkSCeqM7w23exMSIQiFWr0MCbaHJBMUygVIMIIDJBoO2Gg7UkLDZ3Po8tl858Gyy+/54PPVe0YPzrx7+bSn7lvw9P0Ln75/4ZP3Lnj4lgsuuWCIjCI9HP/MW79KpyVTK5l3/7X0lism5mYmyBkZQ8uS4rSzJuS99eSV1186Li87iQ524xOZyP6tyH4vr2ED+nzzxo0P3Txr/PDseIOGllG0jEqI1YwanHHzFRNXvnJ9ZtrZN9yt16Ad2TAMw8I0d3D/9zbtRqMhHa9tuPXT79+8+mK1PMg16xmx/kTJkz/+WW9Bey6EIych9uLhnbjm67qqZvPa/SeR4LRBfWcOyUWCocko8q55E+56dxUS/3rboaumDkeCgX47UBhYICUlNuayCWgnuBAIAh64eMqV/w7reheLjJyW3Tp3HBoNafG4QZ+s34OUL3eynjV7T3aqtDcjo4a28/RFTsvy0hIOl9ch8SkF2UjEp19K/Frw++Q3mEMds1FypLTnqqnDc1P8xmx2aOnkYWv3ob8RTrhj3QKfzXvnbE4QCm3MfWg0JJV6qc32FlKGWBQdTucqtfpaaTAYMbAoBADodE8QhBKNhkSSBm3MIybjvUjcank5Nu5jJBi1eK7c6fgRCSoUsxXKeUgwNIKgtTEPtzRfg8Tt9k/VmpuQYNRyOleLohUJUlQflcqvCkpHiBjdY40Nc9Bw7yIIpUq9LPDTznmO0fRAJBgaQTB0O1lUgpDT9CCWbS2H6KNQXIBEfGh6gNP5gzTC87XSlz2hW/aGO2DWVpoZRhBaJBiCXD7J6fhOGuG4Up6vD3x0154oOWDPriMFn827eDY3WZ2PvvqTze6+fN6Ie6+bjjYDAEBirPbdL7c2GW2FZQ35OW2fZ4Wcvu7ScUFnFqVpauPn96JRAABISYjZ9tUDaLQjnf23uvJ7eTG0bNEFQxddEDj6B+sA7uGOYViEBqQkDk0PnlALYXdp1bJ3vyhuaEYbet2+8pobP/r2zhU/RnZGB4C/zZ/Wy0OoVu04GvjY+ebZaA+acEwckJWsRy+dS+tbims7/tP4Km5L3TBzVJgznvsM6JM4LDsVjWLdZ9aQ3FiNCo2GRJJE0Kk4g/7RQ8hJjgvxechKRLtCEAQMzmz3+ySwXLvR5kQiUlFypAQlp2W3zhmLRjsyNCs1RoV2divqqK4OhoUDn81752yuUM4jyU6MsAEAAEqjvQuNSYpHh+B2b+H5SiQol0+WK4LfbIemUl1G0+igJZdrXS8kELuLw/EFAI8ENdp7kEg4FIrpFIVevXBcsXSiyygX9COk0d5JEDQaDYmmBzPMKDTa6+TyyWgIQBA6GAkXSCbrH2IPyGSB9egIhmn36TsZkFwW+N74wuz63uB5tEtE4OEfWtDkfsBsEKFEyQF7dh0p+GzexbP5jv2lNrsbAJbMbfe4Hpib7F2w2Fz+LdHrXP29zgqRfxwxDMMiG7RVVN98+Vufv/HH9jMyhM3NcT8dPLH8g6+vfu/L7SUVaHPYZg3MnZCbiUZ72M970QGhfZPjQkyKGAJJEBMHZKFRgC3HOxjuynL8zkJ0vxEEzBraDwmGY/aw/mgI6z7TO9mh22vGkFySJJDgnpKqwAotIaSHrJcSmMJOjdWp5O3evcRp0ccGgWMspKLhSGnP1IIcjUKORjtCEFCQgd66W53u8GfHwrAQ8NkcjfaA8IoOoxSKCwHQ4eEsu0MUO7gldjpWoSEAleoyNBQuQqlagsZAcDq+RWPRyuHf3xYAZHReiGxpSGTQ5xYu959oKCqJIut2b0ajQCiV89FYGMKvktRzaHowGgIQBBMa6kjoGuWBSVuKSicItEOAD0miQ9kCS4H3hC7uDVH0BG5nYJma0EhSj4YAAuvChxANB+zZeKTgszka7YzGltZPvlbd7oV6dYPZuxBvaPfYjzbn0u9lbLB073/oP9DdZGgAwzAsbBcOzvtg856TdY1oQ0dcHu7N9Tu+3H1o6dihV4weEtfJTrgRsLvZrcXlG0+WrjtWbO18NWpEUozmiYtnotEeVlrfUtOCnhUmDcxCIuEbmJ4UWIo6sNAH4lhlPcuhXU4G9knqbE9qr7H9M9AQ1n1G5/ZBQ2HQqRRDs1L3n6qWBjleOFxeNyrsH5gUkFKXUivQgatpsUFLoLYKnMo18EPoEyVHSnsuHJGHhsKTpNMgEUEU7W53BOl7DEPgs3kvkMsnoKEwkKSeYUay7C5pUBQ9HnY/Ix8vDSLc7g1IhCAYhTLymgZK5UUW85PI1Isu1x9B++BHG44rDuzvr5DPQCLhY+ihDkBr4rHsfiQSnTyeg6KIPrSmmSGdH4EBACCXT0JDvY4kdQAkgCANCmJr/ih8ZMA0p1IEiV7YyGShLmIDi7AHViTvCV3cG6JoQkMAna1DBRDkykQUHWioHVFywJ6NRwo+m3dFUnzrMb55T8mC6WjpfwCobbR8+t1OAEiM02b3ieRjcEacS7/X0oEPoqGuWdv0LhrqVugdLIZhWPgokvjb/GnLP/gabQhPs83xxh/b31q/Y3R2+qyBueNy0nMS0EITERNFqDaZj9U0HKysPVBRe6S63sO3m6HrFJqiXlu2MFbd4xciiF1F6KUnAIzOTUdDYQtaRbqwuoNLtKMV9WgIYEz/CDcjJzlWwchc7BnoT3HOSzFo9erO3iC1GtW3D5JwB4DjVfXhJ9xjtaH+aUVAAj0hoGiMFB1QnYZr/3COkiOlPeFPLIzQKtFbdwCwOnDCHesG+Gze0ygqjSQj3Cdy+Xgk4Q4ArOdQiIQ7z5UHFnthmFGdqsKMoKgUms5Hpl5k2b2i6Ox8Mq63ud1b0BBAiB3YIRkd5NEp5zmKhqKShz2IhgDkzEQ0FB4Z3Z8glKLoRBt6FUkQarTWdueHgFEhE6kEoGdhkkpEIlKBk6yK0DuXu13aG4HPCQBAFPx/WkdEEe33AMG6/LcnSg7Ys/FIwWfzrpg4sm+sTtVidrz4/rrSquYpo/rGx2poGWV3sJV1xl2HytdsPOp0eQDgL9dOJdDBwNHrXP29zgroHS+GYVinjM7us2hEwff7OrhkCYEXxB0lFTtKKgAgVq3MT0nMS47PjNOn6mOSYrR6lUKnVDDBptsWRXCwrM3NWl1ui9PdZLM3WGz1Flut2XqqsaWsydhDw+L+sXD6kD6R1KboouNVDWgIICNBj4bCFqMMkqerM1lFEUKca0sbggwIDSzJHSaSIHKS4o5VBkniY12UmdC58b9SWYlB3lta34kCoNpgny6fwPLuMeogN3g+gQUZhfZvHaPkSAnKoFEG1qMPU+BTCgDwCH5d2DAsYvhs3qNkshw0FLZglaOB44rRkIQnWCJJJguScuoUmSwPSbgDcB7PMaadeSajh4c9jIa69kchySBl03i+BkAE6OSJodcF/fDI6EgKAwIAACmT9fN4DqHh3kUQRPvXBeEiyFCD7YBAz8JBC6dIBH7d9dIpuyt7gyC0BKFCeqPzfOcmaee5KjQEQJEJaKgdUXLAnqVHCj6bR0ytZJ598OKHX1hlsjpXrt6zcvUedA2AGI3ivutnzBzf1fNpbzpXf6+zAnrawDAM66xHF844Ul1XVN+MNnRei925rbh8W3E5EpdRJE1RMpIkCYIXBM77H99Ll61Sf5s/7bJRQWoj9oLACRJJkkiLDXIFGSZNsDQiy/FWpytwekafykYTGgLI7EI2M8WgxQn3npBsiLwnY2awhHtVc7jjkQFAxaAdu0Lr7PohRMmRElRuSqjecxh2ZuGzec8JrP4cPipYmonn0H0r5eEK0VA7fTw7habznQG9MznP8ehPuHPcCTQEFEVFPvKJIIJkZkWRFQRL0NReVOG4UjQEIJNlo6GwUbI+vZBG7AVk+wXZgwpRwP2sRtMFLLtbGgkcZBNasPXJ8FPVUXLAnr1HCj6bR2xwXuqXr9/ww7rDOw6UllY1W20uAFAo6ASDJjs9buzQrBnj89TKbrtn6TXn6u8VMUNiTEb/lPT+EQ47Dh9OuGMY1lUKWvbq0oVL3/nC4nShbd2E48/MKVyKIOCxhTOvGDMEbegttUZ0eKYgiCMfeA0Jdp2T5WLaH5PXZLWjIYD0eD0aClvoWiJYxAyayMf4pwarqN4c7E/fHoYO0vMlhKA9ZSITJUdKUF35o2BYT8Nn854Tfi2FQDJZkDQTL6BPFqWCdkftSv9QLypYpinovxVtuCD9bfnamkw01mWi6ABoN38XJXghSEk0iop8b1BkEhrqHgLHlXFcCc+V8Xy9IDQKgkUU7aLoFEXX6f/cougCcIuiB313BIggz9dDCCwa05N6b2/IFVORhDvHlbHsToYZKw22j3METKfMMMPD/xqMkgP27DlSUPhs3hVateLqi0dfffFotOEsd278Xo+8dzMaaofLwbrs7pYGc/mJmhN7TpmaWutiyWjqX1/eM2xKvv/qPQUn3DEM6wbZ8Yb3r1t840ffdn3Ok+ikljNPXXLB3MH90YbewguC0RbQr6xnsFyo4X4me5BLt8A5MMMXtDI11nVd6TOuktNoCKBTn0Ca6lwCnSTbHdLbKdFzpASllkf+R8GwXoDP5j2EICN/tBy0F63Ah+q6KPBBKmuRhAYNdRIZrAR8YLH46MMJQqjd1Y16Z1bMLhKEILUByYAZQcNHhq7E0kkcV+pyrXW7NrLsfrQQeQ/rfAK9c5c6ETgje0OpXGy1vAT+MyRbzE/HxX9LEEGuDxE224c8j2bMFcp5SKR90XLARvmREho+m2PnpKmLInlgIPDCwS0nP3lm1Ym9pZyH/8eVr//1nZsmLRyBrtcD0KKoGIb5iKKb40o5rlQUO9Gv87w1KC3p/esWx5yLydP+SfFf377szJ7RbS42RNHq7hX6n3G6g/SaUdAdX3+3J2huF+s6ebCS32FS0HRgdfJOFV7srgR6Z0XPkRIUTrhj0Q+fzXtC0HkIw0QQysAqw6IY5OG3D1J/2asrSX8vggySsg/6b0UVQbD1Wu3ss4IoBPmTdWXm26DPhDpPdDl/aWq8qKF+osX8lNu9qdfyyxLRkxs5k3tDJstSKhciQZbdYzLdFzpDDQBO509Wy9NIkKJS1OrrkGB7oueAjdYjJVz4bI5hXiRFDp864JU1f11wwzQA4FjuuVvfP777FLpeD4iekwqGRR2Hc1Vt/YTa+glO51q0DQtmcJ/kr25bmpsY7oDB6EeRxFXjhn1x29Ks+CAlrXsT25lcZ48KnFBeTssCk7PhC5w/EzvjCCLIQxQPh/7pQ+jCJ6JLoudICaobK+dgWM/BZ/MoQwRL8YRKewVNinU91xP0J4RO/UeDoHvj/MYirwlC0aXzdsBsop3l8RxpbJzf0nITywaZze98Ew17IybmkcDj3en4rrHxQqfzh6Alazye4ybjPcaWWwJbY3SPBvsSCy6aDtioO1I6C5/NMcyHIIk7n19aMDYXADiWe+XeT0Qhgt5TndPbxzyGnUVcro1oCOtIRpz+i9uWPvr972sOn0TbzjYjMtMeXTg9LzkBbTgT+N7qtNuhwA2hutaX+Ux1hT7ndbGjd+Dbia48V+kt0XOkYNhZDZ/Nu1sXv5oCn3eG/kIO2trFbYDu+AlnRODeO88F/h279DCY6NrbHY4vzKa/iiKa3AyKJGMIIoYgNSShIrz/kWqCUDrsn6Ornp2iZG9Qsky9/lmj8W4kznlOGFtuJwg5TQ+mqFSCjAGRFQSjx3OY5+uQlb002ruVykvQaCjRc8BG15ESGXw2xzAfgiCuemjB35a8CgAVJ2t3/nZo3Nyh6ErdCifcMaw9otu9GY1hYVAx9EtXzJs3JO9fq/+st9jQ5rNB38S426aNnT8kD204c+SyIF/XsRrVJWML0GiXhR57SMtIpJO7i+1Sn+IoSZDyQlQMX+1GnBD5HYsgiu6AruKdLct+RkTPkYJhZzt8Nu9GgV0+O0MI7PJJhJzdMWirKNi6mO0RxSAfg/A7rp4pQfcGScar1Feg0S4jSR0aikYMgN8HUhS7NPeJGCQvGS6HfYXJ9H9o9DSS1Mvlk2hmBE0PlMmySDK5nTLrXNdTzNEgqvaGUrVEEIxm8+NoA4AousPsfa/W3BwT81c0GlI0HbBRdKR0BT6bY5jPkIl5SrXcaXcDwNaf9+OEO4adGR7PMV5oQqNY2GYO6Ds2J/2dDTs/33nQyXblPrNXjcpKu2HyqKn9c6KtL6+CCfJ1rWBk9yychEZ7mJyWOfzLuHuTsxFXDLe7wurF09M8/LmWcHe60Yx5+IIes0E/hNEm6EaekSMFw84N+GzeLbpS6Dzoe0OnuYlg0/oJXZ6RSBSCZGoC605Em6D7iiCUMTF/R6PnB4JQBExPJYiiK+KZBiIuL+5hD5jNwf8KDDNGo71ToZh+/uQronBvqDU3U7Isk/H+CGYxJck4veElhWI22tCR6Dlgo+dI6Rb4bI5hACCjqfT+KYX7ywDg5L5StLm79epXNhbokPnA60WvotF2vDT0NR0d+jEs1m1cblxPpqs0cuaBOZNvmDzqoy17V+48aHdHRV41qASt+sLBeRcNGzAwNRFtiw5KhlbLGWQfGm1d6mcRGYNGFfjv2t1sxAl3qxPtuHdGWJ3RXoW2s7qyY4M+BYnVBLkFijbRc6Rg2DkDn827ThQsaChsQrA0N0nGoiEJikpGQ92R6xGC/YSg/1ZUIQgVQWiQ7vkRJBDPGSQZF/jri6It4jSiEOnH22T+W7DBH5RO97hacxMaPtdF595QKC5ISt5mNj/psP8PbWsHRaWrNctVqqs66j8eXPQcsNFzpHQXfDbHMACIiW3tKNBY1eLf0v0izI9g2DnP5dqEhrCIGFTK+2dPun3a2LVHCr/bd3RvWTW6xpmTrNNO6pc5b3DemJx0MuqfmycZtKfq/C77nKzHyXqUDDq5ZY+K06qQzQCA2hZrrEaFBMPUlbxwNzLZz7WEe1MXBo1WNpnREEBcTLR3Y/SKkiMFw84x+GzeFTxfj4bCxnNlaAiAJEPlICiqDxoC4DwlcvlUNNoZHFeChgAoKgUNRR+KSuW4QmlEFB2i6CCICC9dzmoUlYDsDQDguSqSiUeCYYrseZLbvc3DHkCjAHrDiyrVlWg0pGB56rNMNO8Np/Nnp2OVNEJRfQA8gmASRQ9BKElSR5I6SpbDMCMZZhTDjAAgpet3VpQcsFFypHQ7fDbHznM81zqu3e3q5m/LQDjhHi0oguqjTEej/iiia5UXsbAJQrOb3YlGsS5QMvSiEQWLRhRUGc0bT5ZuKizdXVrlCigS3Qti1apRWWnj+qaPy8k4u+Y3z02OC8x0n6xuHJadigR7VJ843e6iSiRY1mgsyEhCgmGqMwXpMdf7alqCpJjPajXGyHdsRaMRDQFkxOvRUFSKkiMFw85J+GweGZ6vQkNh4/ggQ55lsmw0JEHTA9AQAMd1dcY8zoPmngBARuejoehD03mBiTOP5yjDjEaC5wOKygDYigQ57hTNDEOCYeL5SBJ2LuePaAhArpjR2fwyAAhCj/dS7GlRuzcslqdt1v9KAjJtzL1a7d09mkeKkgM2So6UHoLP5th5q6Gy9T5RqQ4yY0T36sEvSqxTYuiYRwc+gUZ7Fedyb3W5/mA9xziuVBSsguggCDlJqCkqSSbLoemBcvkEhh5GEO12EqxvnMuyB73LDDMsKWGNf3sH6uone7hi77KcGZuYsMqvOYhu2GYAABA5rszjOcZ6jno8x1jPEeR02Gy8q9l4lzSC6JNaHH4JS55vcLl+d7r/4LhTPN8oilaS0JNUPEMPUyimKRWzOnx639C02O3eDgAG/dMa9Q0A4OEKzZYX3O4touiUUVkq1WKt5jbpnDN2x9c2+4cez3GCkMtkuWrVpRr1cuji5FkR6WPQXTVu2FXjhrk57mBl3ZGqusPV9Ueq66qNPfLMX0HL0gy63MS4ASkJ+SkJ+SkJiVoNutJZYkB64m8H0KvP/adqejmNmJUY5EqorCHyi/uimkgmS5CRQfrOuLkILxMFQaxoMqHRs1xpfYsgiCQZSfeQsoYgCfegf/ooFCVHCoad2/DZvFM4rhiAj+y6i/ME6Vcuk/VFQxI0PRiAAP8J+jye49KXEQj2E8igyf1oQ9NDnM7VSJBld/dy/i5KyOggH56gwxfC5PGcQENhcLO70BCAWn0tGgpD96aYz4jo3Bs22zv+2XbSYHhVqVosifSIKDlgo+RI6Wn4bI6dV2pKG6pPNXiXtYZwM3gRwwl3DABEu/1zs/XfPF+HNogOXnTwQiPrOQLOHwGAJGNUyos06huCXl5r1Mtb2Pu9yyx7gPUcYehB/qu0i2X3+7LtAKBWh36e323bDABG0//Z7CvQaA8QBJPF+rLN/jEy1o8XG3mh0eM5bnespMiEmJh7w8yGezxFAOBmdzc2XembU8vDFZotzzldvyXGf00QKgCxxXiP3fG1t1UU3Sy7j2X3OZ1r4+P+19GjiB4kl8nGZPcZk9066tnJeipazJUtpsoWc63ZarQ7TA6X0eE0O11OlvPwvIfnPbwgiAJFkjKSpCmKpkiaohgZpZHLY5RynVKhVylilAqDSpmq16YZdKn6mFj1WVB1Okxj+gUZBLOrqOL6maPQaE8amB6kJ/ve4gj77hltzhZbkOngOqRVBnkibXOyaCg8RbVNLjbCZH3Ucnu4otqmvLQEtCEMuwIGMQBAQUa0F+r1ipIjBcPOE/hsHg5RdHk8J2l6INoQBrd7CxoCCN3FkiRjabrA4zkiDbLsAUEwkmSEj055vpLjipAgwwwNv8fJGcTIJ6AhALd7i0ZzBxo9D9D0EDQE4Ga3a9FYWAShWRAi6TnBB0tcyuVT0FAYPOxhNHS2icK9wXFlVssz0ohavbwXsu0QNQdslBwpvQafzbHzwUdPfe9bzilo/bT3HJxwP9+JorvZeKfT+TPa0A5BsNjsK+TyqUGT1yrlIpP5n4LQWpnBbv+U0b/gv0q7fBlhACAItUq5UNLop3u3GQBEsbWKU49i2YNNzVfzHZ1oeaHRaPq707UuLvYdkujghO7hCgXR2txysy/b7sOy+8yW5/S6Jy3W/0r3rY/LvdlifVUX8xDacIYoGTovOT4vOR4Avqv65cvKHwGAAoiVrPOvQQ/304YaQ+31XdUvH1a+B1aACr94mG+PWgXpyfEx6iaLXRrccbKiqtncJy6SWYkiMyQzhSJJXvA7ag6U1locrhhVpycR2lHo/0cKm0YhJwlCEP2679VHWp1m+8lyNHRO2FVUGUHCvdnqOF6FlhuW07KB6aFKBkePKDlSol/Q0Q98r5wQsZ52+fVv1zdYAGDSuH5PP7oIbe5J0rM5JuV2b4kg4S4IjR4Pmj4jCHnQTJCUQnEBknAH4FzONSr1Mv9guAI7nAKAXD4dDUUlhhlGUokC39qpzcvt2sRz5ZQsUxo8HzDMSAAZgF8/A9a9RxDMEcxy6XZvRkNhEEVnYKlxkjRENh2l270JDZ1VonNv2G3vIVul0d4pfdlzouSAjYYj5QzCZ3PsHOO0ud7625ebf9zriwye0F/S3iNwwv18ZzT/HclcE4SGlmWTVBwBMkGw8Hwtx1dJB6VSZIJSMUfyjjYEoVCrrrDa3vW+tDu+1+seD6fniyh6HM4ffC9VyoUh3tW92wwASuWFMplfj0hRtFusb/heqpQLaLpA0h6IQQP+3O6tjc3LRdEvASSjMihZH4JQCoLJ4zkpnY3d5Vrf2HhpYsKPoa+0OE+RzfYez9cTBMMwI0Dk3ewe3y9us3+iVi21WF8CAIJgGHo4EKTbvdt33WCzvx+jvVtaeQaLZgQB80bmf7q+7SQBAIIortx04KFFU6XBHqVgZCP6piFl3HlB+PNwySVjQx8mQfweUPojTAQBGqXc4nBJg0cr60URIphiZ82+rla2jU6/Hyi8ZtoINNqRdQeL/B9kAACM7Z9BUx0Pu4kGUXKkRD+tIsiXf8TDRDAMC83lXK3R3IJGO+J0/iy9oPWSy6d0OEJRqVpitb6CBB2OLyJNuAtOx7doDECp6tXHOV1AqJSLbba3/YOCzf6hTvdP/+C5jyCUcvlYt3urf5hzudaqVFf4BzvmdP6EhsISJAtBEJF0fRUEs8u1Ho2eZaJxb7jdG6QvSVJHUanSSE+KigM2Oo4UDMPabPx+NxrqiIflLM22ooPlO3495LS1pQ4YBT3zsnGSFXtEkC937Pzh4Yrt9v/5XjL0YJ3uMYV8PFLMRBTtbnaPy7XB6VrDceVq9dIQV/ka9XKr7T3vvYEo2hyOVWr1VehKAVzuP6T15tTqpZJGPz2xzUrFLKViljTC8w3ShLtSMVelulTS3jk8X9fUcosv204QtEZ9k1ZzI0WlSdbinK4NZsszvvqYrOew0fRIrAG9WZLihUaz5RWaLkiIW0FRyQDgcm9ubFrmTamLItvYfI0ouhhmWHzsxxSVBAAsu6ehabG3w4IgWNzsTkVEwxV71LyUmWPjRlg5m9Vjs3hsn5V/4+T98qqhdfHt0eyyiUNWbNiHdOv+YsuBeaPyC4JVeukhM4fkBs6b+uG63ReNHhi0z2x7miz2LcfL0GjY+qfG7/EvZWN1ug+WdbpU957iqhNVfp1ozhkHy2qPVdYHrQLUHo4XPvpzDxoFmDkkFw1FsSg5UqKcWsHIKJLj/bq0n3uTGWBYlGDZvR7PoQ57pkuJosdmfRONAiiU89BQAJksWy6fhJSjYdk9Lucv4bwd4XB8FVjAnWHGhi4lH1VU6mtttncB/L7xHPaPVcrFNDNUGjwfKJTzAtKIYLP+R6VaEk5NSx+er3e7/kSjYSAImiDUSFckQTBKX4bJZntTFCMc4BglonNv8Hyt9KUosqLoCXFD3b2i5IA940cKhmFSz978HhqK1KV3zo6J06DR7hZk0jns/CHtJ05RyYkJ3ynkkwJPHgShVsin6nWPpyTtSEz40TtLZ3tkshyFfLLvpc3+qaSxXXbHV75lmSxHzoyRNPrpiW3uaS3Ge3yPEwhCnRD/jV73mH+2HQBkSsWspISfFfJJvpDd8YV3ctSQuDjDf73ZdgBQyCerVZf52ni+miDk8bHve7PtAMAwo5SScj0s69cJNEooKHmaMjlfmzs6dtjMpEkM2cEAAkQX3x7NMuL180ehlZE4Xvjrp7/YXG4k3nPmj8yX0+jz2vJG4/c7jyDB0P7z81a3x2+cZqcMzQqSWF+5+QAaCsnD8y98vwGNnkNe/nFzYHf1EL7edqi2xYIENQr5nOE9PuauG0XJkRL9EmLQwWRHyuucLDqwHTuDVny146FHv/5jI5rrxM5GFvNTgd3VQ3A4VvC833NlACDJGOmFXAhabeu8SlJmy1OCgH7JhyYILVbL82gUQKu9Bw1FMZksK7D3jCh6jMY7OrtDzgFK5eLAQbQcd8ph/wIJhma1PCeKEXZqoagEJCKKTq6Ts0p62IN2W7flX86gKNwbSNUUUXTaAgbN9JwoOWCj4UjBMKzbjZ41+Jr/C+tSqotwwv28xnFt1ZMV8skE0fETHjkz2pe6bY9GfZ1vmfUcYgNKTyIEweRyrfO9VIccotVD29xz3O7tLkkpvVj9CyEeJxCEMtbwhrScjsX6mqQ9CIYZStN50ohKOV/6UqmYgyT3FcwE3zLHnZulq89hd82foJajjxAqGk3XvPpldXPr9AkRaLE5vtl2CI22I0aluGjMQDQK8Px3G45WorW/2/P7waIfdx1Do50xPCdIwv3X/Se3nQj3U80Lwt9X/HqyuhFtOIfsLqp86Ydwq3keKqt9OdjKl04YpGR6qU9Td4mGIyX6BQ4HcbKeb7Z1cNbGetOqn/fv2ldaXWtCG7CzkNu91WJ+Eo22g2X3WsxBiieoVFcRhAqNBsPIxykUc5Egz5W3NF8rik4k3h5RtDY3LeV59OQul0+UK6YhwSinjXk48MaB40qbGi/i+bb7i84ShCa7/TM0Gt1IUqdSXY5GAczmRz3sQTTaDqfzJ0ewaaLCRDMj0RCAw/ENGmofz1e1tFx3buQxo3BvyGTo0Ear9dXmpiUOx9ccVySKdqT7ebeLhgM2Go4UDMO6kYyRXXHP3H/+706S6o1kONpFETtv8UK3pZyUytkUleIbhma3f8roX/RfxY/D+b1kShZKHeysFlQ3bnPP8VW0BwCGHqTqaG53ikpSqxbbTl8HuNwbeb7O14E9EEOPQCI0PUj6Ui6fKH0JANLZZni+TtKCnQWS9dqHFk194ovfkfipuuZlL6+8be64S8cPZmTomI/2tNgcuwor1+w7uflYqZKhl0wId6j7LbPH/rjrGNI/3e3h7n7vhxeWzx/Z1+8ZT6DVu489vvJ3pOJHZ03Iz0zSa+pNNmlQFOHhT3959caLOtyGJov9n1+u23T0FNpwzvlsw15RFO9eMDFwXILUnuKqhz7+meV4JK5WMDfMbPcxYdSKkiMlyo3K7RM4gcEbv2wd2TetU5WIsB5SUdXc2NQ9xQGwKGGzvSOCEBPzSGCvSSm3e5ux5TZRZJE4QWg12ruQYAg6/bNswzakQyjL7mpuulJveEUmy5HGA3GeE0bTfUFnbdXpg/R5j3IUlarT/9NkfACJc1xhY8M8bcwDKtVVBIE+qW2PIDS53Vudju9drj9JUqVWX4OuEd002nsdjq+Q/Kwouppblsca3mbk46TxQA7H1ybjA11JucrlUwInBrDbP1SqLqbpwUg8kNu13mi8K7K6K1EoCveGUnVZYDUVt3ub270NCfojCEJNkjEkqZfRAxh6qFw+SUbno2uFIUoO2F47Uu5/88cNB0sA4NYF425dOB5tPu2d1dvf+WkHAEwenP3aXZegzQAAcLSsfu3uE0dK6yobTDanWwRQyekEnTo9UT8oO2VMfkZBFr7Gw84vGp0qd0jGkIl5c6+ZFJvkN3ynR4W698Z6k5E13rTnOjQqcUX6sguSZqPRrqHpthIBLtcml3ujQj5V0h4xSqO+xmx5wfvC7vher3sixCSodskjX4ViaojkMvTgNvcIUbQ7JZ33VZJiLyEo5NN8CXcAcLu3hUjT0wHVMykqAYD0nddpGq2rQJGxvmVRdEhasLPDonGDDpbVfr8Drd9isjuf+3b9h+t2zx2RN6Zf+vCcVE3ApIgtNkdZg7GswVhU07S7qLK4rimypHeiTnPb3HGvrfYrDgsATRb7TW98fcXkoZdPHJqT1PZJ83J7uD3FVe/9vmv/qWpfUKOQR1blgyLJKycPC9wGi8N165vfLpk4ePn0USkGLdIKACV1zWv3nfxswz5p6Qy1nLG70dRG17lYzuZy21xscV0z2gZQb7IV1zarFYxWyajkDBnBfK/hWbFx3/ojJbfOGTttUF+dCs3ylNa3fLX10BebDwR9BHLvwkl6NfqWs0I0HClRbtbQ/v9etQmpIeNiuev/89Xd8yddOn6wgmn3QpHjhXqTVa2Qn6Ufj7PCnv3hjtfBziJ223su56/amPsUijkkqUdaOa7Ybv/EbvsoaIImRvc3kjSg0fZRVJLe8EZL83XIT2PZ3Y0NM9Tqm5SqxTQdZMiax3PY4fjGYf9Y0iemjU7/bIfJ+vCIomgTBKsoWIJ2AeE8JwlCThBaktSG2a8/NJVqKeve43CsROKC0GI2/d1m/Y9SeQkjn8AwY0gyJmCdJo4r4TwlHu44697m8ZzoVIGgaENRyVrtAxbL00hc4BuampaoNdep1ctlsn5Iqyi6Wfc2q/U1lt3lCxKEKoIbCqVyrsWsFwSTNCiKruamK/X6FxT+A3alPOwBq+2/Lucv0v1PEBpR9OuBcXaJwr2hVC5yOL5g3TvQhg6IomjjeRvP13g8x5zwLQAwzEi15mal8iJ03Y5EwwF7xo+UTmky259asW7zIbQ7kZnjzXZXcU3z+gMlANC/T8LKf1zdY7cdZ96Ff32/3mjd8vpdKvlZNkIXC23lsX+joY5QFKnWqShZb/RnD9TufRR2PlApF5jM/wLw9lEVmpqv0aiv12ru6HoBFrXqKov1Fe81uija7Y7vNeqr0ZUAAIDjTrHsft9LtepKSWMQPbfNPcHN7j29qQAA0vrsIdD+vQBYz34VtJtwJ6l4NAQkQSh8p/PABxgE0ZZa6saBh1hvevTymUabc8ORErQBoMFs+3T93k/X7wUAOS3TqRRqBeNiPXa3x+FmkQkSu+K66aO2Hi9Dpi0FAEEUV246sHLTgb7JcZmJhsQYNUESJpuz0WI/XF6HdIpXK5j37rx06UufS4Phu3zikK+2Bqk57uF57zZkJ8XmpSXoVQpaRpnsLpPdeaK6sdGM3oQk6jRv3bb40uc/ReJh+nrroZL6ZpuTtbncVqfb5mJtTrfN5bY6WV4ItcO/2XbIV5+EIEDFMBolo1bItQpGrWA0SrlGzmiU8gWjBuSlocU9O/To5bOe/voPXw69utn82Oe/kSRRkJ6UrNfGalUkSTSa7RWNxsKaJv+3tpk8MPvyiUPR6NkjGo6UaKZXK5ZMGPLZhr1I3MVyL3y/4T8/bx2SlZIer9Mo5LwgshxndbotDlez1dFosbdYHYIoPnP13MBy+Vh32bO/DA1hZye9/gWT6a++rDfPV5iM9wFQDDOUolJJMh4Ikufree5U4NykPgrFLLV6ORrtiEIxS6d73Gx+HImLImuzvWmzvUlR6TTdnyTjSVIvCCZeaOQ8J3i+BlnfR6O5TdXR5bqUKFqt1tdFwSoIFlG0CoJFEK2iYBEEqyjaQqfAjEZpd36KJDUEEXP6/zEEqSGJGILUaLX3E4RSsmYoesPzgtDscv2GNgDwfJ3N9jbY3gYAgpCTpIEgNKLoFEWbKDqCPns4q2m0t7ncf7JB5osS7LYP7bYPZXSeTJZDkclAEALfIggNLLsPuXcgyZi4+O8bGy4I+ogoBILQajS3WyzPInFBMLa03CyT9VMoZ9N0AUnGApCCYBKEFo/nEOvexnFlyFs0mlsoWbbZ9AgSP4tE4d4gCDo29kNjy61u92a0rZNYdi/bstep+Favf5GkEtHmkKLhgD2zR0r4WqyO61/4srqptXAiQUCSQRujUnh4vsXiMNvbtqcgK+kczraX1RvrjXh04LnJkIg+WotyOOEeLSiC6qNMR6MSOrr7P1sUlRajvc1ifcP7UhQ9Vtu7NvtHSsU8tXqZQj4p4ir/FJWoVMx1OFd7X9rtn7aXcJdOl0qSemVArUlEz21zT/CfkpSQBfRGDwrp7sTz7ebCIGBlL4KQ+TpjUkF6QrXtIvH0KV8E8bpd97p4d19N1jOD/+pbAQAKrSWPHnnRu/xw/p0jDH4DG585/vpB0zGGpD8Z8xpJtP3kelfTbuOB4+bCCkeN2WPlRI+CUsTLY/uqMyfGjx6k83uogHUWRZIv37DgiS9+D10G3e3hGsw2iLxgdSgkSbx0/cJrXl1Z0WhC2wAAoKSuuSRYt24fiiSfu+bCwM7F4dMo5P++bv51r33l4Xm0DQAASutbSutb0Kg/OS178br5uSlxcVpVszWSjic/7Dp6uLwOjXaSKILdzdrdLAD6PCA3JS6ChPu4vIz7LpqMFHAXBPFweV2YW9s/Nf755fPQ6FklGo6UKHfz7DEbjpRUNpnQBgAn69lZWLGzEI1jvcPpZA8crkCj2NlJLp8co/tHQAF3nmX3AezzDwZH0wMMsW+i0fCoNTeLwLc3ZSvPV/J8JRpth1pzc4zuMTQakiDYbNb/otFI8IJgBjAHnvA1mtvDT7gDyGLj3jcZH3RI7kECiaI7aKf7cwsVG/t+U+MCjitFWwAAgPOc5Dxo2TEpgqANhjdpeoBMls1xQZ5th6bW3OJyrZV2vfLhuCKbtQiNBqNUXRqjezww73zWicK9QRBqjfYOjq/gu2PSL5fr96amxfEJq0gysLtYCNFwwJ7hIyVMr3yzyZttV8npvyyadOHY/BjJqNYWq2NfUfXWI6V/7CteNMnvdv4cs/NYN3xcMaxb4IR7tIihYx4d+AQa7Xm6mL/yfIvd0da9VBQ9DucPDucPFJWsUi5Wq6+kAwZJhUOjvs6XcGc9h1n2IMMEdpMU7ZLZYFSqSwmi41E/PbfN3Y7j2+pmAIhVNVmSl+EShFDpwtA1QAEAIKxsJgFElir9hLW4ylEjgkhA21Pvk9a2UWlFtlIk4V5urwKALHW6L9ve6G5+t2TFITPaRcvOOeyco9xe9WfD1pGGIff2v5khO/5zY+2hSPKpZXOGZKa8uGoj0m281+jVio/+cvmtb31bXBsqsR6UnJY9c/XcKQU5B0rb7UYXjkEZyf+6as5jK3+LbCeo5PRL1y/0Th2Z3ydx6/EydI2zVovVce30kaIIr6zeFEE5lIL0pDdvWxw47+hZJxqOlGimUylev+mia179MrLKTl23/1DFrr2lh49VNTRazVanx8MrFHScQZOWoh+QlzJiaGbBgNTQ1ZZMZscfG4/v2ldaVtFsMjtABINelZOVMH5M31lTByiVoT7Dl1//dn2DBQAmjev39KOL0GaJx55ZtXFrIQAkJcZ89dFtaDMAAFxz6/sVVS0A8P2KO2MNagAQBHHn3lNr1x0pLW9qarYKIsQa1KnJulHDsyaN69cn1e+JuMPJHjhceaq0sbi0oaS0oara6Buh8sFnmz/4LHgfw7Xf3BvidyTJ1l13sqjut/VH9x2saG6x2R1ujVqRmqIfNij9onnDUsKrZRk9+9mrvsHy56bj+w9XllU0Wawut9ujkNNajSIt1dA3K2HE0IwRwzIVYYwlF0Rx647i7btKjhyvNprsTqdHo1GkJMUMG5wxe0ZBdmanEkPt4oUmjeY2ANFi/lfQrHdoNDM0Lu7zwPkDw6fR3Caj0o3Ge0XRjraFhyDoGN2TEXSxj0oyveFVmhlhMT9xno/1JElDXPx3zc1LOc8JtK0jBCE3GN6UK2YAAE0PiiCNSBDy2LiPGxsWRjwHplp9vU7/LwBCJsumqDTe787rLBNVe0MQmu229+32T5AqN13Ecaeam65OSPwZgELbQjnzB+yZPVLCYXexv+9p7SLx/C0LJg7K8msGiNWqZo3oN2tEv0eWzQx/EqOz0Y7jER5BGNbtcMIdo2INLymVc0zmf3JcW14VAHi+zmp702p7U86M1mhuUikXdKrzuFw+gZb193Ct3/s2x2exAQl3t3ub9FJAo1oqaQyhp7a524lCN3SYFEUnGpIgoIObyXCeYXjlaDJOWIvdAlvnakxRtA33K7S2XRYUW/0e7Js9VpPHAgA56kxfMIbWltpbz3NykslUpycr4hmSMbLmY5ZCJ+8CgL3GQx+Urry977W+d2GRuWzikIkDsl76YdO6g2H1fGlPfp/EyyZE0tkhPkb92b1Ln/32z9A9iBEZ8frnls8rSE8CAJM91Cc8HHNH5KUn6O//YHWdqXPjB/ulxD+/fF7f5Djvy/y0cyrhbrQ7AWD5jJF9U+Ie+/zXTnXeXzJhyP8tmhp6ktWzyxk/UqJZTnLcygeWPfTJzyeqGtC2nrRrX+k7H20sPoX+o3a72253V1Q1b99d8uGKLUsvHXPbDdOQdbwEUVzx5Y6V3+x0OFlpvLbeXFtv3rqz+IPPNt+yfOq82b39J2tstsYa1DV1psef+aGwpF7aVO1kq2uMu/eVOZ2e66+aKG06cqz6kX9+K410nVJJsyz31ocbvv9pn/TBm8nsMJkdx07UfPHdrhuunnTNFe3OzwbRt585Tnjnow3f/bSP4/wG5jucrMPJ1jda9h0s//qHPSolc/uN0y66cJh0HcSho1WvvPn7qbJGadBoshtN9mMna1d+u3PGlAEP3DlbrQ6r70II3s4TGs3ttCzPaLxPEPz+xdDU6mtidP8Mo4NFBxTK+YnMUJPpr27Xn2hbRxhmjN7wgkzWH204m6nV1yoU083mJ13On9G2zqDpQaqwJ2CMQhSVlJCw2mz6e+gexAiZLNsQ+xZND/G+pJnBTucP/quEhSQTEhJ/MRrv7uzHkiA0ev0zStUSX0Qun+RwfClZ5ewTJXvD6fjWbP6HEOw2liBUJKkjCC0EPggXRRHcILoFoSVwwmcfj+eQ3b4igkd3Z/yAPbNHSocq6o0sxwNAvE4dmG2XOrez7U63Z8/JcMdsYVhPO3fupbGuUCpmKxUzHY4frPZ3WfYg0upmd7tbdptlOXrdY0rFHKQ1BI1mudH0d++yw7HKoHsC6ZsjnS6VpgtoukDS2IEe2ubuJQidS/9FpNtOmb6keYW9Wppw9/ZwHxM7bFfLgWJbmbT/e7mjyrvQV9OWcJeTzLzUWeX2ymkJEwbp8mmy7XvGwTv/W/TRHuMhANjYsP3y9IVxjF//PiwCqbExL12/4FRd8/82HVh3sCj8/DVBQF5a4vi8jLnD8/L7tP3FO0slp59aNmfRuEFvrtm+u6iDS5z4GPVVU4ZfPW2E72rP7OiGvioF6Uk//v2673Yc+XT93pqAku6BMhL0V08dcdmEIb7unwCQ3ydBsspZz/dJmDQga/Xfr//ojz1fbztokhRwDEQQMK5/5p3zJgzOTEbbzn5n/EiJZhkJ+s/uvfKbbYdWbjpQEay8TFAUSaoiHQPx4Yotn36xLZyxFzOnBq8R72a5J577cdvOYmmQJAkQwdcx3GhyPP/amuLShr/cMjMwOdBzmpptWrXpjgf/ZzS125t4/OgcJKJWy/Ny2w49XhB8TyPiYzVxscF7N5NUqI4FapX8+dfWrtvQ9kCUllEcz/v2vCCI73+6maapKxeP8a0jFW37WRThsWdWbfXfHooiSZLweHhp0OFk01JCXWP8vv7Y86+u8XBt7yIIkFGULyKK8MfG44XF9a8/v9Q7ZCFivtGKcsWMpOQtNuubdvungmD0XwtByOWTtTH/xzAj0JZIUVSfuLgVrHuHzfamy7UewG+PBUPJFVM0mlvk8qloyzmBotJjY9/juEK77QOn8+fQg0r9ETRdIJdPUaouoelBaOPZhiDUesOrKvVSq+XfbvdWtNkfRSWp1TepNTcTRNv3f1d2AknGxsV95nR8a7O9FWIOAx+C0KpUS7Qx95Kk32WbXD4l4hRz9Djje8NqecFqfRUJ0nSBSn2tXD5JJssCyTDo9giC0eM5yrq32R2fCzz6WN1mfVWtviaCXnFn/IA9s0dKaC62dRCnVtXVJ8ThE0Rxyj3/dbg9BVlJnz2yTNp0sKTm+hdaP4Gv3XXJ5MHZ0tY7X/9u+9FyOS3b+vpd0nux6ibz+gPFewuri6ubWqwO1sOrFUxyrHZgZtLcMXlj8jMkP6PN8fL6HccrTlY2FlY1VtS3jQ6cdHdrFWKp6+aMvnvxJDR6GuvhftpxfOPBksKqJqPVwdCyZINmzICMSyYNzk1t7aEV1Pu/7Hzzh20A8PuLt8TFqAGguLrpm02H9pysqjdaRVGM06n7pcVPKMi6ZOIg6a+Mndtwwh3zoVSqxSrVYpY9aHd84XB+jzzW5rhTTc3XqVSLY/UvS2fdDEGlusxkfto7e6co2u2O7zTqth7Nouh0SB5Qh929Xar7t7l7SQtKEoRSEdHtCk33Un+inNNJ8wpH9di44d7lelej2WMBgJlJk3a1HHDwzhpnfZqyNSNQZm/Nrvre67U47ULpSx8Vpby7/4137v2blbOLIB41F05JGIuuhEUkJznu0ctn/m3J9AOltQdKq49XNlQ1mxvMNrubZT08Q1MqhlErmFiNMjPRkJVoyEmKG56Tpld3tcecz4ictPfvXFLRaNp4tGRfSfWp+pZGi93JemiK0irl6fH6/D4JE/OzxuVl0JTfUyKHu3smNZLTsqWTh10xceiRirp9p6r3n6qpbjZbnC6Lw+3mOCVDx2pUWYmGgelJE/Izh2alBmaFZg/rP/vVSA63FfdF8PXV4+yutu5FagVz1/wJN88es/VE+Y6T5SerGyubTDYX6+F5JUMn6jTZiYYRfftMG5STHq9v+xFhe2rZnKeWdeLR5mUTh1w2sbWzTziGZKUcfPU+NBqRXjtSMuL13bXNXnfNn3DX/AlotPswMmrZlOFLJw/fd6p6/6nqw+V1FU0mi8Nldbo9HE/LKJWcjteqE3TqjHh9dnJcXmr8wPSkyIZBrPx21ycrt/le9kk1zJk5qCA/NS5WI5fLLFZnRWXLwSOV23eXGPTqfn2TJG9t89Ibv/qywKkp+qsvHzd2ZE5crEYEsbHRumN3yYqvdzQ0WgHg2x/36mKUy5f24N5DVFa3vPPRRqPJrpDTc2YNGjMiKy3FoFTQJrOjuLRx555TJ4vq8vqlIO8qyE9997W2yySb3T3/8te8yxfPH37tlaE6obfnz00nTGYHAIwclnnZJaOGDOyjVss5Tigsqf/yu10btpz0rvbBZ1vmzBhk0Kv83gwA0beft+wo8mXbRwzNvHLx6AF5KTFaJQC4Wa6yquVEYe3u/WU79pyKi9WMGOp3cSJ18EjlMy//LAgiACQlxCxdMmbsqJzkJB1JEHYHe+xEzTc/7tmx+xQAVFa3/P1f3//n+WUyWafTQz6iYPMtE4RWG/OwRnuv273e7drk8RzhuHJRtIgiRxAqikqSyXIZ+TiFYrZMltX2I7oPIx8XKx8n8A0u93rWvYPjijiuUhQtoughCAVJxlBUpozuJ2fGyBXTOlltOQiKSklNq0Gj0UQm66/TP6/TP82697Dsbo/nMMeV83ydKNpE0U0QcoJQk6SGJONksr4yWV8Z3Z9hxpBBJkk6uzHM2Lj4rzmu1OX6jXXv5Lginm8QRQdByAhSJ6OyaGaQXD5dLp8SOHxWLp/Stb8yoVQtUaqWsOwet3sry+7iuTJBMAuChSAIglCSZDxFpdP0QEY+Ri6fGnTAh1K1SKlahEbbpze8qje8ikbbp1Zfq5bcyXaIYUZGuk/OwN7wsts/C8i2kzrd42rNTeHk2X1I0iCXT5LLJ6k1t7U0X+U/qxnwfD3LHmSY1pvNzjrjB+wZPVLaFa9rfSpc1Wi2u1i1IsL+EJ1CEkT/9MQDxdUlNc2CKEoLAB4sqfUtHz5ViyTcCyubACAvPcGXeq5ptvzrs3U7jpdLVwMAi8NlcbgKqxpXbT0yZUjO87fMD7zy/GL9gdXb2zoWRGz3iconPv2ttrmt5xbL8cVOd3FN8xd/Hlg6c/h9l07pMFfeaLLHxajf+WnHez/t8KX+AcDRYKpsMJ2oaFg8uZeGA2LRAP2wYhjDDGWYoXrdP12u3232z1zuTdJakw7Hd6Jgi4/7OJyTLklo1arFNvsK70u7/TNpwt3pXCOKrbcfBEGrVIt9TZ3VjdvcvaSndoJg4uM+kjRGnVRlkoKSu3h3xel+6wBw0loCAHo6ZrBuAE3KPAJXZD3lS7h7C7jLSbkv0iE5KR9mGLS5cScANLPhd0zAwkKR5Mi+aSP7pqENvSUjQX/NtJHXTBuJNrSPFwQ01AUkSQzJShmSlXLdDLTpfMPx6I6V07IZg/vOGNwXiZ+HzviRErUIAnp6zxSXNrz70UbvMkkSt14/9fJFo6U3aSlJurzc5AumDxRFaK+H+Mathb/+cdS7PGJo5rOPL/ZV6yaASEqMuXj+8FnTCx569KujJ2oA4OP/bR09IntgHprj7iEffLaFZbkB/VP+9Y9F8XFtPdOTk3T5/VMWzBnCcULgM7+e4M22X3PF+JuunewLymTkwLyUfz5y8Utv/PbjmgMAwLLcb38evWLxaN86XlG4n33Z9ow+sf9+6jJK0sFfzshycxJzcxIXzB3qcnnqGizt7WQ3yz314k/ebPvAvJR//+sKtaotN6FWMaNHZI0ekfXWBxu++G4XABw7UbN23eEFc4f61uksEdBHywQhVyjmKhRzkXivIalEleoKleoKtOH8JWPk4xj5ODR8npHJsjWaW0FzK9rQKxhmFMOMQqPnq17eGzxfZzE/gQR1un+qNTciwfCRZIze8FpD/WRk7grWvTnihPtpZ/iAPbNHSqD0RH2SQVNvtHk4/q0ftz14+TR0jZ4xMDPxQHG1i+WqGs0ZiXpf/OCptucKR0rrfMsA0GJ1NFvsADAws61HRaxWdbyi3rusYGR56Yl9EnRyWtZktu8trPL2Itp06NSzn//5xPLZvnd5zR2Tn5feOsLDxXJvrGodfHDP4sl0wJPygVnBsxYbDpY8/O7P3iFuagUzPDct0aBxsZ7DpXWVDSZBFP+3bl+T2f7sTfPQd/prNNs3rt7+zk87AEApp3NSYpUM3WCy1TRbOF6Y5P/gATvn4YQ7FhxBMErlfKVyvocrtlhecjhX+Zqcrt8cju/DzI9r1Nf5Eu6s5wjrOczQrc/07JLyZ0rF3K4/du6ube5GFNU2uE8QzN6n7pL26EIAkaVOP2EprnBU+4LehHuWOoMiqAxVnxJbWZGtdFpia/81b0mZbHW6dJLVDsUzsd4FF+/2b8EwrNuEU6wDw3rfpyu3+br83H7j9MsvaTebQBDQXh2PFV9u9y5oNYrHH14YdG5MtYr55yMXX3PbB04nK4jiJyu3Pv/EEnSlnsGyXHKS7sWnLtNqgnQ8BICu9JXurGGD06XZdqmbrp38y++HvJXQDx+rCky4R+F+Nluc3oW4WI00245QKOisjHZHf69dd6SxyQoAtIx67OGLpNl2qZuWT1638VhTsw0Avvx+T1cS7hFMlIphGNab7PYPkJnDaLpArblBGomATJZD0wUezxFpkOd7pJf3ee6qWSNe/noTAHz+x36j1XnPpZMT9cGL0XUjX9K8qKpRmnA/VFIDANOH567fX3ykrE4UwfcIvLCqdRaTgVltCXcFI7t61oiTlY0XTSwYk58hLTRvc7of/ejXjQdLAOCn7cduv2hCksHv9xo/MHP8wNYBbVaH25dwv2zaUFWw65ZANc2WRz9c6822L5ky5J5LJ0uHCPyy8/iTn61jPdyvu0+O6t/n0imhBun+uO3on/uLEvWa+5ZMmTmin+z0hYrdxW48WJKT0u6VCdajOA8vo7utFHP42r1OxTAvWpYbF/tWfOwH0sczNsdnklVCoekCOdN2/2a3r/Qu8HyDy73FF1errvQtd10Xt7kbIWU3Wc8B6cso5C3jXu9qcgutqfBC6ykAyFGnA0BfdSYAFNlKvU0egatx1kFAPZkOUUTrl52I7z8xDMPOJ3a7e/P2Iu9yVkbcZRe3m20PoaS00TcT6fzZQ/S6IIVQvBLitbOnD/Qu79h9ylv5pHfccNWk9rLtvezKS8egodN0Mcq+2Yne5foGi39jlO7n5MQY78LREzUnCttGrHfKT2sPehfGjc5JSdL5N7ahZdS40a1Dgiqqmusb0V2ERSGn2/Pn9sJn3vr12oc+XXjL21OWvjLzmtcX3f7u3U99/fbKLYdP4jQfhgUXOBmpSr2sWwaIy2S5SIQXmpEI1nXLZo6YNKi1A/WaXScu+vuHT3zy24GSmh7tgjMgozVpXlzd5AtWNZqaLQ4AWDxpMADYnO6yurZx7ScrTyfcJT3cAeDGeWNfuHXBpEHZyLSuGqX8mRsv1KkVACCIYk/MifrG91u8negvGNn/b1fNRAryzBs74O5FE73L7/68Uzr1S6A/9hUl6DQr/rZszug8X7YdANQKZt7YAfkZrRddWMTKjlVv/nEv5z9tT1CiKK7/dtdDC1+8KO3OBSm3X97/vkev/M+2n/ej6/Uk3MMdC4tSOU+rud5qe8/7kmU78THVqJe72d3eZYfze73unwRBO52rfTM1UVSyQjG17Q3dpCvb3PYEtmvkzHgAyvebulx/yJmx/qtElxx1BgCIIFY6anM1WU7eVemoAYAsdQZ4Z0ath0pHjVtwy0l5tbOWF4XWeAARxBJb2SHziUp7dSPbbPM4nLzTI3Ks4OGE1kldMAzDsPPKwSOV3joeADB/9pDITrYHj7Tda00ch97GIyaN7/fDLwe8ywcOV8yeUeDX3DMoipw6qT8aPRNoGTV6eKjxy/GxGm8dd5sdHXMWnft51rSB363eBwAsy93zyBeXXTxq0YLh7c0oG5Tdwfpmoy0Y0EH1JGk6vrSsKSmhNd2PRSFBEFetO/TRN9ub/UtRcbzgdHvqm617Dld8+v3O3MyE955eJmei8S540e3v1jdb//j0bqUirF6ZGNZdBKGJ48qQINNN960EGfC8VkSrbGE+7/y0w1uQpLNIgnj5jote+WbTF+v3iyKwHP/jtqM/bjuaFq9bOH7gxRMLkgxa9D1dlplsUMlph9tTKEm4HyipAYC4GPXYARmMjGI5/nBpbXZK6xj3oqpGAFDK6azk1kiHlHJ64qDsX3YeB4A6Yzc/1G+22H/f29oX5C+nE+uIxZOH/PeHbU63p9Fk23miwvdgI6gHr5jmK6mPdbsf31//y6ebDAkxs6+aePHNM2Lb6TbBuj3P3PDujl9bO1gAgKXFvnvd4d3rDk9cMOLhd25kwhv90EXReKlxfrJ4LE8dewKN+ruv/4MaWSfuKLoXw4wBaE1ei6JbFD2B04AEpVQuJM2PC0IzAAiCye3epFDMdLh+8q2gVl0O0CPjOyLeZpLw+4oUxAi/1kkyRqGY7HJt8L602T+N0d5NEGfsj9gh6bypuZqsQuspbyf0XG0WAORqsgBAEIUSW/nAmP5lp0u9e/vFS+1q2f95+fe1rtYbWgzDMAwDgOLSRt/yoIF9JC2dUFLadnLpm9VWui2o3NM9uAHgZHFdzyWCpTLT44JWX+l9melxocvX+FoDp9OIzv1ckJ+6dMnYld/sBACXy/PZl9s//2bnuFE5F0wfOGFsbjhZ1KKSel9Ro7c/3PD2hxv8mttnsjjQEBY1nG7PP15evX1/qS9CEGCIURl0KjfL1TdZfX0Ss9Jiw/mc9L6Kmpb65gjvODCsi3jer8q2F0X5dUCOmMC3DpbyIcjovR0+q8ko8qErpi0YN+Cdn3ZsOVzqPdlVN5nfXr39vZ93Xjgm/9aF49LigycoI0MSRF5G4v6iamkPd++MqfkZCTKK7Ncn/mhZ/aFTtRdNaL0wKKxsBIC89ETp/D0dSoltfVrgcLH+LV2160Sl9xIoNy2+T4IebQYAb1n5PgneBwn7CqtDJNxjVIoZwzvoo4BFjPPwG1ftBgBjo+XLV9eMnT2kvYT7K3d/Is22S239ad9zt4iPfnwb0ZlPYGSi8Wrj/MSLfLmjDI3648WOx030HGmpNZI0hJm5BgCCYDTqpRbrG96XDtcahhnpdu/2raDusfmaurDNKoJQiKLL+5JlD0OkDyljtPf6Eu6CYG4xPhQX+5bfGtEkVZmkpBRO3lXtrAOAElsZAMQxhjjGAABpqhRva7GtbGBM/wp7FQAoKUWK0m9s1KrqtSsrVnmXtTL1UH1Bljo9QR6rlqkUpEJOMb/U/rG+YZv0LRiGYdj5wCxJWSYlRNjTylfFm5ZRarXcvxGl17d1rPO9safpYpRo6AzR6SLfkqjdz7ddPzUnM/6tDze0GO0AwPPC1p3FW3cWq1XM9CkDLp43rH/fUEki70SyEXC78fi8KOXx8Hc/+fXRolrvy3iD5rpLx00b2y/2dB0kjheOF9f9uaPwlw1Hr790fNs7o8muQ+VoCMN6iyAELZkV7r1zSKLHU4iEZFQGEsF84nXqhPZrrzeabE1mv0E8gQZkJr1658V1LdYftx39acfxqkYTAPCC8NOOY7/vLXzg8qlLQlYh76wBGUn7i6qrG81Ot0cppwHgYEkNAORnJAHAwMzko2X1vnlTWY4vrTNCQD2ZDvnKs3R7hZyjZa3b1i8t3r/Fj6/Tel1L0IOl1YDMzj1IwDrl5L5S++mLzJTMhIFjWuv+IXasPbj+211oVGLbz/vXf7NzxmU9PusyTrifv0TRbbG+olZdKZNloW0BBMFos73ve4mUJu+QWn2txfomgAAAbtcml3yjr8qKnBkjk+X4rd2+3txmhhnmdrcO5nI4f9DFPERRwae0Dk3OjFUoZrpcf3hfOpyrwEjF6l8kiA7ugQWhxe74Vi4fy9DdeUYMzTtv6nFLUbWzFgDKHJUA0F/b+gcigOiryTpiPnHKVg4Alc5aAMhWZ0hnTK1wVH9R8YN3+cKUGcsyFjEkeq2mpgLGFWIYhmHnAbukbolKyUhaOsHhbO3cJJd3fB1LEgTDyFiWA/9/vUfR/uVHzyClfx3STonm/Tx7RsHUSXlrfj/87Y/7KqpaawHbHexPaw/+tPbgyGGZd9w4PTfHrzeAj93RtnkMIyPJcG+MQ48VwM6gN1Zs9GXbJ4/OfeIv85CSLDKKHJyXOjgv9Y6rJkfP4YnYjRPu2JlDEEGeqgpCPUl2tY6W272V59Gi2zJ6ABLBfC6dPPjWhe0+F3xn9fYwC84kx2pvWTDulgXjdp+s/OLP/RsOlogiuD3cM//7AwC6Mec+MDMRAARRLKltHpSVbHexp2qaASA/PQEACrKSvt4IxTVN3nT8qdpmb3fyoAl3UYSjZXU7j5cXVTfXtlgsdpfNybIc5/bwHq6nnnk3nX4Mv2bXiTW7Tvg3BmF2tHbKDMqg6SDJg3XFoa1tT+8mzB/W1iAhCuJ7j33te0nJyIU3Ti8Ym9tYbfzhvT/qK1ovGj959ofpS8b2dCf3ji+gsR41RDfs/VEfo9Fewlmsr1msrzPMCKViulw+haELCALNhAqC2en6xWx5ieerfUGN6irJKh2TUelKxQynax0AcHyl07nG16RWL21br2O9t81KxQW+hLso2hubrog1vM4wQ/3XAgBREIwkGaoAWZzhP/UNczm+wvvS4fjW7dqk0VyvUMxk6AJJOR2R46s5TzHr2edyb2bZvaLoiY/7tHv6FoQtR51x3FJU7agDgDJ7FQD017Y9OeynyT5iPnHKXgEAQWdM3dq021uFJludsTzrMmku3sfGR9i5DMOwc4mTdy/Z+hAAvDnykUx1Ctoc0j7j8WePfTTckP+3gTegbVgUU0jyvy63RxlRzl2tas0LhNPjWBBEbxYYADrsph2C0+VBQ+e6KN/PckZ2yfzhl8wffvREzdp1R9ZvPmG1td4D7z1QfvM9n/zllpmLFwbpbCF9CPHIffNmTMmXNGJnn2PFdV+v2e9dHjM065n7F1KSeeoQUZttd7o9+46iSUkM6zUUlYaGANyujTJNPzTaGaLIWixPo1Gg5PLJaAzrMaPz0kfnpR8vr//HR2tLa1sA4NVvNs0e1T9GpUBXjYgvdV5c3TQoK/lQSa23lM2g7BQAKMhKBgBBEI+W14/q38dbTwYABmahCfc/9xe//t3migYTEu9pNmfnegnwfKg+9lF7ljk3lB5rrWkMACOmB69euPnHvdWnp+oBgL+9f8vEBa1Xg7OuGH/XjKcaqloAoL6i+djOkoKO5ijqIpxwx0SW3cuyewH+DUDIZBkUmUiQWgJIQXTwfA3HVXh7pvsolfOUygulkXCo1cu9CXcAcDhbe0AThFqlXNi2Urh6Y5vV6mss1jcEweh96eEK6xvnymTZMlkmAYwougXRLPBNvNBAErrUlEP+7/ZDkob4uE8am5f6quPxQqPZ8oLZ8gIARZIxBKEQRbsgOAA6vqftad4EehPbYuccDa4mAMg73cMdAPppswGg3tVo9lia3UYA6OtfwN37FgDIj8kNmm0HgJOWYjSEYVhvuXrHP4ys5Z1Rf++jQq90faqdDbfs/lcMrV45/lm0LTrsN5508K6dzYfRBizAyydX/FG/CwCuzpq3NGOutOndku9+qN4AADOTxtyfd7UvLoK4oWHPhoa9JbYqq8cupxg9rU1QGIbr88bGDU5v/5PToRht291dY7PNoI+kXpv+dJkID8fb7G5NyPRui2T6xK5UerGdTuaeP86W/VyQn1qQn3r3bTM3bS38atWeE4W1ACAI4mtvr0tJ1o0fjQ431kvK7DQbbZIW7Kz0+erWMpUalfzvt88JkW0PjfVwazYe27ynpKS8scXikNOyxDjtqMEZF80cnJMevM7A7sPl9zz1DQA888BF08b243lh7aZjv287WVbVbDQ75HJZSoJu1KD0S+cOT00MUmT2xKn63YfKi8oaisobK2uMvqkFZl77uv+KAABXXzzmjqvazVFGsPFeH3+7490vtwLA6ndvi9OrAaCkomnV7wf3Ha1saLYKohinV+dmJowblrVg+uDwh4NgZx2KSqaoJN6/2LrN9p5KfWXE04+JImsy3uthDyJxheICktQjQaynDchMevf+yxY//rHV4Xa4PZsPlc4f1z3jDDKSDGoFY3ex3mz+0fI6AEgyaJMMGgDITon1th4tqxvVv09RdRMAqBVMZqJB+kM+XLPrjVVbvcs6tWLioKz+fRJT4rQxKoVKTisY+vM/9/2w9aj0Ld3FWwYHAAZmJg3KTvZvDCI77LlesW5XXdKaSScIor16Mqveba0tAQBTF432ZdsBICZWfdVDC1+55xPvy12/H8IJd6w3iRxXzkGo8YxK5YVxhjfRaBiUihkyKsPXy9tLpVxI+E9P2nk9tc0koY2Lfbux6SppEpzjSjmuVLIWAEA7WWU/NJ2flPBrc8tNbrb1ruA03pfTjxLeGVAFUdhnPCyCyJB0ljrd15qryfYu7DMe8fZkR3q4+wrImD0WadxnU+MOPJkqhp1Bqcp4I2updTWHSLi3uM0AkKSIQxuixnBD3trabePju208bASa3eavKn+7ImNOLNPVAde9o8jqdwoOGgEAJ+/+59F3D5uKfBGOc9o5Z7Wz4YDx5HFL6aMFN0tW75ysjLbUz7ETNaFrbbcnL7ftXcWn6ocNDlUKtkTSySU3B/3nKLI1N8fzfs/pA5VXtaChc93ZtZ9pGTVz6oCZUwf88MuBV978zZu6/OyL7YEJ95ysBIJoLQJ7/EQtXIy0Y2cTk9W5YWfrl9UlFwxJiI0wM7j3SMXTb/1a19h27erx8DaH+1Rl0zdr9l8+b8Rd10wNkW4uq2pu6p/y1xd/OFbc2rcGADwcX2RvKCpr+PbXg3+7ffbsSWhu65s1+3/Z2A35oy5uvFeT0RanV3/w9faPvtnuS/0DQFWdqarOdPJU/UUzz+QJF+sFCsWFdvvH0gjPV7a03Bob+04EOXeP54jJeJ/HE/gJJzTau9AY1iviYlSTB+f8svM4AJTWRXi2DUQSRF56wr6iam/C/WRlIwAM6ds6dJUkiIKs5F0nKo6V1wNAa7WZjERpJY+iqqY3f9jmXV46Y/jdiyfJaTRRqVV2T3/8QLHa1u4Fg7KT/7p0hn8jFl1a6kzehcT0WGWwjiAVhbXHdpV4lwmCuPr/0N69E+cPf/W+T0VBBIBTR9v6y/cQ9HOMnT8IQqHV3GZ3rBQEM9oWjIxK18U8rFItDivBHASpVl9j9h9TplZfKX3ZoV7eZoV8SmLCdy3Gv3BcqIR+mCgqMTHhe7vjO4v1NY5r/RYIQSbLUquulDNj0IYelqJM9M6Mutt4AAByNJkU0TYwSkdrE+XxDe6mvcZDAKCWqZIUfh1ncjSZGxq3A8DelsNVjpo+qlRfkwjin/VbPyr7om1tDMN6XbIi/qj5VL2rtYBdUE1stCfcRxgGfD3xBTTau3a3HP2pZvO8lElnRcI9QW4o9E+vC6JQYqvS0Rqzx6+T7yelqw+bihQUszxr4di4wQZG6+BdzW7TEXPJ9ubDF6ZMlK7cWcOHtD3BXbPuyCXzh0sawzViaNuD3q07ikMngrfubBtTNWxw27/u5St+0twSqqfzyeK6XqhLjpCWleQ4XtLSS87S/XzxvGEHj1T+sfE4ABwvrBVEEZm+TK9T9c1OLD7VAAA79pTYHaxaFUlpIywaHDpRLQit2eGFMwb7N4Zr8+7if7zyk4fjAUClZIbmpyXEat2s52hRbVWdSRDFL37e22SyP3nPfPSdpx0/Vb95T8nxkjqCgLzspKw+cbSMqqhpOXSyWhSB9XD/+u/ajJTYfP9HjLMn5ffLSvAuu1nu7ZVbvMt3XDWFDpgwYEBu8H6XXd94r2aj/YM92z74ejsAKOV0Vp84pYJubLHVNpg5XpgwIgd9A3bOUWtutNtXIOOt3a71jQ2ztdoHFcqFBNFxnVNBaHG7tzjsK9zu1s8zQq2+urMzq2HdSH+6wniHz787ZUBm0r6iam8S35twH5rTlgQYnJ2860TF8fIGOJ3oRwq4r919wvucLz8j8cHLpwWtqm0JWTm9K7xV5uH0lmPRzHn6KjE+1eDf0uq3z1uf3ADAiGkD0vuhp06NXpWcEV9b1ggAlUVtz8h7CE64n88ove5xXcxf3exut3s7xxVyXAUv1IuCQwSXKIokqSYJnYzOZegChWKWnBkdWdraR6NeZrG+KIqs96VMli1nxvqv0qHe3mY5MzolaavT+avT9TvrOcDzdYJgIwiGJHUkaZDJshl6EMOEny+g1KrL1KpL3exul2uTm93B87WC0CwIdoJQkKSWotJoWV+GHiJXTKZl/dF39wrfvKn7jIcBIE9SwN0rV5vV4G46YDoCANnqdKRuzKT4MV9XrrZydrfg/uvhZ8bGjkhTJpME2ehuPmg61uhuVlKKRekXflW5WvouKbPHYuXsDs7p4J0O3ungnKzQ+pnZ1bK/ztWglClVlEJFKZWUMl5ukD4P6PrbMeycl6KMB4C609Wfgmp2mwAgSR6LNmAS+40n0FAUy1an7Wo50uQ2xcv13ki5o84tsIP0ffe2HJeuuaFhDwDclLPIl1tnSFpPa/tq0i9OmyZdMwIGvXrU8Kw9+8sA4ERh7Zp1Ry6cNQhdqSOpKfqRwzL3HigHgF9+P7x0ydhYQ/DRco1N1t/WH/MuDx+SkZKEVnVIjNcWldQDwKnyRrPF2V4tlO9/2o+Gep5SSZME4b0Fra0Lq59B9zp793N2pqQrgBjkSnDBnCGvvrUOAOwO9uP/bbnzZtyj7Wx1+GSNdyFOr05PCX77HVpto+XJN9Z4E9aLLhh6x9VT1JK5JX7dfPzZt39jPdy6rSdGDEy/5ILgvbw37y4GgKy02H/eM79fVqIvfryk7sHnvjeaHRwvfPjN9hcevsTXBABjhmaNGZrlXbbZ3b6E+6VzhiGTvranWzbe66f1RzbuKkqI1fzlmqnTxvWXna7MY3eyW/aUZPXB1wPnPpmsr0Zzi82GjgvnuDKj8S7C9Fe5YjItGyCTZROkjiBUAKIoukTRKYpWnqvguHKOK/R4jgO0jZBAMMzIGN2TaBTrRaV1rR1uEg2dHrUQwoCMJACobbFYHK7qJhMADO0rSbjnpABAVaOp2eKoN1ohIOFe3dQ6QGd4blrQbDsAHCiuRkPBSEuoO1ys6nS5mBDGDcwkSUIQxMOltVWNpj4JenQNLGqwbo93Qa0NciUpCuL6b3f6Xl547RRJY5uEtFhvwt12er7cnoMT7uc7gpAr5JMU8kloQ4+QSW961KorJE2d0LvbDACUUjlPqZyHhiNHypmxnX/Y0CYx/js05C8t5SQakpDJstPTatGoRF915nFLkUfgwH/GVK9+mpxtTXu8rd76M1JqmerBvNtfOPmmnXN4BG5L0y5paxxjuLf/TemqtK8rf/JWpAn0wom3im2laBQAAH6s+Q2J/HPQg/naXGmki2/HsHNeiiIeAOqcoXq4N0d9D/czjhP5g+a2oivRr48qcVcLFFkrfAn3Ims5AGSr06QJd07krZwDAHI1aCfl7rJ86QRvwh0AXnrjVwAIkXO3O1iW9QSWel++dMK+g+WiCDa7+4nnfnzhn0sUAfkph5N94rkfnc7WZ67XXDHevx0AYMigPt6u2RwnvPfJpgf/MgddA+CPTcfXrjsDswWQBJGaoq+qMQLAjj0lJrPDV1S910TbfuZ5Ye0fR2ZMzg8x3a7Hw2/Y0noVlJ4WG7SSxoK5Q7/4bnddvRkAvlq1JyZGefXl49u7yec4Yfvukn45ickBDxKwM85XR8XXVbyz3v58s93JAsCM8f0funkW0jpn8gCTxfHaJxsA4MNvts+fXtDehHhateI/j10e5/9QakDf5HuWT3vi9V8AYOehMg/Ht/f2yHTXxgPAhp1FCbGaD5+9GvkV1EpmzuQB0gh2DtPGPOzxHHG7N6ENAKJocznXuGAN2hA2Rj4+Lu5jgpCjDVh3cLg9HSaX9xdV7zzeOthxfEGWX1vXeGdAFQRxy+FSUQQ5LctLb/tO9hVG97ZCQMJdwbSmJVuswROgP+04FuZkqgpGppTTTrcHAIqqmuJ16AVkoES9Zu7ovF92nhAE8V8r/njj7kW+J45YtFGoGIfVBe0M0Tiw+URzrcm7rNGrxs4J/phZcXpco7Pz8wZ1Fk64Y73H4fxOFH0jhcmIE+5YT8vWtA0b73+6aLtPP0mkr38Bd6/8mNyXhj6+pu7P/cYj9a4mXuQ1MlWyMnGkYcgFSVOUlAIA0lWpFY6wHlNjGNa9UpQJAFAXsqRMc2sN97YebYXW8g0Ne4+Yi2ucjazgUcmUGaqkyQkjLkyZKAsYJiKCuKlh3x8Nu7xTbiopRSwTk6VOHR8/ZGzcIDmJZsoogjxsLv62ct1Ja7mDc+kZ7RB9vysz5qQp2/oJej1z7MOtTQd8LzNVKW+OeqSt+TQn716y9SFva5g/GQDW1e/8rW57qa3GwaOXX4N1uc8NvRsAapyNX1X+fspWVW6v5UQeAO7Y+6x0zSXps67PvkgaAYCdzUfW1m4rtJbbOIeGVg2Iyb44bdpgnd/Tvsi2OXyZ6hQAKLJV+ArfeyvMZKvbuiABgIyg1DKlnXOW2qv7aUOVEInYkII+Sy8ds/LbXQDg8fDPvfLL96v3zZo2YEBeql6nlMkoh4OtazCXlDYeOlp54HDl/90zd/b0AuSHDB2UftVl41Z8tQMADh6pvO6OD6++fNzYUTnxcVoAaGq27thz6rMvt9c3tCbjLr1o5MhhQU5Yc2YUfPDZFpblAGD12oNWm2vppWP69U2iKNLl8pwoqv35t8Pr1h8TRTDoVUZT8PvAnjNhbO5X3+8GAIvV9eCjX99+w7QBeSkqJSOKYHe4m1tsRpM9dKWXLoq2/czzwguvrX39nT9GD88aPTyrX25yZp9Yb70aQRDrGy0HDld+9f3uU2Wto8LnzQ5eY4SWUU/9/ZK/PPS5y+0BgPc/3bxuw7ELLxhckJ8Wq1eRFOlwsI1N1vLK5sPHqg4crrTaXG+8sAwn3KOQ5fTdsi5YZ7cONZvsf+4o9C7fvmyyf2Ori2cNefeLrU63p8lo23O4Yvxw9MLY68oFI5FUtdf0sf3/Ra3leMHj4StrjaGnMO2Ubtx4r3uvmx70V8DOHwRBx8Z9bDLe43S2OxY5AgRBazR3aGMewNmnnvPqN5uOldfPGtlvdF5GXnoCkjJutjhWbz/63s87vTW4ZgzPzUqKZEhQezITW+dNXX+gBAAGZiVJNyBWq0qL11U3mTcdKgEArUqO9CIfmJn047ajALDp0KmSmua+qW09fgRRXLXlyAtfrG9buyPD+qZuP1YOAP/5fkt+RqIhjLPDXxZN2n6s3Gh17jpRcdO/v7p3yZRhkh76AOBiuYMlNZsPn7I52SeWz5Y2Yb1JHaPyJtzNTVa0DWDtitaBYgAwbfEY+vSDHIR4ep4SafHGHhJ8CzCsJ9gdbcW7FYqpFIUWVMKixKT4MZPix6DR0/pps78c/zYa9WdgdMsyFi3LWIQ2nPbi0EfR0GlPD34YDXVGF9+OYee81h7ukpIyTx19b0fz4cH6fs8N+Ys34u3hnny6h/tJa/n9+1/yLisoJk6uN7KWo+ZTR82n9rYcf2LQrd4mn1dO/u+P+l0AoKIU8XKD1WOvcNRVOOq2NR38ZOyTcgZNuO9oPvxx6WoAiJfrRUpscpv+rN+9venQy8MfyFD5nSkmxA/R0RqLx+b9gdKmQNXOhj/qd71y8n8Qxk9+rfDz3+p20KRsmL6/WqYqtJbXOBsBIEeTNljXb2BMa5LC4rHVOZtUlCIvJvOo+RQA9NNmKCSPELy710cQhVcK//dn/W4AUFLyeLne5LFubzq0velQ0NR8p7a5U/ooExmSlpZxL7RWxNDqeDl6xzU2btCf9bs/Kf2pr6ZP357p537L9VNtdvfqtQe9L08W152UzDQYphuvmWy2OL0/pLbe/OJ/fgUAb3dmX01nr5lTB9xx43RpxMegV990zeQ3P2i9kduw5eSGLScJAmQU5a3S4DVz6oARQzK8/0RvumLx6LXrDlusLgAoKqm//+9fAoCckXk8vLfUTIxWufqL1sO2h0Thfna5PJu3F23e3jrEhCQJmYzyeDjJRI8AACOHZV528Si/kET/vknPPLb4ied+8O7esormtz7YgK6ERT2Hq3VohUqBnlnCsfdIhbeXXN+M+LQkPdoMAAAKOd0vK/HQyWoA2H+sqr2c9fRx/dEQAADQNBUfq/H2xPc9HugW3bjxAKBVK6aO7YdGsfMPQSgMse8onAss5n/xfCXa3GkypepirfY+mSwHbcG6lQhwrLzeOzEpRZJ9EnQGjVLB0G6OazDaaprNvlNkbmrc369CB8R0EUGAd97UzYdOgX8Bd69B2cnVTeatR8ogYMZUALhwTP5bP24z211Ot+eqp/83a2S/rORYiiRrmi3bj5bVNFvUCubGeWPf+nGb39vaceWM4d6E+4nKhkse+2hEvz7xOrWb5SwOV4PJdsW0YRdPRLtxJBm0/7514T3//cHmdB86VXvDC1/qNcqMRL1STrtYrslsr222eK+7Jg9u91sU6wWp2QmN1S0AUH2qQeAFUvJcp6XevPXn/b6Xs5dN9C0j7Band4EJGLXZ7XDCHeslHs8Jlm29tQYAjeoqSSOGYRjWS2JotYpSOHiXxWOPodWcyB80FVIEedx8ysG7VJQCTtdwTzzdwz1PmzkzaUxfTZ8J8UMT5AYA4ER+VdX6j0p/3N1y9LC5WNpZ+5St+o/6XTQpe7zglmGGPO80DyaPdXfzUbPHpme0vjV9Pi5dPS1x5E05i7ytxyynnj72gYm1flb2898H3ihdc1riqGmJowDg17rtrxeulDYF4kT+lZP/C+cnHzAV/la3gyHpV4Y/kKVO9b73xeOfbGk6EMfobum72Ldmfky2t6u7t0M6ANzX/ypv5/GgPi9f+2f9bhWluDdv2fi4ISRB8qKwpXH/f4q++KZyXYLcsCDVr1ti+NvcWQRB5mj6FJ1OuHsErtxeMzJ2gCiiQzKXZy08YCxsYc337Pv35ITh81MnF+hykOk6uogkiAf/Mmf4kIz3P91cU2dCm/0p28mjkSTx4F/m9Oub9MFnm82nL52RFLBWo7h26YTLL2k36woAVywe7eH4Dz7b7HuvKII0C3zJ/OF33jT9ZHG9L9Jr4mM1zz+x5NFnVjU123xBN8tJVulxUbWfSZJMTtJ5S8H4CILo7TvvQ8uoxReNuHn5FCrkqPCRwzLff/26/7z7x5YdRUiyHtE3OyEurjvL3WLdxVfr3FtAoLOOnX7U1zcjVEUaX7/v+tOFhhEMLctoZwI3AGDo1jtu6Qe+67pr473yc5KQ6YWx85lSuVChmON0fOV0/uB27wDo3EeXIGiaGaVUzFUqLyapLo3Pw8KkZNpSh7wglNcby+uNknYAAIKAheML7r9sSoxKgTR13cDM5H1F1SzHA8DQvuiF8eDslF93n/S2IvVkAECrkr98+0X3vfmjxeFiOf6XnSekrUkGzXM3z89Ni39n9XZv1ju0yYOzb1kw7t2fdgCA1eHeeLBE2mp3+Sou+BneL+3TR5Y+/vGvh0/VAoDJ5jTZWq95pBL0+GLgTMou6HNwy0kAcNpch7YVDpuc72v65o1fudNXg/2HZfYPNuDSy1jfejZUqHq8whVOuGO9xGp/37dMUSlK5RxJI4ZhGNZ7UpTxJbaqeldzDK0+bil18u4pCSM2Ne47aCwcHz9EBNHIWgxMDEO2Xbvfn3e15AeAjKCWpM/a2nSg0FpxwlIqTbgbWQsAGJiY4Ya2ayA9rb0geZzvJSJXm/5A/jW+lO7AmJwrM+a8XfzNQVPrYPmIhfmTdzQdAoAJ8UO92XYAkBHU5RmztzQd2Gs8wYsCRYRK27XH6rF/W/UHAPyl/5UT44d5gxRBTk0cyYn8yydXfFb288ykMUrK72ovzG3uLFEU87SZJyylNc7GVGXCKXs1J/J52ix0PYB4uf6V4Q/8t+irXS1HNjXu29S4L1kRNzt5/PzUSRqZCl27C2ZOHTB9cv62XcV79pcfPV7dbLRbrE5RFBVyOiFem54WO3hg2qRx/VJT9Og7JS6eN2zWtIHr1h/dvvvUqbJGk9lBkIRep8rJShg7MnvWtIEadccX01dfPm7m1AGr1xw8cLiiqsZod7iVCiY+TjN8SMacGQX5/VMAICujbYBzbxqYn/rp2zetXXd4266SU2WNVpsLADRqRaxBlZ2ZUJCPdiLrIVGyn2UycuUHt+w7UL73QHnRqfraOrPJ7HC7OV4QlApar1dnZ8QPHZw+Y3J+fHj58aTEmH/9Y1F5ZfPGrYUHDldUVRvNVqfHwysUdHysJqNPbMGAtNEjsnKzccIoSmlO3y3bHcFzKKG1mOzehd+2HP9ty3H/xiDa66JuiFH2fra6uzbeS9/OVMbYeYsgGJX6apX6akFodLt3cJ4THu4Ez5UJglUUbaJoF0WeIGQAcpLUkqSBopIpKl0my6WZApoeQhD4E9Wr7r9syowRuTuPlR8rr69usjSZ7S7Ww/GCUk7HqBV9U+KG5qbOHZ2XFq9D39lNBmS2nSiHBPRwH3y6jDsES7gDwPB+ad88ce3nf+zferS0qtHM8UKMSpGRpJ8yOGfJ1CFqBQMAfdPiiqraRuiGcNvC8eMGZn6z8dDBkppGs10URY2SSdBp+vWJD9w2n6wkwycPX7nzeMWf+4v3F1U1mu1Wp1tOy2K1qqxkw7DctKlDcnLT/EayYr1szAWDV73zh3f5/ce/efHHB5UaBQDs23Dsx/dbh1ECwKLbL/AtI1wOd11F66coLlnv19YDcMId6w0cd8rh+Mr3Uqu5EX/2MAzzunrqiKunjkCjWGcMyUo5+Op9aLR9KYr4EltVo9vYT5vhnTBzcZ8Zmxv37zEeGx8/xMhaOZGXFnBvT6oysdBaYef87uFztekKimlwtbxW+PnSjLm+bvIhzE4eh3Sg7qdJBwA752QFjzTv31lh/uQm1gT+NevhdEUdQRSMrMU30Win7DEeZwWPRqaadDrb7jM1ceRbxV/bOMcB40lfUXWvMLc5AvkxWT9UQ5G1IlWZUGgtB4ABp0vlIOLl+scH3VJorVhTu3Vz4746V/OnZT99Xfn79dkXz0+dhK7dBSRJTBrXb9K4LtUxUKuYi+cPv3j+cLShM1KSdLdcNwWNSmg1io0//x8a9ffZOzehoe6gVjGXXjTy0otGog3t++qj29BQO5782yVoqB1Rsp9Jghg1PGvU8Cy0oQsy0+OuvXL8tVeORxsiwjAjU9Nq0CjWM+INrU9Wyqpb/FvCYutkmp4X0CFBXvKO5irsCd218V4h5lPFznMkmaBULgTlQrQB61Yv34GWGQzq1oXjb10Y/Gw1rG8qUnm8N104Jv/CMW1dbRCDc1L2vdPBrUq8Tn334kl3L273OvPLR69BQ+2LeG+MHZAxdkAGGu3ITfPG3jRvLBrFutvQSflxKXrvzKjFhypuGv/Y8CkDjI2WfRuOiacHUKb1TZra/pjLU0eqfDXckzN7/PEJTnpiPU4UXc3GO0WxdaQnRSVp1Df4r4JhGIb1Hu+8qY1uIwDsNR5LkBv6aTOy1Cl7Wo4BQJO3nozcL/vs4tlNjXv3G09WOuotnM3JuVnB4501VAS/0Z06WnNv/6u8JdF/r9s5RN9vWuLIyQkjkH7cUr5+5T7e2ZUBgA8oeNIpYf5kHa0BABPrN/1OC2sBAAIItSzCXloV9loAyFAlkwEd5GUEla5KLrSWl9qrkYR7mNscgTxtJgAU2SqmJo4sslaQBNlPm1EsqeqO6K/N6K/NuD13yYaGvd9WrqtyNrxZ/JVbYBf3mYGuimEYdibk5bT2lKyqM1rtLq269dsyTIrTifL8vkkFuWgNhECZaR0/Qu41Z/XGYxiGYVhnUTLymv+76NX7PvW+bK41rftyu/8qcPOTS6S13RH7NhzzLWfkdXzq7CKccMd6Fus5bDT9lWUP+CK6mH/gIWYYhmFnUIoyHgCMrNXEWkttNd5iL8MMed9XrS+31zazJpDMmAqSMuIEENma1HxttkamlFPM3pbj1c4G32o+kxOGD9bl/lC94ff6nQdNhQdNhe+WfLcgdcqVGXMUVJB63N7C8T0hzJ88JrZgbe22LU0HlmbO9RapB4BV1esBYJA+N8SjgtCcvBsAlLLgb1dRcgCwcc6AeFjbHIEkRZye1nrnTS20lmeqUsL51RiSnp08bkbS6JdPrtjYsPfz8jULUid3paM9hmFYdxnUr/VuWRRh3baTiy4Y6t/egVhda5msgbkpD9w4078x2p3VG49hGIZhEZhz9cQ9fx7Zsnof2gAAAHOunjRuTqgrgT1/HvUtD54QfLbzboQT7lh3Mlued7p+o8g4glCIIstxpzj/yc2Virlq1RJpBMMwDOtlKYp4ADB5rPtNJ0QQRxjyAWB0bMH3Vev3Go97c6lJpxPuboF9+ugHJo91sL7f/+Uvj2VifD/nafcHQRPuAKBntMuzF16dNX+/8cSvddu3Nx36uvL3g6aTLw67T0ag49a7d0JOqTB/8pi4QePiBu9oPnzHnmfHxg1WyxQnreVF1gqNTHV738jPWSqZAgCcXPBR/w7eDQCB3efD3ObI9NdmHjIX2jlnlaPhwpSJaHP7ZAR1S87ijQ17nby7zF7TX9vuTEQYhmG9JjMtNjczobi8EQC+Wbv/ohmDQ8+UixiQmwK/HQSAorLg57JodlZvPIZhGIZFgCCI/3v7Rq1eveazzdI4JSMvvWP2dX+/RBpE1JY1ntxb6l3W6FUDx/T1b+9+OOGOdSdRtHs8x1prxwRg6EFxsW+gUQzDMKx3eXu4m1jLAWMhAcQwQx4AFOj6qmXK/cYTuZp0kBQ0P2IqMXmsAPBA3tXSbDucnh81BIogR8UOHBU7sNhW+bdDbxRaKzY37pueOBpd70wjgHhk4A1/P/TGEXPJ1qYDgijEynVzUyZckT47nBr07clWpwFAuaM2cNpVTuQrHXUAkKXu8cGMUnkxmbtajvzZsFsEMT8mC20OScdoKILkRUHoWmUbDMOwbrRo9tAX31sHAKWVzR9/t/PGy4JXNw5qzJBMkiQEQTxaVFtdb0pL0qNr9BaZrO0c4XCySkXHo4iiZ+MxDMMwrNcwcvqeV65ZfMcFW1bv886Amtk/ZdJFIxP7dHDX9uv/tvoKuM9ZNpHp+flXcMId6yUq5cJYw8sEoUYbMAzDsN4VL9fTpMzssVc7G/tpM7QyFQDICGq4IX9Py9EYWgOSHu5OwQ0ABBAG/2x7jbPRO/FmOHI16QNjsne3HKtzNqNt0eGDU6uOmEsezL8mzOcBvpoqZo/Nv6XNCEO+ilLYOeemxn3TE/1m7/F2FVdS8mH6PGm8p3nLuP9UsxkAOptw39tynBcFGUH1UbUWTcYwDDvjFkwf9O3aA6cqmwDgg6+3KRX0soXtzpaGSIjVXDAx/9fNxwVBfP7d31/+26WyznSQ70YKOa2U0063BwCKKxrjDB3fMUXPxmMYhmFYL0vvl7z0/nloNKRlD86/4t4LvcvyMB5sdx0+K2PdiWGGy+UTKCqVIDQAFEnqaHqARn19UsKauNh3CUKDvgHDMAzrdQQQSfLYBldLrbPJW0/Ga0xsgYtnD5oKCSB8Pbu9c3iKIP5c0zZw74Cp8LEjbwmn+whIra3d9kXFr6X2at9kqpzIb206cNhcDAA5mj5+a0eNX2u3E0AkKeK8M8F2iCJIb975m6p1Dt7li0vfrpYpl2VeCAD/LfpyS+N+b8dwQRQ2Ne57q/hrALgyY05gSZke1V+bSQBR5ajX0uo0ZSLaDHDAVPjPI++urd1W4ajz/S4trOXnms0vnPgEAGYmjdHIWgsHYxiGnXG0jHrsrgsZurUb2RufbbzlHys37ipyuvzG3NY2WtZtO/ncO79X1LRI47ctm6yPUQLAnsMVdzz+5aGT1dJWAHC5PbsPl7/68fqn3/oVaepeg/PTvAtvfb7ZZEGn9wgqejYewzAMw6IcI6eVarn3vxATq3Yj3MMd604q5SKVchEaxTAMw6JMijJ+d8sxAJAm3EfHFhBAGFlLnFznq7TeR5k4PXHU+oY975Z890P1Bj2trXe3mFhrfkz2hSkTPzz1g+/tXg3uli8rfvus7GeGpA1MjCAKZo+NFTwAMCVhxJi4AmT98O1sPnzQVGTnnHbeWe1oAIB6d/MTR95WyZRqSqmSKS5PvyDi/PXkhOHr6nc+dOBVX0ROMokKw0jDwMsyZulpbduqp12ZMeffJz7d23J82fa/xTE6TuTNHtu1WQsW95nhW2dRn+mNbuMP1RuePf6RkpLraI3ZY/NOpjovZdKl6b09zZ1apkxTJVY56vO1WWgbAADwAr+r5ciuliMAQAChoBhO5D0C520dEzvo1txL/d6AYRh2pvXPTnztH5c+9Pwqm8MNAEcKax75948URcbp1TEaBevhG5ut3s7jAHDJrCHS9ybFaZ994CLve48U1tz26Bd6rbJPikEpp12sp9lor2u0eJ8uTxiRI31jt7v8wuG7DpYBQGFpw+X3fDB8QJ84g9rNclabu7HFduncYQumD0LeEj0bj2EYhmEYAifcMQzDMOy8k6yMBwAlJc+PyfYFY2h1XkzWCUtpkry1nozXfXlXD4jJ+bVue62z0eyxpSjiL06btihteqWjHgBNuF+QNM7Ne45ZSmqdTU1uIwFEDK3uq+k3I2nM5IThXZkRdHfLsTW1W6URF896Hxt4zUuZFFnCvdJRL4BAEqQoit6ZTkVRdAtspaO+0lG/tenAGyMfDuzWPT1xlJKSr6reUGKtbHQbVZQiW52aHlBu5Za+i8fEFqyu2XTCUtbkNmlo1VB9/3kpk0bGDkDW7B152swqR3179WTyY7JuzLnkkKmwwlFv9lhdPEuTsmRFXH9t5vSkUWNi0XQPhmFYNBg6oM8Hz1713xWbNu0u9kZ4XmhotjY0W/1XhMCz0NABfd5/ZtlT/117tKgWAExWp8kapIN5QmzPDtWdMCLnhiXjP/xmOwDY7O7Ne0qkrXaHW/rSJ0o2HsMwDMMwBOGrGY9hGIZhGHa+KbfX3n/gJYqgHspfPtyQ5+vaL4JYbq994sg7jW7jrX0vvShtqv/7MAzDsKhTXN64eU/JnsPldY0Wk8Xp9nAKOW2IUaUl6wfmJk8Ynl3QL5UIyLl77T5cvnFn0YHj1U1Gm83hltMyg16VmRo7JD9t0si+fTPiA9e/56lvACAjNfaLV69HWn2uvPcjbx2b1x5dMnpwJtrs79DJ6u9/O3i4sKapxS6KolrFxBs0uZkJl84ZVtAvBV1borMb7/Xxtzve/XIrAMybWvCPO+eizRiGYRiGRQon3DEMwzAMO3+9Vrjyt7rt12TNvzJjDtoG8Fbx1z/VbF7UZ/pNObhgGoZhGIZhGIZhGNax3qgTj2EYhmEYFp2a3CYA0AZUjPGqcTYCQCyjQxswDMMwDMMwDMMwLBiccMcwDMMw7PyVrU4FgB9rNnlz6z7NbvPbxd/sM55gSHpi/DBpE4ZhGIZhGIZhGIa1B5eUwTAMwzDs/GXx2B848LI3256qTNDRGhHEZre50W0EADnJ3J931aSE4ejbMAzDMAzDMAzDMCwYnHDHMAzDMOy85uBdq6s37Wo5Uumod/JuiiC1MlWaKmmYvv/s5PGxTAz6BgzDMAzDMAzDMAxrB064YxiGYRiGYRiGYRiGYRiGYVg3wDXcMQzDMAzDMAzDMAzDMAzDMKwb4IQ7hmEYhmEYhmEYhmEYhmEYhnUDnHDHMAzDMAzDMAzDMAzDMAzDsG6AE+4YhmEYhmEYhmEYhmEYhmEY1g1wwh3DMAzDMAzDMAzDMAzDMAzDugFOuGMYhmEYhmEYhmEYhmEYhmFYN8AJdwzDMAzDMAzDMAzDMAzDMAzrBjjhjmEYhmEYhmEYhmEYhmEYhmHdACfcMQzDMAzDMAzDMAzDMAzDMKwb4IQ7hmEYhmEYhmEYhmEYhmEYhnUDnHDHMAzDMAzDMAzDMAzDMAzDsG6AE+4YhmEYhmEYhmEYhmEYhmEY1g1wwh3DMAzDMAzDMAzDMAzDMAzDugFOuGMYhmEYhmEYhmEYhmEYhmFYN8AJdwzDMAzDMAzDMAzDMAzDMAzrBjjhjmEYhmEYhmEYhmEYhmEYhmHdACfcMQzDMAzDMAzDMAzDMAzDMKwb4IQ7hmEYhmEYhmEYhmEYhmEYhnUDnHDHMAzDMAzDMAzDMAzDMAzDsG7w/3c+cdrxbhwFAAAAAElFTkSuQmCC", - "type": "image", - "xaxis": "x", - "yaxis": "y" - } - ], - "layout": { - "margin": { - "t": 60 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } + "output_type": "display_data", + "data": { + "text/plain": [ + "Downloading (…)okenizer_config.json: 0%| | 0.00/28.0 [00:00
" + "source": [ + "Then we define a function that applies the tokenizer to the column `Description` of an input batch..." ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "text = df_train[\"Description\"].str.cat(sep=\" \")\n", - "\n", - "# Create and generate a word cloud image:\n", - "word_cloud = WordCloud(scale=5, background_color=\"white\").generate(text)\n", - "\n", - "# Display the generated image:\n", - "fig = px.imshow(word_cloud, width=1440)\n", - "fig.update_layout(xaxis_showticklabels=False, yaxis_showticklabels=False)\n", - "fig.show(config={\"toImageButtonOptions\": {\"format\": \"svg\", \"filename\": \"peril_cloud\"}})" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "7I4oINQQEVHB" - }, - "source": [ - "\n", - "\n", - "## 2. Classify by Peril Type in a Supervised Setting\n", - "\n", - "In this section, we will train classifiers to predict the peril type (labels).\n", - "\n", - "We will follow two approaches:\n", - "\n", - "1. We use a transformer encoder to encode the claim descriptions,\n", - " and then train a logistic regression classifier to predict the peril type from the encoded descriptions.\n", - "\n", - "2. We train a transformer encoder with a classifier head directly.\n", - "\n", - "Let's get started." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Djm3pEdfEVHC" - }, - "source": [ - "\n", - "\n", - "### 2.1 Train a Classifier on Encoded Claim Descriptions\n", - "\n", - "We follow the approach presented in Part I of this tutorial.\n", - "\n", - "In this single-language case study, we use the `distilbert-base-uncased` model.\n", - "First, we load the model and the tokenizer." - ] - }, - { - "cell_type": "code", - "execution_count": 9, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 249, - "referenced_widgets": [ - "8db5f342b5384702b5151f3b322c440d", - "fb6db763317e4bbda9cba708c654d63b", - "998eda4a96db48e3812e5abc99efaabe", - "c8a74725ae254744b8a186455e829510", - "8373feff24314cb694208947a8738fe5", - "506e50b472fc48718c2e43b843ca56f7", - "505d2e0776f9413d9e65233a8c7a3ce0", - "5ed062448c2149d1b83d037bd4570aad", - "f0556ff087614accad129c6ca7ee9ed8", - "6dd9fea4b17f4b3ab425bd27dd36fc6e", - "52ec7cde15c54517800202fea56f6f9b", - "5e161921a5b547fbb813dedff389dc31", - "6ef6110defb94222863e8e996095d917", - "69ec9cf67095408a9fa7b90b5d0f1402", - "8ca63df694944110b2e324c1f8bf2664", - "6860a13715bd4749866ce60e6c186ca4", - "cd8230629dc94c56b5eb1260cff145a0", - "0c8d5caa32624d3e950372123ea76085", - "e7283168055b48acb94cf69be4ee57fd", - "f9afd1d342804aca92854daed877309c", - "395756fef94a4599999d43242fb15233", - "7ca61d692c464aa48568b65d63c86e36", - "7859b4f0ccff4091a7d7b28c0ea795fd", - "ad04758f764b4f3dbb71bd7822085f53", - "4cdd9588dc4f493ea45fae1da13d1d31", - "fa7ed39b1e6244ef809f6a8875e66836", - "75eaa88df13247d2a326f1216d68918e", - "823eb9fed415468fb18776f13a899991", - "05d19b34fe2e49b5b2076627e73288f5", - "d030c4d6f5914aa5a437c53b52e01ea9", - "1178f617fe0042c3876a9006de9a1d53", - "44fe5107721a490c8b5139744d00d6b3", - "8c2e4b1aef0643079e6d074c7b3df700", - "7269518d12b24e2c95b5eb45d1aa88af", - "982b01ca4ba14504934ee6e440ad019f", - "f375cf9a3bc343c6958a2a20b9b6b096", - "c663b01bc6c540ffab55a0a0e84fb027", - "e0d677c6cf6c40eeb8e7fd769b8b9020", - "0d1dc7e37a7441079a9955a166d0c46d", - "f4143e675e7543a9af0bd70636306db6", - "1b612c743595417ba3f393056c6a7e7a", - "57d028e4b6204017bf158df49b358d48", - "eebda1a16e4b4a4783a1da98f2d1a2f6", - "10ad0b729d7a403198a35900081f1108", - "6877960084d644908dcd99df7fde80db", - "8a0735f52b9c4f949897b336c80766bc", - "fa0a76c3235948c1a26ae247a37fd02a", - "e23a1b561a4442adb4b7aab8fd862b9c", - "fbc30ecadc1241089bc9928439a8daee", - "61dd26d4ee6a42c5a9f0d5e5f1748633", - "b7e14c0716ec42dd9bc8705202998881", - "fd2100438f864e3b957fab001fc2122b", - "d360844c59b849e1807a0f2b3019fd8a", - "bec6ddd26c264fc1b85869d3f84df41d", - "75e2ce0c1d814f3eb0cbe57cd6caf3b6" - ] }, - "id": "o7MG5LsCEVHC", - "outputId": "802d4610-d903-4ad4-ad76-016a2a095951", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "Some weights of the model checkpoint at distilbert-base-uncased were not used when initializing DistilBertModel: ['vocab_layer_norm.bias', 'vocab_transform.bias', 'vocab_projector.bias', 'vocab_layer_norm.weight', 'vocab_projector.weight', 'vocab_transform.weight']\n", - "- This IS expected if you are initializing DistilBertModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).\n", - "- This IS NOT expected if you are initializing DistilBertModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).\n" - ] - } - ], - "source": [ - "model_name = \"distilbert-base-uncased\"\n", - "tokenizer = AutoTokenizer.from_pretrained(model_name)\n", - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "model = AutoModel.from_pretrained(model_name).to(device)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "LwjhsMVsEVHC" - }, - "source": [ - "Then we define a function that applies the tokenizer to the column `Description` of an input batch..." - ] - }, - { - "cell_type": "code", - "execution_count": 10, - "metadata": { - "id": "ubdj3ThPEVHC", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [], - "source": [ - "# define a function to tokenize a batch\n", - "def tokenize(batch):\n", - " return tokenizer(batch[\"Description\"], truncation=True, padding=True, max_length=12)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "R55XqaTHEVHD" - }, - "source": [ - "... and we apply this function to the entire dataset by use of the `map` function:" - ] - }, - { - "cell_type": "code", - "execution_count": 11, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 81, - "referenced_widgets": [ - "a6556e2718524752b34217ff63a9fc4d", - "64568851a9ce44d1bb791bf2b8a4c4ae", - "74cfe3c0a87d46b6a7254c9fabc0e3a4", - "c60da4ac32f448c886b571de6f37a76b", - "059dc7a7910e447cb50d06979bdbf539", - "9fbf6b3450724f188a4aeccd325f1b4a", - "b044b4d34a2a42ed81212cc5c5e401ea", - "403a646eafea4a1ea95fab6f6e76d023", - "87091c179a7541c6b3584b0b02789a50", - "583071c719374ee996e4c7d254890412", - "ff630cfd369b4f3892eb32d0df84a0db", - "d066e40caa1b4a5590496a2aeb9dcea8", - "d70e851f6f7b43a38559aa4d3a5b6c84", - "615e006f120643e68ed890a78766c9e2", - "6ba1a277d3c74922975166c8578cb552", - "7cfddd8a70ab4ba98dddcc7e42b491a8", - "ec079ac635894ee2a7ebe1315129fc74", - "11ab378d7c254c64a910872ea18d7e27", - "669341ce6b2e4aa3b14d33110b236c9c", - "32b677302bf749f8bb437be83cf1a9d2", - "c883626d4ab54836831f016aee1a3b3a", - "a8e558bade474b4ea205d1fe31519cd6" - ] + "cell_type": "code", + "execution_count": 15, + "metadata": { + "id": "ubdj3ThPEVHC", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [], + "source": [ + "# define a function to tokenize a batch\n", + "def tokenize(batch):\n", + " return tokenizer(batch[\"Description\"], truncation=True, padding=True, max_length=12)" + ] }, - "id": "Y7GWGmtIEVHD", - "outputId": "8b6aec49-17bf-49ef-ebf5-c357cc1a4398", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "c4cff6d2677c4d66992de8cfd8dbf912", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "R55XqaTHEVHD" }, - "text/plain": [ - " 0%| | 0/5 [00:00y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "xaxis": "x", - "y": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "yaxis": "y", - "z": [ - [ - 310, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0 - ], - [ - 46, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0 - ], - [ - 123, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0 - ], - [ - 107, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0 - ], - [ - 18, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0 - ], - [ - 227, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0 - ], - [ - 67, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0 - ], - [ - 38, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0 - ], - [ - 103, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0 + "output_type": "stream", + "name": "stdout", + "text": [ + "Dummy classifier\n", + "accuracy score = 29.8%, log loss = 1.977, Brier loss = 0.835\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " Vandalism 0.30 1.00 0.46 310\n", + " Fire 0.00 0.00 0.00 46\n", + " Lightning 0.00 0.00 0.00 123\n", + " Wind 0.00 0.00 0.00 107\n", + " Hail 0.00 0.00 0.00 18\n", + " Vehicle 0.00 0.00 0.00 227\n", + " WaterNW 0.00 0.00 0.00 67\n", + " WaterW 0.00 0.00 0.00 38\n", + " Misc 0.00 0.00 0.00 103\n", + "\n", + " accuracy 0.30 1039\n", + " macro avg 0.03 0.11 0.05 1039\n", + "weighted avg 0.09 0.30 0.14 1039\n", + "\n" ] - ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 14 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } + ], + "source": [ + "x_train, y_train, x_test, y_test = get_xy(ds, \"mean_hidden_state\", \"labels\")\n", + "\n", + "# fit dummy classifier\n", + "clf_dummy = dummy_classifier(x_train, y_train)\n", + "_ = evaluate_classifier(y_test, None, clf_dummy.predict_proba(x_test), labels, \"Dummy classifier\", None)" + ] + }, + { + "cell_type": "code", + "execution_count": 19, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 872 + }, + "id": "5CxDvvqHEVHE", + "outputId": "0d095cf7-bcdb-4497-dec1-7f5ad07586f8", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Logistic Regression classifier\n", + "accuracy score = 83.9%, log loss = 0.531, Brier loss = 0.243\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " Vandalism 0.85 0.95 0.90 310\n", + " Fire 0.94 0.70 0.80 46\n", + " Lightning 0.90 0.93 0.91 123\n", + " Wind 0.91 0.87 0.89 107\n", + " Hail 0.93 0.78 0.85 18\n", + " Vehicle 0.90 0.92 0.91 227\n", + " WaterNW 0.72 0.34 0.46 67\n", + " WaterW 0.45 0.76 0.57 38\n", + " Misc 0.75 0.60 0.67 103\n", + "\n", + " accuracy 0.84 1039\n", + " macro avg 0.82 0.76 0.77 1039\n", + "weighted avg 0.84 0.84 0.83 1039\n", + "\n" ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Dummy classifier" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} + } + ], + "source": [ + "# fit a logarithmic regression classifier to the encoded texts\n", + "clf = logistic_regression_classifier(x_train, y_train, c=0.2)\n", + "_ = evaluate_classifier(y_test, None, clf.predict_proba(x_test), labels, \"Logistic Regression classifier\", \"cm_peril_lr\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "8SonrXfCEVHE", + "pycharm": { + "name": "#%% md\n" } - } }, - "text/html": [ - "
" + "source": [ + "This result is encouraging.\n", + "From the classification report, we see that the perils `WaterNW`, `WaterW` and `Misc` are most difficult to predict." ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "x_train, y_train, x_test, y_test = get_xy(ds, \"mean_hidden_state\", \"labels\")\n", - "\n", - "# fit dummy classifier\n", - "clf_dummy = dummy_classifier(x_train, y_train)\n", - "_ = evaluate_classifier(y_test, None, clf_dummy.predict_proba(x_test), labels, \"Dummy classifier\", None)" - ] - }, - { - "cell_type": "code", - "execution_count": 14, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 872 }, - "id": "5CxDvvqHEVHE", - "outputId": "daaa6970-f646-46a7-c987-6bc10ea7147f", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "Logistic Regression classifier\n", - "accuracy score = 83.9%, log loss = 0.531, Brier loss = 0.243\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " Vandalism 0.85 0.95 0.90 310\n", - " Fire 0.94 0.70 0.80 46\n", - " Lightning 0.90 0.93 0.91 123\n", - " Wind 0.91 0.87 0.89 107\n", - " Hail 0.93 0.78 0.85 18\n", - " Vehicle 0.90 0.92 0.91 227\n", - " WaterNW 0.72 0.34 0.46 67\n", - " WaterW 0.45 0.76 0.57 38\n", - " Misc 0.75 0.60 0.67 103\n", - "\n", - " accuracy 0.84 1039\n", - " macro avg 0.82 0.76 0.77 1039\n", - "weighted avg 0.84 0.84 0.83 1039\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "jjCbT3UoEVHF" + }, + "source": [ + "\n", + "\n", + "### 2.2 Task-specific Training of a Transformer-based Classifier\n", + "\n", + "In this section, we train directly a transformer-based sequence classifier,\n", + "using the approach described in Part I of this tutorial.\n", + "\n", + "On an AWS EC2 p2.xlarge instance, the run time is about 2 minutes." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_peril_lr", - "format": "svg" + "cell_type": "code", + "execution_count": 20, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 172 + }, + "id": "eWXNvLgPEVHF", + "outputId": "5035a9de-e79d-4f13-fd89-1eb27a3b4e52", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "xaxis": "x", - "y": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "yaxis": "y", - "z": [ - [ - 296, - 1, - 0, - 1, - 0, - 6, - 0, - 0, - 6 - ], - [ - 3, - 32, - 3, - 0, - 0, - 2, - 0, - 1, - 5 - ], - [ - 1, - 0, - 114, - 1, - 0, - 1, - 0, - 1, - 5 - ], - [ - 5, - 0, - 5, - 93, - 1, - 1, - 0, - 1, - 1 - ], - [ - 1, - 0, - 0, - 2, - 14, - 1, - 0, - 0, - 0 - ], - [ - 12, - 0, - 0, - 2, - 0, - 209, - 3, - 1, - 0 - ], - [ - 10, - 0, - 1, - 0, - 0, - 0, - 23, - 29, - 4 - ], - [ - 1, - 0, - 0, - 2, - 0, - 1, - 5, - 29, - 0 - ], - [ - 20, - 1, - 4, - 1, - 0, - 12, - 1, - 2, - 62 + "output_type": "stream", + "name": "stderr", + "text": [ + "Some weights of DistilBertForSequenceClassification were not initialized from the model checkpoint at distilbert-base-uncased and are newly initialized: ['pre_classifier.bias', 'classifier.bias', 'pre_classifier.weight', 'classifier.weight']\n", + "You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n" ] - ] + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "\n", + "
\n", + " \n", + " \n", + " [1248/1248 01:07, Epoch 2/2]\n", + "
\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
StepTraining Loss
6230.527700
12460.309900

" + ] + }, + "metadata": {} } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 14 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] + ], + "source": [ + "model_name = \"distilbert-base-uncased\"\n", + "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", + "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model\n", + "model = AutoModelForSequenceClassification.from_pretrained(model_name, num_labels=len(labels)).to(device)\n", + "\n", + "def compute_metrics(pred):\n", + " labels = pred.label_ids\n", + " preds = pred.predictions.argmax(-1)\n", + " f1 = f1_score(labels, preds, average=\"weighted\")\n", + " acc = accuracy_score(labels, preds)\n", + " return {\"accuracy\": acc, \"f1\": f1}\n", + "\n", + "# train the model\n", + "batch_size = 8\n", + "logging_steps = len(ds[\"train\"]) // batch_size\n", + "training_args = TrainingArguments(\n", + " output_dir=model_name+\"_peril_epochs\",\n", + " num_train_epochs=2,\n", + " per_device_train_batch_size=batch_size,\n", + " per_device_eval_batch_size=batch_size,\n", + " metric_for_best_model=\"f1\",\n", + " logging_steps=logging_steps,\n", + " save_strategy=trainer_utils.IntervalStrategy.NO,\n", + ")\n", + "trainer = Trainer(model=model, args=training_args,\n", + " compute_metrics=compute_metrics, train_dataset=ds[\"train\"],\n", + " eval_dataset=ds[\"test\"])\n", + "trainer.train();\n", + "trainer.save_model(model_name + \"_peril\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "6732WFTuEVHF" + }, + "source": [ + "We evaluate the model on the test set:" + ] + }, + { + "cell_type": "code", + "execution_count": 21, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 872 + }, + "id": "FkkgHZcaEVHF", + "outputId": "b5c432d4-f9f9-4517-a415-f8d8dd127db2", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 + "text/html": [] }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Transformer-based classifier\n", + "accuracy score = 84.7%, log loss = 0.539, Brier loss = 0.237\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " Vandalism 0.90 0.95 0.93 310\n", + " Fire 0.88 0.80 0.84 46\n", + " Lightning 0.94 0.94 0.94 123\n", + " Wind 0.94 0.90 0.92 107\n", + " Hail 0.94 0.94 0.94 18\n", + " Vehicle 0.93 0.93 0.93 227\n", + " WaterNW 0.00 0.00 0.00 67\n", + " WaterW 0.35 0.89 0.50 38\n", + " Misc 0.71 0.72 0.71 103\n", + "\n", + " accuracy 0.85 1039\n", + " macro avg 0.73 0.79 0.75 1039\n", + "weighted avg 0.82 0.85 0.83 1039\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "

\n", + "
\n", + "\n", + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Logistic Regression classifier" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } + ], + "source": [ + "predictions = trainer.predict(ds[\"test\"])\n", + "_ = evaluate_classifier(predictions.label_ids, None, softmax(predictions.predictions, axis=1), labels,\"Transformer-based classifier\", \"cm_peril_transformer\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "N68LJA8yEVHG" }, - "text/html": [ - "
" + "source": [ + "The performance is comparable to that of the logistic regression classifier, with an improved Brier loss and accuracy score.\n", + "It appears that the model struggles to tell `WaterNW` apart from `WaterW`.\n" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "# fit a logarithmic regression classifier to the encoded texts\n", - "clf = logistic_regression_classifier(x_train, y_train, c=0.2)\n", - "_ = evaluate_classifier(y_test, None, clf.predict_proba(x_test), labels, \"Logistic Regression classifier\", \"cm_peril_lr\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "8SonrXfCEVHE", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "This result is encouraging.\n", - "From the classification report, we see that the perils `WaterNW`, `WaterW` and `Misc` are most difficult to predict." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "jjCbT3UoEVHF" - }, - "source": [ - "\n", - "\n", - "### 2.2 Task-specific Training of a Transformer-based Classifier\n", - "\n", - "In this section, we train directly a transformer-based sequence classifier,\n", - "using the approach described in Part I of this tutorial.\n", - "\n", - "On an AWS EC2 p2.xlarge instance, the run time is about 2 minutes." - ] - }, - { - "cell_type": "code", - "execution_count": 15, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 522 }, - "id": "eWXNvLgPEVHF", - "outputId": "c6a7f947-8f53-467f-b115-c23eaea70a71", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "Some weights of the model checkpoint at distilbert-base-uncased were not used when initializing DistilBertForSequenceClassification: ['vocab_layer_norm.bias', 'vocab_transform.bias', 'vocab_projector.bias', 'vocab_layer_norm.weight', 'vocab_projector.weight', 'vocab_transform.weight']\n", - "- This IS expected if you are initializing DistilBertForSequenceClassification from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).\n", - "- This IS NOT expected if you are initializing DistilBertForSequenceClassification from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).\n", - "Some weights of DistilBertForSequenceClassification were not initialized from the model checkpoint at distilbert-base-uncased and are newly initialized: ['pre_classifier.weight', 'classifier.weight', 'classifier.bias', 'pre_classifier.bias']\n", - "You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n", - "The following columns in the training set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: Lightning, WaterW, Wind, cls_hidden_state, WaterNW, Vandalism, Fire, mean_hidden_state, Hail, Vehicle, Misc, Description, Loss. If Lightning, WaterW, Wind, cls_hidden_state, WaterNW, Vandalism, Fire, mean_hidden_state, Hail, Vehicle, Misc, Description, Loss are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "***** Running training *****\n", - " Num examples = 4991\n", - " Num Epochs = 2\n", - " Instantaneous batch size per device = 8\n", - " Total train batch size (w. parallel, distributed & accumulation) = 8\n", - " Gradient Accumulation steps = 1\n", - " Total optimization steps = 1248\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "CoYTxK22EVHG" + }, + "source": [ + "\n", + "\n", + "## 3. Zero-shot Classification\n", + "\n", + "There are situations with no or only few labeled data.\n", + "\n", + "Zero-shot classification is an approach that is suited in this case.\n", + "Zero-shot classification is about classifying text sequences in an unsupervised way\n", + "(without having training data in advance and building a model).\n", + "\n", + "The model is presented with a text sequence and a list of expressions, and assigns a probability to each expression." + ] }, { - "data": { - "text/html": [ - "\n", - "
\n", - " \n", - " \n", - " [1248/1248 00:51, Epoch 2/2]\n", - "
\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
StepTraining Loss
6230.530700
12460.304900

" - ], - "text/plain": [ - "" + "cell_type": "markdown", + "metadata": { + "id": "VLx2AElsEVHG" + }, + "source": [ + "\n", + "\n", + "### 3.1 Demonstration of the approach\n", + "\n", + "In this section you will learn how to apply zero-shot classification to perform the classification by peril type on\n", + "the claims data described above.\n", + "\n", + "First, we create a dictionary mapping certain verbal expression to peril types:" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stderr", - "output_type": "stream", - "text": [ - "\n", - "\n", - "Training completed. Do not forget to share your model on huggingface.co/models =)\n", - "\n", - "\n", - "Saving model checkpoint to distilbert-base-uncased_peril\n", - "Configuration saved in distilbert-base-uncased_peril/config.json\n", - "Model weights saved in distilbert-base-uncased_peril/pytorch_model.bin\n" - ] - } - ], - "source": [ - "model_name = \"distilbert-base-uncased\"\n", - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model\n", - "model = AutoModelForSequenceClassification.from_pretrained(model_name, num_labels=len(labels)).to(device)\n", - "\n", - "def compute_metrics(pred):\n", - " labels = pred.label_ids\n", - " preds = pred.predictions.argmax(-1)\n", - " f1 = f1_score(labels, preds, average=\"weighted\")\n", - " acc = accuracy_score(labels, preds)\n", - " return {\"accuracy\": acc, \"f1\": f1}\n", - "\n", - "# train the model\n", - "batch_size = 8\n", - "logging_steps = len(ds[\"train\"]) // batch_size\n", - "training_args = TrainingArguments(\n", - " output_dir=model_name+\"_peril_epochs\",\n", - " num_train_epochs=2,\n", - " per_device_train_batch_size=batch_size,\n", - " per_device_eval_batch_size=batch_size,\n", - " metric_for_best_model=\"f1\",\n", - " logging_steps=logging_steps,\n", - " save_strategy=trainer_utils.IntervalStrategy.NO,\n", - ")\n", - "trainer = Trainer(model=model, args=training_args,\n", - " compute_metrics=compute_metrics, train_dataset=ds[\"train\"],\n", - " eval_dataset=ds[\"test\"])\n", - "trainer.train();\n", - "trainer.save_model(model_name + \"_peril\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "6732WFTuEVHF" - }, - "source": [ - "We evaluate the model on the test set:" - ] - }, - { - "cell_type": "code", - "execution_count": 16, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 961 + "cell_type": "code", + "execution_count": 22, + "metadata": { + "id": "JmrKLlMKEVHG", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [], + "source": [ + "choices = OrderedDict({\n", + " \"Vandalism\": 0,\n", + " \"Theft\": 0,\n", + " \"Fire\": 1,\n", + " \"Lightning\": 2,\n", + " \"Wind\": 3,\n", + " \"Hail\": 4,\n", + " \"Vehicle\": 5,\n", + " \"Water\": 6,\n", + " \"Weather\": 7,\n", + " \"Misc\": 8})" + ] }, - "id": "FkkgHZcaEVHF", - "outputId": "981b7946-b71b-45e0-c1a6-40ac534ae614", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "The following columns in the test set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: Lightning, WaterW, Wind, cls_hidden_state, WaterNW, Vandalism, Fire, mean_hidden_state, Hail, Vehicle, Misc, Description, Loss. If Lightning, WaterW, Wind, cls_hidden_state, WaterNW, Vandalism, Fire, mean_hidden_state, Hail, Vehicle, Misc, Description, Loss are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "***** Running Prediction *****\n", - " Num examples = 1039\n", - " Batch size = 8\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "IpkNFlZ8EVHG", + "pycharm": { + "name": "#%% md\n" + } + }, + "source": [ + "We set up the zero-shot classifier using the `pipeline` abstraction.\n", + "By default, the `facebook/bart-large-mnli` model is used.\n", + "By specifying `device=0`, we use GPU support if available." + ] }, { - "data": { - "text/html": [ - "\n", - "

\n", - " \n", - " \n", - " [130/130 00:01]\n", - "
\n", - " " + "cell_type": "code", + "execution_count": 23, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "referenced_widgets": [ + "2200519804e141398ad3b7ec1a1651d7", + "58536efab4a94045af79a642549cb28f", + "f07aa0b876924898b8e66b35ed36e7cf", + "8e2925bd03e649ea939aeb8dc061c0a3", + "cd5917f3d0624092b32c4d9bfed69a98", + "c8d4274188bf464d8686f83280ffa9e1", + "9d3d3feb9b25419a876586ec51da8ee0", + "f9379789ea434bca9e3a040f774b9a31", + "a10b60b5ec8b4668a6f12474e6f944ce", + "30fe641c399544e3b1111fd1043802e9", + "b829f2bd5c53486a9339df054a5b090a", + "1cc54f2db67b43299c32ac3d80a14a05", + "a838ad30c8214f70825456bdbe8040bc", + "714784cacd254171ae4c654a6df16aac", + "257651054ee64b0b86426ea8867abf34", + "979e96beb1cf47d7a7cbe26597cc1b97", + "6b09cf6fa47b44209bf41d1d82f0eddd", + "ff5f70c5ba78479e9600101bd61a9762", + "02eaa5b14ccb4420b54a63c06289a9c6", + "ea26895dcf48415392b883b65349b063", + "961a9f04da1342d08899144b0392d3a0", + "3cfab93db69a4da4a23a8852950430e3", + "545125171280483eb39001760dbe64b8", + "d9668e4d305e49808115050d94abbf10", + "c0d4c7a7053d419cbb0bb6e1dc86d218", + "43223ffb2f3947198fa57c73af2dea9c", + "15e421344c8341d1a8011702d4dc07c3", + "2577d0d7013f4fb7b500916137bed1b0", + "541d2d7200b44dfab80178e1c68806ec", + "9499be411d9d42bfbcd5477b53fe8d74", + "feb9bad9b33943729dcc67a7ffd8c8ef", + "cfaa75849a064d66b18893963f1413a4", + "cc93da4a48374a95bfaf600b321b5464", + "bde596f909cf4f4c8ec7166f6d6ff5da", + "3757acbc0aa943cd9a2a22fa0336805c", + "67495b76189f4489bc4ec4b3cbe8b2aa", + "6fd8d362aa5049e087e6210660c8aac7", + "4ca172d25bc2489a90bef50b6ab671e1", + "410a5a0a52ee46f19413833ea0c9ffa9", + "2150f647187d4df5805ed69fe91456e9", + "c263ee996b7e476e96fd77456922635d", + "2352fe8e75fa460b8859823270b054e3", + "19503938c7c9427ab9368718f113d0dc", + "3575328060fc48c39207ac7ed254108d", + "b7343b6eba3a4c6fbfb41de9a2f1c2a5", + "146686cbbb514f95892dc87061565fb2", + "1e98e49f489543e78e3384b66c048cc6", + "a106da5cb7314f03b075ee7c0e4e9ec7", + "7db3a1b06b714d7ab26338bdb4062b4c", + "cedf88473f774984a22f65e06f7608bb", + "5c9474ce8e3a45658f68e823d74f1995", + "e390d3472da24d7286239e9b852dad6c", + "7e73588e6d82482fa7398bc4d4e0e913", + "5af9d65c8ac242f0972d93f48c9fc4bb", + "e5a9124fe6044842a27a9c30883d5869", + "489233bb8c044988a3e08102f8aadbf8", + "7f0fd2b6ae724ebe93b39e15d0b18ffa", + "bcb392fa900e4f78ab0f5d985ccb0c5e", + "07dfbcc8771f48d6b3426dc82ef74617", + "60eb749393b2460c92b6af9d8632b73e", + "319fbe6f513644b9bd98d76589a70b1f", + "5add45e0435b4f16b94b59d969ece2f6", + "b83f6ddd989d4f67957622f1c5932d87", + "2c27bf385c1c4e2892044acfd233b326", + "118bb1212469463d87ef9762316cf9cd", + "5790a88fec1141ae8813301962eae01d" + ], + "height": 244 + }, + "id": "kmmi1hs8EVHG", + "outputId": "bd4f77a4-d6ce-45d9-8511-59639b02eb33", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "stream", + "name": "stderr", + "text": [ + "No model was supplied, defaulted to facebook/bart-large-mnli and revision c626438 (https://huggingface.co/facebook/bart-large-mnli).\n", + "Using a pipeline without specifying a model name and revision in production is not recommended.\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Downloading (…)lve/main/config.json: 0%| | 0.00/1.15k [00:00" + "source": [ + "classifier = pipeline(\"zero-shot-classification\", device=0)" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stdout", - "output_type": "stream", - "text": [ - "Transformer-based classifier\n", - "accuracy score = 85.2%, log loss = 0.520, Brier loss = 0.219\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " Vandalism 0.90 0.94 0.92 310\n", - " Fire 0.86 0.83 0.84 46\n", - " Lightning 0.94 0.94 0.94 123\n", - " Wind 0.96 0.91 0.93 107\n", - " Hail 1.00 0.94 0.97 18\n", - " Vehicle 0.92 0.93 0.93 227\n", - " WaterNW 0.81 0.19 0.31 67\n", - " WaterW 0.39 0.87 0.54 38\n", - " Misc 0.70 0.66 0.68 103\n", - "\n", - " accuracy 0.85 1039\n", - " macro avg 0.83 0.80 0.78 1039\n", - "weighted avg 0.87 0.85 0.84 1039\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "VR7Qe56REVHH", + "pycharm": { + "name": "#%% md\n" + } + }, + "source": [ + "Then, we feed the claim descriptions of the entire test set,\n", + "presenting the classifier with the list of possible choices as the second argument.\n", + "\n", + "We use the test set directly, because zero shot classification requires no training!\n", + "\n", + "On an AWS EC2 p2.xlarge instance, the run time is about 5 minutes." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_peril_transformer", - "format": "svg" + "cell_type": "code", + "execution_count": 24, + "metadata": { + "id": "JLTEy0G8EVHH", + "pycharm": { + "name": "#%%\n" } - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "xaxis": "x", - "y": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "yaxis": "y", - "z": [ - [ - 291, - 4, - 1, - 0, - 0, - 6, - 0, - 0, - 8 - ], - [ - 0, - 38, - 3, - 0, - 0, - 1, - 0, - 0, - 4 - ], - [ - 0, - 0, - 116, - 1, - 0, - 0, - 0, - 0, - 6 - ], - [ - 4, - 0, - 3, - 97, - 0, - 2, - 0, - 0, - 1 - ], - [ - 0, - 0, - 0, - 1, - 17, - 0, - 0, - 0, - 0 - ], - [ - 8, - 1, - 0, - 0, - 0, - 212, - 0, - 3, - 3 - ], - [ - 4, - 0, - 0, - 0, - 0, - 0, - 13, - 45, - 5 - ], - [ - 0, - 0, - 0, - 1, - 0, - 0, - 2, - 33, - 2 - ], - [ - 18, - 1, - 1, - 1, - 0, - 9, - 1, - 4, - 68 + }, + "outputs": [], + "source": [ + "res = classifier(ds[\"test\"][\"Description\"], list(choices.keys()))" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "amIfcKCREVHH" + }, + "source": [ + "This returns a list of `dict` with the following keys:\n", + "* **sequence** (`str`) — The sequence for which this is the output.\n", + "* **labels** (`List[str]`) — The labels sorted by order of likelihood.\n", + "* **scores** (`List[float]`) — The probabilities for each of the labels.\n", + "\n", + "We store the predictions in a Pandas DataFrame and evaluate the performance." + ] + }, + { + "cell_type": "code", + "execution_count": 25, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 872 + }, + "id": "rrOMsvGHRPHR", + "outputId": "e58fc511-c36d-4b4b-b1f8-9a0487132b60" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Zero-shot-classification\n", + "accuracy score = 65.5%, log loss = 1.043, Brier loss = 0.463\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " Vandalism 0.93 0.44 0.59 310\n", + " Fire 0.68 0.70 0.69 46\n", + " Lightning 0.94 0.93 0.94 123\n", + " Wind 1.00 0.84 0.91 107\n", + " Hail 0.75 1.00 0.86 18\n", + " Vehicle 0.89 0.69 0.77 227\n", + " WaterNW 0.56 0.75 0.64 67\n", + " WaterW 0.00 0.00 0.00 38\n", + " Misc 0.25 0.83 0.38 103\n", + "\n", + " accuracy 0.66 1039\n", + " macro avg 0.67 0.69 0.64 1039\n", + "weighted avg 0.79 0.66 0.68 1039\n", + "\n" ] - ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 14 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } + ], + "source": [ + "proba = np.zeros((df_valid.shape[0], len(labels)))\n", + "for i, sample in enumerate(res):\n", + " for label, score in zip(sample[\"labels\"], sample[\"scores\"]):\n", + " proba[i, choices[label]] += score\n", + " proba[i, :] = proba[i, :] / np.sum(proba[i, :])\n", + "_ = evaluate_classifier(np.array(df_valid[\"labels\"]), None, proba, labels, \"Zero-shot-classification\", \"cm_peril_zero_a\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "Biym_RIDEVHH", + "pycharm": { + "name": "#%% md\n" + } + }, + "source": [ + "On the test set, we achieve an accuracy of 65.5% (compared to 29.8% of the dummy classifier).\n", + "Apparently, the classifier struggles to correctly identify the `WaterW` cases based on the expression “Weather”.\n", + "Also, it seems that the expression “Misc” may not be the optimal choice, as it produces many false positives." + ] + }, + { + "cell_type": "code", + "execution_count": 26, + "metadata": { + "id": "4EG2NJ_FEVHH", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [], + "source": [ + "pred = [{\n", + " **{\"pred\"+str(i): choices[item[\"labels\"][i]] for i in range(10)},\n", + " **{\"score\"+str(i): item[\"scores\"][i] for i in range(10)}\n", + "} for item in res]\n", + "df_pred = pd.DataFrame(pred)\n", + "df_pred[[\"labels\", \"Description\"]] = df_valid[[\"labels\", \"Description\"]]" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "3z9s2Z7zEVHH" + }, + "source": [ + "\n", + "\n", + "### 3.2 Refinement\n", + "\n", + "To improve the performance on \"Misc\", we introduce the following heuristic:\n", + "If the probability assigned to the expression “Misc” is highest\n", + "but with a margin of less than 50 percentage points to the second-most likely expression, we select the latter." + ] + }, + { + "cell_type": "code", + "execution_count": 27, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 872 + }, + "id": "GbSjWVZtEVHH", + "outputId": "21346bc0-ba8c-43ff-8886-feeb542f59aa", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Zero-shot classification, refined\n", + "accuracy score = 69.7%, log loss = nan, Brier loss = nan\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " Vandalism 0.77 0.62 0.69 310\n", + " Fire 0.69 0.78 0.73 46\n", + " Lightning 0.92 0.94 0.93 123\n", + " Wind 0.91 0.85 0.88 107\n", + " Hail 0.58 1.00 0.73 18\n", + " Vehicle 0.62 0.77 0.69 227\n", + " WaterNW 0.54 0.78 0.63 67\n", + " WaterW 0.29 0.11 0.15 38\n", + " Misc 0.45 0.40 0.42 103\n", + "\n", + " accuracy 0.70 1039\n", + " macro avg 0.64 0.69 0.65 1039\n", + "weighted avg 0.70 0.70 0.69 1039\n", + "\n" ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } + "metadata": {} + } + ], + "source": [ + "def select_misc(row, threshold):\n", + " return row[\"pred1\"] if row[\"pred0\"] == 8 and row[\"score0\"] - row[\"score1\"] < threshold else row[\"pred0\"]\n", + "df_pred[\"pred*\"] = df_pred.apply(lambda x: select_misc(x, 0.5), axis=1)\n", + "_ = evaluate_classifier(np.array(df_pred[\"labels\"]), np.array(df_pred[\"pred*\"]), None, labels, \"Zero-shot classification, refined\", \"cm_peril_zero_b\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "VeEvTc2yEVHI" + }, + "source": [ + "We export the output to Excel to analyze the prediction errors." + ] + }, + { + "cell_type": "code", + "execution_count": 28, + "metadata": { + "id": "fVV5op92EVHI" + }, + "outputs": [], + "source": [ + "if not os.path.exists(\"./results\"):\n", + " os.mkdir(\"./results\")\n", + "df_pred.to_excel(\"results/peril_pred_zero_shot.xlsx\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "uucd4ButEVHI" + }, + "source": [ + "Looking at false predictions in the training set, we observe the following:\n", + "\n", + "* True label “Vandalism”, predicted label “Vehicle” or “Misc”: Quite many descriptions contain the word “glass”. For these claims, “Vandalism” appears to be a natural classification.\n", + " \n", + "* True label “Vehicle”, predicted label “Vandalism”: This group contains many descriptions like “light pole damaged”, “fence damaged”. Apparently, the zero-shot classifier does not realize that for these items, damage caused by a vehicle is more likely than damage caused by vandalism.\n", + "* True label “WaterW”, predicted label “WaterNW”: Some of the descriptions like “frozen pipe caused water damage to indoor pool”, “gutter pulled from roof ice dam”, “Water damage and mold growth from storms” suggest that the candidate word “Weather” is not optimal to attract all weather-related water claims.\n", + "\n", + "Based on these and similar observations, one could refine the approach by adding more candidate expressions, e.g., adding “glass” to hazard type 0 (“Vandalism”), “light pole” and “fence” to hazard type 5 (“Vehicle”), “storm” and “ice” to hazard type 7 (“WaterW”), etc.\n", + "\n", + "However, the computational effort of zero-shot classification scales with the number of candidate expressions times number of samples, so that we don't want to supply too many candidate expressions.\n", + "Ideally, we would have an approach to extract candidate expressions from the data....\n", + "\n", + "We will look at such an approach in [Section 5](#topic_modeling).\n", + "Before going there, the next section offers an alternative approach with less computational effort than zero-shot classification." + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "csG9Uh15maLE" + }, + "source": [ + "\n", + "\n", + "## 4. Unsupervised Classification Using Similarity\n", + "\n", + "This approach is similar to the previous one. It is also suitable in situations with no or only few labeled data.\n", + "\n", + "The model is presented with a text sequence and a list of expressions, and selects the expression which is most \"similar\" to the text sequence.\n", + "Here, we use cosine-similarity, which is defined as the dot product of two embedding vectors, each normalized to unit length." + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "vkqpIohSob7s" + }, + "source": [ + "\n", + "\n", + "### 4.1 Demonstration of the approach\n", + "\n", + "In this section you will learn how to perform unsupervised classification using similarity.\n", + "\n", + "Again, we will try to predict the peril type from the claim descriptions.\n", + "\n", + "First, we create a dictionary that maps certain verbal expression to peril types:" + ] + }, + { + "cell_type": "code", + "execution_count": 29, + "metadata": { + "id": "A-MB8vWeo9Qa" + }, + "outputs": [], + "source": [ + "candidates = OrderedDict({\n", + " \"Vandalism\": 0,\n", + " \"Glass\": 0,\n", + " \"Theft\": 0,\n", + " \"Fire damage\": 1,\n", + " \"Lightning damage\": 2,\n", + " \"Wind damage\": 3,\n", + " \"Hail damage\": 4,\n", + " \"Damage caused by a vehicle\": 5,\n", + " \"Water damage\": 6,\n", + " \"Weather damage\": 7,\n", + " \"Ice\": 7,\n", + " \"Electricity\": 8,\n", + " \"power surge\": 8})" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "5JhbMQjepls9" + }, + "source": [ + "As you can see, we have applied some of the lessons learned from the previous experiments with the zero-shot classifier. For instance, we have added \"Glass\" to the list of candidate expressions mapped to \"Vandalism\"." + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "Coa6gM93qNZv" + }, + "source": [ + "We use the model ``sentence-transformers/all-MiniLM-L12-v2``, which is a BERT model that produces a sequence of real-valued vectors of length 384. During its pre-training on sentence similarity tasks, mean pooling was applied to convert this sequence into a single vector." + ] + }, + { + "cell_type": "code", + "execution_count": 30, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 209, + "referenced_widgets": [ + "5f74275afa1d46da8085b979edd7d4de", + "627058aa0f314f1eb21388e8a327a429", + "0d27a80e51674bc4ab93817c47e22d34", + "94a41b1e2e0a4ea79b1031aa5828ecb6", + "3a6a1f92769f4bfa924920c8c003a02f", + "c1ae57b61c9b4b949e0fa0581611aa80", + "9a10cedca8a44948840681975df987a7", + "1c3ae5a90e564510aac2ce4a61b9c56d", + "9096ce54dea847bc9d398ae31f086c16", + "66e0472ab90e4c6c94d18e374f8cf9c7", + "05fbe6032b7f421fa897992621795b33", + "4595744bea1843c79d6c8b11027c1db8", + "320c7ca65249451a824d2df8c430a3a4", + "a279e42a1701404bbcb2732ed248a334", + "0998c7ff46e74d49b9fb991a337bad0e", + "7f15dfe1fa454a1e8faa2c764e437ba7", + "a7c671a21dee45829a450e40de873384", + "45d00478792d44cfa033feb875b84a7b", + "3fb4ac16169c4bdab40cf7189de202d9", + "800b4b1478b94daa9045c8d183de2bdd", + "b027b9effe2b44d895b3f5babedaf6e7", + "8c49c80da8b84575ae24724c345fcb06", + "1c9d63e6919242a193aafd755220497d", + "6c08750a5b304550b784400b5cd48846", + "47bb8f56b89549ae8a72b8976a3664eb", + "c927c1d243364d1c88534038402d3629", + "8c34114e5cbb479eb8b8fc691a3e65da", + "f3c04685c6af44bd9bf88d404d1f8c9d", + "4124b1638d2c4ca1ae0c9fc7a92c2884", + "62abd2484e5444d6859d3bbd639fa4d7", + "1245ab4237cc4ee9b6c851301607b301", + "47622165b2ae457d8578e141318e95d5", + "6f3f15dd4f0f4e7bafd6c29414269465", + "ccf3d21d1e394e79a736bb5ae51e1a1c", + "ebc5ae4cf440454a945580961ea23bb1", + "0202fb280ebb4149b1f3a85545fe5cd3", + "362c20f6821747b1a9854c094f00f672", + "1fcdb6ee7a894d32b11901032dce5f92", + "d6704ca6a7a24c1d9489f662a65921bf", + "716aeb463e49482ca7fbf7c4af312138", + "69eb91d460e24f29b479b64bdc270847", + "9914a5f63edd444db1e7bc0992fb2770", + "5b4ed5562c0242d9a69788aeebe0f9af", + "325c8a22307c4b77a84f549627db0d5a", + "448a40829fdf408cac3af81ef9c03df4", + "32b565d94b2f405693f5eba1bc16f53d", + "78ad4e18627b4131aca129f38652ccba", + "e89c8fe1562b45b7818ff20c4ef58f8e", + "39cbad4a6bd944b4bd18ea9b14debac2", + "6859fef3694e4c49b0ab633200756934", + "b51d592bfbf34b24b16544f42dcad5e8", + "b9711b3014f0476d8cccb1642cf28681", + "5a331fc31a1546f093494ee2404cfbe1", + "739340399a6c4c4fb50143e3587423ad", + "8c183b90a3dd45c2a7fe797ea079e319", + "f51acf459e944e7cb86ec7e57c47496f", + "221e6c077d39456f839d859fbd67e9cc", + "9d814a3f4ba5482199f7c5f91bf7e39d", + "e7f354b860fb45cfa7368eb01f2e5c01", + "2067761d355d4de3ab734ecd38d85702", + "d96a4c788fa140e2ac5977582e2a2ff1", + "ea0f1a6513ce4d73b9362a9839999312", + "71ed5aad90ba4794b7242efa2f66e82a", + "423662a69bcb4312ae86d9f23290a447", + "3bae1d2fbd2449af80e6c0a6ff3cadb0", + "2866aaeac9af4b35a0b9a76c33d8dece" + ] + }, + "id": "65gL10u6q0_F", + "outputId": "7789a627-0a56-44dd-d93a-fbd1e2fb1bf4" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Downloading (…)okenizer_config.json: 0%| | 0.00/352 [00:00predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } + ], + "source": [ + "ds_candidates = Dataset.from_dict({\"Description\": candidates.keys()})\n", + "ds_candidates = ds_candidates.map(tokenize, batched=True)\n", + "ds_candidates = ds_candidates.map(extract_sequence_encoding, fn_kwargs={\"model\": model, \"normalize\": True}, batched=True)\n", + "y = np.array(ds_candidates[\"mean_hidden_state\"])" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "1DLkEGHiVwsJ" }, - "text/html": [ - "
" + "source": [ + "Finally, we calculate the pairwise cosine similarity scores by the dot product of the two arrays, and greedily select the peril type with the highest score." ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "predictions = trainer.predict(ds[\"test\"])\n", - "_ = evaluate_classifier(predictions.label_ids, None, softmax(predictions.predictions, axis=1), labels,\"Transformer-based classifier\", \"cm_peril_transformer\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "N68LJA8yEVHG" - }, - "source": [ - "The performance is comparable to that of the logistic regression classifier, with an improved Brier loss and accuracy score.\n", - "It appears that the model struggles to tell `WaterNW` apart from `WaterW`.\n" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "CoYTxK22EVHG" - }, - "source": [ - "\n", - "\n", - "## 3. Zero-shot Classification\n", - "\n", - "There are situations with no or only few labeled data.\n", - "\n", - "Zero-shot classification is an approach that is suited in this case.\n", - "Zero-shot classification is about classifying text sequences in an unsupervised way\n", - "(without having training data in advance and building a model).\n", - "\n", - "The model is presented with a text sequence and a list of expressions, and assigns a probability to each expression." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "VLx2AElsEVHG" - }, - "source": [ - "\n", - "\n", - "### 3.1 Demonstration of the approach\n", - "\n", - "In this section you will learn how to apply zero-shot classification to perform the classification by peril type on\n", - "the claims data described above.\n", - "\n", - "First, we create a dictionary mapping certain verbal expression to peril types:" - ] - }, - { - "cell_type": "code", - "execution_count": 17, - "metadata": { - "id": "JmrKLlMKEVHG", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [], - "source": [ - "choices = OrderedDict({\n", - " \"Vandalism\": 0,\n", - " \"Theft\": 0,\n", - " \"Fire\": 1,\n", - " \"Lightning\": 2,\n", - " \"Wind\": 3,\n", - " \"Hail\": 4,\n", - " \"Vehicle\": 5,\n", - " \"Water\": 6,\n", - " \"Weather\": 7,\n", - " \"Misc\": 8})" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "IpkNFlZ8EVHG", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "We set up the zero-shot classifier using the `pipeline` abstraction.\n", - "By default, the `facebook/bart-large-mnli` model is used.\n", - "By specifying `device=0`, we use GPU support if available." - ] - }, - { - "cell_type": "code", - "execution_count": 18, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0, - "referenced_widgets": [ - "0427a43036264a3683b9ccc05ae4d263", - "fe358f54827f476d98557365e873d898", - "5f70a433d78f4d7494af38d6cb103845", - "a8983ba16a794aad8271b7d69a81b3ad", - "e6fa423db2cd4a628ce17ffd90d3d254", - "fd90644c12544a3d8444543cf97dbeab", - "b361bfc331fb42a7ab25522003c63f06", - "c53fd5527ead4008b3f00a323a391b41", - "00b59754edd24f61a38ea1ed4f1aa077", - "d7d032ad620448f2b18e6c4c06c7154f", - "fefec331bdc5456498084257b45a03b6", - "70d5e293d0a343ee813f8a5d57dcfd2d", - "7b7f296ea45d40aba5537caa21c47bf3", - "ff61a61119094626a738050955793c39", - "701c8174d1ea43cfa251c81708f1fc77", - "064dca1b1b824a908647633e4f72f71b", - "4188c72c71db4ecb82e754385003bcf4", - "b0d7fc82ccb34ed5b45448d581bf2727", - "ab70f467b69a47349a1c5d3839b884b9", - "4fc06fe12e514785a121c7ae1b9e0c97", - "c458935ca1564885b1195ad72beed0f6", - "7351dbf107194d1f9ed9d263dfe62f2c", - "c75799c0da57418fb2beceede73ba46b", - "f4e15b7446214c6f86cb0095711fe9f2", - "9ba3ea34fde448a2a478524403cc8038", - "c9ec17636a764edab3bb01eda508dca3", - "a5544445e9a04406bfe2185f53bfa799", - "a388d930425f462d831235f5f1f01d5a", - "3cb8f213216b4db4b17b6159ff8af1b2", - "7b26397bea754aaeb2e7c60852f182e4", - "ba0e140e43614be3a776cb929ed8d5bb", - "1ec9d7b1c71a440db6089c6539f680a3", - "fbef18bdfa234ff8b17413b096029fb8", - "e4c457574310465bbe2175c04874e996", - "c42d01f933044313b2860cabae5ce5ee", - "bcad04bb62194a10a94f1317a1292ead", - "40c801e68caf4b678ab85afae0ef4423", - "d98808d12cdc4bfc8f5423f8cdbba476", - "cbd8a118b2904c4a88c0c93abea26d44", - "38a5ae14a1ed4f248790e722ef07c632", - "4262b30ff3384960ada0f7042955027b", - "589d76442a81446f81ff107f0449ef35", - "86f9a8016dd741fe84808a5babf042a6", - "6df44ef8a0a142cca7d6af2bfc067cb6", - "a1910eeb981144dca95cf8e6dda49eb4", - "4a12f613fa4f4fc0881791941e1c8e0d", - "72d1f3de89dc45b3ad3dbfa93184f757", - "e91cb5eb1a894209b3599ba5eb3f215d", - "8e7db1dd82b5406e9c1b1699dc43b6dd", - "bd9ba4aaae6745dcb6b78effa1c8e937", - "c4a7299fdc564d09b5c662b2eeec51d1", - "bfeace42248941eaad5251bcee579dde", - "465a869777814955a2eff4f206bb3c91", - "f3e128dab6a24396b8deb3526a90040a", - "a623fa5f4e16419f99f40f8837228e7e", - "65c2905bddb9483cbe58b3711dfb400e", - "ccdd150660704acaa0e5bae0e44d8566", - "091fcb8d2a714647a2ece136d3ffeb07", - "e5221be381054945a6e4c507799f88a7", - "fef3a407898f44798e08baf4a27f5fcb", - "9637b86b7807491a84098c2114e691df", - "28c6d8a464d4483eb8abae01f4cf14db", - "a04fbcff413a4775b5e0476618069995", - "cfe231dfa61e4d2fb55d28535bde9dc4", - "0af9681c674541f5874c3eb7f1798ac4", - "c315d91e15f34eeaa4ee955f88e86285" - ] }, - "id": "kmmi1hs8EVHG", - "outputId": "21aa6b34-289c-4f42-e617-298c042a8391", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "No model was supplied, defaulted to facebook/bart-large-mnli (https://huggingface.co/facebook/bart-large-mnli)\n", - "loading configuration file https://huggingface.co/facebook/bart-large-mnli/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/980f2be6bd282c5079e99199d7554cfd13000433ed0fdc527e7def799e5738fe.4fdc7ce6768977d347b32986aff152e26fcebbda34ef89ac9b114971d0342e09\n", - "Model config BartConfig {\n", - " \"_name_or_path\": \"facebook/bart-large-mnli\",\n", - " \"_num_labels\": 3,\n", - " \"activation_dropout\": 0.0,\n", - " \"activation_function\": \"gelu\",\n", - " \"add_final_layer_norm\": false,\n", - " \"architectures\": [\n", - " \"BartForSequenceClassification\"\n", - " ],\n", - " \"attention_dropout\": 0.0,\n", - " \"bos_token_id\": 0,\n", - " \"classif_dropout\": 0.0,\n", - " \"classifier_dropout\": 0.0,\n", - " \"d_model\": 1024,\n", - " \"decoder_attention_heads\": 16,\n", - " \"decoder_ffn_dim\": 4096,\n", - " \"decoder_layerdrop\": 0.0,\n", - " \"decoder_layers\": 12,\n", - " \"decoder_start_token_id\": 2,\n", - " \"dropout\": 0.1,\n", - " \"encoder_attention_heads\": 16,\n", - " \"encoder_ffn_dim\": 4096,\n", - " \"encoder_layerdrop\": 0.0,\n", - " \"encoder_layers\": 12,\n", - " \"eos_token_id\": 2,\n", - " \"forced_eos_token_id\": 2,\n", - " \"gradient_checkpointing\": false,\n", - " \"id2label\": {\n", - " \"0\": \"contradiction\",\n", - " \"1\": \"neutral\",\n", - " \"2\": \"entailment\"\n", - " },\n", - " \"init_std\": 0.02,\n", - " \"is_encoder_decoder\": true,\n", - " \"label2id\": {\n", - " \"contradiction\": 0,\n", - " \"entailment\": 2,\n", - " \"neutral\": 1\n", - " },\n", - " \"max_position_embeddings\": 1024,\n", - " \"model_type\": \"bart\",\n", - " \"normalize_before\": false,\n", - " \"num_hidden_layers\": 12,\n", - " \"output_past\": false,\n", - " \"pad_token_id\": 1,\n", - " \"scale_embedding\": false,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"use_cache\": true,\n", - " \"vocab_size\": 50265\n", - "}\n", - "\n", - "loading configuration file https://huggingface.co/facebook/bart-large-mnli/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/980f2be6bd282c5079e99199d7554cfd13000433ed0fdc527e7def799e5738fe.4fdc7ce6768977d347b32986aff152e26fcebbda34ef89ac9b114971d0342e09\n", - "Model config BartConfig {\n", - " \"_name_or_path\": \"facebook/bart-large-mnli\",\n", - " \"_num_labels\": 3,\n", - " \"activation_dropout\": 0.0,\n", - " \"activation_function\": \"gelu\",\n", - " \"add_final_layer_norm\": false,\n", - " \"architectures\": [\n", - " \"BartForSequenceClassification\"\n", - " ],\n", - " \"attention_dropout\": 0.0,\n", - " \"bos_token_id\": 0,\n", - " \"classif_dropout\": 0.0,\n", - " \"classifier_dropout\": 0.0,\n", - " \"d_model\": 1024,\n", - " \"decoder_attention_heads\": 16,\n", - " \"decoder_ffn_dim\": 4096,\n", - " \"decoder_layerdrop\": 0.0,\n", - " \"decoder_layers\": 12,\n", - " \"decoder_start_token_id\": 2,\n", - " \"dropout\": 0.1,\n", - " \"encoder_attention_heads\": 16,\n", - " \"encoder_ffn_dim\": 4096,\n", - " \"encoder_layerdrop\": 0.0,\n", - " \"encoder_layers\": 12,\n", - " \"eos_token_id\": 2,\n", - " \"forced_eos_token_id\": 2,\n", - " \"gradient_checkpointing\": false,\n", - " \"id2label\": {\n", - " \"0\": \"contradiction\",\n", - " \"1\": \"neutral\",\n", - " \"2\": \"entailment\"\n", - " },\n", - " \"init_std\": 0.02,\n", - " \"is_encoder_decoder\": true,\n", - " \"label2id\": {\n", - " \"contradiction\": 0,\n", - " \"entailment\": 2,\n", - " \"neutral\": 1\n", - " },\n", - " \"max_position_embeddings\": 1024,\n", - " \"model_type\": \"bart\",\n", - " \"normalize_before\": false,\n", - " \"num_hidden_layers\": 12,\n", - " \"output_past\": false,\n", - " \"pad_token_id\": 1,\n", - " \"scale_embedding\": false,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"use_cache\": true,\n", - " \"vocab_size\": 50265\n", - "}\n", - "\n", - "loading weights file https://huggingface.co/facebook/bart-large-mnli/resolve/main/pytorch_model.bin from cache at /home/ubuntu/.cache/huggingface/transformers/35014754ae1fcb956d44903df02e4f69d0917cab0901ace5ac7f4a4a998346fe.a30bb5d685bb3c6e9376ab4480f1b252d9796d438d1c84a9b2deb0275c5b2151\n", - "All model checkpoint weights were used when initializing BartForSequenceClassification.\n", - "\n", - "All the weights of BartForSequenceClassification were initialized from the model checkpoint at facebook/bart-large-mnli.\n", - "If your task is similar to the task the model of the checkpoint was trained on, you can already use BartForSequenceClassification for predictions without further training.\n", - "loading configuration file https://huggingface.co/facebook/bart-large-mnli/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/980f2be6bd282c5079e99199d7554cfd13000433ed0fdc527e7def799e5738fe.4fdc7ce6768977d347b32986aff152e26fcebbda34ef89ac9b114971d0342e09\n", - "Model config BartConfig {\n", - " \"_name_or_path\": \"facebook/bart-large-mnli\",\n", - " \"_num_labels\": 3,\n", - " \"activation_dropout\": 0.0,\n", - " \"activation_function\": \"gelu\",\n", - " \"add_final_layer_norm\": false,\n", - " \"architectures\": [\n", - " \"BartForSequenceClassification\"\n", - " ],\n", - " \"attention_dropout\": 0.0,\n", - " \"bos_token_id\": 0,\n", - " \"classif_dropout\": 0.0,\n", - " \"classifier_dropout\": 0.0,\n", - " \"d_model\": 1024,\n", - " \"decoder_attention_heads\": 16,\n", - " \"decoder_ffn_dim\": 4096,\n", - " \"decoder_layerdrop\": 0.0,\n", - " \"decoder_layers\": 12,\n", - " \"decoder_start_token_id\": 2,\n", - " \"dropout\": 0.1,\n", - " \"encoder_attention_heads\": 16,\n", - " \"encoder_ffn_dim\": 4096,\n", - " \"encoder_layerdrop\": 0.0,\n", - " \"encoder_layers\": 12,\n", - " \"eos_token_id\": 2,\n", - " \"forced_eos_token_id\": 2,\n", - " \"gradient_checkpointing\": false,\n", - " \"id2label\": {\n", - " \"0\": \"contradiction\",\n", - " \"1\": \"neutral\",\n", - " \"2\": \"entailment\"\n", - " },\n", - " \"init_std\": 0.02,\n", - " \"is_encoder_decoder\": true,\n", - " \"label2id\": {\n", - " \"contradiction\": 0,\n", - " \"entailment\": 2,\n", - " \"neutral\": 1\n", - " },\n", - " \"max_position_embeddings\": 1024,\n", - " \"model_type\": \"bart\",\n", - " \"normalize_before\": false,\n", - " \"num_hidden_layers\": 12,\n", - " \"output_past\": false,\n", - " \"pad_token_id\": 1,\n", - " \"scale_embedding\": false,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"use_cache\": true,\n", - " \"vocab_size\": 50265\n", - "}\n", - "\n", - "loading file https://huggingface.co/facebook/bart-large-mnli/resolve/main/vocab.json from cache at /home/ubuntu/.cache/huggingface/transformers/b4f8395edd321fd7cd8a87bca767b1135680a41d8931516dd1a447294633b9db.647b4548b6d9ea817e82e7a9231a320231a1c9ea24053cc9e758f3fe68216f05\n", - "loading file https://huggingface.co/facebook/bart-large-mnli/resolve/main/merges.txt from cache at /home/ubuntu/.cache/huggingface/transformers/19c09c9654551e163f858f3c99c226a8d0026acc4935528df3b09179204efe4c.5d12962c5ee615a4c803841266e9c3be9a691a924f72d395d3a6c6c81157788b\n", - "loading file https://huggingface.co/facebook/bart-large-mnli/resolve/main/tokenizer.json from cache at /home/ubuntu/.cache/huggingface/transformers/540455855ce0a3c13893c5d090d142de9481365bd32dc5457c957e5d13444d23.fc9576039592f026ad76a1c231b89aee8668488c671dfbe6616bab2ed298d730\n", - "loading file https://huggingface.co/facebook/bart-large-mnli/resolve/main/added_tokens.json from cache at None\n", - "loading file https://huggingface.co/facebook/bart-large-mnli/resolve/main/special_tokens_map.json from cache at None\n", - "loading file https://huggingface.co/facebook/bart-large-mnli/resolve/main/tokenizer_config.json from cache at /home/ubuntu/.cache/huggingface/transformers/569800088d6f014777e6d5d8cb61b2b8bb3d18a508a1d8af041aae6bbc6f3dfe.67d01b18f2079bd75eac0b2f2e7235768c7f26bd728e7a855a1c5acae01a91a8\n", - "loading configuration file https://huggingface.co/facebook/bart-large-mnli/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/980f2be6bd282c5079e99199d7554cfd13000433ed0fdc527e7def799e5738fe.4fdc7ce6768977d347b32986aff152e26fcebbda34ef89ac9b114971d0342e09\n", - "Model config BartConfig {\n", - " \"_name_or_path\": \"facebook/bart-large-mnli\",\n", - " \"_num_labels\": 3,\n", - " \"activation_dropout\": 0.0,\n", - " \"activation_function\": \"gelu\",\n", - " \"add_final_layer_norm\": false,\n", - " \"architectures\": [\n", - " \"BartForSequenceClassification\"\n", - " ],\n", - " \"attention_dropout\": 0.0,\n", - " \"bos_token_id\": 0,\n", - " \"classif_dropout\": 0.0,\n", - " \"classifier_dropout\": 0.0,\n", - " \"d_model\": 1024,\n", - " \"decoder_attention_heads\": 16,\n", - " \"decoder_ffn_dim\": 4096,\n", - " \"decoder_layerdrop\": 0.0,\n", - " \"decoder_layers\": 12,\n", - " \"decoder_start_token_id\": 2,\n", - " \"dropout\": 0.1,\n", - " \"encoder_attention_heads\": 16,\n", - " \"encoder_ffn_dim\": 4096,\n", - " \"encoder_layerdrop\": 0.0,\n", - " \"encoder_layers\": 12,\n", - " \"eos_token_id\": 2,\n", - " \"forced_eos_token_id\": 2,\n", - " \"gradient_checkpointing\": false,\n", - " \"id2label\": {\n", - " \"0\": \"contradiction\",\n", - " \"1\": \"neutral\",\n", - " \"2\": \"entailment\"\n", - " },\n", - " \"init_std\": 0.02,\n", - " \"is_encoder_decoder\": true,\n", - " \"label2id\": {\n", - " \"contradiction\": 0,\n", - " \"entailment\": 2,\n", - " \"neutral\": 1\n", - " },\n", - " \"max_position_embeddings\": 1024,\n", - " \"model_type\": \"bart\",\n", - " \"normalize_before\": false,\n", - " \"num_hidden_layers\": 12,\n", - " \"output_past\": false,\n", - " \"pad_token_id\": 1,\n", - " \"scale_embedding\": false,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"use_cache\": true,\n", - " \"vocab_size\": 50265\n", - "}\n", - "\n" - ] - } - ], - "source": [ - "classifier = pipeline(\"zero-shot-classification\", device=0)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "VR7Qe56REVHH", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "Then, we feed the claim descriptions of the entire test set,\n", - "presenting the classifier with the list of possible choices as the second argument.\n", - "\n", - "We use the test set directly, because zero shot classification requires no training!\n", - "\n", - "On an AWS EC2 p2.xlarge instance, the run time is about 5 minutes." - ] - }, - { - "cell_type": "code", - "execution_count": 19, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" + "cell_type": "code", + "execution_count": 33, + "metadata": { + "id": "lfYLThd3scHW" + }, + "outputs": [], + "source": [ + "scores = np.dot(x, y.T)\n", + "selected = np.argmax(scores, axis=1)\n", + "pred = np.array([list(candidates.values())[i] for i in selected])" + ] }, - "id": "JLTEy0G8EVHH", - "outputId": "b237faa9-fa45-427c-a2fc-ba5bb249a878", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "Disabling tokenizer parallelism, we're using DataLoader multithreading already\n" - ] - } - ], - "source": [ - "res = classifier(ds[\"test\"][\"Description\"], list(choices.keys()))" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "amIfcKCREVHH" - }, - "source": [ - "This returns a list of `dict` with the following keys:\n", - "* **sequence** (`str`) — The sequence for which this is the output.\n", - "* **labels** (`List[str]`) — The labels sorted by order of likelihood.\n", - "* **scores** (`List[float]`) — The probabilities for each of the labels.\n", - "\n", - "We store the predictions in a Pandas DataFrame and evaluate the performance." - ] - }, - { - "cell_type": "code", - "execution_count": 20, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 + "cell_type": "markdown", + "metadata": { + "id": "vpE6-FbaVvUT" + }, + "source": [ + "For inspection, we generate a Pandas DataFrame and export it to an Excel file." + ] + }, + { + "cell_type": "code", + "execution_count": 34, + "metadata": { + "id": "N6vJhe_oyfxU" + }, + "outputs": [], + "source": [ + "df_scores = pd.DataFrame(columns=candidates.keys(), data=scores)\n", + "df_selected = pd.DataFrame(columns=[\"selected\"], data=selected)\n", + "df_pred = pd.DataFrame(columns=[\"pred\"], data=pred)\n", + "if not os.path.exists(\"./results\"):\n", + " os.mkdir(\"./results\")\n", + "pd.concat([df_valid, df_scores, df_pred], axis=1).to_excel(\"./results/zero_similarity_test.xlsx\")" + ] }, - "id": "rrOMsvGHRPHR", - "outputId": "4a8171ab-4fe2-461a-9c5a-3b2f2cee4dae" - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "Zero-shot-classification\n", - "accuracy score = 65.5%, log loss = 1.043, Brier loss = 0.463\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " Vandalism 0.93 0.44 0.59 310\n", - " Fire 0.68 0.70 0.69 46\n", - " Lightning 0.94 0.93 0.94 123\n", - " Wind 1.00 0.84 0.91 107\n", - " Hail 0.75 1.00 0.86 18\n", - " Vehicle 0.89 0.69 0.77 227\n", - " WaterNW 0.56 0.75 0.64 67\n", - " WaterW 0.00 0.00 0.00 38\n", - " Misc 0.25 0.83 0.38 103\n", - "\n", - " accuracy 0.66 1039\n", - " macro avg 0.67 0.69 0.64 1039\n", - "weighted avg 0.79 0.66 0.68 1039\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "ZKfBreSXhx98" + }, + "source": [ + "The performance is as follows:" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_peril_zero_a", - "format": "svg" - } - }, - "data": [ + "cell_type": "code", + "execution_count": 35, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 872 + }, + "id": "lEOYl-skt6by", + "outputId": "700a0c6f-b772-4c96-ba08-23621cf78d38" + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "xaxis": "x", - "y": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "yaxis": "y", - "z": [ - [ - 135, - 7, - 1, - 0, - 4, - 12, - 1, - 1, - 149 - ], - [ - 0, - 32, - 3, - 0, - 0, - 2, - 1, - 0, - 8 - ], - [ - 0, - 0, - 115, - 0, - 0, - 0, - 0, - 0, - 8 - ], - [ - 1, - 0, - 2, - 90, - 1, - 1, - 1, - 1, - 10 - ], - [ - 0, - 0, - 0, - 0, - 18, - 0, - 0, - 0, - 0 - ], - [ - 3, - 5, - 0, - 0, - 0, - 156, - 4, - 1, - 58 - ], - [ - 1, - 0, - 0, - 0, - 0, - 0, - 50, - 0, - 16 - ], - [ - 0, - 1, - 0, - 0, - 0, - 0, - 28, - 0, - 9 - ], - [ - 5, - 2, - 1, - 0, - 1, - 5, - 4, - 0, - 85 + "output_type": "stream", + "name": "stdout", + "text": [ + "Similarity\n", + "accuracy score = 74.5%, log loss = nan, Brier loss = nan\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " Vandalism 0.90 0.80 0.85 310\n", + " Fire 0.64 0.83 0.72 46\n", + " Lightning 0.80 0.95 0.87 123\n", + " Wind 0.91 0.84 0.87 107\n", + " Hail 0.67 1.00 0.80 18\n", + " Vehicle 0.88 0.71 0.79 227\n", + " WaterNW 0.48 0.88 0.62 67\n", + " WaterW 0.12 0.26 0.17 38\n", + " Misc 0.76 0.30 0.43 103\n", + "\n", + " accuracy 0.74 1039\n", + " macro avg 0.68 0.73 0.68 1039\n", + "weighted avg 0.80 0.74 0.75 1039\n", + "\n" ] - ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 14 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Zero-shot-classification" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } - } - } + ], + "source": [ + "_ = evaluate_classifier(np.array(df_valid[\"labels\"]), pred, None, labels, \"Similarity\", \"cm_peril_sim_a\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "rBb2NUiVh71w" }, - "text/html": [ - "
" + "source": [ + "This is not bad! We have already improved on the accuracy score obtained by the zero-shot classifier (using a different set of candidate expressions though).\n", + "\n", + "Let’s see how we can improve the results further." ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "proba = np.zeros((df_valid.shape[0], len(labels)))\n", - "for i, sample in enumerate(res):\n", - " for label, score in zip(sample[\"labels\"], sample[\"scores\"]):\n", - " proba[i, choices[label]] += score\n", - " proba[i, :] = proba[i, :] / np.sum(proba[i, :])\n", - "_ = evaluate_classifier(np.array(df_valid[\"labels\"]), None, proba, labels, \"Zero-shot-classification\", \"cm_peril_zero_a\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Biym_RIDEVHH", - "pycharm": { - "name": "#%% md\n" - } - }, - "source": [ - "On the test set, we achieve an accuracy of 65.5% (compared to 29.8% of the dummy classifier).\n", - "Apparently, the classifier struggles to correctly identify the `WaterW` cases based on the expression “Weather”.\n", - "Also, it seems that the expression “Misc” may not be the optimal choice, as it produces many false positives." - ] - }, - { - "cell_type": "code", - "execution_count": 21, - "metadata": { - "id": "4EG2NJ_FEVHH", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [], - "source": [ - "pred = [{\n", - " **{\"pred\"+str(i): choices[item[\"labels\"][i]] for i in range(10)},\n", - " **{\"score\"+str(i): item[\"scores\"][i] for i in range(10)}\n", - "} for item in res]\n", - "df_pred = pd.DataFrame(pred)\n", - "df_pred[[\"labels\", \"Description\"]] = df_valid[[\"labels\", \"Description\"]]" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "3z9s2Z7zEVHH" - }, - "source": [ - "\n", - "\n", - "### 3.2 Refinement\n", - "\n", - "To improve the performance on \"Misc\", we introduce the following heuristic:\n", - "If the probability assigned to the expression “Misc” is highest\n", - "but with a margin of less than 50 percentage points to the second-most likely expression, we select the latter." - ] - }, - { - "cell_type": "code", - "execution_count": 22, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 }, - "id": "GbSjWVZtEVHH", - "outputId": "70e5bf18-7280-4380-ccc7-3b37877ebd45", - "pycharm": { - "name": "#%%\n" - } - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "Zero-shot classification, refined\n", - "accuracy score = 69.7%, log loss = nan, Brier loss = nan\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " Vandalism 0.77 0.62 0.69 310\n", - " Fire 0.69 0.78 0.73 46\n", - " Lightning 0.92 0.94 0.93 123\n", - " Wind 0.91 0.85 0.88 107\n", - " Hail 0.58 1.00 0.73 18\n", - " Vehicle 0.62 0.77 0.69 227\n", - " WaterNW 0.54 0.78 0.63 67\n", - " WaterW 0.29 0.11 0.15 38\n", - " Misc 0.45 0.40 0.42 103\n", - "\n", - " accuracy 0.70 1039\n", - " macro avg 0.64 0.69 0.65 1039\n", - "weighted avg 0.70 0.70 0.69 1039\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "CEEIA6IT3lZE" + }, + "source": [ + "\n", + "\n", + "### 4.2. Refinement\n", + "\n", + "A possible way to improve the performance is to train a classifier using the predicted labels of the previous section. Although this is a supervised learning step, we are not using the original labels, therefore the overall approach is still unsupervised." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_peril_zero_b", - "format": "svg" - } - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "xaxis": "x", - "y": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "yaxis": "y", - "z": [ - [ - 191, - 7, - 2, - 8, - 8, - 70, - 3, - 2, - 19 - ], - [ - 0, - 36, - 3, - 0, - 1, - 3, - 1, - 0, - 2 - ], - [ - 1, - 0, - 116, - 0, - 0, - 2, - 0, - 2, - 2 - ], - [ - 3, - 0, - 2, - 91, - 1, - 2, - 1, - 4, - 3 - ], - [ - 0, - 0, - 0, - 0, - 18, - 0, - 0, - 0, - 0 - ], - [ - 19, - 6, - 2, - 1, - 0, - 175, - 6, - 2, - 16 - ], - [ - 5, - 0, - 0, - 0, - 1, - 1, - 52, - 0, - 8 - ], - [ - 3, - 1, - 0, - 0, - 0, - 0, - 29, - 4, - 1 - ], - [ - 25, - 2, - 1, - 0, - 2, - 27, - 5, - 0, - 41 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 14 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Zero-shot classification, refined" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } - } - } + "cell_type": "markdown", + "metadata": { + "id": "M4rgq9pLiJku" }, - "text/html": [ - "
" + "source": [ + "First, we predict the labels on the training set, the same way as before, and store them in the DataFrame `df_train_copy`:" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "def select_misc(row, threshold):\n", - " return row[\"pred1\"] if row[\"pred0\"] == 8 and row[\"score0\"] - row[\"score1\"] < threshold else row[\"pred0\"]\n", - "df_pred[\"pred*\"] = df_pred.apply(lambda x: select_misc(x, 0.5), axis=1)\n", - "_ = evaluate_classifier(np.array(df_pred[\"labels\"]), np.array(df_pred[\"pred*\"]), None, labels, \"Zero-shot classification, refined\", \"cm_peril_zero_b\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "VeEvTc2yEVHI" - }, - "source": [ - "We export the output to Excel to analyze the prediction errors." - ] - }, - { - "cell_type": "code", - "execution_count": 23, - "metadata": { - "id": "fVV5op92EVHI" - }, - "outputs": [], - "source": [ - "if not os.path.exists(\"./results\"):\n", - " os.mkdir(\"./results\")\n", - "df_pred.to_excel(\"results/peril_pred_zero_shot.xlsx\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "uucd4ButEVHI" - }, - "source": [ - "Looking at false predictions in the training set, we observe the following:\n", - "\n", - "* True label “Vandalism”, predicted label “Vehicle” or “Misc”: Quite many descriptions contain the word “glass”. For these claims, “Vandalism” appears to be a natural classification.\n", - " \n", - "* True label “Vehicle”, predicted label “Vandalism”: This group contains many descriptions like “light pole damaged”, “fence damaged”. Apparently, the zero-shot classifier does not realize that for these items, damage caused by a vehicle is more likely than damage caused by vandalism.\n", - "* True label “WaterW”, predicted label “WaterNW”: Some of the descriptions like “frozen pipe caused water damage to indoor pool”, “gutter pulled from roof ice dam”, “Water damage and mold growth from storms” suggest that the candidate word “Weather” is not optimal to attract all weather-related water claims.\n", - "\n", - "Based on these and similar observations, one could refine the approach by adding more candidate expressions, e.g., adding “glass” to hazard type 0 (“Vandalism”), “light pole” and “fence” to hazard type 5 (“Vehicle”), “storm” and “ice” to hazard type 7 (“WaterW”), etc.\n", - "\n", - "However, the computational effort of zero-shot classification scales with the number of candidate expressions times number of samples, so that we don't want to supply too many candidate expressions.\n", - "Ideally, we would have an approach to extract candidate expressions from the data.... \n", - "\n", - "We will look at such an approach in [Section 5](#topic_modeling).\n", - "Before going there, the next section offers an alternative approach with less computational effort than zero-shot classification." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "csG9Uh15maLE" - }, - "source": [ - "\n", - "\n", - "## 4. Unsupervised Classification Using Similarity\n", - "\n", - "This approach is similar to the previous one. It is also suitable in situations with no or only few labeled data.\n", - "\n", - "The model is presented with a text sequence and a list of expressions, and selects the expression which is most \"similar\" to the text sequence. \n", - "Here, we use cosine-similarity, which is defined as the dot product of two embedding vectors, each normalized to unit length." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "vkqpIohSob7s" - }, - "source": [ - "\n", - "\n", - "### 4.1 Demonstration of the approach\n", - "\n", - "In this section you will learn how to perform unsupervised classification using similarity.\n", - "\n", - "Again, we will try to predict the peril type from the claim descriptions.\n", - "\n", - "First, we create a dictionary that maps certain verbal expression to peril types:" - ] - }, - { - "cell_type": "code", - "execution_count": 24, - "metadata": { - "id": "A-MB8vWeo9Qa" - }, - "outputs": [], - "source": [ - "candidates = OrderedDict({\n", - " \"Vandalism\": 0,\n", - " \"Glass\": 0,\n", - " \"Theft\": 0,\n", - " \"Fire damage\": 1,\n", - " \"Lightning damage\": 2,\n", - " \"Wind damage\": 3,\n", - " \"Hail damage\": 4,\n", - " \"Damage caused by a vehicle\": 5,\n", - " \"Water damage\": 6,\n", - " \"Weather damage\": 7,\n", - " \"Ice\": 7,\n", - " \"Electricity\": 8,\n", - " \"power surge\": 8})" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "5JhbMQjepls9" - }, - "source": [ - "As you can see, we have applied some of the lessons learned from the previous experiments with the zero-shot classifier. For instance, we have added \"Glass\" to the list of candidate expressions mapped to \"Vandalism\"." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Coa6gM93qNZv" - }, - "source": [ - "We use the model ``sentence-transformers/all-MiniLM-L12-v2``, which is a BERT model that produces a sequence of real-valued vectors of length 384. During its pre-training on sentence similarity tasks, mean pooling was applied to convert this sequence into a single vector." - ] - }, - { - "cell_type": "code", - "execution_count": 25, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" }, - "id": "65gL10u6q0_F", - "outputId": "39e9484a-666e-467e-cf92-43d3456ab522" - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "loading file https://huggingface.co/sentence-transformers/all-MiniLM-L12-v2/resolve/main/vocab.txt from cache at /home/ubuntu/.cache/huggingface/transformers/8453639ef9bce7fd3334f2ffcc63f19ffa3ff3b8b0aec5ee8741d0d59ab5eb31.d789d64ebfe299b0e416afc4a169632f903f693095b4629a7ea271d5a0cf2c99\n", - "loading file https://huggingface.co/sentence-transformers/all-MiniLM-L12-v2/resolve/main/tokenizer.json from cache at /home/ubuntu/.cache/huggingface/transformers/c0d6cf2687a28e7fdc2d77fc4b172632b15debbafe3f381b3d800782b3bb28fc.b1d3b19ab013240a348484166f1a44749cad6f108156f07e3784cbf6c2a27772\n", - "loading file https://huggingface.co/sentence-transformers/all-MiniLM-L12-v2/resolve/main/added_tokens.json from cache at None\n", - "loading file https://huggingface.co/sentence-transformers/all-MiniLM-L12-v2/resolve/main/special_tokens_map.json from cache at /home/ubuntu/.cache/huggingface/transformers/759b5b75ca69b02d11c5dc31d4e00cbcb38ad91929ab3ca2f0c6bf6dc9459b1e.dd8bd9bfd3664b530ea4e645105f557769387b3da9f79bdb55ed556bdd80611d\n", - "loading file https://huggingface.co/sentence-transformers/all-MiniLM-L12-v2/resolve/main/tokenizer_config.json from cache at /home/ubuntu/.cache/huggingface/transformers/3a7676bf5f7cb02094e1801ae25a698f8a4a6866ba2460a42461b62dac7b1334.5b23e166abf4f8000a0354959c4020a8884f59070a6d651fea41ed5c12d74910\n", - "loading configuration file https://huggingface.co/sentence-transformers/all-MiniLM-L12-v2/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/a46191c34f15e96c8728222b3df77a916eb326096e81d5197b2ce8b95ab23a2a.58abd84a9ec36b7a88d68f5a4f944253c7454868833676e579e2b47196f2d068\n", - "Model config BertConfig {\n", - " \"_name_or_path\": \"sentence-transformers/all-MiniLM-L12-v2\",\n", - " \"attention_probs_dropout_prob\": 0.1,\n", - " \"classifier_dropout\": null,\n", - " \"gradient_checkpointing\": false,\n", - " \"hidden_act\": \"gelu\",\n", - " \"hidden_dropout_prob\": 0.1,\n", - " \"hidden_size\": 384,\n", - " \"initializer_range\": 0.02,\n", - " \"intermediate_size\": 1536,\n", - " \"layer_norm_eps\": 1e-12,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"bert\",\n", - " \"num_attention_heads\": 12,\n", - " \"num_hidden_layers\": 12,\n", - " \"pad_token_id\": 0,\n", - " \"position_embedding_type\": \"absolute\",\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"type_vocab_size\": 2,\n", - " \"use_cache\": true,\n", - " \"vocab_size\": 30522\n", - "}\n", - "\n", - "loading weights file https://huggingface.co/sentence-transformers/all-MiniLM-L12-v2/resolve/main/pytorch_model.bin from cache at /home/ubuntu/.cache/huggingface/transformers/d44255b116c329ad3895f8436d9a62d72aac4ddff7017b906d59a3f00e9e27c5.89e6bd2185b4194bc0170670472dca8e5818c9c1e9f6cea8b8650d3fa2f1262b\n", - "All model checkpoint weights were used when initializing BertModel.\n", - "\n", - "All the weights of BertModel were initialized from the model checkpoint at sentence-transformers/all-MiniLM-L12-v2.\n", - "If your task is similar to the task the model of the checkpoint was trained on, you can already use BertModel for predictions without further training.\n" - ] - } - ], - "source": [ - "model_name = \"sentence-transformers/all-MiniLM-L12-v2\"\n", - "tokenizer = AutoTokenizer.from_pretrained(model_name)\n", - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "model = AutoModel.from_pretrained(model_name).to(device)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "p7ojKresUJIY" - }, - "source": [ - "Next, we generate the sentence embeddings of the claim descriptions. To this end, we tokenize them and then pass them into the helper function `extract_sequence_encoding`, which applies the transformer encoder and extracts the last hidden state. Mean pooling is applied, in line with the way the model was pre-trained. The value `True` is passed with key word argument `normalize` to enforce normalization of the output vector to unit length in the Euclidean norm. " - ] - }, - { - "cell_type": "code", - "execution_count": 26, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0, - "referenced_widgets": [ - "b560f1a23b664f19b3025e200ee52ba2", - "8f3f3bc6709340cb8256a29186d167ca", - "33a0207a4af444c0a62de263d5772590", - "60099a13723c4e1c97b4eeb6909faf64", - "1369dd9f01474e18ad1d1f0cec6cb77a", - "3e3f7f53c2d949ebbc9b41d2eec97a4b", - "61482c60ad804e2fb3e195b9c3daf54e", - "abf058cbf4d0482eb0b7d3c5cb2dac0c", - "bd085d626c39431c87272f1775c31725", - "44585c198e864e9f86c6c69d466d3031", - "af16e2ef100240498a1cec6c85719307", - "2ac2219e56074d8a9c6a276a0742c618", - "dd49d64d85e24fa8b1b6bc33804fc597", - "993d9d6c6c3942cea4abd0852253257f", - "6dc91b7ebdf041bab30eb87fb25d80cf", - "92640e149e0640efbf76f5d1c0a69012", - "bfd22ee5ae88497cb077f75071249dde", - "27d41f8299cb473180149d8504862c09", - "099e5c754c404468a90fb9247cc0bbdc", - "962e5812ab924251b94c65ed1d6689db", - "fee2373861754a5aa57deca0fe0a549f", - "62cfc810ac124d2e801c0166c4cc49a8", - "a0bddffbbc794534bd008fb8bbc31153", - "dcee270b34da412fa65ebeffdfa75f66", - "844ba52e1f6947f790fe4add513e398a", - "a5ffca33779d4dfca4e7aa8c6780c88a", - "225b0156f4354ab0a5df66a2d58017d6", - "8e092557c85b4112b493f0abbcd00835", - "b5709e8c44fa41da92ce6553466c4781", - "80f9504c61574e52ab1d4adcc62d62a6", - "5671ca67fe5347dc9ce8d78bdc84f147", - "cb9672f222594a2ca19b89b286da2bed", - "7b10b5954a0f45fa8435e4255a208d49", - "fd0b9cfbcbe043508af4da14b2c3b5d3", - "724e61cdd8074ae99517fae53bc06854", - "2eaea0dc84ed4ebfba680f2fcfa04637", - "0d6060ee7aec42d492f9bb1e4b8f2ce4", - "4d6ec2b0c2bc435e9d3fcbdff951b29b", - "0edf2e575f3347f287a964f4e1f3fc49", - "0d15af1100e1498bbcc991f5b78adc59", - "2d1a52b80c5a4213a6dc911524663467", - "bd967c22dcca4384b1f2ef93792eec5b", - "ecb380ec3dc849c983440cb1b73bfa30", - "1de320a9241847a894efd02932b989b7" - ] + "cell_type": "code", + "execution_count": 36, + "metadata": { + "id": "NjT3zaHM3sNv" + }, + "outputs": [], + "source": [ + "x_train = np.array(ds_sim[\"train\"][\"mean_hidden_state\"])\n", + "scores = np.dot(x_train, y.T)\n", + "selected = np.argmax(scores, axis=1)\n", + "pred = np.array([list(candidates.values())[i] for i in selected])\n", + "\n", + "df_train_copy = df_train.copy()\n", + "df_train_copy[\"labels\"] = pred" + ] }, - "id": "EV0qy1wNrHuJ", - "outputId": "d10b40ff-8731-4b71-c4f4-10145e593c37" - }, - "outputs": [ { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "bd1193f498234674bc75278377c704ec", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "uNcUCbopiSMA" }, - "text/plain": [ - " 0%| | 0/5 [00:00" + ], + "text/html": [ + "\n", + "
\n", + " \n", + " \n", + " [624/624 00:30, Epoch 1/1]\n", + "
\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
StepTraining Loss
6230.437100

" + ] + }, + "metadata": {} + } + ], + "source": [ + "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model\n", + "model = AutoModelForSequenceClassification.from_pretrained(model_name, num_labels=len(labels)).to(device)\n", + "\n", + "# train the model\n", + "batch_size = 8\n", + "logging_steps = len(ds_train_copy) // batch_size\n", + "training_args = TrainingArguments(\n", + " output_dir=model_name+\"_peril_s_epochs\",\n", + " num_train_epochs=1,\n", + " per_device_train_batch_size=batch_size,\n", + " per_device_eval_batch_size=batch_size,\n", + " metric_for_best_model=\"f1\",\n", + " logging_steps=logging_steps,\n", + " save_strategy=trainer_utils.IntervalStrategy.NO,\n", + ")\n", + "trainer = Trainer(model=model, args=training_args,\n", + " compute_metrics=compute_metrics, train_dataset=ds_train_copy,\n", + " eval_dataset=ds_train_copy)\n", + "trainer.train();\n", + "trainer.save_model(model_name + \"_peril_s\")" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "ds_candidates = Dataset.from_dict({\"Description\": candidates.keys()})\n", - "ds_candidates = ds_candidates.map(tokenize, batched=True)\n", - "ds_candidates = ds_candidates.map(extract_sequence_encoding, fn_kwargs={\"model\": model, \"normalize\": True}, batched=True)\n", - "y = np.array(ds_candidates[\"mean_hidden_state\"])" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "1DLkEGHiVwsJ" - }, - "source": [ - "Finally, we calculate the pairwise cosine similarity scores by the dot product of the two arrays, and greedily select the peril type with the highest score." - ] - }, - { - "cell_type": "code", - "execution_count": 28, - "metadata": { - "id": "lfYLThd3scHW" - }, - "outputs": [], - "source": [ - "scores = np.dot(x, y.T)\n", - "selected = np.argmax(scores, axis=1)\n", - "pred = np.array([list(candidates.values())[i] for i in selected])" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "vpE6-FbaVvUT" - }, - "source": [ - "For inspection, we generate a Pandas DataFrame and export it to an Excel file." - ] - }, - { - "cell_type": "code", - "execution_count": 29, - "metadata": { - "id": "N6vJhe_oyfxU" - }, - "outputs": [], - "source": [ - "df_scores = pd.DataFrame(columns=candidates.keys(), data=scores)\n", - "df_selected = pd.DataFrame(columns=[\"selected\"], data=selected)\n", - "df_pred = pd.DataFrame(columns=[\"pred\"], data=pred)\n", - "if not os.path.exists(\"./results\"):\n", - " os.mkdir(\"./results\")\n", - "pd.concat([df_valid, df_scores, df_pred], axis=1).to_excel(\"./results/zero_similarity_test.xlsx\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "ZKfBreSXhx98" - }, - "source": [ - "The performance is as follows:" - ] - }, - { - "cell_type": "code", - "execution_count": 30, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 }, - "id": "lEOYl-skt6by", - "outputId": "e80f76a5-837d-4b3d-c87a-9ef56477b93d" - }, - "outputs": [ { - "name": "stdout", - "output_type": "stream", - "text": [ - "Similarity\n", - "accuracy score = 74.5%, log loss = nan, Brier loss = nan\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " Vandalism 0.90 0.80 0.85 310\n", - " Fire 0.64 0.83 0.72 46\n", - " Lightning 0.80 0.95 0.87 123\n", - " Wind 0.91 0.84 0.87 107\n", - " Hail 0.67 1.00 0.80 18\n", - " Vehicle 0.88 0.71 0.79 227\n", - " WaterNW 0.48 0.88 0.62 67\n", - " WaterW 0.12 0.26 0.17 38\n", - " Misc 0.76 0.30 0.43 103\n", - "\n", - " accuracy 0.74 1039\n", - " macro avg 0.68 0.73 0.68 1039\n", - "weighted avg 0.80 0.74 0.75 1039\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "Zb40jPS-iulN" + }, + "source": [ + "… and evaluate the performance on the test set:" + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_peril_sim_a", - "format": "svg" - } - }, - "data": [ + "cell_type": "code", + "execution_count": 40, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 872 + }, + "id": "cU3f6uVc9gjU", + "outputId": "85fe8509-4a30-482d-9323-1b240b6f37ee" + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "xaxis": "x", - "y": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "yaxis": "y", - "z": [ - [ - 249, - 8, - 4, - 3, - 3, - 6, - 7, - 26, - 4 - ], - [ - 1, - 38, - 3, - 1, - 0, - 0, - 1, - 1, - 1 - ], - [ - 0, - 0, - 117, - 0, - 0, - 1, - 1, - 1, - 3 - ], - [ - 3, - 0, - 2, - 90, - 2, - 0, - 0, - 10, - 0 - ], - [ - 0, - 0, - 0, - 0, - 18, - 0, - 0, - 0, - 0 - ], - [ - 5, - 9, - 17, - 3, - 3, - 162, - 13, - 14, - 1 - ], - [ - 3, - 0, - 1, - 0, - 0, - 0, - 59, - 3, - 1 - ], - [ - 0, - 0, - 0, - 0, - 0, - 0, - 28, - 10, - 0 - ], - [ - 17, - 4, - 3, - 2, - 1, - 15, - 15, - 15, - 31 + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [] + }, + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Simularity, refined\n", + "accuracy score = 75.9%, log loss = 1.156, Brier loss = 0.410\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " Vandalism 0.90 0.86 0.88 310\n", + " Fire 0.56 0.76 0.64 46\n", + " Lightning 0.80 0.94 0.87 123\n", + " Wind 0.97 0.80 0.88 107\n", + " Hail 0.90 1.00 0.95 18\n", + " Vehicle 0.89 0.73 0.80 227\n", + " WaterNW 0.44 0.90 0.59 67\n", + " WaterW 0.11 0.18 0.14 38\n", + " Misc 0.87 0.32 0.47 103\n", + "\n", + " accuracy 0.76 1039\n", + " macro avg 0.71 0.72 0.69 1039\n", + "weighted avg 0.82 0.76 0.77 1039\n", + "\n" ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 14 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "

\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "predictions = trainer.predict(ds[\"test\"])\n", + "_ = evaluate_classifier(predictions.label_ids, None, softmax(predictions.predictions, axis=1), labels, \"Simularity, refined\", \"cm_peril_sim_b\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "jbpNYDeKi1MT" + }, + "source": [ + "The accuracy score has improved by about 2 percentage points.\n", + "\n", + "Compared to the results obtained by zero-shot classification, we observe that the confusion between “Vandalism” and “Vehicle” has strongly reduced. This might be at least partially due to the fact that we have used different candidate expressions.\n", + "\n", + "For a fair comparison, you might want to go back and re-run the zero-shot classification using the new candidate expressions. However, you will have noticed that the sentence similarity approach is much faster to execute. The computational effort for both approaches is dominated by running the respective transformer model. For the zero-shot classification, the model is run behind the scenes for each combination of sample and candidate expression, so that the effort scales with the number of samples times the number of candidate expressions. In contrast, as we have seen above, the similarity approach runs the transformer model once for each input sample and once for each candidate expression, so that the effort scales with the number of samples plus the number of candidate expressions. This allows experimenting with different candidate expressions." + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "QO_xTyOKEVHI" + }, + "source": [ + "\n", + "\n", + "## 5. Unsupervised Topic Modeling by Clustering of Document Embeddings\n", + "\n", + "In the previous section we have seen the strength of zero-shot classification:\n", + "No prior training of the language model is required to produce a classification of reasonable quality.\n", + "However, it may be difficult to provide suitable candidate expressions.\n", + "\n", + "In this section, we present an alternative approach.\n", + "\n", + "The idea is to encode all text samples, to create clusters of \"similar\" documents and to extract meaningful\n", + "verbal representations of the clusters.\n", + "\n", + "Several packages are available to perform this task, e.g.,\n", + "[BERTopic](https://maartengr.github.io/BERTopic/index.html),\n", + "[Top2Vec](https://github.com/ddangelov/Top2Vec) and\n", + "[chat-intents](https://github.com/dborrelli/chat-intents).\n", + "These packages use similar concepts but provide different APIs, hyper-parameters, diagnostics tools, etc.\n", + "\n", + "Here, we use BERTopic.\n", + "\n", + "The algorithm consists of the following steps:\n", + "\n", + "1. **Embed documents:**\n", + " * Encode each text sample (document) into a vector - the embedding.\n", + " This can be based on a BERT model or any other document embedding technique.\n", + " By default, BERTopic uses `all-MiniLM-L6-v2`, which is trained in English.\n", + " In the multi-lingual case it uses `paraphrase-multilingual-MiniLM-L12-v2`.

\n", + "\n", + "2. **Cluster documents:**\n", + " * Reduce the dimensionality of the embeddings.\n", + " This is required because the documents embeddings are high-dimensional,\n", + " and typically, clustering algorithms have difficulty clustering data in high dimensional space.\n", + " By default, BERTopic uses\n", + " [UMAP (Uniform Manifold Approximation and Projection for Dimension Reduction)](https://umap-learn.readthedocs.io/en/latest/)\n", + " as it preserves both the local and global structure of embeddings quite well.
\n", + "\n", + " * Create clusters of semantically similar documents.\n", + " By default, BERTopic uses\n", + " [HDBSCAN](https://hdbscan.readthedocs.io/en/latest/)\n", + " as it allows to identify outliers.

\n", + "\n", + "3. **Create topic representation:**\n", + " * Extract and reduce topics with c-TF-IDF.\n", + " This is a modification of TF-IDF, which applies TD-IDF to the concatenation of all documents within each document cluster,\n", + " to obtain importance scores for the words within the cluster.\n", + " \n", + " * Improve coherence and diversity of words with Maximal Marginal Relevance, to find the most coherent words without having too much overlap between the words themselves. This results in the removal of words that do not contribute to a topic.\n", + " \n", + "Let's apply the algorithm to our dataset and examine the results." + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "wds9A1oIEVHI" + }, + "source": [ + "\n", + "\n", + "### 5.1. Basic topic modeling\n", + "\n", + "Normally, BERTopic instantiates UMAP and HDBSCAN automatically.\n", + "Here, we instantiate them manually and pass them to BERTopic, for the following reasons:\n", + "\n", + "* For UMAP, we specify `random_state=42`, to improve reproducibility across runs. Please note that reproducibility across platforms is not guaranteed.\n", + "\n", + "* For HDBSCAN, we specify `min_cluster_size=30` and `min_samples=1` in order to control the number of clusters and the percentage of samples classified as outliers.\n", + "\n", + "Otherwise, we use the default parameters used by BERTopic." + ] + }, + { + "cell_type": "code", + "execution_count": 41, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000, + "referenced_widgets": [ + "0a93b0ad407449ffb60629889468f722", + "545539439faa4dd68428ba67c8497efb", + "78dd7d0bb9a94aaea598d1154da76314", + "605cab64c1454b16ae4fa738fe749222", + "293771f688a5487caa6852958c93c1e2", + "8dcd26bbf7084ce599d4f793e50f0433", + "a0c16d99783740469f83a1451561e2a3", + "b029308c7f2741e2be2d41bed714424b", + "b4517d2b1bf7483995ab260bf21376c8", + "ad89c7a7393644e69e462b04f912079d", + "c98ceb9a76224a2e9d379e2e3f2b1643", + "d8e09e61568a467c928f1a810d5dacf7", + "0f5f6a7b0f944dd9be63047ecbd1052f", + "7855b8efab284ad58f64fc35ffc130ce", + "ad2bc40eec7344a0bd4cab0461952fbb", + "8256b776f57246ad9763b1560395d4b5", + "758e8f60f8f2407abd27e9ba6c27caa1", + "6d86c1e2d4b54e998e63516991747611", + "54b3fd81ee77419d8d3969aac3b75c1c", + "908c7f7f09624aaca95553aed79af6a1", + "9c41b1d1ad84442688442fdcb61479fd", + "7edf0149002045e9b48eb4d50c9f5943", + "a57fb66bfbdd427881a9e3825e3c477b", + "1f83e073333f4280b3265842151588e3", + "39e27c577a994959afd7cf01d5ae58ec", + "5a125462ef474964a68f5d1ca863d48a", + "3c4ee169ef1744dab58d4299047efe3b", + "cf72fda1a65c4a73bf422998fb8100a4", + "de764140bba446afb6faa7cf4b64130b", + "ec2f29cfa86a4d60bd9c0b97a4e4eaa0", + "061c896648b241d9b6844cce5cbe9384", + "47338744bb804702a918aa01c15dac3c", + "a380b4c20a0f48e3ab60f64815aa6371", + "3adb7f184b394e1f9c0e1d972dd74824", + "2feb0dea2733457eb4fe564c4c6c3638", + "cc653b9583c64e7296a5a7aee00f4d71", + "af558c5ada404484ac68934e8ec72874", + "c79a60b8fa4b45d7acc70c4ea6fda415", + "7fa300386dd240798331bcbdc7beb04e", + "04922f056ede4cc28e16aca5ef771120", + "045ddc78143b445494f8c78672f081af", + "28647e49f768427094f2de4689711c6a", + "e143aef52827432e84ccd648d25e79da", + "8689afc30539442d88d6add9acc43ced", + "da9f459e78334daeaf85d15efce5cabb", + "ef9e43f56cee405cb88e7111886be517", + "bd56d5bf6f3e45e99c746c4414f24f79", + "e5f97293ce03488398ee7eff2b7acb65", + "00b4a55efa1f440cb9427fc3261d1e12", + "bcac9643e7d846b4a1b03a5605042976", + "fd7f741ef4054ab7b8bc692e4b71e04b", + "72800938513345898591b1fe44810aaf", + "14fe74db8e4c4977803b462bc941af24", + "bb7a6e56d5e84db78fa525aeb533e546", + "7557209fd8784f3d9c614f230b3a4547", + "241075466ab6455eb52ac3072766046b", + "905a4aae088846319dd660c39971be1b", + "1c85bfbd56864c538fb33fbb066c437d", + "fdda33f9ab734b4c88b9c6c1facae84b", + "0db9b2f2ee2446859095a082c35d3111", + "17e12f0e81274ace8e6741644d57516a", + "c8162a3c0ecb4849b8715026656174cc", + "1853a24008f54bd18d730d8d3f70a7a7", + "0d2d84b74bba49269851798b8e75191a", + "a78062463dd94f4c8ad4453684017d5d", + "ebd5f31cbe5c4694ae21ed3de5a558cb", + "3763bc3b756e443aa83bbcfcbe56ea9b", + "403eff6c9efe48da858f22802297a625", + "780e4d663a4f45e087650776fb5fd4bd", + "ed796dd3445c40cd9bdbe5dd8115f0b9", + "e39c3c4eb2db4d8b80cbf86157cfdcf3", + "2b4e8ed72673494bb9531d22f37aa37f", + "fc0504f969c34a5999c2f046a17b9e58", + "2e60b7e5121b4f4cbe02c5e70d2436c4", + "831417d971094b00b38d000e105556e1", + "207b5bde178c48b6983ae98bd90372b9", + "bfe0555f0672497485e69bc7d156111e", + "96250a8028524757a432ec794b438d0e", + "81a571f6382b45eabf40398b549b674d", + "b5e18c4c4f3a4a3e9a5d8aa89b3c7222", + "8ccd518744fa427fbd7466a192204f2d", + "3205286f337a482abe1999891a56db15", + "2fd85852c8a446b794bef0414a5d1b42", + "cd2a8dd704e44787ae3e280451d36f39", + "33c9c9474d94430da4d8b1176c71b184", + "3040da57fc3a491ca95c3ef746bd813c", + "44bb15aeab564ca6a5b34a9c2941e298", + "529b6d913e8a4f2eb7caae1219e95d38", + "681b5052bf724cdca9d6a2d73114c1d1", + "e53e9a1c02094db29f15099da40103cd", + "6200267d273b48b3a35ac140de49630b", + "1433d12e4c874c79bbbb0286d4eacde4", + "21f44d8a27be4f1aa0b0203ddc3527b1", + "da7e7b42d0c2431e93a0189229cbbc5b", + "151f9c76297b4ca3bf6b71b08345e0dd", + "25099eccf4e84cb49fd9ed8b0ed3184f", + "a1b8a7e0639c4170b826da2775ddc5df", + "02c1215b364e4c7b9383b86c6daa4472", + "568133b1fa894d4288cc0cd302b851ef", + "6faba8ae0c8b40b69543f3e91a67d225", + "d4816bb72f82473ca29bbcb0b37ffb68", + "ddd9638742da46c4a3a82881dbe79846", + "59f257cf1c6d44b090426525857c140a", + "40fe1b409e494a88b33cd34dc2aa6616", + "d66ed2383e71446daa92c192ffb68ce5", + "0d8c13840d9b46b1895563aa41fcbd72", + "62e674c59ad84a2fa3f6f3f4e333db61", + "4ca5212c96054392871b75a0ef5c6875", + "494979dd889744de9314ede61e10d2c1", + "a18dfa4b3fc14f278e1c875d54cb6341", + "37ffffeff297428da5b29b512360f939", + "f98261d50e2d400a84eaad5f4bc3a757", + "0390606e1b964339a9a2802f0461a380", + "21499c4a84784d8a80cfff923ec4f593", + "284f5506aa834873955e5b8e3539a60a", + "9f99f1b0afed481b8efc1a04788cdac8", + "6af24361f81243fca3cf416c487d08c7", + "3f72b06f37bb457caffe815207c6af7c", + "7ce328cb515342929c3e9bc538e90763", + "100bd06a11b14becb016ec629683188e", + "d5f600e9d25b46e3a8acc6e66e69de36", + "cea3f981bbce4ab094b9b7d3cd1e3426", + "9fe070e4921c4aad95cfccb370ba14e5", + "fc84582f240d4c208f10e37a4a8c8454", + "573eb6654161424d89404c222301a17f", + "12ae0b0ee8f34ccea5289edfb174e387", + "ec1d511a8d874500902a03a05dbc728a", + "3e41a4ad2a13400595ac057fe4d6f54e", + "cf2f0bb859254cd1bbcd489e8b7de593", + "962d3c30407a4a97b75c5c44e7dfc468", + "5802642641a34552aeb8952350032e24", + "0df6988eac6d4dedbdc732a41d4330f9", + "c6c975acadf940c0b04c2eaaf06aa60a", + "b1128267ec774682ba6c8237b746c96e", + "c914b15925f7492a9201b63cf6912e5c", + "9abfa4ffcf2547ab8b297c694f4a35a2", + "26e5d6f0d5094bada101e7077c942e80", + "ad90886ea329457fae3bc83d3499872f", + "af63497d6ccd4e36abf8757b54199ef6", + "bad55ae359834077b82d5d9379313c22", + "ddc1de26de03472ea8e1fb05fcb1cb6b", + "fd3ea26946c84b50aac2082bcd5ebcc3", + "c88407178fbb4612b1b8222c3164b6d5", + "7069d66194ea4426be8dc0d7ed47b6d3", + "0bf3bcdf23354ea1847360045d26d9a1", + "92c107fc11ec477b92401c97cb4b3338", + "59792503e5d4455599186d5ff902821b", + "922a567fcc724b59b9d6f63adb843459", + "1e0ab24cf65b4c03a6e3becdfbb21387", + "26431386aa6d4cc0aa49dd3edc03f950", + "5e48399e1c9e42339da52ebfc09b8dcb", + "7775e97259be4f928888070a7c43fcb1", + "e8a81f5b13e04735ba62bdbe90174e76", + "2fdb513e2bab417bb86ce04500531f92" ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 + }, + "id": "ILamlptxEVHI", + "outputId": "76d51c44-c736-4735-f6ce-72618516e07c" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Downloading (…)e9125/.gitattributes: 0%| | 0.00/1.18k [00:00\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
TopicCountNameRepresentationRepresentative_Docs
0-1662-1_lightning_water_damage_wwtp[lightning, water, damage, wwtp, ms, siren, at...[theft of laptop Washington MS ...
107000_vandalism_park_dmg_shelter[vandalism, park, dmg, shelter, at, pavilion, ...[a/c vandalism ...
212371_glass_vandalism_west_es[glass, vandalism, west, es, ms, at, lincoln, ...[glass vandalism at HS ...
322032_fire_smoke_damage_equipment[fire, smoke, damage, equipment, station, park...[fire & smoke damage at Fire Station #7 ...
431803_phone_lightning_system_to[phone, lightning, system, to, compressor, com...[lightning damaged phone system ...
541784_power_surge_generator_spoilage[power, surge, generator, spoilage, food, outa...[power surge damage ...
651775_froze_pipe_sewer_pipes[froze, pipe, sewer, pipes, library, ice, up, ...[pipe froze and water damage ...
761646_theft_of_stolen_break[theft, of, stolen, break, from, in, wire, cam...[theft of equipment from vehicle ...
871467_graffiti_on_kennedy_hoyt[graffiti, on, kennedy, hoyt, llm, wall, doors...[graffiti at West ...
981218_lightning_damage_scale_dpw[lightning, damage, scale, dpw, museum, nasonv...[lightning damage ...
1091049_signal_traffic_damaged_box[signal, traffic, damaged, box, paradise, knoc...[traffic signal damaged ...
111010310_broken_door_glass_breakage[broken, door, glass, breakage, entrance, brok...[broken door/glass at LaFollette HS ...
121110111_fence_plow_gate_by[fence, plow, gate, by, damaged, vehicle, snow...[fence gate damaged by vehicle ...
13129312_roof_wind_shingles_blew[roof, wind, shingles, blew, collapsed, off, w...[wind damage to roof ...
14138313_hydrant_fire_hit_damaged[hydrant, fire, hit, damaged, run, plow, vehic...[fire hydrant damaged ...
15148114_wind_storage_damage_tower[wind, storage, damage, tower, antenna, to, te...[wind damage ...
16158115_llm_glass_mendota_hawk[llm, glass, mendota, hawk, black, whitehorse,...[LaFollette - llm-12118 - glass door ...
17167816_building_truck_vehicle_by[building, truck, vehicle, by, damaged, bldg, ...[HS building damaged by truck ...
18177617_water_damage_goodman_pool[water, damage, goodman, pool, at, field, toki...[water damage ...
19187518_garage_door_truck_hwy[garage, door, truck, hwy, damaged, shop, over...[garage door damaged ...
20197419_window_windows_broken_thrown[window, windows, broken, thrown, screens, scr...[broken window ...
21207220_hail_buildings_roof_multiple[hail, buildings, roof, multiple, to, windhail...[hail damage ...
22216721_light_pole_damaged_lightpole[light, pole, damaged, lightpole, rawson, pole...[light pole damaged ...
23226322_pole_vehicle_hit_struck[pole, vehicle, hit, struck, light, utility, a...[vehicle damaged light pole ...
24235823_laptop_theft_of_from[laptop, theft, of, from, stolen, ita, compute...[theft of laptop ...
25245424_hwy_lightning_st_highway[hwy, lightning, st, highway, dept, main, shop...[lightning damage at hwy dept. ...
26255225_laptop_bradford_computer_damaged[laptop, bradford, computer, damaged, mckinley...[laptop #6 damaged ...
27265126_airport_lightning_lights_runway[airport, lightning, lights, runway, damage, b...[lightning damage at airport ...
28274827_equipment_playground_instrument_gps[equipment, playground, instrument, gps, gear,...[playground equipment damaged ...
29284528_overhead_door_damaged_loader[overhead, door, damaged, loader, hangar, fram...[overhead door damaged ...
30294529_wind_trees_fence_park[wind, trees, fence, park, fencing, shed, stor...[wind damage at O'Donnell Park ...
31304530_street_light_damaged_accident[street, light, damaged, accident, vehicle, kn...[street light damaged ...
32314431_gym_floor_leak_roof[gym, floor, leak, roof, k9, injured, training...[water damage to gym floor ...
33324432_sign_vehicle_signal_traffic[sign, vehicle, signal, traffic, struck, hit, ...[vehicle struck and damaged traffic signal ...
34334333_hs_lightning_hhs_lec[hs, lightning, hhs, lec, damage, at, lighning...[lightning damage at HS ...
35344134_school_elementary_water_high[school, elementary, water, high, damage, elem...[water damage at school ...
36353935_storm_bldgs_locations_multiple[storm, bldgs, locations, multiple, damage, fa...[storm damage ...
37363736_hs_water_tremper_reuther[hs, water, tremper, reuther, hcc, mats, damag...[water damage at HS ...
38373737_radio_antenna_lightning_radios[radio, antenna, lightning, radios, to, freque...[lightning damage to radio ...
39383638_water_carpet_equipment_computers[water, carpet, equipment, computers, to, copi...[water damage to equipment ...
40393539_toki_courthouse_ms_damagecourthouse[toki, courthouse, ms, damagecourthouse, glass...[glass vandalism at Toki MS ...
41403440_center_water_bldg_main[center, water, bldg, main, sinkhole, health, ...[water damage at Comm Center ...
42413441_ms_es_lightning_damage[ms, es, lightning, damage, micrologix, mms, w...[lightning damage at MS ...
43423442_street_pole_light_streetlight[street, pole, light, streetlight, damaged, du...[street light pole damaged ...
44433343_well_10_lightning_wells[well, 10, lightning, wells, house, monitoring...[lightning damage to well 5 ...
45443144_hydrant_vehicle_struck_hit[hydrant, vehicle, struck, hit, over, by, car,...[hydrant damaged ...
46453145_plant_reservoir_tower_lightning[plant, reservoir, tower, lightning, wastewate...[lightning damage to sewer plant ...
47463146_falk_follette_la_glass[falk, follette, la, glass, es, vandalism, sta...[glass vandalism at Falk ES ...
48473047_radio_dropped_radios_lost[radio, dropped, radios, lost, portable, when,...[radio damaged ...
49483048_lift_station_elevator_lightning[lift, station, elevator, lightning, stations,...[lightning damage at lift station ...
50493049_buildings_building_water_basement[buildings, building, water, basement, to, abo...[water damage to building ...
\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + " \n" + ] }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 + "metadata": {}, + "execution_count": 41 + } + ], + "source": [ + "np.random.seed(42)\n", + "import random\n", + "random.seed(42)\n", + "umap_model = UMAP(n_neighbors=15, n_components=10, metric='cosine', low_memory=False, random_state=42)\n", + "hdbscan_model = HDBSCAN(min_cluster_size=30, metric='euclidean', prediction_data=True, min_samples=1)\n", + "topic_model = BERTopic(umap_model=umap_model, hdbscan_model=hdbscan_model)\n", + "topics, probs = topic_model.fit_transform(df_train[\"Description\"])\n", + "topic_model.get_topic_info()" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "LcmIftTnEVHJ" + }, + "source": [ + "The first output of `fit_transform` holds the topic ID for each sample. The second output is the probability of the sample belonging to that topic.\n", + "\n", + "In our case, we have obtained ca. 50 clusters. due to randomness of UMAP, the results may differ between runs. Unfortunately, we have not found a way to fix this.\n", + "\n", + "The cluster with ID `-1` contains all samples which are considered \"noise\" because they were not attributed to any cluster.\n", + "\n", + "The function `get_topic_info` returns the topic ID, the sample count, and a concatenation of the words representing the cluster.\n", + "\n", + "To get a visual impression of the clusters, BERTopic provides the function `visualize_topics` which embeds the c-TF-IDF representation of the topics in 2D using UMAP and then visualizes the two dimensions using plotly in an interactive view." + ] + }, + { + "cell_type": "code", + "execution_count": 42, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 667 + }, + "id": "q5WOiwszEVHJ", + "outputId": "6f005b1b-5531-4fab-c886-a41662004f95" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Similarity" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } + ], + "source": [ + "topic_model.visualize_topics()" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "IrKzZcJgEVHJ" }, - "text/html": [ - "
" + "source": [ + "We can visualize the selected terms for a few topics by creating bar charts out of the c-TF-IDF scores for each topic representation.\n", + "Insights can be gained from the relative c-TF-IDF scores between and within topics. Moreover, you can easily compare topic representations to each other. To visualize this hierarchy, simply call the function `visualize_barchart`:" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "_ = evaluate_classifier(np.array(df_valid[\"labels\"]), pred, None, labels, \"Similarity\", \"cm_peril_sim_a\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "rBb2NUiVh71w" - }, - "source": [ - "This is not bad! We have already improved on the accuracy score obtained by the zero-shot classifier (using a different set of candidate expressions though).\n", - "\n", - "Let’s see how we can improve the results further." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "CEEIA6IT3lZE" - }, - "source": [ - "\n", - "\n", - "### 4.2. Refinement\n", - "\n", - "A possible way to improve the performance is to train a classifier using the predicted labels of the previous section. Although this is a supervised learning step, we are not using the original labels, therefore the overall approach is still unsupervised." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "M4rgq9pLiJku" - }, - "source": [ - "First, we predict the labels on the training set, the same way as before, and store them in the DataFrame `df_train_copy`:" - ] - }, - { - "cell_type": "code", - "execution_count": 31, - "metadata": { - "id": "NjT3zaHM3sNv" - }, - "outputs": [], - "source": [ - "x_train = np.array(ds_sim[\"train\"][\"mean_hidden_state\"])\n", - "scores = np.dot(x_train, y.T)\n", - "selected = np.argmax(scores, axis=1)\n", - "pred = np.array([list(candidates.values())[i] for i in selected])\n", - "\n", - "df_train_copy = df_train.copy()\n", - "df_train_copy[\"labels\"] = pred" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "uNcUCbopiSMA" - }, - "source": [ - "From here, we follow the approach of [Section 2](#supervised). Again, we use ` distilbert-base-uncased`." - ] - }, - { - "cell_type": "code", - "execution_count": 32, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" }, - "id": "AKStE1hD8s8g", - "outputId": "0a3d9d81-74ff-4e3a-c6ab-f8cdeacd32a0" - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "loading configuration file https://huggingface.co/distilbert-base-uncased/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/23454919702d26495337f3da04d1655c7ee010d5ec9d77bdb9e399e00302c0a1.91b885ab15d631bf9cee9dc9d25ece0afd932f2f5130eba28f2055b2220c0333\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"distilbert-base-uncased\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"initializer_range\": 0.02,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 30522\n", - "}\n", - "\n", - "loading file https://huggingface.co/distilbert-base-uncased/resolve/main/vocab.txt from cache at /home/ubuntu/.cache/huggingface/transformers/0e1bbfda7f63a99bb52e3915dcf10c3c92122b827d92eb2d34ce94ee79ba486c.d789d64ebfe299b0e416afc4a169632f903f693095b4629a7ea271d5a0cf2c99\n", - "loading file https://huggingface.co/distilbert-base-uncased/resolve/main/tokenizer.json from cache at /home/ubuntu/.cache/huggingface/transformers/75abb59d7a06f4f640158a9bfcde005264e59e8d566781ab1415b139d2e4c603.7f2721073f19841be16f41b0a70b600ca6b880c8f3df6f3535cbc704371bdfa4\n", - "loading file https://huggingface.co/distilbert-base-uncased/resolve/main/added_tokens.json from cache at None\n", - "loading file https://huggingface.co/distilbert-base-uncased/resolve/main/special_tokens_map.json from cache at None\n", - "loading file https://huggingface.co/distilbert-base-uncased/resolve/main/tokenizer_config.json from cache at /home/ubuntu/.cache/huggingface/transformers/8c8624b8ac8aa99c60c912161f8332de003484428c47906d7ff7eb7f73eecdbb.20430bd8e10ef77a7d2977accefe796051e01bc2fc4aa146bc862997a1a15e79\n", - "loading configuration file https://huggingface.co/distilbert-base-uncased/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/23454919702d26495337f3da04d1655c7ee010d5ec9d77bdb9e399e00302c0a1.91b885ab15d631bf9cee9dc9d25ece0afd932f2f5130eba28f2055b2220c0333\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"distilbert-base-uncased\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"initializer_range\": 0.02,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 30522\n", - "}\n", - "\n" - ] - } - ], - "source": [ - "model_name = \"distilbert-base-uncased\"\n", - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "tokenizer = AutoTokenizer.from_pretrained(model_name)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "yzX4H1CrijUf" - }, - "source": [ - "First, we tokenize the claim descriptions:" - ] - }, - { - "cell_type": "code", - "execution_count": 33, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0, - "referenced_widgets": [ - "7f74e439781b403089ad377dd50c658e", - "df9a7621df924d88b3c65ba841f1be41", - "feed20df83614d89ad29099b05c32a84", - "23fbeb7bd6a345dcae57aa2807c05fb2", - "411cf8ff337647fd8c1591faf98610c7", - "9b338a9cc78a4c8196e2e0f0e34be824", - "89e36db6c06b42b9891fcd33e5041677", - "38f92f34bc5b4a658dd2f6fbcaec80f1", - "c510dfd747254a1588b761a3fdde091d", - "0a9cd7f035cf4540a15e3d22b74fd5f6", - "46091f4e750c47889eb6a1e852267734" - ] + "cell_type": "code", + "execution_count": 43, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 342 + }, + "id": "Gd0yT5hMEVHJ", + "outputId": "583785e4-2541-42a3-800e-0bd3b1920930" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "topic_model.visualize_barchart(top_n_topics=4)" + ] }, - "id": "xkzmKbyF8Q5J", - "outputId": "4aa5e350-fe27-4cf0-c704-3f16e707de48" - }, - "outputs": [ { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "8c4ec9290c464a5a93aa54bd96e8fec0", - "version_major": 2, - "version_minor": 0 + "cell_type": "markdown", + "metadata": { + "id": "vAiy4n1iEVHJ" }, - "text/plain": [ - " 0%| | 0/5 [00:00\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "topic_model.visualize_hierarchy()" ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "ds_train_copy = Dataset.from_pandas(df_train_copy)\n", - "ds_train_copy = ds_train_copy.map(tokenize, batched=True)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "p61QHwmpioyo" - }, - "source": [ - "Then, we perform one epoch of training…" - ] - }, - { - "cell_type": "code", - "execution_count": 34, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 }, - "id": "sInKXHcx4yy2", - "outputId": "f22ad3fa-de6f-4dbd-bdd0-02893892979b" - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "loading configuration file https://huggingface.co/distilbert-base-uncased/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/23454919702d26495337f3da04d1655c7ee010d5ec9d77bdb9e399e00302c0a1.91b885ab15d631bf9cee9dc9d25ece0afd932f2f5130eba28f2055b2220c0333\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"distilbert-base-uncased\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"id2label\": {\n", - " \"0\": \"LABEL_0\",\n", - " \"1\": \"LABEL_1\",\n", - " \"2\": \"LABEL_2\",\n", - " \"3\": \"LABEL_3\",\n", - " \"4\": \"LABEL_4\",\n", - " \"5\": \"LABEL_5\",\n", - " \"6\": \"LABEL_6\",\n", - " \"7\": \"LABEL_7\",\n", - " \"8\": \"LABEL_8\"\n", - " },\n", - " \"initializer_range\": 0.02,\n", - " \"label2id\": {\n", - " \"LABEL_0\": 0,\n", - " \"LABEL_1\": 1,\n", - " \"LABEL_2\": 2,\n", - " \"LABEL_3\": 3,\n", - " \"LABEL_4\": 4,\n", - " \"LABEL_5\": 5,\n", - " \"LABEL_6\": 6,\n", - " \"LABEL_7\": 7,\n", - " \"LABEL_8\": 8\n", - " },\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 30522\n", - "}\n", - "\n", - "loading weights file https://huggingface.co/distilbert-base-uncased/resolve/main/pytorch_model.bin from cache at /home/ubuntu/.cache/huggingface/transformers/9c169103d7e5a73936dd2b627e42851bec0831212b677c637033ee4bce9ab5ee.126183e36667471617ae2f0835fab707baa54b731f991507ebbb55ea85adb12a\n", - "Some weights of the model checkpoint at distilbert-base-uncased were not used when initializing DistilBertForSequenceClassification: ['vocab_layer_norm.bias', 'vocab_transform.bias', 'vocab_projector.bias', 'vocab_layer_norm.weight', 'vocab_projector.weight', 'vocab_transform.weight']\n", - "- This IS expected if you are initializing DistilBertForSequenceClassification from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).\n", - "- This IS NOT expected if you are initializing DistilBertForSequenceClassification from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).\n", - "Some weights of DistilBertForSequenceClassification were not initialized from the model checkpoint at distilbert-base-uncased and are newly initialized: ['pre_classifier.weight', 'classifier.weight', 'classifier.bias', 'pre_classifier.bias']\n", - "You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n", - "PyTorch: setting up devices\n", - "The default value for the training argument `--report_to` will change in v5 (from all installed integrations to none). In v5, you will need to use `--report_to all` to get the same behavior as now. You should start updating your code and make this info disappear :-).\n", - "The following columns in the training set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: Lightning, WaterW, Wind, WaterNW, Vandalism, words per description, Fire, Hail, Vehicle, Misc, Description, Loss. If Lightning, WaterW, Wind, WaterNW, Vandalism, words per description, Fire, Hail, Vehicle, Misc, Description, Loss are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "***** Running training *****\n", - " Num examples = 4991\n", - " Num Epochs = 1\n", - " Instantaneous batch size per device = 8\n", - " Total train batch size (w. parallel, distributed & accumulation) = 8\n", - " Gradient Accumulation steps = 1\n", - " Total optimization steps = 624\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "QR332SW6EVHK" + }, + "source": [ + "Next, we want to assign labels to each cluster.\n", + "Compared to manually labeling thousands of samples, this task is much less burdensome!\n", + "\n", + "This is usually a manual task. Assignment of labels is guided by the topic information, the topic word scores and the hierarchical clustering.\n", + "\n", + "In our case, the actual labels are available, so that we can use this information to perform the labeling.\n", + "\n", + "Let's inspect how well the clusters matches the labels. The graph below shows one column per topic.\n", + "The shading indicates the distribution of labels within a given topic.\n", + "The presence of a single dark patch in a column indicates that almost all of the samples of the topic are associated with a single label." + ] }, { - "data": { - "text/html": [ - "\n", - "
\n", - " \n", - " \n", - " [624/624 00:27, Epoch 1/1]\n", - "
\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
StepTraining Loss
6230.455400

" + "cell_type": "code", + "execution_count": 45, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 542 + }, + "id": "RDl-OdssEVHK", + "outputId": "1b55717d-9503-4eb4-baca-81f386233389" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "

\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } ], - "text/plain": [ - "" + "source": [ + "df_train[\"Topic\"] = topics\n", + "tb = pd.pivot_table(df_train, index=[\"Topic\"], columns=[\"labels\"], aggfunc='count', fill_value=0)[\"Description\"]\n", + "fig = px.imshow(tb.divide(tb.sum(axis=1), axis=0).T, zmin=-0.05)\n", + "fig.update_layout(xaxis={\"dtick\": 1}, yaxis={\"dtick\": 1, \"range\":[0,8]}, coloraxis={\"colorscale\": \"Greys\"})\n", + "fig.show()" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stderr", - "output_type": "stream", - "text": [ - "\n", - "\n", - "Training completed. Do not forget to share your model on huggingface.co/models =)\n", - "\n", - "\n", - "Saving model checkpoint to distilbert-base-uncased_peril_s\n", - "Configuration saved in distilbert-base-uncased_peril_s/config.json\n", - "Model weights saved in distilbert-base-uncased_peril_s/pytorch_model.bin\n" - ] - } - ], - "source": [ - "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model\n", - "model = AutoModelForSequenceClassification.from_pretrained(model_name, num_labels=len(labels)).to(device)\n", - "\n", - "# train the model\n", - "batch_size = 8\n", - "logging_steps = len(ds_train_copy) // batch_size\n", - "training_args = TrainingArguments(\n", - " output_dir=model_name+\"_peril_s_epochs\",\n", - " num_train_epochs=1,\n", - " per_device_train_batch_size=batch_size,\n", - " per_device_eval_batch_size=batch_size,\n", - " metric_for_best_model=\"f1\",\n", - " logging_steps=logging_steps,\n", - " save_strategy=trainer_utils.IntervalStrategy.NO,\n", - ")\n", - "trainer = Trainer(model=model, args=training_args,\n", - " compute_metrics=compute_metrics, train_dataset=ds_train_copy,\n", - " eval_dataset=ds_train_copy)\n", - "trainer.train();\n", - "trainer.save_model(model_name + \"_peril_s\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Zb40jPS-iulN" - }, - "source": [ - "… and evaluate the performance on the test set:" - ] - }, - { - "cell_type": "code", - "execution_count": 35, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 0 + "cell_type": "markdown", + "metadata": { + "id": "cLoeG-9tEVHK" + }, + "source": [ + "Obviously, the topic `-1`, which represents the outliers, has a finite frequency for many classes.\n", + "Further, the classes 6 (`WaterNW`) and 7 (`WaterW`) seem to be difficult to tell apart from the clusters; this affects some of the topics.\n", + "For most other topics, the clustering aligns quite well with the labels.\n", + "\n", + "Overall, it appears reasonable to map each topic to the label with the highest frequency. Apart from the exceptions mentioned above, this aligns with a mapping that a human would define manually, in absence of the actual labels.\n", + "\n", + "Therefore, let's define the mapping from topics to labels by picking the label with the highest frequency. The table below shows the topic info, enriched with the label counts and the mapping." + ] + }, + { + "cell_type": "code", + "execution_count": 46, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000 + }, + "id": "NZ6vPSS-EVHK", + "outputId": "3fbba007-530f-4089-f28a-c5d83f373586" + }, + "outputs": [ + { + "output_type": "execute_result", + "data": { + "text/plain": [ + " Topic Count Name \\\n", + "0 -1 662 -1_lightning_water_damage_wwtp \n", + "1 0 700 0_vandalism_park_dmg_shelter \n", + "2 1 237 1_glass_vandalism_west_es \n", + "3 2 203 2_fire_smoke_damage_equipment \n", + "4 3 180 3_phone_lightning_system_to \n", + "5 4 178 4_power_surge_generator_spoilage \n", + "6 5 177 5_froze_pipe_sewer_pipes \n", + "7 6 164 6_theft_of_stolen_break \n", + "8 7 146 7_graffiti_on_kennedy_hoyt \n", + "9 8 121 8_lightning_damage_scale_dpw \n", + "10 9 104 9_signal_traffic_damaged_box \n", + "11 10 103 10_broken_door_glass_breakage \n", + "12 11 101 11_fence_plow_gate_by \n", + "13 12 93 12_roof_wind_shingles_blew \n", + "14 13 83 13_hydrant_fire_hit_damaged \n", + "15 14 81 14_wind_storage_damage_tower \n", + "16 15 81 15_llm_glass_mendota_hawk \n", + "17 16 78 16_building_truck_vehicle_by \n", + "18 17 76 17_water_damage_goodman_pool \n", + "19 18 75 18_garage_door_truck_hwy \n", + "20 19 74 19_window_windows_broken_thrown \n", + "21 20 72 20_hail_buildings_roof_multiple \n", + "22 21 67 21_light_pole_damaged_lightpole \n", + "23 22 63 22_pole_vehicle_hit_struck \n", + "24 23 58 23_laptop_theft_of_from \n", + "25 24 54 24_hwy_lightning_st_highway \n", + "26 25 52 25_laptop_bradford_computer_damaged \n", + "27 26 51 26_airport_lightning_lights_runway \n", + "28 27 48 27_equipment_playground_instrument_gps \n", + "29 28 45 28_overhead_door_damaged_loader \n", + "30 29 45 29_wind_trees_fence_park \n", + "31 30 45 30_street_light_damaged_accident \n", + "32 31 44 31_gym_floor_leak_roof \n", + "33 32 44 32_sign_vehicle_signal_traffic \n", + "34 33 43 33_hs_lightning_hhs_lec \n", + "35 34 41 34_school_elementary_water_high \n", + "36 35 39 35_storm_bldgs_locations_multiple \n", + "37 36 37 36_hs_water_tremper_reuther \n", + "38 37 37 37_radio_antenna_lightning_radios \n", + "39 38 36 38_water_carpet_equipment_computers \n", + "40 39 35 39_toki_courthouse_ms_damagecourthouse \n", + "41 40 34 40_center_water_bldg_main \n", + "42 41 34 41_ms_es_lightning_damage \n", + "43 42 34 42_street_pole_light_streetlight \n", + "44 43 33 43_well_10_lightning_wells \n", + "45 44 31 44_hydrant_vehicle_struck_hit \n", + "46 45 31 45_plant_reservoir_tower_lightning \n", + "47 46 31 46_falk_follette_la_glass \n", + "48 47 30 47_radio_dropped_radios_lost \n", + "49 48 30 48_lift_station_elevator_lightning \n", + "50 49 30 49_buildings_building_water_basement \n", + "\n", + " Representation \\\n", + "0 [lightning, water, damage, wwtp, ms, siren, at... \n", + "1 [vandalism, park, dmg, shelter, at, pavilion, ... \n", + "2 [glass, vandalism, west, es, ms, at, lincoln, ... \n", + "3 [fire, smoke, damage, equipment, station, park... \n", + "4 [phone, lightning, system, to, compressor, com... \n", + "5 [power, surge, generator, spoilage, food, outa... \n", + "6 [froze, pipe, sewer, pipes, library, ice, up, ... \n", + "7 [theft, of, stolen, break, from, in, wire, cam... \n", + "8 [graffiti, on, kennedy, hoyt, llm, wall, doors... \n", + "9 [lightning, damage, scale, dpw, museum, nasonv... \n", + "10 [signal, traffic, damaged, box, paradise, knoc... \n", + "11 [broken, door, glass, breakage, entrance, brok... \n", + "12 [fence, plow, gate, by, damaged, vehicle, snow... \n", + "13 [roof, wind, shingles, blew, collapsed, off, w... \n", + "14 [hydrant, fire, hit, damaged, run, plow, vehic... \n", + "15 [wind, storage, damage, tower, antenna, to, te... \n", + "16 [llm, glass, mendota, hawk, black, whitehorse,... \n", + "17 [building, truck, vehicle, by, damaged, bldg, ... \n", + "18 [water, damage, goodman, pool, at, field, toki... \n", + "19 [garage, door, truck, hwy, damaged, shop, over... \n", + "20 [window, windows, broken, thrown, screens, scr... \n", + "21 [hail, buildings, roof, multiple, to, windhail... \n", + "22 [light, pole, damaged, lightpole, rawson, pole... \n", + "23 [pole, vehicle, hit, struck, light, utility, a... \n", + "24 [laptop, theft, of, from, stolen, ita, compute... \n", + "25 [hwy, lightning, st, highway, dept, main, shop... \n", + "26 [laptop, bradford, computer, damaged, mckinley... \n", + "27 [airport, lightning, lights, runway, damage, b... \n", + "28 [equipment, playground, instrument, gps, gear,... \n", + "29 [overhead, door, damaged, loader, hangar, fram... \n", + "30 [wind, trees, fence, park, fencing, shed, stor... \n", + "31 [street, light, damaged, accident, vehicle, kn... \n", + "32 [gym, floor, leak, roof, k9, injured, training... \n", + "33 [sign, vehicle, signal, traffic, struck, hit, ... \n", + "34 [hs, lightning, hhs, lec, damage, at, lighning... \n", + "35 [school, elementary, water, high, damage, elem... \n", + "36 [storm, bldgs, locations, multiple, damage, fa... \n", + "37 [hs, water, tremper, reuther, hcc, mats, damag... \n", + "38 [radio, antenna, lightning, radios, to, freque... \n", + "39 [water, carpet, equipment, computers, to, copi... \n", + "40 [toki, courthouse, ms, damagecourthouse, glass... \n", + "41 [center, water, bldg, main, sinkhole, health, ... \n", + "42 [ms, es, lightning, damage, micrologix, mms, w... \n", + "43 [street, pole, light, streetlight, damaged, du... \n", + "44 [well, 10, lightning, wells, house, monitoring... \n", + "45 [hydrant, vehicle, struck, hit, over, by, car,... \n", + "46 [plant, reservoir, tower, lightning, wastewate... \n", + "47 [falk, follette, la, glass, es, vandalism, sta... \n", + "48 [radio, dropped, radios, lost, portable, when,... \n", + "49 [lift, station, elevator, lightning, stations,... \n", + "50 [buildings, building, water, basement, to, abo... \n", + "\n", + " Representative_Docs 0 1 2 3 4 \\\n", + "0 [theft of laptop Washington MS ... 117 5 225 59 1 \n", + "1 [a/c vandalism ... 694 1 0 4 0 \n", + "2 [glass vandalism at HS ... 237 0 0 0 0 \n", + "3 [fire & smoke damage at Fire Station #7 ... 23 147 4 0 0 \n", + "4 [lightning damaged phone system ... 4 4 150 1 0 \n", + "5 [power surge damage ... 0 4 23 3 0 \n", + "6 [pipe froze and water damage ... 3 0 1 3 0 \n", + "7 [theft of equipment from vehicle ... 130 2 1 0 0 \n", + "8 [graffiti at West ... 143 0 0 0 0 \n", + "9 [lightning damage ... 0 0 120 0 1 \n", + "10 [traffic signal damaged ... 0 0 0 0 0 \n", + "11 [broken door/glass at LaFollette HS ... 92 0 0 1 0 \n", + "12 [fence gate damaged by vehicle ... 6 0 0 7 0 \n", + "13 [wind damage to roof ... 2 1 0 64 1 \n", + "14 [fire hydrant damaged ... 0 0 0 0 0 \n", + "15 [wind damage ... 0 0 0 78 0 \n", + "16 [LaFollette - llm-12118 - glass door ... 73 0 2 0 0 \n", + "17 [HS building damaged by truck ... 3 0 0 6 0 \n", + "18 [water damage ... 0 0 0 0 0 \n", + "19 [garage door damaged ... 1 0 0 0 0 \n", + "20 [broken window ... 64 1 0 1 1 \n", + "21 [hail damage ... 0 0 0 4 68 \n", + "22 [light pole damaged ... 5 1 1 0 1 \n", + "23 [vehicle damaged light pole ... 0 0 0 0 1 \n", + "24 [theft of laptop ... 51 0 0 0 0 \n", + "25 [lightning damage at hwy dept. ... 0 0 53 0 0 \n", + "26 [laptop #6 damaged ... 38 0 0 0 0 \n", + "27 [lightning damage at airport ... 0 1 46 1 0 \n", + "28 [playground equipment damaged ... 14 0 0 1 0 \n", + "29 [overhead door damaged ... 3 0 0 1 0 \n", + "30 [wind damage at O'Donnell Park ... 2 0 0 41 0 \n", + "31 [street light damaged ... 4 0 0 2 0 \n", + "32 [water damage to gym floor ... 4 0 0 0 0 \n", + "33 [vehicle struck and damaged traffic signal ... 4 0 0 0 0 \n", + "34 [lightning damage at HS ... 0 0 43 0 0 \n", + "35 [water damage at school ... 1 0 0 0 0 \n", + "36 [storm damage ... 0 0 6 17 2 \n", + "37 [water damage at HS ... 0 0 0 0 0 \n", + "38 [lightning damage to radio ... 0 1 36 0 0 \n", + "39 [water damage to equipment ... 0 0 1 0 0 \n", + "40 [glass vandalism at Toki MS ... 19 0 0 0 0 \n", + "41 [water damage at Comm Center ... 0 0 0 0 0 \n", + "42 [lightning damage at MS ... 0 1 33 0 0 \n", + "43 [street light pole damaged ... 0 0 0 0 0 \n", + "44 [lightning damage to well 5 ... 0 0 31 0 0 \n", + "45 [hydrant damaged ... 2 0 0 0 0 \n", + "46 [lightning damage to sewer plant ... 0 0 31 0 0 \n", + "47 [glass vandalism at Falk ES ... 30 0 0 0 0 \n", + "48 [radio damaged ... 3 2 0 1 0 \n", + "49 [lightning damage at lift station ... 1 0 25 0 0 \n", + "50 [water damage to building ... 1 0 0 1 0 \n", + "\n", + " 5 6 7 8 mapping label \n", + "0 83 59 86 27 2 Lightning \n", + "1 1 0 0 0 0 Vandalism \n", + "2 0 0 0 0 0 Vandalism \n", + "3 10 5 5 9 1 Fire \n", + "4 2 1 5 13 2 Lightning \n", + "5 1 1 2 144 8 Misc \n", + "6 10 32 98 30 7 WaterW \n", + "7 6 1 0 24 0 Vandalism \n", + "8 2 0 1 0 0 Vandalism \n", + "9 0 0 0 0 2 Lightning \n", + "10 101 0 0 3 5 Vehicle \n", + "11 4 0 0 6 0 Vandalism \n", + "12 85 0 0 3 5 Vehicle \n", + "13 0 1 10 14 3 Wind \n", + "14 81 1 0 1 5 Vehicle \n", + "15 0 0 1 2 3 Wind \n", + "16 2 0 1 3 0 Vandalism \n", + "17 60 0 2 7 5 Vehicle \n", + "18 0 25 50 1 7 WaterW \n", + "19 71 0 0 3 5 Vehicle \n", + "20 2 0 2 3 0 Vandalism \n", + "21 0 0 0 0 4 Hail \n", + "22 57 0 0 2 5 Vehicle \n", + "23 60 0 0 2 5 Vehicle \n", + "24 1 0 0 6 0 Vandalism \n", + "25 0 0 0 1 2 Lightning \n", + "26 5 0 0 9 0 Vandalism \n", + "27 2 0 1 0 2 Lightning \n", + "28 13 0 0 20 8 Misc \n", + "29 39 0 0 2 5 Vehicle \n", + "30 1 0 1 0 3 Wind \n", + "31 39 0 0 0 5 Vehicle \n", + "32 0 9 23 8 7 WaterW \n", + "33 40 0 0 0 5 Vehicle \n", + "34 0 0 0 0 2 Lightning \n", + "35 0 9 30 1 7 WaterW \n", + "36 0 0 13 1 3 Wind \n", + "37 0 11 25 1 7 WaterW \n", + "38 0 0 0 0 2 Lightning \n", + "39 0 10 24 1 7 WaterW \n", + "40 0 6 9 1 0 Vandalism \n", + "41 1 13 19 1 7 WaterW \n", + "42 0 0 0 0 2 Lightning \n", + "43 33 0 0 1 5 Vehicle \n", + "44 2 0 0 0 2 Lightning \n", + "45 28 1 0 0 5 Vehicle \n", + "46 0 0 0 0 2 Lightning \n", + "47 0 0 0 1 0 Vandalism \n", + "48 8 5 1 10 8 Misc \n", + "49 1 1 1 1 2 Lightning \n", + "50 1 11 16 0 7 WaterW " + ], + "text/html": [ + "\n", + "
\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
TopicCountNameRepresentationRepresentative_Docs012345678mappinglabel
0-1662-1_lightning_water_damage_wwtp[lightning, water, damage, wwtp, ms, siren, at...[theft of laptop Washington MS ...1175225591835986272Lightning
107000_vandalism_park_dmg_shelter[vandalism, park, dmg, shelter, at, pavilion, ...[a/c vandalism ...694104010000Vandalism
212371_glass_vandalism_west_es[glass, vandalism, west, es, ms, at, lincoln, ...[glass vandalism at HS ...237000000000Vandalism
322032_fire_smoke_damage_equipment[fire, smoke, damage, equipment, station, park...[fire & smoke damage at Fire Station #7 ...23147400105591Fire
431803_phone_lightning_system_to[phone, lightning, system, to, compressor, com...[lightning damaged phone system ...4415010215132Lightning
541784_power_surge_generator_spoilage[power, surge, generator, spoilage, food, outa...[power surge damage ...0423301121448Misc
651775_froze_pipe_sewer_pipes[froze, pipe, sewer, pipes, library, ice, up, ...[pipe froze and water damage ...30130103298307WaterW
761646_theft_of_stolen_break[theft, of, stolen, break, from, in, wire, cam...[theft of equipment from vehicle ...1302100610240Vandalism
871467_graffiti_on_kennedy_hoyt[graffiti, on, kennedy, hoyt, llm, wall, doors...[graffiti at West ...143000020100Vandalism
981218_lightning_damage_scale_dpw[lightning, damage, scale, dpw, museum, nasonv...[lightning damage ...001200100002Lightning
1091049_signal_traffic_damaged_box[signal, traffic, damaged, box, paradise, knoc...[traffic signal damaged ...000001010035Vehicle
111010310_broken_door_glass_breakage[broken, door, glass, breakage, entrance, brok...[broken door/glass at LaFollette HS ...92001040060Vandalism
121110111_fence_plow_gate_by[fence, plow, gate, by, damaged, vehicle, snow...[fence gate damaged by vehicle ...60070850035Vehicle
13129312_roof_wind_shingles_blew[roof, wind, shingles, blew, collapsed, off, w...[wind damage to roof ...2106410110143Wind
14138313_hydrant_fire_hit_damaged[hydrant, fire, hit, damaged, run, plow, vehic...[fire hydrant damaged ...00000811015Vehicle
15148114_wind_storage_damage_tower[wind, storage, damage, tower, antenna, to, te...[wind damage ...00078000123Wind
16158115_llm_glass_mendota_hawk[llm, glass, mendota, hawk, black, whitehorse,...[LaFollette - llm-12118 - glass door ...73020020130Vandalism
17167816_building_truck_vehicle_by[building, truck, vehicle, by, damaged, bldg, ...[HS building damaged by truck ...30060600275Vehicle
18177617_water_damage_goodman_pool[water, damage, goodman, pool, at, field, toki...[water damage ...000000255017WaterW
19187518_garage_door_truck_hwy[garage, door, truck, hwy, damaged, shop, over...[garage door damaged ...10000710035Vehicle
20197419_window_windows_broken_thrown[window, windows, broken, thrown, screens, scr...[broken window ...64101120230Vandalism
21207220_hail_buildings_roof_multiple[hail, buildings, roof, multiple, to, windhail...[hail damage ...00046800004Hail
22216721_light_pole_damaged_lightpole[light, pole, damaged, lightpole, rawson, pole...[light pole damaged ...51101570025Vehicle
23226322_pole_vehicle_hit_struck[pole, vehicle, hit, struck, light, utility, a...[vehicle damaged light pole ...00001600025Vehicle
24235823_laptop_theft_of_from[laptop, theft, of, from, stolen, ita, compute...[theft of laptop ...51000010060Vandalism
25245424_hwy_lightning_st_highway[hwy, lightning, st, highway, dept, main, shop...[lightning damage at hwy dept. ...00530000012Lightning
26255225_laptop_bradford_computer_damaged[laptop, bradford, computer, damaged, mckinley...[laptop #6 damaged ...38000050090Vandalism
27265126_airport_lightning_lights_runway[airport, lightning, lights, runway, damage, b...[lightning damage at airport ...01461020102Lightning
28274827_equipment_playground_instrument_gps[equipment, playground, instrument, gps, gear,...[playground equipment damaged ...1400101300208Misc
29284528_overhead_door_damaged_loader[overhead, door, damaged, loader, hangar, fram...[overhead door damaged ...30010390025Vehicle
30294529_wind_trees_fence_park[wind, trees, fence, park, fencing, shed, stor...[wind damage at O'Donnell Park ...20041010103Wind
31304530_street_light_damaged_accident[street, light, damaged, accident, vehicle, kn...[street light damaged ...40020390005Vehicle
32314431_gym_floor_leak_roof[gym, floor, leak, roof, k9, injured, training...[water damage to gym floor ...40000092387WaterW
33324432_sign_vehicle_signal_traffic[sign, vehicle, signal, traffic, struck, hit, ...[vehicle struck and damaged traffic signal ...40000400005Vehicle
34334333_hs_lightning_hhs_lec[hs, lightning, hhs, lec, damage, at, lighning...[lightning damage at HS ...00430000002Lightning
35344134_school_elementary_water_high[school, elementary, water, high, damage, elem...[water damage at school ...10000093017WaterW
36353935_storm_bldgs_locations_multiple[storm, bldgs, locations, multiple, damage, fa...[storm damage ...006172001313Wind
37363736_hs_water_tremper_reuther[hs, water, tremper, reuther, hcc, mats, damag...[water damage at HS ...000000112517WaterW
38373737_radio_antenna_lightning_radios[radio, antenna, lightning, radios, to, freque...[lightning damage to radio ...01360000002Lightning
39383638_water_carpet_equipment_computers[water, carpet, equipment, computers, to, copi...[water damage to equipment ...001000102417WaterW
40393539_toki_courthouse_ms_damagecourthouse[toki, courthouse, ms, damagecourthouse, glass...[glass vandalism at Toki MS ...19000006910Vandalism
41403440_center_water_bldg_main[center, water, bldg, main, sinkhole, health, ...[water damage at Comm Center ...000001131917WaterW
42413441_ms_es_lightning_damage[ms, es, lightning, damage, micrologix, mms, w...[lightning damage at MS ...01330000002Lightning
43423442_street_pole_light_streetlight[street, pole, light, streetlight, damaged, du...[street light pole damaged ...00000330015Vehicle
44433343_well_10_lightning_wells[well, 10, lightning, wells, house, monitoring...[lightning damage to well 5 ...00310020002Lightning
45443144_hydrant_vehicle_struck_hit[hydrant, vehicle, struck, hit, over, by, car,...[hydrant damaged ...20000281005Vehicle
46453145_plant_reservoir_tower_lightning[plant, reservoir, tower, lightning, wastewate...[lightning damage to sewer plant ...00310000002Lightning
47463146_falk_follette_la_glass[falk, follette, la, glass, es, vandalism, sta...[glass vandalism at Falk ES ...30000000010Vandalism
48473047_radio_dropped_radios_lost[radio, dropped, radios, lost, portable, when,...[radio damaged ...32010851108Misc
49483048_lift_station_elevator_lightning[lift, station, elevator, lightning, stations,...[lightning damage at lift station ...10250011112Lightning
50493049_buildings_building_water_basement[buildings, building, water, basement, to, abo...[water damage to building ...100101111607WaterW
\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + "
\n" + ] + }, + "metadata": {}, + "execution_count": 46 + } + ], + "source": [ + "tb[\"mapping\"] = tb.values.argmax(axis=1)\n", + "tb[\"label\"] = [labels[i] for i in tb[\"mapping\"]]\n", + "mapping = {i: tb.loc[i, \"mapping\"] for i in tb.index}\n", + "topic_model.get_topic_info().merge(tb, on=\"Topic\")" + ] }, - "id": "cU3f6uVc9gjU", - "outputId": "be8e6700-743e-460d-b01c-7ab8ecb929b8" - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "The following columns in the test set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: Lightning, WaterW, Wind, cls_hidden_state, WaterNW, Vandalism, Fire, mean_hidden_state, Hail, Vehicle, Misc, Description, Loss. If Lightning, WaterW, Wind, cls_hidden_state, WaterNW, Vandalism, Fire, mean_hidden_state, Hail, Vehicle, Misc, Description, Loss are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "***** Running Prediction *****\n", - " Num examples = 1039\n", - " Batch size = 8\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "YkF2EY-hEVHK" + }, + "source": [ + "Now, let's apply this model to the validation set. First, we assign each sample to a cluster, based on the clustering model." + ] }, { - "data": { - "text/html": [ - "\n", - "
\n", - " \n", - " \n", - " [130/130 00:01]\n", - "
\n", - " " + "cell_type": "code", + "execution_count": 47, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "xeE03QWFEVHK", + "outputId": "a86f0d7f-c056-4b44-f37b-80d2828200f1" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stderr", + "text": [ + "/usr/local/lib/python3.10/dist-packages/scipy/sparse/_index.py:146: SparseEfficiencyWarning:\n", + "\n", + "Changing the sparsity structure of a csr_matrix is expensive. lil_matrix is more efficient.\n", + "\n" + ] + } ], - "text/plain": [ - "" + "source": [ + "topics_test, probs_test = topic_model.transform(df_valid[\"Description\"])" ] - }, - "metadata": {}, - "output_type": "display_data" }, { - "name": "stdout", - "output_type": "stream", - "text": [ - "Simularity, refined\n", - "accuracy score = 76.6%, log loss = 1.172, Brier loss = 0.403\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " Vandalism 0.90 0.88 0.89 310\n", - " Fire 0.62 0.74 0.67 46\n", - " Lightning 0.80 0.94 0.87 123\n", - " Wind 0.97 0.82 0.89 107\n", - " Hail 0.90 1.00 0.95 18\n", - " Vehicle 0.89 0.75 0.82 227\n", - " WaterNW 0.46 0.93 0.61 67\n", - " WaterW 0.11 0.18 0.14 38\n", - " Misc 0.80 0.27 0.41 103\n", - "\n", - " accuracy 0.77 1039\n", - " macro avg 0.72 0.72 0.69 1039\n", - "weighted avg 0.81 0.77 0.77 1039\n", - "\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "gKz-IvZEEVHL" + }, + "source": [ + "Then, we apply the mapping from topics to labels, which we have defined above based on the training set. The table below shows for each topic the frequency by label, and the mapping." + ] }, { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_peril_sim_b", - "format": "svg" + "cell_type": "code", + "execution_count": 48, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000 + }, + "id": "WRLhMAZhEVHL", + "outputId": "9c2430ae-c65a-48b5-bf67-cf3d409754e7" + }, + "outputs": [ + { + "output_type": "execute_result", + "data": { + "text/plain": [ + "labels 0 1 2 3 4 5 6 7 8 mapping\n", + "Topic \n", + "-1 21 6 28 28 0 23 10 8 17 2\n", + " 0 49 0 0 0 0 0 0 0 0 0\n", + " 1 1 0 0 0 0 0 0 0 0 0\n", + " 2 5 37 0 0 0 3 3 1 2 1\n", + " 3 0 1 42 1 0 1 0 0 3 2\n", + " 4 0 0 5 0 0 1 0 0 30 8\n", + " 5 3 1 1 0 0 6 21 9 10 7\n", + " 6 18 0 1 0 0 1 0 0 8 0\n", + " 7 59 0 0 0 0 1 0 0 0 0\n", + " 8 0 0 11 0 0 0 0 0 0 2\n", + " 9 1 0 0 3 0 9 0 0 1 5\n", + " 10 19 0 0 0 0 0 0 0 1 0\n", + " 11 1 0 0 0 0 13 0 0 0 5\n", + " 12 0 0 0 27 0 0 0 0 3 3\n", + " 13 0 0 0 0 0 13 0 0 0 5\n", + " 14 0 0 0 29 0 0 0 1 0 3\n", + " 15 106 0 0 1 0 4 2 0 1 0\n", + " 16 1 0 0 0 0 17 0 0 2 5\n", + " 17 0 0 0 0 0 1 7 6 0 7\n", + " 18 0 0 0 0 0 13 0 0 0 5\n", + " 19 16 0 0 0 0 2 0 0 4 0\n", + " 20 0 0 0 2 18 0 0 0 0 4\n", + " 21 0 0 0 1 0 5 0 0 1 5\n", + " 22 0 0 0 1 0 46 0 0 1 5\n", + " 23 4 0 0 0 0 0 0 0 2 0\n", + " 24 0 0 3 1 0 0 0 0 0 2\n", + " 25 0 0 0 0 0 0 0 0 5 0\n", + " 26 0 0 8 1 0 0 0 0 0 2\n", + " 27 1 0 0 0 0 2 0 0 1 8\n", + " 28 3 0 1 2 0 15 0 0 1 5\n", + " 29 0 0 0 6 0 0 0 0 0 3\n", + " 30 1 0 0 0 0 19 0 0 0 5\n", + " 31 0 0 0 0 0 1 7 4 2 7\n", + " 32 0 0 0 0 0 21 0 0 2 5\n", + " 33 0 0 1 0 0 0 0 0 0 2\n", + " 34 0 1 0 0 0 0 3 1 0 7\n", + " 35 0 0 1 4 0 0 0 2 0 3\n", + " 36 0 0 0 0 0 0 1 1 0 7\n", + " 37 0 0 12 0 0 0 0 0 0 2\n", + " 38 0 0 0 0 0 0 5 0 0 7\n", + " 39 1 0 0 0 0 0 1 0 0 0\n", + " 40 0 0 0 0 0 0 2 1 0 7\n", + " 42 0 0 0 0 0 2 0 0 1 5\n", + " 44 0 0 0 0 0 7 0 0 0 5\n", + " 45 0 0 4 0 0 0 1 0 1 2\n", + " 47 0 0 0 0 0 1 0 0 2 8\n", + " 48 0 0 5 0 0 0 0 0 0 2\n", + " 49 0 0 0 0 0 0 4 4 2 7" + ], + "text/html": [ + "\n", + "
\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
labels012345678mapping
Topic
-12162828023108172
049000000000
11000000000
253700033121
301421010032
400500100308
5311006219107
618010010080
759000010000
800110000002
91003090015
1019000000010
1110000130005
1200027000033
1300000130005
1400029000103
15106001042010
1610000170025
170000017607
1800000130005
1916000020040
2000021800004
210001050015
2200010460015
234000000020
240031000002
250000000050
260081000002
271000020018
2830120150015
290006000003
3010000190005
310000017427
3200000210025
330010000002
340100003107
350014000203
360000001107
3700120000002
380000005007
391000001000
400000002107
420000020015
440000070005
450040001012
470000010028
480050000002
490000004427
\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + "
\n" + ] + }, + "metadata": {}, + "execution_count": 48 } - }, - "data": [ + ], + "source": [ + "df_valid[\"Topic\"] = topics_test\n", + "df_valid[\"prob\"] = probs_test\n", + "df_valid[\"pred\"] = [mapping[t] for t in topics_test]\n", + "df_valid.to_excel(\"results/peril_topics.xlsx\")\n", + "tb_valid = pd.pivot_table(df_valid, index=[\"Topic\"], columns=[\"labels\"], aggfunc='count', fill_value=0)[\"Description\"]\n", + "tb_valid[\"mapping\"] = [mapping[t] for t in tb_valid.index]\n", + "tb_valid" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "m7epfnhsEVHL" + }, + "source": [ + "This classifier achieves an accuracy score of ca. 70%, compared to 30% obtained with the dummy classifier." + ] + }, + { + "cell_type": "code", + "execution_count": 49, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 872 + }, + "id": "ZF9x0l1xEVHL", + "outputId": "71a91dab-9ae3-4db3-df72-c441dc63007d" + }, + "outputs": [ { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "xaxis": "x", - "y": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "yaxis": "y", - "z": [ - [ - 273, - 10, - 4, - 0, - 0, - 6, - 7, - 8, - 2 - ], - [ - 1, - 34, - 3, - 0, - 0, - 2, - 4, - 1, - 1 - ], - [ - 0, - 0, - 116, - 0, - 0, - 0, - 2, - 2, - 3 - ], - [ - 3, - 0, - 3, - 88, - 2, - 1, - 0, - 10, - 0 - ], - [ - 0, - 0, - 0, - 0, - 18, - 0, - 0, - 0, - 0 - ], - [ - 5, - 7, - 17, - 1, - 0, - 170, - 11, - 16, - 0 - ], - [ - 3, - 0, - 0, - 0, - 0, - 0, - 62, - 1, - 1 - ], - [ - 0, - 0, - 0, - 1, - 0, - 0, - 30, - 7, - 0 - ], - [ - 20, - 4, - 2, - 1, - 0, - 11, - 20, - 17, - 28 + "output_type": "stream", + "name": "stdout", + "text": [ + "Topic modeling by clustering\n", + "accuracy score = 71.9%, log loss = nan, Brier loss = nan\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " Vandalism 0.89 0.88 0.88 310\n", + " Fire 0.73 0.80 0.76 46\n", + " Lightning 0.48 0.93 0.63 123\n", + " Wind 0.90 0.62 0.73 107\n", + " Hail 0.90 1.00 0.95 18\n", + " Vehicle 0.88 0.79 0.84 227\n", + " WaterNW 0.00 0.00 0.00 67\n", + " WaterW 0.25 0.68 0.37 38\n", + " Misc 0.77 0.32 0.45 103\n", + "\n", + " accuracy 0.72 1039\n", + " macro avg 0.64 0.67 0.62 1039\n", + "weighted avg 0.74 0.72 0.71 1039\n", + "\n" ] - ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" + ], + "source": [ + "_ = evaluate_classifier(df_valid[\"labels\"], df_valid[\"pred\"], None, labels, \"Topic modeling by clustering\", \"cm_peril_topic_a\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "Kq6ygqVhEVHL" + }, + "source": [ + "BERTopic provides the function `find_topics` which returns a list of IDs and similarity scores of topics that best match a given search term.\n", + "\n", + "This is useful to validate the mapping. Let's use the search term \"Fire\" and retrieve the three most similar topics.\n", + "For each of these topics, we print the similarity score and the label it was mapped to. We also show the word scores for each topic." + ] + }, + { + "cell_type": "code", + "execution_count": 50, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 394 + }, + "id": "8lXgN3eBEVHL", + "outputId": "085695eb-af23-4564-96db-bb5f8e8b56b2" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "topic 2: similarity score 63.5%, mapped to peril 1 (Fire)\n", + "topic 13: similarity score 39.1%, mapped to peril 5 (Vehicle)\n", + "topic 8: similarity score 35.9%, mapped to peril 2 (Lightning)\n" ] - ], - "showscale": false - }, - "font": { - "size": 14 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Simularity, refined" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } + "metadata": {} } - } + ], + "source": [ + "similar_topics, similarity = topic_model.find_topics(\"Fire\", top_n=3)\n", + "for t, s in zip(similar_topics, similarity):\n", + " print(f\"topic {t:2d}: similarity score {s:.1%}, mapped to peril {mapping[t]:d} ({labels[mapping[t]]})\")\n", + "topic_model.visualize_barchart(similar_topics)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "zP9N-QnoEVHM" }, - "text/html": [ - "
" + "source": [ + "As expected, the topics which have been mapped to \"Fire\" appear first in the list, with similarity scores of more than 80%.\n", + "\n", + "The first topic that was not mapped to \"Fire\" has a similarity score of less than 70%. It was mapped to the label \"Vehicle\".\n", + "Indeed: Although the word \"Fire\" ranks second in the word score, this is in combination with hydrant. This is about vehicles hitting fire hydrants." ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "predictions = trainer.predict(ds[\"test\"])\n", - "_ = evaluate_classifier(predictions.label_ids, None, softmax(predictions.predictions, axis=1), labels, \"Simularity, refined\", \"cm_peril_sim_b\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "jbpNYDeKi1MT" - }, - "source": [ - "The accuracy score has improved by about 2 percentage points.\n", - "\n", - "Compared to the results obtained by zero-shot classification, we observe that the confusion between “Vandalism” and “Vehicle” has strongly reduced. This might be at least partially due to the fact that we have used different candidate expressions. \n", - "\n", - "For a fair comparison, you might want to go back and re-run the zero-shot classification using the new candidate expressions. However, you will have noticed that the sentence similarity approach is much faster to execute. The computational effort for both approaches is dominated by running the respective transformer model. For the zero-shot classification, the model is run behind the scenes for each combination of sample and candidate expression, so that the effort scales with the number of samples times the number of candidate expressions. In contrast, as we have seen above, the similarity approach runs the transformer model once for each input sample and once for each candidate expression, so that the effort scales with the number of samples plus the number of candidate expressions. This allows experimenting with different candidate expressions." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "QO_xTyOKEVHI" - }, - "source": [ - "\n", - "\n", - "## 5. Unsupervised Topic Modeling by Clustering of Document Embeddings\n", - "\n", - "In the previous section we have seen the strength of zero-shot classification:\n", - "No prior training of the language model is required to produce a classification of reasonable quality.\n", - "However, it may be difficult to provide suitable candidate expressions.\n", - "\n", - "In this section, we present an alternative approach.\n", - "\n", - "The idea is to encode all text samples, to create clusters of \"similar\" documents and to extract meaningful\n", - "verbal representations of the clusters.\n", - "\n", - "Several packages are available to perform this task, e.g.,\n", - "[BERTopic](https://maartengr.github.io/BERTopic/index.html),\n", - "[Top2Vec](https://github.com/ddangelov/Top2Vec) and\n", - "[chat-intents](https://github.com/dborrelli/chat-intents).\n", - "These packages use similar concepts but provide different APIs, hyper-parameters, diagnostics tools, etc.\n", - "\n", - "Here, we use BERTopic.\n", - "\n", - "The algorithm consists of the following steps:\n", - "\n", - "1. **Embed documents:**\n", - " * Encode each text sample (document) into a vector - the embedding.\n", - " This can be based on a BERT model or any other document embedding technique.\n", - " By default, BERTopic uses `all-MiniLM-L6-v2`, which is trained in English.\n", - " In the multi-lingual case it uses `paraphrase-multilingual-MiniLM-L12-v2`.

\n", - "\n", - "2. **Cluster documents:**\n", - " * Reduce the dimensionality of the embeddings.\n", - " This is required because the documents embeddings are high-dimensional,\n", - " and typically, clustering algorithms have difficulty clustering data in high dimensional space.\n", - " By default, BERTopic uses\n", - " [UMAP (Uniform Manifold Approximation and Projection for Dimension Reduction)](https://umap-learn.readthedocs.io/en/latest/)\n", - " as it preserves both the local and global structure of embeddings quite well.
\n", - "\n", - " * Create clusters of semantically similar documents. \n", - " By default, BERTopic uses\n", - " [HDBSCAN](https://hdbscan.readthedocs.io/en/latest/)\n", - " as it allows to identify outliers.

\n", - "\n", - "3. **Create topic representation:**\n", - " * Extract and reduce topics with c-TF-IDF.\n", - " This is a modification of TF-IDF, which applies TD-IDF to the concatenation of all documents within each document cluster,\n", - " to obtain importance scores for the words within the cluster.\n", - " \n", - " * Improve coherence and diversity of words with Maximal Marginal Relevance, to find the most coherent words without having too much overlap between the words themselves. This results in the removal of words that do not contribute to a topic.\n", - " \n", - "Let's apply the algorithm to our dataset and examine the results." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "wds9A1oIEVHI" - }, - "source": [ - "\n", - "\n", - "### 5.1. Basic topic modeling\n", - "\n", - "Normally, BERTopic instantiates UMAP and HDBSCAN automatically.\n", - "Here, we instantiate them manually and pass them to BERTopic, for the following reasons:\n", - "\n", - "* For UMAP, we specify `random_state=42`, to improve reproducibility across runs. Please note that reproducibility across platforms is not guaranteed.\n", - "\n", - "* For HDBSCAN, we specify `min_cluster_size=30` and `min_samples=1` in order to control the number of clusters and the percentage of samples classified as outliers.\n", - "\n", - "Otherwise, we use the default parameters used by BERTopic. " - ] - }, - { - "cell_type": "code", - "execution_count": 36, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000, - "referenced_widgets": [ - "6f75d8f4973b4190971e31114659357f", - "ca23d08401e14f0ea2f26b30474cd851", - "141b59a274af4e12987648aad7c1c0a9", - "0df5ec008faf4097863467f9fa482d92", - "c2edb8c2fa8c4b448bb1c606ec89ec75", - "88b1b4ec2b4845e2a421a88fd4d3f2ca", - "d5d0343c5f044627a9eb7831abb65756", - "2e468409dc97440da727a31629f71d1a", - "593c169dfbf345629433470655a325d1", - "05b5736964ad48e5825672d3ca3cfe69", - "89fa8071833c4955b78bb6f8ddfcd4f3", - "52b1066a90f24f3a89b56702c5d67fd6", - "3b71a74a8cc84a6ab5ba95795030faba", - "cb267211536c4106a41b588fa2213296", - "91118756833249068ba8c266b98fe113", - "86d75ca4676b4db6871a9881611d8c0a", - "696b1b25f9bb4ff6b3ddc764c690c804", - "6ff6ee62693b4ce3af2624122d1a7e88", - "9bcd120e350a415fabd76b387730e2ef", - "50a500aedb6347b9b193bc9d2d544647", - "1906621155644db484bfe4d4fe07ce12", - "61f5ce18c63a428194767ea7a9bc8c6f", - "a145ccc5ad3440309655bdc56ed329d5", - "48e2b645abee40c6b5fcf2586c877f34", - "a930ad54c6d542f4846a38a75ba0dbca", - "68e79e7d3f644a64b1e9a6b965b9873d", - "79fc0fde09ff419bb70cd4fcf60166bd", - "6926a810d0674b67aaef319fc6457132", - "761295306fb94ad6a48a52b3dd4f6c4b", - "e04f5119ee654401942c040b0ede110b", - "9b1a721fdb7e4341b9f4537d009d0abe", - "885205ed837d43ac9dd9685cb0cb1779", - "e489fa3983a54d4aa24fd5fc7c3c0398", - "2c84acd0ade64716a46cc6fa86bc6951", - "d5c6923249b345599fae1f92fbab2681", - "8f35f14c856d4a8994aaca9820e22ec6", - "0d240a2d4bbd40b282dc5a64609672a6", - "3732cedae3eb4ca89fda08e5467715ee", - "60fe343d068a47a7b64090d7c38bdf5a", - "6ad218f38bae4a0db5557c334d03c14b", - "47727eb57d314f00b035238e90681338", - "39586bcb9c1b4fbca93d05a582209753", - "c8ee1ad0025148138522d1f3d35a01cf", - "6b92e4f8e8914c9098eeb35e2daf2882", - "f5b83013d0794a26be03e02f036519cc", - "278142b28f7341209ff853d67c354a10", - "592526530ec44c1886774b8ddbd9306a", - "5d8af77774244f15a0b53a5a5498c61b", - "1bc3df520c024829b8e9379fd4f09cf7", - "90d526066e8c4987a16cbcf7e01c1038", - "c220518979d74b8c9089ffc8fb62ca04", - "45564f8299044b5da17d323762393edb", - "3027db6a4b5f4b34ad69c5c34681fc97", - "203a6cc968e944c6b70c10e574370b92", - "e7be1952f3234c38adc44db5d30684b4", - "9ccad851f5ec43cabe766cd13bfd594f", - "a567b6bc200349a392136a8c544448b5", - "cb1aeeb006bc475e99ba806bf8624566", - "9b8788d6cf47462c8b693a6bbf0de0e3", - "fcb348895f0243958ce39af66638433e", - "3e95e45bdc9147808b25ce2e2b842969", - "223f257b5927425ea2793ff78a60a591", - "841cb44b752d47c2a21e4c663da38048", - "d53e5b8834ec494c998ba9342ae1c6e1", - "6789e4b00123408386fad863dc4ff235", - "5901aeb5d1e24779952c96b8263e62a0", - "3a3ccd73339b465ea43741d1edeadd68", - "c511ddfcffae4ea286eabbddcb07bc5e", - "5b93aeeeffcb48ed85bb027905659782", - "ae7311c2f28749a4a191de0455a5378c", - "3aaa95820770413db9e0e25a53be9d19", - "8eac561ce34a49ab8c55e44d1a7ada05", - "420475421b5043dd96330c4d2005e2db", - "e53e65e6566d41aba1ae11474fd534ba", - "6f380f1159304891bb0e77a369c8f5e9", - "d76596c02a514829b97a4a025e15e0a6", - "7d9ac315f1614932985252e878fd53ef", - "41ea8e1316d340df99aae24bd8c93969", - "dbbb4af430e04eadae3287109ef79f77", - "38b7e0b568c447079ff87f12e6ba21a0", - "78961bf6ea3c445a86de8c0a9fa60301", - "c013bf903fbd4af5bfc99bc0abf78996", - "b85ea9918cea4475a7dcf968114a5537", - "47e1eb19e96a481cb5cf3cdab90d87c3", - "18cac2a5cc9a48bdab2a64891fb1f66f", - "77cd1035f5e94347aa781762a85b6244", - "1f8047295eff40b19f0a976e67f98c3a", - "90202f1772e04b4ead3ff10a6e7ed150", - "352c9cd723a84d698fe110f0056f756b", - "8c59ac47b9ab4b1093a738827bf15261", - "184ac127cfe442a181e9d1135f45d4b9", - "2acd1b83b0364cf0b5be89d058f6277d", - "af8f72598deb46588804ca1689d32bd3", - "f75815ed31734a98aff984b195c71ca5", - "8c04349225674a9691eb9956b383f393", - "8ce831be076d4a0aaeac2dea7f74571c", - "4b9d8d5cbe864468b109aa5abf25d092", - "2081108498f544d8b70330a5cf2b33f3", - "ada3c89be1224ffea01d05a6696977ab", - "8d672c5dd2394accb419b50af6369d8a", - "a9a18ba5036c4957a11bfcccaa2bcbea", - "b6e0555332d04740b5724ced980fb823", - "d692a6ab5155487eb74e0c529e18dace", - "cb4d69702f514e5688aaed4e0cb2d68e", - "e7af31e46e174ea6b2a1a168784269d0", - "6e710b3d2d94441c805bfaf194bd6228", - "22dd156738a64b1d9c36306ade52a9df", - "f9c813702cbd43a8a7756f9925b8e091", - "47149232a2d640ca97e85f58cc8af710", - "2044594efdf34fcf8d1a84ad027885eb", - "f23f28f634ad46668da2af750c51d17d", - "5c475d1892c94592b7398bc028439f7a", - "43346612910e44a6ab4618c90fa27829", - "5821fd6e83244dc69f06caf1c69420df", - "daf1284fcd1c45bc9bb3f430544db154", - "ba73900d058346d49be5dca064b5e663", - "e6efec28608d40d1806a247484911a6d", - "459e68fba5b84cc88db37198e399de63", - "f39dec147f404f0b851468d008fec716", - "717b5278234d44b3acd04dc27a31dfe2", - "509bafaa375041d4b001bacce41a5318", - "f02c6045c6f74123b82c0988a08d2910", - "e2c6f05a6875492b9a958e693629145a", - "38e01a43e0424095b0216725223cacc3", - "4df39113ca2043258a34afe304f3d9d2", - "726446afcb2d42d7b8f806631dfbeb61", - "b187b12607ce49419f849fa1d1fcab8c", - "a7f0da2b16144f4bb8d6eadc63dc8cb6", - "a95f0fe4ce3b424ca87a41b1f678c249", - "f40893f97e914de090030cccd9cd0be0", - "b0202f326ca64676a4b9e2333edf2533", - "b74e13ff83d148f3898ab00cec0ea79e", - "8ec05331ade54131a517c23402fa631b", - "6e6899d861c84ad388b49f3ad6488ed7", - "cd40c48954164c04a1c3ca2f21a0a93a", - "f733c4422f064d8baf9e1d4537185011", - "afdd3ead171c4a1a88b912d5605a8ac3", - "28eab6f7e43848fcae1d568a26083a55", - "4588c062e290463bac0a5f468fd56c0d", - "00bddf74632a484b929d238afc51c81e", - "2c3b2a634ba147de9014180a70dacc1b", - "03f86c9d0b764e36b23e30358346eaf3", - "62fd3930106f4355871cee9397fec8cf", - "96e1dc646e07413cb3d2de813ace9557", - "e59c0e8b62654e89af549065e81c566d", - "09ea5fdae5eb49fd898d7d9f027a5785", - "b3aac4c5435e475aba0d006367212b54", - "fd58814a4c97441d911481a3b810d555", - "cc4705d0575944adbc0987368d3e49ca", - "74762ff37b2a4d828633630af1ed1ecb", - "ead6bc3051794fca93f0269308fd0c0c", - "d413bf53515b4cc5ac81b444f15fd19c", - "2b3c46c4f2914c809ec948a648fb291e", - "1bd452a69f6f408182343235b5f74435" - ] }, - "id": "ILamlptxEVHI", - "outputId": "30f4a11e-ae78-42c8-bbb2-93c2b0f9988e" - }, - "outputs": [ { - "name": "stderr", - "output_type": "stream", - "text": [ - "loading configuration file /home/ubuntu/.cache/torch/sentence_transformers/sentence-transformers_all-MiniLM-L6-v2/config.json\n", - "Model config BertConfig {\n", - " \"_name_or_path\": \"/home/ubuntu/.cache/torch/sentence_transformers/sentence-transformers_all-MiniLM-L6-v2/\",\n", - " \"architectures\": [\n", - " \"BertModel\"\n", - " ],\n", - " \"attention_probs_dropout_prob\": 0.1,\n", - " \"classifier_dropout\": null,\n", - " \"gradient_checkpointing\": false,\n", - " \"hidden_act\": \"gelu\",\n", - " \"hidden_dropout_prob\": 0.1,\n", - " \"hidden_size\": 384,\n", - " \"initializer_range\": 0.02,\n", - " \"intermediate_size\": 1536,\n", - " \"layer_norm_eps\": 1e-12,\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"bert\",\n", - " \"num_attention_heads\": 12,\n", - " \"num_hidden_layers\": 6,\n", - " \"pad_token_id\": 0,\n", - " \"position_embedding_type\": \"absolute\",\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"type_vocab_size\": 2,\n", - " \"use_cache\": true,\n", - " \"vocab_size\": 30522\n", - "}\n", - "\n", - "loading weights file /home/ubuntu/.cache/torch/sentence_transformers/sentence-transformers_all-MiniLM-L6-v2/pytorch_model.bin\n", - "All model checkpoint weights were used when initializing BertModel.\n", - "\n", - "All the weights of BertModel were initialized from the model checkpoint at /home/ubuntu/.cache/torch/sentence_transformers/sentence-transformers_all-MiniLM-L6-v2/.\n", - "If your task is similar to the task the model of the checkpoint was trained on, you can already use BertModel for predictions without further training.\n", - "Didn't find file /home/ubuntu/.cache/torch/sentence_transformers/sentence-transformers_all-MiniLM-L6-v2/added_tokens.json. We won't load it.\n", - "loading file /home/ubuntu/.cache/torch/sentence_transformers/sentence-transformers_all-MiniLM-L6-v2/vocab.txt\n", - "loading file /home/ubuntu/.cache/torch/sentence_transformers/sentence-transformers_all-MiniLM-L6-v2/tokenizer.json\n", - "loading file None\n", - "loading file /home/ubuntu/.cache/torch/sentence_transformers/sentence-transformers_all-MiniLM-L6-v2/special_tokens_map.json\n", - "loading file /home/ubuntu/.cache/torch/sentence_transformers/sentence-transformers_all-MiniLM-L6-v2/tokenizer_config.json\n" - ] + "cell_type": "markdown", + "metadata": { + "id": "67ZBWOL-EVHM" + }, + "source": [ + "\n", + "\n", + "### 5.2. Refinement\n", + "\n", + "Above, a relatively large number of samples was classified as outlier. All outliers were mapped to a single class, but this mapping is questionable, because we have seen that outlier samples belong to different classes.\n", + "\n", + "To mitigate this issue, we could label the outlier samples manually. However, this is quite tedious.\n", + "\n", + "Alternatively, we can train a classifier to the labels obtained from the unsupervised approach. To avoid label noise, we suppress outliers.\n", + "\n", + "First, we create the training dataset. We replace the true labels by the labels obtained from the clustering approach." + ] }, { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
TopicCountName
0-11077-1_vandalism_at_lightning_es
102080_glass_vandalism_west_es
212011_fire_smoke_damage_equipment
321822_froze_pipe_sewer_pipes
431763_power_surge_generator_spoilage
541614_theft_of_stolen_break
651415_graffiti_on_kennedy_hoyt
761286_lightning_damage_scale_dpw
871127_park_vandalism_pavilion_dmg
981098_broken_door_glass_breakage
1091099_lightning_dept_hall_hwy
111010410_signal_traffic_damaged_paradise
12118411_wind_damage_course_golf
13128312_hydrant_fire_hit_damaged
14137913_llm_glass_mendota_hawk
15147714_garage_door_hwy_shop
16157615_computer_lightning_to_equipment
17167316_fence_gate_vehicle_damaged
18177317_building_truck_vehicle_by
19187218_hail_buildings_roof_multiple
20196819_water_damage_goodman_pool
21206820_shelter_eastman_farlin_seymour
22216721_pole_vehicle_hit_light
23226422_pole_light_damaged_lightpole
24236223_window_broken_windows_screens
25246124_laptop_theft_from_of
26255725_roof_wind_shingles_blew
27265626_water_es_ms_damage
29275527_dmg_humboldt_lafollette_vandalism
28285528_vandalism_damage_odonnell_bandshell
30295429_street_light_run_damaged
31305130_airport_lightning_lights_runway
32315031_center_water_main_dept
33324932_phone_system_phones_telephone
34334933_vandalism_lemonweir_lock_gazebo
35344734_well_meter_flow_lightning
36354735_school_water_elementary_high
37364536_sign_vehicle_signal_traffic
38374437_overhead_door_damaged_loader
39384438_wind_fence_park_trees
40394439_equipment_playground_slide_gps
41404240_storm_multiple_sites_locations
42414241_hs_lightning_hhs_damage
43424142_park_washington_vandalism_jacobus
44433943_hs_water_tremper_pw
45443844_laptop_mckinley_damaged_computer
46453845_water_equipment_carpet_to
47463846_radio_antenna_lightning_radios
48473347_street_pole_light_streetlight
49483348_gym_floor_injured_k9
50493249_ms_es_lightning_damage
51503250_hydrant_vehicle_struck_hit
52513151_radio_lost_dropped_portable
53523052_roof_collapsed_collapse_gutter
54533053_buildings_building_water_basement
55543054_tower_lightning_north_internet
\n", - "
" + "cell_type": "code", + "execution_count": 51, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 49, + "referenced_widgets": [ + "4ef1df4f11a6406c8ffe11d3be4af259", + "6454374431404c1ea46899c35c05b063", + "73e34a464d6142d4bee73412fbc91e93", + "c7eed26541f14cb8a92a29b99b569d34", + "9d4bac79b75f4d1b8d7965eb5d5c5bc3", + "41b17d092d6c41f7a4d37d4b454c1825", + "51acf591d4f2434ba35a4665247c815f", + "70adad47fbe848ebb9497f683127adf7", + "a46e3ffffed1435087c74d615ceebe9d", + "db7ee224b00b4d2eb787d24561e83ce4", + "4d51eb40e0a1457e8411536dfe0ddb0a" + ] + }, + "id": "rM4tmo_WEVHM", + "outputId": "7b89b04b-7792-4a5a-ff89-b9bd142c85af" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Map: 0%| | 0/4329 [00:00=0].copy()\n", + "df_train_unsupervised[\"labels\"] = [mapping[t] for t in df_train_unsupervised[\"Topic\"]]\n", + "ds_train_unsupervised = Dataset.from_pandas(df_train_unsupervised)\n", + "ds_train_unsupervised = ds_train_unsupervised.map(tokenize, batched=True)" ] - }, - "execution_count": 36, - "metadata": {}, - "output_type": "execute_result" - } - ], - "source": [ - "np.random.seed(42)\n", - "import random\n", - "random.seed(42)\n", - "umap_model = UMAP(n_neighbors=15, n_components=10, metric='cosine', low_memory=False, random_state=42)\n", - "hdbscan_model = HDBSCAN(min_cluster_size=30, metric='euclidean', prediction_data=True, min_samples=1)\n", - "topic_model = BERTopic(umap_model=umap_model, hdbscan_model=hdbscan_model)\n", - "topics, probs = topic_model.fit_transform(df_train[\"Description\"])\n", - "topic_model.get_topic_info()" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "LcmIftTnEVHJ" - }, - "source": [ - "The first output of `fit_transform` holds the topic ID for each sample. The second output is the probability of the sample belonging to that topic.\n", - "\n", - "In our case, we have obtained ca. 50 clusters. due to randomness of UMAP, the results may differ between runs. Unfortunately, we have not found a way to fix this.\n", - "\n", - "The cluster with ID `-1` contains all samples which are considered \"noise\" because they were not attributed to any cluster.\n", - "\n", - "The function `get_topic_info` returns the topic ID, the sample count, and a concatenation of the words representing the cluster.\n", - "\n", - "To get a visual impression of the clusters, BERTopic provides the function `visualize_topics` which embeds the c-TF-IDF representation of the topics in 2D using UMAP and then visualizes the two dimensions using plotly in an interactive view." - ] - }, - { - "cell_type": "code", - "execution_count": 37, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 667 }, - "id": "q5WOiwszEVHJ", - "outputId": "81c6a4e0-317c-4abf-fd2c-daf91952a04e" - }, - "outputs": [ { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly" - }, - "data": [ + "cell_type": "code", + "execution_count": 52, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 172 + }, + "id": "4Mdi7Y6aEVHN", + "outputId": "abfd0c29-2306-4c80-99b7-ded7518d9774" + }, + "outputs": [ { - "customdata": [ - [ - 1, - "fire | smoke | damage | equipment | station", - 201 - ], - [ - 2, - "froze | pipe | sewer | pipes | library", - 182 - ], - [ - 3, - "power | surge | generator | spoilage | food", - 176 - ], - [ - 4, - "theft | of | stolen | break | from", - 161 - ], - [ - 5, - "graffiti | on | kennedy | hoyt | llm", - 141 - ], - [ - 6, - "lightning | damage | scale | dpw | museum", - 128 - ], - [ - 7, - "park | vandalism | pavilion | dmg | madison", - 112 - ], - [ - 8, - "broken | door | glass | breakage | entrance", - 109 - ], - [ - 9, - "lightning | dept | hall | hwy | st", - 109 - ], - [ - 10, - "signal | traffic | damaged | paradise | box", - 104 - ], - [ - 11, - "wind | damage | course | golf | tower", - 84 - ], - [ - 12, - "hydrant | fire | hit | damaged | run", - 83 - ], - [ - 13, - "llm | glass | mendota | hawk | black", - 79 - ], - [ - 14, - "garage | door | hwy | shop | truck", - 77 - ], - [ - 15, - "computer | lightning | to | equipment | system", - 76 - ], - [ - 16, - "fence | gate | vehicle | damaged | by", - 73 - ], - [ - 17, - "building | truck | vehicle | by | wall", - 73 - ], - [ - 18, - "hail | buildings | roof | multiple | windhail", - 72 - ], - [ - 19, - "water | damage | goodman | pool | toki", - 68 - ], - [ - 20, - "shelter | eastman | farlin | seymour | vandalism", - 68 - ], - [ - 21, - "pole | vehicle | hit | light | struck", - 67 - ], - [ - 22, - "pole | light | damaged | lightpole | rawson", - 64 - ], - [ - 23, - "window | broken | windows | screens | screen", - 62 - ], - [ - 24, - "laptop | theft | from | of | stolen", - 61 - ], - [ - 25, - "roof | wind | shingles | blew | off", - 57 - ], - [ - 26, - "water | es | ms | damage | west", - 56 - ], - [ - 27, - "dmg | humboldt | lafollette | vandalism | park", - 55 - ], - [ - 28, - "vandalism | damage | odonnell | bandshell | clubhouse", - 55 - ], - [ - 29, - "street | light | run | damaged | hit", - 54 - ], - [ - 30, - "airport | lightning | lights | runway | gates", - 51 - ], - [ - 31, - "center | water | main | dept | resch", - 50 - ], - [ - 32, - "phone | system | phones | telephone | lightning", - 49 - ], - [ - 33, - "vandalism | lemonweir | lock | gazebo | window", - 49 - ], - [ - 34, - "well | meter | flow | lightning | 10", - 47 - ], - [ - 35, - "school | water | elementary | high | lincoln", - 47 - ], - [ - 36, - "sign | vehicle | signal | traffic | struck", - 45 - ], - [ - 37, - "overhead | door | damaged | loader | hangar", - 44 - ], - [ - 38, - "wind | fence | park | trees | fencing", - 44 - ], - [ - 39, - "equipment | playground | slide | gps | instrument", - 44 - ], - [ - 40, - "storm | multiple | sites | locations | bldgs", - 42 - ], - [ - 41, - "hs | lightning | hhs | damage | at", - 42 - ], - [ - 42, - "park | washington | vandalism | jacobus | wilson", - 41 - ], - [ - 43, - "hs | water | tremper | pw | reuther", - 39 - ], - [ - 44, - "laptop | mckinley | damaged | computer | wic", - 38 - ], - [ - 45, - "water | equipment | carpet | to | computers", - 38 - ], - [ - 46, - "radio | antenna | lightning | radios | to", - 38 - ], - [ - 47, - "street | pole | light | streetlight | damaged", - 33 - ], - [ - 48, - "gym | floor | injured | k9 | training", - 33 - ], - [ - 49, - "ms | es | lightning | damage | karcher", - 32 - ], - [ - 50, - "hydrant | vehicle | struck | hit | over", - 32 - ], - [ - 51, - "radio | lost | dropped | portable | radios", - 31 - ], - [ - 52, - "roof | collapsed | collapse | gutter | snow", - 30 - ], - [ - 53, - "buildings | building | water | basement | to", - 30 - ], - [ - 54, - "tower | lightning | north | internet | barnes", - 30 + "output_type": "stream", + "name": "stderr", + "text": [ + "Some weights of DistilBertForSequenceClassification were not initialized from the model checkpoint at distilbert-base-uncased and are newly initialized: ['pre_classifier.bias', 'classifier.bias', 'pre_classifier.weight', 'classifier.weight']\n", + "You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n" ] - ], - "hovertemplate": "Topic %{customdata[0]}
Words: %{customdata[1]}
Size: %{customdata[2]}", - "legendgroup": "", - "marker": { - "color": "#B0BEC5", - "line": { - "color": "DarkSlateGrey", - "width": 2 + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "\n", + "
\n", + " \n", + " \n", + " [1084/1084 00:55, Epoch 2/2]\n", + "
\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
StepTraining Loss
5410.377000
10820.090200

" + ] }, - "size": [ - 201, - 182, - 176, - 161, - 141, - 128, - 112, - 109, - 109, - 104, - 84, - 83, - 79, - 77, - 76, - 73, - 73, - 72, - 68, - 68, - 67, - 64, - 62, - 61, - 57, - 56, - 55, - 55, - 54, - 51, - 50, - 49, - 49, - 47, - 47, - 45, - 44, - 44, - 44, - 42, - 42, - 41, - 39, - 38, - 38, - 38, - 33, - 33, - 32, - 32, - 31, - 30, - 30, - 30 - ], - "sizemode": "area", - "sizeref": 0.125625, - "symbol": "circle" - }, - "mode": "markers", - "name": "", - "orientation": "v", - "showlegend": false, - "type": "scatter", - "x": [ - 4.360762596130371, - 0.7932742238044739, - 0.2752592861652374, - -0.8667153716087341, - -0.289823442697525, - -2.950580358505249, - -0.21415774524211884, - -0.4716852903366089, - 4.518781661987305, - 16.868803024291992, - 5.648620128631592, - 16.180559158325195, - -0.3241567313671112, - 3.491412878036499, - 0.8606080412864685, - 3.875570297241211, - 3.656827926635742, - 4.885891437530518, - -2.6868414878845215, - -1.2351701259613037, - 16.549402236938477, - 16.407291412353516, - -0.22113357484340668, - -1.0431572198867798, - 5.2124786376953125, - -1.0305452346801758, - -0.36974582076072693, - -13.733373641967773, - 25.175086975097656, - 0.8627772927284241, - -13.690558433532715, - 0.4739021360874176, - -0.21453410387039185, - 1.0973047018051147, - -0.9572131037712097, - 16.911088943481445, - 3.3607969284057617, - 5.523925304412842, - 25.11425018310547, - -13.985651016235352, - -2.9206526279449463, - -0.2947523891925812, - -3.371992826461792, - -1.121610403060913, - 0.821208655834198, - 13.629738807678223, - 25.336883544921875, - -3.473048686981201, - -1.1059958934783936, - 16.247385025024414, - 13.630906105041504, - 5.329831123352051, - -13.614521980285645, - -2.9508841037750244 - ], - "xaxis": "x", - "y": [ - 5.099972724914551, - 12.630294799804688, - 13.182474136352539, - 11.931550025939941, - -4.145082950592041, - 7.585357189178467, - -11.443068504333496, - -4.5971832275390625, - 5.205262660980225, - 4.044532299041748, - 4.909511089324951, - 4.027768135070801, - -4.191524982452393, - -5.808047294616699, - 13.14031982421875, - -5.423551082611084, - -5.643819808959961, - 5.298285007476807, - 7.328395366668701, - -4.728237628936768, - 3.637396812438965, - 3.494387626647949, - -5.0907111167907715, - 11.757235527038574, - 5.327895641326904, - -4.541518211364746, - -11.287375450134277, - 9.561244010925293, - -0.17016500234603882, - 13.26408863067627, - 9.604170799255371, - 13.053056716918945, - -5.17617654800415, - 13.463350296020508, - 11.841389656066895, - 3.9184176921844482, - -5.935364723205566, - 4.994048595428467, - -0.10936477780342102, - 9.308842658996582, - 7.54194974899292, - -11.362563133239746, - 7.997793197631836, - 11.677850723266602, - 12.852232933044434, - -7.7953996658325195, - -0.332033634185791, - 8.100335121154785, - -4.636351585388184, - 3.94486665725708, - -7.794538497924805, - 5.423069000244141, - 9.680058479309082, - 7.5858154296875 - ], - "yaxis": "y" + "metadata": {} } - ], - "layout": { - "annotations": [ - { - "showarrow": false, - "text": "D1", - "x": -16.083498668670654, - "y": 1.1616620302200316, - "yshift": 10 - }, - { - "showarrow": false, - "text": "D2", - "x": 6.526958703994751, - "xshift": 10, - "y": 15.482852840423584 - } - ], - "height": 650, - "hoverlabel": { - "bgcolor": "white", - "font": { - "family": "Rockwell", - "size": 16 - } - }, - "legend": { - "itemsizing": "constant", - "tracegroupgap": 0 - }, - "margin": { - "t": 60 - }, - "shapes": [ - { - "line": { - "color": "#CFD8DC", - "width": 2 - }, - "type": "line", - "x0": 6.526958703994751, - "x1": 6.526958703994751, - "y0": -13.159528779983521, - "y1": 15.482852840423584 - }, - { - "line": { - "color": "#9E9E9E", - "width": 2 - }, - "type": "line", - "x0": -16.083498668670654, - "x1": 29.137416076660156, - "y0": 1.1616620302200316, - "y1": 1.1616620302200316 - } - ], - "sliders": [ - { - "active": 0, - "pad": { - "t": 50 - }, - "steps": [ - { - "args": [ - { - "marker.color": [ - [ - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 1", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 2", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 3", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 4", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 5", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 6", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 7", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 8", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 9", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 10", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 11", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 12", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 13", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 14", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 15", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 16", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 17", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 18", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 19", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 20", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 21", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 22", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 23", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 24", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 25", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 26", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 27", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 28", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 29", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 30", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 31", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 32", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 33", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 34", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 35", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 36", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 37", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 38", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 39", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 40", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 41", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 42", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 43", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 44", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 45", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 46", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 47", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 48", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 49", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 50", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 51", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 52", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red", - "#B0BEC5" - ] - ] - } - ], - "label": "Topic 53", - "method": "update" - }, - { - "args": [ - { - "marker.color": [ - [ - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "#B0BEC5", - "red" - ] - ] - } - ], - "label": "Topic 54", - "method": "update" - } - ] - } - ], - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "rgb(36,36,36)" - }, - "error_y": { - "color": "rgb(36,36,36)" - }, - "marker": { - "line": { - "color": "white", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "white", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "rgb(36,36,36)", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "rgb(36,36,36)" - }, - "baxis": { - "endlinecolor": "rgb(36,36,36)", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "rgb(36,36,36)" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - }, - "colorscale": [ - [ - 0, - "#440154" - ], - [ - 0.1111111111111111, - "#482878" - ], - [ - 0.2222222222222222, - "#3e4989" - ], - [ - 0.3333333333333333, - "#31688e" - ], - [ - 0.4444444444444444, - "#26828e" - ], - [ - 0.5555555555555556, - "#1f9e89" - ], - [ - 0.6666666666666666, - "#35b779" - ], - [ - 0.7777777777777778, - "#6ece58" - ], - [ - 0.8888888888888888, - "#b5de2b" - ], - [ - 1, - "#fde725" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - }, - "colorscale": [ - [ - 0, - "#440154" - ], - [ - 0.1111111111111111, - "#482878" - ], - [ - 0.2222222222222222, - "#3e4989" - ], - [ - 0.3333333333333333, - "#31688e" - ], - [ - 0.4444444444444444, - "#26828e" - ], - [ - 0.5555555555555556, - "#1f9e89" - ], - [ - 0.6666666666666666, - "#35b779" - ], - [ - 0.7777777777777778, - "#6ece58" - ], - [ - 0.8888888888888888, - "#b5de2b" - ], - [ - 1, - "#fde725" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - }, - "colorscale": [ - [ - 0, - "#440154" - ], - [ - 0.1111111111111111, - "#482878" - ], - [ - 0.2222222222222222, - "#3e4989" - ], - [ - 0.3333333333333333, - "#31688e" - ], - [ - 0.4444444444444444, - "#26828e" - ], - [ - 0.5555555555555556, - "#1f9e89" - ], - [ - 0.6666666666666666, - "#35b779" - ], - [ - 0.7777777777777778, - "#6ece58" - ], - [ - 0.8888888888888888, - "#b5de2b" - ], - [ - 1, - "#fde725" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "line": { - "color": "white", - "width": 0.6 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - }, - "colorscale": [ - [ - 0, - "#440154" - ], - [ - 0.1111111111111111, - "#482878" - ], - [ - 0.2222222222222222, - "#3e4989" - ], - [ - 0.3333333333333333, - "#31688e" - ], - [ - 0.4444444444444444, - "#26828e" - ], - [ - 0.5555555555555556, - "#1f9e89" - ], - [ - 0.6666666666666666, - "#35b779" - ], - [ - 0.7777777777777778, - "#6ece58" - ], - [ - 0.8888888888888888, - "#b5de2b" - ], - [ - 1, - "#fde725" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - }, - "colorscale": [ - [ - 0, - "#440154" - ], - [ - 0.1111111111111111, - "#482878" - ], - [ - 0.2222222222222222, - "#3e4989" - ], - [ - 0.3333333333333333, - "#31688e" - ], - [ - 0.4444444444444444, - "#26828e" - ], - [ - 0.5555555555555556, - "#1f9e89" - ], - [ - 0.6666666666666666, - "#35b779" - ], - [ - 0.7777777777777778, - "#6ece58" - ], - [ - 0.8888888888888888, - "#b5de2b" - ], - [ - 1, - "#fde725" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - }, - "colorscale": [ - [ - 0, - "#440154" - ], - [ - 0.1111111111111111, - "#482878" - ], - [ - 0.2222222222222222, - "#3e4989" - ], - [ - 0.3333333333333333, - "#31688e" - ], - [ - 0.4444444444444444, - "#26828e" - ], - [ - 0.5555555555555556, - "#1f9e89" - ], - [ - 0.6666666666666666, - "#35b779" - ], - [ - 0.7777777777777778, - "#6ece58" - ], - [ - 0.8888888888888888, - "#b5de2b" - ], - [ - 1, - "#fde725" - ] + ], + "source": [ + "model_name = \"distilbert-base-uncased\"\n", + "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", + "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model\n", + "model = AutoModelForSequenceClassification.from_pretrained(model_name, num_labels=len(labels)).to(device)\n", + "\n", + "# train the model\n", + "batch_size = 8\n", + "logging_steps = len(ds_train_unsupervised) // batch_size\n", + "training_args = TrainingArguments(\n", + " output_dir=model_name+\"_peril_u_epochs\",\n", + " num_train_epochs=2,\n", + " per_device_train_batch_size=batch_size,\n", + " per_device_eval_batch_size=batch_size,\n", + " metric_for_best_model=\"f1\",\n", + " logging_steps=logging_steps,\n", + " save_strategy=trainer_utils.IntervalStrategy.NO,\n", + ")\n", + "trainer = Trainer(model=model, args=training_args,\n", + " compute_metrics=compute_metrics, train_dataset=ds_train_unsupervised,\n", + " eval_dataset=ds[\"test\"])\n", + "trainer.train();\n", + "trainer.save_model(model_name + \"_peril_u\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "Rs65tNt_EVHN" + }, + "source": [ + "Then, we evaluate the classifier on the test set, by comparing the predicted to the true labels." + ] + }, + { + "cell_type": "code", + "execution_count": 53, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 872 + }, + "id": "HldJUXwtEVHN", + "outputId": "10ee308d-7c4a-4edd-9315-18c9c2dc4cda" + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "rgb(237,237,237)" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "rgb(217,217,217)" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowhead": 0, - "arrowwidth": 1 + "text/html": [] }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 1, - "tickcolor": "rgb(36,36,36)", - "ticks": "outside" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "rgb(103,0,31)" - ], - [ - 0.1, - "rgb(178,24,43)" - ], - [ - 0.2, - "rgb(214,96,77)" - ], - [ - 0.3, - "rgb(244,165,130)" - ], - [ - 0.4, - "rgb(253,219,199)" - ], - [ - 0.5, - "rgb(247,247,247)" - ], - [ - 0.6, - "rgb(209,229,240)" - ], - [ - 0.7, - "rgb(146,197,222)" - ], - [ - 0.8, - "rgb(67,147,195)" - ], - [ - 0.9, - "rgb(33,102,172)" - ], - [ - 1, - "rgb(5,48,97)" - ] - ], - "sequential": [ - [ - 0, - "#440154" - ], - [ - 0.1111111111111111, - "#482878" - ], - [ - 0.2222222222222222, - "#3e4989" - ], - [ - 0.3333333333333333, - "#31688e" - ], - [ - 0.4444444444444444, - "#26828e" - ], - [ - 0.5555555555555556, - "#1f9e89" - ], - [ - 0.6666666666666666, - "#35b779" - ], - [ - 0.7777777777777778, - "#6ece58" - ], - [ - 0.8888888888888888, - "#b5de2b" - ], - [ - 1, - "#fde725" - ] - ], - "sequentialminus": [ - [ - 0, - "#440154" - ], - [ - 0.1111111111111111, - "#482878" - ], - [ - 0.2222222222222222, - "#3e4989" - ], - [ - 0.3333333333333333, - "#31688e" - ], - [ - 0.4444444444444444, - "#26828e" - ], - [ - 0.5555555555555556, - "#1f9e89" - ], - [ - 0.6666666666666666, - "#35b779" - ], - [ - 0.7777777777777778, - "#6ece58" - ], - [ - 0.8888888888888888, - "#b5de2b" - ], - [ - 1, - "#fde725" - ] - ] - }, - "colorway": [ - "#1F77B4", - "#FF7F0E", - "#2CA02C", - "#D62728", - "#9467BD", - "#8C564B", - "#E377C2", - "#7F7F7F", - "#BCBD22", - "#17BECF" - ], - "font": { - "color": "rgb(36,36,36)" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "white", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "white", - "polar": { - "angularaxis": { - "gridcolor": "rgb(232,232,232)", - "linecolor": "rgb(36,36,36)", - "showgrid": false, - "showline": true, - "ticks": "outside" - }, - "bgcolor": "white", - "radialaxis": { - "gridcolor": "rgb(232,232,232)", - "linecolor": "rgb(36,36,36)", - "showgrid": false, - "showline": true, - "ticks": "outside" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "white", - "gridcolor": "rgb(232,232,232)", - "gridwidth": 2, - "linecolor": "rgb(36,36,36)", - "showbackground": true, - "showgrid": false, - "showline": true, - "ticks": "outside", - "zeroline": false, - "zerolinecolor": "rgb(36,36,36)" - }, - "yaxis": { - "backgroundcolor": "white", - "gridcolor": "rgb(232,232,232)", - "gridwidth": 2, - "linecolor": "rgb(36,36,36)", - "showbackground": true, - "showgrid": false, - "showline": true, - "ticks": "outside", - "zeroline": false, - "zerolinecolor": "rgb(36,36,36)" - }, - "zaxis": { - "backgroundcolor": "white", - "gridcolor": "rgb(232,232,232)", - "gridwidth": 2, - "linecolor": "rgb(36,36,36)", - "showbackground": true, - "showgrid": false, - "showline": true, - "ticks": "outside", - "zeroline": false, - "zerolinecolor": "rgb(36,36,36)" - } - }, - "shapedefaults": { - "fillcolor": "black", - "line": { - "width": 0 - }, - "opacity": 0.3 - }, - "ternary": { - "aaxis": { - "gridcolor": "rgb(232,232,232)", - "linecolor": "rgb(36,36,36)", - "showgrid": false, - "showline": true, - "ticks": "outside" - }, - "baxis": { - "gridcolor": "rgb(232,232,232)", - "linecolor": "rgb(36,36,36)", - "showgrid": false, - "showline": true, - "ticks": "outside" - }, - "bgcolor": "white", - "caxis": { - "gridcolor": "rgb(232,232,232)", - "linecolor": "rgb(36,36,36)", - "showgrid": false, - "showline": true, - "ticks": "outside" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "rgb(232,232,232)", - "linecolor": "rgb(36,36,36)", - "showgrid": false, - "showline": true, - "ticks": "outside", - "title": { - "standoff": 15 - }, - "zeroline": false, - "zerolinecolor": "rgb(36,36,36)" - }, - "yaxis": { - "automargin": true, - "gridcolor": "rgb(232,232,232)", - "linecolor": "rgb(36,36,36)", - "showgrid": false, - "showline": true, - "ticks": "outside", - "title": { - "standoff": 15 - }, - "zeroline": false, - "zerolinecolor": "rgb(36,36,36)" - } - } - }, - "title": { - "font": { - "color": "Black", - "size": 22 - }, - "text": "Intertopic Distance Map", - "x": 0.5, - "xanchor": "center", - "y": 0.95, - "yanchor": "top" - }, - "width": 650, - "xaxis": { - "anchor": "y", - "domain": [ - 0, - 1 - ], - "range": [ - -16.083498668670654, - 29.137416076660156 - ], - "title": { - "text": "" - }, - "visible": false - }, - "yaxis": { - "anchor": "x", - "domain": [ - 0, - 1 - ], - "range": [ - -13.159528779983521, - 15.482852840423584 - ], - "title": { - "text": "" - }, - "visible": false - } - } - }, - "text/html": [ - "

" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "topic_model.visualize_topics()" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "IrKzZcJgEVHJ" - }, - "source": [ - "We can visualize the selected terms for a few topics by creating bar charts out of the c-TF-IDF scores for each topic representation.\n", - "Insights can be gained from the relative c-TF-IDF scores between and within topics. Moreover, you can easily compare topic representations to each other. To visualize this hierarchy, simply call the function `visualize_barchart`:" - ] - }, - { - "cell_type": "code", - "execution_count": 38, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 342 - }, - "id": "Gd0yT5hMEVHJ", - "outputId": "3863a7ba-a769-460f-d003-a4e43717ab2f" - }, - "outputs": [ - { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly" - }, - "data": [ - { - "marker": { - "color": "#D55E00" - }, - "orientation": "h", - "type": "bar", - "x": [ - 0.038128182207882395, - 0.04479394583665111, - 0.05593389088554244, - 0.07275218655635046, - 0.13801910476607823 - ], - "xaxis": "x", - "y": [ - "ms ", - "es ", - "west ", - "vandalism ", - "glass " - ], - "yaxis": "y" - }, - { - "marker": { - "color": "#0072B2" - }, - "orientation": "h", - "type": "bar", - "x": [ - 0.023295897805408042, - 0.023555605798973325, - 0.025803975483149527, - 0.08229676777844862, - 0.15913408180789676 - ], - "xaxis": "x2", - "y": [ - "station ", - "equipment ", - "damage ", - "smoke ", - "fire " - ], - "yaxis": "y2" + "metadata": {} }, { - "marker": { - "color": "#CC79A7" - }, - "orientation": "h", - "type": "bar", - "x": [ - 0.06957795460763112, - 0.07042296993941073, - 0.07393959399336025, - 0.07866108895353201, - 0.07972543102064714 - ], - "xaxis": "x3", - "y": [ - "library ", - "pipes ", - "sewer ", - "pipe ", - "froze " - ], - "yaxis": "y3" + "output_type": "stream", + "name": "stdout", + "text": [ + "Topic modeling by clustering, refined\n", + "accuracy score = 79.8%, log loss = 1.514, Brier loss = 0.383\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " Vandalism 0.84 0.95 0.89 310\n", + " Fire 0.80 0.87 0.83 46\n", + " Lightning 0.93 0.93 0.93 123\n", + " Wind 0.89 0.87 0.88 107\n", + " Hail 0.89 0.94 0.92 18\n", + " Vehicle 0.88 0.87 0.88 227\n", + " WaterNW 0.00 0.00 0.00 67\n", + " WaterW 0.28 0.89 0.43 38\n", + " Misc 0.76 0.38 0.51 103\n", + "\n", + " accuracy 0.80 1039\n", + " macro avg 0.70 0.75 0.70 1039\n", + "weighted avg 0.78 0.80 0.78 1039\n", + "\n" + ] }, { - "marker": { - "color": "#E69F00" - }, - "orientation": "h", - "type": "bar", - "x": [ - 0.04817645074952102, - 0.051298981764011584, - 0.06890171236430481, - 0.2123333962021105, - 0.21986552294095435 - ], - "xaxis": "x4", - "y": [ - "food ", - "spoilage ", - "generator ", - "surge ", - "power " - ], - "yaxis": "y4" - } - ], - "layout": { - "annotations": [ - { - "font": { - "size": 16 - }, - "showarrow": false, - "text": "Topic 0", - "x": 0.0875, - "xanchor": "center", - "xref": "paper", - "y": 1, - "yanchor": "bottom", - "yref": "paper" - }, - { - "font": { - "size": 16 - }, - "showarrow": false, - "text": "Topic 1", - "x": 0.36250000000000004, - "xanchor": "center", - "xref": "paper", - "y": 1, - "yanchor": "bottom", - "yref": "paper" - }, - { - "font": { - "size": 16 - }, - "showarrow": false, - "text": "Topic 2", - "x": 0.6375000000000001, - "xanchor": "center", - "xref": "paper", - "y": 1, - "yanchor": "bottom", - "yref": "paper" - }, - { - "font": { - "size": 16 - }, - "showarrow": false, - "text": "Topic 3", - "x": 0.9125, - "xanchor": "center", - "xref": "paper", - "y": 1, - "yanchor": "bottom", - "yref": "paper" - } - ], - "height": 325, - "hoverlabel": { - "bgcolor": "white", - "font": { - "family": "Rockwell", - "size": 16 - } - }, - "showlegend": false, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "white", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "white", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "#C8D4E3", - "linecolor": "#C8D4E3", - "minorgridcolor": "#C8D4E3", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "#C8D4E3", - "linecolor": "#C8D4E3", - "minorgridcolor": "#C8D4E3", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "white", - "showlakes": true, - "showland": true, - "subunitcolor": "#C8D4E3" }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "white", - "polar": { - "angularaxis": { - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "" - }, - "bgcolor": "white", - "radialaxis": { - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "white", - "gridcolor": "#DFE8F3", - "gridwidth": 2, - "linecolor": "#EBF0F8", - "showbackground": true, - "ticks": "", - "zerolinecolor": "#EBF0F8" - }, - "yaxis": { - "backgroundcolor": "white", - "gridcolor": "#DFE8F3", - "gridwidth": 2, - "linecolor": "#EBF0F8", - "showbackground": true, - "ticks": "", - "zerolinecolor": "#EBF0F8" - }, - "zaxis": { - "backgroundcolor": "white", - "gridcolor": "#DFE8F3", - "gridwidth": 2, - "linecolor": "#EBF0F8", - "showbackground": true, - "ticks": "", - "zerolinecolor": "#EBF0F8" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "#DFE8F3", - "linecolor": "#A2B1C6", - "ticks": "" - }, - "baxis": { - "gridcolor": "#DFE8F3", - "linecolor": "#A2B1C6", - "ticks": "" - }, - "bgcolor": "white", - "caxis": { - "gridcolor": "#DFE8F3", - "linecolor": "#A2B1C6", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "#EBF0F8", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "#EBF0F8", - "zerolinewidth": 2 - } - } - }, - "title": { - "font": { - "color": "Black", - "size": 22 - }, - "text": "Topic Word Scores", - "x": 0.5, - "xanchor": "center", - "yanchor": "top" - }, - "width": 1000, - "xaxis": { - "anchor": "y", - "domain": [ - 0, - 0.175 - ], - "showgrid": true - }, - "xaxis2": { - "anchor": "y2", - "domain": [ - 0.275, - 0.45 - ], - "showgrid": true - }, - "xaxis3": { - "anchor": "y3", - "domain": [ - 0.55, - 0.7250000000000001 - ], - "showgrid": true - }, - "xaxis4": { - "anchor": "y4", - "domain": [ - 0.825, - 1 - ], - "showgrid": true - }, - "yaxis": { - "anchor": "x", - "domain": [ - 0, - 1 - ], - "showgrid": true - }, - "yaxis2": { - "anchor": "x2", - "domain": [ - 0, - 1 - ], - "showgrid": true - }, - "yaxis3": { - "anchor": "x3", - "domain": [ - 0, - 1 - ], - "showgrid": true - }, - "yaxis4": { - "anchor": "x4", - "domain": [ - 0, - 1 - ], - "showgrid": true + "metadata": {} } - } + ], + "source": [ + "predictions = trainer.predict(ds[\"test\"])\n", + "_ = evaluate_classifier(predictions.label_ids, None, softmax(predictions.predictions, axis=1), labels, \"Topic modeling by clustering, refined\", \"cm_peril_topic_b\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "r_LJQY04EVHN" }, - "text/html": [ - "
" + "source": [ + "The accuracy score has improved significantly." ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "topic_model.visualize_barchart(top_n_topics=4)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "vAiy4n1iEVHJ" - }, - "source": [ - "BERTopics creates topics in a hierarchical structure. The function `visualize_hierarchy` displays the hierarchy. This information is useful to reduce the number of topics, either by specifying a value for the parameter `nr_topics` upon instantiation of BERTopic, or after the training by calling the function `reduce_topics`." - ] - }, - { - "cell_type": "code", - "execution_count": 39, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000 }, - "id": "Azf54Sl6EVHJ", - "outputId": "035907f6-c0a9-4ba4-c6e4-a09e7f1df765" - }, - "outputs": [ { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly" - }, - "data": [ - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.6023164198318862, - 0.6023164198318862, - 0 - ], - "xaxis": "x", - "y": [ - -5, - -5, - -15, - -15 - ], - "yaxis": "y" + "cell_type": "markdown", + "metadata": { + "id": "0Wet19WmEVHN" + }, + "source": [ + "\n", + "\n", + "## 6. Conclusions\n", + "\n", + "Congratulations!\n", + "\n", + "In this Part II of the tutorial, you have first applied the techniques you have learned in Part I to a dataset with shorter texts.\n", + "\n", + "Then you have learned how to use zero shot classification in a situation with no labels. The beauty of this approach is that it requires no training and produces a reasonable classification by a list of user-defined expressions.\n", + "\n", + "You have also seen that unsupervised classification can be achieved by similarity scoring between the input sequence and a list of user-defined expressions.\n", + "\n", + "Going one step further, you have seen an approach that creates clusters of similar documents and represents each cluster by typical words. This can be used as a starting point to create meaningful labels.\n", + "\n", + "If you have enjoyed this tutorial, feel free to apply any of the approaches - or improved versions, of course - to your own text data, to enrich your structured features available for supervised learning tasks." + ] + } + ], + "metadata": { + "accelerator": "GPU", + "colab": { + "provenance": [], + "toc_visible": true + }, + "kernelspec": { + "display_name": "Python 3", + "language": "python", + "name": "python3" + }, + "language_info": { + "codemirror_mode": { + "name": "ipython", + "version": 3 + }, + "file_extension": ".py", + "mimetype": "text/x-python", + "name": "python", + "nbconvert_exporter": "python", + "pygments_lexer": "ipython3", + "version": "3.7.10" + }, + "widgets": { + "application/vnd.jupyter.widget-state+json": { + "5de761bf4ce54fff891723d5f98c30c0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_b366a73190a04eca91fd9e178afbd079", + "IPY_MODEL_e7e87b9254b3409d8fbce91e18cc4e67", + "IPY_MODEL_3b96837862ae49b383cdb217b9e7678b" + ], + "layout": "IPY_MODEL_38d82167e54d434db8b4773fccdc6964" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.6750348120527309, - 0.6750348120527309, - 0 - ], - "xaxis": "x", - "y": [ - -25, - -25, - -35, - -35 - ], - "yaxis": "y" + "b366a73190a04eca91fd9e178afbd079": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_0b1a03946ab44964ac6edb92aa6db81d", + "placeholder": "​", + "style": "IPY_MODEL_0c77cb11648542ae996d05d71def2d0a", + "value": "Downloading (…)okenizer_config.json: 100%" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.6023164198318862, - 0.8456337969927024, - 0.8456337969927024, - 0.6750348120527309 - ], - "xaxis": "x", - "y": [ - -10, - -10, - -30, - -30 - ], - "yaxis": "y" + "e7e87b9254b3409d8fbce91e18cc4e67": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_4a750fab548b4f2cb426ebd59b6daf67", + "max": 28, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_5cbe432ada394f689eb626e6ac6ee1e9", + "value": 28 + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,65,54)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.23835020611618307, - 0.23835020611618307, - 0 - ], - "xaxis": "x", - "y": [ - -45, - -45, - -55, - -55 - ], - "yaxis": "y" + "3b96837862ae49b383cdb217b9e7678b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_7d75e25536874831970c370271156295", + "placeholder": "​", + "style": "IPY_MODEL_50a7e6c371bf4bbc8fea6a6bdc1e5675", + "value": " 28.0/28.0 [00:00<00:00, 846B/s]" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(35,205,205)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.4456516865881315, - 0.4456516865881315, - 0 - ], - "xaxis": "x", - "y": [ - -65, - -65, - -75, - -75 - ], - "yaxis": "y" + "38d82167e54d434db8b4773fccdc6964": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(35,205,205)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.37054621528245557, - 0.37054621528245557, - 0 - ], - "xaxis": "x", - "y": [ - -105, - -105, - -115, - -115 - ], - "yaxis": "y" + "0b1a03946ab44964ac6edb92aa6db81d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(35,205,205)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.40204042021542746, - 0.40204042021542746, - 0.37054621528245557 - ], - "xaxis": "x", - "y": [ - -95, - -95, - -110, - -110 - ], - "yaxis": "y" + "0c77cb11648542ae996d05d71def2d0a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(35,205,205)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.482574709153566, - 0.482574709153566, - 0.40204042021542746 - ], - "xaxis": "x", - "y": [ - -85, - -85, - -102.5, - -102.5 - ], - "yaxis": "y" + "4a750fab548b4f2cb426ebd59b6daf67": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(35,205,205)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.4456516865881315, - 0.5129831716423786, - 0.5129831716423786, - 0.482574709153566 - ], - "xaxis": "x", - "y": [ - -70, - -70, - -93.75, - -93.75 - ], - "yaxis": "y" + "5cbe432ada394f689eb626e6ac6ee1e9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(0,116,217)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.23835020611618307, - 1.1292240591332572, - 1.1292240591332572, - 0.5129831716423786 - ], - "xaxis": "x", - "y": [ - -50, - -50, - -81.875, - -81.875 - ], - "yaxis": "y" + "7d75e25536874831970c370271156295": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(133,20,75)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.4296952641723087, - 0.4296952641723087, - 0 - ], - "xaxis": "x", - "y": [ - -125, - -125, - -135, - -135 - ], - "yaxis": "y" + "50a7e6c371bf4bbc8fea6a6bdc1e5675": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(133,20,75)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.3126402618954365, - 0.3126402618954365, - 0 - ], - "xaxis": "x", - "y": [ - -145, - -145, - -155, - -155 - ], - "yaxis": "y" + "936a3987f942462693f82b88a4dc7d87": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_70db356388aa47bb94b9bd9d44886579", + "IPY_MODEL_39e2f380a4c54f518a0f4fb0208f6cf0", + "IPY_MODEL_75657aaf52794cfaa2fd69e9740e9257" + ], + "layout": "IPY_MODEL_783f18beb4d94dfaa6b450de189842e5" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(133,20,75)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.49418052679699354, - 0.49418052679699354, - 0 - ], - "xaxis": "x", - "y": [ - -165, - -165, - -175, - -175 - ], - "yaxis": "y" + "70db356388aa47bb94b9bd9d44886579": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5f86aeb0f83e4206800af67b306a0c0f", + "placeholder": "​", + "style": "IPY_MODEL_46d258d710524bef9f8ce4317b3ffdad", + "value": "Downloading (…)lve/main/config.json: 100%" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(133,20,75)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.3126402618954365, - 0.6189591183403861, - 0.6189591183403861, - 0.49418052679699354 - ], - "xaxis": "x", - "y": [ - -150, - -150, - -170, - -170 - ], - "yaxis": "y" + "39e2f380a4c54f518a0f4fb0208f6cf0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5014ff2443284a57950aceb5475e9a19", + "max": 483, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_f9deae3c7ae346e9b8f1e41c94201957", + "value": 483 + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(133,20,75)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.4296952641723087, - 0.7933887478448209, - 0.7933887478448209, - 0.6189591183403861 - ], - "xaxis": "x", - "y": [ - -130, - -130, - -160, - -160 - ], - "yaxis": "y" + "75657aaf52794cfaa2fd69e9740e9257": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_04295d910be446d593fbfebe0a07b625", + "placeholder": "​", + "style": "IPY_MODEL_fee0d7272c2645aab945ca5c098d1f84", + "value": " 483/483 [00:00<00:00, 39.9kB/s]" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,220,0)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.48058033175196757, - 0.48058033175196757, - 0 - ], - "xaxis": "x", - "y": [ - -205, - -205, - -215, - -215 - ], - "yaxis": "y" + "783f18beb4d94dfaa6b450de189842e5": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,220,0)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.5066912881760213, - 0.5066912881760213, - 0.48058033175196757 - ], - "xaxis": "x", - "y": [ - -195, - -195, - -210, - -210 - ], - "yaxis": "y" + "5f86aeb0f83e4206800af67b306a0c0f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,220,0)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.5685772179118984, - 0.5685772179118984, - 0.5066912881760213 - ], - "xaxis": "x", - "y": [ - -185, - -185, - -202.5, - -202.5 - ], - "yaxis": "y" + "46d258d710524bef9f8ce4317b3ffdad": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,220,0)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.6516488321797296, - 0.6516488321797296, - 0 - ], - "xaxis": "x", - "y": [ - -225, - -225, - -235, - -235 - ], - "yaxis": "y" + "5014ff2443284a57950aceb5475e9a19": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,220,0)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.5608596022515082, - 0.5608596022515082, - 0 - ], - "xaxis": "x", - "y": [ - -245, - -245, - -255, - -255 - ], - "yaxis": "y" + "f9deae3c7ae346e9b8f1e41c94201957": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,220,0)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.5850865189888045, - 0.5850865189888045, - 0 - ], - "xaxis": "x", - "y": [ - -265, - -265, - -275, - -275 - ], - "yaxis": "y" + "04295d910be446d593fbfebe0a07b625": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,220,0)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.5608596022515082, - 0.7154898260340787, - 0.7154898260340787, - 0.5850865189888045 - ], - "xaxis": "x", - "y": [ - -250, - -250, - -270, - -270 - ], - "yaxis": "y" + "fee0d7272c2645aab945ca5c098d1f84": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,220,0)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.6516488321797296, - 0.795806156758281, - 0.795806156758281, - 0.7154898260340787 - ], - "xaxis": "x", - "y": [ - -230, - -230, - -260, - -260 - ], - "yaxis": "y" + "8d2b1667e8b542eda14174a9c3e6f208": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_74adbc967e914123bc2bfc5dacb7630f", + "IPY_MODEL_b7fa2473bfc744b091190c0d64735e20", + "IPY_MODEL_41c26bf23c614163b597e52761facd86" + ], + "layout": "IPY_MODEL_55f6187d766a46248f5c56ec666dccb5" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,220,0)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.5685772179118984, - 0.8582152319964806, - 0.8582152319964806, - 0.795806156758281 - ], - "xaxis": "x", - "y": [ - -193.75, - -193.75, - -245, - -245 - ], - "yaxis": "y" + "74adbc967e914123bc2bfc5dacb7630f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f64187684eee4c33a1bcc8e17ae98301", + "placeholder": "​", + "style": "IPY_MODEL_8435b1c0cd864e8f9f67247c59d8e06f", + "value": "Downloading (…)solve/main/vocab.txt: 100%" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(0,116,217)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.7933887478448209, - 1.2133726364083586, - 1.2133726364083586, - 0.8582152319964806 - ], - "xaxis": "x", - "y": [ - -145, - -145, - -219.375, - -219.375 - ], - "yaxis": "y" + "b7fa2473bfc744b091190c0d64735e20": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_7d8a93c13e8243efbb8df5b8bbf4a9fc", + "max": 231508, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_99077d65096e4a738cb2f7b6c2aaa7d6", + "value": 231508 + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(0,116,217)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 1.1292240591332572, - 1.441742429005455, - 1.441742429005455, - 1.2133726364083586 - ], - "xaxis": "x", - "y": [ - -65.9375, - -65.9375, - -182.1875, - -182.1875 - ], - "yaxis": "y" + "41c26bf23c614163b597e52761facd86": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c03367c15d71470999dbb00e2429a5f0", + "placeholder": "​", + "style": "IPY_MODEL_4cf9b9fbd0334a9b8d6c65850109b41b", + "value": " 232k/232k [00:00<00:00, 1.73MB/s]" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(40,35,35)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.2822729572596061, - 0.2822729572596061, - 0 - ], - "xaxis": "x", - "y": [ - -295, - -295, - -305, - -305 - ], - "yaxis": "y" + "55f6187d766a46248f5c56ec666dccb5": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(40,35,35)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.3876552434301354, - 0.3876552434301354, - 0.2822729572596061 - ], - "xaxis": "x", - "y": [ - -285, - -285, - -300, - -300 - ], - "yaxis": "y" + "f64187684eee4c33a1bcc8e17ae98301": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(40,35,35)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.4460071878809543, - 0.4460071878809543, - 0 - ], - "xaxis": "x", - "y": [ - -315, - -315, - -325, - -325 - ], - "yaxis": "y" + "8435b1c0cd864e8f9f67247c59d8e06f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(40,35,35)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.4794862266852582, - 0.4794862266852582, - 0 - ], - "xaxis": "x", - "y": [ - -335, - -335, - -345, - -345 - ], - "yaxis": "y" + "7d8a93c13e8243efbb8df5b8bbf4a9fc": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(40,35,35)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.4460071878809543, - 0.6982942598519148, - 0.6982942598519148, - 0.4794862266852582 - ], - "xaxis": "x", - "y": [ - -320, - -320, - -340, - -340 - ], - "yaxis": "y" + "99077d65096e4a738cb2f7b6c2aaa7d6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(40,35,35)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.3876552434301354, - 0.919690067313055, - 0.919690067313055, - 0.6982942598519148 - ], - "xaxis": "x", - "y": [ - -292.5, - -292.5, - -330, - -330 - ], - "yaxis": "y" + "c03367c15d71470999dbb00e2429a5f0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.3528000059829244, - 0.3528000059829244, - 0 - ], - "xaxis": "x", - "y": [ - -355, - -355, - -365, - -365 - ], - "yaxis": "y" + "4cf9b9fbd0334a9b8d6c65850109b41b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.24817551893157758, - 0.24817551893157758, - 0 - ], - "xaxis": "x", - "y": [ - -385, - -385, - -395, - -395 - ], - "yaxis": "y" + "77b6e23d10f24ae986e796459dd47faf": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_dd5f78d31d85485d89c609a4c1c560b0", + "IPY_MODEL_4954d8ffa3f34b1489a0a548655368ba", + "IPY_MODEL_dd2abf3d137847a0b061bc32e25bf4f5" + ], + "layout": "IPY_MODEL_f0f164f0ae99419aaf92f625cb2987e3" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.5783755534463907, - 0.5783755534463907, - 0.24817551893157758 - ], - "xaxis": "x", - "y": [ - -375, - -375, - -390, - -390 - ], - "yaxis": "y" + "dd5f78d31d85485d89c609a4c1c560b0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_e2101e95402f4b76a654f2fd06d9cb82", + "placeholder": "​", + "style": "IPY_MODEL_ed69ce527b2f480abb6fead6089aa870", + "value": "Downloading (…)/main/tokenizer.json: 100%" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.3528000059829244, - 0.6825150816307292, - 0.6825150816307292, - 0.5783755534463907 - ], - "xaxis": "x", - "y": [ - -360, - -360, - -382.5, - -382.5 - ], - "yaxis": "y" + "4954d8ffa3f34b1489a0a548655368ba": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_befc3d34e6924c2d8c5cbfd994c6360e", + "max": 466062, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_1c82763c43f541a182de5692fc7a1ca2", + "value": 466062 + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.5833882086821892, - 0.5833882086821892, - 0 - ], - "xaxis": "x", - "y": [ - -405, - -405, - -415, - -415 - ], - "yaxis": "y" + "dd2abf3d137847a0b061bc32e25bf4f5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_973c00d9934e491b89eb23083f3deeed", + "placeholder": "​", + "style": "IPY_MODEL_736f08c910874fafb4a496de8517e53a", + "value": " 466k/466k [00:00<00:00, 3.55MB/s]" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.4238227864178827, - 0.4238227864178827, - 0 - ], - "xaxis": "x", - "y": [ - -435, - -435, - -445, - -445 - ], - "yaxis": "y" + "f0f164f0ae99419aaf92f625cb2987e3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.6113919609993128, - 0.6113919609993128, - 0.4238227864178827 - ], - "xaxis": "x", - "y": [ - -425, - -425, - -440, - -440 - ], - "yaxis": "y" + "e2101e95402f4b76a654f2fd06d9cb82": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.5833882086821892, - 0.7143901041898164, - 0.7143901041898164, - 0.6113919609993128 - ], - "xaxis": "x", - "y": [ - -410, - -410, - -432.5, - -432.5 - ], - "yaxis": "y" + "ed69ce527b2f480abb6fead6089aa870": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(61,153,112)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.6825150816307292, - 0.8865467339513728, - 0.8865467339513728, - 0.7143901041898164 - ], - "xaxis": "x", - "y": [ - -371.25, - -371.25, - -421.25, - -421.25 - ], - "yaxis": "y" + "befc3d34e6924c2d8c5cbfd994c6360e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,65,54)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.22016924579619745, - 0.22016924579619745, - 0 - ], - "xaxis": "x", - "y": [ - -475, - -475, - -485, - -485 - ], - "yaxis": "y" + "1c82763c43f541a182de5692fc7a1ca2": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,65,54)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.5066679991691487, - 0.5066679991691487, - 0.22016924579619745 - ], - "xaxis": "x", - "y": [ - -465, - -465, - -480, - -480 - ], - "yaxis": "y" + "973c00d9934e491b89eb23083f3deeed": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(255,65,54)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.5302013565182664, - 0.5302013565182664, - 0.5066679991691487 - ], - "xaxis": "x", - "y": [ - -455, - -455, - -472.5, - -472.5 - ], - "yaxis": "y" + "736f08c910874fafb4a496de8517e53a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(35,205,205)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.3783237475449943, - 0.3783237475449943, - 0 - ], - "xaxis": "x", - "y": [ - -495, - -495, - -505, - -505 - ], - "yaxis": "y" + "f667052649984f7295359e00c7dfe491": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_2712323f94c746c3871e424f0c0bc928", + "IPY_MODEL_dacbe9b563e5468ab9d9f0bbf6d47d8c", + "IPY_MODEL_4fcfbef91ffa4dc48eaf062ed2fea45f" + ], + "layout": "IPY_MODEL_cb8f544c88c34580947daae0b390779b" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(35,205,205)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.39342586151933556, - 0.39342586151933556, - 0 - ], - "xaxis": "x", - "y": [ - -535, - -535, - -545, - -545 - ], - "yaxis": "y" + "2712323f94c746c3871e424f0c0bc928": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_2f043d8319c4447399ab62735cf6761f", + "placeholder": "​", + "style": "IPY_MODEL_d5924691f4164f549756bfd57d83b04f", + "value": "Downloading model.safetensors: 100%" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(35,205,205)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.5457860064578354, - 0.5457860064578354, - 0.39342586151933556 - ], - "xaxis": "x", - "y": [ - -525, - -525, - -540, - -540 - ], - "yaxis": "y" + "dacbe9b563e5468ab9d9f0bbf6d47d8c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_392811b52dc141099d755a7392023722", + "max": 267954768, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_f2f7dcbf838e4938a4f959bbc4b70e12", + "value": 267954768 + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(35,205,205)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0, - 0.6699488447399525, - 0.6699488447399525, - 0.5457860064578354 - ], - "xaxis": "x", - "y": [ - -515, - -515, - -532.5, - -532.5 - ], - "yaxis": "y" + "4fcfbef91ffa4dc48eaf062ed2fea45f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_952a86292e0043e89e0adae2df4efc3c", + "placeholder": "​", + "style": "IPY_MODEL_3251f229b9a24114b5b1f01d6107b537", + "value": " 268M/268M [00:01<00:00, 157MB/s]" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(35,205,205)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.3783237475449943, - 0.8729512687439737, - 0.8729512687439737, - 0.6699488447399525 - ], - "xaxis": "x", - "y": [ - -500, - -500, - -523.75, - -523.75 - ], - "yaxis": "y" + "cb8f544c88c34580947daae0b390779b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(0,116,217)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.5302013565182664, - 1.0528410175390792, - 1.0528410175390792, - 0.8729512687439737 - ], - "xaxis": "x", - "y": [ - -463.75, - -463.75, - -511.875, - -511.875 - ], - "yaxis": "y" + "2f043d8319c4447399ab62735cf6761f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(0,116,217)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.8865467339513728, - 1.3481969547871322, - 1.3481969547871322, - 1.0528410175390792 - ], - "xaxis": "x", - "y": [ - -396.25, - -396.25, - -487.8125, - -487.8125 - ], - "yaxis": "y" + "d5924691f4164f549756bfd57d83b04f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(0,116,217)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.919690067313055, - 1.604036421668238, - 1.604036421668238, - 1.3481969547871322 - ], - "xaxis": "x", - "y": [ - -311.25, - -311.25, - -442.03125, - -442.03125 - ], - "yaxis": "y" + "392811b52dc141099d755a7392023722": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(0,116,217)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 1.441742429005455, - 1.6465235329143428, - 1.6465235329143428, - 1.604036421668238 - ], - "xaxis": "x", - "y": [ - -124.0625, - -124.0625, - -376.640625, - -376.640625 - ], - "yaxis": "y" + "f2f7dcbf838e4938a4f959bbc4b70e12": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } }, - { - "hoverinfo": "text", - "marker": { - "color": "rgb(0,116,217)" - }, - "mode": "lines", - "type": "scatter", - "x": [ - 0.8456337969927024, - 1.9794277500966373, - 1.9794277500966373, - 1.6465235329143428 - ], - "xaxis": "x", - "y": [ - -20, - -20, - -250.3515625, - -250.3515625 - ], - "yaxis": "y" - } - ], - "layout": { - "autosize": false, - "height": 1025, - "hoverlabel": { - "bgcolor": "white", - "font": { - "family": "Rockwell", - "size": 16 - } - }, - "hovermode": "closest", - "plot_bgcolor": "#ECEFF1", - "showlegend": false, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "white", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "white", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "#C8D4E3", - "linecolor": "#C8D4E3", - "minorgridcolor": "#C8D4E3", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "#C8D4E3", - "linecolor": "#C8D4E3", - "minorgridcolor": "#C8D4E3", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "white", - "showlakes": true, - "showland": true, - "subunitcolor": "#C8D4E3" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "white", - "polar": { - "angularaxis": { - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "" - }, - "bgcolor": "white", - "radialaxis": { - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "white", - "gridcolor": "#DFE8F3", - "gridwidth": 2, - "linecolor": "#EBF0F8", - "showbackground": true, - "ticks": "", - "zerolinecolor": "#EBF0F8" - }, - "yaxis": { - "backgroundcolor": "white", - "gridcolor": "#DFE8F3", - "gridwidth": 2, - "linecolor": "#EBF0F8", - "showbackground": true, - "ticks": "", - "zerolinecolor": "#EBF0F8" - }, - "zaxis": { - "backgroundcolor": "white", - "gridcolor": "#DFE8F3", - "gridwidth": 2, - "linecolor": "#EBF0F8", - "showbackground": true, - "ticks": "", - "zerolinecolor": "#EBF0F8" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "#DFE8F3", - "linecolor": "#A2B1C6", - "ticks": "" - }, - "baxis": { - "gridcolor": "#DFE8F3", - "linecolor": "#A2B1C6", - "ticks": "" - }, - "bgcolor": "white", - "caxis": { - "gridcolor": "#DFE8F3", - "linecolor": "#A2B1C6", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "#EBF0F8", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "#EBF0F8", - "zerolinewidth": 2 - } - } - }, - "title": { - "font": { - "color": "Black", - "size": 22 - }, - "text": "Hierarchical Clustering", - "x": 0.5, - "xanchor": "center", - "yanchor": "top" - }, - "width": 1000, - "xaxis": { - "mirror": "allticks", - "rangemode": "tozero", - "showgrid": false, - "showline": true, - "showticklabels": true, - "ticks": "outside", - "type": "linear", - "zeroline": false - }, - "yaxis": { - "mirror": "allticks", - "range": [ - -550, - 0 - ], - "rangemode": "tozero", - "showgrid": false, - "showline": true, - "showticklabels": true, - "tickmode": "array", - "ticks": "outside", - "ticktext": [ - "46_radio_antenna_lightning", - "51_radio_lost_dropped", - "10_signal_traffic_damaged", - "30_airport_lightning_lights", - "12_hydrant_fire_hit", - "50_hydrant_vehicle_struck", - "26_water_es_ms", - "35_school_water_elementary", - "2_froze_pipe_sewer", - "43_hs_water_tremper", - "19_water_damage_goodman", - "31_center_water_main", - "8_broken_door_glass", - "23_window_broken_windows", - "4_theft_of_stolen", - "24_laptop_theft_from", - "32_phone_system_phones", - "44_laptop_mckinley_damaged", - "3_power_surge_generator", - "40_storm_multiple_sites", - "1_fire_smoke_damage", - "6_lightning_damage_scale", - "34_well_meter_flow", - "39_equipment_playground_slide", - "27_dmg_humboldt_lafollette", - "49_ms_es_lightning", - "41_hs_lightning_hhs", - "48_gym_floor_injured", - "38_wind_fence_park", - "11_wind_damage_course", - "25_roof_wind_shingles", - "18_hail_buildings_roof", - "52_roof_collapsed_collapse", - "53_buildings_building_water", - "54_tower_lightning_north", - "0_glass_vandalism_west", - "13_llm_glass_mendota", - "9_lightning_dept_hall", - "7_park_vandalism_pavilion", - "42_park_washington_vandalism", - "5_graffiti_on_kennedy", - "16_fence_gate_vehicle", - "20_shelter_eastman_farlin", - "28_vandalism_damage_odonnell", - "33_vandalism_lemonweir_lock", - "22_pole_light_damaged", - "21_pole_vehicle_hit", - "29_street_light_run", - "47_street_pole_light", - "15_computer_lightning_to", - "45_water_equipment_carpet", - "36_sign_vehicle_signal", - "37_overhead_door_damaged", - "14_garage_door_hwy", - "17_building_truck_vehicle" - ], - "tickvals": [ - -5, - -15, - -25, - -35, - -45, - -55, - -65, - -75, - -85, - -95, - -105, - -115, - -125, - -135, - -145, - -155, - -165, - -175, - -185, - -195, - -205, - -215, - -225, - -235, - -245, - -255, - -265, - -275, - -285, - -295, - -305, - -315, - -325, - -335, - -345, - -355, - -365, - -375, - -385, - -395, - -405, - -415, - -425, - -435, - -445, - -455, - -465, - -475, - -485, - -495, - -505, - -515, - -525, - -535, - -545 - ], - "type": "linear", - "zeroline": false - } - } - }, - "text/html": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "topic_model.visualize_hierarchy()" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "QR332SW6EVHK" - }, - "source": [ - "Next, we want to assign labels to each cluster.\n", - "Compared to manually labeling thousands of samples, this task is much less burdensome!\n", - "\n", - "This is usually a manual task. Assignment of labels is guided by the topic information, the topic word scores and the hierarchical clustering.\n", - "\n", - "In our case, the actual labels are available, so that we can use this information to perform the labeling.\n", - "\n", - "Let's inspect how well the clusters matches the labels. The graph below shows one column per topic.\n", - "The shading indicates the distribution of labels within a given topic.\n", - "The presence of a single dark patch in a column indicates that almost all of the samples of the topic are associated with a single label." - ] - }, - { - "cell_type": "code", - "execution_count": 40, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 542 - }, - "id": "RDl-OdssEVHK", - "outputId": "413b0dc3-7b14-405f-97a7-0dcf77b9b9ef" - }, - "outputs": [ - { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly" - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "Topic: %{x}
labels: %{y}
color: %{z}", - "name": "0", - "type": "heatmap", - "x": [ - -1, - 0, - 1, - 2, - 3, - 4, - 5, - 6, - 7, - 8, - 9, - 10, - 11, - 12, - 13, - 14, - 15, - 16, - 17, - 18, - 19, - 20, - 21, - 22, - 23, - 24, - 25, - 26, - 27, - 28, - 29, - 30, - 31, - 32, - 33, - 34, - 35, - 36, - 37, - 38, - 39, - 40, - 41, - 42, - 43, - 44, - 45, - 46, - 47, - 48, - 49, - 50, - 51, - 52, - 53, - 54 - ], - "xaxis": "x", - "y": [ - 0, - 1, - 2, - 3, - 4, - 5, - 6, - 7, - 8 - ], - "yaxis": "y", - "z": [ - [ - 0.4958217270194986, - 1, - 0.09950248756218906, - 0.04395604395604396, - 0, - 0.7950310559006211, - 0.9929078014184397, - 0, - 0.9910714285714286, - 0.8990825688073395, - 0, - 0, - 0, - 0, - 0.8987341772151899, - 0.012987012987012988, - 0.013157894736842105, - 0.0821917808219178, - 0.0273972602739726, - 0, - 0, - 1, - 0, - 0.0625, - 0.8870967741935484, - 0.8688524590163934, - 0.017543859649122806, - 0.03571428571428571, - 1, - 0.9818181818181818, - 0.09259259259259259, - 0, - 0, - 0.061224489795918366, - 0.9795918367346939, - 0, - 0.02127659574468085, - 0.08888888888888889, - 0.045454545454545456, - 0, - 0.2727272727272727, - 0, - 0, - 1, - 0, - 0.6842105263157895, - 0, - 0, - 0, - 0.12121212121212122, - 0, - 0.0625, - 0.12903225806451613, - 0.03333333333333333, - 0.03333333333333333, - 0 - ], - [ - 0.0064995357474466105, - 0, - 0.736318407960199, - 0, - 0.022727272727272728, - 0.006211180124223602, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.02631578947368421, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.016129032258064516, - 0, - 0, - 0, - 0, - 0, - 0, - 0.0196078431372549, - 0, - 0, - 0.02040816326530612, - 0.02127659574468085, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.02564102564102564, - 0, - 0, - 0.02631578947368421, - 0, - 0, - 0.03125, - 0, - 0.03225806451612903, - 0.03333333333333333, - 0, - 0 - ], - [ - 0.20148560817084493, - 0, - 0.01990049751243781, - 0.005494505494505495, - 0.11931818181818182, - 0, - 0, - 0.9921875, - 0, - 0, - 0.9908256880733946, - 0.009615384615384616, - 0, - 0, - 0.02531645569620253, - 0, - 0.9342105263157895, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.9215686274509803, - 0, - 0.7551020408163265, - 0, - 0.851063829787234, - 0.02127659574468085, - 0, - 0, - 0, - 0, - 0.3333333333333333, - 1, - 0, - 0, - 0, - 0.02631578947368421, - 0.9736842105263158, - 0, - 0, - 0.96875, - 0, - 0, - 0, - 0, - 1 - ], - [ - 0.06128133704735376, - 0, - 0, - 0.01098901098901099, - 0.017045454545454544, - 0, - 0, - 0, - 0.008928571428571428, - 0.009174311926605505, - 0, - 0.009615384615384616, - 0.9880952380952381, - 0, - 0, - 0.012987012987012988, - 0.013157894736842105, - 0.0821917808219178, - 0.0547945205479452, - 0.05555555555555555, - 0, - 0, - 0, - 0, - 0.016129032258064516, - 0, - 0.9824561403508771, - 0, - 0, - 0, - 0.037037037037037035, - 0.0196078431372549, - 0, - 0, - 0, - 0, - 0, - 0, - 0.022727272727272728, - 0.9545454545454546, - 0.022727272727272728, - 0.3333333333333333, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.03225806451612903, - 0.1, - 0.03333333333333333, - 0 - ], - [ - 0.0009285051067780873, - 0, - 0, - 0, - 0, - 0, - 0, - 0.0078125, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.9444444444444444, - 0, - 0, - 0.014925373134328358, - 0.015625, - 0, - 0, - 0, - 0, - 0, - 0, - 0.018518518518518517, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.047619047619047616, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.03333333333333333, - 0, - 0 - ], - [ - 0.09377901578458682, - 0, - 0.04975124378109453, - 0.06043956043956044, - 0.005681818181818182, - 0.037267080745341616, - 0, - 0, - 0, - 0.027522935779816515, - 0.009174311926605505, - 0.9711538461538461, - 0, - 0.9759036144578314, - 0.02531645569620253, - 0.935064935064935, - 0, - 0.821917808219178, - 0.8082191780821918, - 0, - 0, - 0, - 0.9552238805970149, - 0.890625, - 0.016129032258064516, - 0.01639344262295082, - 0, - 0, - 0, - 0.01818181818181818, - 0.8333333333333334, - 0.0392156862745098, - 0.04, - 0, - 0, - 0.0851063829787234, - 0, - 0.9111111111111111, - 0.8863636363636364, - 0.022727272727272728, - 0.2727272727272727, - 0, - 0, - 0, - 0, - 0.13157894736842105, - 0, - 0, - 0.9696969696969697, - 0, - 0, - 0.875, - 0.25806451612903225, - 0, - 0.03333333333333333, - 0 - ], - [ - 0.033426183844011144, - 0, - 0.024875621890547265, - 0.17582417582417584, - 0, - 0.006211180124223602, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.012048192771084338, - 0, - 0, - 0, - 0, - 0, - 0, - 0.3382352941176471, - 0, - 0, - 0, - 0, - 0, - 0, - 0.42857142857142855, - 0, - 0, - 0, - 0, - 0.36, - 0.02040816326530612, - 0, - 0, - 0.2553191489361702, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.28205128205128205, - 0, - 0.34210526315789475, - 0, - 0, - 0.21212121212121213, - 0, - 0.03125, - 0.16129032258064516, - 0.03333333333333333, - 0.36666666666666664, - 0 - ], - [ - 0.06963788300835655, - 0, - 0.024875621890547265, - 0.5274725274725275, - 0.011363636363636364, - 0, - 0.0070921985815602835, - 0, - 0, - 0, - 0, - 0, - 0, - 0, - 0.012658227848101266, - 0, - 0, - 0, - 0.0273972602739726, - 0, - 0.6470588235294118, - 0, - 0, - 0, - 0.03225806451612903, - 0, - 0, - 0.5357142857142857, - 0, - 0, - 0.018518518518518517, - 0, - 0.58, - 0.061224489795918366, - 0, - 0, - 0.6808510638297872, - 0, - 0, - 0.022727272727272728, - 0, - 0.2857142857142857, - 0, - 0, - 0.6666666666666666, - 0, - 0.6052631578947368, - 0, - 0, - 0.42424242424242425, - 0, - 0, - 0.03225806451612903, - 0.3333333333333333, - 0.5333333333333333, - 0 - ], - [ - 0.03714020427112349, - 0, - 0.04477611940298507, - 0.17582417582417584, - 0.8238636363636364, - 0.15527950310559005, - 0, - 0, - 0, - 0.06422018348623854, - 0, - 0.009615384615384616, - 0.011904761904761904, - 0.012048192771084338, - 0.0379746835443038, - 0.03896103896103896, - 0.013157894736842105, - 0.0136986301369863, - 0.0821917808219178, - 0, - 0.014705882352941176, - 0, - 0.029850746268656716, - 0.03125, - 0.03225806451612903, - 0.11475409836065574, - 0, - 0, - 0, - 0, - 0, - 0, - 0.02, - 0.10204081632653061, - 0, - 0.0425531914893617, - 0.02127659574468085, - 0, - 0.045454545454545456, - 0, - 0.4318181818181818, - 0, - 0, - 0, - 0.02564102564102564, - 0.18421052631578946, - 0.02631578947368421, - 0, - 0.030303030303030304, - 0.24242424242424243, - 0, - 0.03125, - 0.3548387096774194, - 0.43333333333333335, - 0, - 0 - ] - ] - } - ], - "layout": { - "coloraxis": { - "cmax": 1, - "cmin": -0.05, - "colorscale": [ - [ - 0, - "rgb(255,255,255)" - ], - [ - 0.125, - "rgb(240,240,240)" - ], - [ - 0.25, - "rgb(217,217,217)" - ], - [ - 0.375, - "rgb(189,189,189)" - ], - [ - 0.5, - "rgb(150,150,150)" - ], - [ - 0.625, - "rgb(115,115,115)" - ], - [ - 0.75, - "rgb(82,82,82)" - ], - [ - 0.875, - "rgb(37,37,37)" - ], - [ - 1, - "rgb(0,0,0)" - ] - ] - }, - "margin": { - "t": 60 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "dtick": 1, - "scaleanchor": "y", - "title": { - "text": "Topic" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "dtick": 1, - "range": [ - 0, - 8 - ], - "title": { - "text": "labels" - } - } - } - }, - "text/html": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "df_train[\"Topic\"] = topics\n", - "tb = pd.pivot_table(df_train, index=[\"Topic\"], columns=[\"labels\"], aggfunc='count', fill_value=0)[\"Description\"]\n", - "fig = px.imshow(tb.divide(tb.sum(axis=1), axis=0).T, zmin=-0.05)\n", - "fig.update_layout(xaxis={\"dtick\": 1}, yaxis={\"dtick\": 1, \"range\":[0,8]}, coloraxis={\"colorscale\": \"Greys\"})\n", - "fig.show()" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "cLoeG-9tEVHK" - }, - "source": [ - "Obviously, the topic `-1`, which represents the outliers, has a finite frequency for many classes.\n", - "Further, the classes 6 (`WaterNW`) and 7 (`WaterW`) seem to be difficult to tell apart from the clusters; this affects some of the topics.\n", - "For most other topics, the clustering aligns quite well with the labels.\n", - "\n", - "Overall, it appears reasonable to map each topic to the label with the highest frequency. Apart from the exceptions mentioned above, this aligns with a mapping that a human would define manually, in absence of the actual labels.\n", - "\n", - "Therefore, let's define the mapping from topics to labels by picking the label with the highest frequency. The table below shows the topic info, enriched with the label counts and the mapping. " - ] - }, - { - "cell_type": "code", - "execution_count": 41, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000 - }, - "id": "NZ6vPSS-EVHK", - "outputId": "9ba06643-0e5a-40ac-d096-7365def09ae8" - }, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
TopicCountName012345678mappinglabel
0-11077-1_vandalism_at_lightning_es53472176611013675400Vandalism
102080_glass_vandalism_west_es208000000000Vandalism
212011_fire_smoke_damage_equipment20148400105591Fire
321822_froze_pipe_sewer_pipes80120113296327WaterW
431763_power_surge_generator_spoilage0421301021458Misc
541614_theft_of_stolen_break1281000610250Vandalism
651415_graffiti_on_kennedy_hoyt140000000100Vandalism
761286_lightning_damage_scale_dpw001270100002Lightning
871127_park_vandalism_pavilion_dmg111001000000Vandalism
981098_broken_door_glass_breakage98001030070Vandalism
1091099_lightning_dept_hall_hwy001080010002Lightning
111010410_signal_traffic_damaged_paradise001101010015Vehicle
12118411_wind_damage_course_golf00083000013Wind
13128312_hydrant_fire_hit_damaged00000811015Vehicle
14137913_llm_glass_mendota_hawk71020020130Vandalism
15147714_garage_door_hwy_shop10010720035Vehicle
16157615_computer_lightning_to_equipment12711000012Lightning
17167316_fence_gate_vehicle_damaged60060600015Vehicle
18177317_building_truck_vehicle_by20040590265Vehicle
19187218_hail_buildings_roof_multiple00046800004Hail
20196819_water_damage_goodman_pool000000234417WaterW
21206820_shelter_eastman_farlin_seymour68000000000Vandalism
22216721_pole_vehicle_hit_light00001640025Vehicle
23226422_pole_light_damaged_lightpole40001570025Vehicle
24236223_window_broken_windows_screens55101010220Vandalism
25246124_laptop_theft_from_of53000010070Vandalism
26255725_roof_wind_shingles_blew10056000003Wind
27265626_water_es_ms_damage200000243007WaterW
28275527_dmg_humboldt_lafollette_vandalism55000000000Vandalism
29285528_vandalism_damage_odonnell_bandshell54000010000Vandalism
30295429_street_light_run_damaged50021450105Vehicle
31305130_airport_lightning_lights_runway01471020002Lightning
32315031_center_water_main_dept000002182917WaterW
33324932_phone_system_phones_telephone30370001352Lightning
34334933_vandalism_lemonweir_lock_gazebo48100000000Vandalism
35344734_well_meter_flow_lightning01400040022Lightning
36354735_school_water_elementary_high101000123217WaterW
37364536_sign_vehicle_signal_traffic40000410005Vehicle
38374437_overhead_door_damaged_loader20010390025Vehicle
39384438_wind_fence_park_trees00042010103Wind
40394439_equipment_playground_slide_gps1200101200198Misc
41404240_storm_multiple_sites_locations0014142001202Lightning
42414241_hs_lightning_hhs_damage00420000002Lightning
43424142_park_washington_vandalism_jacobus41000000000Vandalism
44433943_hs_water_tremper_pw010000112617WaterW
45443844_laptop_mckinley_damaged_computer26000050070Vandalism
46453845_water_equipment_carpet_to001000132317WaterW
47463846_radio_antenna_lightning_radios01370000002Lightning
48473347_street_pole_light_streetlight00000320015Vehicle
49483348_gym_floor_injured_k940000071487WaterW
50493249_ms_es_lightning_damage01310000002Lightning
51503250_hydrant_vehicle_struck_hit20000281015Vehicle
52513151_radio_lost_dropped_portable41010851118Misc
53523052_roof_collapsed_collapse_gutter110310110138Misc
54533053_buildings_building_water_basement100101111607WaterW
55543054_tower_lightning_north_internet00300000002Lightning
\n", - "
" - ], - "text/plain": [ - " Topic Count Name 0 1 2 3 \\\n", - "0 -1 1077 -1_vandalism_at_lightning_es 534 7 217 66 \n", - "1 0 208 0_glass_vandalism_west_es 208 0 0 0 \n", - "2 1 201 1_fire_smoke_damage_equipment 20 148 4 0 \n", - "3 2 182 2_froze_pipe_sewer_pipes 8 0 1 2 \n", - "4 3 176 3_power_surge_generator_spoilage 0 4 21 3 \n", - "5 4 161 4_theft_of_stolen_break 128 1 0 0 \n", - "6 5 141 5_graffiti_on_kennedy_hoyt 140 0 0 0 \n", - "7 6 128 6_lightning_damage_scale_dpw 0 0 127 0 \n", - "8 7 112 7_park_vandalism_pavilion_dmg 111 0 0 1 \n", - "9 8 109 8_broken_door_glass_breakage 98 0 0 1 \n", - "10 9 109 9_lightning_dept_hall_hwy 0 0 108 0 \n", - "11 10 104 10_signal_traffic_damaged_paradise 0 0 1 1 \n", - "12 11 84 11_wind_damage_course_golf 0 0 0 83 \n", - "13 12 83 12_hydrant_fire_hit_damaged 0 0 0 0 \n", - "14 13 79 13_llm_glass_mendota_hawk 71 0 2 0 \n", - "15 14 77 14_garage_door_hwy_shop 1 0 0 1 \n", - "16 15 76 15_computer_lightning_to_equipment 1 2 71 1 \n", - "17 16 73 16_fence_gate_vehicle_damaged 6 0 0 6 \n", - "18 17 73 17_building_truck_vehicle_by 2 0 0 4 \n", - "19 18 72 18_hail_buildings_roof_multiple 0 0 0 4 \n", - "20 19 68 19_water_damage_goodman_pool 0 0 0 0 \n", - "21 20 68 20_shelter_eastman_farlin_seymour 68 0 0 0 \n", - "22 21 67 21_pole_vehicle_hit_light 0 0 0 0 \n", - "23 22 64 22_pole_light_damaged_lightpole 4 0 0 0 \n", - "24 23 62 23_window_broken_windows_screens 55 1 0 1 \n", - "25 24 61 24_laptop_theft_from_of 53 0 0 0 \n", - "26 25 57 25_roof_wind_shingles_blew 1 0 0 56 \n", - "27 26 56 26_water_es_ms_damage 2 0 0 0 \n", - "28 27 55 27_dmg_humboldt_lafollette_vandalism 55 0 0 0 \n", - "29 28 55 28_vandalism_damage_odonnell_bandshell 54 0 0 0 \n", - "30 29 54 29_street_light_run_damaged 5 0 0 2 \n", - "31 30 51 30_airport_lightning_lights_runway 0 1 47 1 \n", - "32 31 50 31_center_water_main_dept 0 0 0 0 \n", - "33 32 49 32_phone_system_phones_telephone 3 0 37 0 \n", - "34 33 49 33_vandalism_lemonweir_lock_gazebo 48 1 0 0 \n", - "35 34 47 34_well_meter_flow_lightning 0 1 40 0 \n", - "36 35 47 35_school_water_elementary_high 1 0 1 0 \n", - "37 36 45 36_sign_vehicle_signal_traffic 4 0 0 0 \n", - "38 37 44 37_overhead_door_damaged_loader 2 0 0 1 \n", - "39 38 44 38_wind_fence_park_trees 0 0 0 42 \n", - "40 39 44 39_equipment_playground_slide_gps 12 0 0 1 \n", - "41 40 42 40_storm_multiple_sites_locations 0 0 14 14 \n", - "42 41 42 41_hs_lightning_hhs_damage 0 0 42 0 \n", - "43 42 41 42_park_washington_vandalism_jacobus 41 0 0 0 \n", - "44 43 39 43_hs_water_tremper_pw 0 1 0 0 \n", - "45 44 38 44_laptop_mckinley_damaged_computer 26 0 0 0 \n", - "46 45 38 45_water_equipment_carpet_to 0 0 1 0 \n", - "47 46 38 46_radio_antenna_lightning_radios 0 1 37 0 \n", - "48 47 33 47_street_pole_light_streetlight 0 0 0 0 \n", - "49 48 33 48_gym_floor_injured_k9 4 0 0 0 \n", - "50 49 32 49_ms_es_lightning_damage 0 1 31 0 \n", - "51 50 32 50_hydrant_vehicle_struck_hit 2 0 0 0 \n", - "52 51 31 51_radio_lost_dropped_portable 4 1 0 1 \n", - "53 52 30 52_roof_collapsed_collapse_gutter 1 1 0 3 \n", - "54 53 30 53_buildings_building_water_basement 1 0 0 1 \n", - "55 54 30 54_tower_lightning_north_internet 0 0 30 0 \n", - "\n", - " 4 5 6 7 8 mapping label \n", - "0 1 101 36 75 40 0 Vandalism \n", - "1 0 0 0 0 0 0 Vandalism \n", - "2 0 10 5 5 9 1 Fire \n", - "3 0 11 32 96 32 7 WaterW \n", - "4 0 1 0 2 145 8 Misc \n", - "5 0 6 1 0 25 0 Vandalism \n", - "6 0 0 0 1 0 0 Vandalism \n", - "7 1 0 0 0 0 2 Lightning \n", - "8 0 0 0 0 0 0 Vandalism \n", - "9 0 3 0 0 7 0 Vandalism \n", - "10 0 1 0 0 0 2 Lightning \n", - "11 0 101 0 0 1 5 Vehicle \n", - "12 0 0 0 0 1 3 Wind \n", - "13 0 81 1 0 1 5 Vehicle \n", - "14 0 2 0 1 3 0 Vandalism \n", - "15 0 72 0 0 3 5 Vehicle \n", - "16 0 0 0 0 1 2 Lightning \n", - "17 0 60 0 0 1 5 Vehicle \n", - "18 0 59 0 2 6 5 Vehicle \n", - "19 68 0 0 0 0 4 Hail \n", - "20 0 0 23 44 1 7 WaterW \n", - "21 0 0 0 0 0 0 Vandalism \n", - "22 1 64 0 0 2 5 Vehicle \n", - "23 1 57 0 0 2 5 Vehicle \n", - "24 0 1 0 2 2 0 Vandalism \n", - "25 0 1 0 0 7 0 Vandalism \n", - "26 0 0 0 0 0 3 Wind \n", - "27 0 0 24 30 0 7 WaterW \n", - "28 0 0 0 0 0 0 Vandalism \n", - "29 0 1 0 0 0 0 Vandalism \n", - "30 1 45 0 1 0 5 Vehicle \n", - "31 0 2 0 0 0 2 Lightning \n", - "32 0 2 18 29 1 7 WaterW \n", - "33 0 0 1 3 5 2 Lightning \n", - "34 0 0 0 0 0 0 Vandalism \n", - "35 0 4 0 0 2 2 Lightning \n", - "36 0 0 12 32 1 7 WaterW \n", - "37 0 41 0 0 0 5 Vehicle \n", - "38 0 39 0 0 2 5 Vehicle \n", - "39 0 1 0 1 0 3 Wind \n", - "40 0 12 0 0 19 8 Misc \n", - "41 2 0 0 12 0 2 Lightning \n", - "42 0 0 0 0 0 2 Lightning \n", - "43 0 0 0 0 0 0 Vandalism \n", - "44 0 0 11 26 1 7 WaterW \n", - "45 0 5 0 0 7 0 Vandalism \n", - "46 0 0 13 23 1 7 WaterW \n", - "47 0 0 0 0 0 2 Lightning \n", - "48 0 32 0 0 1 5 Vehicle \n", - "49 0 0 7 14 8 7 WaterW \n", - "50 0 0 0 0 0 2 Lightning \n", - "51 0 28 1 0 1 5 Vehicle \n", - "52 0 8 5 1 11 8 Misc \n", - "53 1 0 1 10 13 8 Misc \n", - "54 0 1 11 16 0 7 WaterW \n", - "55 0 0 0 0 0 2 Lightning " - ] - }, - "execution_count": 41, - "metadata": {}, - "output_type": "execute_result" - } - ], - "source": [ - "tb[\"mapping\"] = tb.values.argmax(axis=1)\n", - "tb[\"label\"] = [labels[i] for i in tb[\"mapping\"]]\n", - "mapping = {i: tb.loc[i, \"mapping\"] for i in tb.index}\n", - "topic_model.get_topic_info().merge(tb, on=\"Topic\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "YkF2EY-hEVHK" - }, - "source": [ - "Now, let's apply this model to the validation set. First, we assign each sample to a cluster, based on the clustering model." - ] - }, - { - "cell_type": "code", - "execution_count": 42, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/" - }, - "id": "xeE03QWFEVHK", - "outputId": "b6a5ff69-a3a6-40be-f9b2-fb9fb38cfba5" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "/home/ubuntu/anaconda3/envs/pytorch_latest_p37/lib/python3.7/site-packages/scipy/sparse/_index.py:125: SparseEfficiencyWarning:\n", - "\n", - "Changing the sparsity structure of a csr_matrix is expensive. lil_matrix is more efficient.\n", - "\n" - ] - } - ], - "source": [ - "topics_test, probs_test = topic_model.transform(df_valid[\"Description\"])" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "gKz-IvZEEVHL" - }, - "source": [ - "Then, we apply the mapping from topics to labels, which we have defined above based on the training set. The table below shows for each topic the frequency by label, and the mapping." - ] - }, - { - "cell_type": "code", - "execution_count": 43, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000 - }, - "id": "WRLhMAZhEVHL", - "outputId": "d396bc87-da4e-491e-be9d-7104692a7a9c" - }, - "outputs": [ - { - "data": { - "text/html": [ - "
\n", - "\n", - "\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
labels012345678mapping
Topic
-15733628028138180
153501012121
2411006211197
300500000298
417010010090
559000030010
600110000002
79000000000
818000000010
90051000002
1010020100015
1100034000113
1200000130005
13104101051110
1400000130005
1501260000022
161000090015
1710000150035
1800021800004
190000005307
203000000000
2100010470005
220011060015
2315000000030
245000000050
2500022000013
260000002007
281000000000
2910000190005
3000111000002
310000004207
320040000002
335000000000
340130000002
350200003107
3600000220025
3730120150015
380007010003
391000020018
400033000302
430000002007
440000000020
450000004007
4600110000002
470000030015
480000006327
500000070005
510000010038
520001000118
530100004327
540140000002
\n", - "
" - ], - "text/plain": [ - "labels 0 1 2 3 4 5 6 7 8 mapping\n", - "Topic \n", - "-1 57 3 36 28 0 28 13 8 18 0\n", - " 1 5 35 0 1 0 1 2 1 2 1\n", - " 2 4 1 1 0 0 6 21 11 9 7\n", - " 3 0 0 5 0 0 0 0 0 29 8\n", - " 4 17 0 1 0 0 1 0 0 9 0\n", - " 5 59 0 0 0 0 3 0 0 1 0\n", - " 6 0 0 11 0 0 0 0 0 0 2\n", - " 7 9 0 0 0 0 0 0 0 0 0\n", - " 8 18 0 0 0 0 0 0 0 1 0\n", - " 9 0 0 5 1 0 0 0 0 0 2\n", - " 10 1 0 0 2 0 10 0 0 1 5\n", - " 11 0 0 0 34 0 0 0 1 1 3\n", - " 12 0 0 0 0 0 13 0 0 0 5\n", - " 13 104 1 0 1 0 5 1 1 1 0\n", - " 14 0 0 0 0 0 13 0 0 0 5\n", - " 15 0 1 26 0 0 0 0 0 2 2\n", - " 16 1 0 0 0 0 9 0 0 1 5\n", - " 17 1 0 0 0 0 15 0 0 3 5\n", - " 18 0 0 0 2 18 0 0 0 0 4\n", - " 19 0 0 0 0 0 0 5 3 0 7\n", - " 20 3 0 0 0 0 0 0 0 0 0\n", - " 21 0 0 0 1 0 47 0 0 0 5\n", - " 22 0 0 1 1 0 6 0 0 1 5\n", - " 23 15 0 0 0 0 0 0 0 3 0\n", - " 24 5 0 0 0 0 0 0 0 5 0\n", - " 25 0 0 0 22 0 0 0 0 1 3\n", - " 26 0 0 0 0 0 0 2 0 0 7\n", - " 28 1 0 0 0 0 0 0 0 0 0\n", - " 29 1 0 0 0 0 19 0 0 0 5\n", - " 30 0 0 11 1 0 0 0 0 0 2\n", - " 31 0 0 0 0 0 0 4 2 0 7\n", - " 32 0 0 4 0 0 0 0 0 0 2\n", - " 33 5 0 0 0 0 0 0 0 0 0\n", - " 34 0 1 3 0 0 0 0 0 0 2\n", - " 35 0 2 0 0 0 0 3 1 0 7\n", - " 36 0 0 0 0 0 22 0 0 2 5\n", - " 37 3 0 1 2 0 15 0 0 1 5\n", - " 38 0 0 0 7 0 1 0 0 0 3\n", - " 39 1 0 0 0 0 2 0 0 1 8\n", - " 40 0 0 3 3 0 0 0 3 0 2\n", - " 43 0 0 0 0 0 0 2 0 0 7\n", - " 44 0 0 0 0 0 0 0 0 2 0\n", - " 45 0 0 0 0 0 0 4 0 0 7\n", - " 46 0 0 11 0 0 0 0 0 0 2\n", - " 47 0 0 0 0 0 3 0 0 1 5\n", - " 48 0 0 0 0 0 0 6 3 2 7\n", - " 50 0 0 0 0 0 7 0 0 0 5\n", - " 51 0 0 0 0 0 1 0 0 3 8\n", - " 52 0 0 0 1 0 0 0 1 1 8\n", - " 53 0 1 0 0 0 0 4 3 2 7\n", - " 54 0 1 4 0 0 0 0 0 0 2" - ] - }, - "execution_count": 43, - "metadata": {}, - "output_type": "execute_result" - } - ], - "source": [ - "df_valid[\"Topic\"] = topics_test\n", - "df_valid[\"prob\"] = probs_test\n", - "df_valid[\"pred\"] = [mapping[t] for t in topics_test]\n", - "df_valid.to_excel(\"results/peril_topics.xlsx\")\n", - "tb_valid = pd.pivot_table(df_valid, index=[\"Topic\"], columns=[\"labels\"], aggfunc='count', fill_value=0)[\"Description\"]\n", - "tb_valid[\"mapping\"] = [mapping[t] for t in tb_valid.index]\n", - "tb_valid" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "m7epfnhsEVHL" - }, - "source": [ - "This classifier achieves an accuracy score of ca. 70%, compared to 30% obtained with the dummy classifier. " - ] - }, - { - "cell_type": "code", - "execution_count": 44, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 872 - }, - "id": "ZF9x0l1xEVHL", - "outputId": "8585246e-643d-4e7b-f2fa-20c3ea94a77c" - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Topic modeling by clustering\n", - "accuracy score = 69.6%, log loss = nan, Brier loss = nan\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " Vandalism 0.63 0.95 0.76 310\n", - " Fire 0.74 0.76 0.75 46\n", - " Lightning 0.86 0.63 0.73 123\n", - " Wind 0.94 0.59 0.72 107\n", - " Hail 0.90 1.00 0.95 18\n", - " Vehicle 0.88 0.79 0.83 227\n", - " WaterNW 0.00 0.00 0.00 67\n", - " WaterW 0.23 0.61 0.33 38\n", - " Misc 0.76 0.33 0.46 103\n", - "\n", - " accuracy 0.70 1039\n", - " macro avg 0.66 0.63 0.61 1039\n", - "weighted avg 0.71 0.70 0.68 1039\n", - "\n" - ] - }, - { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_peril_topic_a", - "format": "svg" - } - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "xaxis": "x", - "y": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "yaxis": "y", - "z": [ - [ - 293, - 5, - 0, - 0, - 0, - 7, - 0, - 4, - 1 - ], - [ - 4, - 35, - 3, - 0, - 0, - 0, - 0, - 4, - 0 - ], - [ - 37, - 0, - 78, - 0, - 0, - 2, - 0, - 1, - 5 - ], - [ - 29, - 1, - 5, - 63, - 2, - 6, - 0, - 0, - 1 - ], - [ - 0, - 0, - 0, - 0, - 18, - 0, - 0, - 0, - 0 - ], - [ - 37, - 1, - 0, - 1, - 0, - 179, - 0, - 6, - 3 - ], - [ - 14, - 2, - 0, - 0, - 0, - 0, - 0, - 51, - 0 - ], - [ - 9, - 1, - 3, - 1, - 0, - 0, - 0, - 23, - 1 - ], - [ - 40, - 2, - 2, - 2, - 0, - 10, - 0, - 13, - 34 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 14 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Topic modeling by clustering" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } - } - } - }, - "text/html": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "_ = evaluate_classifier(df_valid[\"labels\"], df_valid[\"pred\"], None, labels, \"Topic modeling by clustering\", \"cm_peril_topic_a\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Kq6ygqVhEVHL" - }, - "source": [ - "BERTopic provides the function `find_topics` which returns a list of IDs and similarity scores of topics that best match a given search term.\n", - "\n", - "This is useful to validate the mapping. Let's use the search term \"Fire\" and retrieve the three most similar topics.\n", - "For each of these topics, we print the similarity score and the label it was mapped to. We also show the word scores for each topic." - ] - }, - { - "cell_type": "code", - "execution_count": 45, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 394 - }, - "id": "8lXgN3eBEVHL", - "outputId": "eca8d60f-a11e-4bc2-a29d-f5b7d3d284fe" - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "topic 1: similarity score 91.8%, mapped to peril 1 (Fire)\n", - "topic 12: similarity score 69.0%, mapped to peril 5 (Vehicle)\n", - "topic 6: similarity score 61.5%, mapped to peril 2 (Lightning)\n" - ] - }, - { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly" - }, - "data": [ - { - "marker": { - "color": "#D55E00" - }, - "orientation": "h", - "type": "bar", - "x": [ - 0.023295897805408042, - 0.023555605798973325, - 0.025803975483149527, - 0.08229676777844862, - 0.15913408180789676 - ], - "xaxis": "x", - "y": [ - "station ", - "equipment ", - "damage ", - "smoke ", - "fire " - ], - "yaxis": "y" - }, - { - "marker": { - "color": "#0072B2" - }, - "orientation": "h", - "type": "bar", - "x": [ - 0.06773847894241732, - 0.06843868470222605, - 0.08788076091307075, - 0.2101435049735843, - 0.37106834322585786 - ], - "xaxis": "x2", - "y": [ - "run ", - "damaged ", - "hit ", - "fire ", - "hydrant " - ], - "yaxis": "y2" - }, - { - "marker": { - "color": "#CC79A7" - }, - "orientation": "h", - "type": "bar", - "x": [ - 0.020046212271247463, - 0.034534857629611976, - 0.03582062495989983, - 0.06723236635579213, - 0.14756059548565328 - ], - "xaxis": "x3", - "y": [ - "museum ", - "dpw ", - "scale ", - "damage ", - "lightning " - ], - "yaxis": "y3" - } - ], - "layout": { - "annotations": [ - { - "font": { - "size": 16 - }, - "showarrow": false, - "text": "Topic 1", - "x": 0.0875, - "xanchor": "center", - "xref": "paper", - "y": 1, - "yanchor": "bottom", - "yref": "paper" - }, - { - "font": { - "size": 16 - }, - "showarrow": false, - "text": "Topic 12", - "x": 0.36250000000000004, - "xanchor": "center", - "xref": "paper", - "y": 1, - "yanchor": "bottom", - "yref": "paper" - }, - { - "font": { - "size": 16 - }, - "showarrow": false, - "text": "Topic 6", - "x": 0.6375000000000001, - "xanchor": "center", - "xref": "paper", - "y": 1, - "yanchor": "bottom", - "yref": "paper" - } - ], - "height": 325, - "hoverlabel": { - "bgcolor": "white", - "font": { - "family": "Rockwell", - "size": 16 - } - }, - "showlegend": false, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "white", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "white", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "#C8D4E3", - "linecolor": "#C8D4E3", - "minorgridcolor": "#C8D4E3", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "#C8D4E3", - "linecolor": "#C8D4E3", - "minorgridcolor": "#C8D4E3", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "white", - "showlakes": true, - "showland": true, - "subunitcolor": "#C8D4E3" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "white", - "polar": { - "angularaxis": { - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "" - }, - "bgcolor": "white", - "radialaxis": { - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "white", - "gridcolor": "#DFE8F3", - "gridwidth": 2, - "linecolor": "#EBF0F8", - "showbackground": true, - "ticks": "", - "zerolinecolor": "#EBF0F8" - }, - "yaxis": { - "backgroundcolor": "white", - "gridcolor": "#DFE8F3", - "gridwidth": 2, - "linecolor": "#EBF0F8", - "showbackground": true, - "ticks": "", - "zerolinecolor": "#EBF0F8" - }, - "zaxis": { - "backgroundcolor": "white", - "gridcolor": "#DFE8F3", - "gridwidth": 2, - "linecolor": "#EBF0F8", - "showbackground": true, - "ticks": "", - "zerolinecolor": "#EBF0F8" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "#DFE8F3", - "linecolor": "#A2B1C6", - "ticks": "" - }, - "baxis": { - "gridcolor": "#DFE8F3", - "linecolor": "#A2B1C6", - "ticks": "" - }, - "bgcolor": "white", - "caxis": { - "gridcolor": "#DFE8F3", - "linecolor": "#A2B1C6", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "#EBF0F8", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "#EBF0F8", - "linecolor": "#EBF0F8", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "#EBF0F8", - "zerolinewidth": 2 - } - } - }, - "title": { - "font": { - "color": "Black", - "size": 22 - }, - "text": "Topic Word Scores", - "x": 0.5, - "xanchor": "center", - "yanchor": "top" - }, - "width": 1000, - "xaxis": { - "anchor": "y", - "domain": [ - 0, - 0.175 - ], - "showgrid": true - }, - "xaxis2": { - "anchor": "y2", - "domain": [ - 0.275, - 0.45 - ], - "showgrid": true - }, - "xaxis3": { - "anchor": "y3", - "domain": [ - 0.55, - 0.7250000000000001 - ], - "showgrid": true - }, - "xaxis4": { - "anchor": "y4", - "domain": [ - 0.825, - 1 - ], - "showgrid": true - }, - "yaxis": { - "anchor": "x", - "domain": [ - 0, - 1 - ], - "showgrid": true - }, - "yaxis2": { - "anchor": "x2", - "domain": [ - 0, - 1 - ], - "showgrid": true - }, - "yaxis3": { - "anchor": "x3", - "domain": [ - 0, - 1 - ], - "showgrid": true - }, - "yaxis4": { - "anchor": "x4", - "domain": [ - 0, - 1 - ], - "showgrid": true - } - } - }, - "text/html": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "similar_topics, similarity = topic_model.find_topics(\"Fire\", top_n=3)\n", - "for t, s in zip(similar_topics, similarity):\n", - " print(f\"topic {t:2d}: similarity score {s:.1%}, mapped to peril {mapping[t]:d} ({labels[mapping[t]]})\")\n", - "topic_model.visualize_barchart(similar_topics)" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "zP9N-QnoEVHM" - }, - "source": [ - "As expected, the topics which have been mapped to \"Fire\" appear first in the list, with similarity scores of more than 80%.\n", - "\n", - "The first topic that was not mapped to \"Fire\" has a similarity score of less than 70%. It was mapped to the label \"Vehicle\".\n", - "Indeed: Although the word \"Fire\" ranks second in the word score, this is in combination with hydrant. This is about vehicles hitting fire hydrants." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "67ZBWOL-EVHM" - }, - "source": [ - "\n", - "\n", - "### 5.2. Refinement\n", - "\n", - "Above, a relatively large number of samples was classified as outlier. All outliers were mapped to a single class, but this mapping is questionable, because we have seen that outlier samples belong to different classes.\n", - "\n", - "To mitigate this issue, we could label the outlier samples manually. However, this is quite tedious.\n", - "\n", - "Alternatively, we can train a classifier to the labels obtained from the unsupervised approach. To avoid label noise, we suppress outliers.\n", - "\n", - "First, we create the training dataset. We replace the true labels by the labels obtained from the clustering approach." - ] - }, - { - "cell_type": "code", - "execution_count": 46, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 49, - "referenced_widgets": [ - "812345908d9c456b892444c0b98cae07", - "32c3cd5ee8dd4ab09011eed21d488ab6", - "57f258f537b548ae9f6f7a4f7e6a0078", - "1a4d202a3564477cb941ecf2c69e3a33", - "0b3b964e02a546b4aedd07d27135d031", - "46b16ac89d734566a2098ba73d31f56b", - "99ae5a8cceee4c7ab0daeea24cb0c2a5", - "dd4bd7681c8b44a2b7162b365948b8bd", - "0fd482518b9f4859866abc02b3f98f94", - "f3720a4f21c2491eb4ea17f3efcc74d1", - "d7207b39009a4219bd76e13063f6bee9" - ] - }, - "id": "rM4tmo_WEVHM", - "outputId": "a7ff735c-2cc2-473e-bc4b-6b86a6d799b2" - }, - "outputs": [ - { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "099231f01c2a429c991f22e06af5a5bd", - "version_major": 2, - "version_minor": 0 - }, - "text/plain": [ - " 0%| | 0/4 [00:00=0].copy()\n", - "df_train_unsupervised[\"labels\"] = [mapping[t] for t in df_train_unsupervised[\"Topic\"]]\n", - "ds_train_unsupervised = Dataset.from_pandas(df_train_unsupervised)\n", - "ds_train_unsupervised = ds_train_unsupervised.map(tokenize, batched=True)" - ] - }, - { - "cell_type": "code", - "execution_count": 47, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 1000 - }, - "id": "4Mdi7Y6aEVHN", - "outputId": "e5b8a5e3-76cb-493d-8f63-d5aca1e07267" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "loading configuration file https://huggingface.co/distilbert-base-uncased/resolve/main/config.json from cache at /home/ubuntu/.cache/huggingface/transformers/23454919702d26495337f3da04d1655c7ee010d5ec9d77bdb9e399e00302c0a1.91b885ab15d631bf9cee9dc9d25ece0afd932f2f5130eba28f2055b2220c0333\n", - "Model config DistilBertConfig {\n", - " \"_name_or_path\": \"distilbert-base-uncased\",\n", - " \"activation\": \"gelu\",\n", - " \"architectures\": [\n", - " \"DistilBertForMaskedLM\"\n", - " ],\n", - " \"attention_dropout\": 0.1,\n", - " \"dim\": 768,\n", - " \"dropout\": 0.1,\n", - " \"hidden_dim\": 3072,\n", - " \"id2label\": {\n", - " \"0\": \"LABEL_0\",\n", - " \"1\": \"LABEL_1\",\n", - " \"2\": \"LABEL_2\",\n", - " \"3\": \"LABEL_3\",\n", - " \"4\": \"LABEL_4\",\n", - " \"5\": \"LABEL_5\",\n", - " \"6\": \"LABEL_6\",\n", - " \"7\": \"LABEL_7\",\n", - " \"8\": \"LABEL_8\"\n", - " },\n", - " \"initializer_range\": 0.02,\n", - " \"label2id\": {\n", - " \"LABEL_0\": 0,\n", - " \"LABEL_1\": 1,\n", - " \"LABEL_2\": 2,\n", - " \"LABEL_3\": 3,\n", - " \"LABEL_4\": 4,\n", - " \"LABEL_5\": 5,\n", - " \"LABEL_6\": 6,\n", - " \"LABEL_7\": 7,\n", - " \"LABEL_8\": 8\n", - " },\n", - " \"max_position_embeddings\": 512,\n", - " \"model_type\": \"distilbert\",\n", - " \"n_heads\": 12,\n", - " \"n_layers\": 6,\n", - " \"pad_token_id\": 0,\n", - " \"qa_dropout\": 0.1,\n", - " \"seq_classif_dropout\": 0.2,\n", - " \"sinusoidal_pos_embds\": false,\n", - " \"tie_weights_\": true,\n", - " \"transformers_version\": \"4.19.2\",\n", - " \"vocab_size\": 30522\n", - "}\n", - "\n", - "loading weights file https://huggingface.co/distilbert-base-uncased/resolve/main/pytorch_model.bin from cache at /home/ubuntu/.cache/huggingface/transformers/9c169103d7e5a73936dd2b627e42851bec0831212b677c637033ee4bce9ab5ee.126183e36667471617ae2f0835fab707baa54b731f991507ebbb55ea85adb12a\n", - "Some weights of the model checkpoint at distilbert-base-uncased were not used when initializing DistilBertForSequenceClassification: ['vocab_layer_norm.bias', 'vocab_transform.bias', 'vocab_projector.bias', 'vocab_layer_norm.weight', 'vocab_projector.weight', 'vocab_transform.weight']\n", - "- This IS expected if you are initializing DistilBertForSequenceClassification from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).\n", - "- This IS NOT expected if you are initializing DistilBertForSequenceClassification from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).\n", - "Some weights of DistilBertForSequenceClassification were not initialized from the model checkpoint at distilbert-base-uncased and are newly initialized: ['pre_classifier.weight', 'classifier.weight', 'classifier.bias', 'pre_classifier.bias']\n", - "You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n", - "PyTorch: setting up devices\n", - "The default value for the training argument `--report_to` will change in v5 (from all installed integrations to none). In v5, you will need to use `--report_to all` to get the same behavior as now. You should start updating your code and make this info disappear :-).\n", - "The following columns in the training set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: Lightning, WaterW, Wind, WaterNW, Vandalism, words per description, Fire, Hail, Vehicle, Misc, __index_level_0__, Description, Loss, Topic. If Lightning, WaterW, Wind, WaterNW, Vandalism, words per description, Fire, Hail, Vehicle, Misc, __index_level_0__, Description, Loss, Topic are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "***** Running training *****\n", - " Num examples = 3914\n", - " Num Epochs = 2\n", - " Instantaneous batch size per device = 8\n", - " Total train batch size (w. parallel, distributed & accumulation) = 8\n", - " Gradient Accumulation steps = 1\n", - " Total optimization steps = 980\n" - ] - }, - { - "data": { - "text/html": [ - "\n", - "
\n", - " \n", - " \n", - " [980/980 00:40, Epoch 2/2]\n", - "
\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
StepTraining Loss
4890.387200
9780.093200

" - ], - "text/plain": [ - "" - ] - }, - "metadata": {}, - "output_type": "display_data" - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\n", - "\n", - "Training completed. Do not forget to share your model on huggingface.co/models =)\n", - "\n", - "\n", - "Saving model checkpoint to distilbert-base-uncased_peril_u\n", - "Configuration saved in distilbert-base-uncased_peril_u/config.json\n", - "Model weights saved in distilbert-base-uncased_peril_u/pytorch_model.bin\n" - ] - } - ], - "source": [ - "model_name = \"distilbert-base-uncased\"\n", - "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", - "torch.manual_seed(42) # for reproducibility, set random seed before instantiating the model\n", - "model = AutoModelForSequenceClassification.from_pretrained(model_name, num_labels=len(labels)).to(device)\n", - "\n", - "# train the model\n", - "batch_size = 8\n", - "logging_steps = len(ds_train_unsupervised) // batch_size\n", - "training_args = TrainingArguments(\n", - " output_dir=model_name+\"_peril_u_epochs\",\n", - " num_train_epochs=2,\n", - " per_device_train_batch_size=batch_size,\n", - " per_device_eval_batch_size=batch_size,\n", - " metric_for_best_model=\"f1\",\n", - " logging_steps=logging_steps,\n", - " save_strategy=trainer_utils.IntervalStrategy.NO,\n", - ")\n", - "trainer = Trainer(model=model, args=training_args,\n", - " compute_metrics=compute_metrics, train_dataset=ds_train_unsupervised,\n", - " eval_dataset=ds[\"test\"])\n", - "trainer.train();\n", - "trainer.save_model(model_name + \"_peril_u\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "Rs65tNt_EVHN" - }, - "source": [ - "Then, we evaluate the classifier on the test set, by comparing the predicted to the true labels." - ] - }, - { - "cell_type": "code", - "execution_count": 48, - "metadata": { - "colab": { - "base_uri": "https://localhost:8080/", - "height": 961 - }, - "id": "HldJUXwtEVHN", - "outputId": "4e384eaa-5e89-47de-b40e-e92bf7ddfe77" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "The following columns in the test set don't have a corresponding argument in `DistilBertForSequenceClassification.forward` and have been ignored: Lightning, WaterW, Wind, cls_hidden_state, WaterNW, Vandalism, Fire, mean_hidden_state, Hail, Vehicle, Misc, Description, Loss. If Lightning, WaterW, Wind, cls_hidden_state, WaterNW, Vandalism, Fire, mean_hidden_state, Hail, Vehicle, Misc, Description, Loss are not expected by `DistilBertForSequenceClassification.forward`, you can safely ignore this message.\n", - "***** Running Prediction *****\n", - " Num examples = 1039\n", - " Batch size = 8\n" - ] - }, - { - "data": { - "text/html": [ - "\n", - "

\n", - " \n", - " \n", - " [130/130 00:01]\n", - "
\n", - " " - ], - "text/plain": [ - "" - ] - }, - "metadata": {}, - "output_type": "display_data" - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Topic modeling by clustering, refined\n", - "accuracy score = 79.2%, log loss = 1.456, Brier loss = 0.385\n", - "classification report\n", - " precision recall f1-score support\n", - "\n", - " Vandalism 0.85 0.93 0.89 310\n", - " Fire 0.76 0.85 0.80 46\n", - " Lightning 0.88 0.94 0.91 123\n", - " Wind 0.99 0.80 0.89 107\n", - " Hail 0.90 1.00 0.95 18\n", - " Vehicle 0.87 0.89 0.88 227\n", - " WaterNW 0.00 0.00 0.00 67\n", - " WaterW 0.28 0.87 0.42 38\n", - " Misc 0.70 0.41 0.52 103\n", - "\n", - " accuracy 0.79 1039\n", - " macro avg 0.69 0.74 0.69 1039\n", - "weighted avg 0.78 0.79 0.77 1039\n", - "\n" - ] - }, - { - "data": { - "application/vnd.plotly.v1+json": { - "config": { - "plotlyServerURL": "https://plot.ly", - "toImageButtonOptions": { - "filename": "cm_peril_topic_b", - "format": "svg" - } - }, - "data": [ - { - "coloraxis": "coloraxis", - "hovertemplate": "x: %{x}
y: %{y}
color: %{z}", - "name": "0", - "texttemplate": "%{z}", - "type": "heatmap", - "x": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "xaxis": "x", - "y": [ - " Vandalism ", - " Fire ", - " Lightning ", - " Wind ", - " Hail ", - " Vehicle ", - " WaterNW ", - " WaterW ", - " Misc " - ], - "yaxis": "y", - "z": [ - [ - 288, - 7, - 3, - 0, - 0, - 8, - 0, - 3, - 1 - ], - [ - 1, - 39, - 3, - 0, - 0, - 1, - 0, - 1, - 1 - ], - [ - 1, - 1, - 116, - 0, - 0, - 1, - 0, - 0, - 4 - ], - [ - 3, - 0, - 5, - 86, - 2, - 8, - 0, - 2, - 1 - ], - [ - 0, - 0, - 0, - 0, - 18, - 0, - 0, - 0, - 0 - ], - [ - 11, - 0, - 0, - 0, - 0, - 201, - 0, - 9, - 6 - ], - [ - 5, - 1, - 0, - 0, - 0, - 0, - 0, - 59, - 2 - ], - [ - 0, - 0, - 1, - 1, - 0, - 0, - 0, - 33, - 3 - ], - [ - 30, - 3, - 4, - 0, - 0, - 11, - 0, - 13, - 42 - ] - ] - } - ], - "layout": { - "coloraxis": { - "colorscale": [ - [ - 0, - "rgb(247,251,255)" - ], - [ - 0.125, - "rgb(222,235,247)" - ], - [ - 0.25, - "rgb(198,219,239)" - ], - [ - 0.375, - "rgb(158,202,225)" - ], - [ - 0.5, - "rgb(107,174,214)" - ], - [ - 0.625, - "rgb(66,146,198)" - ], - [ - 0.75, - "rgb(33,113,181)" - ], - [ - 0.875, - "rgb(8,81,156)" - ], - [ - 1, - "rgb(8,48,107)" - ] - ], - "showscale": false - }, - "font": { - "size": 14 - }, - "template": { - "data": { - "bar": [ - { - "error_x": { - "color": "#2a3f5f" - }, - "error_y": { - "color": "#2a3f5f" - }, - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "bar" - } - ], - "barpolar": [ - { - "marker": { - "line": { - "color": "#E5ECF6", - "width": 0.5 - }, - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "barpolar" - } - ], - "carpet": [ - { - "aaxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "baxis": { - "endlinecolor": "#2a3f5f", - "gridcolor": "white", - "linecolor": "white", - "minorgridcolor": "white", - "startlinecolor": "#2a3f5f" - }, - "type": "carpet" - } - ], - "choropleth": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "choropleth" - } - ], - "contour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "contour" - } - ], - "contourcarpet": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "contourcarpet" - } - ], - "heatmap": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmap" - } - ], - "heatmapgl": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "heatmapgl" - } - ], - "histogram": [ - { - "marker": { - "pattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - } - }, - "type": "histogram" - } - ], - "histogram2d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2d" - } - ], - "histogram2dcontour": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "histogram2dcontour" - } - ], - "mesh3d": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "type": "mesh3d" - } - ], - "parcoords": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "parcoords" - } - ], - "pie": [ - { - "automargin": true, - "type": "pie" - } - ], - "scatter": [ - { - "fillpattern": { - "fillmode": "overlay", - "size": 10, - "solidity": 0.2 - }, - "type": "scatter" - } - ], - "scatter3d": [ - { - "line": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatter3d" - } - ], - "scattercarpet": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattercarpet" - } - ], - "scattergeo": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergeo" - } - ], - "scattergl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattergl" - } - ], - "scattermapbox": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scattermapbox" - } - ], - "scatterpolar": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolar" - } - ], - "scatterpolargl": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterpolargl" - } - ], - "scatterternary": [ - { - "marker": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "type": "scatterternary" - } - ], - "surface": [ - { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - }, - "colorscale": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "type": "surface" - } - ], - "table": [ - { - "cells": { - "fill": { - "color": "#EBF0F8" - }, - "line": { - "color": "white" - } - }, - "header": { - "fill": { - "color": "#C8D4E3" - }, - "line": { - "color": "white" - } - }, - "type": "table" - } - ] - }, - "layout": { - "annotationdefaults": { - "arrowcolor": "#2a3f5f", - "arrowhead": 0, - "arrowwidth": 1 - }, - "autotypenumbers": "strict", - "coloraxis": { - "colorbar": { - "outlinewidth": 0, - "ticks": "" - } - }, - "colorscale": { - "diverging": [ - [ - 0, - "#8e0152" - ], - [ - 0.1, - "#c51b7d" - ], - [ - 0.2, - "#de77ae" - ], - [ - 0.3, - "#f1b6da" - ], - [ - 0.4, - "#fde0ef" - ], - [ - 0.5, - "#f7f7f7" - ], - [ - 0.6, - "#e6f5d0" - ], - [ - 0.7, - "#b8e186" - ], - [ - 0.8, - "#7fbc41" - ], - [ - 0.9, - "#4d9221" - ], - [ - 1, - "#276419" - ] - ], - "sequential": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ], - "sequentialminus": [ - [ - 0, - "#0d0887" - ], - [ - 0.1111111111111111, - "#46039f" - ], - [ - 0.2222222222222222, - "#7201a8" - ], - [ - 0.3333333333333333, - "#9c179e" - ], - [ - 0.4444444444444444, - "#bd3786" - ], - [ - 0.5555555555555556, - "#d8576b" - ], - [ - 0.6666666666666666, - "#ed7953" - ], - [ - 0.7777777777777778, - "#fb9f3a" - ], - [ - 0.8888888888888888, - "#fdca26" - ], - [ - 1, - "#f0f921" - ] - ] - }, - "colorway": [ - "#636efa", - "#EF553B", - "#00cc96", - "#ab63fa", - "#FFA15A", - "#19d3f3", - "#FF6692", - "#B6E880", - "#FF97FF", - "#FECB52" - ], - "font": { - "color": "#2a3f5f" - }, - "geo": { - "bgcolor": "white", - "lakecolor": "white", - "landcolor": "#E5ECF6", - "showlakes": true, - "showland": true, - "subunitcolor": "white" - }, - "hoverlabel": { - "align": "left" - }, - "hovermode": "closest", - "mapbox": { - "style": "light" - }, - "paper_bgcolor": "white", - "plot_bgcolor": "#E5ECF6", - "polar": { - "angularaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "radialaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "scene": { - "xaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "yaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - }, - "zaxis": { - "backgroundcolor": "#E5ECF6", - "gridcolor": "white", - "gridwidth": 2, - "linecolor": "white", - "showbackground": true, - "ticks": "", - "zerolinecolor": "white" - } - }, - "shapedefaults": { - "line": { - "color": "#2a3f5f" - } - }, - "ternary": { - "aaxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "baxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - }, - "bgcolor": "#E5ECF6", - "caxis": { - "gridcolor": "white", - "linecolor": "white", - "ticks": "" - } - }, - "title": { - "x": 0.05 - }, - "xaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - }, - "yaxis": { - "automargin": true, - "gridcolor": "white", - "linecolor": "white", - "ticks": "", - "title": { - "standoff": 15 - }, - "zerolinecolor": "white", - "zerolinewidth": 2 - } - } - }, - "title": { - "text": "Topic modeling by clustering, refined" - }, - "width": 600, - "xaxis": { - "anchor": "y", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "scaleanchor": "y", - "title": { - "text": "predicted class" - } - }, - "yaxis": { - "anchor": "x", - "autorange": "reversed", - "constrain": "domain", - "domain": [ - 0, - 1 - ], - "title": { - "text": "actual class" - } - } - } - }, - "text/html": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], - "source": [ - "predictions = trainer.predict(ds[\"test\"])\n", - "_ = evaluate_classifier(predictions.label_ids, None, softmax(predictions.predictions, axis=1), labels, \"Topic modeling by clustering, refined\", \"cm_peril_topic_b\")" - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "r_LJQY04EVHN" - }, - "source": [ - "The accuracy score has improved significantly." - ] - }, - { - "cell_type": "markdown", - "metadata": { - "id": "0Wet19WmEVHN" - }, - "source": [ - "\n", - "\n", - "## 6. Conclusions\n", - "\n", - "Congratulations!\n", - "\n", - "In this Part II of the tutorial, you have first applied the techniques you have learned in Part I to a dataset with shorter texts.\n", - "\n", - "Then you have learned how to use zero shot classification in a situation with no labels. The beauty of this approach is that it requires no training and produces a reasonable classification by a list of user-defined expressions.\n", - "\n", - "You have also seen that unsupervised classification can be achieved by similarity scoring between the input sequence and a list of user-defined expressions.\n", - "\n", - "Going one step further, you have seen an approach that creates clusters of similar documents and represents each cluster by typical words. This can be used as a starting point to create meaningful labels.\n", - "\n", - "If you have enjoyed this tutorial, feel free to apply any of the approaches - or improved versions, of course - to your own text data, to enrich your structured features available for supervised learning tasks." - ] - } - ], - "metadata": { - "accelerator": "GPU", - "colab": { - "collapsed_sections": [ - "hcc6Je4lEVG4", - "iEu2UBDEEVG4", - "44WiOM3SEVG-", - "CoYTxK22EVHG", - "csG9Uh15maLE" - ], - "name": "Actuarial_Applications_of_NLP_Part_2_v2.ipynb", - "provenance": [], - "toc_visible": true - }, - "kernelspec": { - "display_name": "Python 3", - "language": "python", - "name": "python3" - }, - "language_info": { - "codemirror_mode": { - "name": "ipython", - "version": 3 - }, - "file_extension": ".py", - "mimetype": "text/x-python", - "name": "python", - "nbconvert_exporter": "python", - "pygments_lexer": "ipython3", - "version": "3.7.10" - }, - "widgets": { - "application/vnd.jupyter.widget-state+json": { - "00311803314143ecbb24e25acbb94f66": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "00b59754edd24f61a38ea1ed4f1aa077": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "00bddf74632a484b929d238afc51c81e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "03f86c9d0b764e36b23e30358346eaf3": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "0427a43036264a3683b9ccc05ae4d263": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_fe358f54827f476d98557365e873d898", - "IPY_MODEL_5f70a433d78f4d7494af38d6cb103845", - "IPY_MODEL_a8983ba16a794aad8271b7d69a81b3ad" - ], - "layout": "IPY_MODEL_e6fa423db2cd4a628ce17ffd90d3d254" - } - }, - "059dc7a7910e447cb50d06979bdbf539": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "05b5736964ad48e5825672d3ca3cfe69": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "05d19b34fe2e49b5b2076627e73288f5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "064dca1b1b824a908647633e4f72f71b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "091fcb8d2a714647a2ece136d3ffeb07": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_a04fbcff413a4775b5e0476618069995", - "max": 1355863, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_cfe231dfa61e4d2fb55d28535bde9dc4", - "value": 1355863 - } - }, - "099e5c754c404468a90fb9247cc0bbdc": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "09ea5fdae5eb49fd898d7d9f027a5785": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_ead6bc3051794fca93f0269308fd0c0c", - "max": 349, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_d413bf53515b4cc5ac81b444f15fd19c", - "value": 349 - } - }, - "0a1bd69095c54b25b1641114bcc4d932": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_279fd335dcb44b5bbaec54749a862539", - "placeholder": "​", - "style": "IPY_MODEL_0f7e760ab9444b9196a317d5abd6d309", - "value": " 1/1 [00:00<00:00, 18.67ba/s]" - } - }, - "0a9cd7f035cf4540a15e3d22b74fd5f6": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "0af9681c674541f5874c3eb7f1798ac4": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "0b3b964e02a546b4aedd07d27135d031": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "0befa271378e45059b91035558802962": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "0c8d5caa32624d3e950372123ea76085": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "0d15af1100e1498bbcc991f5b78adc59": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "0d1dc7e37a7441079a9955a166d0c46d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "0d240a2d4bbd40b282dc5a64609672a6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_c8ee1ad0025148138522d1f3d35a01cf", - "placeholder": "​", - "style": "IPY_MODEL_6b92e4f8e8914c9098eeb35e2daf2882", - "value": " 612/612 [00:00<00:00, 15.7kB/s]" - } - }, - "0d6060ee7aec42d492f9bb1e4b8f2ce4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_ecb380ec3dc849c983440cb1b73bfa30", - "placeholder": "​", - "style": "IPY_MODEL_1de320a9241847a894efd02932b989b7", - "value": " 65/65 [00:00<00:00, 72.64ba/s]" - } - }, - "0df5ec008faf4097863467f9fa482d92": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_05b5736964ad48e5825672d3ca3cfe69", - "placeholder": "​", - "style": "IPY_MODEL_89fa8071833c4955b78bb6f8ddfcd4f3", - "value": " 1.18k/1.18k [00:00<00:00, 31.2kB/s]" - } - }, - "0edf2e575f3347f287a964f4e1f3fc49": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "0f7e760ab9444b9196a317d5abd6d309": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "0fd482518b9f4859866abc02b3f98f94": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "10ad0b729d7a403198a35900081f1108": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "1178f617fe0042c3876a9006de9a1d53": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "11ab378d7c254c64a910872ea18d7e27": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "1369dd9f01474e18ad1d1f0cec6cb77a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "141b59a274af4e12987648aad7c1c0a9": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_2e468409dc97440da727a31629f71d1a", - "max": 1175, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_593c169dfbf345629433470655a325d1", - "value": 1175 - } - }, - "15d67358fa8242faae6b0eca661afcbf": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_7017cacda2dc4e72971a437d0a2a028c", - "placeholder": "​", - "style": "IPY_MODEL_9b8bc0251d4e422587c993e0935d846e", - "value": "100%" - } - }, - "184ac127cfe442a181e9d1135f45d4b9": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_8ce831be076d4a0aaeac2dea7f74571c", - "max": 112, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_4b9d8d5cbe864468b109aa5abf25d092", - "value": 112 - } - }, - "18cac2a5cc9a48bdab2a64891fb1f66f": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "1906621155644db484bfe4d4fe07ce12": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "1a36071ac6d14266b2208e8a9bc86732": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_24ee4d111fc34bc294d38e589360cd38", - "IPY_MODEL_d68fc2f69eaf48bf905e133be2bc82f1", - "IPY_MODEL_6d477c6ce2fd4e83913ac7fd0eae45dd" - ], - "layout": "IPY_MODEL_1e3fe01fd1b949f9a59742f9ebcf2f15" - } - }, - "1a4d202a3564477cb941ecf2c69e3a33": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_f3720a4f21c2491eb4ea17f3efcc74d1", - "placeholder": "​", - "style": "IPY_MODEL_d7207b39009a4219bd76e13063f6bee9", - "value": " 5/5 [00:00<00:00, 3.22ba/s]" - } - }, - "1b612c743595417ba3f393056c6a7e7a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "1bc3df520c024829b8e9379fd4f09cf7": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "1bd452a69f6f408182343235b5f74435": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "1de320a9241847a894efd02932b989b7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "1e3fe01fd1b949f9a59742f9ebcf2f15": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "1ec9d7b1c71a440db6089c6539f680a3": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "1f8047295eff40b19f0a976e67f98c3a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "203a6cc968e944c6b70c10e574370b92": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "2044594efdf34fcf8d1a84ad027885eb": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "2081108498f544d8b70330a5cf2b33f3": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "223f257b5927425ea2793ff78a60a591": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "225b0156f4354ab0a5df66a2d58017d6": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "22dd156738a64b1d9c36306ade52a9df": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "23fbeb7bd6a345dcae57aa2807c05fb2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_0a9cd7f035cf4540a15e3d22b74fd5f6", - "placeholder": "​", - "style": "IPY_MODEL_46091f4e750c47889eb6a1e852267734", - "value": " 5/5 [00:00<00:00, 20.44ba/s]" - } - }, - "24ee4d111fc34bc294d38e589360cd38": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_7d0fcbb785544e5cb5e8dd2ae7aa1f98", - "placeholder": "​", - "style": "IPY_MODEL_babdfdcf27714853ae2be7ea4e7d0713", - "value": "100%" - } - }, - "278142b28f7341209ff853d67c354a10": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_90d526066e8c4987a16cbcf7e01c1038", - "placeholder": "​", - "style": "IPY_MODEL_c220518979d74b8c9089ffc8fb62ca04", - "value": "Downloading: 100%" - } - }, - "279fd335dcb44b5bbaec54749a862539": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "27d41f8299cb473180149d8504862c09": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "28c6d8a464d4483eb8abae01f4cf14db": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "28eab6f7e43848fcae1d568a26083a55": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "2925e8f3abb342f9a10e9e78fa152a81": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_943cc95dedf842a09a12e422c28c70f0", - "placeholder": "​", - "style": "IPY_MODEL_9b6a0849f182474c88493b24657e5103", - "value": "100%" - } - }, - "2ac2219e56074d8a9c6a276a0742c618": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_dd49d64d85e24fa8b1b6bc33804fc597", - "IPY_MODEL_993d9d6c6c3942cea4abd0852253257f", - "IPY_MODEL_6dc91b7ebdf041bab30eb87fb25d80cf" - ], - "layout": "IPY_MODEL_92640e149e0640efbf76f5d1c0a69012" - } - }, - "2acd1b83b0364cf0b5be89d058f6277d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_2081108498f544d8b70330a5cf2b33f3", - "placeholder": "​", - "style": "IPY_MODEL_ada3c89be1224ffea01d05a6696977ab", - "value": " 112/112 [00:00<00:00, 2.72kB/s]" - } - }, - "2b3c46c4f2914c809ec948a648fb291e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "2c3b2a634ba147de9014180a70dacc1b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "2c84acd0ade64716a46cc6fa86bc6951": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_d5c6923249b345599fae1f92fbab2681", - "IPY_MODEL_8f35f14c856d4a8994aaca9820e22ec6", - "IPY_MODEL_0d240a2d4bbd40b282dc5a64609672a6" - ], - "layout": "IPY_MODEL_3732cedae3eb4ca89fda08e5467715ee" - } - }, - "2d1a52b80c5a4213a6dc911524663467": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "2e468409dc97440da727a31629f71d1a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "2eaea0dc84ed4ebfba680f2fcfa04637": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_2d1a52b80c5a4213a6dc911524663467", - "max": 65, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_bd967c22dcca4384b1f2ef93792eec5b", - "value": 65 - } - }, - "3027db6a4b5f4b34ad69c5c34681fc97": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "32b677302bf749f8bb437be83cf1a9d2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "32c3cd5ee8dd4ab09011eed21d488ab6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_46b16ac89d734566a2098ba73d31f56b", - "placeholder": "​", - "style": "IPY_MODEL_99ae5a8cceee4c7ab0daeea24cb0c2a5", - "value": "100%" - } - }, - "33a0207a4af444c0a62de263d5772590": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_abf058cbf4d0482eb0b7d3c5cb2dac0c", - "max": 5, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_bd085d626c39431c87272f1775c31725", - "value": 5 - } - }, - "352c9cd723a84d698fe110f0056f756b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_8c59ac47b9ab4b1093a738827bf15261", - "IPY_MODEL_184ac127cfe442a181e9d1135f45d4b9", - "IPY_MODEL_2acd1b83b0364cf0b5be89d058f6277d" - ], - "layout": "IPY_MODEL_af8f72598deb46588804ca1689d32bd3" - } - }, - "3732cedae3eb4ca89fda08e5467715ee": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "38a5ae14a1ed4f248790e722ef07c632": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "38b7e0b568c447079ff87f12e6ba21a0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_18cac2a5cc9a48bdab2a64891fb1f66f", - "max": 53, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_77cd1035f5e94347aa781762a85b6244", - "value": 53 - } - }, - "38e01a43e0424095b0216725223cacc3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_a95f0fe4ce3b424ca87a41b1f678c249", - "max": 13156, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_f40893f97e914de090030cccd9cd0be0", - "value": 13156 - } - }, - "38f92f34bc5b4a658dd2f6fbcaec80f1": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "395756fef94a4599999d43242fb15233": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "39586bcb9c1b4fbca93d05a582209753": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "3a3ccd73339b465ea43741d1edeadd68": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_c511ddfcffae4ea286eabbddcb07bc5e", - "IPY_MODEL_5b93aeeeffcb48ed85bb027905659782", - "IPY_MODEL_ae7311c2f28749a4a191de0455a5378c" - ], - "layout": "IPY_MODEL_3aaa95820770413db9e0e25a53be9d19" - } - }, - "3aaa95820770413db9e0e25a53be9d19": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "3b71a74a8cc84a6ab5ba95795030faba": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_696b1b25f9bb4ff6b3ddc764c690c804", - "placeholder": "​", - "style": "IPY_MODEL_6ff6ee62693b4ce3af2624122d1a7e88", - "value": "Downloading: 100%" - } - }, - "3cb8f213216b4db4b17b6159ff8af1b2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "3e3f7f53c2d949ebbc9b41d2eec97a4b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "3e95e45bdc9147808b25ce2e2b842969": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "3fb6cc95ab404b988cad7d68a28a8b50": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "403a646eafea4a1ea95fab6f6e76d023": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "40c801e68caf4b678ab85afae0ef4423": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_86f9a8016dd741fe84808a5babf042a6", - "placeholder": "​", - "style": "IPY_MODEL_6df44ef8a0a142cca7d6af2bfc067cb6", - "value": " 878k/878k [00:01<00:00, 427kB/s]" - } - }, - "411cf8ff337647fd8c1591faf98610c7": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "4188c72c71db4ecb82e754385003bcf4": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "41ea8e1316d340df99aae24bd8c93969": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_dbbb4af430e04eadae3287109ef79f77", - "IPY_MODEL_38b7e0b568c447079ff87f12e6ba21a0", - "IPY_MODEL_78961bf6ea3c445a86de8c0a9fa60301" - ], - "layout": "IPY_MODEL_c013bf903fbd4af5bfc99bc0abf78996" - } - }, - "420475421b5043dd96330c4d2005e2db": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "4262b30ff3384960ada0f7042955027b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "43346612910e44a6ab4618c90fa27829": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_459e68fba5b84cc88db37198e399de63", - "max": 350, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_f39dec147f404f0b851468d008fec716", - "value": 350 - } - }, - "43cbd67bf5714404b0895a53cedf5fd6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_2925e8f3abb342f9a10e9e78fa152a81", - "IPY_MODEL_71a02d2db9a7422f924c991a48a3ce9c", - "IPY_MODEL_fd3051ae1a27483da9bfaca20612aca5" - ], - "layout": "IPY_MODEL_a192e1868ac1430597d5fcb565b7c632" - } - }, - "44585c198e864e9f86c6c69d466d3031": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "44fe5107721a490c8b5139744d00d6b3": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "45564f8299044b5da17d323762393edb": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "4588c062e290463bac0a5f468fd56c0d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "459e68fba5b84cc88db37198e399de63": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "46091f4e750c47889eb6a1e852267734": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "465a869777814955a2eff4f206bb3c91": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "46b16ac89d734566a2098ba73d31f56b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "47149232a2d640ca97e85f58cc8af710": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "473781ce46bf4bd9acf858135c26c31b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "47727eb57d314f00b035238e90681338": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "47e1eb19e96a481cb5cf3cdab90d87c3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "48e2b645abee40c6b5fcf2586c877f34": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_6926a810d0674b67aaef319fc6457132", - "placeholder": "​", - "style": "IPY_MODEL_761295306fb94ad6a48a52b3dd4f6c4b", - "value": "Downloading: 100%" - } - }, - "499f2cd457cd4b5da95cb3ec2c2eb635": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "4a12f613fa4f4fc0881791941e1c8e0d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_bd9ba4aaae6745dcb6b78effa1c8e937", - "placeholder": "​", - "style": "IPY_MODEL_c4a7299fdc564d09b5c662b2eeec51d1", - "value": "Downloading merges.txt: 100%" - } - }, - "4b9d8d5cbe864468b109aa5abf25d092": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "4cdd9588dc4f493ea45fae1da13d1d31": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_d030c4d6f5914aa5a437c53b52e01ea9", - "max": 231508, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_1178f617fe0042c3876a9006de9a1d53", - "value": 231508 - } - }, - "4d6ec2b0c2bc435e9d3fcbdff951b29b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "4df39113ca2043258a34afe304f3d9d2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_b0202f326ca64676a4b9e2333edf2533", - "placeholder": "​", - "style": "IPY_MODEL_b74e13ff83d148f3898ab00cec0ea79e", - "value": " 13.2k/13.2k [00:00<00:00, 404kB/s]" - } - }, - "4fc06fe12e514785a121c7ae1b9e0c97": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "505d2e0776f9413d9e65233a8c7a3ce0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "506e50b472fc48718c2e43b843ca56f7": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "509bafaa375041d4b001bacce41a5318": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "50a500aedb6347b9b193bc9d2d544647": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "52b1066a90f24f3a89b56702c5d67fd6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_3b71a74a8cc84a6ab5ba95795030faba", - "IPY_MODEL_cb267211536c4106a41b588fa2213296", - "IPY_MODEL_91118756833249068ba8c266b98fe113" - ], - "layout": "IPY_MODEL_86d75ca4676b4db6871a9881611d8c0a" - } - }, - "52ec7cde15c54517800202fea56f6f9b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "5671ca67fe5347dc9ce8d78bdc84f147": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "57d028e4b6204017bf158df49b358d48": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "57f258f537b548ae9f6f7a4f7e6a0078": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_dd4bd7681c8b44a2b7162b365948b8bd", - "max": 5, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_0fd482518b9f4859866abc02b3f98f94", - "value": 5 - } - }, - "5821fd6e83244dc69f06caf1c69420df": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_717b5278234d44b3acd04dc27a31dfe2", - "placeholder": "​", - "style": "IPY_MODEL_509bafaa375041d4b001bacce41a5318", - "value": " 350/350 [00:00<00:00, 14.0kB/s]" - } - }, - "583071c719374ee996e4c7d254890412": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "589d76442a81446f81ff107f0449ef35": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "5901aeb5d1e24779952c96b8263e62a0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "592526530ec44c1886774b8ddbd9306a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_45564f8299044b5da17d323762393edb", - "max": 116, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_3027db6a4b5f4b34ad69c5c34681fc97", - "value": 116 - } - }, - "593c169dfbf345629433470655a325d1": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "5b93aeeeffcb48ed85bb027905659782": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_e53e65e6566d41aba1ae11474fd534ba", - "max": 90888945, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_6f380f1159304891bb0e77a369c8f5e9", - "value": 90888945 - } - }, - "5c475d1892c94592b7398bc028439f7a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_ba73900d058346d49be5dca064b5e663", - "placeholder": "​", - "style": "IPY_MODEL_e6efec28608d40d1806a247484911a6d", - "value": "Downloading: 100%" - } - }, - "5d8af77774244f15a0b53a5a5498c61b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_203a6cc968e944c6b70c10e574370b92", - "placeholder": "​", - "style": "IPY_MODEL_e7be1952f3234c38adc44db5d30684b4", - "value": " 116/116 [00:00<00:00, 3.56kB/s]" - } - }, - "5e161921a5b547fbb813dedff389dc31": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_6ef6110defb94222863e8e996095d917", - "IPY_MODEL_69ec9cf67095408a9fa7b90b5d0f1402", - "IPY_MODEL_8ca63df694944110b2e324c1f8bf2664" - ], - "layout": "IPY_MODEL_6860a13715bd4749866ce60e6c186ca4" - } - }, - "5ed062448c2149d1b83d037bd4570aad": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "5f70a433d78f4d7494af38d6cb103845": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_c53fd5527ead4008b3f00a323a391b41", - "max": 1154, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_00b59754edd24f61a38ea1ed4f1aa077", - "value": 1154 - } - }, - "60099a13723c4e1c97b4eeb6909faf64": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_44585c198e864e9f86c6c69d466d3031", - "placeholder": "​", - "style": "IPY_MODEL_af16e2ef100240498a1cec6c85719307", - "value": " 5/5 [00:00<00:00, 11.14ba/s]" - } - }, - "60fe343d068a47a7b64090d7c38bdf5a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "61482c60ad804e2fb3e195b9c3daf54e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "615e006f120643e68ed890a78766c9e2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_669341ce6b2e4aa3b14d33110b236c9c", - "max": 2, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_32b677302bf749f8bb437be83cf1a9d2", - "value": 2 - } - }, - "61dd26d4ee6a42c5a9f0d5e5f1748633": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "61f5ce18c63a428194767ea7a9bc8c6f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "62cfc810ac124d2e801c0166c4cc49a8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "62fd3930106f4355871cee9397fec8cf": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "64568851a9ce44d1bb791bf2b8a4c4ae": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_9fbf6b3450724f188a4aeccd325f1b4a", - "placeholder": "​", - "style": "IPY_MODEL_b044b4d34a2a42ed81212cc5c5e401ea", - "value": "100%" - } - }, - "65c2905bddb9483cbe58b3711dfb400e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_ccdd150660704acaa0e5bae0e44d8566", - "IPY_MODEL_091fcb8d2a714647a2ece136d3ffeb07", - "IPY_MODEL_e5221be381054945a6e4c507799f88a7" - ], - "layout": "IPY_MODEL_fef3a407898f44798e08baf4a27f5fcb" - } - }, - "669341ce6b2e4aa3b14d33110b236c9c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "6789e4b00123408386fad863dc4ff235": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "67eff42814534eae9adbeab6ceeb14cb": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_15d67358fa8242faae6b0eca661afcbf", - "IPY_MODEL_99fc1a725e834ae78d73c65412b7fe7a", - "IPY_MODEL_c1ca50f6ee3b42c2a993e8c58f1900f3" - ], - "layout": "IPY_MODEL_00311803314143ecbb24e25acbb94f66" - } - }, - "6860a13715bd4749866ce60e6c186ca4": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "6877960084d644908dcd99df7fde80db": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_8a0735f52b9c4f949897b336c80766bc", - "IPY_MODEL_fa0a76c3235948c1a26ae247a37fd02a", - "IPY_MODEL_e23a1b561a4442adb4b7aab8fd862b9c" - ], - "layout": "IPY_MODEL_fbc30ecadc1241089bc9928439a8daee" - } - }, - "68e79e7d3f644a64b1e9a6b965b9873d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_885205ed837d43ac9dd9685cb0cb1779", - "placeholder": "​", - "style": "IPY_MODEL_e489fa3983a54d4aa24fd5fc7c3c0398", - "value": " 10.6k/10.6k [00:00<00:00, 308kB/s]" - } - }, - "6926a810d0674b67aaef319fc6457132": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "696b1b25f9bb4ff6b3ddc764c690c804": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "69ec9cf67095408a9fa7b90b5d0f1402": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_e7283168055b48acb94cf69be4ee57fd", - "max": 483, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_f9afd1d342804aca92854daed877309c", - "value": 483 - } - }, - "6ad218f38bae4a0db5557c334d03c14b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "6b92e4f8e8914c9098eeb35e2daf2882": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "6ba1a277d3c74922975166c8578cb552": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_c883626d4ab54836831f016aee1a3b3a", - "placeholder": "​", - "style": "IPY_MODEL_a8e558bade474b4ea205d1fe31519cd6", - "value": " 2/2 [00:00<00:00, 4.94ba/s]" - } - }, - "6d477c6ce2fd4e83913ac7fd0eae45dd": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_c6837ff9f2f04351b5dc0dd7cb7452a9", - "placeholder": "​", - "style": "IPY_MODEL_a6e08cd785a9445798047aab9a9c5af8", - "value": " 65/65 [00:01<00:00, 62.12ba/s]" - } - }, - "6dc91b7ebdf041bab30eb87fb25d80cf": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_fee2373861754a5aa57deca0fe0a549f", - "placeholder": "​", - "style": "IPY_MODEL_62cfc810ac124d2e801c0166c4cc49a8", - "value": " 2/2 [00:00<00:00, 6.97ba/s]" - } - }, - "6dd9fea4b17f4b3ab425bd27dd36fc6e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "6df44ef8a0a142cca7d6af2bfc067cb6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "6e6899d861c84ad388b49f3ad6488ed7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_28eab6f7e43848fcae1d568a26083a55", - "placeholder": "​", - "style": "IPY_MODEL_4588c062e290463bac0a5f468fd56c0d", - "value": "Downloading: 100%" - } - }, - "6e710b3d2d94441c805bfaf194bd6228": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "6ef6110defb94222863e8e996095d917": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_cd8230629dc94c56b5eb1260cff145a0", - "placeholder": "​", - "style": "IPY_MODEL_0c8d5caa32624d3e950372123ea76085", - "value": "Downloading config.json: 100%" - } - }, - "6f380f1159304891bb0e77a369c8f5e9": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "6f75d8f4973b4190971e31114659357f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_ca23d08401e14f0ea2f26b30474cd851", - "IPY_MODEL_141b59a274af4e12987648aad7c1c0a9", - "IPY_MODEL_0df5ec008faf4097863467f9fa482d92" - ], - "layout": "IPY_MODEL_c2edb8c2fa8c4b448bb1c606ec89ec75" - } - }, - "6ff6ee62693b4ce3af2624122d1a7e88": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "7017cacda2dc4e72971a437d0a2a028c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "701c8174d1ea43cfa251c81708f1fc77": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_c458935ca1564885b1195ad72beed0f6", - "placeholder": "​", - "style": "IPY_MODEL_7351dbf107194d1f9ed9d263dfe62f2c", - "value": " 1.52G/1.52G [01:02<00:00, 6.85MB/s]" - } - }, - "70d5e293d0a343ee813f8a5d57dcfd2d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_7b7f296ea45d40aba5537caa21c47bf3", - "IPY_MODEL_ff61a61119094626a738050955793c39", - "IPY_MODEL_701c8174d1ea43cfa251c81708f1fc77" - ], - "layout": "IPY_MODEL_064dca1b1b824a908647633e4f72f71b" - } - }, - "717b5278234d44b3acd04dc27a31dfe2": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "71a02d2db9a7422f924c991a48a3ce9c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_7e7c9bdd6daa4d10b024d99e64e05ea6", - "max": 1, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_0befa271378e45059b91035558802962", - "value": 1 - } - }, - "724e61cdd8074ae99517fae53bc06854": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_0edf2e575f3347f287a964f4e1f3fc49", - "placeholder": "​", - "style": "IPY_MODEL_0d15af1100e1498bbcc991f5b78adc59", - "value": "100%" - } - }, - "726446afcb2d42d7b8f806631dfbeb61": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "7269518d12b24e2c95b5eb45d1aa88af": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_982b01ca4ba14504934ee6e440ad019f", - "IPY_MODEL_f375cf9a3bc343c6958a2a20b9b6b096", - "IPY_MODEL_c663b01bc6c540ffab55a0a0e84fb027" - ], - "layout": "IPY_MODEL_e0d677c6cf6c40eeb8e7fd769b8b9020" - } - }, - "72d1f3de89dc45b3ad3dbfa93184f757": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_bfeace42248941eaad5251bcee579dde", - "max": 456318, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_465a869777814955a2eff4f206bb3c91", - "value": 456318 - } - }, - "7351dbf107194d1f9ed9d263dfe62f2c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "7451eb4fc5d548b6bd6bf146533ca049": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_499f2cd457cd4b5da95cb3ec2c2eb635", - "placeholder": "​", - "style": "IPY_MODEL_afee60b7de804dd2bbbece6125975782", - "value": "100%" - } - }, - "74762ff37b2a4d828633630af1ed1ecb": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "74cfe3c0a87d46b6a7254c9fabc0e3a4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_403a646eafea4a1ea95fab6f6e76d023", - "max": 5, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_87091c179a7541c6b3584b0b02789a50", - "value": 5 - } - }, - "75e2ce0c1d814f3eb0cbe57cd6caf3b6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "75eaa88df13247d2a326f1216d68918e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "761295306fb94ad6a48a52b3dd4f6c4b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "77cd1035f5e94347aa781762a85b6244": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "7859b4f0ccff4091a7d7b28c0ea795fd": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_ad04758f764b4f3dbb71bd7822085f53", - "IPY_MODEL_4cdd9588dc4f493ea45fae1da13d1d31", - "IPY_MODEL_fa7ed39b1e6244ef809f6a8875e66836" - ], - "layout": "IPY_MODEL_75eaa88df13247d2a326f1216d68918e" - } - }, - "78961bf6ea3c445a86de8c0a9fa60301": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_1f8047295eff40b19f0a976e67f98c3a", - "placeholder": "​", - "style": "IPY_MODEL_90202f1772e04b4ead3ff10a6e7ed150", - "value": " 53.0/53.0 [00:00<00:00, 1.37kB/s]" - } - }, - "79fc0fde09ff419bb70cd4fcf60166bd": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "7b10b5954a0f45fa8435e4255a208d49": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "7b26397bea754aaeb2e7c60852f182e4": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "7b5019ea704940c9abb4fc87f7556e43": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "7b7f296ea45d40aba5537caa21c47bf3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_4188c72c71db4ecb82e754385003bcf4", - "placeholder": "​", - "style": "IPY_MODEL_b0d7fc82ccb34ed5b45448d581bf2727", - "value": "Downloading pytorch_model.bin: 100%" - } - }, - "7ca61d692c464aa48568b65d63c86e36": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "7cfddd8a70ab4ba98dddcc7e42b491a8": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "7d0fcbb785544e5cb5e8dd2ae7aa1f98": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "7d9ac315f1614932985252e878fd53ef": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "7e7c9bdd6daa4d10b024d99e64e05ea6": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "7f74e439781b403089ad377dd50c658e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_df9a7621df924d88b3c65ba841f1be41", - "IPY_MODEL_feed20df83614d89ad29099b05c32a84", - "IPY_MODEL_23fbeb7bd6a345dcae57aa2807c05fb2" - ], - "layout": "IPY_MODEL_411cf8ff337647fd8c1591faf98610c7" - } - }, - "80f9504c61574e52ab1d4adcc62d62a6": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "812345908d9c456b892444c0b98cae07": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_32c3cd5ee8dd4ab09011eed21d488ab6", - "IPY_MODEL_57f258f537b548ae9f6f7a4f7e6a0078", - "IPY_MODEL_1a4d202a3564477cb941ecf2c69e3a33" - ], - "layout": "IPY_MODEL_0b3b964e02a546b4aedd07d27135d031" - } - }, - "823eb9fed415468fb18776f13a899991": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "8373feff24314cb694208947a8738fe5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "841cb44b752d47c2a21e4c663da38048": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "844ba52e1f6947f790fe4add513e398a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_80f9504c61574e52ab1d4adcc62d62a6", - "max": 312, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_5671ca67fe5347dc9ce8d78bdc84f147", - "value": 312 - } - }, - "85f350e4537f422bbc436500fcdb0f40": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_7451eb4fc5d548b6bd6bf146533ca049", - "IPY_MODEL_cc0f395961ef4078941ee410aad3d010", - "IPY_MODEL_0a1bd69095c54b25b1641114bcc4d932" - ], - "layout": "IPY_MODEL_9524aa31300a4c8d9bb85cf04fe94f58" - } - }, - "86d75ca4676b4db6871a9881611d8c0a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "86f9a8016dd741fe84808a5babf042a6": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "87091c179a7541c6b3584b0b02789a50": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "885205ed837d43ac9dd9685cb0cb1779": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "88b1b4ec2b4845e2a421a88fd4d3f2ca": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "89e36db6c06b42b9891fcd33e5041677": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "89fa8071833c4955b78bb6f8ddfcd4f3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "8a0735f52b9c4f949897b336c80766bc": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_61dd26d4ee6a42c5a9f0d5e5f1748633", - "placeholder": "​", - "style": "IPY_MODEL_b7e14c0716ec42dd9bc8705202998881", - "value": "Downloading pytorch_model.bin: 100%" - } - }, - "8c04349225674a9691eb9956b383f393": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "8c2e4b1aef0643079e6d074c7b3df700": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "8c59ac47b9ab4b1093a738827bf15261": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_f75815ed31734a98aff984b195c71ca5", - "placeholder": "​", - "style": "IPY_MODEL_8c04349225674a9691eb9956b383f393", - "value": "Downloading: 100%" - } - }, - "8ca63df694944110b2e324c1f8bf2664": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_395756fef94a4599999d43242fb15233", - "placeholder": "​", - "style": "IPY_MODEL_7ca61d692c464aa48568b65d63c86e36", - "value": " 483/483 [00:00<00:00, 6.90kB/s]" - } - }, - "8ce831be076d4a0aaeac2dea7f74571c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "8d672c5dd2394accb419b50af6369d8a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_a9a18ba5036c4957a11bfcccaa2bcbea", - "IPY_MODEL_b6e0555332d04740b5724ced980fb823", - "IPY_MODEL_d692a6ab5155487eb74e0c529e18dace" - ], - "layout": "IPY_MODEL_cb4d69702f514e5688aaed4e0cb2d68e" - } - }, - "8db5f342b5384702b5151f3b322c440d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_fb6db763317e4bbda9cba708c654d63b", - "IPY_MODEL_998eda4a96db48e3812e5abc99efaabe", - "IPY_MODEL_c8a74725ae254744b8a186455e829510" - ], - "layout": "IPY_MODEL_8373feff24314cb694208947a8738fe5" - } - }, - "8e092557c85b4112b493f0abbcd00835": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "8e7db1dd82b5406e9c1b1699dc43b6dd": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "8eac561ce34a49ab8c55e44d1a7ada05": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "8ec05331ade54131a517c23402fa631b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_6e6899d861c84ad388b49f3ad6488ed7", - "IPY_MODEL_cd40c48954164c04a1c3ca2f21a0a93a", - "IPY_MODEL_f733c4422f064d8baf9e1d4537185011" - ], - "layout": "IPY_MODEL_afdd3ead171c4a1a88b912d5605a8ac3" - } - }, - "8f35f14c856d4a8994aaca9820e22ec6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_47727eb57d314f00b035238e90681338", - "max": 612, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_39586bcb9c1b4fbca93d05a582209753", - "value": 612 - } - }, - "8f3f3bc6709340cb8256a29186d167ca": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_3e3f7f53c2d949ebbc9b41d2eec97a4b", - "placeholder": "​", - "style": "IPY_MODEL_61482c60ad804e2fb3e195b9c3daf54e", - "value": "100%" - } - }, - "90202f1772e04b4ead3ff10a6e7ed150": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "90d526066e8c4987a16cbcf7e01c1038": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "91118756833249068ba8c266b98fe113": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_1906621155644db484bfe4d4fe07ce12", - "placeholder": "​", - "style": "IPY_MODEL_61f5ce18c63a428194767ea7a9bc8c6f", - "value": " 190/190 [00:00<00:00, 6.53kB/s]" - } - }, - "92640e149e0640efbf76f5d1c0a69012": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "943cc95dedf842a09a12e422c28c70f0": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "9524aa31300a4c8d9bb85cf04fe94f58": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "962e5812ab924251b94c65ed1d6689db": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "9637b86b7807491a84098c2114e691df": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "9688dd1f639a4c0680ad9a9c983e3447": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "96e1dc646e07413cb3d2de813ace9557": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_e59c0e8b62654e89af549065e81c566d", - "IPY_MODEL_09ea5fdae5eb49fd898d7d9f027a5785", - "IPY_MODEL_b3aac4c5435e475aba0d006367212b54" - ], - "layout": "IPY_MODEL_fd58814a4c97441d911481a3b810d555" - } - }, - "982b01ca4ba14504934ee6e440ad019f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_0d1dc7e37a7441079a9955a166d0c46d", - "placeholder": "​", - "style": "IPY_MODEL_f4143e675e7543a9af0bd70636306db6", - "value": "Downloading tokenizer.json: 100%" - } - }, - "993d9d6c6c3942cea4abd0852253257f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_099e5c754c404468a90fb9247cc0bbdc", - "max": 2, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_962e5812ab924251b94c65ed1d6689db", - "value": 2 - } - }, - "998eda4a96db48e3812e5abc99efaabe": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_5ed062448c2149d1b83d037bd4570aad", - "max": 28, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_f0556ff087614accad129c6ca7ee9ed8", - "value": 28 - } - }, - "99ae5a8cceee4c7ab0daeea24cb0c2a5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "99fc1a725e834ae78d73c65412b7fe7a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_cf0e6cab40e548dc9b972aa7d8986559", - "max": 312, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_7b5019ea704940c9abb4fc87f7556e43", - "value": 312 - } - }, - "9b1a721fdb7e4341b9f4537d009d0abe": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "9b338a9cc78a4c8196e2e0f0e34be824": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "9b6a0849f182474c88493b24657e5103": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "9b8788d6cf47462c8b693a6bbf0de0e3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_6789e4b00123408386fad863dc4ff235", - "placeholder": "​", - "style": "IPY_MODEL_5901aeb5d1e24779952c96b8263e62a0", - "value": " 39.3k/39.3k [00:00<00:00, 618kB/s]" - } - }, - "9b8bc0251d4e422587c993e0935d846e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "9ba3ea34fde448a2a478524403cc8038": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_7b26397bea754aaeb2e7c60852f182e4", - "max": 26, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_ba0e140e43614be3a776cb929ed8d5bb", - "value": 26 - } - }, - "9bcd120e350a415fabd76b387730e2ef": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "9ccad851f5ec43cabe766cd13bfd594f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_a567b6bc200349a392136a8c544448b5", - "IPY_MODEL_cb1aeeb006bc475e99ba806bf8624566", - "IPY_MODEL_9b8788d6cf47462c8b693a6bbf0de0e3" - ], - "layout": "IPY_MODEL_fcb348895f0243958ce39af66638433e" - } - }, - "9fbf6b3450724f188a4aeccd325f1b4a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "a04fbcff413a4775b5e0476618069995": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "a0bddffbbc794534bd008fb8bbc31153": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_dcee270b34da412fa65ebeffdfa75f66", - "IPY_MODEL_844ba52e1f6947f790fe4add513e398a", - "IPY_MODEL_a5ffca33779d4dfca4e7aa8c6780c88a" - ], - "layout": "IPY_MODEL_225b0156f4354ab0a5df66a2d58017d6" - } - }, - "a145ccc5ad3440309655bdc56ed329d5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_48e2b645abee40c6b5fcf2586c877f34", - "IPY_MODEL_a930ad54c6d542f4846a38a75ba0dbca", - "IPY_MODEL_68e79e7d3f644a64b1e9a6b965b9873d" - ], - "layout": "IPY_MODEL_79fc0fde09ff419bb70cd4fcf60166bd" - } - }, - "a1910eeb981144dca95cf8e6dda49eb4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_4a12f613fa4f4fc0881791941e1c8e0d", - "IPY_MODEL_72d1f3de89dc45b3ad3dbfa93184f757", - "IPY_MODEL_e91cb5eb1a894209b3599ba5eb3f215d" - ], - "layout": "IPY_MODEL_8e7db1dd82b5406e9c1b1699dc43b6dd" - } - }, - "a192e1868ac1430597d5fcb565b7c632": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "a388d930425f462d831235f5f1f01d5a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "a5544445e9a04406bfe2185f53bfa799": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "a567b6bc200349a392136a8c544448b5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_3e95e45bdc9147808b25ce2e2b842969", - "placeholder": "​", - "style": "IPY_MODEL_223f257b5927425ea2793ff78a60a591", - "value": "Downloading: 100%" - } - }, - "a5ffca33779d4dfca4e7aa8c6780c88a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_cb9672f222594a2ca19b89b286da2bed", - "placeholder": "​", - "style": "IPY_MODEL_7b10b5954a0f45fa8435e4255a208d49", - "value": " 312/312 [00:04<00:00, 74.04ba/s]" - } - }, - "a623fa5f4e16419f99f40f8837228e7e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "a6556e2718524752b34217ff63a9fc4d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_64568851a9ce44d1bb791bf2b8a4c4ae", - "IPY_MODEL_74cfe3c0a87d46b6a7254c9fabc0e3a4", - "IPY_MODEL_c60da4ac32f448c886b571de6f37a76b" - ], - "layout": "IPY_MODEL_059dc7a7910e447cb50d06979bdbf539" - } - }, - "a6e08cd785a9445798047aab9a9c5af8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "a7f0da2b16144f4bb8d6eadc63dc8cb6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "a8983ba16a794aad8271b7d69a81b3ad": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_d7d032ad620448f2b18e6c4c06c7154f", - "placeholder": "​", - "style": "IPY_MODEL_fefec331bdc5456498084257b45a03b6", - "value": " 1.13k/1.13k [00:00<00:00, 29.2kB/s]" - } - }, - "a8e558bade474b4ea205d1fe31519cd6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "a930ad54c6d542f4846a38a75ba0dbca": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_e04f5119ee654401942c040b0ede110b", - "max": 10610, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_9b1a721fdb7e4341b9f4537d009d0abe", - "value": 10610 - } - }, - "a95f0fe4ce3b424ca87a41b1f678c249": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "a9a18ba5036c4957a11bfcccaa2bcbea": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_e7af31e46e174ea6b2a1a168784269d0", - "placeholder": "​", - "style": "IPY_MODEL_6e710b3d2d94441c805bfaf194bd6228", - "value": "Downloading: 100%" - } - }, - "ab70f467b69a47349a1c5d3839b884b9": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "abf058cbf4d0482eb0b7d3c5cb2dac0c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "ad04758f764b4f3dbb71bd7822085f53": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_823eb9fed415468fb18776f13a899991", - "placeholder": "​", - "style": "IPY_MODEL_05d19b34fe2e49b5b2076627e73288f5", - "value": "Downloading vocab.txt: 100%" - } - }, - "ada3c89be1224ffea01d05a6696977ab": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "ae7311c2f28749a4a191de0455a5378c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_d76596c02a514829b97a4a025e15e0a6", - "placeholder": "​", - "style": "IPY_MODEL_7d9ac315f1614932985252e878fd53ef", - "value": " 90.9M/90.9M [00:01<00:00, 59.8MB/s]" - } - }, - "af16e2ef100240498a1cec6c85719307": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "af8f72598deb46588804ca1689d32bd3": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "afdd3ead171c4a1a88b912d5605a8ac3": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "afee60b7de804dd2bbbece6125975782": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "b0202f326ca64676a4b9e2333edf2533": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "b044b4d34a2a42ed81212cc5c5e401ea": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "b0d7fc82ccb34ed5b45448d581bf2727": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "b187b12607ce49419f849fa1d1fcab8c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "b361bfc331fb42a7ab25522003c63f06": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "b3aac4c5435e475aba0d006367212b54": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_2b3c46c4f2914c809ec948a648fb291e", - "placeholder": "​", - "style": "IPY_MODEL_1bd452a69f6f408182343235b5f74435", - "value": " 349/349 [00:00<00:00, 10.6kB/s]" - } - }, - "b560f1a23b664f19b3025e200ee52ba2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_8f3f3bc6709340cb8256a29186d167ca", - "IPY_MODEL_33a0207a4af444c0a62de263d5772590", - "IPY_MODEL_60099a13723c4e1c97b4eeb6909faf64" - ], - "layout": "IPY_MODEL_1369dd9f01474e18ad1d1f0cec6cb77a" - } - }, - "b5709e8c44fa41da92ce6553466c4781": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "b6e0555332d04740b5724ced980fb823": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_22dd156738a64b1d9c36306ade52a9df", - "max": 466247, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_f9c813702cbd43a8a7756f9925b8e091", - "value": 466247 - } - }, - "b74e13ff83d148f3898ab00cec0ea79e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "b7e14c0716ec42dd9bc8705202998881": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "b85ea9918cea4475a7dcf968114a5537": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "ba0e140e43614be3a776cb929ed8d5bb": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "ba73900d058346d49be5dca064b5e663": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "babdfdcf27714853ae2be7ea4e7d0713": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "bcad04bb62194a10a94f1317a1292ead": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_4262b30ff3384960ada0f7042955027b", - "max": 898822, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_589d76442a81446f81ff107f0449ef35", - "value": 898822 - } - }, - "bd085d626c39431c87272f1775c31725": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "bd967c22dcca4384b1f2ef93792eec5b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "bd9ba4aaae6745dcb6b78effa1c8e937": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "bdcc9a7699f040f68fd3ce7e85dcce5c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "bec6ddd26c264fc1b85869d3f84df41d": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "bfd22ee5ae88497cb077f75071249dde": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "bfeace42248941eaad5251bcee579dde": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "c013bf903fbd4af5bfc99bc0abf78996": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "c1ca50f6ee3b42c2a993e8c58f1900f3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_3fb6cc95ab404b988cad7d68a28a8b50", - "placeholder": "​", - "style": "IPY_MODEL_d10cf159a50646d6a376fa65e6042589", - "value": " 312/312 [00:08<00:00, 39.55ba/s]" - } - }, - "c220518979d74b8c9089ffc8fb62ca04": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "c2edb8c2fa8c4b448bb1c606ec89ec75": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "c315d91e15f34eeaa4ee955f88e86285": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "c42d01f933044313b2860cabae5ce5ee": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_cbd8a118b2904c4a88c0c93abea26d44", - "placeholder": "​", - "style": "IPY_MODEL_38a5ae14a1ed4f248790e722ef07c632", - "value": "Downloading vocab.json: 100%" - } - }, - "c458935ca1564885b1195ad72beed0f6": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "c4a7299fdc564d09b5c662b2eeec51d1": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "c510dfd747254a1588b761a3fdde091d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "c511ddfcffae4ea286eabbddcb07bc5e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_8eac561ce34a49ab8c55e44d1a7ada05", - "placeholder": "​", - "style": "IPY_MODEL_420475421b5043dd96330c4d2005e2db", - "value": "Downloading: 100%" - } - }, - "c53fd5527ead4008b3f00a323a391b41": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "c5a0e59e0ec14d53a655c8f087c3c071": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "c60da4ac32f448c886b571de6f37a76b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_583071c719374ee996e4c7d254890412", - "placeholder": "​", - "style": "IPY_MODEL_ff630cfd369b4f3892eb32d0df84a0db", - "value": " 5/5 [00:00<00:00, 9.24ba/s]" - } - }, - "c663b01bc6c540ffab55a0a0e84fb027": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_eebda1a16e4b4a4783a1da98f2d1a2f6", - "placeholder": "​", - "style": "IPY_MODEL_10ad0b729d7a403198a35900081f1108", - "value": " 455k/455k [00:00<00:00, 824kB/s]" - } - }, - "c6837ff9f2f04351b5dc0dd7cb7452a9": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "c75799c0da57418fb2beceede73ba46b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_f4e15b7446214c6f86cb0095711fe9f2", - "IPY_MODEL_9ba3ea34fde448a2a478524403cc8038", - "IPY_MODEL_c9ec17636a764edab3bb01eda508dca3" - ], - "layout": "IPY_MODEL_a5544445e9a04406bfe2185f53bfa799" - } - }, - "c883626d4ab54836831f016aee1a3b3a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "c8a74725ae254744b8a186455e829510": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_6dd9fea4b17f4b3ab425bd27dd36fc6e", - "placeholder": "​", - "style": "IPY_MODEL_52ec7cde15c54517800202fea56f6f9b", - "value": " 28.0/28.0 [00:00<00:00, 252B/s]" - } - }, - "c8ee1ad0025148138522d1f3d35a01cf": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "c9ec17636a764edab3bb01eda508dca3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_1ec9d7b1c71a440db6089c6539f680a3", - "placeholder": "​", - "style": "IPY_MODEL_fbef18bdfa234ff8b17413b096029fb8", - "value": " 26.0/26.0 [00:00<00:00, 419B/s]" - } - }, - "ca23d08401e14f0ea2f26b30474cd851": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_88b1b4ec2b4845e2a421a88fd4d3f2ca", - "placeholder": "​", - "style": "IPY_MODEL_d5d0343c5f044627a9eb7831abb65756", - "value": "Downloading: 100%" - } - }, - "cb1aeeb006bc475e99ba806bf8624566": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_841cb44b752d47c2a21e4c663da38048", - "max": 39265, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_d53e5b8834ec494c998ba9342ae1c6e1", - "value": 39265 - } - }, - "cb267211536c4106a41b588fa2213296": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_9bcd120e350a415fabd76b387730e2ef", - "max": 190, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_50a500aedb6347b9b193bc9d2d544647", - "value": 190 - } - }, - "cb4d69702f514e5688aaed4e0cb2d68e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "cb9672f222594a2ca19b89b286da2bed": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "cbd8a118b2904c4a88c0c93abea26d44": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "cc0f395961ef4078941ee410aad3d010": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_f072a260238d44aba5746762092530cb", - "max": 1, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_473781ce46bf4bd9acf858135c26c31b", - "value": 1 - } - }, - "cc4705d0575944adbc0987368d3e49ca": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "ccdd150660704acaa0e5bae0e44d8566": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_9637b86b7807491a84098c2114e691df", - "placeholder": "​", - "style": "IPY_MODEL_28c6d8a464d4483eb8abae01f4cf14db", - "value": "Downloading tokenizer.json: 100%" - } - }, - "cd40c48954164c04a1c3ca2f21a0a93a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_00bddf74632a484b929d238afc51c81e", - "max": 231508, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_2c3b2a634ba147de9014180a70dacc1b", - "value": 231508 - } - }, - "cd8230629dc94c56b5eb1260cff145a0": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "cf0e6cab40e548dc9b972aa7d8986559": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "cfe231dfa61e4d2fb55d28535bde9dc4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "d030c4d6f5914aa5a437c53b52e01ea9": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "d066e40caa1b4a5590496a2aeb9dcea8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_d70e851f6f7b43a38559aa4d3a5b6c84", - "IPY_MODEL_615e006f120643e68ed890a78766c9e2", - "IPY_MODEL_6ba1a277d3c74922975166c8578cb552" - ], - "layout": "IPY_MODEL_7cfddd8a70ab4ba98dddcc7e42b491a8" - } - }, - "d10cf159a50646d6a376fa65e6042589": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "d360844c59b849e1807a0f2b3019fd8a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "d413bf53515b4cc5ac81b444f15fd19c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "d53e5b8834ec494c998ba9342ae1c6e1": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "d5c6923249b345599fae1f92fbab2681": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_60fe343d068a47a7b64090d7c38bdf5a", - "placeholder": "​", - "style": "IPY_MODEL_6ad218f38bae4a0db5557c334d03c14b", - "value": "Downloading: 100%" - } - }, - "d5d0343c5f044627a9eb7831abb65756": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "d68fc2f69eaf48bf905e133be2bc82f1": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_9688dd1f639a4c0680ad9a9c983e3447", - "max": 65, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_bdcc9a7699f040f68fd3ce7e85dcce5c", - "value": 65 - } - }, - "d692a6ab5155487eb74e0c529e18dace": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_47149232a2d640ca97e85f58cc8af710", - "placeholder": "​", - "style": "IPY_MODEL_2044594efdf34fcf8d1a84ad027885eb", - "value": " 466k/466k [00:00<00:00, 876kB/s]" - } - }, - "d70e851f6f7b43a38559aa4d3a5b6c84": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_ec079ac635894ee2a7ebe1315129fc74", - "placeholder": "​", - "style": "IPY_MODEL_11ab378d7c254c64a910872ea18d7e27", - "value": "100%" - } - }, - "d7207b39009a4219bd76e13063f6bee9": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "d76596c02a514829b97a4a025e15e0a6": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "d7d032ad620448f2b18e6c4c06c7154f": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "d98808d12cdc4bfc8f5423f8cdbba476": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "daf1284fcd1c45bc9bb3f430544db154": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "dbbb4af430e04eadae3287109ef79f77": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_b85ea9918cea4475a7dcf968114a5537", - "placeholder": "​", - "style": "IPY_MODEL_47e1eb19e96a481cb5cf3cdab90d87c3", - "value": "Downloading: 100%" - } - }, - "dcee270b34da412fa65ebeffdfa75f66": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_8e092557c85b4112b493f0abbcd00835", - "placeholder": "​", - "style": "IPY_MODEL_b5709e8c44fa41da92ce6553466c4781", - "value": "100%" - } - }, - "dd49d64d85e24fa8b1b6bc33804fc597": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_bfd22ee5ae88497cb077f75071249dde", - "placeholder": "​", - "style": "IPY_MODEL_27d41f8299cb473180149d8504862c09", - "value": "100%" - } - }, - "dd4bd7681c8b44a2b7162b365948b8bd": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "df9a7621df924d88b3c65ba841f1be41": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_9b338a9cc78a4c8196e2e0f0e34be824", - "placeholder": "​", - "style": "IPY_MODEL_89e36db6c06b42b9891fcd33e5041677", - "value": "100%" - } - }, - "e04f5119ee654401942c040b0ede110b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "e0d677c6cf6c40eeb8e7fd769b8b9020": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "e23a1b561a4442adb4b7aab8fd862b9c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_bec6ddd26c264fc1b85869d3f84df41d", - "placeholder": "​", - "style": "IPY_MODEL_75e2ce0c1d814f3eb0cbe57cd6caf3b6", - "value": " 256M/256M [00:09<00:00, 26.3MB/s]" - } - }, - "e2c6f05a6875492b9a958e693629145a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_b187b12607ce49419f849fa1d1fcab8c", - "placeholder": "​", - "style": "IPY_MODEL_a7f0da2b16144f4bb8d6eadc63dc8cb6", - "value": "Downloading: 100%" - } - }, - "e489fa3983a54d4aa24fd5fc7c3c0398": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "e4c457574310465bbe2175c04874e996": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_c42d01f933044313b2860cabae5ce5ee", - "IPY_MODEL_bcad04bb62194a10a94f1317a1292ead", - "IPY_MODEL_40c801e68caf4b678ab85afae0ef4423" - ], - "layout": "IPY_MODEL_d98808d12cdc4bfc8f5423f8cdbba476" - } - }, - "e5221be381054945a6e4c507799f88a7": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_0af9681c674541f5874c3eb7f1798ac4", - "placeholder": "​", - "style": "IPY_MODEL_c315d91e15f34eeaa4ee955f88e86285", - "value": " 1.29M/1.29M [00:00<00:00, 2.74MB/s]" - } - }, - "e53e65e6566d41aba1ae11474fd534ba": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "e59c0e8b62654e89af549065e81c566d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_cc4705d0575944adbc0987368d3e49ca", - "placeholder": "​", - "style": "IPY_MODEL_74762ff37b2a4d828633630af1ed1ecb", - "value": "Downloading: 100%" - } - }, - "e6efec28608d40d1806a247484911a6d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "e6fa423db2cd4a628ce17ffd90d3d254": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "e7283168055b48acb94cf69be4ee57fd": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "e7af31e46e174ea6b2a1a168784269d0": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "e7be1952f3234c38adc44db5d30684b4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "e91cb5eb1a894209b3599ba5eb3f215d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_f3e128dab6a24396b8deb3526a90040a", - "placeholder": "​", - "style": "IPY_MODEL_a623fa5f4e16419f99f40f8837228e7e", - "value": " 446k/446k [00:00<00:00, 865kB/s]" - } - }, - "ead6bc3051794fca93f0269308fd0c0c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "ec079ac635894ee2a7ebe1315129fc74": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "ecb380ec3dc849c983440cb1b73bfa30": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "eebda1a16e4b4a4783a1da98f2d1a2f6": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "f02c6045c6f74123b82c0988a08d2910": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_e2c6f05a6875492b9a958e693629145a", - "IPY_MODEL_38e01a43e0424095b0216725223cacc3", - "IPY_MODEL_4df39113ca2043258a34afe304f3d9d2" - ], - "layout": "IPY_MODEL_726446afcb2d42d7b8f806631dfbeb61" - } - }, - "f0556ff087614accad129c6ca7ee9ed8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "f072a260238d44aba5746762092530cb": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "f23f28f634ad46668da2af750c51d17d": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_5c475d1892c94592b7398bc028439f7a", - "IPY_MODEL_43346612910e44a6ab4618c90fa27829", - "IPY_MODEL_5821fd6e83244dc69f06caf1c69420df" - ], - "layout": "IPY_MODEL_daf1284fcd1c45bc9bb3f430544db154" - } - }, - "f2d518ef81f546d9b034cbf3d8be71ca": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "f3720a4f21c2491eb4ea17f3efcc74d1": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "f375cf9a3bc343c6958a2a20b9b6b096": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_1b612c743595417ba3f393056c6a7e7a", - "max": 466062, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_57d028e4b6204017bf158df49b358d48", - "value": 466062 - } - }, - "f39dec147f404f0b851468d008fec716": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "f3e128dab6a24396b8deb3526a90040a": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "f40893f97e914de090030cccd9cd0be0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "f4143e675e7543a9af0bd70636306db6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "f4e15b7446214c6f86cb0095711fe9f2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_a388d930425f462d831235f5f1f01d5a", - "placeholder": "​", - "style": "IPY_MODEL_3cb8f213216b4db4b17b6159ff8af1b2", - "value": "Downloading tokenizer_config.json: 100%" - } - }, - "f5b83013d0794a26be03e02f036519cc": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_278142b28f7341209ff853d67c354a10", - "IPY_MODEL_592526530ec44c1886774b8ddbd9306a", - "IPY_MODEL_5d8af77774244f15a0b53a5a5498c61b" - ], - "layout": "IPY_MODEL_1bc3df520c024829b8e9379fd4f09cf7" - } - }, - "f733c4422f064d8baf9e1d4537185011": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_03f86c9d0b764e36b23e30358346eaf3", - "placeholder": "​", - "style": "IPY_MODEL_62fd3930106f4355871cee9397fec8cf", - "value": " 232k/232k [00:00<00:00, 923kB/s]" - } - }, - "f75815ed31734a98aff984b195c71ca5": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "f9afd1d342804aca92854daed877309c": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "f9c813702cbd43a8a7756f9925b8e091": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "fa0a76c3235948c1a26ae247a37fd02a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_fd2100438f864e3b957fab001fc2122b", - "max": 267967963, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_d360844c59b849e1807a0f2b3019fd8a", - "value": 267967963 - } - }, - "fa7ed39b1e6244ef809f6a8875e66836": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_44fe5107721a490c8b5139744d00d6b3", - "placeholder": "​", - "style": "IPY_MODEL_8c2e4b1aef0643079e6d074c7b3df700", - "value": " 226k/226k [00:00<00:00, 832kB/s]" - } - }, - "fb6db763317e4bbda9cba708c654d63b": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_506e50b472fc48718c2e43b843ca56f7", - "placeholder": "​", - "style": "IPY_MODEL_505d2e0776f9413d9e65233a8c7a3ce0", - "value": "Downloading tokenizer_config.json: 100%" - } - }, - "fbc30ecadc1241089bc9928439a8daee": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "fbef18bdfa234ff8b17413b096029fb8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "fcb348895f0243958ce39af66638433e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "fd0b9cfbcbe043508af4da14b2c3b5d3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_724e61cdd8074ae99517fae53bc06854", - "IPY_MODEL_2eaea0dc84ed4ebfba680f2fcfa04637", - "IPY_MODEL_0d6060ee7aec42d492f9bb1e4b8f2ce4" - ], - "layout": "IPY_MODEL_4d6ec2b0c2bc435e9d3fcbdff951b29b" - } - }, - "fd2100438f864e3b957fab001fc2122b": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "fd3051ae1a27483da9bfaca20612aca5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_f2d518ef81f546d9b034cbf3d8be71ca", - "placeholder": "​", - "style": "IPY_MODEL_c5a0e59e0ec14d53a655c8f087c3c071", - "value": " 1/1 [00:00<00:00, 28.60ba/s]" - } - }, - "fd58814a4c97441d911481a3b810d555": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "fd90644c12544a3d8444543cf97dbeab": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "fe358f54827f476d98557365e873d898": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_fd90644c12544a3d8444543cf97dbeab", - "placeholder": "​", - "style": "IPY_MODEL_b361bfc331fb42a7ab25522003c63f06", - "value": "Downloading config.json: 100%" - } - }, - "fee2373861754a5aa57deca0fe0a549f": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "feed20df83614d89ad29099b05c32a84": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_38f92f34bc5b4a658dd2f6fbcaec80f1", - "max": 5, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_c510dfd747254a1588b761a3fdde091d", - "value": 5 - } - }, - "fef3a407898f44798e08baf4a27f5fcb": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "fefec331bdc5456498084257b45a03b6": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "ff61a61119094626a738050955793c39": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_ab70f467b69a47349a1c5d3839b884b9", - "max": 1629486723, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_4fc06fe12e514785a121c7ae1b9e0c97", - "value": 1629486723 - } - }, - "ff630cfd369b4f3892eb32d0df84a0db": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } + "952a86292e0043e89e0adae2df4efc3c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3251f229b9a24114b5b1f01d6107b537": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "4026dcdddca340c38ce39e52b42af5b0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_5745ecf2686c4ee48768c8e8ea52564a", + "IPY_MODEL_88e6c818218646b8b4113f90a3d9d46f", + "IPY_MODEL_9b6ad42d8e9e4871bfb469ba885545dd" + ], + "layout": "IPY_MODEL_e8dbf55012d24eab949ea28e7eb5d3e3" + } + }, + "5745ecf2686c4ee48768c8e8ea52564a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_16eaf10ff5154c5ab2ce2659ca5c1285", + "placeholder": "​", + "style": "IPY_MODEL_65f2b9ceee2a40b098f4b91674afc150", + "value": "Map: 100%" + } + }, + "88e6c818218646b8b4113f90a3d9d46f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_db8e8d115fd8479f96170f1576c6dbcc", + "max": 4991, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_8372541436324b378ccb10e048e3fd7f", + "value": 4991 + } + }, + "9b6ad42d8e9e4871bfb469ba885545dd": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_65d257a1c45746239e3fd0d1bd2c3828", + "placeholder": "​", + "style": "IPY_MODEL_9dfaae0a3ebe49239983c37cfad58845", + "value": " 4991/4991 [00:00<00:00, 11343.21 examples/s]" + } + }, + "e8dbf55012d24eab949ea28e7eb5d3e3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "16eaf10ff5154c5ab2ce2659ca5c1285": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "65f2b9ceee2a40b098f4b91674afc150": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "db8e8d115fd8479f96170f1576c6dbcc": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8372541436324b378ccb10e048e3fd7f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "65d257a1c45746239e3fd0d1bd2c3828": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9dfaae0a3ebe49239983c37cfad58845": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "ffc413f82c644528a2ec8705f6db4048": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_27eb980ee9e94d1aaa03c0a86ff0ed74", + "IPY_MODEL_6a7503a48c7341bf81e2d07a4304c72f", + "IPY_MODEL_f961a58e35a1457ebc6c708b9295d731" + ], + "layout": "IPY_MODEL_5ee2ed5078264f7f8aaf97347153dc6c" + } + }, + "27eb980ee9e94d1aaa03c0a86ff0ed74": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_d558eb7761a546b68a6b93c92fe6bba0", + "placeholder": "​", + "style": "IPY_MODEL_04b109903925482ca83ee9136a8a7565", + "value": "Map: 100%" + } + }, + "6a7503a48c7341bf81e2d07a4304c72f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_031e975a4e0c4926b11472fb06c766c4", + "max": 1039, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_4dda2fe09cc548a9b2f46ccd43109ab9", + "value": 1039 + } + }, + "f961a58e35a1457ebc6c708b9295d731": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_7d7905f3a80a4c85a443dcce8825ee95", + "placeholder": "​", + "style": "IPY_MODEL_337470f659eb40b2a7a4c34e7de77538", + "value": " 1039/1039 [00:00<00:00, 8515.28 examples/s]" + } + }, + "5ee2ed5078264f7f8aaf97347153dc6c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d558eb7761a546b68a6b93c92fe6bba0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "04b109903925482ca83ee9136a8a7565": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "031e975a4e0c4926b11472fb06c766c4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "4dda2fe09cc548a9b2f46ccd43109ab9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "7d7905f3a80a4c85a443dcce8825ee95": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "337470f659eb40b2a7a4c34e7de77538": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "1493d02ebe5146b59c14a9d21523b0d1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_92697c12d850440aad104272e36b1a8a", + "IPY_MODEL_f1f6f5c3543a48999885e41446bc6e86", + "IPY_MODEL_a6ac626f1faa49efad60429bb84824db" + ], + "layout": "IPY_MODEL_62165eba4361461eab98456acd808fb4" + } + }, + "92697c12d850440aad104272e36b1a8a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5e16292476884785ac7efd851bcec214", + "placeholder": "​", + "style": "IPY_MODEL_1e241a02605547a9bf09c8946266da84", + "value": "Map: 100%" + } + }, + "f1f6f5c3543a48999885e41446bc6e86": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_cd4deec5594a4242b71fefa3043f3903", + "max": 4991, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_82133d8b579a4601804e29d3fe8de1e3", + "value": 4991 + } + }, + "a6ac626f1faa49efad60429bb84824db": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c4c55b80077748f4b07c5377d505c6db", + "placeholder": "​", + "style": "IPY_MODEL_531e193006114c64b93f3930c2f24807", + "value": " 4991/4991 [00:13<00:00, 712.79 examples/s]" + } + }, + "62165eba4361461eab98456acd808fb4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5e16292476884785ac7efd851bcec214": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1e241a02605547a9bf09c8946266da84": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "cd4deec5594a4242b71fefa3043f3903": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "82133d8b579a4601804e29d3fe8de1e3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "c4c55b80077748f4b07c5377d505c6db": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "531e193006114c64b93f3930c2f24807": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "9158ec9a01eb48cdb910b060ad1185a1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_dc883c3f9c854538a85e8c77cc46b551", + "IPY_MODEL_40801320d0c3492bb7f1dcb4b6c4fb94", + "IPY_MODEL_6578fe1e9a6b49f9b550123e7eaad22d" + ], + "layout": "IPY_MODEL_675b68fe3ed04594bba5b948c0ada867" + } + }, + "dc883c3f9c854538a85e8c77cc46b551": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_332a4a95247742c3a6f2a2c459b2b3a8", + "placeholder": "​", + "style": "IPY_MODEL_1bb7af7c85a9484dab55cc126d22384d", + "value": "Map: 100%" + } + }, + "40801320d0c3492bb7f1dcb4b6c4fb94": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_6cf7ca09d01945129f73e3d7e19c0c19", + "max": 1039, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_d3f5fb056a3d46c785b1fde844052659", + "value": 1039 + } + }, + "6578fe1e9a6b49f9b550123e7eaad22d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_775a2a2703f04531ae1d855b8a353e64", + "placeholder": "​", + "style": "IPY_MODEL_154131c8d35a432cbaa126824c79892e", + "value": " 1039/1039 [00:02<00:00, 322.16 examples/s]" + } + }, + "675b68fe3ed04594bba5b948c0ada867": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "332a4a95247742c3a6f2a2c459b2b3a8": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1bb7af7c85a9484dab55cc126d22384d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "6cf7ca09d01945129f73e3d7e19c0c19": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d3f5fb056a3d46c785b1fde844052659": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "775a2a2703f04531ae1d855b8a353e64": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "154131c8d35a432cbaa126824c79892e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "2200519804e141398ad3b7ec1a1651d7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_58536efab4a94045af79a642549cb28f", + "IPY_MODEL_f07aa0b876924898b8e66b35ed36e7cf", + "IPY_MODEL_8e2925bd03e649ea939aeb8dc061c0a3" + ], + "layout": "IPY_MODEL_cd5917f3d0624092b32c4d9bfed69a98" + } + }, + "58536efab4a94045af79a642549cb28f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c8d4274188bf464d8686f83280ffa9e1", + "placeholder": "​", + "style": "IPY_MODEL_9d3d3feb9b25419a876586ec51da8ee0", + "value": "Downloading (…)lve/main/config.json: 100%" + } + }, + "f07aa0b876924898b8e66b35ed36e7cf": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f9379789ea434bca9e3a040f774b9a31", + "max": 1154, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_a10b60b5ec8b4668a6f12474e6f944ce", + "value": 1154 + } + }, + "8e2925bd03e649ea939aeb8dc061c0a3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_30fe641c399544e3b1111fd1043802e9", + "placeholder": "​", + "style": "IPY_MODEL_b829f2bd5c53486a9339df054a5b090a", + "value": " 1.15k/1.15k [00:00<00:00, 42.4kB/s]" + } + }, + "cd5917f3d0624092b32c4d9bfed69a98": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c8d4274188bf464d8686f83280ffa9e1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9d3d3feb9b25419a876586ec51da8ee0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "f9379789ea434bca9e3a040f774b9a31": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a10b60b5ec8b4668a6f12474e6f944ce": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "30fe641c399544e3b1111fd1043802e9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b829f2bd5c53486a9339df054a5b090a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "1cc54f2db67b43299c32ac3d80a14a05": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_a838ad30c8214f70825456bdbe8040bc", + "IPY_MODEL_714784cacd254171ae4c654a6df16aac", + "IPY_MODEL_257651054ee64b0b86426ea8867abf34" + ], + "layout": "IPY_MODEL_979e96beb1cf47d7a7cbe26597cc1b97" + } + }, + "a838ad30c8214f70825456bdbe8040bc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_6b09cf6fa47b44209bf41d1d82f0eddd", + "placeholder": "​", + "style": "IPY_MODEL_ff5f70c5ba78479e9600101bd61a9762", + "value": "Downloading model.safetensors: 100%" + } + }, + "714784cacd254171ae4c654a6df16aac": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_02eaa5b14ccb4420b54a63c06289a9c6", + "max": 1629437147, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_ea26895dcf48415392b883b65349b063", + "value": 1629437147 + } + }, + "257651054ee64b0b86426ea8867abf34": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_961a9f04da1342d08899144b0392d3a0", + "placeholder": "​", + "style": "IPY_MODEL_3cfab93db69a4da4a23a8852950430e3", + "value": " 1.63G/1.63G [00:14<00:00, 62.8MB/s]" + } + }, + "979e96beb1cf47d7a7cbe26597cc1b97": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6b09cf6fa47b44209bf41d1d82f0eddd": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ff5f70c5ba78479e9600101bd61a9762": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "02eaa5b14ccb4420b54a63c06289a9c6": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ea26895dcf48415392b883b65349b063": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "961a9f04da1342d08899144b0392d3a0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3cfab93db69a4da4a23a8852950430e3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "545125171280483eb39001760dbe64b8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_d9668e4d305e49808115050d94abbf10", + "IPY_MODEL_c0d4c7a7053d419cbb0bb6e1dc86d218", + "IPY_MODEL_43223ffb2f3947198fa57c73af2dea9c" + ], + "layout": "IPY_MODEL_15e421344c8341d1a8011702d4dc07c3" + } + }, + "d9668e4d305e49808115050d94abbf10": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_2577d0d7013f4fb7b500916137bed1b0", + "placeholder": "​", + "style": "IPY_MODEL_541d2d7200b44dfab80178e1c68806ec", + "value": "Downloading (…)okenizer_config.json: 100%" + } + }, + "c0d4c7a7053d419cbb0bb6e1dc86d218": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_9499be411d9d42bfbcd5477b53fe8d74", + "max": 26, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_feb9bad9b33943729dcc67a7ffd8c8ef", + "value": 26 + } + }, + "43223ffb2f3947198fa57c73af2dea9c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_cfaa75849a064d66b18893963f1413a4", + "placeholder": "​", + "style": "IPY_MODEL_cc93da4a48374a95bfaf600b321b5464", + "value": " 26.0/26.0 [00:00<00:00, 1.07kB/s]" + } + }, + "15e421344c8341d1a8011702d4dc07c3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2577d0d7013f4fb7b500916137bed1b0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "541d2d7200b44dfab80178e1c68806ec": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "9499be411d9d42bfbcd5477b53fe8d74": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "feb9bad9b33943729dcc67a7ffd8c8ef": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "cfaa75849a064d66b18893963f1413a4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "cc93da4a48374a95bfaf600b321b5464": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "bde596f909cf4f4c8ec7166f6d6ff5da": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_3757acbc0aa943cd9a2a22fa0336805c", + "IPY_MODEL_67495b76189f4489bc4ec4b3cbe8b2aa", + "IPY_MODEL_6fd8d362aa5049e087e6210660c8aac7" + ], + "layout": "IPY_MODEL_4ca172d25bc2489a90bef50b6ab671e1" + } + }, + "3757acbc0aa943cd9a2a22fa0336805c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_410a5a0a52ee46f19413833ea0c9ffa9", + "placeholder": "​", + "style": "IPY_MODEL_2150f647187d4df5805ed69fe91456e9", + "value": "Downloading (…)olve/main/vocab.json: 100%" + } + }, + "67495b76189f4489bc4ec4b3cbe8b2aa": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c263ee996b7e476e96fd77456922635d", + "max": 898822, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_2352fe8e75fa460b8859823270b054e3", + "value": 898822 + } + }, + "6fd8d362aa5049e087e6210660c8aac7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_19503938c7c9427ab9368718f113d0dc", + "placeholder": "​", + "style": "IPY_MODEL_3575328060fc48c39207ac7ed254108d", + "value": " 899k/899k [00:00<00:00, 4.61MB/s]" + } + }, + "4ca172d25bc2489a90bef50b6ab671e1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "410a5a0a52ee46f19413833ea0c9ffa9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2150f647187d4df5805ed69fe91456e9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "c263ee996b7e476e96fd77456922635d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2352fe8e75fa460b8859823270b054e3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "19503938c7c9427ab9368718f113d0dc": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3575328060fc48c39207ac7ed254108d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "b7343b6eba3a4c6fbfb41de9a2f1c2a5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_146686cbbb514f95892dc87061565fb2", + "IPY_MODEL_1e98e49f489543e78e3384b66c048cc6", + "IPY_MODEL_a106da5cb7314f03b075ee7c0e4e9ec7" + ], + "layout": "IPY_MODEL_7db3a1b06b714d7ab26338bdb4062b4c" + } + }, + "146686cbbb514f95892dc87061565fb2": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_cedf88473f774984a22f65e06f7608bb", + "placeholder": "​", + "style": "IPY_MODEL_5c9474ce8e3a45658f68e823d74f1995", + "value": "Downloading (…)olve/main/merges.txt: 100%" + } + }, + "1e98e49f489543e78e3384b66c048cc6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_e390d3472da24d7286239e9b852dad6c", + "max": 456318, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_7e73588e6d82482fa7398bc4d4e0e913", + "value": 456318 + } + }, + "a106da5cb7314f03b075ee7c0e4e9ec7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5af9d65c8ac242f0972d93f48c9fc4bb", + "placeholder": "​", + "style": "IPY_MODEL_e5a9124fe6044842a27a9c30883d5869", + "value": " 456k/456k [00:00<00:00, 3.45MB/s]" + } + }, + "7db3a1b06b714d7ab26338bdb4062b4c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "cedf88473f774984a22f65e06f7608bb": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5c9474ce8e3a45658f68e823d74f1995": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "e390d3472da24d7286239e9b852dad6c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7e73588e6d82482fa7398bc4d4e0e913": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "5af9d65c8ac242f0972d93f48c9fc4bb": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "e5a9124fe6044842a27a9c30883d5869": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "489233bb8c044988a3e08102f8aadbf8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_7f0fd2b6ae724ebe93b39e15d0b18ffa", + "IPY_MODEL_bcb392fa900e4f78ab0f5d985ccb0c5e", + "IPY_MODEL_07dfbcc8771f48d6b3426dc82ef74617" + ], + "layout": "IPY_MODEL_60eb749393b2460c92b6af9d8632b73e" + } + }, + "7f0fd2b6ae724ebe93b39e15d0b18ffa": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_319fbe6f513644b9bd98d76589a70b1f", + "placeholder": "​", + "style": "IPY_MODEL_5add45e0435b4f16b94b59d969ece2f6", + "value": "Downloading (…)/main/tokenizer.json: 100%" + } + }, + "bcb392fa900e4f78ab0f5d985ccb0c5e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_b83f6ddd989d4f67957622f1c5932d87", + "max": 1355863, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_2c27bf385c1c4e2892044acfd233b326", + "value": 1355863 + } + }, + "07dfbcc8771f48d6b3426dc82ef74617": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_118bb1212469463d87ef9762316cf9cd", + "placeholder": "​", + "style": "IPY_MODEL_5790a88fec1141ae8813301962eae01d", + "value": " 1.36M/1.36M [00:00<00:00, 6.96MB/s]" + } + }, + "60eb749393b2460c92b6af9d8632b73e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "319fbe6f513644b9bd98d76589a70b1f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5add45e0435b4f16b94b59d969ece2f6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "b83f6ddd989d4f67957622f1c5932d87": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2c27bf385c1c4e2892044acfd233b326": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "118bb1212469463d87ef9762316cf9cd": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5790a88fec1141ae8813301962eae01d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "5f74275afa1d46da8085b979edd7d4de": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_627058aa0f314f1eb21388e8a327a429", + "IPY_MODEL_0d27a80e51674bc4ab93817c47e22d34", + "IPY_MODEL_94a41b1e2e0a4ea79b1031aa5828ecb6" + ], + "layout": "IPY_MODEL_3a6a1f92769f4bfa924920c8c003a02f" + } + }, + "627058aa0f314f1eb21388e8a327a429": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_c1ae57b61c9b4b949e0fa0581611aa80", + "placeholder": "​", + "style": "IPY_MODEL_9a10cedca8a44948840681975df987a7", + "value": "Downloading (…)okenizer_config.json: 100%" + } + }, + "0d27a80e51674bc4ab93817c47e22d34": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_1c3ae5a90e564510aac2ce4a61b9c56d", + "max": 352, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_9096ce54dea847bc9d398ae31f086c16", + "value": 352 + } + }, + "94a41b1e2e0a4ea79b1031aa5828ecb6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_66e0472ab90e4c6c94d18e374f8cf9c7", + "placeholder": "​", + "style": "IPY_MODEL_05fbe6032b7f421fa897992621795b33", + "value": " 352/352 [00:00<00:00, 13.0kB/s]" + } + }, + "3a6a1f92769f4bfa924920c8c003a02f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c1ae57b61c9b4b949e0fa0581611aa80": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9a10cedca8a44948840681975df987a7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "1c3ae5a90e564510aac2ce4a61b9c56d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9096ce54dea847bc9d398ae31f086c16": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "66e0472ab90e4c6c94d18e374f8cf9c7": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "05fbe6032b7f421fa897992621795b33": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "4595744bea1843c79d6c8b11027c1db8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_320c7ca65249451a824d2df8c430a3a4", + "IPY_MODEL_a279e42a1701404bbcb2732ed248a334", + "IPY_MODEL_0998c7ff46e74d49b9fb991a337bad0e" + ], + "layout": "IPY_MODEL_7f15dfe1fa454a1e8faa2c764e437ba7" + } + }, + "320c7ca65249451a824d2df8c430a3a4": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_a7c671a21dee45829a450e40de873384", + "placeholder": "​", + "style": "IPY_MODEL_45d00478792d44cfa033feb875b84a7b", + "value": "Downloading (…)solve/main/vocab.txt: 100%" + } + }, + "a279e42a1701404bbcb2732ed248a334": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3fb4ac16169c4bdab40cf7189de202d9", + "max": 231508, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_800b4b1478b94daa9045c8d183de2bdd", + "value": 231508 + } + }, + "0998c7ff46e74d49b9fb991a337bad0e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_b027b9effe2b44d895b3f5babedaf6e7", + "placeholder": "​", + "style": "IPY_MODEL_8c49c80da8b84575ae24724c345fcb06", + "value": " 232k/232k [00:00<00:00, 3.06MB/s]" + } + }, + "7f15dfe1fa454a1e8faa2c764e437ba7": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a7c671a21dee45829a450e40de873384": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "45d00478792d44cfa033feb875b84a7b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "3fb4ac16169c4bdab40cf7189de202d9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "800b4b1478b94daa9045c8d183de2bdd": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "b027b9effe2b44d895b3f5babedaf6e7": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8c49c80da8b84575ae24724c345fcb06": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "1c9d63e6919242a193aafd755220497d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_6c08750a5b304550b784400b5cd48846", + "IPY_MODEL_47bb8f56b89549ae8a72b8976a3664eb", + "IPY_MODEL_c927c1d243364d1c88534038402d3629" + ], + "layout": "IPY_MODEL_8c34114e5cbb479eb8b8fc691a3e65da" + } + }, + "6c08750a5b304550b784400b5cd48846": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f3c04685c6af44bd9bf88d404d1f8c9d", + "placeholder": "​", + "style": "IPY_MODEL_4124b1638d2c4ca1ae0c9fc7a92c2884", + "value": "Downloading (…)/main/tokenizer.json: 100%" + } + }, + "47bb8f56b89549ae8a72b8976a3664eb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_62abd2484e5444d6859d3bbd639fa4d7", + "max": 466247, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_1245ab4237cc4ee9b6c851301607b301", + "value": 466247 + } + }, + "c927c1d243364d1c88534038402d3629": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_47622165b2ae457d8578e141318e95d5", + "placeholder": "​", + "style": "IPY_MODEL_6f3f15dd4f0f4e7bafd6c29414269465", + "value": " 466k/466k [00:00<00:00, 2.39MB/s]" + } + }, + "8c34114e5cbb479eb8b8fc691a3e65da": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f3c04685c6af44bd9bf88d404d1f8c9d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "4124b1638d2c4ca1ae0c9fc7a92c2884": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "62abd2484e5444d6859d3bbd639fa4d7": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1245ab4237cc4ee9b6c851301607b301": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "47622165b2ae457d8578e141318e95d5": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6f3f15dd4f0f4e7bafd6c29414269465": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "ccf3d21d1e394e79a736bb5ae51e1a1c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_ebc5ae4cf440454a945580961ea23bb1", + "IPY_MODEL_0202fb280ebb4149b1f3a85545fe5cd3", + "IPY_MODEL_362c20f6821747b1a9854c094f00f672" + ], + "layout": "IPY_MODEL_1fcdb6ee7a894d32b11901032dce5f92" + } + }, + "ebc5ae4cf440454a945580961ea23bb1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_d6704ca6a7a24c1d9489f662a65921bf", + "placeholder": "​", + "style": "IPY_MODEL_716aeb463e49482ca7fbf7c4af312138", + "value": "Downloading (…)cial_tokens_map.json: 100%" + } + }, + "0202fb280ebb4149b1f3a85545fe5cd3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_69eb91d460e24f29b479b64bdc270847", + "max": 112, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_9914a5f63edd444db1e7bc0992fb2770", + "value": 112 + } + }, + "362c20f6821747b1a9854c094f00f672": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5b4ed5562c0242d9a69788aeebe0f9af", + "placeholder": "​", + "style": "IPY_MODEL_325c8a22307c4b77a84f549627db0d5a", + "value": " 112/112 [00:00<00:00, 4.48kB/s]" + } + }, + "1fcdb6ee7a894d32b11901032dce5f92": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d6704ca6a7a24c1d9489f662a65921bf": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "716aeb463e49482ca7fbf7c4af312138": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "69eb91d460e24f29b479b64bdc270847": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9914a5f63edd444db1e7bc0992fb2770": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "5b4ed5562c0242d9a69788aeebe0f9af": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "325c8a22307c4b77a84f549627db0d5a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "448a40829fdf408cac3af81ef9c03df4": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_32b565d94b2f405693f5eba1bc16f53d", + "IPY_MODEL_78ad4e18627b4131aca129f38652ccba", + "IPY_MODEL_e89c8fe1562b45b7818ff20c4ef58f8e" + ], + "layout": "IPY_MODEL_39cbad4a6bd944b4bd18ea9b14debac2" + } + }, + "32b565d94b2f405693f5eba1bc16f53d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_6859fef3694e4c49b0ab633200756934", + "placeholder": "​", + "style": "IPY_MODEL_b51d592bfbf34b24b16544f42dcad5e8", + "value": "Downloading (…)lve/main/config.json: 100%" + } + }, + "78ad4e18627b4131aca129f38652ccba": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_b9711b3014f0476d8cccb1642cf28681", + "max": 573, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_5a331fc31a1546f093494ee2404cfbe1", + "value": 573 + } + }, + "e89c8fe1562b45b7818ff20c4ef58f8e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_739340399a6c4c4fb50143e3587423ad", + "placeholder": "​", + "style": "IPY_MODEL_8c183b90a3dd45c2a7fe797ea079e319", + "value": " 573/573 [00:00<00:00, 20.4kB/s]" + } + }, + "39cbad4a6bd944b4bd18ea9b14debac2": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6859fef3694e4c49b0ab633200756934": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b51d592bfbf34b24b16544f42dcad5e8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "b9711b3014f0476d8cccb1642cf28681": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5a331fc31a1546f093494ee2404cfbe1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "739340399a6c4c4fb50143e3587423ad": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8c183b90a3dd45c2a7fe797ea079e319": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "f51acf459e944e7cb86ec7e57c47496f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_221e6c077d39456f839d859fbd67e9cc", + "IPY_MODEL_9d814a3f4ba5482199f7c5f91bf7e39d", + "IPY_MODEL_e7f354b860fb45cfa7368eb01f2e5c01" + ], + "layout": "IPY_MODEL_2067761d355d4de3ab734ecd38d85702" + } + }, + "221e6c077d39456f839d859fbd67e9cc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_d96a4c788fa140e2ac5977582e2a2ff1", + "placeholder": "​", + "style": "IPY_MODEL_ea0f1a6513ce4d73b9362a9839999312", + "value": "Downloading pytorch_model.bin: 100%" + } + }, + "9d814a3f4ba5482199f7c5f91bf7e39d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_71ed5aad90ba4794b7242efa2f66e82a", + "max": 133506609, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_423662a69bcb4312ae86d9f23290a447", + "value": 133506609 + } + }, + "e7f354b860fb45cfa7368eb01f2e5c01": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3bae1d2fbd2449af80e6c0a6ff3cadb0", + "placeholder": "​", + "style": "IPY_MODEL_2866aaeac9af4b35a0b9a76c33d8dece", + "value": " 134M/134M [00:00<00:00, 198MB/s]" + } + }, + "2067761d355d4de3ab734ecd38d85702": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d96a4c788fa140e2ac5977582e2a2ff1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ea0f1a6513ce4d73b9362a9839999312": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "71ed5aad90ba4794b7242efa2f66e82a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "423662a69bcb4312ae86d9f23290a447": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "3bae1d2fbd2449af80e6c0a6ff3cadb0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2866aaeac9af4b35a0b9a76c33d8dece": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "2c818172220a463b86e8506b8d4d4544": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_3cf0a2866240469badd808cdff21dcf9", + "IPY_MODEL_096c8611486245f48d2a47a32aaedf0b", + "IPY_MODEL_78200e8e8f524a388aa1089ef4c764d6" + ], + "layout": "IPY_MODEL_d2f9abbf266d401ea70b2ed1393ad106" + } + }, + "3cf0a2866240469badd808cdff21dcf9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_8107463dabdf4361bc1ee1e398332d98", + "placeholder": "​", + "style": "IPY_MODEL_61cd7bef43a64e3c986d7494fefd620c", + "value": "Map: 100%" + } + }, + "096c8611486245f48d2a47a32aaedf0b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_fbc79b5a25e047109998ca2544270d24", + "max": 4991, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_7aa2febe09344f7faab7e2ea3f17934e", + "value": 4991 + } + }, + "78200e8e8f524a388aa1089ef4c764d6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_4a84260fa3684ecd994ee4ce71852196", + "placeholder": "​", + "style": "IPY_MODEL_fd3cbbc513fb402f8fe15574a1d01a73", + "value": " 4991/4991 [00:00<00:00, 9302.35 examples/s]" + } + }, + "d2f9abbf266d401ea70b2ed1393ad106": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8107463dabdf4361bc1ee1e398332d98": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "61cd7bef43a64e3c986d7494fefd620c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "fbc79b5a25e047109998ca2544270d24": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7aa2febe09344f7faab7e2ea3f17934e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "4a84260fa3684ecd994ee4ce71852196": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fd3cbbc513fb402f8fe15574a1d01a73": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "b69dea2394c444a787c6a91a928e152d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_d891083164114c5897b56c53c4359093", + "IPY_MODEL_e5607e4bdd69490698439daafe1807c7", + "IPY_MODEL_ee50e9d4ff9943f082ee58e0e6ef39e0" + ], + "layout": "IPY_MODEL_5d0afb221a2d40acb65ea5b2813b94a0" + } + }, + "d891083164114c5897b56c53c4359093": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_02eb4fbb7db247629b770404b5e14da0", + "placeholder": "​", + "style": "IPY_MODEL_0267f239aaf94ddeacff27abe4b693c9", + "value": "Map: 100%" + } + }, + "e5607e4bdd69490698439daafe1807c7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_133779a0c5364fbbb0c30cc303420f0e", + "max": 1039, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_f748d8f0253346668978c01abaf7837f", + "value": 1039 + } + }, + "ee50e9d4ff9943f082ee58e0e6ef39e0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_cceb23f1972042489c92ad40707125f4", + "placeholder": "​", + "style": "IPY_MODEL_d0bafc08bf5b41ef90d430ad3dbd84a7", + "value": " 1039/1039 [00:00<00:00, 7945.23 examples/s]" + } + }, + "5d0afb221a2d40acb65ea5b2813b94a0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "02eb4fbb7db247629b770404b5e14da0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0267f239aaf94ddeacff27abe4b693c9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "133779a0c5364fbbb0c30cc303420f0e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f748d8f0253346668978c01abaf7837f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "cceb23f1972042489c92ad40707125f4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d0bafc08bf5b41ef90d430ad3dbd84a7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "d3ebe58a4bb44911a68cf0a28d27f668": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_ef894bea7b7c4f93aa5e465adc65bb15", + "IPY_MODEL_8b4d22668b924a2e84d447cda3c6807c", + "IPY_MODEL_b5cb6f10f5b449ed9d88db38ff511b57" + ], + "layout": "IPY_MODEL_dd03e7b8ecc949a39978fb4026921284" + } + }, + "ef894bea7b7c4f93aa5e465adc65bb15": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ff6685df85604180a57eef690acecd02", + "placeholder": "​", + "style": "IPY_MODEL_7d94b89825564b42bea692dce185ae01", + "value": "Map: 100%" + } + }, + "8b4d22668b924a2e84d447cda3c6807c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_31e39dcf9d5e44bd95840402a8e23f9a", + "max": 4991, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_e1b2a889ce334bc99a123f1406619435", + "value": 4991 + } + }, + "b5cb6f10f5b449ed9d88db38ff511b57": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_2d4f765e93c146f385b073d808e4d5e6", + "placeholder": "​", + "style": "IPY_MODEL_effd70ee57ed411482632ae361864d15", + "value": " 4991/4991 [00:06<00:00, 747.83 examples/s]" + } + }, + "dd03e7b8ecc949a39978fb4026921284": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ff6685df85604180a57eef690acecd02": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7d94b89825564b42bea692dce185ae01": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "31e39dcf9d5e44bd95840402a8e23f9a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "e1b2a889ce334bc99a123f1406619435": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "2d4f765e93c146f385b073d808e4d5e6": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "effd70ee57ed411482632ae361864d15": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "5b0266cdaf324d719520d2a894b178f9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_97a81e281a5f4015884cef52097e1376", + "IPY_MODEL_e9519922ea3b42d191e5e77b36e86630", + "IPY_MODEL_ceb84e2b4df846db80c15e4a54bf04b0" + ], + "layout": "IPY_MODEL_830993d753904c4ab00c361e6bb7f386" + } + }, + "97a81e281a5f4015884cef52097e1376": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_43b680131b1d4688ba25e321351eae1c", + "placeholder": "​", + "style": "IPY_MODEL_7134252fb8204035959c1a2caf3445cb", + "value": "Map: 100%" + } + }, + "e9519922ea3b42d191e5e77b36e86630": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_6855168610e1450e890f8ef0a1b40b97", + "max": 1039, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_6bea289840764a38a254fdb81056443e", + "value": 1039 + } + }, + "ceb84e2b4df846db80c15e4a54bf04b0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_6afbdd3d62bd4c8ba0301ea78d5dd47f", + "placeholder": "​", + "style": "IPY_MODEL_fa8e9cf4596b482a96adad3c0a9b8042", + "value": " 1039/1039 [00:01<00:00, 941.83 examples/s]" + } + }, + "830993d753904c4ab00c361e6bb7f386": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "43b680131b1d4688ba25e321351eae1c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7134252fb8204035959c1a2caf3445cb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "6855168610e1450e890f8ef0a1b40b97": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6bea289840764a38a254fdb81056443e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "6afbdd3d62bd4c8ba0301ea78d5dd47f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fa8e9cf4596b482a96adad3c0a9b8042": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "fdc6f7cf2e2a4486b7ccf475144f30e7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_0b8a5b7ed9734f9bb40d69c7e4820820", + "IPY_MODEL_32bf9d8b267d473e80d053005ef22859", + "IPY_MODEL_bcd0bac05ba242209a629baddafb00cf" + ], + "layout": "IPY_MODEL_cfbe1975542949c1807736707be93141" + } + }, + "0b8a5b7ed9734f9bb40d69c7e4820820": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5254c26dd1db49a486692129d809ac39", + "placeholder": "​", + "style": "IPY_MODEL_632f8d67102b41b3865dab13d8a6219c", + "value": "Map: 100%" + } + }, + "32bf9d8b267d473e80d053005ef22859": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_4766d42a9fd541fab09c6e5052a9a8e8", + "max": 13, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_10f361903ae341c7bcbd2cceabafb728", + "value": 13 + } + }, + "bcd0bac05ba242209a629baddafb00cf": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_d441eeb13e2c4e3a9bbc6bf1d9fcaac5", + "placeholder": "​", + "style": "IPY_MODEL_f472b3d813494f7795748b7046a9766f", + "value": " 13/13 [00:00<00:00, 581.96 examples/s]" + } + }, + "cfbe1975542949c1807736707be93141": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "5254c26dd1db49a486692129d809ac39": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "632f8d67102b41b3865dab13d8a6219c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "4766d42a9fd541fab09c6e5052a9a8e8": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "10f361903ae341c7bcbd2cceabafb728": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "d441eeb13e2c4e3a9bbc6bf1d9fcaac5": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "f472b3d813494f7795748b7046a9766f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "318bd1e4c10c464983f083db1afe60bf": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_22b5ae363fe0419eb7c0e13050948ec3", + "IPY_MODEL_e87902dd30fc4a82a230af76bf1528d0", + "IPY_MODEL_9ab40312bef04711a2a0347bfd527708" + ], + "layout": "IPY_MODEL_e29b0382ca914048b2fceaa68c6714ff" + } + }, + "22b5ae363fe0419eb7c0e13050948ec3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_80df714e378046918773f4e7d58e36e4", + "placeholder": "​", + "style": "IPY_MODEL_995ada87ad8c483d899cb58817bce566", + "value": "Map: 100%" + } + }, + "e87902dd30fc4a82a230af76bf1528d0": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_f2f910180dab4a4ba449d94e02a3430b", + "max": 13, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_1ef714e4cbe5437ba7460f81740df425", + "value": 13 + } + }, + "9ab40312bef04711a2a0347bfd527708": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_0b305b33835f4be7b9c62b29be826045", + "placeholder": "​", + "style": "IPY_MODEL_4d05924654ef41a6bd62372337a386da", + "value": " 13/13 [00:00<00:00, 259.22 examples/s]" + } + }, + "e29b0382ca914048b2fceaa68c6714ff": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "80df714e378046918773f4e7d58e36e4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "995ada87ad8c483d899cb58817bce566": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "f2f910180dab4a4ba449d94e02a3430b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1ef714e4cbe5437ba7460f81740df425": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "0b305b33835f4be7b9c62b29be826045": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "4d05924654ef41a6bd62372337a386da": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "a5031e1dc6974abda39169786b5c199d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_c75fd940551245829dc2e7393c7173b3", + "IPY_MODEL_40da65b891d240aea9358b2d487257ce", + "IPY_MODEL_92b58e9a24be486bb72a6a8e4bc10af4" + ], + "layout": "IPY_MODEL_85cb5dd482d740bf872763b94bdbd3fb" + } + }, + "c75fd940551245829dc2e7393c7173b3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3f8b3f16df4b4be996979e0c4abf8c02", + "placeholder": "​", + "style": "IPY_MODEL_6e59977f9d02489885b3dccf336304b6", + "value": "Map: 100%" + } + }, + "40da65b891d240aea9358b2d487257ce": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_8824371c43c84ff6a973aff7f2dbd032", + "max": 4991, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_241f3b90f6a842e09a9bea0b24f5c936", + "value": 4991 + } + }, + "92b58e9a24be486bb72a6a8e4bc10af4": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_d1b13e4ae377404e84b5d4128fa5fa08", + "placeholder": "​", + "style": "IPY_MODEL_044c8ea072134111a3634a0f9815125e", + "value": " 4991/4991 [00:00<00:00, 18340.41 examples/s]" + } + }, + "85cb5dd482d740bf872763b94bdbd3fb": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3f8b3f16df4b4be996979e0c4abf8c02": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6e59977f9d02489885b3dccf336304b6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "8824371c43c84ff6a973aff7f2dbd032": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "241f3b90f6a842e09a9bea0b24f5c936": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "d1b13e4ae377404e84b5d4128fa5fa08": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "044c8ea072134111a3634a0f9815125e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "0a93b0ad407449ffb60629889468f722": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_545539439faa4dd68428ba67c8497efb", + "IPY_MODEL_78dd7d0bb9a94aaea598d1154da76314", + "IPY_MODEL_605cab64c1454b16ae4fa738fe749222" + ], + "layout": "IPY_MODEL_293771f688a5487caa6852958c93c1e2" + } + }, + "545539439faa4dd68428ba67c8497efb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_8dcd26bbf7084ce599d4f793e50f0433", + "placeholder": "​", + "style": "IPY_MODEL_a0c16d99783740469f83a1451561e2a3", + "value": "Downloading (…)e9125/.gitattributes: 100%" + } + }, + "78dd7d0bb9a94aaea598d1154da76314": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_b029308c7f2741e2be2d41bed714424b", + "max": 1175, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_b4517d2b1bf7483995ab260bf21376c8", + "value": 1175 + } + }, + "605cab64c1454b16ae4fa738fe749222": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ad89c7a7393644e69e462b04f912079d", + "placeholder": "​", + "style": "IPY_MODEL_c98ceb9a76224a2e9d379e2e3f2b1643", + "value": " 1.18k/1.18k [00:00<00:00, 42.0kB/s]" + } + }, + "293771f688a5487caa6852958c93c1e2": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8dcd26bbf7084ce599d4f793e50f0433": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a0c16d99783740469f83a1451561e2a3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "b029308c7f2741e2be2d41bed714424b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "b4517d2b1bf7483995ab260bf21376c8": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "ad89c7a7393644e69e462b04f912079d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c98ceb9a76224a2e9d379e2e3f2b1643": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "d8e09e61568a467c928f1a810d5dacf7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_0f5f6a7b0f944dd9be63047ecbd1052f", + "IPY_MODEL_7855b8efab284ad58f64fc35ffc130ce", + "IPY_MODEL_ad2bc40eec7344a0bd4cab0461952fbb" + ], + "layout": "IPY_MODEL_8256b776f57246ad9763b1560395d4b5" + } + }, + "0f5f6a7b0f944dd9be63047ecbd1052f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_758e8f60f8f2407abd27e9ba6c27caa1", + "placeholder": "​", + "style": "IPY_MODEL_6d86c1e2d4b54e998e63516991747611", + "value": "Downloading (…)_Pooling/config.json: 100%" + } + }, + "7855b8efab284ad58f64fc35ffc130ce": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_54b3fd81ee77419d8d3969aac3b75c1c", + "max": 190, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_908c7f7f09624aaca95553aed79af6a1", + "value": 190 + } + }, + "ad2bc40eec7344a0bd4cab0461952fbb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_9c41b1d1ad84442688442fdcb61479fd", + "placeholder": "​", + "style": "IPY_MODEL_7edf0149002045e9b48eb4d50c9f5943", + "value": " 190/190 [00:00<00:00, 7.86kB/s]" + } + }, + "8256b776f57246ad9763b1560395d4b5": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "758e8f60f8f2407abd27e9ba6c27caa1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6d86c1e2d4b54e998e63516991747611": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "54b3fd81ee77419d8d3969aac3b75c1c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "908c7f7f09624aaca95553aed79af6a1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "9c41b1d1ad84442688442fdcb61479fd": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7edf0149002045e9b48eb4d50c9f5943": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "a57fb66bfbdd427881a9e3825e3c477b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_1f83e073333f4280b3265842151588e3", + "IPY_MODEL_39e27c577a994959afd7cf01d5ae58ec", + "IPY_MODEL_5a125462ef474964a68f5d1ca863d48a" + ], + "layout": "IPY_MODEL_3c4ee169ef1744dab58d4299047efe3b" + } + }, + "1f83e073333f4280b3265842151588e3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_cf72fda1a65c4a73bf422998fb8100a4", + "placeholder": "​", + "style": "IPY_MODEL_de764140bba446afb6faa7cf4b64130b", + "value": "Downloading (…)7e55de9125/README.md: 100%" + } + }, + "39e27c577a994959afd7cf01d5ae58ec": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ec2f29cfa86a4d60bd9c0b97a4e4eaa0", + "max": 10610, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_061c896648b241d9b6844cce5cbe9384", + "value": 10610 + } + }, + "5a125462ef474964a68f5d1ca863d48a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_47338744bb804702a918aa01c15dac3c", + "placeholder": "​", + "style": "IPY_MODEL_a380b4c20a0f48e3ab60f64815aa6371", + "value": " 10.6k/10.6k [00:00<00:00, 443kB/s]" + } + }, + "3c4ee169ef1744dab58d4299047efe3b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "cf72fda1a65c4a73bf422998fb8100a4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "de764140bba446afb6faa7cf4b64130b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "ec2f29cfa86a4d60bd9c0b97a4e4eaa0": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "061c896648b241d9b6844cce5cbe9384": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "47338744bb804702a918aa01c15dac3c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a380b4c20a0f48e3ab60f64815aa6371": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "3adb7f184b394e1f9c0e1d972dd74824": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_2feb0dea2733457eb4fe564c4c6c3638", + "IPY_MODEL_cc653b9583c64e7296a5a7aee00f4d71", + "IPY_MODEL_af558c5ada404484ac68934e8ec72874" + ], + "layout": "IPY_MODEL_c79a60b8fa4b45d7acc70c4ea6fda415" + } + }, + "2feb0dea2733457eb4fe564c4c6c3638": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_7fa300386dd240798331bcbdc7beb04e", + "placeholder": "​", + "style": "IPY_MODEL_04922f056ede4cc28e16aca5ef771120", + "value": "Downloading (…)55de9125/config.json: 100%" + } + }, + "cc653b9583c64e7296a5a7aee00f4d71": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_045ddc78143b445494f8c78672f081af", + "max": 612, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_28647e49f768427094f2de4689711c6a", + "value": 612 + } + }, + "af558c5ada404484ac68934e8ec72874": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_e143aef52827432e84ccd648d25e79da", + "placeholder": "​", + "style": "IPY_MODEL_8689afc30539442d88d6add9acc43ced", + "value": " 612/612 [00:00<00:00, 28.4kB/s]" + } + }, + "c79a60b8fa4b45d7acc70c4ea6fda415": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7fa300386dd240798331bcbdc7beb04e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "04922f056ede4cc28e16aca5ef771120": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "045ddc78143b445494f8c78672f081af": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "28647e49f768427094f2de4689711c6a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "e143aef52827432e84ccd648d25e79da": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "8689afc30539442d88d6add9acc43ced": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "da9f459e78334daeaf85d15efce5cabb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_ef9e43f56cee405cb88e7111886be517", + "IPY_MODEL_bd56d5bf6f3e45e99c746c4414f24f79", + "IPY_MODEL_e5f97293ce03488398ee7eff2b7acb65" + ], + "layout": "IPY_MODEL_00b4a55efa1f440cb9427fc3261d1e12" + } + }, + "ef9e43f56cee405cb88e7111886be517": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_bcac9643e7d846b4a1b03a5605042976", + "placeholder": "​", + "style": "IPY_MODEL_fd7f741ef4054ab7b8bc692e4b71e04b", + "value": "Downloading (…)ce_transformers.json: 100%" + } + }, + "bd56d5bf6f3e45e99c746c4414f24f79": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_72800938513345898591b1fe44810aaf", + "max": 116, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_14fe74db8e4c4977803b462bc941af24", + "value": 116 + } + }, + "e5f97293ce03488398ee7eff2b7acb65": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_bb7a6e56d5e84db78fa525aeb533e546", + "placeholder": "​", + "style": "IPY_MODEL_7557209fd8784f3d9c614f230b3a4547", + "value": " 116/116 [00:00<00:00, 4.56kB/s]" + } + }, + "00b4a55efa1f440cb9427fc3261d1e12": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "bcac9643e7d846b4a1b03a5605042976": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fd7f741ef4054ab7b8bc692e4b71e04b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "72800938513345898591b1fe44810aaf": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "14fe74db8e4c4977803b462bc941af24": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "bb7a6e56d5e84db78fa525aeb533e546": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7557209fd8784f3d9c614f230b3a4547": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "241075466ab6455eb52ac3072766046b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_905a4aae088846319dd660c39971be1b", + "IPY_MODEL_1c85bfbd56864c538fb33fbb066c437d", + "IPY_MODEL_fdda33f9ab734b4c88b9c6c1facae84b" + ], + "layout": "IPY_MODEL_0db9b2f2ee2446859095a082c35d3111" + } + }, + "905a4aae088846319dd660c39971be1b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_17e12f0e81274ace8e6741644d57516a", + "placeholder": "​", + "style": "IPY_MODEL_c8162a3c0ecb4849b8715026656174cc", + "value": "Downloading (…)125/data_config.json: 100%" + } + }, + "1c85bfbd56864c538fb33fbb066c437d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_1853a24008f54bd18d730d8d3f70a7a7", + "max": 39265, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_0d2d84b74bba49269851798b8e75191a", + "value": 39265 + } + }, + "fdda33f9ab734b4c88b9c6c1facae84b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_a78062463dd94f4c8ad4453684017d5d", + "placeholder": "​", + "style": "IPY_MODEL_ebd5f31cbe5c4694ae21ed3de5a558cb", + "value": " 39.3k/39.3k [00:00<00:00, 1.72MB/s]" + } + }, + "0db9b2f2ee2446859095a082c35d3111": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "17e12f0e81274ace8e6741644d57516a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c8162a3c0ecb4849b8715026656174cc": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "1853a24008f54bd18d730d8d3f70a7a7": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0d2d84b74bba49269851798b8e75191a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "a78062463dd94f4c8ad4453684017d5d": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ebd5f31cbe5c4694ae21ed3de5a558cb": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "3763bc3b756e443aa83bbcfcbe56ea9b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_403eff6c9efe48da858f22802297a625", + "IPY_MODEL_780e4d663a4f45e087650776fb5fd4bd", + "IPY_MODEL_ed796dd3445c40cd9bdbe5dd8115f0b9" + ], + "layout": "IPY_MODEL_e39c3c4eb2db4d8b80cbf86157cfdcf3" + } + }, + "403eff6c9efe48da858f22802297a625": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_2b4e8ed72673494bb9531d22f37aa37f", + "placeholder": "​", + "style": "IPY_MODEL_fc0504f969c34a5999c2f046a17b9e58", + "value": "Downloading pytorch_model.bin: 100%" + } + }, + "780e4d663a4f45e087650776fb5fd4bd": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_2e60b7e5121b4f4cbe02c5e70d2436c4", + "max": 90888945, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_831417d971094b00b38d000e105556e1", + "value": 90888945 + } + }, + "ed796dd3445c40cd9bdbe5dd8115f0b9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_207b5bde178c48b6983ae98bd90372b9", + "placeholder": "​", + "style": "IPY_MODEL_bfe0555f0672497485e69bc7d156111e", + "value": " 90.9M/90.9M [00:00<00:00, 159MB/s]" + } + }, + "e39c3c4eb2db4d8b80cbf86157cfdcf3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2b4e8ed72673494bb9531d22f37aa37f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fc0504f969c34a5999c2f046a17b9e58": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "2e60b7e5121b4f4cbe02c5e70d2436c4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "831417d971094b00b38d000e105556e1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "207b5bde178c48b6983ae98bd90372b9": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "bfe0555f0672497485e69bc7d156111e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "96250a8028524757a432ec794b438d0e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_81a571f6382b45eabf40398b549b674d", + "IPY_MODEL_b5e18c4c4f3a4a3e9a5d8aa89b3c7222", + "IPY_MODEL_8ccd518744fa427fbd7466a192204f2d" + ], + "layout": "IPY_MODEL_3205286f337a482abe1999891a56db15" + } + }, + "81a571f6382b45eabf40398b549b674d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_2fd85852c8a446b794bef0414a5d1b42", + "placeholder": "​", + "style": "IPY_MODEL_cd2a8dd704e44787ae3e280451d36f39", + "value": "Downloading (…)nce_bert_config.json: 100%" + } + }, + "b5e18c4c4f3a4a3e9a5d8aa89b3c7222": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_33c9c9474d94430da4d8b1176c71b184", + "max": 53, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_3040da57fc3a491ca95c3ef746bd813c", + "value": 53 + } + }, + "8ccd518744fa427fbd7466a192204f2d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_44bb15aeab564ca6a5b34a9c2941e298", + "placeholder": "​", + "style": "IPY_MODEL_529b6d913e8a4f2eb7caae1219e95d38", + "value": " 53.0/53.0 [00:00<00:00, 2.10kB/s]" + } + }, + "3205286f337a482abe1999891a56db15": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2fd85852c8a446b794bef0414a5d1b42": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "cd2a8dd704e44787ae3e280451d36f39": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "33c9c9474d94430da4d8b1176c71b184": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3040da57fc3a491ca95c3ef746bd813c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "44bb15aeab564ca6a5b34a9c2941e298": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "529b6d913e8a4f2eb7caae1219e95d38": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "681b5052bf724cdca9d6a2d73114c1d1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_e53e9a1c02094db29f15099da40103cd", + "IPY_MODEL_6200267d273b48b3a35ac140de49630b", + "IPY_MODEL_1433d12e4c874c79bbbb0286d4eacde4" + ], + "layout": "IPY_MODEL_21f44d8a27be4f1aa0b0203ddc3527b1" + } + }, + "e53e9a1c02094db29f15099da40103cd": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_da7e7b42d0c2431e93a0189229cbbc5b", + "placeholder": "​", + "style": "IPY_MODEL_151f9c76297b4ca3bf6b71b08345e0dd", + "value": "Downloading (…)cial_tokens_map.json: 100%" + } + }, + "6200267d273b48b3a35ac140de49630b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_25099eccf4e84cb49fd9ed8b0ed3184f", + "max": 112, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_a1b8a7e0639c4170b826da2775ddc5df", + "value": 112 + } + }, + "1433d12e4c874c79bbbb0286d4eacde4": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_02c1215b364e4c7b9383b86c6daa4472", + "placeholder": "​", + "style": "IPY_MODEL_568133b1fa894d4288cc0cd302b851ef", + "value": " 112/112 [00:00<00:00, 4.91kB/s]" + } + }, + "21f44d8a27be4f1aa0b0203ddc3527b1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "da7e7b42d0c2431e93a0189229cbbc5b": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "151f9c76297b4ca3bf6b71b08345e0dd": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "25099eccf4e84cb49fd9ed8b0ed3184f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a1b8a7e0639c4170b826da2775ddc5df": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "02c1215b364e4c7b9383b86c6daa4472": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "568133b1fa894d4288cc0cd302b851ef": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "6faba8ae0c8b40b69543f3e91a67d225": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_d4816bb72f82473ca29bbcb0b37ffb68", + "IPY_MODEL_ddd9638742da46c4a3a82881dbe79846", + "IPY_MODEL_59f257cf1c6d44b090426525857c140a" + ], + "layout": "IPY_MODEL_40fe1b409e494a88b33cd34dc2aa6616" + } + }, + "d4816bb72f82473ca29bbcb0b37ffb68": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_d66ed2383e71446daa92c192ffb68ce5", + "placeholder": "​", + "style": "IPY_MODEL_0d8c13840d9b46b1895563aa41fcbd72", + "value": "Downloading (…)e9125/tokenizer.json: 100%" + } + }, + "ddd9638742da46c4a3a82881dbe79846": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_62e674c59ad84a2fa3f6f3f4e333db61", + "max": 466247, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_4ca5212c96054392871b75a0ef5c6875", + "value": 466247 + } + }, + "59f257cf1c6d44b090426525857c140a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_494979dd889744de9314ede61e10d2c1", + "placeholder": "​", + "style": "IPY_MODEL_a18dfa4b3fc14f278e1c875d54cb6341", + "value": " 466k/466k [00:00<00:00, 3.56MB/s]" + } + }, + "40fe1b409e494a88b33cd34dc2aa6616": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d66ed2383e71446daa92c192ffb68ce5": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0d8c13840d9b46b1895563aa41fcbd72": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "62e674c59ad84a2fa3f6f3f4e333db61": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "4ca5212c96054392871b75a0ef5c6875": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "494979dd889744de9314ede61e10d2c1": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a18dfa4b3fc14f278e1c875d54cb6341": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "37ffffeff297428da5b29b512360f939": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_f98261d50e2d400a84eaad5f4bc3a757", + "IPY_MODEL_0390606e1b964339a9a2802f0461a380", + "IPY_MODEL_21499c4a84784d8a80cfff923ec4f593" + ], + "layout": "IPY_MODEL_284f5506aa834873955e5b8e3539a60a" + } + }, + "f98261d50e2d400a84eaad5f4bc3a757": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_9f99f1b0afed481b8efc1a04788cdac8", + "placeholder": "​", + "style": "IPY_MODEL_6af24361f81243fca3cf416c487d08c7", + "value": "Downloading (…)okenizer_config.json: 100%" + } + }, + "0390606e1b964339a9a2802f0461a380": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_3f72b06f37bb457caffe815207c6af7c", + "max": 350, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_7ce328cb515342929c3e9bc538e90763", + "value": 350 + } + }, + "21499c4a84784d8a80cfff923ec4f593": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_100bd06a11b14becb016ec629683188e", + "placeholder": "​", + "style": "IPY_MODEL_d5f600e9d25b46e3a8acc6e66e69de36", + "value": " 350/350 [00:00<00:00, 19.4kB/s]" + } + }, + "284f5506aa834873955e5b8e3539a60a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "9f99f1b0afed481b8efc1a04788cdac8": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "6af24361f81243fca3cf416c487d08c7": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "3f72b06f37bb457caffe815207c6af7c": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7ce328cb515342929c3e9bc538e90763": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "100bd06a11b14becb016ec629683188e": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "d5f600e9d25b46e3a8acc6e66e69de36": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "cea3f981bbce4ab094b9b7d3cd1e3426": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_9fe070e4921c4aad95cfccb370ba14e5", + "IPY_MODEL_fc84582f240d4c208f10e37a4a8c8454", + "IPY_MODEL_573eb6654161424d89404c222301a17f" + ], + "layout": "IPY_MODEL_12ae0b0ee8f34ccea5289edfb174e387" + } + }, + "9fe070e4921c4aad95cfccb370ba14e5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ec1d511a8d874500902a03a05dbc728a", + "placeholder": "​", + "style": "IPY_MODEL_3e41a4ad2a13400595ac057fe4d6f54e", + "value": "Downloading (…)9125/train_script.py: 100%" + } + }, + "fc84582f240d4c208f10e37a4a8c8454": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_cf2f0bb859254cd1bbcd489e8b7de593", + "max": 13156, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_962d3c30407a4a97b75c5c44e7dfc468", + "value": 13156 + } + }, + "573eb6654161424d89404c222301a17f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5802642641a34552aeb8952350032e24", + "placeholder": "​", + "style": "IPY_MODEL_0df6988eac6d4dedbdc732a41d4330f9", + "value": " 13.2k/13.2k [00:00<00:00, 542kB/s]" + } + }, + "12ae0b0ee8f34ccea5289edfb174e387": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ec1d511a8d874500902a03a05dbc728a": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "3e41a4ad2a13400595ac057fe4d6f54e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "cf2f0bb859254cd1bbcd489e8b7de593": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "962d3c30407a4a97b75c5c44e7dfc468": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "5802642641a34552aeb8952350032e24": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "0df6988eac6d4dedbdc732a41d4330f9": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "c6c975acadf940c0b04c2eaaf06aa60a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_b1128267ec774682ba6c8237b746c96e", + "IPY_MODEL_c914b15925f7492a9201b63cf6912e5c", + "IPY_MODEL_9abfa4ffcf2547ab8b297c694f4a35a2" + ], + "layout": "IPY_MODEL_26e5d6f0d5094bada101e7077c942e80" + } + }, + "b1128267ec774682ba6c8237b746c96e": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ad90886ea329457fae3bc83d3499872f", + "placeholder": "​", + "style": "IPY_MODEL_af63497d6ccd4e36abf8757b54199ef6", + "value": "Downloading (…)7e55de9125/vocab.txt: 100%" + } + }, + "c914b15925f7492a9201b63cf6912e5c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_bad55ae359834077b82d5d9379313c22", + "max": 231508, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_ddc1de26de03472ea8e1fb05fcb1cb6b", + "value": 231508 + } + }, + "9abfa4ffcf2547ab8b297c694f4a35a2": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_fd3ea26946c84b50aac2082bcd5ebcc3", + "placeholder": "​", + "style": "IPY_MODEL_c88407178fbb4612b1b8222c3164b6d5", + "value": " 232k/232k [00:00<00:00, 3.43MB/s]" + } + }, + "26e5d6f0d5094bada101e7077c942e80": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ad90886ea329457fae3bc83d3499872f": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "af63497d6ccd4e36abf8757b54199ef6": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "bad55ae359834077b82d5d9379313c22": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ddc1de26de03472ea8e1fb05fcb1cb6b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "fd3ea26946c84b50aac2082bcd5ebcc3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "c88407178fbb4612b1b8222c3164b6d5": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "7069d66194ea4426be8dc0d7ed47b6d3": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_0bf3bcdf23354ea1847360045d26d9a1", + "IPY_MODEL_92c107fc11ec477b92401c97cb4b3338", + "IPY_MODEL_59792503e5d4455599186d5ff902821b" + ], + "layout": "IPY_MODEL_922a567fcc724b59b9d6f63adb843459" + } + }, + "0bf3bcdf23354ea1847360045d26d9a1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_1e0ab24cf65b4c03a6e3becdfbb21387", + "placeholder": "​", + "style": "IPY_MODEL_26431386aa6d4cc0aa49dd3edc03f950", + "value": "Downloading (…)5de9125/modules.json: 100%" + } + }, + "92c107fc11ec477b92401c97cb4b3338": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_5e48399e1c9e42339da52ebfc09b8dcb", + "max": 349, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_7775e97259be4f928888070a7c43fcb1", + "value": 349 + } + }, + "59792503e5d4455599186d5ff902821b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_e8a81f5b13e04735ba62bdbe90174e76", + "placeholder": "​", + "style": "IPY_MODEL_2fdb513e2bab417bb86ce04500531f92", + "value": " 349/349 [00:00<00:00, 13.5kB/s]" + } + }, + "922a567fcc724b59b9d6f63adb843459": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "1e0ab24cf65b4c03a6e3becdfbb21387": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "26431386aa6d4cc0aa49dd3edc03f950": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "5e48399e1c9e42339da52ebfc09b8dcb": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "7775e97259be4f928888070a7c43fcb1": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "e8a81f5b13e04735ba62bdbe90174e76": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2fdb513e2bab417bb86ce04500531f92": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "4ef1df4f11a6406c8ffe11d3be4af259": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_6454374431404c1ea46899c35c05b063", + "IPY_MODEL_73e34a464d6142d4bee73412fbc91e93", + "IPY_MODEL_c7eed26541f14cb8a92a29b99b569d34" + ], + "layout": "IPY_MODEL_9d4bac79b75f4d1b8d7965eb5d5c5bc3" + } + }, + "6454374431404c1ea46899c35c05b063": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_41b17d092d6c41f7a4d37d4b454c1825", + "placeholder": "​", + "style": "IPY_MODEL_51acf591d4f2434ba35a4665247c815f", + "value": "Map: 100%" + } + }, + "73e34a464d6142d4bee73412fbc91e93": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_70adad47fbe848ebb9497f683127adf7", + "max": 4329, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_a46e3ffffed1435087c74d615ceebe9d", + "value": 4329 + } + }, + "c7eed26541f14cb8a92a29b99b569d34": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_db7ee224b00b4d2eb787d24561e83ce4", + "placeholder": "​", + "style": "IPY_MODEL_4d51eb40e0a1457e8411536dfe0ddb0a", + "value": " 4329/4329 [00:00<00:00, 11617.98 examples/s]" + } + }, + "9d4bac79b75f4d1b8d7965eb5d5c5bc3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "41b17d092d6c41f7a4d37d4b454c1825": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "51acf591d4f2434ba35a4665247c815f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "70adad47fbe848ebb9497f683127adf7": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "a46e3ffffed1435087c74d615ceebe9d": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "db7ee224b00b4d2eb787d24561e83ce4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "4d51eb40e0a1457e8411536dfe0ddb0a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + } + } } - } - } - }, - "nbformat": 4, - "nbformat_minor": 1 -} + }, + "nbformat": 4, + "nbformat_minor": 0 +} \ No newline at end of file diff --git a/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_3.ipynb b/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_3.ipynb new file mode 100644 index 0000000..5fac5ab --- /dev/null +++ b/12 - NLP Using Transformers/Actuarial_Applications_of_NLP_Part_3.ipynb @@ -0,0 +1,1896 @@ +{ + "cells": [ + { + "cell_type": "markdown", + "metadata": { + "id": "kmbK3sewEVGy" + }, + "source": [ + "# Actuarial Applications of Natural Language Processing Using Transformers\n", + "### A Case Study for Processing Text Features in an Actuarial Context\n", + "### Part III – Case Studies on Car Accident Descriptions - Unsupervised Techniques Using ChatGPT\n", + "\n", + "By Andreas Troxler, September 2023\n", + "\n", + "In this Part III of the tutorial, you will learn how ChatGPT can be used to extract features from text when no labels are available.\n", + "This is very relevant in practice: text data is often available, but labels are missing or sparse!\n", + "\n", + "We use the car accident reports already familiar from Part I, and try to find out the number of vehicles involved and whether someone was injured.\n", + "\n", + "As a user of ChatGPT, you need to be aware of its limitations, which can lead to incorrect results. Limitations include the following:\n", + "* ChatGPT may create wrong answers, due to lack of common sense, lack of detailed and up-to-date information, lack of understanding of the context,biases and prejudices, etc.\n", + "* Results obtained by ChatGPT are not reproducible across runs and model versions.\n", + "* It is difficult to explain how ChatGPT arrives at the answer.\n", + "* ChatGPT is a very complex Large Language Model (LLM). As such, it requires significant computational resources.\n", + "* ...\n", + "\n", + "With that in mind, let's get started." + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "EnmTW4uhEVG3" + }, + "source": [ + "## Notebook Overview\n", + "\n", + "This notebook is divided into tutorial is divided into three parts; they are:\n", + "\n", + "1. [Introduction.](#intro)
\n", + " We begin by explaining pre-requisites. Then we turn to loading and exploring the dataset – ca. 6k records of English and German car accident reports with an average length of about 400 words. This is a repetition from Part I of the tutorial.

\n", + "\n", + "2. [Extract features using ChatGPT.](#chat_gpt)
\n", + " We apply ChatGPT to extract some features from this data.

\n", + " \n", + "3. [Conclusion](#conclusion)\n" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "hcc6Je4lEVG4" + }, + "source": [ + "\n", + "\n", + "## 1. Introduction\n", + "\n", + "In this section we discuss the pre-requisites, load and inspect the dataset." + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "iEu2UBDEEVG4" + }, + "source": [ + "\n", + "\n", + "### 1.1. Prerequisites\n" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "2mGZv-UxvKO_" + }, + "source": [ + "#### Computing Power and OpenAI Account\n", + "\n", + "In this notebook, we use the API provided by OpenAI. Therefore, it does not require GPU support.\n", + "\n", + "On the flipside, you need to [set up an OpenAI account](https://platform.openai.com/signup?launch) and generate your personal API authentication key. In the following, we assume that this key is stored in the file `openai-key.txt` in the working directory. Of course, you can use a different file name. Do not share your API key with others, or expose it in the browser or other client-side code." + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "qXPfoNIUIpuv" + }, + "source": [ + "#### Local files\n", + "Make sure the following files are available in the directory of the notebook:\n", + "* `tutorial_utils.py` - a collection of utility functions used throughout this notebook\n", + "* `NHTSA_NMVCCS_extract.parquet.gzip` - the data\n", + "* `openai-key.txt` - a text file containing your OpenAI API authentication key\n", + "\n", + "This notebook will create the following subdirectory:\n", + "* `results` - figures and Excel files" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "3ahENX7-EVG5" + }, + "source": [ + "#### Getting started with Python and Jupyter Notebook\n", + "\n", + "For this tutorial, we assume that you are already familiar with Python and Jupyter Notebook.\n", + "\n", + "In this section, Jupyter Notebook and Python settings are initialized.\n", + "For code in Python, the [PEP8 standard](https://www.python.org/dev/peps/pep-0008/)\n", + "(\"PEP = Python Enhancement Proposal\") is enforced with minor variations to improve readability.\n" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 17 + }, + "id": "1wK6e7a5EVG5", + "outputId": "0043b6d7-65ff-4d36-86d7-6acda4a5dc3c", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "" + ] + }, + "metadata": {} + } + ], + "source": [ + "# Notebook settings\n", + "\n", + "# clear the namespace variables\n", + "from IPython import get_ipython\n", + "get_ipython().run_line_magic(\"reset\", \"-sf\")\n", + "\n", + "# formatting: cell width\n", + "from IPython.display import display, HTML\n", + "display(HTML(\"\"))" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "5V9gFHqyEVG7" + }, + "source": [ + "#### Importing Required Libraries\n", + "\n", + "If you run this notebook on Google Colab, you will need to install the following libraries:" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "Mxggg0WmFDuy", + "colab": { + "base_uri": "https://localhost:8080/" + }, + "outputId": "010fad57-e734-4463-bd92-1333b1e887a2" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Requirement already satisfied: openai in /usr/local/lib/python3.10/dist-packages (0.28.0)\n", + "Requirement already satisfied: requests>=2.20 in /usr/local/lib/python3.10/dist-packages (from openai) (2.31.0)\n", + "Requirement already satisfied: tqdm in /usr/local/lib/python3.10/dist-packages (from openai) (4.66.1)\n", + "Requirement already satisfied: aiohttp in /usr/local/lib/python3.10/dist-packages (from openai) (3.8.5)\n", + "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests>=2.20->openai) (3.2.0)\n", + "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests>=2.20->openai) (3.4)\n", + "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests>=2.20->openai) (2.0.4)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests>=2.20->openai) (2023.7.22)\n", + "Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->openai) (23.1.0)\n", + "Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.10/dist-packages (from aiohttp->openai) (6.0.4)\n", + "Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /usr/local/lib/python3.10/dist-packages (from aiohttp->openai) (4.0.3)\n", + "Requirement already satisfied: yarl<2.0,>=1.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->openai) (1.9.2)\n", + "Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from aiohttp->openai) (1.4.0)\n", + "Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.10/dist-packages (from aiohttp->openai) (1.3.1)\n" + ] + } + ], + "source": [ + "!pip install openai" + ] + }, + { + "cell_type": "code", + "source": [ + "!pip install retry" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "aYrTzcumrSE9", + "outputId": "6b4b3aec-376c-4045-badd-2ae6c0e42df9" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Requirement already satisfied: retry in /usr/local/lib/python3.10/dist-packages (0.9.2)\n", + "Requirement already satisfied: decorator>=3.4.2 in /usr/local/lib/python3.10/dist-packages (from retry) (4.4.2)\n", + "Requirement already satisfied: py<2.0.0,>=1.4.26 in /usr/local/lib/python3.10/dist-packages (from retry) (1.11.0)\n" + ] + } + ] + }, + { + "cell_type": "code", + "source": [ + "!pip install kaleido" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "598t72H5Dxui", + "outputId": "84b8b633-3170-4afd-abea-86d7c54fe073" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Requirement already satisfied: kaleido in /usr/local/lib/python3.10/dist-packages (0.2.1)\n" + ] + } + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "7b2yEtZjEVG8" + }, + "source": [ + "Next, we import the required libraries:" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "LuwY5ubtEVG9", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [], + "source": [ + "import os\n", + "import openai\n", + "import pandas as pd\n", + "import plotly.express as px\n", + "from tqdm import tqdm\n", + "from retry import retry\n", + "from wordcloud import WordCloud\n", + "from tutorial_utils import evaluate_classifier" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "44WiOM3SEVG-" + }, + "source": [ + "\n", + "\n", + "### 1.2. Exploring the Data\n", + "\n", + "You can skip this section if you are already fammiliar with Part I of this tutorial.\n", + "\n", + "The data used throughout this tutorial is derived from data of a vehicle crash causation study performed in the United States from 2005 to 2007. The dataset has almost 7'000 records, each relating to one accident. For each case, a verbal description of the accident is available in English, which summarizes road and weather conditions, vehicles, drivers and passengers involved, preconditions, injury severities, etc. The same information is also encoded in tabular form, so that we can apply supervised learning techniques to train the NLP models and compare the information extracted from the verbal descriptions with the encoded data.\n", + "\n", + "The original data consists of multiple tables. For this tutorial, we have aggregated it into a single dataset and added German translations of the English accident descriptions. The translations were generated using the [DeepL python API](https://pypi.org/project/deepl/).\n", + "\n", + "To explore the data, let's load it into a Pandas DataFrame and examine its shape, columns and data types:" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "DogoPiqXEVG-", + "outputId": "cab3c351-d8ee-489f-9146-eb9d187bff22", + "pycharm": { + "name": "#%%\n" + } + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "shape of DataFrame: (6949, 16)\n", + "('level_0', dtype('int64'))\n", + "('index', dtype('int64'))\n", + "('SCASEID', dtype('int64'))\n", + "('SUMMARY_EN', dtype('O'))\n", + "('SUMMARY_GE', dtype('O'))\n", + "('INJSEVA', dtype('int64'))\n", + "('NUMTOTV', dtype('int64'))\n", + "('WEATHER1', dtype('int64'))\n", + "('WEATHER2', dtype('int64'))\n", + "('WEATHER3', dtype('int64'))\n", + "('WEATHER4', dtype('int64'))\n", + "('WEATHER5', dtype('int64'))\n", + "('WEATHER6', dtype('int64'))\n", + "('WEATHER7', dtype('int64'))\n", + "('WEATHER8', dtype('int64'))\n", + "('INJSEVB', dtype('int64'))\n" + ] + } + ], + "source": [ + "df = pd.read_parquet(\"NHTSA_NMVCCS_extract.parquet.gzip\")\n", + "print(f\"shape of DataFrame: {df.shape}\")\n", + "print(*list(zip(df.columns, df.dtypes)), sep=\"\\n\")" + ] + }, + { + "cell_type": "markdown", + "source": [ + "The column `SCASEID` is a unique case identifier.\n", + "\n", + "The columns `SUMMARY_EN` and `SUMMARY_GE` are strings representing the verbal descriptions of the accident in English and German, respectively.\n", + "\n", + "`NUMTOTV` is the number of vehicles involved in the case. Let's have a look at the distribution of this feature:" + ], + "metadata": { + "id": "HbWiphKq49iZ" + } + }, + { + "cell_type": "code", + "source": [ + "fig = px.bar(df[\"NUMTOTV\"].value_counts().sort_index(), width=640)\n", + "fig.update_layout(title=\"number of cases by number of vehicles\", xaxis_title=\"number of vehicles\",\n", + " yaxis_title=\"number of cases\")\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"num_vehicles\"}})" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 542 + }, + "id": "sZJYuvAc5HIW", + "outputId": "2aa6cf0c-2caf-4bd0-9600-2682e277702f" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "Most cases involve two vehicles, and only very few accidents involve more than three vehicles.\n", + "\n", + "Each of the columns `WEATHER1` to `WEATHER8` indicates the presence of a specific weather condition (1: weather condition present, 9999: presence of weather condition unknown, 0 otherwise):\n", + "\n", + "| column | meaning | count |\n", + "|---|---|---|\n", + "| `WEATHER1` | cloudy | 1112 |\n", + "| `WEATHER2` | snow | 114 |\n", + "| `WEATHER3` | fog, smog, smoke | 28 |\n", + "| `WEATHER4` | rain | 624 |\n", + "| `WEATHER5` | sleet, hail (freezing drizzle or rain) | 25 |\n", + "| `WEATHER6` | blowing snow | 38 |\n", + "| `WEATHER7` | severe crosswinds | 20 |\n", + "| `WEATHER8` | other | 25 |\n", + "\n", + "\n", + "These weather conditions are not mutually exclusive, i.e., more than one condition can be present in a single case. The frequency distribution looks as follows:" + ], + "metadata": { + "id": "AR_3rVMz5lyz" + } + }, + { + "cell_type": "code", + "source": [ + "fig=px.bar(x=range(1,9), y=[(df[\"WEATHER\"+str(i)]==1).sum() for i in range(1,9)], width=640)\n", + "fig.update_layout(title=\"number of cases by weather condition\", xaxis_title=\"weather condition\",\n", + " yaxis_title=\"number of cases\")\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"weather\"}})" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 542 + }, + "id": "aR7onfnc6IUY", + "outputId": "c5e55c64-39c9-48e0-c211-0341646d8abf" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "The most frequently recorded weather conditions are \"cloudy\" (`WEATHER1`) and \"rain\" (`WEATHER4`).\n", + "\n", + "`INJSEVA` indicates the most serious sustained injury in the accident. For instance, if one person was not injured, and another person suffered a non-incapacitating injury, injury class 2 was assigned to the case.\n", + "\n", + "Information on injury severity has been taken from police accident reports, which are not available in the data. Unfortunately, this information does not necessarily align with the case description: There are many cases for which the case description indicates the presence of an injury, but INJSEVA does not, and vice versa.\n", + "\n", + "For this reason, we created manually an additional column `INJSEVB` based on the case description, to indicate the presence of a (possible) bodily injury. The table below shows the distribution of number of cases by the two variables.\n", + "\n", + "| `INJSEVA` | meaning | count | `INJSEVB`=0 | `INJSEVB`=1 |\n", + "|---|---|---|---|---|\n", + "| 0 | O - No injury | 1'458 | 96| 1'554 |\n", + "| 1 | C - Possible injury | 1'112 | 1'298 | 2'410 |\n", + "| 2 | B - Non-incapacitating injury | 729 | 945 | 1'674 |\n", + "| 3 | A - Incapacitating injury | 304 | 373 | 677 |\n", + "| 4 | K - Killed | 5 | 114 | 119 |\n", + "| 5 | U - Injury, severity unknown | 44 | 122 | 166 |\n", + "| 6 | Died prior to crash | 0 | 0| 0 |\n", + "| 9 | Unknown if injured | 51 | 16 | 67 |\n", + "| 10 | No person in crash | 1 | 0| 1 |\n", + " 11 | No PAR (police accident report) obtained | 231 | 50 | 281 |\n", + "|**Total**| | **3'935** | **3'014**| **6'949**|\n", + "\n", + "Now we turn to the verbal accident descriptions. First, we examine the length of the English texts, `SUMMARY_EN`. To this end, we split the texts into words, with blank spaces as separator, and show a box plot of the text length by number of vehicles involved in the accident:" + ], + "metadata": { + "id": "5JgGwQUt6Y8l" + } + }, + { + "cell_type": "code", + "source": [ + "# statistics of summary length\n", + "df[\"words per case summary\"] = df[\"SUMMARY_EN\"].str.split().apply(len)\n", + "print(f\"Overall number of words by case summary: min {df['words per case summary'].min()}, \"\n", + " f\"average {df['words per case summary'].mean():.0f}, max {df['words per case summary'].max()}\")\n", + "fig = px.box(df, x=\"NUMTOTV\", y=\"words per case summary\", width=640)\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"text_length\"}})" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 559 + }, + "id": "EqRcgK837K42", + "outputId": "583bc6b9-b925-4f2b-dbb5-08c6d21bc102" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Overall number of words by case summary: min 60, average 419, max 1248\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "Not surprisingly, the length of the descriptions correlates with the number of vehicles involved.\n", + "\n", + "The average length is above 400 words.\n", + "\n", + "Let's examine one of the English texts and its German translation:" + ], + "metadata": { + "id": "aXS50_o07R_W" + } + }, + { + "cell_type": "code", + "source": [ + "display(HTML(df.loc[0, \"SUMMARY_EN\"]))" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 138 + }, + "id": "TFgOi5y_7a7w", + "outputId": "c38cdfe6-5fa0-4ff0-ab3d-52fee97088dd" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "V1, a 2000 Pontiac Montana minivan, made a left turn from a private driveway onto a northbound 5-lane two-way, dry asphalt roadway on a downhill grade. The posted speed limit on this roadway was 80 kmph (50 MPH). V1 entered the roadway by crossing over the two southbound lanes and then entering the third northbound lane, which was a left turn-only lane at a 4-way intersection. The driver of V1 intended to travel straight through the intersection, and so he began to change lanes to the right. He did not see V2, a 1994 Pontiac Grand Am, that was traveling in the second northbound lane. The northbound roadway had curved to the right prior to the private driveway that V1 had exited. As V1 began to change lanes to the right, the front of V1 contacted the left rear of V2 before coming to final rest on the roadway.\r \r The driver of V1 was a 60-year old male who reported that he had been traveling between 2-17 kmph (1-10 mph) prior to the crash. He had no health-related problems, and had taken no medication prior to the crash. He was rested and traveling back home. He was wearing his prescribed lenses that corrected a myopic (nearsighted) condition. He did not sustain any injuries from the crash and refused treatment.\r \r The Critical Precrash Event for the driver of V1 was when he began to travel over the lane line on the right side of the travel lane. The Critical Reason for the Critical Precrash Event was inadequate surveillance (failed to look, looked but did not see). Associated factors coded to the driver of V1 include an illegal use of a left turn lane (cited by police) and an unfamiliarity with the roadway. As per the driver of V1, this was the first time he had driven on this roadway. \r \r The driver of V2 was a 28-year old woman who reported that she had been traveling between 66-80 kmph (41-50 mph) prior to the crash. She had no health-related problems, and had taken no medication prior to the crash. She was rested and on her way home. She does not wear corrective lenses. She sustained minor injuries and was transported to a local trauma facility.\r \r The Critical Precrash Event for the driver of V2 was when the other vehicle encroached into her lane, from an adjacent lane (same direction) over the left lane line. The Critical Reason for the Critical Precrash Event was not coded to the driver of V2 and no associated factors were coded to her." + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "code", + "source": [ + "display(HTML(df.loc[0, \"SUMMARY_GE\"]))" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 173 + }, + "id": "0LSITZqq7ffd", + "outputId": "857968b6-81c0-4fdb-cd26-9df898135987" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "V1, ein Minivan der Marke Pontiac Montana aus dem Jahr 2000, bog von einer privaten Einfahrt nach links auf eine zweispurige, trockene Asphaltstraße mit 5 Fahrspuren in nördlicher Richtung und einem Gefälle ab. Die zulässige Höchstgeschwindigkeit auf dieser Fahrbahn betrug 80 km/h (50 MPH). V1 fuhr auf die Fahrbahn, indem er die beiden Fahrspuren in Richtung Süden überquerte und dann auf die dritte Fahrspur in Richtung Norden einfuhr, die an einer Kreuzung mit vier Fahrspuren nur für Linksabbieger vorgesehen war. Der Fahrer von V1 beabsichtigte, geradeaus über die Kreuzung zu fahren, und begann daher, die Spur nach rechts zu wechseln. Dabei übersah er V2, einen Pontiac Grand Am von 1994, der auf der zweiten Fahrspur in Richtung Norden unterwegs war. Die Fahrbahn in nördlicher Richtung war vor der privaten Einfahrt, aus der V1 herausgefahren war, nach rechts gebogen. Als V1 begann, die Spur nach rechts zu wechseln, berührte die Front von V1 das linke Heck von V2, bevor er auf der Fahrbahn zum Stehen kam. Der Fahrer von V1 war ein 60-jähriger Mann, der angab, vor dem Unfall mit einer Geschwindigkeit von 2 bis 17 km/h unterwegs gewesen zu sein. Er hatte keine gesundheitlichen Probleme und hatte vor dem Unfall keine Medikamente eingenommen. Er war ausgeruht und auf dem Weg nach Hause. Er trug die ihm verschriebenen Kontaktlinsen, die eine Kurzsichtigkeit korrigieren. Er zog sich bei dem Unfall keine Verletzungen zu und lehnte eine Behandlung ab. Das kritische Ereignis vor dem Unfall war für den Fahrer von V1, als er begann, die Fahrspurlinie auf der rechten Seite der Fahrbahn zu überfahren. Der kritische Grund für das kritische Ereignis vor dem Unfall war unzureichende Überwachung (nicht hingesehen, hingesehen, aber nicht gesehen). Zu den assoziierten Faktoren, die dem Fahrer von V1 zugeschrieben werden, gehören das illegale Benutzen einer Linksabbiegerspur (von der Polizei verwarnt) und die Unkenntnis der Fahrbahn. Für den Fahrer von V1 war es das erste Mal, dass er diese Fahrbahn befuhr. \r \r Bei der Fahrerin von V2 handelte es sich um eine 28-jährige Frau, die angab, vor dem Unfall mit einer Geschwindigkeit von 66-80 km/h unterwegs gewesen zu sein. Sie hatte keine gesundheitlichen Probleme und hatte vor dem Unfall keine Medikamente eingenommen. Sie war ausgeruht und befand sich auf dem Heimweg. Sie trägt keine Korrekturgläser. Sie erlitt leichte Verletzungen und wurde in eine örtliche Unfallklinik gebracht. Das kritische Ereignis vor dem Unfall war für die Fahrerin von V2, als das andere Fahrzeug von einer benachbarten Fahrspur (gleiche Richtung) über die linke Fahrspurlinie in ihre Spur eindrang. Der kritische Grund für das kritische Vorunfallereignis wurde der Fahrerin von V2 nicht zugeordnet, und es wurden ihr keine zugehörigen Faktoren zugeordnet." + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "To get an impression of the most frequent words, we generate a simple word cloud form all English case descriptions. By default, the word cloud excludes so-called stop words (such as articles, prepositions, pronouns, conjunctions, etc.), which are the most common words and do not add much information to the text." + ], + "metadata": { + "id": "iQSybuXr7oXF" + } + }, + { + "cell_type": "code", + "source": [ + "text = df[\"SUMMARY_EN\"].str.cat(sep=\" \")\n", + "\n", + "# Create and generate a word cloud image:\n", + "word_cloud = WordCloud(max_words=100, background_color=\"white\").generate(text)\n", + "\n", + "# Display the generated image:\n", + "fig = px.imshow(word_cloud, width=640)\n", + "fig.update_layout(xaxis_showticklabels=False, yaxis_showticklabels=False)\n", + "fig.show(config={\"toImageButtonOptions\": {\"format\": 'svg', \"filename\": \"word_cloud\"}})" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 542 + }, + "id": "qkpolrOT7tHV", + "outputId": "58952a6c-a752-4f91-cee2-2b6485a7eeea" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "7I4oINQQEVHB" + }, + "source": [ + "\n", + "\n", + "## 2. Extract Features Using ChatGPT\n", + "\n", + "Imagine the following situation: We are building a model to predict the severity of accidents based on features available in tabular form. We believe that knowing the number of vehicles involved in the and whether someone was injured would help improve the model. However, all we have available are accident reports containing the information in unstructured free text form.\n", + "\n", + "If we have sufficient data with labels, we can use supervised techniques such as examined in Part I of this tutorial.\n", + "\n", + "In this Part III, we learn an unsupervised approach that does not require labels.\n", + "\n", + "More precisely, we will use ChatGPT to extract the following information from the car accident reports:\n", + "* Was someone injured or killed?\n", + "* How many vehicles were involved?\n", + "\n", + "Let's get started." + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "Djm3pEdfEVHC" + }, + "source": [ + "\n", + "\n", + "### 2.1 First Steps With the ChatGPT API\n", + "\n", + "\n", + "The idea is very simple: We specify a number of questions and ask ChatGPT to provide answers based on a given accident report.\n", + "\n", + "The prompt might look as follows:\n", + "\n", + "```\n", + "Read the following text, and answer the following:\n", + "1. Was someone injured?\n", + "2. Was someone killed?\n", + "3. How many vehicles were involved?\n", + "4. Summarize your last answer by a number.\n", + "Text:\n", + "V1, a 2000 Pontiac Montana minivan, made a left turn [...]\n", + "```\n", + "\n", + "The response might look like:\n", + "\n", + "```\n", + "1. Yes, the driver of V2 sustained minor injuries.\n", + "2. No, no one was killed.\n", + "3. Two vehicles were involved.\n", + "4. 2\n", + "```\n", + "\n", + "So all we have to do is to extract the desired features from this response!\n", + "\n", + "We begin by writing a short function to call the OpenAI API.\n" + ] + }, + { + "cell_type": "code", + "source": [ + "@retry((openai.error.APIError, openai.error.ServiceUnavailableError), tries=10, delay=15)\n", + "def call_openai(content):\n", + " return openai.ChatCompletion.create(\n", + " model=\"gpt-3.5-turbo\",\n", + " messages=[{\"role\": \"user\", \"content\": content}],\n", + " temperature=0.2,\n", + " max_tokens=256,\n", + " top_p=1,\n", + " frequency_penalty=0,\n", + " presence_penalty=0\n", + " )" + ], + "metadata": { + "id": "uxKexE7OueWd" + }, + "execution_count": null, + "outputs": [] + }, + { + "cell_type": "markdown", + "source": [ + "Note that we have used the `retry` decorator to retry 10 times with a waiting time of 15 seconds to handle some of the most common exceptions (you are invited to develop more sophisticated ways to deal with such issues).\n", + "\n", + "The parameters have the following effects:\n", + "* `model`: Specifies the ChatGPT model version.\n", + "* `messages`: Specifies the content of the user prompt.\n", + "* `temperature`: Values in the interval $[0, 1]$. Controls the randomness of the text generated. A higher temperature results in more diverse and creative output, while a lower temperature makes the output more deterministic and focused. For our purpose, we require fact-based answers and therefore go for low values of temperature.\n", + "* `top_p`: Instead of considering all possible tokens, GPT-3 considers only a subset of tokens (the \"nucleus\") whose cumulative probability mass adds up to this threshold. With `top_p`=1, we allow all possible tokens.\n", + "* `frequency_penalty`: Penalizes repetition of words in the response. For our purpose, we don't mind word repetitions and therefore set this parameter to 0.\n", + "* `presence_penalty`: Encourages use of a diverse vocabulary in the response. For our purpose, this aspect is not important and therefore we set this parameter to 0.\n", + "\n", + "You are encouraged to experiment with these parameters.\n", + "\n", + "Please note that the results may not be reproducible between runs and model versions.\n", + "\n", + "Next, we specify the location of the API authentication key:" + ], + "metadata": { + "id": "RGBNLjDauh90" + } + }, + { + "cell_type": "code", + "source": [ + "openai.api_key_path = \"./openai-key-at.txt\"\n", + "openai.api_key = os.getenv(\"OPENAI_API_KEY\")" + ], + "metadata": { + "id": "g7vgKfVMzebY" + }, + "execution_count": null, + "outputs": [] + }, + { + "cell_type": "markdown", + "source": [ + "Now we are ready!\n", + "\n", + "We specify the following prompt ..." + ], + "metadata": { + "id": "Ah1X_jCzz0Y4" + } + }, + { + "cell_type": "code", + "source": [ + "prompt = \"\"\"\n", + "Read the following text, and answer the following:\n", + "1. Was someone injured?\n", + "2. Was someone killed?\n", + "3. How many vehicles were involved?\n", + "4. Summarize your last answer by a number.\n", + "Text:\n", + "\"\"\"\n", + "prompt" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 35 + }, + "id": "aPQSgdAG0BTM", + "outputId": "973a26a4-3eeb-40cf-b28c-400ff583cc82" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "execute_result", + "data": { + "text/plain": [ + "'\\nRead the following text, and answer the following:\\n1. Was someone injured?\\n2. Was someone killed?\\n3. How many vehicles were involved?\\n4. Summarize your last answer by a number.\\nText:\\n'" + ], + "application/vnd.google.colaboratory.intrinsic+json": { + "type": "string" + } + }, + "metadata": {}, + "execution_count": 15 + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "... and apply it to the first English accident report:" + ], + "metadata": { + "id": "rf9pctAV2Dyr" + } + }, + { + "cell_type": "code", + "source": [ + "response = call_openai(prompt + df.iloc[0][\"SUMMARY_EN\"])\n", + "response" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "s0ZTa-0b0keR", + "outputId": "f972af7c-5014-41bf-fbb5-c8fcb461d88f" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "execute_result", + "data": { + "text/plain": [ + " JSON: {\n", + " \"id\": \"chatcmpl-7vkj3d4NvHiu3Uy1BUIQyqVRp7FV2\",\n", + " \"object\": \"chat.completion\",\n", + " \"created\": 1693998665,\n", + " \"model\": \"gpt-3.5-turbo-0613\",\n", + " \"choices\": [\n", + " {\n", + " \"index\": 0,\n", + " \"message\": {\n", + " \"role\": \"assistant\",\n", + " \"content\": \"1. Yes, the driver of V2 sustained minor injuries.\\n2. No, no one was killed.\\n3. Two vehicles were involved.\\n4. 2\"\n", + " },\n", + " \"finish_reason\": \"stop\"\n", + " }\n", + " ],\n", + " \"usage\": {\n", + " \"prompt_tokens\": 618,\n", + " \"completion_tokens\": 33,\n", + " \"total_tokens\": 651\n", + " }\n", + "}" + ] + }, + "metadata": {}, + "execution_count": 16 + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "As you can see, we received a chat completion object, from which the response is easy to unpack:" + ], + "metadata": { + "id": "spUqVn8U2cCw" + } + }, + { + "cell_type": "code", + "source": [ + "print(response[\"choices\"][0][\"message\"][\"content\"])" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "44Hmpy2W20bU", + "outputId": "8214f583-24f4-4f92-9f60-5b7e946484ec" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "1. Yes, the driver of V2 sustained minor injuries.\n", + "2. No, no one was killed.\n", + "3. Two vehicles were involved.\n", + "4. 2\n" + ] + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "Indeed, the text says that \"[the driver of V2] sustained minor injuries and was transported to a local trauma facility\". There is no mention of a fatality, and there were two vehicles involved, namely V1 and V2:" + ], + "metadata": { + "id": "JlYtHQzM26wS" + } + }, + { + "cell_type": "code", + "source": [ + "display(HTML(df.loc[0, \"SUMMARY_EN\"]))" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 138 + }, + "id": "GOKidim53JUS", + "outputId": "73288c85-ae70-441c-f13c-4f2261265f22" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "V1, a 2000 Pontiac Montana minivan, made a left turn from a private driveway onto a northbound 5-lane two-way, dry asphalt roadway on a downhill grade. The posted speed limit on this roadway was 80 kmph (50 MPH). V1 entered the roadway by crossing over the two southbound lanes and then entering the third northbound lane, which was a left turn-only lane at a 4-way intersection. The driver of V1 intended to travel straight through the intersection, and so he began to change lanes to the right. He did not see V2, a 1994 Pontiac Grand Am, that was traveling in the second northbound lane. The northbound roadway had curved to the right prior to the private driveway that V1 had exited. As V1 began to change lanes to the right, the front of V1 contacted the left rear of V2 before coming to final rest on the roadway.\r \r The driver of V1 was a 60-year old male who reported that he had been traveling between 2-17 kmph (1-10 mph) prior to the crash. He had no health-related problems, and had taken no medication prior to the crash. He was rested and traveling back home. He was wearing his prescribed lenses that corrected a myopic (nearsighted) condition. He did not sustain any injuries from the crash and refused treatment.\r \r The Critical Precrash Event for the driver of V1 was when he began to travel over the lane line on the right side of the travel lane. The Critical Reason for the Critical Precrash Event was inadequate surveillance (failed to look, looked but did not see). Associated factors coded to the driver of V1 include an illegal use of a left turn lane (cited by police) and an unfamiliarity with the roadway. As per the driver of V1, this was the first time he had driven on this roadway. \r \r The driver of V2 was a 28-year old woman who reported that she had been traveling between 66-80 kmph (41-50 mph) prior to the crash. She had no health-related problems, and had taken no medication prior to the crash. She was rested and on her way home. She does not wear corrective lenses. She sustained minor injuries and was transported to a local trauma facility.\r \r The Critical Precrash Event for the driver of V2 was when the other vehicle encroached into her lane, from an adjacent lane (same direction) over the left lane line. The Critical Reason for the Critical Precrash Event was not coded to the driver of V2 and no associated factors were coded to her." + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "We can use the same English prompt and apply it to the German version of the accident report. The response is in English:" + ], + "metadata": { + "id": "CnI4fYcIyDrD" + } + }, + { + "cell_type": "code", + "source": [ + "text = df.iloc[0][\"SUMMARY_GE\"]\n", + "display(HTML(text))\n", + "response = call_openai(prompt + text)\n", + "print(response[\"choices\"][0][\"message\"][\"content\"])" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 243 + }, + "id": "Fd64ys9AyAiy", + "outputId": "9bf74be7-142b-4d0e-db8d-abb039a93c4d" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "V1, ein Minivan der Marke Pontiac Montana aus dem Jahr 2000, bog von einer privaten Einfahrt nach links auf eine zweispurige, trockene Asphaltstraße mit 5 Fahrspuren in nördlicher Richtung und einem Gefälle ab. Die zulässige Höchstgeschwindigkeit auf dieser Fahrbahn betrug 80 km/h (50 MPH). V1 fuhr auf die Fahrbahn, indem er die beiden Fahrspuren in Richtung Süden überquerte und dann auf die dritte Fahrspur in Richtung Norden einfuhr, die an einer Kreuzung mit vier Fahrspuren nur für Linksabbieger vorgesehen war. Der Fahrer von V1 beabsichtigte, geradeaus über die Kreuzung zu fahren, und begann daher, die Spur nach rechts zu wechseln. Dabei übersah er V2, einen Pontiac Grand Am von 1994, der auf der zweiten Fahrspur in Richtung Norden unterwegs war. Die Fahrbahn in nördlicher Richtung war vor der privaten Einfahrt, aus der V1 herausgefahren war, nach rechts gebogen. Als V1 begann, die Spur nach rechts zu wechseln, berührte die Front von V1 das linke Heck von V2, bevor er auf der Fahrbahn zum Stehen kam. Der Fahrer von V1 war ein 60-jähriger Mann, der angab, vor dem Unfall mit einer Geschwindigkeit von 2 bis 17 km/h unterwegs gewesen zu sein. Er hatte keine gesundheitlichen Probleme und hatte vor dem Unfall keine Medikamente eingenommen. Er war ausgeruht und auf dem Weg nach Hause. Er trug die ihm verschriebenen Kontaktlinsen, die eine Kurzsichtigkeit korrigieren. Er zog sich bei dem Unfall keine Verletzungen zu und lehnte eine Behandlung ab. Das kritische Ereignis vor dem Unfall war für den Fahrer von V1, als er begann, die Fahrspurlinie auf der rechten Seite der Fahrbahn zu überfahren. Der kritische Grund für das kritische Ereignis vor dem Unfall war unzureichende Überwachung (nicht hingesehen, hingesehen, aber nicht gesehen). Zu den assoziierten Faktoren, die dem Fahrer von V1 zugeschrieben werden, gehören das illegale Benutzen einer Linksabbiegerspur (von der Polizei verwarnt) und die Unkenntnis der Fahrbahn. Für den Fahrer von V1 war es das erste Mal, dass er diese Fahrbahn befuhr. \r \r Bei der Fahrerin von V2 handelte es sich um eine 28-jährige Frau, die angab, vor dem Unfall mit einer Geschwindigkeit von 66-80 km/h unterwegs gewesen zu sein. Sie hatte keine gesundheitlichen Probleme und hatte vor dem Unfall keine Medikamente eingenommen. Sie war ausgeruht und befand sich auf dem Heimweg. Sie trägt keine Korrekturgläser. Sie erlitt leichte Verletzungen und wurde in eine örtliche Unfallklinik gebracht. Das kritische Ereignis vor dem Unfall war für die Fahrerin von V2, als das andere Fahrzeug von einer benachbarten Fahrspur (gleiche Richtung) über die linke Fahrspurlinie in ihre Spur eindrang. Der kritische Grund für das kritische Vorunfallereignis wurde der Fahrerin von V2 nicht zugeordnet, und es wurden ihr keine zugehörigen Faktoren zugeordnet." + ] + }, + "metadata": {} + }, + { + "output_type": "stream", + "name": "stdout", + "text": [ + "1. Yes, the driver of V2 (Pontiac Grand Am) suffered minor injuries.\n", + "2. No, no one was killed.\n", + "3. Two vehicles were involved (V1 and V2).\n", + "4. 2\n" + ] + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "Now, we want to examine more examples. We store the results in a list." + ], + "metadata": { + "id": "HOccrBgK3oeh" + } + }, + { + "cell_type": "code", + "source": [ + "# reset results\n", + "results = []" + ], + "metadata": { + "id": "RWSxiwgD05bq" + }, + "execution_count": null, + "outputs": [] + }, + { + "cell_type": "markdown", + "source": [ + "It might happen that the following code stops, for instance due to temporary unavailability of the API. In this case, you can simply resume execution after a while.\n", + "\n", + "Feel free to change the upper bound of the loop. In order to run a large number of samples, you may need to switch to a paid scheme." + ], + "metadata": { + "id": "8M8dmb6X311g" + } + }, + { + "cell_type": "code", + "source": [ + "for i in tqdm(range(len(results), 10)):\n", + " text = df.iloc[i][\"SUMMARY_EN\"]\n", + " response = call_openai(prompt + text)\n", + " results.append(response[\"choices\"][0][\"message\"][\"content\"])" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "rlRJSJK40YWa", + "outputId": "c42ea9eb-a1a7-4602-9ae8-ddde9156355c" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "stream", + "name": "stderr", + "text": [ + "100%|██████████| 10/10 [00:42<00:00, 4.24s/it]\n" + ] + } + ] + }, + { + "cell_type": "code", + "source": [ + "# store the results in a DataFrame and export to a csv file\n", + "if not os.path.exists(\"./results\"): os.makedirs(\"./results\")\n", + "pd.DataFrame(results, columns=[\"response\"]).to_csv(f\"./results/NHTSA_responses_{i:04d}.csv\", index=False)" + ], + "metadata": { + "id": "k2ohc8bm4juc" + }, + "execution_count": null, + "outputs": [] + }, + { + "cell_type": "code", + "source": [ + "results" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "8dNQ3zns4UXY", + "outputId": "6162da8f-d48b-4701-b423-c2df7810b611" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "execute_result", + "data": { + "text/plain": [ + "['1. Yes, the driver of V2 sustained minor injuries.\\n2. No, no one was killed.\\n3. Two vehicles were involved.\\n4. 2',\n", + " '1. Yes, the driver of V2 was injured and bleeding.\\n2. No, no one was killed.\\n3. Two vehicles were involved.\\n4. 2',\n", + " '1. No one was injured.\\n2. No one was killed.\\n3. Two vehicles were involved.\\n4. The number of vehicles involved is 2.',\n", + " '1. Yes, the driver of vehicle one (V1) was injured.\\n2. No, no one was killed.\\n3. Only one vehicle (V1) was involved in the crash.\\n4. 1',\n", + " '1. Yes, the 17-year-old male driver of Vehicle #1 was transported to a hospital and treated for a complaint of pain.\\n2. No, no one was killed in the crash.\\n3. Two vehicles were involved in the crash.\\n4. 2',\n", + " '1. Yes, the driver of Vehicle #2 and the passenger in Vehicle #2 had minor injuries to the head/neck areas.\\n2. No, no one was killed in the crash.\\n3. Two vehicles were involved in the crash.\\n4. 2',\n", + " '1. Yes, someone was injured. \\n2. No, no one was killed. \\n3. Two vehicles were involved. \\n4. The number of vehicles involved was two.',\n", + " '1. Yes, someone was injured. The driver of Vehicle #1, an 82-year-old male, was transported to a local hospital for a head injury.\\n2. No, no one was killed.\\n3. Only one vehicle, Vehicle #1 (2004 Subaru Forester), was involved in the crash.\\n4. 1',\n", + " '1. Yes, the driver of Vehicle #1 was injured.\\n2. No, no one was killed.\\n3. Two vehicles were involved.\\n4. 2',\n", + " '1. Yes, the 19-year-old female driver of Vehicle #1 was injured and transported, treated, and released for minor bleeding to the head.\\n2. No, there is no mention of anyone being killed in the text.\\n3. Two vehicles were involved in the crash - Vehicle #1 (1987 Honda Accord) and Vehicle #2 (1994 Honda Civic).\\n4. The number of vehicles involved is 2.']" + ] + }, + "metadata": {}, + "execution_count": 23 + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "\n", + "\n", + "### 2.2 Extracting the Features from the Reponses\n", + "\n", + "Next, we need to extract the desired features from the responses. We write a few of functions to achieve this.\n", + "\n", + "The first function, `first_matching_expression`, accepts a string, a dictionary and a default value as inputs. The dictionary is supposed to hold a mapping from expressions to values. The function searches the expression which appears first in the string and returns its corresponding value. If no expression is found, the default value is returned." + ], + "metadata": { + "id": "zTSnboVA7omm" + } + }, + { + "cell_type": "code", + "source": [ + "def first_matching_expression(string, dictionary, default):\n", + " \"\"\" Given a string and a dict of {expression: value}, returns value corresponding to first occurring expression. \"\"\"\n", + " # put default at end of the string\n", + " positions = [(len(string), default)]\n", + " # append with tuple (position, value) for each (item: value) in the dictionary\n", + " for item, value in dictionary.items():\n", + " position = string.find(item)\n", + " # suppress items which were not found\n", + " if position >= 0:\n", + " positions.append((position, value))\n", + " # return value corresponding to first position\n", + " return sorted(positions)[0][1]" + ], + "metadata": { + "id": "qXu1DY-X8Deh" + }, + "execution_count": null, + "outputs": [] + }, + { + "cell_type": "markdown", + "source": [ + "The next function splits a response into separate substrings representing the answers to each of the four questions. Then it extracts return values by searching defined expressions, by means of the function `first_matching_expression`. It returns both the substrings and the extracted information.\n", + "\n", + "This function is highly task-specific." + ], + "metadata": { + "id": "hGcyZO519Bf3" + } + }, + { + "cell_type": "code", + "source": [ + "def extract_responses(string):\n", + " string = string.lower() + \" \"\n", + " i1 = string.find(\"1. \")\n", + " i2 = string.find(\"2. \")\n", + " i3 = string.find(\"3. \")\n", + " i4 = string.find(\"4. \")\n", + " s1 = string[i1:i2][3:]\n", + " s2 = string[i2:i3][3:]\n", + " s3 = string[i3:i4][3:]\n", + " s4 = string[i4:][3:]\n", + " d1 = {\"yes\": 1, \"minor\": 1}\n", + " r1 = first_matching_expression(s1, d1, 0)\n", + " d2 = {\"yes\": 1}\n", + " r2 = first_matching_expression(s2, d2, 0)\n", + " d3 = {\"1\": 1, \"2\": 2, \"3\": 3, \"4\": 4, \"5\": 5, \"6\": 6, \"7\": 7, \"8\": 8,\n", + " \"9\": 9, \"only\": 1, \"one\": 1, \"two\": 2, \"three\": 3, \"four\": 4,\n", + " \"five\": 5, \"six\": 6, \"seven\": 7, \"eight\": 8, \"nine\": 9}\n", + " r3 = first_matching_expression(s3, d3, 1)\n", + " r4 = first_matching_expression(s4, d3, 1)\n", + " return [s1, s2, s3, s4, r1, r2, r3, r4]" + ], + "metadata": { + "id": "dyOpRR6C9755" + }, + "execution_count": null, + "outputs": [] + }, + { + "cell_type": "markdown", + "source": [ + "Finally, we define a function `add_responses_to_df` that takes a list of responses, applies `extract_responses`, concatenates the information to the original DataFrame and stores the resulting DataFrame.\n" + ], + "metadata": { + "id": "__CykhPc-ek9" + } + }, + { + "cell_type": "code", + "source": [ + "def add_responses_to_df(responses, df, path_file_result):\n", + " df_results = pd.concat([\n", + " df.iloc[:len(responses)],\n", + " pd.DataFrame(\n", + " [extract_responses(r) for r in responses[\"response\"]],\n", + " columns=[\"s1\", \"s2\", \"s3\", \"s4\", \"r1\", \"r2\", \"r3\", \"r4\"])],\n", + " axis=1)\n", + " df_results.to_excel(path_file_result)\n", + " return df_results" + ], + "metadata": { + "id": "qmxcc4i6-i1G" + }, + "execution_count": null, + "outputs": [] + }, + { + "cell_type": "markdown", + "source": [ + "We load the responses for the first 1000 samples from a previous run of this notebook." + ], + "metadata": { + "id": "VHwNErPL7OeN" + } + }, + { + "cell_type": "code", + "source": [ + "results = pd.read_csv(\"NHTSA_responses_0999.csv\")\n", + "results" + ], + "metadata": { + "id": "k5Uwn0Z3_rOU", + "colab": { + "base_uri": "https://localhost:8080/", + "height": 423 + }, + "outputId": "cc9d8395-d14a-4ee6-e8ca-c363b569edf4" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "execute_result", + "data": { + "text/plain": [ + " response\n", + "0 1. Yes, the driver of V2 sustained minor injur...\n", + "1 1. No, the driver of V2 was not injured in the...\n", + "2 1. No one was injured.\\n2. No one was killed.\\...\n", + "3 1. Yes, the driver of vehicle one (V1) was inj...\n", + "4 1. Yes, the 17-year-old male driver of Vehicle...\n", + ".. ...\n", + "995 1. Yes, someone was injured.\\n2. No, no one wa...\n", + "996 1. No, no one was injured.\\n2. No, no one was ...\n", + "997 1. No one was injured.\\n2. No one was killed.\\...\n", + "998 1. No one was injured.\\n2. No one was killed.\\...\n", + "999 1. It is not mentioned in the text whether som...\n", + "\n", + "[1000 rows x 1 columns]" + ], + "text/html": [ + "\n", + "
\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
response
01. Yes, the driver of V2 sustained minor injur...
11. No, the driver of V2 was not injured in the...
21. No one was injured.\\n2. No one was killed.\\...
31. Yes, the driver of vehicle one (V1) was inj...
41. Yes, the 17-year-old male driver of Vehicle...
......
9951. Yes, someone was injured.\\n2. No, no one wa...
9961. No, no one was injured.\\n2. No, no one was ...
9971. No one was injured.\\n2. No one was killed.\\...
9981. No one was injured.\\n2. No one was killed.\\...
9991. It is not mentioned in the text whether som...
\n", + "

1000 rows × 1 columns

\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + "
\n" + ] + }, + "metadata": {}, + "execution_count": 27 + } + ] + }, + { + "cell_type": "code", + "source": [ + "df_res = add_responses_to_df(results, df, \"./results/df_results.xlsx\")" + ], + "metadata": { + "id": "p2LA4Gd3_3hp" + }, + "execution_count": null, + "outputs": [] + }, + { + "cell_type": "markdown", + "source": [ + "\n", + "\n", + "### 2.3 Performance evaluation\n", + "\n", + "Next, we want to evaluate the performance of our model.\n", + "\n", + "Let's look at the confusion matrix of the predicted vs true number of involved vehicles:\n", + "\n", + "\n" + ], + "metadata": { + "id": "_g3KTpBW60o_" + } + }, + { + "cell_type": "code", + "source": [ + "y_true = df_res[\"NUMTOTV\"]\n", + "y_pred = df_res[\"r4\"]\n", + "labels = [str(i) for i in sorted(set(y_true).union(set(y_pred)))]\n", + "_ = evaluate_classifier(y_true, y_pred, None, labels,\n", + " \"ChatGPT #vehicles\", \"cm_nv_chat_gpt\")" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 820 + }, + "id": "mbPJA_04FQds", + "outputId": "cb54bf9a-9737-4f89-c6e8-2d36f4e20772" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "ChatGPT #vehicles\n", + "accuracy score = 97.4%, log loss = nan, Brier loss = nan\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 1 0.99 0.97 0.98 256\n", + " 2 0.98 1.00 0.99 625\n", + " 3 0.92 0.90 0.91 94\n", + " 4 1.00 0.75 0.86 20\n", + " 5 0.67 0.50 0.57 4\n", + " 8 1.00 1.00 1.00 1\n", + "\n", + " accuracy 0.97 1000\n", + " macro avg 0.93 0.85 0.88 1000\n", + "weighted avg 0.97 0.97 0.97 1000\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "For the identification of cases with bodily injury, the performance looks as follows:" + ], + "metadata": { + "id": "xLq_B72X8nel" + } + }, + { + "cell_type": "code", + "source": [ + "y_true = df_res[\"INJSEVB\"]\n", + "y_pred = 1- (1 - df_res[\"r1\"]) * (1 - df_res[\"r2\"])\n", + "labels = [str(i) for i in sorted(set(y_true).union(set(y_pred)))]\n", + "_ = evaluate_classifier(y_true, y_pred, None, labels,\n", + " \"ChatGPT injury\", \"cm_inj_chat_gpt\")" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 750 + }, + "id": "16A9KflsCj-3", + "outputId": "e3f5495e-9543-40c9-c76a-f3014688ccb8" + }, + "execution_count": null, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "ChatGPT injury\n", + "accuracy score = 88.1%, log loss = nan, Brier loss = nan\n", + "classification report\n", + " precision recall f1-score support\n", + "\n", + " 0 0.87 0.81 0.84 382\n", + " 1 0.89 0.92 0.91 618\n", + "\n", + " accuracy 0.88 1000\n", + " macro avg 0.88 0.87 0.87 1000\n", + "weighted avg 0.88 0.88 0.88 1000\n", + "\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/html": [ + "\n", + "\n", + "\n", + "
\n", + "
\n", + "\n", + "" + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "markdown", + "source": [ + "For both tasks, we can compare the accuracy score to the ones achieved by the supervised approaches examined in Part I of this tutorial.\n", + "We observe the following:\n", + "* The accuracy score is higher than with supervised training of a logistic regression classifier on the DistilBERT-encoded texts.\n", + "* The accuracy score is somewhat below the one obtained using task-specific fine-tuning of the DistilBERT model.\n", + "\n", + "Note, however, that here we have not employed any task-specific training!" + ], + "metadata": { + "id": "TqgnpwRx9mhE" + } + }, + { + "cell_type": "markdown", + "metadata": { + "id": "0Wet19WmEVHN" + }, + "source": [ + "\n", + "\n", + "## 3. Conclusion\n", + "\n", + "Congratulations!\n", + "\n", + "In this Part III of the tutorial, you have used ChatGPT to extract features from text in an unsupervised fashion.\n", + "\n", + "Advantages of this approach are certainly that no labels are required, and that it is very simple to implement.\n", + "\n", + "On the other hand, execution time is longer than for the supervised approaches examined in Part I.\n", + "\n", + "In terms of accuracy score, the approach used here performs better than supervised training of a logistic regression classifier on the DistilBERT-encoded texts, but somewhat worse than task-specific supervised fine-tuning of the DistilBERT model.\n", + "Note however that we haven't performed any fine-tuning in this notebook.\n", + "\n", + "In practice, the unsupervised and supervised techniques could be combined, for instance by using ChatGPT to generate labels for a sufficintly large set of data, that is then used in a supervised setting.\n", + "\n", + "If you have enjoyed this tutorial, feel free to apply any of the approaches - or improved versions, of course - to your own text data, to enrich your structured features available for supervised learning tasks." + ] + } + ], + "metadata": { + "colab": { + "provenance": [] + }, + "kernelspec": { + "display_name": "Python 3", + "name": "python3" + }, + "language_info": { + "codemirror_mode": { + "name": "ipython", + "version": 3 + }, + "file_extension": ".py", + "mimetype": "text/x-python", + "name": "python", + "nbconvert_exporter": "python", + "pygments_lexer": "ipython3", + "version": "3.7.10" + } + }, + "nbformat": 4, + "nbformat_minor": 0 +} \ No newline at end of file