data_preparation.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "R4mY1eGn7X7-"
   },
   "source": [
    "**Аннотаяция для проверяющего:**\n",
    "\n",
    "В данном нотубуке реализована сборка датасета из интернета, исследование данных, создание дополнительных фичей, которые могут быть полезны в будущем при обучении. Не все они будут использованы в дальнейшем, это не баг.\n",
    "\n",
    "Описание результатов и проведенной работы - в поледних ячейках датасета.\n",
    "\n",
    "По мере работы с данными в некоторых ячейчах я комментирую свои действия и ход мыслей **в виде комментариев к коду**.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "PpFxu5H9gOYE"
   },
   "source": [
    "### Сбор данных из интернета"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "mPOFnnQoIoZK"
   },
   "outputs": [],
   "source": [
    "import requests as r\n",
    "from bs4 import BeautifulSoup\n",
    "import pandas as pd\n",
    "import re\n",
    "import numpy as np"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 300,
     "status": "ok",
     "timestamp": 1707156167841,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "mNaKIywJK6pM",
    "outputId": "1d755946-9e30-4d3a-eee5-ae08ab43450d"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['series-1-episode-01-pilot-episode',\n",
       " 'series-1-episode-02-the-big-bran-hypothesis',\n",
       " 'series-1-episode-03-the-fuzzy-boots-corollary',\n",
       " 'series-1-episode-04-the-luminous-fish-effect',\n",
       " 'series-1-episode-05-the-hamburger-postulate',\n",
       " 'series-1-episode-06-the-middle-earth-paradigm',\n",
       " 'series-1-episode-07-the-dumpling-paradox',\n",
       " 'series-1-episode-08-the-grasshopper-experiment',\n",
       " 'series-1-episode-09-the-cooper-hofstadter-polarization',\n",
       " 'series-1-episode-10-the-loobenfeld-decay',\n",
       " 'series-1-episode-11-the-pancake-batter-anomaly',\n",
       " 'series-1-episode-12-the-jerusalem-duality',\n",
       " 'series-1-episode-13-the-bat-jar-conjecture',\n",
       " 'series-1-episode-14-the-nerdvana-annihilation',\n",
       " 'series-1-episode-15-the-porkchop-indeterminacy',\n",
       " 'series-1-episode-16-the-peanut-reaction',\n",
       " 'series-1-episode-17-the-tangerine-factor',\n",
       " 'series-2-episode-01-the-bad-fish-paradigm',\n",
       " 'series-2-episode-02-the-codpiece-topology',\n",
       " 'series-2-episode-03-the-barbarian-sublimation',\n",
       " 'series-2-episode-04-the-griffin-equivalency',\n",
       " 'series-2-episode-05-the-euclid-alternative',\n",
       " 'series-2-episode-06-the-cooper-nowitzki-theorem',\n",
       " 'series-2-episode-07-the-panty-pinata-polarization',\n",
       " 'series-2-episode-08-the-lizard-spock-expansion',\n",
       " 'series-2-episode-09-the-white-asparagus-triangulation',\n",
       " 'series-2-episode-10-the-vartabedian-conundrum',\n",
       " 'series-2-episode-11-the-bath-item-gift-hypothesis',\n",
       " 'series-2-episode-12-the-killer-robot-instability',\n",
       " 'series-2-episode-13-the-friendship-algorithm',\n",
       " 'series-2-episode-14-the-financial-permeability',\n",
       " 'series-2-episode-15-the-maternal-capacitance',\n",
       " 'series-2-episode-16-the-cushion-saturation',\n",
       " 'series-2-episode-17-the-terminator-decoupling',\n",
       " 'series-2-episode-18-the-work-song-nanocluster',\n",
       " 'series-2-episode-19-the-dead-hooker-juxtaposition',\n",
       " 'series-2-episode-20-the-hofstadter-isotope',\n",
       " 'series-2-episode-21-the-vegas-renormalization',\n",
       " 'series-2-episode-22-the-classified-materials-turbulence',\n",
       " 'series-2-episode-23-the-monopolar-expedition',\n",
       " 'series-3-episode-01-the-electric-can-opener-fluctuation',\n",
       " 'series-3-episode-02-the-jiminy-conjecture',\n",
       " 'series-3-episode-03-the-gothowitz-deviation',\n",
       " 'series-3-episode-04-the-pirate-solution',\n",
       " 'series-3-episode-05-the-creepy-candy-coating-corollary',\n",
       " 'series-3-episode-06-the-cornhusker-vortex',\n",
       " 'series-3-episode-07-the-guitarist-amplification',\n",
       " 'series-3-episode-08-the-adhesive-duck-deficiency',\n",
       " 'series-3-episode-09-the-vengeance-formulation',\n",
       " 'series-3-episode-10-the-gorilla-experiment',\n",
       " 'series-3-episode-11-the-maternal-congruence',\n",
       " 'series-3-episode-12-the-psychic-vortex',\n",
       " 'series-3-episode-13-the-bozeman-reaction',\n",
       " 'series-3-episode-14-the-einstein-approximation',\n",
       " 'series-3-episode-15-the-large-hadron-collision',\n",
       " 'series-3-episode-16-the-excelsior-acquisition',\n",
       " 'series-3-episode-17-the-precious-fragmentation',\n",
       " 'series-3-episode-18-the-pants-alternative',\n",
       " 'series-3-episode-19-the-wheaton-recurrence',\n",
       " 'series-3-episode-20-the-spaghetti-catalyst',\n",
       " 'series-3-episode-21-the-plimpton-stimulation',\n",
       " 'series-3-episode-22-the-staircase-implementation',\n",
       " 'series-3-episode-23-the-lunar-excitation',\n",
       " 'series-4-episode-01-the-robotic-manipulation',\n",
       " 'series-4-episode-02-the-cruciferous-vegetable-amplification',\n",
       " 'series-4-episode-03-the-zazzy-substitution',\n",
       " 'series-4-episode-04-the-hot-troll-deviation',\n",
       " 'series-4-episode-05-the-desperation-emanation',\n",
       " 'series-4-episode-06-the-irish-pub-formulation',\n",
       " 'series-4-episode-07-the-apology-insufficiency',\n",
       " 'series-4-episode-08-the-21-second-excitation',\n",
       " 'series-4-episode-09-the-boyfriend-complexity',\n",
       " 'series-4-episode-10-the-alien-parasite-hypothesis',\n",
       " 'series-4-episode-11-the-justice-league-recombination',\n",
       " 'series-4-episode-12-the-bus-pants-utilization',\n",
       " 'series-4-episode-13-the-love-car-displacement',\n",
       " 'series-4-episode-14-the-thespian-catalyst',\n",
       " 'series-4-episode-15-the-benefactor-factor',\n",
       " 'series-4-episode-16-the-cohabitation-formulation',\n",
       " 'series-4-episode-17-the-toast-derivation',\n",
       " 'series-4-episode-18-the-prestidigitation-approximation',\n",
       " 'series-4-episode-19-the-zarnecki-incursion',\n",
       " 'series-4-episode-20-the-herb-garden-germination',\n",
       " 'series-4-episode-21-the-agreement-dissection',\n",
       " 'series-4-episode-22-the-wildebeest-implementation',\n",
       " 'series-4-episode-23-the-engagement-reaction',\n",
       " 'series-4-episode-24-the-roommate-transmogrification',\n",
       " 'series-5-episode-01-the-skank-reflex-analysis',\n",
       " 'series-5-episode-02-the-infestation-hypothesis',\n",
       " 'series-5-episode-03-the-pulled-groin-extrapolation',\n",
       " 'series-5-episode-04-the-wiggly-finger-catalyst',\n",
       " 'series-5-episode-05-the-russian-rocket-reaction',\n",
       " 'series-5-episode-06-the-rhinitis-revelation',\n",
       " 'series-5-episode-07-the-good-guy-fluctuation',\n",
       " 'series-5-episode-08-the-isolation-permutation',\n",
       " 'series-5-episode-09-the-ornithophobia-diffusion',\n",
       " 'series-5-episode-10-the-flaming-spittoon-acquisition',\n",
       " 'series-5-episode-11-the-speckerman-recurrence',\n",
       " 'series-5-episode-12-the-shiny-trinket-maneouvre',\n",
       " 'series-5-episode-13-the-recombination-hypothesis',\n",
       " 'series-5-episode-14-the-beta-test-initiation',\n",
       " 'series-5-episode-15-the-friendship-contraction',\n",
       " 'series-5-episode-16-the-vacation-solution',\n",
       " 'series-5-episode-17-the-rothman-disintegration',\n",
       " 'series-5-episode-18-the-werewolf-transformation',\n",
       " 'series-5-episode-19-the-weekend-vortex',\n",
       " 'series-5-episode-20-the-transporter-malfunction',\n",
       " 'series-5-episode-21-the-hawking-excitation',\n",
       " 'series-5-episode-22-the-stag-convergence',\n",
       " 'series-5-episode-23-the-launch-acceleration',\n",
       " 'series-5-episode-24-the-countdown-reflection',\n",
       " 'series-6-episode-01-the-date-night-variable',\n",
       " 'series-6-episode-02-the-decoupling-fluctuation',\n",
       " 'series-6-episode-03-the-higgs-boson-observation',\n",
       " 'series-6-episode-04-the-re-entry-minimization',\n",
       " 'series-6-episode-05-the-holographic-excitation',\n",
       " 'series-6-episode-06-the-extract-obliteration',\n",
       " 'series-6-episode-07-the-habitation-configuration',\n",
       " 'series-6-episode-08-the-43-peculiarity',\n",
       " 'series-6-episode-09-the-parking-spot-escalation',\n",
       " 'series-6-episode-10-the-fish-guts-displacement',\n",
       " 'series-6-episode-11-the-santa-simulation',\n",
       " 'series-6-episode-12-the-egg-salad-equivalency',\n",
       " 'series-6-episode-13-the-bakersfield-expedition',\n",
       " 'series-6-episode-14-the-cooper/kripke-inversion',\n",
       " 'series-6-episode-15-the-spoiler-alert-segmentation',\n",
       " 'series-6-episode-16-the-tangible-affection-proof',\n",
       " 'series-6-episode-17-the-monster-isolation',\n",
       " 'series-6-episode-18-the-contractual-obligation-implementation',\n",
       " 'series-6-episode-19-the-closet-reconfiguration',\n",
       " 'series-6-episode-20-the-tenure-turbulence',\n",
       " 'series-6-episode-21-the-closure-alternative',\n",
       " 'series-6-episode-22-the-proton-resurgence',\n",
       " 'series-6-episode-23-the-love-spell-potential',\n",
       " 'series-6-episode-24-the-bon-voyage-reaction',\n",
       " 'series-7-episode-01-the-hofstadter-insufficiency',\n",
       " 'series-7-episode-02-the-deception-verification',\n",
       " 'series-7-episode-03-the-scavenger-vortex',\n",
       " 'series-7-episode-04-the-raiders-minimization',\n",
       " 'series-7-episode-05-the-workplace-proximity',\n",
       " 'series-7-episode-06-the-romance-resonance',\n",
       " 'series-7-episode-07-the-proton-displacement',\n",
       " 'series-7-episode-08-the-itchy-brain-simulation',\n",
       " 'series-7-episode-09-the-thanksgiving-decoupling',\n",
       " 'series-7-episode-10-the-discovery-dissipation',\n",
       " 'series-7-episode-11-the-cooper-extraction',\n",
       " 'series-7-episode-12-the-hesitation-ramification',\n",
       " 'series-7-episode-13-the-occupation-recalibration',\n",
       " 'series-7-episode-14-the-convention-conundrum',\n",
       " 'series-7-episode-15-the-locomotive-manipulation',\n",
       " 'series-7-episode-16-the-table-polarisation',\n",
       " 'series-7-episode-17-the-friendship-turbulence',\n",
       " 'series-7-episode-18-the-mommy-observation',\n",
       " 'series-7-episode-19-the-indecision-amalgamation',\n",
       " 'series-7-episode-20-the-relationship-diremption',\n",
       " 'series-7-episode-21-the-anything-can-happen-recurrence',\n",
       " 'series-7-episode-22-the-proton-transmogrification',\n",
       " 'series-7-episode-23-the-gorilla-dissolution',\n",
       " 'series-7-episode-24-the-status-quo-combustion',\n",
       " 'series-8-episode-01-the-locomotion-interruption',\n",
       " 'series-8-episode-02-the-junior-professor-solution',\n",
       " 'series-8-episode-03-the-first-pitch-insufficiency',\n",
       " 'series-8-episode-04-the-hook-up-reverbration',\n",
       " 'series-8-episode-05-the-focus-attenuation',\n",
       " 'series-8-episode-06-the-expedition-approximation',\n",
       " 'series-8-episode-07-the-misinterpretation-agitation',\n",
       " 'series-8-episode-08-the-prom-equivalency',\n",
       " 'series-8-episode-09-the-septum-deviation',\n",
       " 'series-8-episode-10-the-champagne-reflection',\n",
       " 'series-8-episode-11-the-clean-room-infiltration',\n",
       " 'series-8-episode-12-the-space-probe-disintegration',\n",
       " 'series-8-episode-13-the-anxiety-optimisation',\n",
       " 'series-8-episode-14-the-troll-manifestation',\n",
       " 'series-8-episode-15-the-comic-book-store-regeneration',\n",
       " 'series-8-episode-16-the-intimacy-acceleration',\n",
       " 'series-8-episode-17-the-colonization-application',\n",
       " 'series-8-episode-18-the-leftover-thermalization',\n",
       " 'series-8-episode-19-the-skywalker-incursion',\n",
       " 'series-8-episode-20-the-fortification-implementation',\n",
       " 'series-8-episode-21-the-communication-deterioration',\n",
       " 'series-8-episode-22-the-graduation-transmission',\n",
       " 'series-8-episode-23-the-maternal-combustion',\n",
       " 'series-8-episode-24-the-commitment-determination',\n",
       " 'series-9-episode-01-the-matrimonial-momentum',\n",
       " 'series-9-episode-02-the-separation-oscillation',\n",
       " 'series-9-episode-03-the-batchelor-party-corrosion',\n",
       " 'series-9-episode-04-the-2003-approximation',\n",
       " 'series-9-episode-05-the-perspiration-implementation',\n",
       " 'series-9-episode-06-the-helium-insufficiency',\n",
       " 'series-9-episode-07-the-spock-resonance',\n",
       " 'series-9-episode-08-the-mystery-date-observation',\n",
       " 'series-9-episode-09-the-platonic-permutation',\n",
       " 'series-9-episode-10-the-earworm-reverberation',\n",
       " 'series-9-episode-11-the-opening-night-excitation',\n",
       " 'series-9-episode-12-the-sales-call-sublimation',\n",
       " 'series-9-episode-13-the-empathy-optimisation',\n",
       " 'series-9-episode-14-the-meemaw-materialisation',\n",
       " 'series-9-episode-15-the-valentino-submergence',\n",
       " 'series-9-episode-16-the-positive-negative-reaction',\n",
       " 'series-9-episode-17-the-celebration-experimentation',\n",
       " 'series-9-episode-18-the-application-deterioration',\n",
       " 'series-9-episode-19-the-solder-excursion-diversion',\n",
       " 'series-9-episode-20-the-big-bear-precipitation',\n",
       " 'series-9-episode-21-the-viewing-party-combustion',\n",
       " 'series-9-episode-22-the-fermentation-bifurcation',\n",
       " 'series-9-episode-23-the-line-substitution-solution',\n",
       " 'series-9-episode-24-the-convergence-convergence',\n",
       " 'series-10-episode-01-the-conjugal-conjecture',\n",
       " 'series-10-episode-02-the-military-miniturization',\n",
       " 'series-10-episode-03--the-dependence-transcendence',\n",
       " 'series-10-episode-04-the-cohabitation-experimentation',\n",
       " 'series-10-episode-05-the-hot-tub-contamination',\n",
       " 'series-10-episode-06-the-foetal-kick-catalyst',\n",
       " 'series-10-episode-07-the-veracity-elasticity',\n",
       " 'series-10-episode-08-the-brain-bowl-incubation',\n",
       " 'series-10-episode-09-the-geology-elevation',\n",
       " 'series-10-episode-10-the-property-division-collision',\n",
       " 'series-10-episode-11-the-birthday-synchronicity',\n",
       " 'series-10-episode-12-the-holiday-summation',\n",
       " 'series-10-episode-13-the-romance-recalibration',\n",
       " 'series-10-episode-14-the-emotion-detection-automation',\n",
       " 'series-10-episode-15-the-locomotion-reverberation',\n",
       " 'series-10-episode-16-the-allowance-evaporation',\n",
       " 'series-10-episode-17-the-comic-con-conundrum',\n",
       " 'series-10-episode-18-the-escape-hatch-identification',\n",
       " 'series-10-episode-19-the-collaboration-fluctuation',\n",
       " 'series-10-episode-20-the-recollection-dissipation',\n",
       " 'series-10-episode-21-the-separation-agitation',\n",
       " 'series-10-episode-22-the-cognition-regeneration',\n",
       " 'series-10-episode-23-the-gyroscopic-collapse',\n",
       " 'series-10-episode-24-the-long-distance-dissonance']"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ep_list = [\n",
    "\"Series_1_Episode_1_Pilot_Episode\",\n",
    "\"Series_1_Episode_2_The_Big_Bran_Hypothesis\",\n",
    "\"Series_1_Episode_3_The_Fuzzy_Boots_Corollary\",\n",
    "\"Series_1_Episode_4_The_Luminous_Fish_Effect\",\n",
    "\"Series_1_Episode_5_The_Hamburger_Postulate\",\n",
    "\"Series_1_Episode_6_The_Middle_Earth_Paradigm\",\n",
    "\"Series_1_Episode_7_The_Dumpling_Paradox\",\n",
    "\"Series_1_Episode_8_The_Grasshopper_Experiment\",\n",
    "\"Series_1_Episode_9_The_Cooper-Hofstadter_Polarization\",\n",
    "\"Series_1_Episode_10_The_Loobenfeld_Decay\",\n",
    "\"Series_1_Episode_11_The_Pancake_Batter_Anomaly\",\n",
    "\"Series_1_Episode_12_The_Jerusalem_Duality\",\n",
    "\"Series_1_Episode_13_The_Bat_Jar_Conjecture\",\n",
    "\"Series_1_Episode_14_The_Nerdvana_Annihilation\",\n",
    "\"Series_1_Episode_15_The_Porkchop_Indeterminacy\",\n",
    "\"Series_1_Episode_16_The_Peanut_Reaction\",\n",
    "\"Series_1_Episode_17_The_Tangerine_Factor\",\n",
    "\"Series_2_Episode_1_The_Bad_Fish_Paradigm\",\n",
    "\"Series_2_Episode_2_The_Codpiece_Topology\",\n",
    "\"Series_2_Episode_3_The_Barbarian_Sublimation\",\n",
    "\"Series_2_Episode_4_The_Griffin_Equivalency\",\n",
    "\"Series_2_Episode_5_The_Euclid_Alternative\",\n",
    "\"Series_2_Episode_6_The_Cooper-Nowitzki_Theorem\",\n",
    "\"Series_2_Episode_7_The_Panty_Pinata_Polarization\",\n",
    "\"Series_2_Episode_8_The_Lizard-Spock_Expansion\",\n",
    "\"Series_2_Episode_9_The_White_Asparagus_Triangulation\",\n",
    "\"Series_2_Episode_10_The_Vartabedian_Conundrum\",\n",
    "\"Series_2_Episode_11_The_Bath_Item_Gift_Hypothesis\",\n",
    "\"Series_2_Episode_12_The_Killer_Robot_Instability\",\n",
    "\"Series_2_Episode_13_The_Friendship_Algorithm\",\n",
    "\"Series_2_Episode_14_The_Financial_Permeability\",\n",
    "\"Series_2_Episode_15_The_Maternal_Capacitance\",\n",
    "\"Series_2_Episode_16_The_Cushion_Saturation\",\n",
    "\"Series_2_Episode_17_The_Terminator_Decoupling\",\n",
    "\"Series_2_Episode_18_The_Work_Song_Nanocluster\",\n",
    "\"Series_2_Episode_19_The_Dead_Hooker_Juxtaposition\",\n",
    "\"Series_2_Episode_20_The_Hofstadter_Isotope\",\n",
    "\"Series_2_Episode_21_The_Vegas_Renormalization\",\n",
    "\"Series_2_Episode_22_The_Classified_Materials_Turbulence\",\n",
    "\"Series_2_Episode_23_The_Monopolar_Expedition\",\n",
    "\"Series_3_Episode_1_The_Electric_Can_Opener_Fluctuation\",\n",
    "\"Series_3_Episode_2_The_Jiminy_Conjecture\",\n",
    "\"Series_3_Episode_3_The_Gothowitz_Deviation\",\n",
    "\"Series_3_Episode_4_The_Pirate_Solution\",\n",
    "\"Series_3_Episode_5_The_Creepy_Candy_Coating_Corollary\",\n",
    "\"Series_3_Episode_6_The_Cornhusker_Vortex\",\n",
    "\"Series_3_Episode_7_The_Guitarist_Amplification\",\n",
    "\"Series_3_Episode_8_The_Adhesive_Duck_Deficiency\",\n",
    "\"Series_3_Episode_9_The_Vengeance_Formulation\",\n",
    "\"Series_3_Episode_10_The_Gorilla_Experiment\",\n",
    "\"Series_3_Episode_11_The_Maternal_Congruence\",\n",
    "\"Series_3_Episode_12_The_Psychic_Vortex\",\n",
    "\"Series_3_Episode_13_The_Bozeman_Reaction\",\n",
    "\"Series_3_Episode_14_The_Einstein_Approximation\",\n",
    "\"Series_3_Episode_15_The_Large_Hadron_Collision\",\n",
    "\"Series_3_Episode_16_The_Excelsior_Acquisition\",\n",
    "\"Series_3_Episode_17_The_Precious_Fragmentation\",\n",
    "\"Series_3_Episode_18_The_Pants_Alternative\",\n",
    "\"Series_3_Episode_19_The_Wheaton_Recurrence\",\n",
    "\"Series_3_Episode_20_The_Spaghetti_Catalyst\",\n",
    "\"Series_3_Episode_21_The_Plimpton_Stimulation\",\n",
    "\"Series_3_Episode_22_The_Staircase_Implementation\",\n",
    "\"Series_3_Episode_23_The_Lunar_Excitation\",\n",
    "\"Series_4_Episode_1_The_Robotic_Manipulation\",\n",
    "\"Series_4_Episode_2_The_Cruciferous_Vegetable_Amplification\",\n",
    "\"Series_4_Episode_3_The_Zazzy_Substitution\",\n",
    "\"Series_4_Episode_4_The_Hot_Troll_Deviation\",\n",
    "\"Series_4_Episode_5_The_Desperation_Emanation\",\n",
    "\"Series_4_Episode_6_The_Irish_Pub_Formulation\",\n",
    "\"Series_4_Episode_7_The_Apology_Insufficiency\",\n",
    "\"Series_4_Episode_8_The_21_Second_Excitation\",\n",
    "\"Series_4_Episode_9_The_Boyfriend_Complexity\",\n",
    "\"Series_4_Episode_10_The_Alien_Parasite_Hypothesis\",\n",
    "\"Series_4_Episode_11_The_Justice_League_Recombination\",\n",
    "\"Series_4_Episode_12_The_Bus_Pants_Utilization\",\n",
    "\"Series_4_Episode_13_The_Love_Car_Displacement\",\n",
    "\"Series_4_Episode_14_The_Thespian_Catalyst\",\n",
    "\"Series_4_Episode_15_The_Benefactor_Factor\",\n",
    "\"Series_4_Episode_16_The_Cohabitation_Formulation\",\n",
    "\"Series_4_Episode_17_The_Toast_Derivation\",\n",
    "\"Series_4_Episode_18_The_Prestidigitation_Approximation\",\n",
    "\"Series_4_Episode_19_The_Zarnecki_Incursion\",\n",
    "\"Series_4_Episode_20_The_Herb_Garden_Germination\",\n",
    "\"Series_4_Episode_21_The_Agreement_Dissection\",\n",
    "\"Series_4_Episode_22_The_Wildebeest_Implementation\",\n",
    "\"Series_4_Episode_23_The_Engagement_Reaction\",\n",
    "\"Series_4_Episode_24_The_Roommate_Transmogrification\",\n",
    "\"Series_5_Episode_1_The_Skank_Reflex_Analysis\",\n",
    "\"Series_5_Episode_2_The_Infestation_Hypothesis\",\n",
    "\"Series_5_Episode_3_The_Pulled_Groin_Extrapolation\",\n",
    "\"Series_5_Episode_4_The_Wiggly_Finger_Catalyst\",\n",
    "\"Series_5_Episode_5_The_Russian_Rocket_Reaction\",\n",
    "\"Series_5_Episode_6_The_Rhinitis_Revelation\",\n",
    "\"Series_5_Episode_7_The_Good_Guy_Fluctuation\",\n",
    "\"Series_5_Episode_8_The_Isolation_Permutation\",\n",
    "\"Series_5_Episode_9_The_Ornithophobia_Diffusion\",\n",
    "\"Series_5_Episode_10_The_Flaming_Spittoon_Acquisition\",\n",
    "\"Series_5_Episode_11_The_Speckerman_Recurrence\",\n",
    "\"Series_5_Episode_12_The_Shiny_Trinket_Maneouvre\",\n",
    "\"Series_5_Episode_13_The_Recombination_Hypothesis\",\n",
    "\"Series_5_Episode_14_The_Beta_Test_Initiation\",\n",
    "\"Series_5_Episode_15_The_Friendship_Contraction\",\n",
    "\"Series_5_Episode_16_The_Vacation_Solution\",\n",
    "\"Series_5_Episode_17_The_Rothman_Disintegration\",\n",
    "\"Series_5_Episode_18_The_Werewolf_Transformation\",\n",
    "\"Series_5_Episode_19_The_Weekend_Vortex\",\n",
    "\"Series_5_Episode_20_The_Transporter_Malfunction\",\n",
    "\"Series_5_Episode_21_The_Hawking_Excitation\",\n",
    "\"Series_5_Episode_22_The_Stag_Convergence\",\n",
    "\"Series_5_Episode_23_The_Launch_Acceleration\",\n",
    "\"Series_5_Episode_24_The_Countdown_Reflection\",\n",
    "\"Series_6_Episode_1_The_Date_Night_Variable\",\n",
    "\"Series_6_Episode_2_The_Decoupling_Fluctuation\",\n",
    "\"Series_6_Episode_3_The_Higgs_Boson_Observation\",\n",
    "\"Series_6_Episode_4_The_Re-Entry_Minimization\",\n",
    "\"Series_6_Episode_5_The_Holographic_Excitation\",\n",
    "\"Series_6_Episode_6_The_Extract_Obliteration\",\n",
    "\"Series_6_Episode_7_The_Habitation_Configuration\",\n",
    "\"Series_6_Episode_8_The_43_Peculiarity\",\n",
    "\"Series_6_Episode_9_The_Parking_Spot_Escalation\",\n",
    "\"Series_6_Episode_10_The_Fish_Guts_Displacement\",\n",
    "\"Series_6_Episode_11_The_Santa_Simulation\",\n",
    "\"Series_6_Episode_12_The_Egg_Salad_Equivalency\",\n",
    "\"Series_6_Episode_13_The_Bakersfield_Expedition\",\n",
    "\"Series_6_Episode_14_The_Cooper/Kripke_Inversion\",\n",
    "\"Series_6_Episode_15_The_Spoiler_Alert_Segmentation\",\n",
    "\"Series_6_Episode_16_The_Tangible_Affection_Proof\",\n",
    "\"Series_6_Episode_17_The_Monster_Isolation\",\n",
    "\"Series_6_Episode_18_The_Contractual_Obligation_Implementation\",\n",
    "\"Series_6_Episode_19_The_Closet_Reconfiguration\",\n",
    "\"Series_6_Episode_20_The_Tenure_Turbulence\",\n",
    "\"Series_6_Episode_21_The_Closure_Alternative\",\n",
    "\"Series_6_Episode_22_The_Proton_Resurgence\",\n",
    "\"Series_6_Episode_23_The_Love_Spell_Potential\",\n",
    "\"Series_6_Episode_24_The_Bon_Voyage_Reaction\",\n",
    "\"Series_7_Episode_1_The_Hofstadter_Insufficiency\",\n",
    "\"Series_7_Episode_2_The_Deception_Verification\",\n",
    "\"Series_7_Episode_3_The_Scavenger_Vortex\",\n",
    "\"Series_7_Episode_4_The_Raiders_Minimization\",\n",
    "\"Series_7_Episode_5_The_Workplace_Proximity\",\n",
    "\"Series_7_Episode_6_The_Romance_Resonance\",\n",
    "\"Series_7_Episode_7_The_Proton_Displacement\",\n",
    "\"Series_7_Episode_8_The_Itchy_Brain_Simulation\",\n",
    "\"Series_7_Episode_9_The_Thanksgiving_Decoupling\",\n",
    "\"Series_7_Episode_10_The_Discovery_Dissipation\",\n",
    "\"Series_7_Episode_11_The_Cooper_Extraction\",\n",
    "\"Series_7_Episode_12_The_Hesitation_Ramification\",\n",
    "\"Series_7_Episode_13_The_Occupation_Recalibration\",\n",
    "\"Series_7_Episode_14_The_Convention_Conundrum\",\n",
    "\"Series_7_Episode_15_The_Locomotive_Manipulation\",\n",
    "\"Series_7_Episode_16_The_Table_Polarisation\",\n",
    "\"Series_7_Episode_17_The_Friendship_Turbulence\",\n",
    "\"Series_7_Episode_18_The_Mommy_Observation\",\n",
    "\"Series_7_Episode_19_The_Indecision_Amalgamation\",\n",
    "\"Series_7_Episode_20_The_Relationship_Diremption\",\n",
    "\"Series_7_Episode_21_The_Anything_Can_Happen_Recurrence\",\n",
    "\"Series_7_Episode_22_The_Proton_Transmogrification\",\n",
    "\"Series_7_Episode_23_The_Gorilla_Dissolution\",\n",
    "\"Series_7_Episode_24_The_Status_Quo_Combustion\",\n",
    "\"Series_8_Episode_1_The_Locomotion_Interruption\",\n",
    "\"Series_8_Episode_2_The_Junior_Professor_Solution\",\n",
    "\"Series_8_Episode_3_The_First_Pitch_Insufficiency\",\n",
    "\"Series_8_Episode_4_The_Hook-Up_Reverbration\",\n",
    "\"Series_8_Episode_5_The_Focus_Attenuation\",\n",
    "\"Series_8_Episode_6_The_Expedition_Approximation\",\n",
    "\"Series_8_Episode_7_The_Misinterpretation_Agitation\",\n",
    "\"Series_8_Episode_8_The_Prom_Equivalency\",\n",
    "\"Series_8_Episode_9_The_Septum_Deviation\",\n",
    "\"Series_8_Episode_10_The_Champagne_Reflection\",\n",
    "\"Series_8_Episode_11_The_Clean_Room_Infiltration\",\n",
    "\"Series_8_Episode_12_The_Space_Probe_Disintegration\",\n",
    "\"Series_8_Episode_13_The_Anxiety_Optimisation\",\n",
    "\"Series_8_Episode_14_The_Troll_Manifestation\",\n",
    "\"Series_8_Episode_15_The_Comic_Book_Store_Regeneration\",\n",
    "\"Series_8_Episode_16_The_Intimacy_Acceleration\",\n",
    "\"Series_8_Episode_17_The_Colonization_Application\",\n",
    "\"Series_8_Episode_18_The_Leftover_Thermalization\",\n",
    "\"Series_8_Episode_19_The_Skywalker_Incursion\",\n",
    "\"Series_8_Episode_20_The_Fortification_Implementation\",\n",
    "\"Series_8_Episode_21_The_Communication_Deterioration\",\n",
    "\"Series_8_Episode_22_The_Graduation_Transmission\",\n",
    "\"Series_8_Episode_23_The_Maternal_Combustion\",\n",
    "\"Series_8_Episode_24_The_Commitment_Determination\",\n",
    "\"Series_9_Episode_1_The_Matrimonial_Momentum\",\n",
    "\"Series_9_Episode_2_The_Separation_Oscillation\",\n",
    "\"Series_9_Episode_3_The_Batchelor_Party_Corrosion\",\n",
    "\"Series_9_Episode_4_The_2003_Approximation\",\n",
    "\"Series_9_Episode_5_The_Perspiration_Implementation\",\n",
    "\"Series_9_Episode_6_The_Helium_Insufficiency\",\n",
    "\"Series_9_Episode_7_The_Spock_Resonance\",\n",
    "\"Series_9_Episode_8_The_Mystery_Date_Observation\",\n",
    "\"Series_9_Episode_9_The_Platonic_Permutation\",\n",
    "\"Series_9_Episode_10_The_Earworm_Reverberation\",\n",
    "\"Series_9_Episode_11_The_Opening_Night_Excitation\",\n",
    "\"Series_9_Episode_12_The_Sales_Call_Sublimation\",\n",
    "\"Series_9_Episode_13_The_Empathy_Optimisation\",\n",
    "\"Series_9_Episode_14_The_Meemaw_Materialisation\",\n",
    "\"Series_9_Episode_15_The_Valentino_Submergence\",\n",
    "\"Series_9_Episode_16_The_Positive_Negative_Reaction\",\n",
    "\"Series_9_Episode_17_The_Celebration_Experimentation\",\n",
    "\"Series_9_Episode_18_The_Application_Deterioration\",\n",
    "\"Series_9_Episode_19_The_Solder_Excursion_Diversion\",\n",
    "\"Series_9_Episode_20_The_Big_Bear_Precipitation\",\n",
    "\"Series_9_Episode_21_The_Viewing_Party_Combustion\",\n",
    "\"Series_9_Episode_22_The_Fermentation_Bifurcation\",\n",
    "\"Series_9_Episode_23_The_Line_Substitution_Solution\",\n",
    "\"Series_9_Episode_24_The_Convergence_Convergence\",\n",
    "\"Series_10_Episode_1_The_Conjugal_Conjecture\",\n",
    "\"Series_10_Episode_2_The_Military_Miniturization\",\n",
    "\"Series_10_Episode_3_-The_Dependence_Transcendence\",\n",
    "\"Series_10_Episode_4_The_Cohabitation_Experimentation\",\n",
    "\"Series_10_Episode_5_The_Hot_Tub_Contamination\",\n",
    "\"Series_10_Episode_6_The_Foetal_Kick_Catalyst\",\n",
    "\"Series_10_Episode_7_The_Veracity_Elasticity\",\n",
    "\"Series_10_Episode_8_The_Brain_Bowl_Incubation\",\n",
    "\"Series_10_Episode_9_The_Geology_Elevation\",\n",
    "\"Series_10_Episode_10_The_Property_Division_Collision\",\n",
    "\"Series_10_Episode_11_The_Birthday_Synchronicity\",\n",
    "\"Series_10_Episode_12_The_Holiday_Summation\",\n",
    "\"Series_10_Episode_13_The_Romance_Recalibration\",\n",
    "\"Series_10_Episode_14_The_Emotion_Detection_Automation\",\n",
    "\"Series_10_Episode_15_The_Locomotion_Reverberation\",\n",
    "\"Series_10_Episode_16_The_Allowance_Evaporation\",\n",
    "\"Series_10_Episode_17_The_Comic-Con_Conundrum\",\n",
    "\"Series_10_Episode_18_The_Escape_Hatch_Identification\",\n",
    "\"Series_10_Episode_19_The_Collaboration_Fluctuation\",\n",
    "\"Series_10_Episode_20_The_Recollection_Dissipation\",\n",
    "\"Series_10_Episode_21_The_Separation_Agitation\",\n",
    "\"Series_10_Episode_22_The_Cognition_Regeneration\",\n",
    "\"Series_10_Episode_23_The_Gyroscopic_Collapse\",\n",
    "\"Series_10_Episode_24_The_Long_Distance_Dissonance\"\n",
    "]\n",
    "\n",
    "ep_list = [re.sub(r'episode-(\\d)-', r'episode-0\\1-',x.lower().replace(\"_\",'-')) for x in ep_list]\n",
    "ep_list"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 91574,
     "status": "ok",
     "timestamp": 1707156441752,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "uheF0QKQJZm5",
    "outputId": "f06a1e02-90b0-46bc-ce1a-6b9592003f40"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "https://bigbangtrans.wordpress.com/series-1-episode-10-the-loobenfeld-decay/\n",
      "Списки:  len(script_list2)= 236 len(font_list)=0\n",
      "236\n",
      "https://bigbangtrans.wordpress.com/series-1-episode-11-the-pancake-batter-anomaly/\n",
      "Списки:  len(script_list2)= 258 len(font_list)=0\n",
      "258\n",
      "https://bigbangtrans.wordpress.com/series-1-episode-12-the-jerusalem-duality/\n",
      "Списки:  len(script_list2)= 244 len(font_list)=0\n",
      "244\n",
      "https://bigbangtrans.wordpress.com/series-1-episode-13-the-bat-jar-conjecture/\n",
      "Списки:  len(script_list2)= 266 len(font_list)=0\n",
      "266\n",
      "https://bigbangtrans.wordpress.com/series-1-episode-14-the-nerdvana-annihilation/\n",
      "Списки:  len(script_list2)= 244 len(font_list)=0\n",
      "244\n",
      "https://bigbangtrans.wordpress.com/series-1-episode-15-the-porkchop-indeterminacy/\n",
      "Списки:  len(script_list2)= 249 len(font_list)=0\n",
      "249\n",
      "https://bigbangtrans.wordpress.com/series-1-episode-16-the-peanut-reaction/\n",
      "Списки:  len(script_list2)= 249 len(font_list)=0\n",
      "249\n",
      "https://bigbangtrans.wordpress.com/series-1-episode-17-the-tangerine-factor/\n",
      "Списки:  len(script_list2)= 229 len(font_list)=0\n",
      "229\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-01-the-bad-fish-paradigm/\n",
      "Списки:  len(script_list2)= 248 len(font_list)=0\n",
      "248\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-02-the-codpiece-topology/\n",
      "Списки:  len(script_list2)= 260 len(font_list)=0\n",
      "260\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-03-the-barbarian-sublimation/\n",
      "Списки:  len(script_list2)= 247 len(font_list)=0\n",
      "247\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-04-the-griffin-equivalency/\n",
      "Списки:  len(script_list2)= 270 len(font_list)=0\n",
      "270\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-06-the-cooper-nowitzki-theorem/\n",
      "Списки:  len(script_list2)= 246 len(font_list)=0\n",
      "246\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-07-the-panty-pinata-polarization/\n",
      "Списки:  len(script_list2)= 279 len(font_list)=0\n",
      "279\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-09-the-white-asparagus-triangulation/\n",
      "Списки:  len(script_list2)= 223 len(font_list)=0\n",
      "223\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-11-the-bath-item-gift-hypothesis/\n",
      "Списки:  len(script_list2)= 231 len(font_list)=0\n",
      "231\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-12-the-killer-robot-instability/\n",
      "Списки:  len(script_list2)= 220 len(font_list)=0\n",
      "220\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-13-the-friendship-algorithm/\n",
      "Списки:  len(script_list2)= 212 len(font_list)=0\n",
      "212\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-14-the-financial-permeability/\n",
      "Списки:  len(script_list2)= 256 len(font_list)=0\n",
      "256\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-15-the-maternal-capacitance/\n",
      "Списки:  len(script_list2)= 233 len(font_list)=0\n",
      "233\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-16-the-cushion-saturation/\n",
      "Списки:  len(script_list2)= 256 len(font_list)=0\n",
      "256\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-17-the-terminator-decoupling/\n",
      "Списки:  len(script_list2)= 218 len(font_list)=0\n",
      "218\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-18-the-work-song-nanocluster/\n",
      "Списки:  len(script_list2)= 233 len(font_list)=0\n",
      "233\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-19-the-dead-hooker-juxtaposition/\n",
      "Списки:  len(script_list2)= 244 len(font_list)=0\n",
      "244\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-20-the-hofstadter-isotope/\n",
      "Списки:  len(script_list2)= 232 len(font_list)=0\n",
      "232\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-21-the-vegas-renormalization/\n",
      "Списки:  len(script_list2)= 249 len(font_list)=0\n",
      "249\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-22-the-classified-materials-turbulence/\n",
      "Списки:  len(script_list2)= 224 len(font_list)=0\n",
      "224\n",
      "https://bigbangtrans.wordpress.com/series-2-episode-23-the-monopolar-expedition/\n",
      "Списки:  len(script_list2)= 247 len(font_list)=0\n",
      "247\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-01-the-electric-can-opener-fluctuation/\n",
      "Списки:  len(script_list2)= 223 len(font_list)=0\n",
      "223\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-02-the-jiminy-conjecture/\n",
      "Списки:  len(script_list2)= 228 len(font_list)=0\n",
      "228\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-03-the-gothowitz-deviation/\n",
      "Списки:  len(script_list2)= 245 len(font_list)=0\n",
      "245\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-04-the-pirate-solution/\n",
      "Списки:  len(script_list2)= 252 len(font_list)=0\n",
      "252\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-05-the-creepy-candy-coating-corollary/\n",
      "Списки:  len(script_list2)= 243 len(font_list)=0\n",
      "243\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-06-the-cornhusker-vortex/\n",
      "Списки:  len(script_list2)= 228 len(font_list)=0\n",
      "228\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-07-the-guitarist-amplification/\n",
      "Списки:  len(script_list2)= 251 len(font_list)=0\n",
      "251\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-08-the-adhesive-duck-deficiency/\n",
      "Списки:  len(script_list2)= 224 len(font_list)=0\n",
      "224\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-09-the-vengeance-formulation/\n",
      "Списки:  len(script_list2)= 207 len(font_list)=0\n",
      "207\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-10-the-gorilla-experiment/\n",
      "Списки:  len(script_list2)= 258 len(font_list)=0\n",
      "258\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-11-the-maternal-congruence/\n",
      "Списки:  len(script_list2)= 233 len(font_list)=0\n",
      "233\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-12-the-psychic-vortex/\n",
      "Списки:  len(script_list2)= 211 len(font_list)=0\n",
      "211\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-13-the-bozeman-reaction/\n",
      "Списки:  len(script_list2)= 179 len(font_list)=0\n",
      "179\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-14-the-einstein-approximation/\n",
      "Списки:  len(script_list2)= 220 len(font_list)=0\n",
      "220\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-15-the-large-hadron-collision/\n",
      "Списки:  len(script_list2)= 213 len(font_list)=0\n",
      "213\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-16-the-excelsior-acquisition/\n",
      "Списки:  len(script_list2)= 229 len(font_list)=0\n",
      "229\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-17-the-precious-fragmentation/\n",
      "Списки:  len(script_list2)= 208 len(font_list)=0\n",
      "208\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-18-the-pants-alternative/\n",
      "Списки:  len(script_list2)= 171 len(font_list)=0\n",
      "171\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-19-the-wheaton-recurrence/\n",
      "Списки:  len(script_list2)= 248 len(font_list)=0\n",
      "248\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-20-the-spaghetti-catalyst/\n",
      "Списки:  len(script_list2)= 258 len(font_list)=0\n",
      "258\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-21-the-plimpton-stimulation/\n",
      "Списки:  len(script_list2)= 269 len(font_list)=0\n",
      "269\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-22-the-staircase-implementation/\n",
      "Списки:  len(script_list2)= 256 len(font_list)=0\n",
      "256\n",
      "https://bigbangtrans.wordpress.com/series-3-episode-23-the-lunar-excitation/\n",
      "Списки:  len(script_list2)= 260 len(font_list)=0\n",
      "260\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-01-the-robotic-manipulation/\n",
      "Списки:  len(script_list2)= 258 len(font_list)=0\n",
      "258\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-02-the-cruciferous-vegetable-amplification/\n",
      "Списки:  len(script_list2)= 249 len(font_list)=0\n",
      "249\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-03-the-zazzy-substitution/\n",
      "Списки:  len(script_list2)= 284 len(font_list)=0\n",
      "284\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-04-the-hot-troll-deviation/\n",
      "Списки:  len(script_list2)= 272 len(font_list)=0\n",
      "272\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-05-the-desperation-emanation/\n",
      "Списки:  len(script_list2)= 239 len(font_list)=0\n",
      "239\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-06-the-irish-pub-formulation/\n",
      "Списки:  len(script_list2)= 266 len(font_list)=0\n",
      "266\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-07-the-apology-insufficiency/\n",
      "Списки:  len(script_list2)= 230 len(font_list)=0\n",
      "230\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-08-the-21-second-excitation/\n",
      "Списки:  len(script_list2)= 224 len(font_list)=0\n",
      "224\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-09-the-boyfriend-complexity/\n",
      "Списки:  len(script_list2)= 257 len(font_list)=0\n",
      "257\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-10-the-alien-parasite-hypothesis/\n",
      "Списки:  len(script_list2)= 225 len(font_list)=0\n",
      "225\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-11-the-justice-league-recombination/\n",
      "Списки:  len(script_list2)= 244 len(font_list)=0\n",
      "244\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-12-the-bus-pants-utilization/\n",
      "Списки:  len(script_list2)= 251 len(font_list)=0\n",
      "251\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-13-the-love-car-displacement/\n",
      "Списки:  len(script_list2)= 259 len(font_list)=0\n",
      "259\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-14-the-thespian-catalyst/\n",
      "Списки:  len(script_list2)= 228 len(font_list)=0\n",
      "228\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-15-the-benefactor-factor/\n",
      "Списки:  len(script_list2)= 226 len(font_list)=0\n",
      "226\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-16-the-cohabitation-formulation/\n",
      "Списки:  len(script_list2)= 246 len(font_list)=0\n",
      "246\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-17-the-toast-derivation/\n",
      "Списки:  len(script_list2)= 243 len(font_list)=0\n",
      "243\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-18-the-prestidigitation-approximation/\n",
      "Списки:  len(script_list2)= 245 len(font_list)=0\n",
      "245\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-19-the-zarnecki-incursion/\n",
      "Списки:  len(script_list2)= 265 len(font_list)=0\n",
      "265\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-20-the-herb-garden-germination/\n",
      "Списки:  len(script_list2)= 256 len(font_list)=0\n",
      "256\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-21-the-agreement-dissection/\n",
      "Списки:  len(script_list2)= 217 len(font_list)=0\n",
      "217\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-22-the-wildebeest-implementation/\n",
      "Списки:  len(script_list2)= 253 len(font_list)=1\n",
      "253\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-23-the-engagement-reaction/\n",
      "Списки:  len(script_list2)= 250 len(font_list)=0\n",
      "250\n",
      "https://bigbangtrans.wordpress.com/series-4-episode-24-the-roommate-transmogrification/\n",
      "Списки:  len(script_list2)= 243 len(font_list)=0\n",
      "243\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-01-the-skank-reflex-analysis/\n",
      "Списки:  len(script_list2)= 202 len(font_list)=0\n",
      "202\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-02-the-infestation-hypothesis/\n",
      "Списки:  len(script_list2)= 223 len(font_list)=0\n",
      "223\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-03-the-pulled-groin-extrapolation/\n",
      "Списки:  len(script_list2)= 214 len(font_list)=0\n",
      "214\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-04-the-wiggly-finger-catalyst/\n",
      "Списки:  len(script_list2)= 204 len(font_list)=0\n",
      "204\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-05-the-russian-rocket-reaction/\n",
      "Списки:  len(script_list2)= 251 len(font_list)=1\n",
      "251\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-06-the-rhinitis-revelation/\n",
      "Списки:  len(script_list2)= 203 len(font_list)=0\n",
      "203\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-07-the-good-guy-fluctuation/\n",
      "Списки:  len(script_list2)= 213 len(font_list)=0\n",
      "213\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-08-the-isolation-permutation/\n",
      "Списки:  len(script_list2)= 214 len(font_list)=0\n",
      "214\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-09-the-ornithophobia-diffusion/\n",
      "Списки:  len(script_list2)= 211 len(font_list)=0\n",
      "211\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-10-the-flaming-spittoon-acquisition/\n",
      "Списки:  len(script_list2)= 205 len(font_list)=0\n",
      "205\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-11-the-speckerman-recurrence/\n",
      "Списки:  len(script_list2)= 248 len(font_list)=0\n",
      "248\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-12-the-shiny-trinket-maneouvre/\n",
      "Списки:  len(script_list2)= 197 len(font_list)=0\n",
      "197\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-13-the-recombination-hypothesis/\n",
      "Списки:  len(script_list2)= 263 len(font_list)=0\n",
      "263\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-14-the-beta-test-initiation/\n",
      "Списки:  len(script_list2)= 186 len(font_list)=0\n",
      "186\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-15-the-friendship-contraction/\n",
      "Списки:  len(script_list2)= 202 len(font_list)=0\n",
      "202\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-16-the-vacation-solution/\n",
      "Списки:  len(script_list2)= 215 len(font_list)=0\n",
      "215\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-17-the-rothman-disintegration/\n",
      "Списки:  len(script_list2)= 236 len(font_list)=0\n",
      "236\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-18-the-werewolf-transformation/\n",
      "Списки:  len(script_list2)= 185 len(font_list)=0\n",
      "185\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-19-the-weekend-vortex/\n",
      "Списки:  len(script_list2)= 202 len(font_list)=0\n",
      "202\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-20-the-transporter-malfunction/\n",
      "Списки:  len(script_list2)= 234 len(font_list)=0\n",
      "234\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-21-the-hawking-excitation/\n",
      "Списки:  len(script_list2)= 208 len(font_list)=0\n",
      "208\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-22-the-stag-convergence/\n",
      "Списки:  len(script_list2)= 202 len(font_list)=0\n",
      "202\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-23-the-launch-acceleration/\n",
      "Списки:  len(script_list2)= 217 len(font_list)=0\n",
      "217\n",
      "https://bigbangtrans.wordpress.com/series-5-episode-24-the-countdown-reflection/\n",
      "Списки:  len(script_list2)= 223 len(font_list)=0\n",
      "223\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-01-the-date-night-variable/\n",
      "Списки:  len(script_list2)= 244 len(font_list)=0\n",
      "244\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-02-the-decoupling-fluctuation/\n",
      "Списки:  len(script_list2)= 240 len(font_list)=0\n",
      "240\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-03-the-higgs-boson-observation/\n",
      "Списки:  len(script_list2)= 211 len(font_list)=0\n",
      "211\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-04-the-re-entry-minimization/\n",
      "Списки:  len(script_list2)= 236 len(font_list)=0\n",
      "236\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-05-the-holographic-excitation/\n",
      "Списки:  len(script_list2)= 233 len(font_list)=0\n",
      "233\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-06-the-extract-obliteration/\n",
      "Списки:  len(script_list2)= 208 len(font_list)=0\n",
      "208\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-07-the-habitation-configuration/\n",
      "Списки:  len(script_list2)= 200 len(font_list)=0\n",
      "200\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-08-the-43-peculiarity/\n",
      "Списки:  len(script_list2)= 246 len(font_list)=2\n",
      "246\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-09-the-parking-spot-escalation/\n",
      "Списки:  len(script_list2)= 215 len(font_list)=0\n",
      "215\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-10-the-fish-guts-displacement/\n",
      "Списки:  len(script_list2)= 208 len(font_list)=0\n",
      "208\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-11-the-santa-simulation/\n",
      "Списки:  len(script_list2)= 222 len(font_list)=0\n",
      "222\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-12-the-egg-salad-equivalency/\n",
      "Списки:  len(script_list2)= 214 len(font_list)=0\n",
      "214\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-13-the-bakersfield-expedition/\n",
      "Списки:  len(script_list2)= 242 len(font_list)=0\n",
      "242\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-15-the-spoiler-alert-segmentation/\n",
      "Списки:  len(script_list2)= 243 len(font_list)=0\n",
      "243\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-16-the-tangible-affection-proof/\n",
      "Списки:  len(script_list2)= 222 len(font_list)=0\n",
      "222\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-17-the-monster-isolation/\n",
      "Списки:  len(script_list2)= 176 len(font_list)=0\n",
      "176\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-18-the-contractual-obligation-implementation/\n",
      "Списки:  len(script_list2)= 157 len(font_list)=0\n",
      "157\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-19-the-closet-reconfiguration/\n",
      "Списки:  len(script_list2)= 236 len(font_list)=0\n",
      "236\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-20-the-tenure-turbulence/\n",
      "Списки:  len(script_list2)= 220 len(font_list)=0\n",
      "220\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-21-the-closure-alternative/\n",
      "Списки:  len(script_list2)= 195 len(font_list)=0\n",
      "195\n",
      "https://bigbangtrans.wordpress.com/series-6-episode-22-the-proton-resurgence/\n",
      "Списки:  len(script_list2)= 224 len(font_list)=0\n",
      "224\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-01-the-hofstadter-insufficiency/\n",
      "Списки:  len(script_list2)= 238 len(font_list)=0\n",
      "238\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-02-the-deception-verification/\n",
      "Списки:  len(script_list2)= 261 len(font_list)=0\n",
      "261\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-03-the-scavenger-vortex/\n",
      "Списки:  len(script_list2)= 265 len(font_list)=0\n",
      "265\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-04-the-raiders-minimization/\n",
      "Списки:  len(script_list2)= 213 len(font_list)=0\n",
      "213\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-05-the-workplace-proximity/\n",
      "Списки:  len(script_list2)= 200 len(font_list)=0\n",
      "200\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-06-the-romance-resonance/\n",
      "Списки:  len(script_list2)= 218 len(font_list)=0\n",
      "218\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-07-the-proton-displacement/\n",
      "Списки:  len(script_list2)= 232 len(font_list)=0\n",
      "232\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-08-the-itchy-brain-simulation/\n",
      "Списки:  len(script_list2)= 211 len(font_list)=0\n",
      "211\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-09-the-thanksgiving-decoupling/\n",
      "Списки:  len(script_list2)= 254 len(font_list)=0\n",
      "254\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-10-the-discovery-dissipation/\n",
      "Списки:  len(script_list2)= 224 len(font_list)=0\n",
      "224\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-11-the-cooper-extraction/\n",
      "Списки:  len(script_list2)= 252 len(font_list)=0\n",
      "252\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-12-the-hesitation-ramification/\n",
      "Списки:  len(script_list2)= 250 len(font_list)=0\n",
      "250\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-13-the-occupation-recalibration/\n",
      "Списки:  len(script_list2)= 277 len(font_list)=0\n",
      "277\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-14-the-convention-conundrum/\n",
      "Списки:  len(script_list2)= 230 len(font_list)=0\n",
      "230\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-15-the-locomotive-manipulation/\n",
      "Списки:  len(script_list2)= 237 len(font_list)=0\n",
      "237\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-16-the-table-polarisation/\n",
      "Списки:  len(script_list2)= 258 len(font_list)=0\n",
      "258\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-17-the-friendship-turbulence/\n",
      "Списки:  len(script_list2)= 227 len(font_list)=0\n",
      "227\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-18-the-mommy-observation/\n",
      "Списки:  len(script_list2)= 251 len(font_list)=0\n",
      "251\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-19-the-indecision-amalgamation/\n",
      "Списки:  len(script_list2)= 238 len(font_list)=0\n",
      "238\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-20-the-relationship-diremption/\n",
      "Списки:  len(script_list2)= 243 len(font_list)=0\n",
      "243\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-21-the-anything-can-happen-recurrence/\n",
      "Списки:  len(script_list2)= 210 len(font_list)=0\n",
      "210\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-22-the-proton-transmogrification/\n",
      "Списки:  len(script_list2)= 228 len(font_list)=0\n",
      "228\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-23-the-gorilla-dissolution/\n",
      "Списки:  len(script_list2)= 251 len(font_list)=0\n",
      "251\n",
      "https://bigbangtrans.wordpress.com/series-7-episode-24-the-status-quo-combustion/\n",
      "Списки:  len(script_list2)= 268 len(font_list)=0\n",
      "268\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-01-the-locomotion-interruption/\n",
      "Списки:  len(script_list2)= 223 len(font_list)=0\n",
      "223\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-02-the-junior-professor-solution/\n",
      "Списки:  len(script_list2)= 232 len(font_list)=0\n",
      "232\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-03-the-first-pitch-insufficiency/\n",
      "Списки:  len(script_list2)= 220 len(font_list)=0\n",
      "220\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-04-the-hook-up-reverbration/\n",
      "Списки:  len(script_list2)= 256 len(font_list)=0\n",
      "256\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-06-the-expedition-approximation/\n",
      "Списки:  len(script_list2)= 253 len(font_list)=0\n",
      "253\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-07-the-misinterpretation-agitation/\n",
      "Списки:  len(script_list2)= 240 len(font_list)=0\n",
      "240\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-08-the-prom-equivalency/\n",
      "Списки:  len(script_list2)= 231 len(font_list)=0\n",
      "231\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-09-the-septum-deviation/\n",
      "Списки:  len(script_list2)= 239 len(font_list)=0\n",
      "239\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-10-the-champagne-reflection/\n",
      "Списки:  len(script_list2)= 221 len(font_list)=0\n",
      "221\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-11-the-clean-room-infiltration/\n",
      "Списки:  len(script_list2)= 233 len(font_list)=0\n",
      "233\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-12-the-space-probe-disintegration/\n",
      "Списки:  len(script_list2)= 228 len(font_list)=0\n",
      "228\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-13-the-anxiety-optimisation/\n",
      "Списки:  len(script_list2)= 221 len(font_list)=0\n",
      "221\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-14-the-troll-manifestation/\n",
      "Списки:  len(script_list2)= 243 len(font_list)=0\n",
      "243\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-15-the-comic-book-store-regeneration/\n",
      "Списки:  len(script_list2)= 246 len(font_list)=0\n",
      "246\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-16-the-intimacy-acceleration/\n",
      "Списки:  len(script_list2)= 233 len(font_list)=0\n",
      "233\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-17-the-colonization-application/\n",
      "Списки:  len(script_list2)= 232 len(font_list)=0\n",
      "232\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-18-the-leftover-thermalization/\n",
      "Списки:  len(script_list2)= 245 len(font_list)=0\n",
      "245\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-19-the-skywalker-incursion/\n",
      "Списки:  len(script_list2)= 218 len(font_list)=0\n",
      "218\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-20-the-fortification-implementation/\n",
      "Списки:  len(script_list2)= 252 len(font_list)=0\n",
      "252\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-21-the-communication-deterioration/\n",
      "Списки:  len(script_list2)= 242 len(font_list)=0\n",
      "242\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-22-the-graduation-transmission/\n",
      "Списки:  len(script_list2)= 220 len(font_list)=0\n",
      "220\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-23-the-maternal-combustion/\n",
      "Списки:  len(script_list2)= 211 len(font_list)=0\n",
      "211\n",
      "https://bigbangtrans.wordpress.com/series-8-episode-24-the-commitment-determination/\n",
      "Списки:  len(script_list2)= 277 len(font_list)=0\n",
      "277\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-01-the-matrimonial-momentum/\n",
      "Списки:  len(script_list2)= 269 len(font_list)=0\n",
      "269\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-02-the-separation-oscillation/\n",
      "Списки:  len(script_list2)= 223 len(font_list)=0\n",
      "223\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-03-the-batchelor-party-corrosion/\n",
      "Списки:  len(script_list2)= 258 len(font_list)=0\n",
      "258\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-04-the-2003-approximation/\n",
      "Списки:  len(script_list2)= 200 len(font_list)=0\n",
      "200\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-05-the-perspiration-implementation/\n",
      "Списки:  len(script_list2)= 213 len(font_list)=0\n",
      "213\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-06-the-helium-insufficiency/\n",
      "Списки:  len(script_list2)= 262 len(font_list)=0\n",
      "262\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-07-the-spock-resonance/\n",
      "Списки:  len(script_list2)= 211 len(font_list)=0\n",
      "211\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-08-the-mystery-date-observation/\n",
      "Списки:  len(script_list2)= 241 len(font_list)=0\n",
      "241\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-09-the-platonic-permutation/\n",
      "Списки:  len(script_list2)= 245 len(font_list)=0\n",
      "245\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-10-the-earworm-reverberation/\n",
      "Списки:  len(script_list2)= 216 len(font_list)=0\n",
      "216\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-11-the-opening-night-excitation/\n",
      "Списки:  len(script_list2)= 251 len(font_list)=0\n",
      "251\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-12-the-sales-call-sublimation/\n",
      "Списки:  len(script_list2)= 256 len(font_list)=0\n",
      "256\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-13-the-empathy-optimisation/\n",
      "Списки:  len(script_list2)= 234 len(font_list)=0\n",
      "234\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-14-the-meemaw-materialisation/\n",
      "Списки:  len(script_list2)= 255 len(font_list)=0\n",
      "255\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-15-the-valentino-submergence/\n",
      "Списки:  len(script_list2)= 247 len(font_list)=0\n",
      "247\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-16-the-positive-negative-reaction/\n",
      "Списки:  len(script_list2)= 234 len(font_list)=0\n",
      "234\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-17-the-celebration-experimentation/\n",
      "Списки:  len(script_list2)= 197 len(font_list)=0\n",
      "197\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-18-the-application-deterioration/\n",
      "Списки:  len(script_list2)= 241 len(font_list)=0\n",
      "241\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-19-the-solder-excursion-diversion/\n",
      "Списки:  len(script_list2)= 260 len(font_list)=0\n",
      "260\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-20-the-big-bear-precipitation/\n",
      "Списки:  len(script_list2)= 256 len(font_list)=0\n",
      "256\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-21-the-viewing-party-combustion/\n",
      "Списки:  len(script_list2)= 250 len(font_list)=0\n",
      "250\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-22-the-fermentation-bifurcation/\n",
      "Списки:  len(script_list2)= 279 len(font_list)=0\n",
      "279\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-23-the-line-substitution-solution/\n",
      "Списки:  len(script_list2)= 244 len(font_list)=0\n",
      "244\n",
      "https://bigbangtrans.wordpress.com/series-9-episode-24-the-convergence-convergence/\n",
      "Списки:  len(script_list2)= 277 len(font_list)=0\n",
      "277\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-01-the-conjugal-conjecture/\n",
      "Списки:  len(script_list2)= 287 len(font_list)=290\n",
      "287\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-02-the-military-miniturization/\n",
      "Списки:  len(script_list2)= 251 len(font_list)=253\n",
      "251\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-03--the-dependence-transcendence/\n",
      "Списки:  len(script_list2)= 258 len(font_list)=261\n",
      "258\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-04-the-cohabitation-experimentation/\n",
      "Списки:  len(script_list2)= 256 len(font_list)=257\n",
      "256\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-05-the-hot-tub-contamination/\n",
      "Списки:  len(script_list2)= 243 len(font_list)=246\n",
      "243\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-06-the-foetal-kick-catalyst/\n",
      "Списки:  len(script_list2)= 259 len(font_list)=260\n",
      "259\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-07-the-veracity-elasticity/\n",
      "Списки:  len(script_list2)= 257 len(font_list)=259\n",
      "257\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-08-the-brain-bowl-incubation/\n",
      "Списки:  len(script_list2)= 222 len(font_list)=224\n",
      "222\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-09-the-geology-elevation/\n",
      "Списки:  len(script_list2)= 220 len(font_list)=220\n",
      "220\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-10-the-property-division-collision/\n",
      "Списки:  len(script_list2)= 261 len(font_list)=261\n",
      "261\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-11-the-birthday-synchronicity/\n",
      "Списки:  len(script_list2)= 247 len(font_list)=251\n",
      "247\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-12-the-holiday-summation/\n",
      "Списки:  len(script_list2)= 236 len(font_list)=262\n",
      "236\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-13-the-romance-recalibration/\n",
      "Списки:  len(script_list2)= 213 len(font_list)=216\n",
      "213\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-14-the-emotion-detection-automation/\n",
      "Списки:  len(script_list2)= 268 len(font_list)=268\n",
      "268\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-15-the-locomotion-reverberation/\n",
      "Списки:  len(script_list2)= 231 len(font_list)=232\n",
      "231\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-16-the-allowance-evaporation/\n",
      "Списки:  len(script_list2)= 234 len(font_list)=234\n",
      "234\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-17-the-comic-con-conundrum/\n",
      "Списки:  len(script_list2)= 261 len(font_list)=263\n",
      "261\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-18-the-escape-hatch-identification/\n",
      "Списки:  len(script_list2)= 260 len(font_list)=260\n",
      "260\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-19-the-collaboration-fluctuation/\n",
      "Списки:  len(script_list2)= 206 len(font_list)=209\n",
      "206\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-20-the-recollection-dissipation/\n",
      "Списки:  len(script_list2)= 254 len(font_list)=260\n",
      "254\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-21-the-separation-agitation/\n",
      "Списки:  len(script_list2)= 239 len(font_list)=240\n",
      "239\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-22-the-cognition-regeneration/\n",
      "Списки:  len(script_list2)= 262 len(font_list)=262\n",
      "262\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-23-the-gyroscopic-collapse/\n",
      "Списки:  len(script_list2)= 250 len(font_list)=253\n",
      "250\n",
      "https://bigbangtrans.wordpress.com/series-10-episode-24-the-long-distance-dissonance/\n",
      "Списки:  len(script_list2)= 236 len(font_list)=239\n",
      "236\n"
     ]
    }
   ],
   "source": [
    "script_df = pd.DataFrame({'series_num':[],'ep_num':[],'ep_name':[], 'phrase_rank':[],'person':[],'text':[]})\n",
    "for ep in ep_list:\n",
    "  url = \"https://bigbangtrans.wordpress.com/\"+ep+\"/\"\n",
    "  page = r.get(url)\n",
    "  soup = BeautifulSoup(page.text, 'html')\n",
    "  try:\n",
    "    text = soup.findAll(\"div\" ,{\"class\":\"entrytext\"})[0]\n",
    "  except:\n",
    "    continue\n",
    "  print(url)\n",
    "  pure_text = soup.text\n",
    "  html_text = str(text)\n",
    "  script_list = re.findall(r'\\n.+: [^\\n]+', pure_text)\n",
    "  script_list2 = [x.replace('\\n','').split(\": \") for x in script_list]\n",
    "  font_list = re.findall('font-family:Calibri, sans-serif', html_text)\n",
    "  print(f'Списки: { len(script_list2)= }{ len(font_list)=}')\n",
    "  curr_series_num = ep.split('-')[1]\n",
    "  curr_ep_num = ep.split('-')[3]\n",
    "  curr_ep_name = ' '.join(ep.split('-')[4:])\n",
    "  curr_df = pd.DataFrame(\n",
    "      {'series_num':[curr_series_num for _ in range(len(script_list))],\n",
    "       'ep_num':[curr_ep_num for _ in range(len(script_list2))],\n",
    "       'ep_name':[curr_ep_name for _ in range(len(script_list2))],\n",
    "       'phrase_rank':[i for i in range(len(script_list2))],\n",
    "       'person':[p[0] for p in script_list2],\n",
    "       'text':[p[1] for p in script_list2]}\n",
    "  )\n",
    "  script_df = pd.concat([script_df, curr_df], axis = 0)\n",
    "  print(curr_df.shape[0])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 363
    },
    "executionInfo": {
     "elapsed": 14,
     "status": "ok",
     "timestamp": 1707156441752,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "fySPQYvUtyjT",
    "outputId": "26b1fe1f-c10d-42b6-d18c-e331085bb75b"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "  <div id=\"df-2e8f333e-3b14-4378-a31f-4efe3f1ff837\" class=\"colab-df-container\">\n",
       "    <div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>series_num</th>\n",
       "      <th>ep_num</th>\n",
       "      <th>ep_name</th>\n",
       "      <th>phrase_rank</th>\n",
       "      <th>person</th>\n",
       "      <th>text</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>160</th>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>the bat jar conjecture</td>\n",
       "      <td>160.0</td>\n",
       "      <td>Howard</td>\n",
       "      <td>Sheldon.</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>161</th>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>the bat jar conjecture</td>\n",
       "      <td>161.0</td>\n",
       "      <td>Raj</td>\n",
       "      <td>Hee hee hee hee hee hee hee hee.</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>162</th>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>the bat jar conjecture</td>\n",
       "      <td>162.0</td>\n",
       "      <td>Penny</td>\n",
       "      <td>Sheldon. I’m just going to sit down.</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>163</th>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>the bat jar conjecture</td>\n",
       "      <td>163.0</td>\n",
       "      <td>Leonard</td>\n",
       "      <td>So, is that your team.</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>164</th>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>the bat jar conjecture</td>\n",
       "      <td>164.0</td>\n",
       "      <td>Sheldon</td>\n",
       "      <td>Actually, I don’t need a team, I could easily ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>165</th>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>the bat jar conjecture</td>\n",
       "      <td>165.0</td>\n",
       "      <td>Leslie</td>\n",
       "      <td>Hello, Sheldon.</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>166</th>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>the bat jar conjecture</td>\n",
       "      <td>166.0</td>\n",
       "      <td>Sheldon</td>\n",
       "      <td>Leslie Winkle?</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>167</th>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>the bat jar conjecture</td>\n",
       "      <td>167.0</td>\n",
       "      <td>Leslie</td>\n",
       "      <td>Yeah, Leslie Winkle. The answer to the questio...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>168</th>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>the bat jar conjecture</td>\n",
       "      <td>168.0</td>\n",
       "      <td>Sheldon</td>\n",
       "      <td>Yes, well, I’m polymerised tree sap and you’re...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>169</th>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>the bat jar conjecture</td>\n",
       "      <td>169.0</td>\n",
       "      <td>Leslie</td>\n",
       "      <td>Oh, ouch.</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>\n",
       "    <div class=\"colab-df-buttons\">\n",
       "\n",
       "  <div class=\"colab-df-container\">\n",
       "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-2e8f333e-3b14-4378-a31f-4efe3f1ff837')\"\n",
       "            title=\"Convert this dataframe to an interactive table.\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
       "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
       "  </svg>\n",
       "    </button>\n",
       "\n",
       "  <style>\n",
       "    .colab-df-container {\n",
       "      display:flex;\n",
       "      gap: 12px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert {\n",
       "      background-color: #E8F0FE;\n",
       "      border: none;\n",
       "      border-radius: 50%;\n",
       "      cursor: pointer;\n",
       "      display: none;\n",
       "      fill: #1967D2;\n",
       "      height: 32px;\n",
       "      padding: 0 0 0 0;\n",
       "      width: 32px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert:hover {\n",
       "      background-color: #E2EBFA;\n",
       "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "      fill: #174EA6;\n",
       "    }\n",
       "\n",
       "    .colab-df-buttons div {\n",
       "      margin-bottom: 4px;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert {\n",
       "      background-color: #3B4455;\n",
       "      fill: #D2E3FC;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert:hover {\n",
       "      background-color: #434B5C;\n",
       "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
       "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
       "      fill: #FFFFFF;\n",
       "    }\n",
       "  </style>\n",
       "\n",
       "    <script>\n",
       "      const buttonEl =\n",
       "        document.querySelector('#df-2e8f333e-3b14-4378-a31f-4efe3f1ff837 button.colab-df-convert');\n",
       "      buttonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "\n",
       "      async function convertToInteractive(key) {\n",
       "        const element = document.querySelector('#df-2e8f333e-3b14-4378-a31f-4efe3f1ff837');\n",
       "        const dataTable =\n",
       "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
       "                                                    [key], {});\n",
       "        if (!dataTable) return;\n",
       "\n",
       "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
       "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
       "          + ' to learn more about interactive tables.';\n",
       "        element.innerHTML = '';\n",
       "        dataTable['output_type'] = 'display_data';\n",
       "        await google.colab.output.renderOutput(dataTable, element);\n",
       "        const docLink = document.createElement('div');\n",
       "        docLink.innerHTML = docLinkHtml;\n",
       "        element.appendChild(docLink);\n",
       "      }\n",
       "    </script>\n",
       "  </div>\n",
       "\n",
       "\n",
       "<div id=\"df-80a86d6a-dbd7-48b0-a84f-80f873a74e8e\">\n",
       "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-80a86d6a-dbd7-48b0-a84f-80f873a74e8e')\"\n",
       "            title=\"Suggest charts\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
       "     width=\"24px\">\n",
       "    <g>\n",
       "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
       "    </g>\n",
       "</svg>\n",
       "  </button>\n",
       "\n",
       "<style>\n",
       "  .colab-df-quickchart {\n",
       "      --bg-color: #E8F0FE;\n",
       "      --fill-color: #1967D2;\n",
       "      --hover-bg-color: #E2EBFA;\n",
       "      --hover-fill-color: #174EA6;\n",
       "      --disabled-fill-color: #AAA;\n",
       "      --disabled-bg-color: #DDD;\n",
       "  }\n",
       "\n",
       "  [theme=dark] .colab-df-quickchart {\n",
       "      --bg-color: #3B4455;\n",
       "      --fill-color: #D2E3FC;\n",
       "      --hover-bg-color: #434B5C;\n",
       "      --hover-fill-color: #FFFFFF;\n",
       "      --disabled-bg-color: #3B4455;\n",
       "      --disabled-fill-color: #666;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart {\n",
       "    background-color: var(--bg-color);\n",
       "    border: none;\n",
       "    border-radius: 50%;\n",
       "    cursor: pointer;\n",
       "    display: none;\n",
       "    fill: var(--fill-color);\n",
       "    height: 32px;\n",
       "    padding: 0;\n",
       "    width: 32px;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart:hover {\n",
       "    background-color: var(--hover-bg-color);\n",
       "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "    fill: var(--button-hover-fill-color);\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart-complete:disabled,\n",
       "  .colab-df-quickchart-complete:disabled:hover {\n",
       "    background-color: var(--disabled-bg-color);\n",
       "    fill: var(--disabled-fill-color);\n",
       "    box-shadow: none;\n",
       "  }\n",
       "\n",
       "  .colab-df-spinner {\n",
       "    border: 2px solid var(--fill-color);\n",
       "    border-color: transparent;\n",
       "    border-bottom-color: var(--fill-color);\n",
       "    animation:\n",
       "      spin 1s steps(1) infinite;\n",
       "  }\n",
       "\n",
       "  @keyframes spin {\n",
       "    0% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "      border-left-color: var(--fill-color);\n",
       "    }\n",
       "    20% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    30% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    40% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    60% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    80% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "    90% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "  }\n",
       "</style>\n",
       "\n",
       "  <script>\n",
       "    async function quickchart(key) {\n",
       "      const quickchartButtonEl =\n",
       "        document.querySelector('#' + key + ' button');\n",
       "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
       "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
       "      try {\n",
       "        const charts = await google.colab.kernel.invokeFunction(\n",
       "            'suggestCharts', [key], {});\n",
       "      } catch (error) {\n",
       "        console.error('Error during call to suggestCharts:', error);\n",
       "      }\n",
       "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
       "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
       "    }\n",
       "    (() => {\n",
       "      let quickchartButtonEl =\n",
       "        document.querySelector('#df-80a86d6a-dbd7-48b0-a84f-80f873a74e8e button');\n",
       "      quickchartButtonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "    })();\n",
       "  </script>\n",
       "</div>\n",
       "    </div>\n",
       "  </div>\n"
      ],
      "text/plain": [
       "    series_num ep_num                 ep_name  phrase_rank   person  \\\n",
       "160          1     13  the bat jar conjecture        160.0   Howard   \n",
       "161          1     13  the bat jar conjecture        161.0      Raj   \n",
       "162          1     13  the bat jar conjecture        162.0    Penny   \n",
       "163          1     13  the bat jar conjecture        163.0  Leonard   \n",
       "164          1     13  the bat jar conjecture        164.0  Sheldon   \n",
       "165          1     13  the bat jar conjecture        165.0   Leslie   \n",
       "166          1     13  the bat jar conjecture        166.0  Sheldon   \n",
       "167          1     13  the bat jar conjecture        167.0   Leslie   \n",
       "168          1     13  the bat jar conjecture        168.0  Sheldon   \n",
       "169          1     13  the bat jar conjecture        169.0   Leslie   \n",
       "\n",
       "                                                  text  \n",
       "160                                          Sheldon.   \n",
       "161                   Hee hee hee hee hee hee hee hee.  \n",
       "162              Sheldon. I’m just going to sit down.   \n",
       "163                             So, is that your team.  \n",
       "164  Actually, I don’t need a team, I could easily ...  \n",
       "165                                   Hello, Sheldon.   \n",
       "166                                    Leslie Winkle?   \n",
       "167  Yeah, Leslie Winkle. The answer to the questio...  \n",
       "168  Yes, well, I’m polymerised tree sap and you’re...  \n",
       "169                                         Oh, ouch.   "
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "script_df.head(908).tail(10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "sK4NguNLfR8s"
   },
   "outputs": [],
   "source": [
    "script_df.to_excel('/content/drive/MyDrive/Colab Notebooks/edu/nlp2/hw1/data/eng_script.xlsx', header=True, index=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "iD2D-QEpfu_O"
   },
   "outputs": [],
   "source": [
    "script_df.to_excel?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 7509,
     "status": "ok",
     "timestamp": 1707077237609,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "uwF90eZou0CH",
    "outputId": "4d7754cd-2df0-4761-875a-59adcdef00ed"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Collecting deepl\n",
      "  Downloading deepl-1.16.1-py3-none-any.whl (34 kB)\n",
      "Requirement already satisfied: requests<3,>=2 in /usr/local/lib/python3.10/dist-packages (from deepl) (2.31.0)\n",
      "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests<3,>=2->deepl) (3.3.2)\n",
      "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests<3,>=2->deepl) (3.6)\n",
      "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests<3,>=2->deepl) (2.0.7)\n",
      "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests<3,>=2->deepl) (2023.11.17)\n",
      "Installing collected packages: deepl\n",
      "Successfully installed deepl-1.16.1\n"
     ]
    }
   ],
   "source": [
    "!pip install --upgrade deepl"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "0NhziT4jgX6N"
   },
   "source": [
    "### Исследование данных: первичная чистка и обогащение."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "9YTrHAkNgXPz"
   },
   "outputs": [],
   "source": [
    "df = pd.read_excel('/content/drive/MyDrive/Colab Notebooks/edu/nlp2/hw1/data/eng_script.xlsx')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 1000
    },
    "executionInfo": {
     "elapsed": 394,
     "status": "ok",
     "timestamp": 1707243104787,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "XDOKnCJMgmj0",
    "outputId": "1bdee5ad-0d80-4ecb-dd9c-bbcc9dd022bd"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(50679, 6)\n",
      "Index(['series_num', 'ep_num', 'ep_name', 'phrase_rank', 'person', 'text'], dtype='object')\n",
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 50679 entries, 0 to 50678\n",
      "Data columns (total 6 columns):\n",
      " #   Column       Non-Null Count  Dtype \n",
      "---  ------       --------------  ----- \n",
      " 0   series_num   50679 non-null  int64 \n",
      " 1   ep_num       50679 non-null  int64 \n",
      " 2   ep_name      50679 non-null  object\n",
      " 3   phrase_rank  50679 non-null  int64 \n",
      " 4   person       50679 non-null  object\n",
      " 5   text         50675 non-null  object\n",
      "dtypes: int64(3), object(3)\n",
      "memory usage: 2.3+ MB\n",
      "None\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "\n",
       "  <div id=\"df-f9badd31-6607-4870-8fbd-37197d7f32f8\" class=\"colab-df-container\">\n",
       "    <div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>series_num</th>\n",
       "      <th>ep_num</th>\n",
       "      <th>phrase_rank</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>count</th>\n",
       "      <td>50679.000000</td>\n",
       "      <td>50679.000000</td>\n",
       "      <td>50679.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean</th>\n",
       "      <td>5.911640</td>\n",
       "      <td>12.408473</td>\n",
       "      <td>118.418832</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std</th>\n",
       "      <td>2.728483</td>\n",
       "      <td>6.789142</td>\n",
       "      <td>69.802418</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min</th>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25%</th>\n",
       "      <td>4.000000</td>\n",
       "      <td>7.000000</td>\n",
       "      <td>58.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50%</th>\n",
       "      <td>6.000000</td>\n",
       "      <td>13.000000</td>\n",
       "      <td>117.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75%</th>\n",
       "      <td>8.000000</td>\n",
       "      <td>18.000000</td>\n",
       "      <td>176.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max</th>\n",
       "      <td>10.000000</td>\n",
       "      <td>24.000000</td>\n",
       "      <td>286.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>\n",
       "    <div class=\"colab-df-buttons\">\n",
       "\n",
       "  <div class=\"colab-df-container\">\n",
       "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-f9badd31-6607-4870-8fbd-37197d7f32f8')\"\n",
       "            title=\"Convert this dataframe to an interactive table.\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
       "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
       "  </svg>\n",
       "    </button>\n",
       "\n",
       "  <style>\n",
       "    .colab-df-container {\n",
       "      display:flex;\n",
       "      gap: 12px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert {\n",
       "      background-color: #E8F0FE;\n",
       "      border: none;\n",
       "      border-radius: 50%;\n",
       "      cursor: pointer;\n",
       "      display: none;\n",
       "      fill: #1967D2;\n",
       "      height: 32px;\n",
       "      padding: 0 0 0 0;\n",
       "      width: 32px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert:hover {\n",
       "      background-color: #E2EBFA;\n",
       "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "      fill: #174EA6;\n",
       "    }\n",
       "\n",
       "    .colab-df-buttons div {\n",
       "      margin-bottom: 4px;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert {\n",
       "      background-color: #3B4455;\n",
       "      fill: #D2E3FC;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert:hover {\n",
       "      background-color: #434B5C;\n",
       "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
       "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
       "      fill: #FFFFFF;\n",
       "    }\n",
       "  </style>\n",
       "\n",
       "    <script>\n",
       "      const buttonEl =\n",
       "        document.querySelector('#df-f9badd31-6607-4870-8fbd-37197d7f32f8 button.colab-df-convert');\n",
       "      buttonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "\n",
       "      async function convertToInteractive(key) {\n",
       "        const element = document.querySelector('#df-f9badd31-6607-4870-8fbd-37197d7f32f8');\n",
       "        const dataTable =\n",
       "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
       "                                                    [key], {});\n",
       "        if (!dataTable) return;\n",
       "\n",
       "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
       "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
       "          + ' to learn more about interactive tables.';\n",
       "        element.innerHTML = '';\n",
       "        dataTable['output_type'] = 'display_data';\n",
       "        await google.colab.output.renderOutput(dataTable, element);\n",
       "        const docLink = document.createElement('div');\n",
       "        docLink.innerHTML = docLinkHtml;\n",
       "        element.appendChild(docLink);\n",
       "      }\n",
       "    </script>\n",
       "  </div>\n",
       "\n",
       "\n",
       "<div id=\"df-037a4a1c-2152-4b52-9578-fe728039a93d\">\n",
       "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-037a4a1c-2152-4b52-9578-fe728039a93d')\"\n",
       "            title=\"Suggest charts\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
       "     width=\"24px\">\n",
       "    <g>\n",
       "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
       "    </g>\n",
       "</svg>\n",
       "  </button>\n",
       "\n",
       "<style>\n",
       "  .colab-df-quickchart {\n",
       "      --bg-color: #E8F0FE;\n",
       "      --fill-color: #1967D2;\n",
       "      --hover-bg-color: #E2EBFA;\n",
       "      --hover-fill-color: #174EA6;\n",
       "      --disabled-fill-color: #AAA;\n",
       "      --disabled-bg-color: #DDD;\n",
       "  }\n",
       "\n",
       "  [theme=dark] .colab-df-quickchart {\n",
       "      --bg-color: #3B4455;\n",
       "      --fill-color: #D2E3FC;\n",
       "      --hover-bg-color: #434B5C;\n",
       "      --hover-fill-color: #FFFFFF;\n",
       "      --disabled-bg-color: #3B4455;\n",
       "      --disabled-fill-color: #666;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart {\n",
       "    background-color: var(--bg-color);\n",
       "    border: none;\n",
       "    border-radius: 50%;\n",
       "    cursor: pointer;\n",
       "    display: none;\n",
       "    fill: var(--fill-color);\n",
       "    height: 32px;\n",
       "    padding: 0;\n",
       "    width: 32px;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart:hover {\n",
       "    background-color: var(--hover-bg-color);\n",
       "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "    fill: var(--button-hover-fill-color);\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart-complete:disabled,\n",
       "  .colab-df-quickchart-complete:disabled:hover {\n",
       "    background-color: var(--disabled-bg-color);\n",
       "    fill: var(--disabled-fill-color);\n",
       "    box-shadow: none;\n",
       "  }\n",
       "\n",
       "  .colab-df-spinner {\n",
       "    border: 2px solid var(--fill-color);\n",
       "    border-color: transparent;\n",
       "    border-bottom-color: var(--fill-color);\n",
       "    animation:\n",
       "      spin 1s steps(1) infinite;\n",
       "  }\n",
       "\n",
       "  @keyframes spin {\n",
       "    0% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "      border-left-color: var(--fill-color);\n",
       "    }\n",
       "    20% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    30% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    40% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    60% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    80% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "    90% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "  }\n",
       "</style>\n",
       "\n",
       "  <script>\n",
       "    async function quickchart(key) {\n",
       "      const quickchartButtonEl =\n",
       "        document.querySelector('#' + key + ' button');\n",
       "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
       "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
       "      try {\n",
       "        const charts = await google.colab.kernel.invokeFunction(\n",
       "            'suggestCharts', [key], {});\n",
       "      } catch (error) {\n",
       "        console.error('Error during call to suggestCharts:', error);\n",
       "      }\n",
       "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
       "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
       "    }\n",
       "    (() => {\n",
       "      let quickchartButtonEl =\n",
       "        document.querySelector('#df-037a4a1c-2152-4b52-9578-fe728039a93d button');\n",
       "      quickchartButtonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "    })();\n",
       "  </script>\n",
       "</div>\n",
       "    </div>\n",
       "  </div>\n"
      ],
      "text/plain": [
       "         series_num        ep_num   phrase_rank\n",
       "count  50679.000000  50679.000000  50679.000000\n",
       "mean       5.911640     12.408473    118.418832\n",
       "std        2.728483      6.789142     69.802418\n",
       "min        1.000000      1.000000      0.000000\n",
       "25%        4.000000      7.000000     58.000000\n",
       "50%        6.000000     13.000000    117.000000\n",
       "75%        8.000000     18.000000    176.000000\n",
       "max       10.000000     24.000000    286.000000"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "\n",
       "  <div id=\"df-57c47a93-afba-4a43-a0b0-79c607ae10e6\" class=\"colab-df-container\">\n",
       "    <div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ep_name</th>\n",
       "      <th>person</th>\n",
       "      <th>text</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>count</th>\n",
       "      <td>50679</td>\n",
       "      <td>50679</td>\n",
       "      <td>50675</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>unique</th>\n",
       "      <td>215</td>\n",
       "      <td>982</td>\n",
       "      <td>43526</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>top</th>\n",
       "      <td>the conjugal conjecture</td>\n",
       "      <td>Sheldon</td>\n",
       "      <td>The apartment.</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>freq</th>\n",
       "      <td>287</td>\n",
       "      <td>10456</td>\n",
       "      <td>368</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>\n",
       "    <div class=\"colab-df-buttons\">\n",
       "\n",
       "  <div class=\"colab-df-container\">\n",
       "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-57c47a93-afba-4a43-a0b0-79c607ae10e6')\"\n",
       "            title=\"Convert this dataframe to an interactive table.\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
       "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
       "  </svg>\n",
       "    </button>\n",
       "\n",
       "  <style>\n",
       "    .colab-df-container {\n",
       "      display:flex;\n",
       "      gap: 12px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert {\n",
       "      background-color: #E8F0FE;\n",
       "      border: none;\n",
       "      border-radius: 50%;\n",
       "      cursor: pointer;\n",
       "      display: none;\n",
       "      fill: #1967D2;\n",
       "      height: 32px;\n",
       "      padding: 0 0 0 0;\n",
       "      width: 32px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert:hover {\n",
       "      background-color: #E2EBFA;\n",
       "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "      fill: #174EA6;\n",
       "    }\n",
       "\n",
       "    .colab-df-buttons div {\n",
       "      margin-bottom: 4px;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert {\n",
       "      background-color: #3B4455;\n",
       "      fill: #D2E3FC;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert:hover {\n",
       "      background-color: #434B5C;\n",
       "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
       "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
       "      fill: #FFFFFF;\n",
       "    }\n",
       "  </style>\n",
       "\n",
       "    <script>\n",
       "      const buttonEl =\n",
       "        document.querySelector('#df-57c47a93-afba-4a43-a0b0-79c607ae10e6 button.colab-df-convert');\n",
       "      buttonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "\n",
       "      async function convertToInteractive(key) {\n",
       "        const element = document.querySelector('#df-57c47a93-afba-4a43-a0b0-79c607ae10e6');\n",
       "        const dataTable =\n",
       "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
       "                                                    [key], {});\n",
       "        if (!dataTable) return;\n",
       "\n",
       "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
       "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
       "          + ' to learn more about interactive tables.';\n",
       "        element.innerHTML = '';\n",
       "        dataTable['output_type'] = 'display_data';\n",
       "        await google.colab.output.renderOutput(dataTable, element);\n",
       "        const docLink = document.createElement('div');\n",
       "        docLink.innerHTML = docLinkHtml;\n",
       "        element.appendChild(docLink);\n",
       "      }\n",
       "    </script>\n",
       "  </div>\n",
       "\n",
       "\n",
       "<div id=\"df-723579fa-9090-412b-8e04-037557e790e7\">\n",
       "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-723579fa-9090-412b-8e04-037557e790e7')\"\n",
       "            title=\"Suggest charts\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
       "     width=\"24px\">\n",
       "    <g>\n",
       "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
       "    </g>\n",
       "</svg>\n",
       "  </button>\n",
       "\n",
       "<style>\n",
       "  .colab-df-quickchart {\n",
       "      --bg-color: #E8F0FE;\n",
       "      --fill-color: #1967D2;\n",
       "      --hover-bg-color: #E2EBFA;\n",
       "      --hover-fill-color: #174EA6;\n",
       "      --disabled-fill-color: #AAA;\n",
       "      --disabled-bg-color: #DDD;\n",
       "  }\n",
       "\n",
       "  [theme=dark] .colab-df-quickchart {\n",
       "      --bg-color: #3B4455;\n",
       "      --fill-color: #D2E3FC;\n",
       "      --hover-bg-color: #434B5C;\n",
       "      --hover-fill-color: #FFFFFF;\n",
       "      --disabled-bg-color: #3B4455;\n",
       "      --disabled-fill-color: #666;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart {\n",
       "    background-color: var(--bg-color);\n",
       "    border: none;\n",
       "    border-radius: 50%;\n",
       "    cursor: pointer;\n",
       "    display: none;\n",
       "    fill: var(--fill-color);\n",
       "    height: 32px;\n",
       "    padding: 0;\n",
       "    width: 32px;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart:hover {\n",
       "    background-color: var(--hover-bg-color);\n",
       "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "    fill: var(--button-hover-fill-color);\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart-complete:disabled,\n",
       "  .colab-df-quickchart-complete:disabled:hover {\n",
       "    background-color: var(--disabled-bg-color);\n",
       "    fill: var(--disabled-fill-color);\n",
       "    box-shadow: none;\n",
       "  }\n",
       "\n",
       "  .colab-df-spinner {\n",
       "    border: 2px solid var(--fill-color);\n",
       "    border-color: transparent;\n",
       "    border-bottom-color: var(--fill-color);\n",
       "    animation:\n",
       "      spin 1s steps(1) infinite;\n",
       "  }\n",
       "\n",
       "  @keyframes spin {\n",
       "    0% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "      border-left-color: var(--fill-color);\n",
       "    }\n",
       "    20% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    30% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    40% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    60% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    80% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "    90% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "  }\n",
       "</style>\n",
       "\n",
       "  <script>\n",
       "    async function quickchart(key) {\n",
       "      const quickchartButtonEl =\n",
       "        document.querySelector('#' + key + ' button');\n",
       "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
       "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
       "      try {\n",
       "        const charts = await google.colab.kernel.invokeFunction(\n",
       "            'suggestCharts', [key], {});\n",
       "      } catch (error) {\n",
       "        console.error('Error during call to suggestCharts:', error);\n",
       "      }\n",
       "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
       "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
       "    }\n",
       "    (() => {\n",
       "      let quickchartButtonEl =\n",
       "        document.querySelector('#df-723579fa-9090-412b-8e04-037557e790e7 button');\n",
       "      quickchartButtonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "    })();\n",
       "  </script>\n",
       "</div>\n",
       "    </div>\n",
       "  </div>\n"
      ],
      "text/plain": [
       "                        ep_name   person            text\n",
       "count                     50679    50679           50675\n",
       "unique                      215      982           43526\n",
       "top     the conjugal conjecture  Sheldon  The apartment.\n",
       "freq                        287    10456             368"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "\n",
       "  <div id=\"df-781ac455-57ed-40c1-8d3c-4d95f8ecea2f\" class=\"colab-df-container\">\n",
       "    <div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>series_num</th>\n",
       "      <th>ep_num</th>\n",
       "      <th>ep_name</th>\n",
       "      <th>phrase_rank</th>\n",
       "      <th>person</th>\n",
       "      <th>text</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>10</td>\n",
       "      <td>the loobenfeld decay</td>\n",
       "      <td>0</td>\n",
       "      <td>Scene</td>\n",
       "      <td>The downstairs lobby.</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>10</td>\n",
       "      <td>the loobenfeld decay</td>\n",
       "      <td>1</td>\n",
       "      <td>Leonard</td>\n",
       "      <td>See, the liquid metal Terminators were created...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>10</td>\n",
       "      <td>the loobenfeld decay</td>\n",
       "      <td>2</td>\n",
       "      <td>Sheldon</td>\n",
       "      <td>Okay, then riddle me this. Assuming all the go...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>\n",
       "    <div class=\"colab-df-buttons\">\n",
       "\n",
       "  <div class=\"colab-df-container\">\n",
       "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-781ac455-57ed-40c1-8d3c-4d95f8ecea2f')\"\n",
       "            title=\"Convert this dataframe to an interactive table.\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
       "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
       "  </svg>\n",
       "    </button>\n",
       "\n",
       "  <style>\n",
       "    .colab-df-container {\n",
       "      display:flex;\n",
       "      gap: 12px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert {\n",
       "      background-color: #E8F0FE;\n",
       "      border: none;\n",
       "      border-radius: 50%;\n",
       "      cursor: pointer;\n",
       "      display: none;\n",
       "      fill: #1967D2;\n",
       "      height: 32px;\n",
       "      padding: 0 0 0 0;\n",
       "      width: 32px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert:hover {\n",
       "      background-color: #E2EBFA;\n",
       "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "      fill: #174EA6;\n",
       "    }\n",
       "\n",
       "    .colab-df-buttons div {\n",
       "      margin-bottom: 4px;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert {\n",
       "      background-color: #3B4455;\n",
       "      fill: #D2E3FC;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert:hover {\n",
       "      background-color: #434B5C;\n",
       "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
       "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
       "      fill: #FFFFFF;\n",
       "    }\n",
       "  </style>\n",
       "\n",
       "    <script>\n",
       "      const buttonEl =\n",
       "        document.querySelector('#df-781ac455-57ed-40c1-8d3c-4d95f8ecea2f button.colab-df-convert');\n",
       "      buttonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "\n",
       "      async function convertToInteractive(key) {\n",
       "        const element = document.querySelector('#df-781ac455-57ed-40c1-8d3c-4d95f8ecea2f');\n",
       "        const dataTable =\n",
       "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
       "                                                    [key], {});\n",
       "        if (!dataTable) return;\n",
       "\n",
       "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
       "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
       "          + ' to learn more about interactive tables.';\n",
       "        element.innerHTML = '';\n",
       "        dataTable['output_type'] = 'display_data';\n",
       "        await google.colab.output.renderOutput(dataTable, element);\n",
       "        const docLink = document.createElement('div');\n",
       "        docLink.innerHTML = docLinkHtml;\n",
       "        element.appendChild(docLink);\n",
       "      }\n",
       "    </script>\n",
       "  </div>\n",
       "\n",
       "\n",
       "<div id=\"df-21ed8ee7-1e4f-48d8-90ec-74acabd136b1\">\n",
       "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-21ed8ee7-1e4f-48d8-90ec-74acabd136b1')\"\n",
       "            title=\"Suggest charts\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
       "     width=\"24px\">\n",
       "    <g>\n",
       "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
       "    </g>\n",
       "</svg>\n",
       "  </button>\n",
       "\n",
       "<style>\n",
       "  .colab-df-quickchart {\n",
       "      --bg-color: #E8F0FE;\n",
       "      --fill-color: #1967D2;\n",
       "      --hover-bg-color: #E2EBFA;\n",
       "      --hover-fill-color: #174EA6;\n",
       "      --disabled-fill-color: #AAA;\n",
       "      --disabled-bg-color: #DDD;\n",
       "  }\n",
       "\n",
       "  [theme=dark] .colab-df-quickchart {\n",
       "      --bg-color: #3B4455;\n",
       "      --fill-color: #D2E3FC;\n",
       "      --hover-bg-color: #434B5C;\n",
       "      --hover-fill-color: #FFFFFF;\n",
       "      --disabled-bg-color: #3B4455;\n",
       "      --disabled-fill-color: #666;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart {\n",
       "    background-color: var(--bg-color);\n",
       "    border: none;\n",
       "    border-radius: 50%;\n",
       "    cursor: pointer;\n",
       "    display: none;\n",
       "    fill: var(--fill-color);\n",
       "    height: 32px;\n",
       "    padding: 0;\n",
       "    width: 32px;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart:hover {\n",
       "    background-color: var(--hover-bg-color);\n",
       "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "    fill: var(--button-hover-fill-color);\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart-complete:disabled,\n",
       "  .colab-df-quickchart-complete:disabled:hover {\n",
       "    background-color: var(--disabled-bg-color);\n",
       "    fill: var(--disabled-fill-color);\n",
       "    box-shadow: none;\n",
       "  }\n",
       "\n",
       "  .colab-df-spinner {\n",
       "    border: 2px solid var(--fill-color);\n",
       "    border-color: transparent;\n",
       "    border-bottom-color: var(--fill-color);\n",
       "    animation:\n",
       "      spin 1s steps(1) infinite;\n",
       "  }\n",
       "\n",
       "  @keyframes spin {\n",
       "    0% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "      border-left-color: var(--fill-color);\n",
       "    }\n",
       "    20% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    30% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    40% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    60% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    80% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "    90% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "  }\n",
       "</style>\n",
       "\n",
       "  <script>\n",
       "    async function quickchart(key) {\n",
       "      const quickchartButtonEl =\n",
       "        document.querySelector('#' + key + ' button');\n",
       "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
       "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
       "      try {\n",
       "        const charts = await google.colab.kernel.invokeFunction(\n",
       "            'suggestCharts', [key], {});\n",
       "      } catch (error) {\n",
       "        console.error('Error during call to suggestCharts:', error);\n",
       "      }\n",
       "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
       "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
       "    }\n",
       "    (() => {\n",
       "      let quickchartButtonEl =\n",
       "        document.querySelector('#df-21ed8ee7-1e4f-48d8-90ec-74acabd136b1 button');\n",
       "      quickchartButtonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "    })();\n",
       "  </script>\n",
       "</div>\n",
       "    </div>\n",
       "  </div>\n"
      ],
      "text/plain": [
       "   series_num  ep_num               ep_name  phrase_rank   person  \\\n",
       "0           1      10  the loobenfeld decay            0    Scene   \n",
       "1           1      10  the loobenfeld decay            1  Leonard   \n",
       "2           1      10  the loobenfeld decay            2  Sheldon   \n",
       "\n",
       "                                                text  \n",
       "0                              The downstairs lobby.  \n",
       "1  See, the liquid metal Terminators were created...  \n",
       "2  Okay, then riddle me this. Assuming all the go...  "
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "\n",
       "  <div id=\"df-79c6fe9b-9700-48b3-af52-192dbe20a55e\" class=\"colab-df-container\">\n",
       "    <div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>series_num</th>\n",
       "      <th>ep_num</th>\n",
       "      <th>ep_name</th>\n",
       "      <th>phrase_rank</th>\n",
       "      <th>person</th>\n",
       "      <th>text</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>50676</th>\n",
       "      <td>10</td>\n",
       "      <td>24</td>\n",
       "      <td>the long distance dissonance</td>\n",
       "      <td>233</td>\n",
       "      <td>Scene</td>\n",
       "      <td>Princeton.</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50677</th>\n",
       "      <td>10</td>\n",
       "      <td>24</td>\n",
       "      <td>the long distance dissonance</td>\n",
       "      <td>234</td>\n",
       "      <td>Sheldon</td>\n",
       "      <td>(Knock, knock, knock) Amy. (Knock, knock, knoc...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50678</th>\n",
       "      <td>10</td>\n",
       "      <td>24</td>\n",
       "      <td>the long distance dissonance</td>\n",
       "      <td>235</td>\n",
       "      <td>\\t\\tPrivacy &amp; Cookies</td>\n",
       "      <td>This site uses cookies. By continuing to use t...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>\n",
       "    <div class=\"colab-df-buttons\">\n",
       "\n",
       "  <div class=\"colab-df-container\">\n",
       "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-79c6fe9b-9700-48b3-af52-192dbe20a55e')\"\n",
       "            title=\"Convert this dataframe to an interactive table.\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
       "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
       "  </svg>\n",
       "    </button>\n",
       "\n",
       "  <style>\n",
       "    .colab-df-container {\n",
       "      display:flex;\n",
       "      gap: 12px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert {\n",
       "      background-color: #E8F0FE;\n",
       "      border: none;\n",
       "      border-radius: 50%;\n",
       "      cursor: pointer;\n",
       "      display: none;\n",
       "      fill: #1967D2;\n",
       "      height: 32px;\n",
       "      padding: 0 0 0 0;\n",
       "      width: 32px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert:hover {\n",
       "      background-color: #E2EBFA;\n",
       "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "      fill: #174EA6;\n",
       "    }\n",
       "\n",
       "    .colab-df-buttons div {\n",
       "      margin-bottom: 4px;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert {\n",
       "      background-color: #3B4455;\n",
       "      fill: #D2E3FC;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert:hover {\n",
       "      background-color: #434B5C;\n",
       "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
       "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
       "      fill: #FFFFFF;\n",
       "    }\n",
       "  </style>\n",
       "\n",
       "    <script>\n",
       "      const buttonEl =\n",
       "        document.querySelector('#df-79c6fe9b-9700-48b3-af52-192dbe20a55e button.colab-df-convert');\n",
       "      buttonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "\n",
       "      async function convertToInteractive(key) {\n",
       "        const element = document.querySelector('#df-79c6fe9b-9700-48b3-af52-192dbe20a55e');\n",
       "        const dataTable =\n",
       "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
       "                                                    [key], {});\n",
       "        if (!dataTable) return;\n",
       "\n",
       "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
       "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
       "          + ' to learn more about interactive tables.';\n",
       "        element.innerHTML = '';\n",
       "        dataTable['output_type'] = 'display_data';\n",
       "        await google.colab.output.renderOutput(dataTable, element);\n",
       "        const docLink = document.createElement('div');\n",
       "        docLink.innerHTML = docLinkHtml;\n",
       "        element.appendChild(docLink);\n",
       "      }\n",
       "    </script>\n",
       "  </div>\n",
       "\n",
       "\n",
       "<div id=\"df-57d57bc3-8809-455b-a131-61a1112baf5d\">\n",
       "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-57d57bc3-8809-455b-a131-61a1112baf5d')\"\n",
       "            title=\"Suggest charts\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
       "     width=\"24px\">\n",
       "    <g>\n",
       "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
       "    </g>\n",
       "</svg>\n",
       "  </button>\n",
       "\n",
       "<style>\n",
       "  .colab-df-quickchart {\n",
       "      --bg-color: #E8F0FE;\n",
       "      --fill-color: #1967D2;\n",
       "      --hover-bg-color: #E2EBFA;\n",
       "      --hover-fill-color: #174EA6;\n",
       "      --disabled-fill-color: #AAA;\n",
       "      --disabled-bg-color: #DDD;\n",
       "  }\n",
       "\n",
       "  [theme=dark] .colab-df-quickchart {\n",
       "      --bg-color: #3B4455;\n",
       "      --fill-color: #D2E3FC;\n",
       "      --hover-bg-color: #434B5C;\n",
       "      --hover-fill-color: #FFFFFF;\n",
       "      --disabled-bg-color: #3B4455;\n",
       "      --disabled-fill-color: #666;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart {\n",
       "    background-color: var(--bg-color);\n",
       "    border: none;\n",
       "    border-radius: 50%;\n",
       "    cursor: pointer;\n",
       "    display: none;\n",
       "    fill: var(--fill-color);\n",
       "    height: 32px;\n",
       "    padding: 0;\n",
       "    width: 32px;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart:hover {\n",
       "    background-color: var(--hover-bg-color);\n",
       "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "    fill: var(--button-hover-fill-color);\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart-complete:disabled,\n",
       "  .colab-df-quickchart-complete:disabled:hover {\n",
       "    background-color: var(--disabled-bg-color);\n",
       "    fill: var(--disabled-fill-color);\n",
       "    box-shadow: none;\n",
       "  }\n",
       "\n",
       "  .colab-df-spinner {\n",
       "    border: 2px solid var(--fill-color);\n",
       "    border-color: transparent;\n",
       "    border-bottom-color: var(--fill-color);\n",
       "    animation:\n",
       "      spin 1s steps(1) infinite;\n",
       "  }\n",
       "\n",
       "  @keyframes spin {\n",
       "    0% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "      border-left-color: var(--fill-color);\n",
       "    }\n",
       "    20% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    30% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    40% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    60% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    80% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "    90% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "  }\n",
       "</style>\n",
       "\n",
       "  <script>\n",
       "    async function quickchart(key) {\n",
       "      const quickchartButtonEl =\n",
       "        document.querySelector('#' + key + ' button');\n",
       "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
       "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
       "      try {\n",
       "        const charts = await google.colab.kernel.invokeFunction(\n",
       "            'suggestCharts', [key], {});\n",
       "      } catch (error) {\n",
       "        console.error('Error during call to suggestCharts:', error);\n",
       "      }\n",
       "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
       "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
       "    }\n",
       "    (() => {\n",
       "      let quickchartButtonEl =\n",
       "        document.querySelector('#df-57d57bc3-8809-455b-a131-61a1112baf5d button');\n",
       "      quickchartButtonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "    })();\n",
       "  </script>\n",
       "</div>\n",
       "    </div>\n",
       "  </div>\n"
      ],
      "text/plain": [
       "       series_num  ep_num                       ep_name  phrase_rank  \\\n",
       "50676          10      24  the long distance dissonance          233   \n",
       "50677          10      24  the long distance dissonance          234   \n",
       "50678          10      24  the long distance dissonance          235   \n",
       "\n",
       "                      person  \\\n",
       "50676                  Scene   \n",
       "50677                Sheldon   \n",
       "50678  \\t\\tPrivacy & Cookies   \n",
       "\n",
       "                                                    text  \n",
       "50676                                        Princeton.   \n",
       "50677  (Knock, knock, knock) Amy. (Knock, knock, knoc...  \n",
       "50678  This site uses cookies. By continuing to use t...  "
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "4     5930\n",
       "10    5911\n",
       "9     5819\n",
       "7     5736\n",
       "8     5416\n",
       "3     5314\n",
       "5     5158\n",
       "2     4828\n",
       "6     4592\n",
       "1     1975\n",
       "Name: series_num, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "11    2419\n",
       "16    2376\n",
       "13    2366\n",
       "15    2327\n",
       "12    2307\n",
       "17    2227\n",
       "20    2205\n",
       "3     2202\n",
       "1     2192\n",
       "2     2167\n",
       "4     2159\n",
       "22    2148\n",
       "6     2143\n",
       "14    2130\n",
       "19    2117\n",
       "7     2113\n",
       "21    2079\n",
       "9     2071\n",
       "10    2054\n",
       "18    1988\n",
       "23    1930\n",
       "8     1813\n",
       "5     1622\n",
       "24    1524\n",
       "Name: ep_num, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "the conjugal conjecture                      287\n",
       "the zazzy substitution                       284\n",
       "the panty pinata polarization                279\n",
       "the fermentation bifurcation                 279\n",
       "the occupation recalibration                 277\n",
       "                                            ... \n",
       "the werewolf transformation                  185\n",
       "the bozeman reaction                         179\n",
       "the monster isolation                        176\n",
       "the pants alternative                        171\n",
       "the contractual obligation implementation    157\n",
       "Name: ep_name, Length: 215, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "0      215\n",
       "108    215\n",
       "101    215\n",
       "102    215\n",
       "103    215\n",
       "      ... \n",
       "282      2\n",
       "283      2\n",
       "284      1\n",
       "285      1\n",
       "286      1\n",
       "Name: phrase_rank, Length: 287, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "Sheldon                                     10456\n",
       "Leonard                                      8567\n",
       "Penny                                        6888\n",
       "Howard                                       5384\n",
       "Raj                                          4286\n",
       "                                            ...  \n",
       "Leonard (pretending to sneeze)                  1\n",
       "Howard (laughs)                                 1\n",
       "Penny (picking up a top and sniffing it)        1\n",
       "Rai                                             1\n",
       "Penny (answering skype)                         1\n",
       "Name: person, Length: 982, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "The apartment.                                                                                                                                                                                                                                                                                                                                                                   368\n",
       "No.                                                                                                                                                                                                                                                                                                                                                                              256\n",
       "What?                                                                                                                                                                                                                                                                                                                                                                            254\n",
       "This site uses cookies. By continuing to use this website, you agree to their use.                                                                                                                                                                                                                                                                                               215\n",
       "Yes.                                                                                                                                                                                                                                                                                                                                                                             203\n",
       "                                                                                                                                                                                                                                                                                                                                                                                ... \n",
       "A bookstore.                                                                                                                                                                                                                                                                                                                                                                       1\n",
       "My new book, The Hidden Reality, takes on a grand question. Is our universe the only universe? You see, there’s a growing belief among scientists like me that ours may only be one among many universes populating a gigantic cosmos. In The Hidden Reality, I explore this possibility without presuming any knowledge of mathematics or physics on the part of the reader.      1\n",
       "Hysterical.                                                                                                                                                                                                                                                                                                                                                                        1\n",
       "I’m glad you talked me into this. We work so hard, sometimes, it’s nice to goof off and do something silly.                                                                                                                                                                                                                                                                        1\n",
       "(Knock, knock, knock) Amy. (Knock, knock, knock) Amy. (Knock, knock, knock) Amy. Will you marry me?                                                                                                                                                                                                                                                                                1\n",
       "Name: text, Length: 43526, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "print(df.shape)\n",
    "print(df.columns)\n",
    "print(df.info())\n",
    "display(df.describe())\n",
    "display(df.describe(include=object))\n",
    "display(df.head(3))\n",
    "display(df.tail(3))\n",
    "for c in df.columns:\n",
    "  display(df[c].value_counts())\n",
    "for c in ['series_num','ep_num','phrase_rank']:\n",
    "  df[c] = df[c].astype('int16')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 1000
    },
    "executionInfo": {
     "elapsed": 348,
     "status": "ok",
     "timestamp": 1707243128594,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "JBX2pd1DiqB3",
    "outputId": "2154a570-7b41-4294-9a0b-af0fccccc7f9"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'\\t\\tPrivacy & Cookies',\n",
       " ' Leonard (To Howard and Raj)',\n",
       " ' Scene',\n",
       " '1. (Redraws tic-tac-toe board) Sheldon',\n",
       " '1. Amy (singing)',\n",
       " '2. (Sheldon is laying out an intricate pattern of dominoes) Amy',\n",
       " '3. (Sheldon is turning the handle on a jack-in-the-box. Just before the end of the tune) Amy',\n",
       " '3. (Winds up jack-in-the-box until it pops out.) Sheldon',\n",
       " '4. Amy',\n",
       " '4. Sheldon (singing)',\n",
       " '5. (Knocks over first of intricate domino pattern) Sheldon',\n",
       " 'Abby',\n",
       " 'Actor',\n",
       " 'Actor (as Mitch)',\n",
       " 'Actress',\n",
       " 'Adam',\n",
       " 'Adam West',\n",
       " 'Air Force Officer',\n",
       " 'Alex',\n",
       " 'Alfred',\n",
       " 'Alfred Hofstadter',\n",
       " 'Alice',\n",
       " 'Alicia',\n",
       " 'All',\n",
       " 'All (chanting)',\n",
       " 'All (joining in)',\n",
       " 'All (repeatedly)',\n",
       " 'All three',\n",
       " 'All together',\n",
       " 'Amelia',\n",
       " 'Amy',\n",
       " 'Amy (Phone text sound)',\n",
       " 'Amy (Tablet ringing)',\n",
       " 'Amy (answering phone)',\n",
       " 'Amy (at door)',\n",
       " 'Amy (between screams)',\n",
       " 'Amy (bursting in)',\n",
       " 'Amy (entering)',\n",
       " 'Amy (exiting bathroom)',\n",
       " 'Amy (in flashback)',\n",
       " 'Amy (into a mini-cam)',\n",
       " 'Amy (knock on door)',\n",
       " 'Amy (now in her car)',\n",
       " 'Amy (off)',\n",
       " 'Amy (on Skype)',\n",
       " 'Amy (on phone)',\n",
       " 'Amy (on skype)',\n",
       " 'Amy (on walkie-talkie)',\n",
       " 'Amy (on webcam)',\n",
       " 'Amy (on webcam, with an undersea background)',\n",
       " 'Amy (phone ringing, running down stairs from outside Penny’s door)',\n",
       " 'Amy (reading a text on her phone)',\n",
       " 'Amy (ringing from tablet)',\n",
       " 'Amy (shouting)',\n",
       " 'Amy (singing)',\n",
       " 'Amy (tablet ringing)',\n",
       " 'Amy (to Penny, on other side of room)',\n",
       " 'Amy (voice)',\n",
       " 'Amy and Bernadette together',\n",
       " 'Amy(off)',\n",
       " 'Angela',\n",
       " 'Announcement',\n",
       " 'Announcer',\n",
       " 'Answerphone',\n",
       " 'Arthur',\n",
       " 'Assistant',\n",
       " 'Assistant (clicks her keyboard a few times)',\n",
       " 'Attorney',\n",
       " 'Audiitoner',\n",
       " 'Awkward guy',\n",
       " 'Baggage Clerk',\n",
       " 'Bar patrons',\n",
       " 'Barber',\n",
       " 'Barman',\n",
       " 'Barry',\n",
       " 'Barry (knocking)',\n",
       " 'Barry (to his own phone)',\n",
       " 'Barry (voice)',\n",
       " 'Barry Kripke',\n",
       " 'Barry’s Siri',\n",
       " 'Bermadette',\n",
       " 'Bermadette (in a voice like Mrs Wolowitz)',\n",
       " 'Bernadette',\n",
       " 'Bernadette (above)',\n",
       " 'Bernadette (as Doll)',\n",
       " 'Bernadette (has a coughing fit)',\n",
       " 'Bernadette (her phone chimes)',\n",
       " 'Bernadette (in Raj’s bathroom)',\n",
       " 'Bernadette (in a gruff voice)',\n",
       " 'Bernadette (in a similar voice)',\n",
       " 'Bernadette (likewise)',\n",
       " 'Bernadette (off)',\n",
       " 'Bernadette (on phone)',\n",
       " 'Bernadette (on screen)',\n",
       " 'Bernadette (on skype)',\n",
       " 'Bernadette (on webcam)',\n",
       " 'Bernadette (out of the window)',\n",
       " 'Bernadette (pff)',\n",
       " 'Bernadette (phone rings)',\n",
       " 'Bernadette (reading)',\n",
       " 'Bernadette (screaming)',\n",
       " 'Bernadette (singing)',\n",
       " 'Bernadette (taking boots and running)',\n",
       " 'Bernadette (waking suddenly)',\n",
       " 'Bert',\n",
       " 'Bespectacled Man',\n",
       " 'Bethany',\n",
       " 'Beverley',\n",
       " 'Beverley (gives him an uncomfortable hug)',\n",
       " 'Beverley (on skype)',\n",
       " 'Beverly',\n",
       " 'Bill',\n",
       " 'Bill Nye',\n",
       " 'Blonde Girl',\n",
       " 'Blonde girl (arriving)',\n",
       " 'Bookstore employee',\n",
       " 'Both',\n",
       " 'Both together (singing)',\n",
       " 'Brent',\n",
       " 'Brent Spiner',\n",
       " 'Buzz (on video, handing Halloween candy to children)',\n",
       " 'Caller',\n",
       " 'Caption',\n",
       " 'Carrie Fisher',\n",
       " 'Charlie Sheen (turning round)',\n",
       " 'Child',\n",
       " 'Chorus of everyone in cafeteria (singing)',\n",
       " 'Claire',\n",
       " 'Claire (on phone)',\n",
       " 'Claire (voice)',\n",
       " 'Cleaner',\n",
       " 'Clerk',\n",
       " 'Col',\n",
       " 'Col Williams',\n",
       " 'Col. Williams',\n",
       " 'Cole',\n",
       " 'Cole (off)',\n",
       " 'Colonel Williams',\n",
       " 'Computer Voice',\n",
       " 'Cooper',\n",
       " 'Cosmonaut',\n",
       " 'Cosmonaut (in Russian)',\n",
       " 'Costume guy',\n",
       " 'Dale',\n",
       " 'Dan',\n",
       " 'Daniel',\n",
       " 'Dave',\n",
       " 'Dave (voice on phone)',\n",
       " 'David',\n",
       " 'David (approaching)',\n",
       " 'Dead Mrs Wolowitz',\n",
       " 'Dennis',\n",
       " 'Dimitri',\n",
       " 'Dimitri (in Russian)',\n",
       " 'Director',\n",
       " 'Doctor',\n",
       " 'Dr Gablehouser',\n",
       " 'Dr Gablehouser (arriving)',\n",
       " 'Dr Gallo',\n",
       " 'Dr Hofstadter',\n",
       " 'Dr Koothrapalli',\n",
       " 'Dr Koothrapalli (on facetime)',\n",
       " 'Dr Koothrapalli (on skype)',\n",
       " 'Dr Koothrappali',\n",
       " 'Dr Lorvis',\n",
       " 'Dr Massimino',\n",
       " 'Dr Millstone',\n",
       " 'Dr Schneider',\n",
       " 'Dr Tyson',\n",
       " 'Dr. Brian Greene',\n",
       " 'Dr. Seibert',\n",
       " 'Elderly Korean Gentleman',\n",
       " 'Elizabeth',\n",
       " 'Ellen',\n",
       " 'Elon',\n",
       " 'Emily',\n",
       " 'Emily (voice)',\n",
       " 'Emily and Penny (simultaneously)',\n",
       " 'Emly',\n",
       " 'Employee',\n",
       " 'Employment Office Assistant',\n",
       " 'Eric',\n",
       " 'Eric (appearing round corner with Penny)',\n",
       " 'Eric (leaving, to Howard)',\n",
       " 'Everybody',\n",
       " 'Everyone',\n",
       " 'Everyone (on ship)',\n",
       " 'Fat Leonard',\n",
       " 'Fat Leonard and Raj',\n",
       " 'Fat Raj',\n",
       " 'Fat Stuart',\n",
       " 'Female Voice',\n",
       " 'First Alien',\n",
       " 'First Car Thief',\n",
       " 'First Girl',\n",
       " 'Foreign Nurse',\n",
       " 'GPS',\n",
       " 'GPS (in Sheldon’s voice)',\n",
       " 'Gablehauser',\n",
       " 'Gablehauser (as phone rings)',\n",
       " 'Gablehauser (entering)',\n",
       " 'Gablehouser',\n",
       " 'Gablehouser (entering)',\n",
       " 'George Smoot',\n",
       " 'George Takei',\n",
       " 'Ghostly voice',\n",
       " 'Girl',\n",
       " 'Girl (arriving)',\n",
       " 'Girl (to Penny)',\n",
       " 'Girl 2',\n",
       " 'Girl dressed as a Witch',\n",
       " 'Girls',\n",
       " 'Glenn',\n",
       " 'Glenn (voice)',\n",
       " 'Goldfarb',\n",
       " 'Good looking man coming up stairs',\n",
       " 'Greene',\n",
       " 'Gretchen',\n",
       " 'Guard',\n",
       " 'Guy',\n",
       " 'Guy at door',\n",
       " 'Guy in baseball hat',\n",
       " 'Guys in Passing Car (throwing a drink over Sheldon)',\n",
       " 'HR Woman',\n",
       " 'HR Woman (writing)',\n",
       " 'Halley',\n",
       " 'Hawking',\n",
       " 'Headmaster',\n",
       " 'Helium Man',\n",
       " 'Hernandez',\n",
       " 'Hot girl',\n",
       " 'Hot girl (to Leonard)',\n",
       " 'Houston',\n",
       " 'Howard',\n",
       " 'Howard (Picks up receiver)',\n",
       " 'Howard (after Raj whispers in his ear)',\n",
       " 'Howard (after Raj whispers to him)',\n",
       " 'Howard (after Raj whispers)',\n",
       " 'Howard (after his phone rings)',\n",
       " 'Howard (answering a knock on the door)',\n",
       " 'Howard (answering door)',\n",
       " 'Howard (arriving)',\n",
       " 'Howard (arriving, in goth gear)',\n",
       " 'Howard (as Leonard enters)',\n",
       " 'Howard (as Leonard groans loudly in his room)',\n",
       " 'Howard (at the door)',\n",
       " 'Howard (crying)',\n",
       " 'Howard (door bell rings)',\n",
       " 'Howard (dressed as a Borg)',\n",
       " 'Howard (entering)',\n",
       " 'Howard (imitating his mother’s voice)',\n",
       " 'Howard (in Stephen Hawking voice)',\n",
       " 'Howard (in a squeaky voice)',\n",
       " 'Howard (into phone)',\n",
       " 'Howard (knocking on bathroom door)',\n",
       " 'Howard (laughs)',\n",
       " 'Howard (off)',\n",
       " 'Howard (on Skype)',\n",
       " 'Howard (on phone)',\n",
       " 'Howard (on the phone)',\n",
       " 'Howard (on the stage, into a microphone)',\n",
       " 'Howard (on webcam)',\n",
       " 'Howard (outside the door)',\n",
       " 'Howard (phone rings)',\n",
       " 'Howard (picks up a granola bar from the table, breaks off half and puts it in his back pocket.)',\n",
       " 'Howard (reading a text)',\n",
       " 'Howard (reluctantly singing)',\n",
       " 'Howard (responding to other Emily)',\n",
       " 'Howard (running down stairs with Raj)',\n",
       " 'Howard (signing)',\n",
       " 'Howard (singing)',\n",
       " 'Howard (steeling himself to talk to Summer Glau, to himself)',\n",
       " 'Howard (still singing)',\n",
       " 'Howard (through bathroom door)',\n",
       " 'Howard (to Raj who has whispered to him)',\n",
       " 'Howard (to Raj who is whispering in his ear)',\n",
       " 'Howard (to Raj, who has whispered to him)',\n",
       " 'Howard (to Raj, who is smiling)',\n",
       " 'Howard (to his genitals)',\n",
       " 'Howard (to man climbing out window)',\n",
       " 'Howard (to self)',\n",
       " 'Howard (to the real Raj who is daydreaming)',\n",
       " 'Howard (translating for Emily)',\n",
       " 'Howard (translating for other Emily)',\n",
       " 'Howard (translating)',\n",
       " 'Howard (voice from inside)',\n",
       " 'Howard (voice off)',\n",
       " 'Howard (voice)',\n",
       " 'Howard and Bernadette (singing)',\n",
       " 'Howard and Bernadette (together)',\n",
       " 'Howard and Raj',\n",
       " 'Howard and Raj (singing)',\n",
       " 'Howard and Raj (together)',\n",
       " 'Howard’s Mother',\n",
       " 'Howard’s Mother (off)',\n",
       " 'Howard’s Mother (voice)',\n",
       " 'Howard’s cousin (on skype)',\n",
       " 'Howard’s mother',\n",
       " 'Howard’s mother (off)',\n",
       " 'Howatd',\n",
       " 'Howie Mandel',\n",
       " 'Huge man (opening door)',\n",
       " 'ISS voice',\n",
       " 'Ira',\n",
       " 'Ira Flatow',\n",
       " 'Isabella',\n",
       " 'James',\n",
       " 'James Earl Jones',\n",
       " 'Janine',\n",
       " 'Jeannie',\n",
       " 'Jeff',\n",
       " 'Jesse',\n",
       " 'Jimmy',\n",
       " 'Jimmy (arriving)',\n",
       " 'Jimmy (belching)',\n",
       " 'Josh',\n",
       " 'Joy',\n",
       " 'Joy (burping)',\n",
       " 'Joyce Kim',\n",
       " 'Judge',\n",
       " 'Katee',\n",
       " 'Katee Sackhoff',\n",
       " 'Kathy',\n",
       " 'Kevin',\n",
       " 'Kevn',\n",
       " 'Kid',\n",
       " 'Kirk (on screen)',\n",
       " 'Korean',\n",
       " 'Kripke',\n",
       " 'Kripke (arriving)',\n",
       " 'Kripke (voice)',\n",
       " 'Kurt',\n",
       " 'Lady Vet',\n",
       " 'Lakshmi',\n",
       " 'Large Black Transvestite',\n",
       " 'Laura',\n",
       " 'LeVar',\n",
       " 'LeVar Burton',\n",
       " 'Leonard',\n",
       " 'Leonard & Howard',\n",
       " 'Leonard (Dials phone)',\n",
       " 'Leonard (Penny sneezes)',\n",
       " 'Leonard (To Howard and Raj)',\n",
       " 'Leonard (Waking up as Penny screams)',\n",
       " 'Leonard (after Raj whispers to him)',\n",
       " 'Leonard (after Sheldon tuts)',\n",
       " 'Leonard (after a long pause)',\n",
       " 'Leonard (after he, Sheldon and Howard whisper to each other)',\n",
       " 'Leonard (as Ride of the Valkyries begins)',\n",
       " 'Leonard (as Sheldon enters)',\n",
       " 'Leonard (as he wins on his slot machine)',\n",
       " 'Leonard (at door)',\n",
       " 'Leonard (chasing him)',\n",
       " 'Leonard (closing door)',\n",
       " 'Leonard (continuing Deck the Halls)',\n",
       " 'Leonard (continuing through Penny)',\n",
       " 'Leonard (crying)',\n",
       " 'Leonard (dressed as Captain Picard)',\n",
       " 'Leonard (entering apartment)',\n",
       " 'Leonard (entering on the phone)',\n",
       " 'Leonard (entering with Howard)',\n",
       " 'Leonard (entering)',\n",
       " 'Leonard (enters)',\n",
       " 'Leonard (exiting the apartment)',\n",
       " 'Leonard (following Sheldon into living room)',\n",
       " 'Leonard (going to living room)',\n",
       " 'Leonard (handing him protective glasses)',\n",
       " 'Leonard (hearing animal noises)',\n",
       " 'Leonard (in Penny’s apartment)',\n",
       " 'Leonard (in a Yoda voice)',\n",
       " 'Leonard (in bed)',\n",
       " 'Leonard (in low voice)',\n",
       " 'Leonard (indicating the blanket)',\n",
       " 'Leonard (into phone)',\n",
       " 'Leonard (into phone, which has just rung)',\n",
       " 'Leonard (jumping and knocking over the Jenga)',\n",
       " 'Leonard (knocking and entering)',\n",
       " 'Leonard (knocking on door)',\n",
       " 'Leonard (laughing)',\n",
       " 'Leonard (laughs)',\n",
       " 'Leonard (leaving)',\n",
       " 'Leonard (letting go of time machine, as does Sheldon)',\n",
       " 'Leonard (looking at an orange notice on the noticeboard)',\n",
       " 'Leonard (looking out of window)',\n",
       " 'Leonard (making a change)',\n",
       " 'Leonard (noticing their door has been broken open)',\n",
       " 'Leonard (off)',\n",
       " 'Leonard (off, also screaming)',\n",
       " 'Leonard (on board boat, at a party, dancing)',\n",
       " 'Leonard (on phone)',\n",
       " 'Leonard (on screen)',\n",
       " 'Leonard (on ship)',\n",
       " 'Leonard (on video)',\n",
       " 'Leonard (opening door)',\n",
       " 'Leonard (out of Raj’s daydream)',\n",
       " 'Leonard (outside apartment)',\n",
       " 'Leonard (phone rings)',\n",
       " 'Leonard (phone rings.)',\n",
       " 'Leonard (pointing)',\n",
       " 'Leonard (pretending to sneeze)',\n",
       " 'Leonard (pulling out a toy lightsabre)',\n",
       " 'Leonard (reading a napkin Sheldon has handed him)',\n",
       " 'Leonard (returning in a tee shirt and backwards cap)',\n",
       " 'Leonard (returning)',\n",
       " 'Leonard (running down stairs)',\n",
       " 'Leonard (running in)',\n",
       " 'Leonard (rushing to catch up with Cole)',\n",
       " 'Leonard (seeing Penny’s door open and the girls inside)',\n",
       " 'Leonard (singing Deck the Halls)',\n",
       " 'Leonard (singing)',\n",
       " 'Leonard (still talking)',\n",
       " 'Leonard (taking it off)',\n",
       " 'Leonard (there is a knock on the door)',\n",
       " 'Leonard (to Penny who has got up to leave)',\n",
       " 'Leonard (to Penny who is standing next to him grinning)',\n",
       " 'Leonard (to Priya)',\n",
       " 'Leonard (to Raj)',\n",
       " 'Leonard (to Sheldon, entering)',\n",
       " 'Leonard (to barmaid)',\n",
       " 'Leonard (undressing)',\n",
       " 'Leonard (voice off)',\n",
       " 'Leonard (voice on phone)',\n",
       " 'Leonard (voice)',\n",
       " 'Leonard (waking up)',\n",
       " 'Leonard (whispering)',\n",
       " 'Leonard and Howard',\n",
       " 'Leonard and Howard (together)',\n",
       " 'Leonard and Howard together',\n",
       " 'Leonard and Penny',\n",
       " 'Leonard and Raj together',\n",
       " 'Leonard and Sheldon',\n",
       " 'Leonard, Howard and Raj (singing)',\n",
       " 'Leonard-warrior',\n",
       " 'Leonard-warrior’s head',\n",
       " 'Leonard:',\n",
       " 'Leonard’s Mother',\n",
       " 'Leslie',\n",
       " 'Leslie (arriving)',\n",
       " 'Leslie (entering)',\n",
       " 'Leslie (whispering)',\n",
       " 'Leslie Winkle',\n",
       " 'Leslie Winkle (entering)',\n",
       " 'Little girl',\n",
       " 'Lucy',\n",
       " 'Lucy ',\n",
       " 'Lucy (by text)',\n",
       " 'Lucy(by text)',\n",
       " 'Maitre d’',\n",
       " 'Man',\n",
       " 'Man (off)',\n",
       " 'Man (to Lucy)',\n",
       " 'Man in Crowd',\n",
       " 'Man in Penny’s Apartment',\n",
       " 'Man in Suit',\n",
       " 'Man in seat behind',\n",
       " 'Man on Screen',\n",
       " 'Man on TV',\n",
       " 'Man with Flowers',\n",
       " 'Man with a box',\n",
       " 'Mandy',\n",
       " 'Man’s Voice (off)',\n",
       " 'Mark Harmon on TV',\n",
       " 'Martha',\n",
       " 'Marty',\n",
       " 'Mary',\n",
       " 'Mary Cooper',\n",
       " 'Mass',\n",
       " 'Mechanical voice on Sheldon’s phone',\n",
       " 'Meemaw',\n",
       " 'Michaela',\n",
       " 'Michaela (arriving)',\n",
       " 'Midwife',\n",
       " 'Mike',\n",
       " 'Mike (on Skype)',\n",
       " 'Mike M',\n",
       " 'Mike Massimino',\n",
       " 'Mike Massimino (on skype)',\n",
       " 'Mike R',\n",
       " 'Mike Rostenkowski',\n",
       " 'Minister',\n",
       " 'Mission Control',\n",
       " 'Mission Control (in Russian)',\n",
       " 'Missy',\n",
       " 'Missy (who has just entered)',\n",
       " 'Model',\n",
       " 'Montage of scenes',\n",
       " 'Mr Rostenkowski',\n",
       " 'Mr Spock Cuckoo Clock',\n",
       " 'Mr. Rostenkowski',\n",
       " 'Mrs',\n",
       " 'Mrs Cooper',\n",
       " 'Mrs Cooper (off)',\n",
       " 'Mrs Cooper (to God)',\n",
       " 'Mrs Davis',\n",
       " 'Mrs Fowler',\n",
       " 'Mrs Fowler (on webcam)',\n",
       " 'Mrs Gunderson',\n",
       " 'Mrs Hofstadter',\n",
       " 'Mrs Hofstadter (on webcam)',\n",
       " 'Mrs Koothrapalli',\n",
       " 'Mrs Koothrappali',\n",
       " 'Mrs Koothrappali (on webcam)',\n",
       " 'Mrs Latham',\n",
       " 'Mrs Petrescu',\n",
       " 'Mrs Wolowitz',\n",
       " 'Mrs Wolowitz (off)',\n",
       " 'Mrs Wolowitz (on phone)',\n",
       " 'Mrs Wolowitz (voice on answerphone)',\n",
       " 'Mrs Wolowitz (voice)',\n",
       " 'Mrs. Rostenkowski',\n",
       " 'Ms Jenson',\n",
       " 'NASA Guy (on skype)',\n",
       " 'Nathan',\n",
       " 'Nathan Fillion',\n",
       " 'Nerdy Guy',\n",
       " 'Nerdy guy',\n",
       " 'Nurse',\n",
       " 'Official',\n",
       " 'Older woman',\n",
       " 'On-screen Sheldon',\n",
       " 'Owner (in English)',\n",
       " 'Owner (in Mandarin)',\n",
       " 'Page',\n",
       " 'Paramedic',\n",
       " 'Past Howard',\n",
       " 'Past Leonard',\n",
       " 'Past Leonard (Enters apartment. It is bare except for two lawn chairs, a television and some whiteboards)',\n",
       " 'Past Penny',\n",
       " 'Past Raj',\n",
       " 'Past Sheldon',\n",
       " 'Penny',\n",
       " 'Penny & Sheldon together',\n",
       " 'Penny (Knock, knock, knock)',\n",
       " 'Penny (Opens door again)',\n",
       " 'Penny (accidentally nudging the man sitting behind her)',\n",
       " 'Penny (acting)',\n",
       " 'Penny (after Amy laughs)',\n",
       " 'Penny (after Raj lets out a noise)',\n",
       " 'Penny (after Raj whispers to Howard and they both laugh)',\n",
       " 'Penny (after a knock on the door)',\n",
       " 'Penny (after a loud sigh)',\n",
       " 'Penny (also still screaming)',\n",
       " 'Penny (answering phone)',\n",
       " 'Penny (answering skype)',\n",
       " 'Penny (answering)',\n",
       " 'Penny (arriving with a man in tow)',\n",
       " 'Penny (arriving with cushion)',\n",
       " 'Penny (arriving)',\n",
       " 'Penny (as Blanche DuBois) ',\n",
       " 'Penny (as Blanche)',\n",
       " 'Penny (as Sheldon enters)',\n",
       " 'Penny (as Sheldon sits on the bed)',\n",
       " 'Penny (as the making out is interrupted by a knock on the door)',\n",
       " 'Penny (at Howard’s workshop, reading text)',\n",
       " 'Penny (at door)',\n",
       " 'Penny (breaking off kiss)',\n",
       " 'Penny (bringing another grasshopper)',\n",
       " 'Penny (checking phone)',\n",
       " 'Penny (coming out of apartment)',\n",
       " 'Penny (coming out of her apartment)',\n",
       " 'Penny (coming out of her flat)',\n",
       " 'Penny (crying)',\n",
       " 'Penny (emerging from Tardis)',\n",
       " 'Penny (entering room dishevelled, with a half naked Raj behind)',\n",
       " 'Penny (entering with a pink suitcase)',\n",
       " 'Penny (entering)',\n",
       " 'Penny (entering, angry)',\n",
       " 'Penny (entering, carrying a laptop)',\n",
       " 'Penny (entering, looking ratty in baggy clothes and with her hair unwashed)',\n",
       " 'Penny (exiting apartment)',\n",
       " 'Penny (finishing Deck the Halls)',\n",
       " 'Penny (from outside)',\n",
       " 'Penny (handing Howard the Vagisil coupon)',\n",
       " 'Penny (handing him vaporub)',\n",
       " 'Penny (in a red bridesmaid dress)',\n",
       " 'Penny (in hallway)',\n",
       " 'Penny (in tears)',\n",
       " 'Penny (knock on door)',\n",
       " 'Penny (knocking and entering)',\n",
       " 'Penny (knocking and entering, holding up a pair of superman undershorts.)',\n",
       " 'Penny (knocking on window)',\n",
       " 'Penny (knocking)',\n",
       " 'Penny (laughing)',\n",
       " 'Penny (listening in her apartment)',\n",
       " 'Penny (lower voice)',\n",
       " 'Penny (normal voice)',\n",
       " 'Penny (off)',\n",
       " 'Penny (off, screaming)',\n",
       " 'Penny (on phone)',\n",
       " 'Penny (on screen)',\n",
       " 'Penny (on television)',\n",
       " 'Penny (opening door to find Raj outside)',\n",
       " 'Penny (opening door)',\n",
       " 'Penny (opening window)',\n",
       " 'Penny (out of the window)',\n",
       " 'Penny (over Sheldon’s strange throat clearance)',\n",
       " 'Penny (phone text tone)',\n",
       " 'Penny (picking up a top and sniffing it)',\n",
       " 'Penny (picking up the bag she has just repacked, whereupon the bottom falls out and the groceries fall to the floor again)',\n",
       " 'Penny (picking up wine)',\n",
       " 'Penny (pointing randomly)',\n",
       " 'Penny (pouring out a shot of tequila)',\n",
       " 'Penny (pretending to be close to tears)',\n",
       " 'Penny (pulling cheeto out of hair)',\n",
       " 'Penny (reading text)',\n",
       " 'Penny (reading)',\n",
       " 'Penny (receiving text)',\n",
       " 'Penny (screams)',\n",
       " 'Penny (singing)',\n",
       " 'Penny (spits out drink explosively. Howard types. Robot arm hands Penny a napkin)',\n",
       " 'Penny (squealing)',\n",
       " 'Penny (squeals)',\n",
       " 'Penny (still singing off)',\n",
       " 'Penny (storming in)',\n",
       " 'Penny (tapping him on the shoulder)',\n",
       " 'Penny (through gritted teeth)',\n",
       " 'Penny (tipping all her laundry into one machine at once)',\n",
       " 'Penny (to Kevin)',\n",
       " 'Penny (to Leonard who is just coming up the stairs)',\n",
       " 'Penny (to Leonard)',\n",
       " 'Penny (to Raj)',\n",
       " 'Penny (to the shoes)',\n",
       " 'Penny (treating Sheldon as a ventriloquist doll)',\n",
       " 'Penny (turning, heavily pregnant)',\n",
       " 'Penny (voice off)',\n",
       " 'Penny (voice off, ascending the stairs)',\n",
       " 'Penny (voice off, singing, quite tunelessly)',\n",
       " 'Penny (voice outside door)',\n",
       " 'Penny (voice)',\n",
       " 'Penny (voiceover)',\n",
       " 'Penny (waking up)',\n",
       " 'Penny (waking, bleary)',\n",
       " 'Penny (whispering)',\n",
       " 'Penny (who is inside the apartment)',\n",
       " 'Penny (with Sheldon in background at the head of a large queue of customers)',\n",
       " 'Penny (with shop assistant, points at Sheldon)',\n",
       " 'Penny (with two black eyes and a plaster across her nose)',\n",
       " 'Penny(leaving)',\n",
       " 'Penny(voice)',\n",
       " 'Penny- warrior',\n",
       " 'Penny-warrior',\n",
       " 'Penny’s Dad',\n",
       " 'Penny’s dad (Wyatt)',\n",
       " 'Phone',\n",
       " 'Photographer',\n",
       " 'Pizza guy',\n",
       " 'Policeman',\n",
       " 'Priya',\n",
       " 'Priya (arriving)',\n",
       " 'Priya (at door)',\n",
       " 'Priya (computer tone)',\n",
       " 'Priya (off)',\n",
       " 'Priya (on laptop screen)',\n",
       " 'Priya (on screen)',\n",
       " 'Prof Crawley',\n",
       " 'Prof Crawley (arriving)',\n",
       " 'Prof Laughlin',\n",
       " 'Prof Sharpe',\n",
       " 'Professor Proton (on youtube)',\n",
       " 'Psychic',\n",
       " 'Ra',\n",
       " 'Radio',\n",
       " 'Rai',\n",
       " 'Raj',\n",
       " 'Raj & Sheldon',\n",
       " 'Raj (Holds up finger to indicate he will be right back. Runs to kitchen. Tries to drink wine but bottle is empty. Looks in fridge and finds rum cake. Comes back stuffing a piece in his mouth)',\n",
       " 'Raj (Sitting against their front door, drinking a beer)',\n",
       " 'Raj (after watching complete destruction of toaster oven)',\n",
       " 'Raj (answering phone)',\n",
       " 'Raj (arriving)',\n",
       " 'Raj (as Sheldon reaches out and grabs from his plate)',\n",
       " 'Raj (as a ringing noise is heard)',\n",
       " 'Raj (at door)',\n",
       " 'Raj (at the workshop)',\n",
       " 'Raj (by text)',\n",
       " 'Raj (checking text on phone)',\n",
       " 'Raj (doorbell rings)',\n",
       " 'Raj (drinking some wine)',\n",
       " 'Raj (earphones in, singing)',\n",
       " 'Raj (entering excitedly)',\n",
       " 'Raj (entering with Howard)',\n",
       " 'Raj (entering)',\n",
       " 'Raj (finding a large quantity of condoms)',\n",
       " 'Raj (from outside)',\n",
       " 'Raj (hearing the cricket)',\n",
       " 'Raj (holding it)',\n",
       " 'Raj (imitating him)',\n",
       " 'Raj (in American accent)',\n",
       " 'Raj (in a munchkin voice)',\n",
       " 'Raj (in cupboard)',\n",
       " 'Raj (indicating Sheldon)',\n",
       " 'Raj (inhales deeply, picks up laptop, presses a button. His mother and father appear on the screen)',\n",
       " 'Raj (inside cupboard)',\n",
       " 'Raj (inside)',\n",
       " 'Raj (knocking and entering)',\n",
       " 'Raj (leaving, singing)',\n",
       " 'Raj (locks door)',\n",
       " 'Raj (off)',\n",
       " 'Raj (on his webcam)',\n",
       " 'Raj (on phone)',\n",
       " 'Raj (on skype)',\n",
       " 'Raj (out of daydream)',\n",
       " 'Raj (outside)',\n",
       " 'Raj (over walkie-talkie)',\n",
       " 'Raj (phone rings)',\n",
       " 'Raj (pointing at a crucifixion statue)',\n",
       " 'Raj (pressing button on camera phone. Camera makes a fart noise)',\n",
       " 'Raj (putting game back on and removing shirt)',\n",
       " 'Raj (rapping)',\n",
       " 'Raj (reaching the other side)',\n",
       " 'Raj (reading Howard’s twitter)',\n",
       " 'Raj (removing his trousers)',\n",
       " 'Raj (rolls and moves)',\n",
       " 'Raj (running in)',\n",
       " 'Raj (screams)',\n",
       " 'Raj (shouting from upstairs window)',\n",
       " 'Raj (singing)',\n",
       " 'Raj (still naked)',\n",
       " 'Raj (taking a big gulp of his drink)',\n",
       " 'Raj (taking his shirt off)',\n",
       " 'Raj (to a mirror)',\n",
       " 'Raj (tries several times. Finally, in a high pitched squeak)',\n",
       " 'Raj (trying door)',\n",
       " 'Raj (voice off)',\n",
       " 'Raj (voice)',\n",
       " 'Raj (waking from a dream)',\n",
       " 'Raj (walking past and straight up to Summer Glau)',\n",
       " 'Raj (waving finger at him)',\n",
       " 'Raj and Penny together',\n",
       " 'Raj, Bernadette and Amy',\n",
       " 'Rajj',\n",
       " 'Raj’s Voice',\n",
       " 'Ramona',\n",
       " 'Ramona (arriving)',\n",
       " 'Ramona (entering)',\n",
       " 'Ramona (off)',\n",
       " 'Ramona Nowitzki',\n",
       " 'Randall',\n",
       " 'Randall (Penny’s brother)',\n",
       " 'Random guy',\n",
       " 'Random man',\n",
       " 'Random voice',\n",
       " 'Random woman',\n",
       " 'Rebecca',\n",
       " 'Receptionist',\n",
       " 'Red-haired guy',\n",
       " 'Registrar',\n",
       " 'Remote-control Hawking',\n",
       " 'Roeger',\n",
       " 'Rothman',\n",
       " 'Rothman (entering, naked)',\n",
       " 'Santa',\n",
       " 'Sarah',\n",
       " 'Scanner',\n",
       " 'Scanner (as Leonard and Sheldon try to fool it with one eye each)',\n",
       " 'Sceme',\n",
       " 'Scene',\n",
       " 'Secne',\n",
       " 'Second Alien',\n",
       " 'Second Car Thief',\n",
       " 'Second Girl',\n",
       " 'Second child',\n",
       " 'Second girl',\n",
       " 'Second guy',\n",
       " 'Second voice',\n",
       " 'Security Guard',\n",
       " 'Sehldon',\n",
       " 'Seibert',\n",
       " 'Server',\n",
       " 'Sgeldon',\n",
       " 'Shedon',\n",
       " 'Sheldon',\n",
       " 'Sheldon (Hugging her)',\n",
       " 'Sheldon (Knock, knock, knock) ',\n",
       " 'Sheldon (Knock, knock, knock, in a low voice)',\n",
       " 'Sheldon (Squirting him with a water spray)',\n",
       " 'Sheldon (after demonstrating)',\n",
       " 'Sheldon (after they look at each other in confusion)',\n",
       " 'Sheldon (after they pass a smug look between each other)',\n",
       " 'Sheldon (answering door)',\n",
       " 'Sheldon (answering)',\n",
       " 'Sheldon (appearing behind her)',\n",
       " 'Sheldon (appearing in an apron and carrying a tray)',\n",
       " 'Sheldon (appearing in the back seat)',\n",
       " 'Sheldon (arriving with Alex)',\n",
       " 'Sheldon (arriving)',\n",
       " 'Sheldon (as The Flash, runs to the Grand Canyon)',\n",
       " 'Sheldon (as music comes down through ceiling)',\n",
       " 'Sheldon (at Penny’s door)',\n",
       " 'Sheldon (at knock on door)',\n",
       " 'Sheldon (behind them)',\n",
       " 'Sheldon (brandishing toy sword from Leonard’s box)',\n",
       " 'Sheldon (burping)',\n",
       " 'Sheldon (calling from outside)',\n",
       " 'Sheldon (choking)',\n",
       " 'Sheldon (coughing several times)',\n",
       " 'Sheldon (creeps into office carrying a box)',\n",
       " 'Sheldon (dodging out of the way)',\n",
       " 'Sheldon (doing nothing)',\n",
       " 'Sheldon (dramatically)',\n",
       " 'Sheldon (drops tray. A nearby table claps)',\n",
       " 'Sheldon (entering again)',\n",
       " 'Sheldon (entering dressed as The Flash)',\n",
       " 'Sheldon (entering in his Star Trek themed shirt)',\n",
       " 'Sheldon (entering)',\n",
       " 'Sheldon (entering, soaked)',\n",
       " 'Sheldon (entering, to Penny who is in his spot)',\n",
       " 'Sheldon (entering, wrapped in duvet)',\n",
       " 'Sheldon (even higher pitch)',\n",
       " 'Sheldon (excitedly)',\n",
       " 'Sheldon (exiting while the door is open)',\n",
       " 'Sheldon (in Mandarin)',\n",
       " 'Sheldon (in Penny’s living room)',\n",
       " 'Sheldon (in bathroom)',\n",
       " 'Sheldon (in his sleep)',\n",
       " 'Sheldon (in the apartment)',\n",
       " 'Sheldon (inside)',\n",
       " 'Sheldon (jumping in panic)',\n",
       " 'Sheldon (jumps up)',\n",
       " 'Sheldon (knock on door)',\n",
       " 'Sheldon (leaping out of the base of the sofa)',\n",
       " 'Sheldon (looking the other way uncomfortably)',\n",
       " 'Sheldon (lower voice)',\n",
       " 'Sheldon (measures)',\n",
       " 'Sheldon (moving to block his path)',\n",
       " 'Sheldon (not in Amy’s daydream, now in the Cheesecake Factory)',\n",
       " 'Sheldon (now in a sparkly green suit with rhinestones)',\n",
       " 'Sheldon (off)',\n",
       " 'Sheldon (off, voice heard through apartment door as they approach)',\n",
       " 'Sheldon (on Kripke’s computer in the lab)',\n",
       " 'Sheldon (on phone)',\n",
       " 'Sheldon (on screen)',\n",
       " 'Sheldon (on video)',\n",
       " 'Sheldon (outside)',\n",
       " 'Sheldon (phone gives text alert)',\n",
       " 'Sheldon (phone rings)',\n",
       " 'Sheldon (picks up train)',\n",
       " 'Sheldon (pointing at his brain)',\n",
       " 'Sheldon (popping his head up)',\n",
       " 'Sheldon (preparing an extension cord)',\n",
       " 'Sheldon (reading)',\n",
       " 'Sheldon (referring to Bollywood singing on television)',\n",
       " 'Sheldon (remembering the hug)',\n",
       " 'Sheldon (removing hernia support)',\n",
       " 'Sheldon (rhythmically, while walking down the stairs)',\n",
       " 'Sheldon (ripping off sticker)',\n",
       " 'Sheldon (rolls dice)',\n",
       " 'Sheldon (running to opposite side of the room)',\n",
       " 'Sheldon (sarcastically)',\n",
       " 'Sheldon (shouting)',\n",
       " 'Sheldon (showing him laptop)',\n",
       " 'Sheldon (singing at the same time)',\n",
       " 'Sheldon (singing)',\n",
       " 'Sheldon (sings)',\n",
       " 'Sheldon (snatching it)',\n",
       " 'Sheldon (still off)',\n",
       " 'Sheldon (still smiling)',\n",
       " 'Sheldon (through glass door pane)',\n",
       " 'Sheldon (throwing alien onto the laptop)',\n",
       " 'Sheldon (to Gablehouser)',\n",
       " 'Sheldon (to Howard)',\n",
       " 'Sheldon (to Leonard)',\n",
       " 'Sheldon (to Raj)',\n",
       " 'Sheldon (to Ricky)',\n",
       " 'Sheldon (to customer)',\n",
       " 'Sheldon (to two oriental-looking people occupying the other seats)',\n",
       " 'Sheldon (trying it)',\n",
       " 'Sheldon (voice from Howards laptop)',\n",
       " 'Sheldon (voice off)',\n",
       " 'Sheldon (voice off, sings to a Mexican tune)',\n",
       " 'Sheldon (voice)',\n",
       " 'Sheldon (waking up in bed)',\n",
       " 'Sheldon (waking up, singing)',\n",
       " 'Sheldon (walking past)',\n",
       " 'Sheldon (wearing a heavy coat and false nose and glasses)',\n",
       " 'Sheldon (while camera zooms out from Sheldon to above planet in a pastiche of the famous Wrath of Khan scene)',\n",
       " 'Sheldon (whispers)',\n",
       " 'Sheldon (with an alien creature stuck to his face)',\n",
       " 'Sheldon on laptop screen',\n",
       " 'Sheldon-bot',\n",
       " 'Sheldon-bot ',\n",
       " 'Sheldon-bot (screen switching itself back on)',\n",
       " 'Sheldon’s phone',\n",
       " 'Sheldon’s voice',\n",
       " 'Shelldon (off)',\n",
       " 'Shldon',\n",
       " 'Shopkeeper',\n",
       " 'Siebert',\n",
       " 'Siri',\n",
       " 'Soup Kitchen Manager',\n",
       " 'Speccy Guy',\n",
       " 'Speccy Guy Behind Counter (sniggering)',\n",
       " 'Spock',\n",
       " 'Spock (on screen)',\n",
       " 'Stadium Announcer',\n",
       " 'Stan Lee',\n",
       " 'Stan Lee (opening door)',\n",
       " 'Steph',\n",
       " 'Stephen',\n",
       " 'Stephen Hawking',\n",
       " 'Stephen Hawking (on Skype)',\n",
       " 'Stephen Hawking (on skype)',\n",
       " 'Steve Wozniak',\n",
       " 'Store assistant',\n",
       " 'Store clerk',\n",
       " 'Story',\n",
       " 'Strange man',\n",
       " 'Strange old man',\n",
       " 'Stuart',\n",
       " 'Stuart (knocking and entering)',\n",
       " 'Stuart (knocking)',\n",
       " 'Stuart (off)',\n",
       " 'Stuart (on phone)',\n",
       " 'Stuart (singing)',\n",
       " 'Stuart (voice on answerphone)',\n",
       " 'Summer',\n",
       " 'Summer (uncomfortable)',\n",
       " 'Susan',\n",
       " 'Susan (Penny’s mother)',\n",
       " 'Sweatpants',\n",
       " 'TV Announcer',\n",
       " 'Tall British Dave',\n",
       " 'Tattooist',\n",
       " 'Taxi Driver',\n",
       " 'Taxi driver',\n",
       " 'Tech Support Guy',\n",
       " 'Tech Support Voice',\n",
       " 'Teleplay',\n",
       " 'Television voice',\n",
       " 'The Flash',\n",
       " 'The Flash (the voice)',\n",
       " 'The three guys',\n",
       " 'Theatre Staff',\n",
       " 'Theatre staff',\n",
       " 'Theodore',\n",
       " 'Third Floor Janitor',\n",
       " 'Toby',\n",
       " 'Todd',\n",
       " 'Together',\n",
       " 'Together (lifting)',\n",
       " 'Together (singing)',\n",
       " 'Tom',\n",
       " 'Transvestite',\n",
       " 'Trent',\n",
       " 'Vanessa',\n",
       " 'Various',\n",
       " 'Various others (all at once)',\n",
       " 'Venkatesh',\n",
       " 'Very tall and powerfully built man',\n",
       " 'Vet',\n",
       " 'Voice',\n",
       " 'Voice Inside',\n",
       " 'Voice from Outside',\n",
       " 'Voice of Spock',\n",
       " 'Voice on TV',\n",
       " 'Voice on television',\n",
       " 'Waiter',\n",
       " 'Waitress',\n",
       " 'Warrior',\n",
       " 'Wil',\n",
       " 'Wil (filming on his phone)',\n",
       " 'Wil Wheaton',\n",
       " 'Wil Wheaton (entering)',\n",
       " 'Witch',\n",
       " 'Woman',\n",
       " 'Woman (leaning over Raj)',\n",
       " 'Woman at Door',\n",
       " 'Woman at table',\n",
       " 'Woman in lab coat',\n",
       " 'Woman in queue',\n",
       " 'Woman on TV',\n",
       " 'Woman’s voice',\n",
       " 'Woman’s voice (off)',\n",
       " 'Wyatt',\n",
       " 'Wyatt (Penny’s father)',\n",
       " 'Wyatt (phone rings)',\n",
       " 'Zack',\n",
       " 'Zack (after a moment’s thought)',\n",
       " 'Zack (on phone)',\n",
       " 'Zombie',\n",
       " '\\xa0Howard',\n",
       " '\\xa0Sheldon'}"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "display(set(df['person'].tolist()))\n",
    "# видим, что много персонажей являются базовыми персонажами, но в скобках даны ситуационные уточнения."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 296,
     "status": "ok",
     "timestamp": 1707243147749,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "RODouzV_kdSq",
    "outputId": "dbddad6c-4316-4c62-86e8-b0f225f14d87"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Sheldon             10651\n",
       "Leonard              8689\n",
       "Penny                7058\n",
       "Howard               5500\n",
       "Raj                  4385\n",
       "                    ...  \n",
       "Voice of Spock          1\n",
       "Store clerk             1\n",
       "Professor Proton        1\n",
       "Joyce Kim               1\n",
       "Ramona Nowitzki         1\n",
       "Name: person, Length: 405, dtype: int64"
      ]
     },
     "execution_count": 93,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['person_orig'] = df['person']\n",
    "df['person'] = df['person_orig'].apply(lambda x:\n",
    "    re.sub(\n",
    "    r\"(.+)\\((.+)\\)\",\n",
    "    r\"\\1\",\n",
    "    x).strip()\n",
    "                                       )\n",
    "df['person_context'] = df['person_orig'].apply(lambda x:\n",
    "    re.sub(\n",
    "    r\"(.+)\\((.+)\\)\",\n",
    "    r\"\\2\",\n",
    "    x).strip()\n",
    "                                       )\n",
    "df['person'].value_counts(ascending = False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "V8y4Q-CJr_kI"
   },
   "outputs": [],
   "source": [
    "df['scene_context'] = df.apply(lambda r: r['text'] if r['person']=='Scene' else np.nan, axis = 1)\n",
    "df['scene_context'] = df['scene_context'].fillna(method='ffill')\n",
    "df = df[~(df['person']=='Scene')]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 704,
     "status": "ok",
     "timestamp": 1707243212317,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "JYEhCNRexPEk",
    "outputId": "50fd72d2-2df0-4955-b53d-4910a8b455e2"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "True     46676\n",
       "False     1329\n",
       "Name: person_context, dtype: int64"
      ]
     },
     "execution_count": 96,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['person_context'] = df.apply(lambda r: np.nan if r['person_orig']==r['person_context'] else r['person_context'], axis=1)\n",
    "df['person_context'].isnull().value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 273,
     "status": "ok",
     "timestamp": 1707243228872,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "vz0zbzcAzKiO",
    "outputId": "fc18fe07-b1d7-436b-ef59-0b5f354559d2"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "No.                                                                                                    256\n",
       "What?                                                                                                  254\n",
       "Yes.                                                                                                   203\n",
       "Hey.                                                                                                   165\n",
       "Yeah.                                                                                                  165\n",
       "                                                                                                      ... \n",
       "It’s a splatter thing. There’s a little piece of tape on the floor you’re supposed to stand behind.      1\n",
       "That’s madness.                                                                                          1\n",
       "I know. Just do it. There’s a big inspection coming up, and I don’t want to lose my TV privileges.       1\n",
       "You really need to let me take a look at that roommate agreement one of these days.                      1\n",
       "(Knock, knock, knock) Amy. (Knock, knock, knock) Amy. (Knock, knock, knock) Amy. Will you marry me?      1\n",
       "Name: text, Length: 42632, dtype: int64"
      ]
     },
     "execution_count": 97,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# df.text.value_counts(ascending = False)\n",
    "# удалим нечаянно попавшей в сценарий строки про кукизы, неаккуратно парсили сайт\n",
    "df = df[~(df['text']=='This site uses cookies. By continuing to use this website, you agree to their use. ')]\n",
    "df.text.value_counts(ascending = False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 307,
     "status": "ok",
     "timestamp": 1707243232289,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "SE56eBiemsXs",
    "outputId": "7882e783-5fa5-4ef3-de9c-e798ced80084"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "Int64Index: 47790 entries, 1 to 50677\n",
      "Data columns (total 9 columns):\n",
      " #   Column          Non-Null Count  Dtype \n",
      "---  ------          --------------  ----- \n",
      " 0   series_num      47790 non-null  int16 \n",
      " 1   ep_num          47790 non-null  int16 \n",
      " 2   ep_name         47790 non-null  object\n",
      " 3   phrase_rank     47790 non-null  int16 \n",
      " 4   person          47790 non-null  object\n",
      " 5   text            47786 non-null  object\n",
      " 6   person_orig     47790 non-null  object\n",
      " 7   person_context  1114 non-null   object\n",
      " 8   scene_context   47790 non-null  object\n",
      "dtypes: int16(3), object(6)\n",
      "memory usage: 2.8+ MB\n"
     ]
    }
   ],
   "source": [
    "df.info()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "60CTCK1q0HhQ"
   },
   "outputs": [],
   "source": [
    "df.to_excel('/content/drive/MyDrive/Colab Notebooks/edu/nlp2/hw1/data/eng_script_enriched.xlsx', header=True, index=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "WLaAL-EUDuGx"
   },
   "source": [
    "### Исследование данных: исследование характеристик диалогов."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "yopYsL9NDsfz"
   },
   "outputs": [],
   "source": [
    "df = pd.read_excel('/content/drive/MyDrive/Colab Notebooks/edu/nlp2/hw1/data/eng_script_enriched.xlsx')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "QZX-BPhXEQdr"
   },
   "outputs": [],
   "source": [
    "# Так как мы решаем задачу чатбота, обогатим каждую текущую строку информацией о\n",
    "# нескольких ПРЕДЫДУЩИХ строках. Для задачи чатбота не требуется знать информацию о\n",
    "# СЛЕДУЮЩИХ строках для предсказания текущей строки."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 5,
     "status": "ok",
     "timestamp": 1707238001089,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "22ts45hrUHNR",
    "outputId": "b4285981-1f65-4ca4-b834-6a38195aea9f"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['series_num', 'ep_num', 'ep_name', 'phrase_rank', 'person', 'text',\n",
       "       'person_orig', 'person_context', 'scene_context'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 55,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "WbFSBEo_EmDv"
   },
   "outputs": [],
   "source": [
    "# добавим на строку предыдущие 5 диалогов и их авторов, но только если все они были в рамках ОДНОЙ СЦЕНЫ.\n",
    "# Одна сцена гарантирует нам единство контекста.\n",
    "\n",
    "tdf = pd.DataFrame({'text':['aaa','bbb','ccc','eee','fff','kkk','zzz'], 'scene':[1,1,1,1,2,2,2]})\n",
    "tdf.groupby('scene')['text'].apply(lambda s: s.shift(5, fill_value='') +' ' + s.shift(4, fill_value='')+' '+s.shift(3, fill_value='') +' ' + s.shift(2, fill_value='')+' ' + s.shift(1, fill_value=''))\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 608
    },
    "executionInfo": {
     "elapsed": 723,
     "status": "ok",
     "timestamp": 1707238073347,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "_H7l7XVXSizV",
    "outputId": "dbf4c3d7-7be9-48eb-d1b8-ea9b6bf2ec67"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "<ipython-input-57-3648e929d941>:1: FutureWarning: Not prepending group keys to the result index of transform-like apply. In the future, the group keys will be included in the index, regardless of whether the applied function returns a like-indexed object.\n",
      "To preserve the previous behavior, use\n",
      "\n",
      "\t>>> .groupby(..., group_keys=False)\n",
      "\n",
      "To adopt the future behavior and silence this warning, use \n",
      "\n",
      "\t>>> .groupby(..., group_keys=True)\n",
      "  df['text_5_prev'] = df.groupby('scene_context')['text'].apply(lambda s: s.shift(5, fill_value='') +' ' + s.shift(4, fill_value='')+' '+s.shift(3, fill_value='') +' ' + s.shift(2, fill_value='')+' ' + s.shift(1, fill_value=''))\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "\n",
       "  <div id=\"df-99dca8b7-5529-44c3-b86e-53eb2095e27e\" class=\"colab-df-container\">\n",
       "    <div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>scene_context</th>\n",
       "      <th>text</th>\n",
       "      <th>phrase_rank</th>\n",
       "      <th>text_5_prev</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>The downstairs lobby.</td>\n",
       "      <td>See, the liquid metal Terminators were created...</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>The downstairs lobby.</td>\n",
       "      <td>Okay, then riddle me this. Assuming all the go...</td>\n",
       "      <td>2</td>\n",
       "      <td>See, the liquid metal Terminators were cre...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>The downstairs lobby.</td>\n",
       "      <td>Skynet is kinky? I don’t know.</td>\n",
       "      <td>3</td>\n",
       "      <td>See, the liquid metal Terminators were crea...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>The downstairs lobby.</td>\n",
       "      <td>Artificial intelligences do not have teen feti...</td>\n",
       "      <td>4</td>\n",
       "      <td>See, the liquid metal Terminators were creat...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>The downstairs lobby.</td>\n",
       "      <td>Alright, oh wait, they use it to in…</td>\n",
       "      <td>5</td>\n",
       "      <td>See, the liquid metal Terminators were create...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47785</th>\n",
       "      <td>Sheldon’s office.</td>\n",
       "      <td>Mmm. No big deal, I enjoy spending time with you.</td>\n",
       "      <td>229</td>\n",
       "      <td>Hey, did you eat yet? Uh, breakfast yes, lunc...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47786</th>\n",
       "      <td>Sheldon’s office.</td>\n",
       "      <td>And I with you. Question, are you seeking a ro...</td>\n",
       "      <td>230</td>\n",
       "      <td>Hey, did you eat yet? Uh, breakfast yes, lunch...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47787</th>\n",
       "      <td>Sheldon’s office.</td>\n",
       "      <td>What if I were?</td>\n",
       "      <td>231</td>\n",
       "      <td>Uh, breakfast yes, lunch no. I did have a coug...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47788</th>\n",
       "      <td>Sheldon’s office.</td>\n",
       "      <td>Well, that would raise a number of problems. W...</td>\n",
       "      <td>232</td>\n",
       "      <td>Well, perfect. I made us sandwiches. How thoug...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47789</th>\n",
       "      <td>Princeton.</td>\n",
       "      <td>(Knock, knock, knock) Amy. (Knock, knock, knoc...</td>\n",
       "      <td>234</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>47790 rows × 4 columns</p>\n",
       "</div>\n",
       "    <div class=\"colab-df-buttons\">\n",
       "\n",
       "  <div class=\"colab-df-container\">\n",
       "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-99dca8b7-5529-44c3-b86e-53eb2095e27e')\"\n",
       "            title=\"Convert this dataframe to an interactive table.\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
       "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
       "  </svg>\n",
       "    </button>\n",
       "\n",
       "  <style>\n",
       "    .colab-df-container {\n",
       "      display:flex;\n",
       "      gap: 12px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert {\n",
       "      background-color: #E8F0FE;\n",
       "      border: none;\n",
       "      border-radius: 50%;\n",
       "      cursor: pointer;\n",
       "      display: none;\n",
       "      fill: #1967D2;\n",
       "      height: 32px;\n",
       "      padding: 0 0 0 0;\n",
       "      width: 32px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert:hover {\n",
       "      background-color: #E2EBFA;\n",
       "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "      fill: #174EA6;\n",
       "    }\n",
       "\n",
       "    .colab-df-buttons div {\n",
       "      margin-bottom: 4px;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert {\n",
       "      background-color: #3B4455;\n",
       "      fill: #D2E3FC;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert:hover {\n",
       "      background-color: #434B5C;\n",
       "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
       "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
       "      fill: #FFFFFF;\n",
       "    }\n",
       "  </style>\n",
       "\n",
       "    <script>\n",
       "      const buttonEl =\n",
       "        document.querySelector('#df-99dca8b7-5529-44c3-b86e-53eb2095e27e button.colab-df-convert');\n",
       "      buttonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "\n",
       "      async function convertToInteractive(key) {\n",
       "        const element = document.querySelector('#df-99dca8b7-5529-44c3-b86e-53eb2095e27e');\n",
       "        const dataTable =\n",
       "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
       "                                                    [key], {});\n",
       "        if (!dataTable) return;\n",
       "\n",
       "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
       "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
       "          + ' to learn more about interactive tables.';\n",
       "        element.innerHTML = '';\n",
       "        dataTable['output_type'] = 'display_data';\n",
       "        await google.colab.output.renderOutput(dataTable, element);\n",
       "        const docLink = document.createElement('div');\n",
       "        docLink.innerHTML = docLinkHtml;\n",
       "        element.appendChild(docLink);\n",
       "      }\n",
       "    </script>\n",
       "  </div>\n",
       "\n",
       "\n",
       "<div id=\"df-82498195-772a-4b5f-813a-b83efbf5c4b3\">\n",
       "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-82498195-772a-4b5f-813a-b83efbf5c4b3')\"\n",
       "            title=\"Suggest charts\"\n",
       "            style=\"display:none;\">\n",
       "\n",
       "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
       "     width=\"24px\">\n",
       "    <g>\n",
       "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
       "    </g>\n",
       "</svg>\n",
       "  </button>\n",
       "\n",
       "<style>\n",
       "  .colab-df-quickchart {\n",
       "      --bg-color: #E8F0FE;\n",
       "      --fill-color: #1967D2;\n",
       "      --hover-bg-color: #E2EBFA;\n",
       "      --hover-fill-color: #174EA6;\n",
       "      --disabled-fill-color: #AAA;\n",
       "      --disabled-bg-color: #DDD;\n",
       "  }\n",
       "\n",
       "  [theme=dark] .colab-df-quickchart {\n",
       "      --bg-color: #3B4455;\n",
       "      --fill-color: #D2E3FC;\n",
       "      --hover-bg-color: #434B5C;\n",
       "      --hover-fill-color: #FFFFFF;\n",
       "      --disabled-bg-color: #3B4455;\n",
       "      --disabled-fill-color: #666;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart {\n",
       "    background-color: var(--bg-color);\n",
       "    border: none;\n",
       "    border-radius: 50%;\n",
       "    cursor: pointer;\n",
       "    display: none;\n",
       "    fill: var(--fill-color);\n",
       "    height: 32px;\n",
       "    padding: 0;\n",
       "    width: 32px;\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart:hover {\n",
       "    background-color: var(--hover-bg-color);\n",
       "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "    fill: var(--button-hover-fill-color);\n",
       "  }\n",
       "\n",
       "  .colab-df-quickchart-complete:disabled,\n",
       "  .colab-df-quickchart-complete:disabled:hover {\n",
       "    background-color: var(--disabled-bg-color);\n",
       "    fill: var(--disabled-fill-color);\n",
       "    box-shadow: none;\n",
       "  }\n",
       "\n",
       "  .colab-df-spinner {\n",
       "    border: 2px solid var(--fill-color);\n",
       "    border-color: transparent;\n",
       "    border-bottom-color: var(--fill-color);\n",
       "    animation:\n",
       "      spin 1s steps(1) infinite;\n",
       "  }\n",
       "\n",
       "  @keyframes spin {\n",
       "    0% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "      border-left-color: var(--fill-color);\n",
       "    }\n",
       "    20% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    30% {\n",
       "      border-color: transparent;\n",
       "      border-left-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    40% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-top-color: var(--fill-color);\n",
       "    }\n",
       "    60% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "    }\n",
       "    80% {\n",
       "      border-color: transparent;\n",
       "      border-right-color: var(--fill-color);\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "    90% {\n",
       "      border-color: transparent;\n",
       "      border-bottom-color: var(--fill-color);\n",
       "    }\n",
       "  }\n",
       "</style>\n",
       "\n",
       "  <script>\n",
       "    async function quickchart(key) {\n",
       "      const quickchartButtonEl =\n",
       "        document.querySelector('#' + key + ' button');\n",
       "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
       "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
       "      try {\n",
       "        const charts = await google.colab.kernel.invokeFunction(\n",
       "            'suggestCharts', [key], {});\n",
       "      } catch (error) {\n",
       "        console.error('Error during call to suggestCharts:', error);\n",
       "      }\n",
       "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
       "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
       "    }\n",
       "    (() => {\n",
       "      let quickchartButtonEl =\n",
       "        document.querySelector('#df-82498195-772a-4b5f-813a-b83efbf5c4b3 button');\n",
       "      quickchartButtonEl.style.display =\n",
       "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "    })();\n",
       "  </script>\n",
       "</div>\n",
       "    </div>\n",
       "  </div>\n"
      ],
      "text/plain": [
       "               scene_context  \\\n",
       "0      The downstairs lobby.   \n",
       "1      The downstairs lobby.   \n",
       "2      The downstairs lobby.   \n",
       "3      The downstairs lobby.   \n",
       "4      The downstairs lobby.   \n",
       "...                      ...   \n",
       "47785     Sheldon’s office.    \n",
       "47786     Sheldon’s office.    \n",
       "47787     Sheldon’s office.    \n",
       "47788     Sheldon’s office.    \n",
       "47789            Princeton.    \n",
       "\n",
       "                                                    text  phrase_rank  \\\n",
       "0      See, the liquid metal Terminators were created...            1   \n",
       "1      Okay, then riddle me this. Assuming all the go...            2   \n",
       "2                        Skynet is kinky? I don’t know.             3   \n",
       "3      Artificial intelligences do not have teen feti...            4   \n",
       "4                   Alright, oh wait, they use it to in…            5   \n",
       "...                                                  ...          ...   \n",
       "47785  Mmm. No big deal, I enjoy spending time with you.          229   \n",
       "47786  And I with you. Question, are you seeking a ro...          230   \n",
       "47787                                    What if I were?          231   \n",
       "47788  Well, that would raise a number of problems. W...          232   \n",
       "47789  (Knock, knock, knock) Amy. (Knock, knock, knoc...          234   \n",
       "\n",
       "                                             text_5_prev  \n",
       "0                                                         \n",
       "1          See, the liquid metal Terminators were cre...  \n",
       "2         See, the liquid metal Terminators were crea...  \n",
       "3        See, the liquid metal Terminators were creat...  \n",
       "4       See, the liquid metal Terminators were create...  \n",
       "...                                                  ...  \n",
       "47785   Hey, did you eat yet? Uh, breakfast yes, lunc...  \n",
       "47786  Hey, did you eat yet? Uh, breakfast yes, lunch...  \n",
       "47787  Uh, breakfast yes, lunch no. I did have a coug...  \n",
       "47788  Well, perfect. I made us sandwiches. How thoug...  \n",
       "47789                                                     \n",
       "\n",
       "[47790 rows x 4 columns]"
      ]
     },
     "execution_count": 57,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['text_5_prev'] = df.groupby('scene_context')['text'].apply(lambda s: s.shift(5, fill_value='') +' ' + s.shift(4, fill_value='')+' '+s.shift(3, fill_value='') +' ' + s.shift(2, fill_value='')+' ' + s.shift(1, fill_value=''))\n",
    "df[['scene_context','text','phrase_rank', 'text_5_prev']]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 7,
     "status": "ok",
     "timestamp": 1707238666084,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "LtOlp_ckHtg7",
    "outputId": "2c8e1275-00c0-4b34-e30d-b0ea71c5da03"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['Sheldon', 'Leonard', 'Penny', 'Howard', 'Raj', 'Amy', 'Bernadette']\n"
     ]
    }
   ],
   "source": [
    "# посмотрим на наиболее частые сочетания персонажей в последовательности из пяти диалогов и из двух диалогов\n",
    "# для этого сначала заменим малозначимых персонажей на other\n",
    "stemp = df['person'].value_counts(normalize = True, ascending=False).cumsum()\n",
    "main_char_list = list(stemp[stemp<0.9].index) # выделим в списко главных героев тех, кто в сумме дает более 90% реплик (по числу, не по длительности)\n",
    "print(main_char_list)\n",
    "df['person'] = df['person'].apply(lambda x: x if x in main_char_list else 'other')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 9,
     "status": "ok",
     "timestamp": 1707238732803,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "3njZGcGSWwI_",
    "outputId": "fbf6fa13-7857-45f1-bc9c-31972043c9c5"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Sheldon       0.222871\n",
       "Leonard       0.181816\n",
       "Penny         0.147688\n",
       "Howard        0.115087\n",
       "other         0.114522\n",
       "Raj           0.091756\n",
       "Amy           0.071145\n",
       "Bernadette    0.055116\n",
       "Name: person, dtype: float64"
      ]
     },
     "execution_count": 66,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['person'].value_counts(normalize = True, ascending=False)\n",
    "# видим, что некотые главны персонажи уступили группе второстепенных персонажей. Что ж, этих персонажей мы не будем выбирать в качестве персонажа нашего бота."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 1327,
     "status": "ok",
     "timestamp": 1707241952069,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "hkCvfdvLXILK",
    "outputId": "72a06fd3-38b5-4257-fcec-33bd5f7e4232"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "<ipython-input-81-7a0b78bbeba8>:1: FutureWarning: Not prepending group keys to the result index of transform-like apply. In the future, the group keys will be included in the index, regardless of whether the applied function returns a like-indexed object.\n",
      "To preserve the previous behavior, use\n",
      "\n",
      "\t>>> .groupby(..., group_keys=False)\n",
      "\n",
      "To adopt the future behavior and silence this warning, use \n",
      "\n",
      "\t>>> .groupby(..., group_keys=True)\n",
      "  df['person_5_prev'] = df.groupby('scene_context')['person'].apply(lambda s: s.shift(5, fill_value='') +' ' + s.shift(4, fill_value='')+' '+s.shift(3, fill_value='') +' ' + s.shift(2, fill_value='')+' ' + s.shift(1, fill_value=''))\n",
      "<ipython-input-81-7a0b78bbeba8>:2: FutureWarning: Not prepending group keys to the result index of transform-like apply. In the future, the group keys will be included in the index, regardless of whether the applied function returns a like-indexed object.\n",
      "To preserve the previous behavior, use\n",
      "\n",
      "\t>>> .groupby(..., group_keys=False)\n",
      "\n",
      "To adopt the future behavior and silence this warning, use \n",
      "\n",
      "\t>>> .groupby(..., group_keys=True)\n",
      "  df['person_2_prev'] = df.groupby('scene_context')['person'].apply(lambda s: s.shift(2, fill_value='')+' ' + s.shift(1, fill_value=''))\n"
     ]
    }
   ],
   "source": [
    "df['person_5_prev'] = df.groupby('scene_context')['person'].apply(lambda s: s.shift(5, fill_value='') +' ' + s.shift(4, fill_value='')+' '+s.shift(3, fill_value='') +' ' + s.shift(2, fill_value='')+' ' + s.shift(1, fill_value=''))\n",
    "df['person_2_prev'] = df.groupby('scene_context')['person'].apply(lambda s: s.shift(2, fill_value='')+' ' + s.shift(1, fill_value=''))\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 1000
    },
    "executionInfo": {
     "elapsed": 281,
     "status": "ok",
     "timestamp": 1707241999031,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "Dh-BUDp1YIil",
    "outputId": "1e22bd17-bdea-44bd-c940-a98df3984089"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      " +++++ Leonard +++++\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "Penny Leonard Penny Leonard Penny          1135\n",
       "Sheldon Leonard Sheldon Leonard Sheldon    1084\n",
       "other Leonard other Leonard other           279\n",
       "                                            166\n",
       "Howard Leonard Howard Leonard Howard        105\n",
       "Name: person_5_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "Leonard Sheldon    1960\n",
       "Leonard Penny      1818\n",
       "Leonard other       573\n",
       "Leonard Howard      430\n",
       "Sheldon Penny       311\n",
       "Name: person_2_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      " +++++ Sheldon +++++\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "Leonard Sheldon Leonard Sheldon Leonard    1107\n",
       "Penny Sheldon Penny Sheldon Penny          1015\n",
       "Amy Sheldon Amy Sheldon Amy                 878\n",
       "other Sheldon other Sheldon other           433\n",
       "                                            223\n",
       "Name: person_5_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "Sheldon Leonard    2301\n",
       "Sheldon Penny      1641\n",
       "Sheldon Amy        1401\n",
       "Sheldon other       936\n",
       "Sheldon Howard      539\n",
       "Name: person_2_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      " +++++ Penny +++++\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "Leonard Penny Leonard Penny Leonard    1099\n",
       "Sheldon Penny Sheldon Penny Sheldon    1004\n",
       "other Penny other Penny other           174\n",
       "Amy Penny Amy Penny Amy                 127\n",
       "                                        107\n",
       "Name: person_5_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "Penny Leonard      1878\n",
       "Penny Sheldon      1539\n",
       "Penny Amy           369\n",
       "Penny other         363\n",
       "Leonard Sheldon     332\n",
       "Name: person_2_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      " +++++ other +++++\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "Sheldon other Sheldon other Sheldon    426\n",
       "Leonard other Leonard other Leonard    286\n",
       "Raj other Raj other Raj                227\n",
       "other other other other other          176\n",
       "Penny other Penny other Penny          169\n",
       "Name: person_5_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "other Sheldon    894\n",
       "other Leonard    637\n",
       "other Raj        457\n",
       "other Howard     416\n",
       "other other      403\n",
       "Name: person_2_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      " +++++ Howard +++++\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "Bernadette Howard Bernadette Howard Bernadette    484\n",
       "Raj Howard Raj Howard Raj                         334\n",
       "other Howard other Howard other                   178\n",
       "Sheldon Howard Sheldon Howard Sheldon             134\n",
       "                                                  114\n",
       "Name: person_5_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "Howard Bernadette    854\n",
       "Howard Raj           765\n",
       "Howard Leonard       426\n",
       "Howard other         403\n",
       "Howard Sheldon       389\n",
       "Name: person_2_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      " +++++ Raj +++++\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "Howard Raj Howard Raj Howard       349\n",
       "other Raj other Raj other          223\n",
       "Sheldon Raj Sheldon Raj Sheldon    178\n",
       "                                    96\n",
       "Leonard Raj Leonard Raj Leonard     70\n",
       "Name: person_5_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "Raj Howard        808\n",
       "Raj other         476\n",
       "Raj Sheldon       406\n",
       "Raj Leonard       308\n",
       "Leonard Howard    205\n",
       "Name: person_2_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      " +++++ Bernadette +++++\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "Howard Bernadette Howard Bernadette Howard       465\n",
       "Penny Bernadette Penny Bernadette Penny           57\n",
       "Amy Bernadette Amy Bernadette Amy                 53\n",
       "Raj Bernadette Raj Bernadette Raj                 40\n",
       "Sheldon Bernadette Sheldon Bernadette Sheldon     36\n",
       "Name: person_5_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "Bernadette Howard    777\n",
       "Bernadette Penny     208\n",
       "Bernadette Amy       151\n",
       "Amy Penny            120\n",
       "Penny Amy            118\n",
       "Name: person_2_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      " +++++ Amy +++++\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "Sheldon Amy Sheldon Amy Sheldon             854\n",
       "Penny Amy Penny Amy Penny                   135\n",
       "Bernadette Amy Bernadette Amy Bernadette     56\n",
       "Leonard Amy Leonard Amy Leonard              51\n",
       "                                             49\n",
       "Name: person_5_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "Amy Sheldon         1256\n",
       "Amy Penny            361\n",
       "Amy Bernadette       173\n",
       "Bernadette Penny     135\n",
       "Amy other            111\n",
       "Name: person_2_prev, dtype: int64"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "for person in df['person'].unique():\n",
    "  print('\\n','+++++',person,'+++++')\n",
    "  display(df[df['person']==person]['person_5_prev'].value_counts().head(5))\n",
    "  display(df[df['person']==person]['person_2_prev'].value_counts().head(5))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "1rBtfO4viIzM"
   },
   "outputs": [],
   "source": [
    "# Настало время выбрать персонажа.\n",
    "# Исследовав сочетания персонажей в 2-диалогах и 5-диалогах мы видим, что Шелдон, Пенни и Леонард часто общаются между и собой обмениваясь по нескольку фраз.\n",
    "# Так как кто-то наверняка выберет Шелдона, я выберу Леонрада, чтобы мы могли заставить общаться двух ботов.\n",
    "# Пенни скорее антагонист Шелдона, а Леонард - его друг. Поэтому я не выбрал Пенни."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "gj45ZyHAlLKa"
   },
   "outputs": [],
   "source": [
    "# мы уже обогатили каждую строку текстом из последних 5ти фраз в рамках сцены, но я подумал, что правильнее хранить эти пять фраз не одним текстом, а в пяти разных полях,\n",
    "# тогда их можно будет суммироать с весами (предпослденяя фраза имеет больше веса, чем последняя и т.п.)\n",
    "for i in range(1,6):\n",
    "  curr_col = f\"text_{i}_shift\"\n",
    "  df[curr_col ] = df.groupby('scene_context')['text'].apply(lambda s: s.shift(i, fill_value=''))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 324,
     "status": "ok",
     "timestamp": 1707242736287,
     "user": {
      "displayName": "Alexander Levakin",
      "userId": "07972543892245848257"
     },
     "user_tz": -180
    },
    "id": "TtE64muEmK78",
    "outputId": "b32b1f26-c31c-4d9a-fc3e-7e235c59c1b8"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 47790 entries, 0 to 47789\n",
      "Data columns (total 17 columns):\n",
      " #   Column          Non-Null Count  Dtype \n",
      "---  ------          --------------  ----- \n",
      " 0   series_num      47790 non-null  int64 \n",
      " 1   ep_num          47790 non-null  int64 \n",
      " 2   ep_name         47790 non-null  object\n",
      " 3   phrase_rank     47790 non-null  int64 \n",
      " 4   person          47790 non-null  object\n",
      " 5   text            47786 non-null  object\n",
      " 6   person_orig     47790 non-null  object\n",
      " 7   person_context  1114 non-null   object\n",
      " 8   scene_context   47790 non-null  object\n",
      " 9   text_5_prev     47770 non-null  object\n",
      " 10  person_5_prev   47790 non-null  object\n",
      " 11  person_2_prev   47790 non-null  object\n",
      " 12  text_1_shift    47786 non-null  object\n",
      " 13  text_2_shift    47786 non-null  object\n",
      " 14  text_3_shift    47786 non-null  object\n",
      " 15  text_4_shift    47786 non-null  object\n",
      " 16  text_5_shift    47786 non-null  object\n",
      "dtypes: int64(3), object(14)\n",
      "memory usage: 6.2+ MB\n"
     ]
    }
   ],
   "source": [
    "df.info()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "nu88-cn68xm7"
   },
   "outputs": [],
   "source": [
    "# на этом подготовка сырых данных закончена, остальные преобразования сделаем по мере написания кода обучений.\n",
    "# Сохраняем обогащенный фрейм в файл:\n",
    "df.to_excel('/content/drive/MyDrive/Colab Notebooks/edu/nlp2/hw1/data/eng_script_enriched_2.xlsx', header=True, index=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "aCg8tRoI8NLQ"
   },
   "source": [
    "### Результаты"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "G40QmxUW5DVQ"
   },
   "source": [
    "**Описание финального датасета:**\n",
    "\n",
    "*    0   series_num        - номер сезона\n",
    "*    1   ep_num            - номер серии\n",
    "*    2   ep_name           - навзание эпизода\n",
    "*    3   phrase_rank       - номер фразы в эпизоде\n",
    "*    4   person            - говорящий (имя персонажа)\n",
    "*    5   text              - что он сказал (answer)\n",
    "*    6   person_orig       - говорящий+эмоция (имя персонажа и как именно он сказал фразу)\n",
    "*    7   person_context    - отдельно эмоция говорящего (не совсем удачное название поля, это не контекст)\n",
    "*    8   scene_context     - описание сцены в которой была сказана фраза\n",
    "*    9   text_5_prev       - текст предыдущих пяти фраз от 5й к 1й, сказанных в рамках сцены, конкатенирован через пробел\n",
    "*    10  person_5_prev     - имена персонажей предыдущих пяти фраз от 5го к 1му, говоривших в рамках сцены, конкатенированы через пробел\n",
    "*    11  person_2_prev     - имена персонажей предыдущих двух фраз от 5го к 1му, говоривших в рамках сцены, конкатенированы через пробел\n",
    "*    12  text_1_shift      - предыдущая фраза (question)\n",
    "*    13  text_2_shift      - пред-предыдущая фраза (контекст)\n",
    "*    14  text_3_shift      - -3 фраза (контекст)\n",
    "*    15  text_4_shift      - -4 фраза (контекст)\n",
    "*    16  text_5_shift      - -5 фраза (контекст)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "shG17T6FvifO"
   },
   "source": [
    "**Итак, на этапе подготовки данных мы сделали:**\n",
    "\n",
    "*   собрали датасет из которого удобно извлечь набор данных (конктекст (сообщения, отстающие на 4..2 от текущего), вопрос(сообщение, отстающее на 1 от текущего), ответ (текущее сообщеине))\n",
    "*   выбрали персонажа бота Леонарна\n",
    "*   почитали сообщества фанатов сериала и выяснили, что наиболее яркая противоположность Леонарду - Шедлдон. В Википедии персонаж Леонарда отнесен к тпу персонажей straight man - общему явлению в сериалах, когда два главных героя работать в паре и одни из них эксцентричный и странный (Шелдон), а другой нормальный (Леонард). Диалоги Шелдона могут быть использованы для сбора датасета \"неправльныйх ответов\".\n",
    "*   на будущее подметили, что было бы интересно посмотреть на взаимодействие нашего бота-персонажа с другим ботом-Шелдоном\n",
    "\n",
    "\n",
    "**Мы не сделали:**\n",
    "\n",
    "\n",
    "*   не перевели тексты на русский язык (гугл транслейт не справляется, а DeepL сложно оплатить из России.\n",
    "*   не сделали тексты lowercase на всякий случай, но помним об этом\n",
    "\n",
    "\n",
    "\n",
    "\n",
    "\n",
    "**Сразу же обратим внимание на потенциальную проблему:**\n",
    "* ранее мы выяснили, что Ш и Л максимально активно общаются друг с другом и на базе этих диалгов мы построили конктекст. То есть в контексте будут намешаны текст\n",
    "* далее, мы выяснили, что Л и Ш являются контр-персонажами по образу мысли, на этом противопоставлении строится сериал\n",
    "\n",
    "Следовательно, в конктексте будут намешаны тексты персонажа и контр-персонажа. Кажется это проблема, но я не уверен... Может наоборот это гарантирует некую нейтральнсоть контекста или в целом это не имеет плюсов или минусов."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "zl4V-q-CmAvt"
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "colab": {
   "authorship_tag": "ABX9TyPCqtHKBvkOtUYfsV0B1K3L",
   "collapsed_sections": [
    "PpFxu5H9gOYE",
    "0NhziT4jgX6N",
    "WLaAL-EUDuGx",
    "aCg8tRoI8NLQ"
   ],
   "mount_file_id": "1waUqkecL7l6nyojH493EsgPVBDO3bIAA",
   "provenance": []
  },
  "kernelspec": {
   "display_name": "Python 3 (Spyder)",
   "language": "python3",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.11.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}